CN101727544A - Examination processing system and method thereof - Google Patents

Examination processing system and method thereof Download PDF

Info

Publication number
CN101727544A
CN101727544A CN201010000447A CN201010000447A CN101727544A CN 101727544 A CN101727544 A CN 101727544A CN 201010000447 A CN201010000447 A CN 201010000447A CN 201010000447 A CN201010000447 A CN 201010000447A CN 101727544 A CN101727544 A CN 101727544A
Authority
CN
China
Prior art keywords
answer
examination
examinee
paper
volume
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201010000447A
Other languages
Chinese (zh)
Inventor
肖国亮
任力文
谭勇军
曹佳
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Examination Center Of Professional & Technical Cadres Pla
Original Assignee
Examination Center Of Professional & Technical Cadres Pla
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Examination Center Of Professional & Technical Cadres Pla filed Critical Examination Center Of Professional & Technical Cadres Pla
Priority to CN201010000447A priority Critical patent/CN101727544A/en
Publication of CN101727544A publication Critical patent/CN101727544A/en
Pending legal-status Critical Current

Links

Images

Abstract

The invention discloses examination processing system and method thereof. The system comprises a standard answer storage device, an answer obtaining device, a doubted answer sheet confirming device, an examination room video storage device and examination room video acquiring devices, wherein the standard answer storage device is used for storing original examination papers, and changing identification codes and corresponding standard answers of the examination papers; the answer obtaining device is used for obtaining identification codes and answers of the examination papers, examination rooms and seat information of examinees; the doubted answer sheet confirming device is used for computing the doubt degree among answer sheets of the examinees according to answers of the examinees and the standard answers, and then confirming the doubted answer sheets according to the doubt degree of the answer sheets by combined with the information of the examination rooms and the seats; the examination room video storage device is used for storing video surveillance data of each examination room; and the examination room video acquiring device is distributed in each examination room for acquiring the video surveillance data of each examination room and transmitting the data to the examination video storage device to be stored. The examination processing system and method can prevent cheating on examinations, especially copying by changing examination papers, thereby reducing the pressure of invigilation; and the doubted examination papers are confirmed by analyzing examination papers, and objective reference is provided for objectively evaluating the exam-discipline of each examination centre and each examination room by combining the video surveillance data.

Description

A kind of examination processing system and method
Technical field
The present invention relates to the exam information technical field, relate in particular to a kind of examination processing system and method.
Background technology
Along with establishment of socialist market economy, disposing the social assessment system reform that society turns to substance with resources of human talents, talent evaluation and the talent deepens continuously, examination more and more becomes a kind of important social assessment mode, become the key behavior that realizes fair social competition mechanism under the market competition environment, embodies individual competitiveness, creation personal-machine meeting and future, individual and society are being produced the influence that becomes more and more important.Especially along with the foundation and the enforcement of qualifications of professional technique and duty (holding) industry qualification system, get through the examinations and obtain qualifications of professional technique or practicing requirements, become the important means that entire society estimates professional technique talent ability and level accurately, objectively.The task of work about test is more and more heavier, and scale is increasing, requires more and more higher.Simultaneously also because its policy is strong, influence widely, relate to numerous professional and technical personnel's vital interests, be related to the construction and the development of employing unit, and receive much attention.
Just because of the importance of examination to personal-machine meeting and future destiny, the means that cheat at one's exam of carrying out to obtain favourable total marks of the examination also present variation, modernization, and the fraudulent means disguise is also stronger.In recent years, because cheat at one's exam, the examination hall practice-discipline is not tight, is investigated and prosecuted or of common occurrence by the incident that is exposed by the media.The people is in minority though cheat at one's exam, and is very harmful, and it had both run counter to the examination principle of " justice, equality, competition, according to qualifications ", and the public credibility of examination and authority are had a greatly reduced quality, even lost it and effect should be arranged and be worth.
Plagiarism is modal means in cheating at one's exam, and can be divided into premediation before examination usually and plagiarize and plagiarize two kinds when participating in the cintest.Premediation is before examination plagiarized and be meant that the examinee planned beforehand in advance with other people, transmitted answer by certain illegal mode, thereby reached the purpose of plagiarism in the examination process before examination.Plagiarize when participating in the cintest and be meant examinee's not premediation in advance, examinee's answer around in the examination process, plagiarizing when participating in the cintest.At present, great majority examinations adopts " plum blossom volume " to plagiarize to prevent the examinee, though obtained certain effect, because its method of combination is simple and regular, examinee's location plagiarism of can planning beforehand before examination, pass the examination, not remarkable to preventing the effect that the examinee plagiarizes.
Except strick precaution cheats at one's exam and prevents that the examinee is because of plagiarism benefits, how on each link of examination, to set up the perfect examination processing system of a cover by technological means, conscientiously grasp the truth that discipline is examined in the examination hall, estimate examination result objective and accurately, examination result information is evaluated and tested effectively, also is that pendulum is in the vast previous severe problem of the author's face of working of examining.
Summary of the invention
The technical matters that the present invention will solve provides a kind of examination processing system and method, can increase the difficulty that cheats at one's exam, the discipline situation of examining in objective acquisition examination hall.
The invention provides a kind of examination processing system, comprising:
Standard volume memory storage, the identification code that is used to store original volume and changes volume, the examination question numbering of original volume, the stem of examination question, option;
The model answer memory storage, the identification code that is used to store original volume and changes volume, and corresponding model answer;
Examinee's answer deriving means is used to obtain identification code, answer and the examinee's of examinee's paper examination hall, seat information;
Doubting test paper is determined to be used for device according to the answer of examinee's paper and the model answer of examinee's paper, calculates the degree of doubting between examinee's test paper, according to the degree of doubting between examinee's test paper, in conjunction with examinee's examination hall, the seat information test paper of determining to doubt;
Examination room video storage device is used to store the video surveillance data in each examination hall;
The examination hall video capture device is distributed in each examination hall, is used to obtain the video surveillance data in each examination hall, sends to described examination video storage device by network and stores.
An embodiment according to examination processing system of the present invention, this examination processing system also comprises: conversion volume generating apparatus, be used for the examination question order of described original volume and/or the order of examination question option are carried out conversion, generate the conversion volume, and obtain the answer and the identification code of described conversion volume; Identification code, examination question numbering, the stem of examination question, the option of described conversion volume sent to described standard to be rolled up memory storage and stores; The identification code of described conversion volume and corresponding answer are sent to described model answer memory storage stores; The paper output device is used to export described original volume and conversion volume and identification code thereof; The visualization device of doubting is used to generate examination hall doubt a test paper seat order relation figure and/or the various test paper statistical forms of doubting of visualization display.
The present invention also provides a kind of examination disposal route, comprising:
Generate the answer and the identification code of multiple conversion volume and conversion volume according to original volume;
According to examinee examination hall, seat information distribution conversion volume, make that adjacent examinee's paper is inequality;
Obtain the video surveillance data in each examination hall in real time, store described video surveillance data;
Obtain identification code, answer and the examinee's of examinee's paper examination hall, seat information;
According to the answer of examinee's paper and the model answer of examinee's paper, calculate the degree of doubting between examinee's test paper, according to the degree of doubting between examinee's test paper, in conjunction with examinee's examination hall, the seat information test paper of determining to doubt;
According to described video surveillance data determine to doubt act of plagiarism between the test paper.
According to an embodiment of examination disposal route of the present invention, above-mentionedly generate the multiple conversion volume and the answer of conversion volume and the step of identification code according to original volume and comprise:
With original volume and the automatic import system of model answer, split into stem, option and model answer;
Generate the preface of topic at random of conversion volume;
Generate the correct option option of conversion volume;
After determining the correct option option, generate each examination question distracter order of conversion volume.
According to an embodiment of examination disposal route of the present invention, above-mentioned answer and the model answer of the examinee's paper step of calculating the degree of doubting between examinee's test paper according to examinee's paper comprises:
According to the answer of examinee's paper and the definite critical value of model answer of examinee's paper with the answer rate;
According to the answer of examinee's paper and the definite critical value of model answer of examinee's paper with the wrong answer rate;
Judge the test paper of doubting according to the answer of examinee's paper and with the answer rate with the critical value of wrong answer rate.
Examination processing system of the present invention and method effectively prevent by the paper converter technique and to cheat at one's exam, and particularly examination is plagiarized, and has alleviated the pressure of invigilator's work; By test paper that the analysis of examination paper is determined to doubt, the discipline situation of examining in objective acquisition examination hall, and provide objective reference frame for the discipline situation of examining in each examination point of objective evaluation, examination hall in conjunction with the video surveillance data.
Description of drawings
Fig. 1 illustrates the system schematic of an embodiment of examination processing system of the present invention;
Fig. 2 illustrates the process flow diagram of an embodiment of the test paper of determining in the examination disposal route of the present invention to doubt;
Fig. 3 illustrates the system schematic of another embodiment of examination processing system of the present invention;
Fig. 4 illustrates the process flow diagram of an embodiment who generates the conversion volume in the examination disposal route of the present invention;
Fig. 5 illustrates the process flow diagram of an embodiment of examination disposal route of the present invention.
Embodiment
With reference to the accompanying drawings the present invention is described more fully, exemplary embodiment of the present invention wherein is described.In the accompanying drawings, identical label is represented identical or similar assembly or element.
Fig. 1 illustrates the system schematic of an embodiment of examination processing system of the present invention.As shown in Figure 1, the examination processing system of this embodiment comprises standard volume memory storage 11, model answer memory storage 12, examinee's answer deriving means 13 that is positioned at examination processing enter platform 1 and the definite device 14 of the test paper of doubting.Wherein, standard volume memory storage 11 is used to store the identification code of original volume and conversion volume, information such as the examination question numbering of original volume, the stem of examination question, option.Standard volume memory storage 11 also can be stored information such as the examination question of conversion volume is numbered, the stem of examination question, option.Model answer memory storage 12 is used to store the identification code of original volume and conversion volume, and corresponding model answer.Examinee's answer deriving means 13 is used to obtain identification code, answer and the examinee's of examinee's paper examination hall, seat information.For example, examination processing system also comprises barcode scanner, read bar code information on examinee's answer sheet by barcode scanner, obtain the identification code of examinee's paper, and the information that obtains is sent to examination processing enter platform wirelessly according to bar code information; By scanning device the scanning of examinee's answer sheet is digital picture, by digital picture being handled the answer that obtains the examinee; Examinee's examination hall, seat information can be presetted, and perhaps read from files such as admission cards for entrance examination.Identification code, answer and the examinee's of examinee's paper of obtaining examination hall, seat information etc. are stored in the database.Doubting test paper determines that device 14 is used for according to the answer of examinee's paper and the model answer of examinee's paper, calculates the degree of doubting between examinee's test paper, according to the degree of doubting between examinee's test paper, in conjunction with examinee's examination hall, the seat information test paper of determining to doubt.To how calculate degree of doubting between the examinee test paper by a detailed introduction of example after a while.For example, doubting test paper determines that device 14 determines to judge the test paper of doubting with the critical value of answer rate with the critical value of wrong answer rate according to the answer of examinee's paper and with the answer rate with the critical value of wrong answer rate according to the model answer of the answer of examinee's paper and examinee's paper.
According to an embodiment of examination processing system of the present invention, this system also comprises examination room video storage device 15 and examination hall video capture device 16.Wherein examination hall video capture device 16 is distributed in each examination hall, is used to obtain the video surveillance data in each examination hall.Examination room video storage device 15 is used to store the video surveillance data that the examination hall video capture device in each examination hall obtains.Examination hall video capture device 16 for example is mounted in each ground, examination hall video camera, by wired or wireless communication modes the video data of producing is sent to examination room video storage device 15.
This embodiment can monitor the examination situation in each examination hall in real time by producing and preserve the video surveillance data in each examination hall; After the test paper of doubting determines that device 14 determines that doubting between the examinee answered the questions in a test paper, calling the video surveillance data in corresponding examination hall comes further affirmation whether to have the generation of the situation of cheating at one's exam, can select targetedly to check ground video surveillance data, avoid checking one by one the huge workload and the cost of video surveillance data, and provide objective strong evidence for processing subsequently.
According to an embodiment of examination processing system of the present invention, this system also comprises the visualization device 17 of doubting, and is used to generate the examination hall test paper seat order relation figure that doubts, and graphically shows each examination hall the doubt position and the relation of doubting mutually of test paper intuitively.For example, represent the seat, with the line segment relation of representing to doubt, with the value representation of the color of line segment or the line segment degree of doubting with point.The visualization device 17 of doubting can also be used for the various test paper statistical forms of doubting of visualization display.For example, generate the examination point test paper scale map of doubting, performance is a unit with the examination point, adds up each examination point test paper of doubting and occupies the number percent of imitating test paper; Generate the examination point test paper contrast figure that doubts, performance is a unit with the examination point, adds up each examination point the doubt test paper and the effective quantity of test paper; Generate the examination hall test paper scale map of doubting, performance is a unit with the examination hall, adds up each examination hall test paper of doubting and occupies the number percent of imitating test paper; Generate the examination hall test paper contrast figure that doubts, performance is a unit with the examination hall, adds up each examination hall the doubt test paper and the effective quantity of test paper.By the visualization device of doubting, can understand and grasp the discipline state of examining in each examination hall intuitively, be convenient to decision-making and processing.
It may be noted that standard volume memory storage, model answer memory storage and the definite device of the test paper of doubting can be respectively separate equipment or server, also can be positioned on the same server.
According to one embodiment of present invention, examinee's answer deriving means comprises answer sheet scanning device, answer information extraction unit and examinee's answer storage unit.Wherein the answer sheet scanning device is used to scan examinee's answer sheet, is converted into digital picture, then the answer sheet digital picture that obtains is sent to computing equipment.Comprise the answer information extraction unit in the computing equipment, be used for the answer sheet digital picture is carried out Flame Image Process, extract wherein examinee information, paper information and examinee's answer, and the relevant information that obtains is sent to examinee's answer storage unit store.
How to introduce below according to the model answer of the answer of examinee's paper and examinee's paper and calculate degree of doubting between examinee's test paper.
The present invention is according to the relevant knowledge of information theory, mathematical statistics, in conjunction with education test and appraisal relative theory, the information rate of having constructed the degree of association (plagiarism degree) between the reflection examinee objective item test paper function of doubting, set up the objective item test paper discrimination model of doubting, thereby provide quantitative test examination hall after examination to examine the technological means of discipline situation.
The present invention is directed to 3 kinds of situations handles respectively: (1) is with the plagiarism between the volume kind examinee (volume kind number is used for the mark conversion to be rolled up, and is equivalent to change the identification code of volume); (2) the not conversion between the different volume kind examinees is plagiarized, and promptly plagiarizes the full-filling information point; (3) conversion between the different volume kind examinees is plagiarized, and promptly plagiarizes option.3 kinds of corresponding 3 alanysis objects of situation, the analytic target of the 1st kind of situation is with the objective item answer between the volume kind examinee; The analytic target of situation is not conversion of the objective item answer between the different volume kind examinees in the 2nd; The analytic target of the 3rd kind of situation is the objective item conversion answer between the different volume kind examinees.
In concrete application process, can be respectively handle according to a kind of, any two kinds or three kinds in the situation in above-mentioned 3.
Judge whether two parts of test papers exist the plagiarism phenomenon, main foundation is that objective item is with the answer rate with the wrong answer rate, for analytic target 1 and 3, can be according to objective item with the answer rate with the wrong answer rate, (, need change back original volume to the objective item answer of conversion volume) for situation 3.For analytic target 2, can only be according to objective item with the answer rate.Therefore, in the following description, analytic target 1,3 is classified as one type analyzes.
Determine reasonably to judge that the objective item that exceeds normal category between the examinee is with answer rate and as follows with the method for the critical value of wrong answer rate:
At first introduce the definition of mutual information and weighting mutual information.
Definition 1: mutual information
If X, Y are two stochastic variables, the mutual information between stochastic variable X and the Y is defined as:
I ( X ; Y ) = Σ x , y p ( x , y ) log Q ( y | x ) q ( y ) - - - ( 1 )
Wherein, Q (y|x) expression stochastic variable Y is to the transition probability of X, and q (y) represents the probability distribution of stochastic variable Y, p (x, y) joint probability distribution of expression stochastic variable X, Y.
Mutual information I (X; Y) what of the quantity of information from X, obtained of expression Y.Consider other factors, introduce the notion of weighting mutual information.
Definition 2: weighting mutual information I *(X; Y)
Weighting mutual information between stochastic variable X and the Y is defined as:
I * ( X ; Y ) = Σ x , y ω ( x , y ) p ( x , y ) log Q ( y | x ) q ( y ) - - - ( 2 )
Wherein, and ω (x, y) 〉=the 0th, incident { X=x, the effectiveness weight coefficient of Y=y}.
Weighting mutual information I *(X; Y) another kind of statement:
I * ( X ; Y ) = Σ x , y ω ( x , y ) p ( x , y ) log Q ( y | x ) q ( y )
= Σ x , y ω ( x , y ) Q ( y | x ) p ( x ) log Q ( y | x ) Σ x ′ Q ( y | x ′ ) p ( x ′ )
= I * ( P , Q ) - - - ( 3 )
Wherein, P represents the probability distribution p (x) of information source, and Q represents transition probability p (y|x).
According to the definition of weighting mutual information, can release conclusion 1: weighting mutual information I *(X; Y) be following convex function, I about transition probability Q *(X; Y) be continuous function about transition probability Q.
Secondly, introduce the function of doubting, on average degree of doubting and the information rate definition of function of doubting:
Definition 3: the function d of doubting (x, y)
A nonnegative real number d on title A * C (x, y), x ∈ A, y ∈ C is the function of doubting, it represents the dubiety between x ∈ A and the y ∈ C.
Definition 4: average degree of doubting d
If X, Y are stochastic variable, the then on average definition of degree of doubting d:
d ‾ = E ( d ( X , Y ) )
= Σ x , y d ( x , y ) p ( x ) Q ( y | x ) - - - ( 4 )
By conclusion 1 as can be known, under the given condition of information source, weighting mutual information I *(X; Y) be the following convex function of transition probability.Therefore,, can find a certain transition probability, make weighting mutual information I satisfying under the condition of d 〉=d *(X; Y) reach minimum value.For this reason, introduce the doubt definition of function of information rate.
Definition 5: the information rate function R (d) of doubting
The doubt definition of function R (d) of information rate:
R ( d ) = min Q ( y | x ) ∈ P d I * ( X ; Y ) - - - ( 5 )
Wherein P d = { Q ( y | x ) : d ‾ = E ( d ( X , Y ) ) = Σ x , y d ( x , y ) p ( x ) Q ( y | x ) ≥ d } , D is the given limit of on average doubting.
According to the doubt definition of function of information rate, can release conclusion 2: the information rate function R (d) of doubting is dull increasing function.
Further release conclusion 3: the information rate function R (d) of doubting is a convex function down, thereby is continuous function.
According to the definition of above-mentioned introducing, the basic model of doubting of the present invention is proposed.
If stochastic variable X, Y represent two examinee's objective item answers respectively, when answer was A, the stochastic variable value was 0; When answer was B, the stochastic variable value was 1; When answer was C, the stochastic variable value was 2; When answer was D, the stochastic variable value was 3.The identical answer quantity of examinee has reflected and has plagiarized relevant information, therefore got the effectiveness weight coefficient:
Figure G2010100004470D00085
Weighting mutual information then:
I * ( X ; Y ) = Σ x p ( x , x ) log Q ( x | x ) q ( x ) - - - ( 7 )
Reflected plagiarism degree between the examinee.
Because whether the suspection of plagiarizing between the examinee is come from their answer identical, therefore get the function of doubting:
Figure G2010100004470D00091
Then on average degree of doubting is:
d ‾ = Σ x , y d ( x , y ) p ( x ) Q ( y | x ) = Σ x p ( x ) Q ( x | x ) = Σ x p ( x , x ) - - - ( 9 )
In fact,
Figure G2010100004470D00093
It is exactly probability expression with the answer rate.
By the weighting mutual information of preceding surface construction and the function of doubting, can obtain the information rate function of doubting:
R ( d ) = min Q ( x | x ) ∈ P d Σ x p ( x , x ) log Q ( x | x ) q ( x ) - - - ( 10 )
Wherein P d = { Q ( x | x ) : d ‾ = Σ x p ( x , x ) ≥ d } , D is the given limit of on average doubting.
Above-mentioned information rate is doubted the visual interpretation of function R (d) on average doubting during limit d more than or equal to given with the answer rate between the examinee, plagiarizes the lower bound of degree between the examinee.
Conclusion 4: when 0≤d≤2/3, the information rate of the above-mentioned structure function R (d) of doubting is equivalent to:
Figure G2010100004470D00096
Conclusion 4 can be interpreted as: when with the answer probability smaller or equal to p (0) 2+ p (1) 2+ p (2) 2+ p (3) 2The time, promptly there is not the plagiarism phenomenon in the degree of plagiarizing between the examinee smaller or equal to 0; Otherwise, when with the answer probability greater than p (0) 2+ p (1) 2+ p (2) 2+ p (3) 2The time, the degree of plagiarizing between the examinee promptly exists and plagiarizes phenomenon greater than 0.Therefore, will with the critical value setting of answer probability d *=p (0) 2+ p (1) 2+ p (2) 2+ p (3) 2
Judge whether exist between two examinees main foundation of plagiarizing phenomenon be two kinds with the answer rate, promptly objective item is with the answer rate with the wrong answer rate.Our purpose is to seek these two kinds of critical values with the answer rate, determines suspicious examinee in view of the above.Provide objective item below earlier with the answer rate with the mathematic(al) representation of wrong answer rate:
Definition 6: examinee i and examinee j objective item k topic are with answer fundamental function δ Ij (k)
If the answer of examinee i objective item k topic is a Ik, the answer of examinee j objective item k topic is a Jk, then examinee i and examinee j objective item k topic is with answer fundamental function δ Ij (k)Be defined as follows:
Figure G2010100004470D00101
Definition 7: examinee i and examinee j objective item are with answer rate v Ij
If the objective item answer string of examinee i is a I1a I2A In, the objective item answer string of examinee j is a J1a J2A Jn, the objective item sum of n for comparing between examinee i and the examinee j, then examinee i and examinee j objective item are with answer rate v IjBe defined as follows:
v ij = Σ k = 1 n δ ij ( k ) / n × 100 % - - - ( 13 )
Definition 8: examinee i and examinee j objective item k topic are with wrong answer fundamental function δ Ij * (k)
If the answer of examinee i objective item k topic is a Ik, the answer of examinee j objective item k topic is a Jk, then examinee i and examinee j objective item k topic is with wrong answer fundamental function δ Ij * (k)Be defined as follows:
Figure G2010100004470D00103
Define 9 examinee i and examinee j objective item with wrong answer rate u Ij
If the objective item answer string of examinee i is a I1a I2A In, the objective item answer string of examinee j is a J1a J2A Jn, the objective item sum of n for comparing between examinee i and the examinee j, then examinee i and examinee j objective item are defined as follows with wrong answer rate uij:
u ij = Σ k = 1 n δ ij * ( k ) / n × 100 % - - - ( 15 )
In the basic model of front, X represents examinee's objective item answer of doubting, when the objective item of doubting with the answer probability greater than p (0) 2+ p (1) 2+ p (2) 2+ p (3) 2The time, then be judged to be the test paper of doubting.In view of the above, can determine that above-mentioned objective item is with answer rate v IjAnd objective item is with wrong answer rate u IjCritical value.
Fig. 2 illustrates the process flow diagram of an embodiment of the test paper of determining in the examination disposal route of the present invention to doubt.
As shown in Figure 2, in step 202, determine the critical value of objective item with the answer rate.
At first, think that examinee's objective item is with answer rate v IjCan be divided into two parts: substantially with answer rate Ev (objective item is with the average of answer rate) with doubt with answer rate ε Ij, objective item is with answer rate v between the examinee IjCan be expressed as:
v ij=Ev+ε ij (16)
Objective item less than Ev does not belong to suspect object with the answer rate, and is on the contrary, just doubtful with the answer rate greater than the objective item of Ev.Therefore, get B 1={ answer is doubted } then utilizes the thought of frequency approaches probability, can get:
Figure G2010100004470D00111
Figure G2010100004470D00112
Figure G2010100004470D00113
Establish stochastic variable X, Y again and represent two examinee's objective item answers respectively, then the objective item probability expression of doubting with the answer rate is:
Figure G2010100004470D00114
Figure G2010100004470D00115
Figure G2010100004470D00116
Figure G2010100004470D00117
Here
Figure G2010100004470D00118
Just be exactly to doubt objective item with the answer probability, so objective item with the critical value of answer rate is:
v *=Ev+(p′ 1(0) 2+p′ 1(1) 2+p′ 1(2) 2+p′ 1(3) 2)P(B 1) (19)
In step 204, determine the critical value of objective item with the wrong answer rate.
Get B 2={ answer mistake } then utilized the thought of frequency approaches probability, can get:
p = Σ i = 1 n p i / n - - - ( 20 )
Wherein, n is the objective item sum;
Establish stochastic variable X, Y again and represent two examinee's objective item answers respectively, then the suspicious probability expression with the answer rate of objective item is:
Figure G2010100004470D001110
Figure G2010100004470D001111
Figure G2010100004470D001112
Figure G2010100004470D001113
Equally,
Figure G2010100004470D00121
Just be exactly to doubt objective item with the answer probability, so, determine the critical value of objective item with the wrong answer rate:
u *=(p′ 2(0) 2+p′ 2(1) 2+p′ 2(2) 2+p′ 2(3) 2)P(B 2) (22)
In step 206, according to judging the test paper of doubting with the answer rate with the critical value of wrong answer rate.
Determined that objective item with the answer rate with the critical value of wrong answer rate, judges the test paper of doubting below in view of the above.
For analytic target one, three, comprehensively objective item is judged with the answer rate with the dual critical value of wrong answer rate, i.e. same answer rate v between examinee's test paper IjWith with wrong answer rate u IjSatisfy v Ij〉=v *And u Ij〉=u *, then be judged to be the test paper of doubting, not to doubt test paper otherwise be judged to be.
For analytic target two, only judge with answer rate critical value, i.e. same answer rate v between examinee's test paper by objective item IjSatisfy v Ij〉=v *, then be considered as the test paper of doubting, otherwise not so.
The physical significance of degree of doubting model
At first, be that information source (examinee's first) is sent information in the communication system plagiarizing abstract between the examinee, after the process channel was disturbed, it was very directly perceived and feasible being received by the stay of two nights (examinee's second) then.Secondly, the weighting mutual information is represented the information relevant with plagiarism that examinee's second obtains from examinee's first place, and it has reflected the degree of plagiarizing between the examinee.Function representation is when on average doubting during limit the minimum degree of plagiarizing between the examinee with the answer rate more than or equal to given between the examinee and information rate is doubted.
Information rate is doubted function having connected with the minimum degree of plagiarizing between answer rate and the examinee between the examinee.Therefore,, just can determine when reaching what degree (promptly with answer rate critical value) with the answer rate between the examinee, just have between the examinee that plagiarize may by the analysis of function that information rate is doubted.
Fig. 3 illustrates the system schematic of another embodiment of examination processing system of the present invention.As shown in Figure 3, the examination processing system of this embodiment comprises standard volume memory storage 31, model answer memory storage 32, the examinee's answer deriving means 33 that is positioned at examination processing enter platform 3, the definite device 34 of the test paper of doubting, conversion volume generating apparatus 38 and paper output device 39.Wherein, standard volume memory storage 31, model answer memory storage 32, the examinee's answer deriving means 33 and the test paper of doubting determine that device 34 can for for purpose of brevity, be not described in detail at this referring to the description of corresponding intrument among Fig. 1.Conversion volume generating apparatus 38 is used for that the order of the examination question order of original volume and/or examination question option is carried out conversion and generates the conversion volume, and obtains the answer and the identification code of conversion volume.For example, conversion volume generating apparatus carries out conversion according to transformation matrix to the examination question order of original volume and/or the order of examination question option, generates the conversion volume; Obtain corresponding answer according to transformation matrix; Generate the identification code of conversion volume according to transformation matrix.Identification code, examination question numbering, the stem of examination question, the option standard that sends to that conversion volume generating apparatus 38 will change volume is rolled up memory storage 31 and is stored; The identification code of changing volume is sent to model answer memory storage 32 with corresponding answer to be stored.Paper output device 39 is used to export original volume and conversion volume and identification code thereof.For example, paper output device 39 is a papery paper printing device, prints the corresponding bar code of identification code with the conversion volume on the papery paper of output and the answer sheet thereof; Perhaps, paper output device 39 is the electronics display terminal.
Examination processing system of the present invention has the original volume import feature, can (for example word form) original volume and the automatic import system of model answer, and split into stem, option and model answer, be stored in respectively in standard volume memory storage 31 and the model answer memory storage 32.Conversion volume generating apparatus 38 is upset objective item exercise question and option automatically in proper order at random by rule, and produces the corresponding standard answer.Objective item exercise question and option after the conversion are recombinated, and export to for example word document automatically, generate conversion volume with standard volume equivalent homogeneity by the paper form.
By generating the conversion volume, can make adjacent examinee's paper different as far as possible, thereby reduce the possibility that the examinee makes a profit by back door.
According to an embodiment of examination disposal route of the present invention, the conversion of generation is rolled up the following condition of foot: the topic preface and the option series arrangement of (1) conversion volume all are at random; This condition is as the basic requirement of paper conversion, and its makes each conversion twist under the identical topic number, and exercise question and option order corresponding between the different switching volume may be different.(2) each conversion twists under the identical topic number pairing correct option option difference; It makes the possibility of plagiarizing full-filling information point profit between the examinee significantly reduce.(3) number of options of correct option and position distribution substantially evenly (require maximum continuously with the answer number less than 4) in each conversion volume; The probability that it makes the examinee guess answer right is impartial substantially.(4) there is not correlativity in the answer between each between each conversion is rolled up and in every cover conversion volume inscribed.
Need explanation, select m type multiple choice for n, promptly the option number is n, and the correct option number is m, and its correct option may be certain m option in n the option.With regard to the paper conversion, n selects m type multiple choice can be equal to C n mSelect 1 type single choice to handle.Therefore, can unite single choice and multiple choice, handle by single choice.
Fig. 4 illustrates the process flow diagram of an embodiment who generates the conversion volume in the examination disposal route of the present invention.
As shown in Figure 4, in step 402, generate and inscribe preface at random.Produce the full arrangement of M individual 1 to N independently at random, as the conversion topic preface of M kind conversion volume corresponding to original volume, wherein M represents to change the species number of volume, and N represents that all participate in the examination question quantity of conversion.
In step 404, generate the correct option option.How introduction generates the correct option option in detail after a while.
In step 406, generate the distracter order.Generate after the correct option option, for every kind of conversion volume, we come distracter on arbitrary position except that the correct option option at random
Introduce the model answer generating algorithm of individual event multiple-choice question and multiple-choice question below respectively.It is example that single choice selects 1 topic type with 4, and multiple choice is an example with 5 choosing many (selecting 2 at least) topic types.These two kinds of topic types appear in the objective item topic type of many examinations, and are therefore more representative.Those skilled in the art is according to following introduction, and the rest may be inferred, can realize the conversion of the objective item topic type of other types.
Individual event multiple-choice question (4 select 1 topic type, suppose that the exercise question sum of individual event multiple-choice question is N, and symbiosis becomes 4 cover conversion volumes)
Algorithm steps comprises:
(A1), structure answer formation base matrix A 1, A 2, A 3, A 4, A 5, A 6:
A 1 = 1 2 3 4 2 1 4 3 3 4 1 2 4 3 2 1 , A 2 = 1 3 4 2 2 4 3 1 3 1 2 4 4 2 1 3 , A 3 = 1 4 2 3 2 3 1 4 3 2 4 1 4 1 3 2 ,
A 4 = 1 2 4 3 2 1 3 4 3 4 2 1 4 3 1 2 , A 5 = 1 3 2 4 2 4 1 3 3 1 4 2 4 2 3 1 , A 6 = 1 4 3 2 2 3 4 1 3 2 1 4 4 1 2 3 - - - ( 23 )
B falls with square:
B = A 1 A 2 A 3 A 4 A 5 A 6 - - - ( 24 )
Matrix A i, (i=1 ..., 6) row and column be 1,2,3,4 to be evenly distributed, matrix B has 24 row, set that each row is formed is whole arrangements of 1-4 just.
(A2), establishing m represents
Figure G2010100004470D00152
Integral part, n represents
Figure G2010100004470D00153
The remainder part.Structural matrix S is as follows:
S = B 1 . . . B m A 1 . . . A n - - - ( 25 )
Wherein, B 1=B 2=...=B m=B.
(A3), generate 1 to N arrangement entirely at random, and matrix S is upset at random by sequence number of each row, form matrix S according to this arrangement *
(A4), judgment matrix S *Whether the maximum consecutive identical number of each column element value is greater than 3.If then jump to step (A3); If not, then jump to step (A5).
(A5), with matrix S *In element value by 1 corresponding A, 2 corresponding B, 3 corresponding C, the corresponding relation of 4 corresponding D is replaced, every row of the matrix after then replacing promptly are the final accurate answers of conversion label that generates.
By above-mentioned paper transform method steps A 1-A5, (1) inscribes preface at random and distracter is random alignment in proper order, guaranteed the topic preface of conversion volume and the randomness of option order; (2) every provisional capital of the matrix S in the algorithm steps (A2) is the arrangement of 1-4, has guaranteed that each conversion twists under the identical topic number pairing correct option option difference; (3) matrix A in the algorithm steps (A1) 1, A 2, A 3, A 4, A 5, A 6Every row all be the arrangement of 1-4, and algorithm steps (A4) requires maximum consecutive identical number less than 4, guaranteed the number of options of correct option in each conversion volume and position distribution substantially evenly; (4) the topic preface random alignment in the algorithm steps (A3), and the matrix A in the algorithm steps (A1) 1, A 2, A 3, A 4, A 5, A 6Structure, guaranteed between each conversion volume and there is not correlativity in the answer between each topic in every cover conversion volume.
Multiple-choice question (5 select 2 topic types at least, suppose that the exercise question sum is N, and symbiosis becomes 4 cover conversion volumes)
For 5 select at least the answer of 2 topic types have 5 select 2,5 select 3,5 select 4 and full choosing totally 4 kinds may.The possibility that full selection shape does not exist answer to change, therefore, key is how answer changes under preceding 3 kinds of situations.
Algorithm steps:
(B1), be constructed as follows answer formation base matrix:
A 1 = ( 1,2 ) ( 1,3 ) ( 1,4 ) ( 1,5 ) ( 2 , 3 ) ( 2,4 ) ( 2,5 ) ( 3,4 ) ( 3,5 ) ( 4,5 ) , A 2 ( 1,2,3 ) ( 1,3,5 ) ( 1,2,4 ) ( 1,4,5 ) ( 2,3,4 ) ( 2,4,5 ) ( 1,2,5 ) ( 1,3,4 ) ( 2,3,5 ) ( 3,4,5 ) - - - ( 26 )
Matrix A 1Corresponding 5 select 2 situations, have 10 row, and set that each row is formed is 5 to select whole arrangements of 2 just; Matrix A 2Corresponding 5 select 3 situations, have 10 row, and set that each row is formed is 5 to select whole arrangements of 3 just; Matrix A 1The set of the capable composition of i is a matrix A 2The subclass of the set of the capable composition of i.
(B2), generate arranging entirely at random of 4 1-10, and do not collide (being correspondence position value difference) mutually between 4 arrangements in twos.
(B3), suppose that m-1 represents the integral part of N/10, n represents the remainder part of N/10, carries out m step (B2) continuously, and guarantees that each arrangement that generates is at random, remember 4 of the i time generation do not collide between in twos be arranged as P 1 i, P 2 i, P 3 i, P 4 i:
P 1 i = p 1,1 i p 1,2 i . . . p 1,10 i , P 2 i = p 2,1 i p 2,2 i . . . p 2,10 i , P 3 i = p 3,1 i p 3,2 i . . . p 3.10 i , P 4 i = p 4,1 i p 4,2 i . . . p 4,10 i - - - ( 27 )
Structural matrix P is as follows:
P = [ p i , j ] N × 4 = P 1 1 P 2 1 P 3 1 P 4 1 P 1 2 P 2 2 P 3 2 P 4 2 . . . . . . . . . . . . P 1 m - 1 P 2 m - 1 P 3 m - 1 P 4 m - 1 p 1,1 m p 2,1 m p 3 , 1 m p 4,1 m p 1,2 m p 2,2 m p 3,2 m p 4,2 m . . . . . . . . . . . . p 1 , n m p 2 , n m p 3 , n m p 4 , n m - - - ( 28 )
(B4),, remember that the option number of i cover conversion volume j topic model answer is k, then generate its corresponding model answer according to following method for upsetting the conversion volume of inscribing preface:
If k=5, then model answer is ABCDE;
If k=2 then gets matrix A 1P I, jElement (the p that row is corresponding I, jThe capable j column element of i of representing matrix P), and according to 1 corresponding A, 2 corresponding B, 3 corresponding C, 4 corresponding D, the corresponding relation of 5 corresponding E is replaced, and the element after the replacement promptly is model answer;
If k=3 then gets matrix A 2P I, jElement (the p that row is corresponding I, jThe capable j column element of i of representing matrix P), and according to 1 corresponding A, 2 corresponding B, 3 corresponding C, 4 corresponding D, the corresponding relation of 5 corresponding E is replaced, and the element after the replacement promptly is model answer;
If k=4, then at first generate 3 answers according to the k=3 situation, again to the model answer of j-1 topic (having generated model answer) before the i cover conversion volume carry out A, B, C, D, E unite frequently, and two answers being left are generated the 4th answer by the few preferential employing principle of frequency.
By above-mentioned paper transform method step B1-B4, finish the generation of the accurate answer of conversion label.(1) inscribing preface and distracter at random is random alignment in proper order, has guaranteed the topic preface of conversion volume and the randomness of option order; (2) 4 random alignment that generate in the algorithm steps (B2) in twos between collision mutually, guaranteed that each conversion twists under the identical topic number pairing correct option option difference; (3) matrix A in the algorithm steps (B1) 1The set of the capable composition of i is a matrix A 2The subclass of the set of the capable composition of i, full arrangement in the step (B2), the building method of matrix P in the step (B3), and preferentially adopt principle less by frequency under the k=4 situation in the step (B4), this three promise the number of options of correct option and position distribution be substantially evenly in each conversion volume; (4) algorithm steps (B2) (B3) (B4) guaranteed between each conversion volume and there is not correlativity in the answer between each topic in every cover conversion volume.
Paper converter technique of the present invention can reduce the success ratio that examination is plagiarized, and the possibility that makes the examinee make a profit by back door reduces as far as possible.Because the mutual equivalent homogeneity of conversion volume, thus the conformance to standard that examinee's ability level is tested, and reduced difficulty and the cost that makes the test, thus solved the shortcoming of " plum blossom volume " technology.
Fig. 5 illustrates the process flow diagram of an embodiment of examination disposal route of the present invention.
As shown in Figure 5,, generate multiple conversion volume according to original volume in step 502, and the answer and the identification code of conversion volume.With original volume and the automatic import system of model answer, and split into stem, option and model answer.Secondly generate and inscribe preface at random, produce the full arrangement of M individual 1 to N independently at random, as the conversion topic preface of M kind conversion volume corresponding to original volume, wherein M represents to change the species number of volume, and N represents that all participate in the examination question quantity of conversion.Generate the correct option option then, behind definite correct option option, generate the distracter order.
In step 504,, make that adjacent examinee's paper is inequality according to examinee examination hall, the multiple conversion volume of seat information distribution.Increase the difficulty of plagiarizing cheating between the examinee like this.
In step 506, obtain the video surveillance data in each examination hall in real time, the store video monitoring data.On the one hand,, can grasp the discipline situation of examining in each examination hall, find the cheating situation in real time by the real-time video monitoring; On the other hand, the video surveillance data of storage can be used for analyzing after examination, and as examining the evidence of recording and handling.
In step 508, obtain identification code, answer and the examinee's of examinee's paper examination hall, seat information.For example, extract the identification code of examinee's answer and examinee's paper according to answer sheet by scanning device binding pattern recognition technology.Examinee's examination hall, seat information can be allocated in advance, perhaps extract from the bar code of expression positional information.
In step 510, according to the answer of examinee's paper and the model answer of examinee's paper, calculate the degree of doubting between examinee's test paper, according to the degree of doubting between examinee's test paper, in conjunction with examinee's examination hall, the seat information test paper of determining to doubt.
In step 512, according to video surveillance data determine to doubt act of plagiarism between the test paper.
It will be understood by those of skill in the art that examination processing system of the present invention and method, in the electronization examination (machine of being commonly referred to is examined) that the examination of adopting the papery paper (being commonly referred to the examination of paper pen) neutralization is carried out on computers, can both use.
Examination processing system of the present invention and method remedy the deficiency of " plum blossom volume " method effectively by the paper converter technique, and prevention cheats at one's exam, and particularly examination is plagiarized, and have alleviated the pressure of invigilator's work simultaneously.By test paper that the analysis of examination paper is determined to doubt, and provide objective reference frame for the discipline situation of examining in each examination point of objective evaluation, examination hall in conjunction with the video surveillance data.
Description of the invention provides for example with for the purpose of describing, and is not exhaustively or limit the invention to disclosed form.Many modifications and variations are obvious for the ordinary skill in the art.Selecting and describing embodiment is for better explanation principle of the present invention and practical application, thereby and makes those of ordinary skill in the art can understand the various embodiment that have various modifications that the present invention's design is suitable for special-purpose.

Claims (10)

1. an examination processing system is characterized in that, comprising:
Standard volume memory storage, the identification code that is used to store original volume and changes volume, the examination question numbering of original volume, the stem of examination question, option;
The model answer memory storage, the identification code that is used to store original volume and changes volume, and corresponding model answer;
Examinee's answer deriving means is used to obtain identification code, answer and the examinee's of examinee's paper examination hall, seat information;
Doubting test paper is determined device, is used for calculating degree of doubting between examinee's test paper according to the model answer of the answer of examinee's paper and examinee's paper, according to the degree of doubting between examinee's test paper, in conjunction with examinee's examination hall, the seat information test paper of determining to doubt;
Examination room video storage device is used to store the video surveillance data in each examination hall;
The examination hall video capture device is distributed in each examination hall, is used to obtain the video surveillance data in each examination hall, sends to described examination video storage device by network and stores.
2. examination processing system according to claim 1 is characterized in that, also comprises:
Conversion volume generating apparatus is used for the examination question order of described original volume and/or the order of examination question option are carried out conversion generation conversion volume, and obtains the answer and the identification code of described conversion volume; Identification code, examination question numbering, the stem of examination question, the option of described conversion volume sent to described standard to be rolled up memory storage and stores; The identification code of described conversion volume and corresponding answer are sent to described model answer memory storage stores;
The paper output device is used to export described original volume and conversion volume and identification code thereof.
3. examination processing system according to claim 2 is characterized in that, described conversion volume generating apparatus carries out conversion generation conversion volume according to transformation matrix to the examination question order of described original volume and/or the order of examination question option; Obtain corresponding answer according to described transformation matrix; Generate the identification code of described conversion volume according to described transformation matrix.
4. examination processing system according to claim 2 is characterized in that, described examination question output device is a papery paper printing device, prints the corresponding bar code of identification code with described conversion volume on the papery paper of output and the answer sheet thereof;
Perhaps,
Described examination question output device is the electronics display terminal.
5. according to any described examination processing system in the claim 1 to 4, it is characterized in that, also comprise:
The visualization device of doubting is used to generate examination hall doubt a test paper seat order relation figure and/or the various test paper statistical forms of doubting of visualization display.
6. according to any described examination processing system in the claim 1 to 4, it is characterized in that, the described test paper of doubting determines that device determines to judge the test paper of doubting with the critical value of answer rate with the critical value of wrong answer rate according to the answer of examinee's paper and with the answer rate with the critical value of wrong answer rate according to the model answer of the answer of examinee's paper and examinee's paper.
7. an examination disposal route is characterized in that, comprising:
Generate the answer and the identification code of multiple conversion volume and conversion volume according to original volume;
According to examinee examination hall, seat information distribution conversion volume, make that adjacent examinee's paper is inequality;
Obtain the video surveillance data in each examination hall in real time, store described video surveillance data;
Obtain identification code, answer and the examinee's of examinee's paper examination hall, seat information;
According to the answer of examinee's paper and the model answer of examinee's paper, calculate the degree of doubting between examinee's test paper, according to the degree of doubting between examinee's test paper, in conjunction with examinee's examination hall, the seat information test paper of determining to doubt;
According to described video surveillance data determine to doubt act of plagiarism between the test paper.
8. examination disposal route according to claim 7 is characterized in that, describedly generates the multiple conversion volume and the answer of conversion volume and the step of identification code according to original volume and comprises:
With original volume and the automatic import system of model answer, split into stem, option and model answer;
Generate the preface of topic at random of conversion volume;
Generate the correct option option of conversion volume;
After determining the correct option option, generate each examination question distracter order of conversion volume.
9. according to claim 7 or 8 described examination disposal routes, it is characterized in that described answer and the model answer of the examinee's paper step of calculating the degree of doubting between examinee's test paper according to examinee's paper comprises:
According to the answer of examinee's paper and the definite critical value of model answer of examinee's paper with the answer rate;
According to the answer of examinee's paper and the definite critical value of model answer of examinee's paper with the wrong answer rate;
Judge the test paper of doubting according to the answer of examinee's paper and with the answer rate with the critical value of wrong answer rate.
10. according to any described examination disposal route in the claim 7 to 9, it is characterized in that, also comprise:
A test paper seat order relation figure doubts in the generation examination hall; And/or
The various test paper statistical forms of doubting of visualization display.
CN201010000447A 2010-01-08 2010-01-08 Examination processing system and method thereof Pending CN101727544A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201010000447A CN101727544A (en) 2010-01-08 2010-01-08 Examination processing system and method thereof

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201010000447A CN101727544A (en) 2010-01-08 2010-01-08 Examination processing system and method thereof

Publications (1)

Publication Number Publication Date
CN101727544A true CN101727544A (en) 2010-06-09

Family

ID=42448424

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201010000447A Pending CN101727544A (en) 2010-01-08 2010-01-08 Examination processing system and method thereof

Country Status (1)

Country Link
CN (1) CN101727544A (en)

Cited By (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103870911A (en) * 2013-10-28 2014-06-18 龙宏元 Test paper and paper inspection system capable of preventing examinees from cheating
CN104077735A (en) * 2014-06-09 2014-10-01 北京工商大学 Online examination room visualization monitoring system
CN104200415A (en) * 2014-09-02 2014-12-10 北京工商大学 Real-time cheat detection method for online examination rooms
CN105632270A (en) * 2016-03-04 2016-06-01 北京华云天一科技有限公司 Data processing method and data processing device based on exam
CN105812470A (en) * 2016-03-23 2016-07-27 重庆至善信息技术有限公司 Objective question display method and device
CN106952359A (en) * 2017-04-26 2017-07-14 江苏工程职业技术学院 Business system is examined in a kind of comprehensively anti-cheating
CN108875345A (en) * 2018-06-27 2018-11-23 武汉启明泰和软件服务有限公司 A kind of paper roll examination question field print method and paper roll examination on the spot method
CN109686160A (en) * 2019-01-31 2019-04-26 上海车轮互联网服务有限公司 Client-based answer reminding method, system and computer readable storage medium
CN113095968A (en) * 2019-12-23 2021-07-09 深圳云天励飞技术有限公司 Cheating identification method and device and electronic equipment

Cited By (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103870911A (en) * 2013-10-28 2014-06-18 龙宏元 Test paper and paper inspection system capable of preventing examinees from cheating
CN104077735A (en) * 2014-06-09 2014-10-01 北京工商大学 Online examination room visualization monitoring system
CN104077735B (en) * 2014-06-09 2017-06-13 北京工商大学 Online test visualizing monitor system
CN104200415A (en) * 2014-09-02 2014-12-10 北京工商大学 Real-time cheat detection method for online examination rooms
CN105632270A (en) * 2016-03-04 2016-06-01 北京华云天一科技有限公司 Data processing method and data processing device based on exam
CN105812470A (en) * 2016-03-23 2016-07-27 重庆至善信息技术有限公司 Objective question display method and device
CN106952359A (en) * 2017-04-26 2017-07-14 江苏工程职业技术学院 Business system is examined in a kind of comprehensively anti-cheating
CN106952359B (en) * 2017-04-26 2023-08-04 江苏工程职业技术学院 Comprehensive anti-cheating examination system
CN108875345A (en) * 2018-06-27 2018-11-23 武汉启明泰和软件服务有限公司 A kind of paper roll examination question field print method and paper roll examination on the spot method
CN109686160A (en) * 2019-01-31 2019-04-26 上海车轮互联网服务有限公司 Client-based answer reminding method, system and computer readable storage medium
CN113095968A (en) * 2019-12-23 2021-07-09 深圳云天励飞技术有限公司 Cheating identification method and device and electronic equipment

Similar Documents

Publication Publication Date Title
CN101727544A (en) Examination processing system and method thereof
Karadja et al. Richer (and holier) than thou? The effect of relative income improvements on demand for redistribution
McNamara et al. Internal review and self-evaluation—the chosen route to school improvement in Ireland?
US7120612B2 (en) Method and apparatus for recommending an optimum training to a trainee, and a computer product
Norris Why American elections are flawed (and how to fix them)
Newburn Police and Crime Commissioners: The Americanization of policing or a very British reform?
KR101832791B1 (en) Hybrid computer scoring system and method based on image for increasing reliability and accuracy
Ong Electoral manipulation, opposition power, and institutional change: Contesting for electoral reform in Singapore, Malaysia, and Cambodia
Clark et al. Poll workers
Cain et al. A reasonable bias approach to gerrymandering: Using automated plan generation to evaluate redistricting proposals
Grant Reconfiguring education through data: How data practices reconfigure teacher professionalism and curriculum
Elmendorf Election Commissions and Electoral Reform: An Overview
Alidu Party politics and electoral malpractice in Ghana’s election 2012
Alvarez et al. Assessing voters’ attitudes towards electronic voting in latin america: Evidence from colombia’s 2007 e-voting pilot
Kalinin Validation of the Finite Mixture Model Using Quasi-Experimental Data and Geography
Khan et al. Role of e-voting system for void of errors in the electoral manipulations: a case study of Nigeria
Norman et al. Preliminary Study: Electronic Counting in Indonesian National Election Using Computer Answer Sheets and DMR Software
Ebirim Assessment of the performance of Independent National Electoral Commission (INEC) in the 2011 Gubernatorial Election in South Eastern Nigeria
Raikes et al. Grading examinations using expert judgements from a diverse pool of judges
RU2298229C2 (en) Method for electronic voting and processing of results
Kovač et al. Performance of authorities in administrative procedures: lessons from statistical data
Luecht Data and scale analysis for credentialing examinations
Fałkowski et al. The power of social mobilisation: The impact of monitoring the 2015 presidential elections in Poland
Ottoboni et al. Bernoulli ballot polling: A manifest improvement for risk-limiting audits
CN101447100A (en) Method for fabricating subentry vote and subentry voting system

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
C12 Rejection of a patent application after its publication
RJ01 Rejection of invention patent application after publication

Application publication date: 20100609