DE202018002612U1 - Subject-independent system for the content registration, evaluation and evaluation of examinations, which are provided on the basis of an open question or several open questions in the free text format - Google Patents

Abstract

Automated device for independently recording, evaluating, evaluating and communicating assessment services based on one or more examination questions in the form of one open or several open questions in free text format and communicating the assessment, the Device has the following features:
a computer with programmed, discipline-independent correction software, which is able to represent one or more correction forces in relation to a test all or essential for the evaluation of the performance of an examination candidate required examination requirements and which allows the correction force or the correction forces to make by means of an input mechanism quantitative and qualitative information about the examinations of a particular candidate and to store these entries, the information of the correction force or the correction forces in particular by selecting from predetermined choices, the programmed computer is designed to the inputs of the To value the correction force or the correction forces with respect to the test performance (s) to store these ratings, the programmed computer is designed to the stored rating data of several Prüfun evaluate and output in systematized form on an output device connected to the computer, the programmed computer being capable of displaying to the correction force (s) on an output device connected to the computer a text reflecting the assessment of the test performance (s) and wherein the computer-programmed correction software has access to stored data, the predetermined response options to be displayed to the correction force or forces, internal criteria for rating and grading exam performance, inputs made by the correction force (s) and from which the computer-programmed correction software contains stored ratings.

Description

Field of the invention

The present disclosure relates to a subject-independent system for recording, evaluating and evaluating examination results and communicating the evaluation of examination results which are provided on the basis of an open question or several open questions in free-text format, the system being the correction force or correction forces of the examination performance facilitates the work involved in the collection, evaluation and evaluation of examinations as well as communication in the assessment of examinations.

Background of the invention

For exam questions on the basis of closed questions (ie exam tasks with a clear, limited solution space and given answer alternatives, eg in single- or multiple-choice-format) there are already numerous methods for fully or partially automated recording, evaluation and evaluation of examinations as well as for the communication of the Examination result or test results. Fully or partially automated systems for recording, evaluating and evaluating examinations as well as for communicating the evaluation of examinations, which are performed on the basis of an open question or open questions in free text format, are so far known only in forms in which so-called surface parameters ( eg word count, sentence structure) are recorded and evaluated (so-called Automated Essay Scoring - EAS). Fully or partially automated systems for recording, evaluating and evaluating examinations as well as for communicating the assessment of examinations, which are provided on the basis of an open question or open questions in free text format and by which the examinations are recorded, evaluated and evaluated with regard to their overall content and which the reviews can communicate independently, are not yet known.

Summary of the invention

The present disclosure relates to an automated device for independently recording, evaluating, evaluating and evaluating examination services which are processed on the basis of one or more examination questions in the form of one open or several open questions in free text format to communicate, the device having the following features:
a computer with programmed, discipline-independent correction software, which is able to represent one or more correction forces in relation to a test all or essential for the evaluation of the performance of an examination candidate required examination requirements and which allows the correction force or the correction forces to make by means of an input mechanism quantitative and qualitative information about the examinations of a particular candidate and to store these entries, the information of the correction force or the correction forces in particular by selecting from predetermined choices, the programmed computer is designed to the inputs of the To value the correction force or the correction forces with respect to the test performance (s) to store these ratings, the programmed computer is designed to the stored rating data of several Prüfun evaluate and output in systematized form on an output device connected to the computer, the programmed computer being capable of displaying to the correction force (s) on an output device connected to the computer a text reflecting the assessment of the test performance (s) and wherein the computer-programmed correction software has access to stored data, the predetermined response options to be displayed to the correction force or forces, internal criteria for rating and grading exam performance, inputs made by the correction force (s) and from which the computer-programmed correction software contains stored ratings.

According to another aspect of the disclosure, the computer-programmed, non-point-specific correction software is able to offer inputs of the creator of an examination by means of an input mechanism to the correction force or the correction forces, predetermined choices and not to be displayed on the correction forces, to record and store internal criteria for the evaluation and grading of examinations.

In accordance with another aspect of the disclosure, the off-the-shelf, programmed proofing software is capable of providing the creator of a test with the typical range of qualitative and quantitative assessments of exam performance that is typical of the subject of the exam and the corrective or corrective forces to be offered (s) and internal criteria for the evaluation and grading of non-indicative View exam performance and allow the creator of the exam to select or customize and save it.

In accordance with another aspect of the disclosure, the programmed computer is configured to evaluate the inputs of the correction force (s) with respect to the exam performance (s), the programmed computer having access to the judging criteria previously entered or selected by the creator of the exam and wherein the computer stores this rating.

In accordance with another aspect of the disclosure, the programmed computer is configured to evaluate the stored rating data of multiple exam performances and to display or output in a systemized form to an output device connected to the computer.

In accordance with another aspect of the disclosure, the programmed, off-the-shelf, correction software has access to the stored test performance evaluation data and is capable of applying the correction force (s) based on the stored evaluation data to an output device connected to the computer to display or output the texts automatically reflecting the evaluation of the examination (s) of an individual candidate, automatically generated by the correction software programmed in the computer.

In accordance with another aspect of the disclosure, the computer may be used by multiple correctional personnel involved in correcting audit services based on the same audit task (s) simultaneously and / or in parallel with inputting and storing quantitative and qualitative information about the audit services become.

According to another aspect of the disclosure, the computer programmed with the correction software may be used by multiple creators of different exam performances to provide input to the correction force or forces by means of an input mechanism, predetermined choices, and internal criteria not to be displayed on the correction forces To record and save overall assessment and grading of examinations.

According to a further aspect of the disclosure, the computer-programmed correction software can be operated in the following operating modes: (i) in the input mode, indications of the creator of the test or the creator of the test are the frame data of the test, the content of the test recorded and stored the corrective power to be displayed or the correction forces to be displayed and the internal evaluation criteria; (ii) in the correction mode, inputs of a correction force are captured and stored based on predetermined choices on quantitative and qualitative aspects of the examinations of a particular candidate; (iii) in the evaluation mode, the individual inputs to the respective examinations made by the correction force or correction forces are assessed on the basis of the assessment criteria made or selected by the examiner or examiners of the examination and assigned to the respective examiner; (iv) in the evaluation mode, the stored rating data of a plurality of exam performances are evaluated and displayed or output in a systemized form to an output device connected to the computer; (v) in the communication mode, the correction force or correction forces based on the stored evaluation data are displayed on an output device connected to the computer, respectively, the evaluation of the examination performance (s) of a single exam candidate reflective, automatically generated by the computer programmed in the correction software texts or output.

According to a further aspect of the disclosure, the computer programmed with the correction software can be operated in different, field-specific operating modes in which typical options for the qualitative and quantitative evaluation of examination performance (s ) from the respective department as well as the correctional forces not to be displayed, internal criteria for the overall assessment and grading of examinations from the respective field are displayed and put to the selection.

According to another aspect of the disclosure, the computer is a personal computer (PC) and / or a server / host combination and / or a mobile phone (smartphone) and / or a tablet computer and / or a personal digital assistant (PDA).

According to another aspect of the disclosure, the program runs on one or more computers and / or on a host and / or entirely or at least partially on a server connected to the host via a network, the network being an intranet and / or the Internet is.

list of figures

• 1 : Workflow Diagram for the recording, evaluation and evaluation as well as for the communication of the result of examinations, which are issued on the basis of open questions about the free text editing.

Detailed description of the exemplary embodiment

The present disclosure is based, in one aspect, on the recognition that not only are examinations performed in response to exam questions given in the form of closed questions, but also examinations that are performed in response to open-question questions and in free-text format , can be recorded, evaluated and evaluated in a partially or fully automated manner and that the communication of the examination results can be carried out in an automated manner even with such examination tasks.

Another aspect of the disclosure concerns the recognition that the correction of examinations performed in response to open-question questions and in free-text format is conventional and without the use of a computer with programmed correction software as set forth in this disclosure Costs mean that a uniform and objective correction of examinations is not ensured, especially when multiple correctional forces are used, and that retrospective adjustment of already made corrections is difficult.

The system introduces a new and independent approach to the collection, assessment and evaluation of examinations as well as the communication of the result or results of examinations, which are based on an open question or open questions in free text format Process of correction of examinations. On the one hand, it allows a faster and thus more cost-effective correction, since it largely relieves the correction force or the correction forces largely by the work of grading and communication of individual examinations and the evaluation of several similar examinations by automation. On the other hand, it increases the transparency and equivalence of audit evaluations by assessing audit performance against a set of pre-defined criteria.

1. 1. „Prüfung“: Eine Aufgabe, welche einem Prüfungskandidaten mit dem Ziel der Bewertung des Leistungsniveaus des Prüfungskandidatens gestellt wird.
2. 2. „Prüfungskandidat“: Person, welche die Prüfung zum Zweck der Bewertung ihres eigenen Leistungsniveaus bearbeitet.
3. 3. „Ersteller einer Prüfung“: Person oder Personen, welche die Prüfung konzipieren und ausarbeiten.
4. 4. „Prüfungsleistung“: Die Antwort bzw. die Antworten eines Prüfungskandidaten, welche vom Prüfungskandidaten in Bearbeitung der Prüfung erbracht wird.
5. 5. „Offene Frage“: Eine Frage, welche die zutreffende Antwort bzw. die zutreffenden Antworten oder mögliche Antworten weder vorgibt noch impliziert.
6. 6. „Freitextformat“: Modus der Beantwortung einer Frage oder Prüfung, bei welcher die Bearbeitung ohne oder mit nur sehr beschränkter Vorgabe der Bearbeitungsform in Textform oder in Form von mathematischen Formeln erfolgt, wobei die Formulierung der Antwort vom Bearbeiter ganz oder weitgehend frei von Vorgaben erfolgen kann.
7. 7. „Korrekturkraft“: Person, welche mit der Erfassung, Bewertung und Auswertung von Prüfungsleistungen sowie der Kommunikation der Bewertung betraut ist.
8. 8. „Erfassung von Prüfungsleistungen“: Erfassung des Inhalts einer Prüfungsleistung durch eine Korrekturkraft.
9. 9. „Bewertung von Prüfungsleistungen“: Bewertung einer oder mehrerer Prüfungsleistungen durch eine Korrekturkraft.
10. 10. „Auswertung von Prüfungsleistungen“: Zusammenfassende Analyse der Ergebnisse von mehreren Prüfungsleistungen durch eine Korrekturkraft.
11. 11. „Kommunikation der Bewertung von Prüfungsleistungen“: Kommunikation des Ergebnisses der Bewertung einer Prüfungsleistung gegenüber dem Prüfungskandidaten.

The following is a definition of terms used in the present disclosure:

1. 1. "Examination": a task which is assigned to an examiner with the aim of assessing the performance level of the candidate.
2. 2. "Candidate" means the person who examines for the purpose of assessing their own performance level.
3. 3. "Creator of an examination" means the person or persons who design and elaborate the examination.
4. 4. "Examination performance": The answer or answers of an examination candidate, which is provided by the candidate in process of the examination.
5. 5. "Open Question": A question that neither sets nor implies the applicable answer or answers or possible answers.
6. 6. "free text format" means the mode of answering a question or an exam in which the processing is done without or with very limited specification of the processing form in text form or in the form of mathematical formulas, whereby the formulation of the answer by the processor is completely or largely free of specifications can be done.
7. 7. "Correctional force" means a person who is entrusted with the recording, evaluation and evaluation of examinations as well as the communication of the assessment.
8. 8. "Recording of examinations": recording the content of an examination by means of a correction.
9. 9. "Assessment of Examinations": Assessment of one or more examinations by a correctional force.
10. 10. "Evaluation of Examinations": Summary analysis of the results of several examinations by a correctional force.
11. 11. "Communication of the assessment of examinations": Communication of the result of the assessment of an examination performance against the candidate.

The following is a description of functionality and operations of essential operations of the correction program according to one embodiment (Department of Law, 1st State Examination, Federal Republic of Germany) of this disclosure.

• Prüfungsfrage: „Kann A von B Herausgabe des PKW verlangen?“
• Prüfungspunkt 1: „Anspruch von A gegen B auf Herausgabe des PKW aus § 985 BGB“
• Prüfungspunkt 1.1: „A Eigentümer?“
• Prüfungspunkt 1.2: „B Besitzer?“
• Prüfungspunkt 1.3: „B ohne Recht zum Besitz?“
• Prüfungspunkt 2 „Anspruch von A gegen B auf Herausgabe des PKW aus § 861 BGB“
• (...)
• Prüfungspunkt n (...)
• Bedingung 1: „keine“
• (...)
• Bedingung n: (...)

In order to enable the correction force or the correction forces to be used by the system, the creator or the creators of the Checking first in the system's input mode, enter and save information about the test's frame data, the content of the test, the choices to be displayed on the correction force or the correction forces, and the internal evaluation and grading criteria. Here, the general data of the examination include general information about, for example, the title, date and place of the examination as well as the general horizon of expectations with regard to the tasks set. The content of the examination includes at least the examination question (s), the individual examination steps and, if possible alternative solutions, the different solutions and their relation to each other as a condition (s). For example, an examination question and examination steps in the Department of Law can be entered as follows:

• Examination question: "Can A demand the release of the car from B?"
• check point 1 : "Claim of A against B on publication of the car from § 985 BGB"
• check point 1.1 : "A owner?"
• check point 1.2 : "B owner?"
• check point 1.3 : "B without right to possession?"
• check point 2 "Claim from A to B on surrender of the car from § 861 BGB"
• (...)
• Test point n (...)
• condition 1 : "none"
• (...)
• Condition n: (...)

In this case, the creator of the examination or the creators of the examination can, for example, in the mode of "law, 1. State Examination, Federal Republic of Germany" either make their own entries or select from a list of already programmed claims.

• Frage n, Anspruch n
• Bewertung der Übersichtlichkeit der Gliederung (Auswahlmöglichkeit zwischen 1=schlechteste Bewertung und 4=beste Bewertung)
• Bewertung der Rechtschreibung (Auswahlmöglichkeit zwischen 1=schtechteste Bewertung und 4=beste Bewertung)
• Bewertung der Grammatik (Auswahlmöglichkeit zwischen 1=schlechteste Bewertung und 4=beste Bewertung)
• Bewertung des Schriftbildes (Auswahlmöglichkeit zwischen 1=schlechteste Bewertung und 4=beste Bewertung)
• Bewertung des Prüfungsaufbaus (Auswahlmöglichkeit zwischen 1=schlechteste Bewertung und 4=beste Bewertung)
• Anpassung der Bewertung der Teilleistung durch die Korrekturkraft (Auswahlmöglichkeit zwischen -100 bis + 100)
• Freitexteingabe der Korrekturkraft (Möglichkeit der Freitexteingabe durch den Korrektor)
• Prüfungspunkt 1: Vom Prüfungskandidaten geprüft? (Auswahlmöglichkeit ja/nein); Welches Gesamtergebnis wird vom Prüfungskandidaten vertreten? (Auswahlmöglichkeit „+“, „-“, „+/-“);
• Prüfungspunkt 1.1: Vom Prüfungskandidaten geprüft? (Auswahlmöglichkeit ja/nein); Welches Ergebnis wird vom Prüfungskandidaten vertreten? (Auswahlmöglichkeit „+“, „-“, „+/-“); Bewertung der Einhaltung des Gutachtenstils? (Auswahlmöglichkeit zwischen 1=schlechteste Bewertung und 4=beste Bewertung)
• Prüfungspunkt 1.2: (...)
• Prüfungspunkt n: (...)

In addition, details of the creator (s) of the test for those parameters are required, which are the correction force or the correction forces displayed in the context of the correction. These can either be freely selected or can be adapted by the creator (s) of the test if a specific operating-range-specific operating mode is selected. In the "Law, 1st State Exam, Federal Republic of Germany" operating mode, these can be, for example:

• Question n, claim n
• Evaluation of the clarity of the structure (choice between 1 = worst rating and 4 = best rating)
• Spelling evaluation (choice between 1 = least scored rating and 4 = best rating)
• Grammar rating (choice between 1 = worst rating and 4 = best rating)
• Rating of the typeface (choice between 1 = worst rating and 4 = best rating)
• Assessment of the exam structure (choice between 1 = worst rating and 4 = best rating)
• Adjustment of the partial performance by the correction force (choice between -100 to + 100)
• Free text input of the correction force (possibility of free text input by the proofreader)
• check point 1 : Examined by the candidate? (Choice yes / no); Which overall result is represented by the candidate? (Choice "+", "-", "+/-");
• check point 1.1 : Examined by the candidate? (Choice yes / no); Which result is represented by the candidate? (Choice "+", "-", "+/-"); Assessment of compliance with the assessment style? (Choice between 1 = worst rating and 4 = best rating)
• check point 1.2 : (...)
• Test point n: (...)

• Globalparameter: Vergabe einer Note „Ausreichend, untere Grenze“ (4 Punkte) ab wieviel Rohpunkten (Skala von 0-100)?; Maximaler Punkteabzug von Leistungsquote zulässig in den Bereichen Übersichtlichkeit der Gliederung, Rechtschreibung, Grammatik, Schriftbild, Prüfungsaufbau, Gutachtenstil? (Auswahlmöglichkeit jeweils auf einer Skala von 0-100);
• Fragen 1 - n: Anteil der Frage an der Gesamtbewertung? (Auswahlmöglichkeit auf einer Skala von 0 - 100%)
• Frage n, Anspruch n: Anteil des Anspruchs an der Gesamtbewertung? (Auswahlmöglichkeit auf einer Skala von 0 - 100%)
• Frage n, Anspruch n
• Prüfungspunkt 1: Schwerpunkt der Prüfung? (Auswahlmöglichkeit ja/nein); Rohpunkte für Prüfung des Anspruchs (Auswahlmöglichkeit auf einer Skala von 0-100); Alternative Prüfungsmöglichkeit (Auswahlmöglichkeit ja/nein); Wenn alternative Prüfungsmöglichkeit: welche? (Auswahl aus Prüfungspunkten 1 - n.n)
• Prüfungspunkt 1.1: Schwerpunkt der Prüfung? (Auswahlmöglichkeit ja/nein); Rohpunkte für Prüfung des Prüfungspunktes (Auswahlmöglichkeit auf einer Skala von 0-100); Alternative Prüfungsmöglichkeit (Auswahlmöglichkeit ja/nein); Wenn alternative Prüfungsmöglichkeit: welche? (Auswahl aus Prüfungspunkten 1 - n.n)
• Prüfungspunkt n: (...)

Furthermore, details of the creator (s) of the check for parameters are required, which, however, of the correction force or the correction forces are not displayed during the correction. These can either be freely selected or can be adapted by the creator (s) of the test if a specific operating-range-specific operating mode is selected. In the "Law, 1st State Exam" operating mode these are, for example:

• Global parameter: Assigning a grade "Sufficient, lower limit" ( 4 Points) from how many raw points (scale from 0-100) ?; Maximum point deduction of benefit rate permissible in the areas of clarity of structure, spelling, grammar, typeface, exam structure, appraisal style? (Choice on a scale of 0-100);
• ask 1 - n: share of the question in the overall rating? (Choice on a scale of 0 - 100%)
• Question n, Claim n: Share of the claim to the overall rating? (Choice on a scale of 0 - 100%)
• Question n, claim n
• check point 1 : Focus of the exam? (Choice yes / no); Raw points for examination of the claim (selection on a scale of 0-100); Alternative examination possibility (choice yes / no); If alternative examination option: which? (Selection from examination points 1 - nn)
• check point 1.1 : Focus of the exam? (Choice yes / no); Raw points for examination of the examination point (optional on a scale of 0-100); Alternative examination possibility (choice yes / no); If alternative examination option: which? (Selection from examination points 1 - nn)
• Test point n: (...)

Upon completion of the test by the test maker (s) of the test, the system may be released for use by the correction force (s). These use the system in the "correction mode" operating mode, displaying the parameters selected by the creator of the check or the creators of the check (see above). After entering an identification of the candidate (e.g., exam number or matriculation number) and the corrective force itself (e.g., abbreviation abbreviation), inputting details of the respective graded exam is made by selecting the displayed preselected choices.

In this case, the correction software programmed on the computer is able to display the correction force or the correction forces in the case of previously entered alternative solution paths also those test points which are only to be tested alternatively. For example, examination alternative B of the correction force is displayed only if the question of the processing of examination alternative A was answered in the negative by the correction force beforehand. After completing the processing by the correction force or the correction forces, it is possible to save the inputs.

• Im Betriebsmodus „Auswertungsmodus“ kann der bzw. können die Ersteller der Prüfung im Falle der Korrektur von mehreren Prüfungsleistungen innerhalb einer Prüfung auf eine automatisierte Auswertung zurückgreifen, welche in der Betriebsart „Rechtswissenschaften, 1. Staatsexamen, Bundesrepublik Deutschland“ mindestens folgende Angaben enthält:
  • Gesamtübersicht: Anzahl der erfassten Prüfungsleistungen = n; Notendurchschnitt = n;
  • Notenverteilung: 0 Punkte = n Prüfungskandidaten, 1 Punkt = n Prüfungskandidaten (...)
  • Korrekturkraft 1: Anzahl der erfassten Prüfungsleistungen = n; Notendurchschnitt = n;
  • Notenverteilung: 0 Punkte = n Prüfungskandidaten, 1 Punkt = n Prüfungskandidaten (...)
  • Korrekturkraft 2: Anzahl der erfassten Prüfungsleistungen = n; Notendurchschnitt = n;
  • Notenverteilung: 0 Punkte = n Prüfungskandidaten, 1 Punkt = n Prüfungskandidaten (...)
  • Korrekturkraft n: Anzahl der erfassten Prüfungsleistungen = n; Notendurchschnitt = n;
  • Notenverteilung: 0 Punkte = n Prüfungskandidaten, 1 Punkt = n Prüfungskandidaten (...)

In the "Evaluation Mode" mode of operation of the correction software programmed on the computer, the evaluation of the test in accordance with the standard is performed automatically without the need for additional input by the correction force or the correction forces or the creator of the test or the creators of the test the parameters set by the creator of the test (s). The system may be configured by the creator of the test (s) to display to the correction force (s) the end grade and / or the raw score of the score during the input process to allow correction, if necessary, by entering adjustment values. The valuation and grading are calculated in particular taking into account the examination alternatives previously entered by the creator of the examination or the preparers of the examination.

• In the operating mode "evaluation mode", the examiner (s), in the case of the correction of several examination performances within an examination, can resort to an automated evaluation, which contains at least the following information in the operating mode "Law, 1st State Examination, Federal Republic of Germany":
  • Overview: Number of examinations = n; Grade point average = n;
  • Grading: 0 points = n Candidates, 1 point = n Candidates (...)
  • correcting force 1 : Number of examinations recorded = n; Grade point average = n;
  • Grading: 0 points = n Candidates, 1 point = n Candidates (...)
  • correcting force 2 : Number of examinations recorded = n; Grade point average = n;
  • Grading: 0 points = n Candidates, 1 point = n Candidates (...)
  • Correction force n: number of examinations = n; Grade point average = n;
  • Grading: 0 points = n Candidates, 1 point = n Candidates (...)

In addition, the system is able to generate a list of the most frequent error points of the test. The above information is displayed by the system and, if desired, output as a file or on an output device.

• WENN Eingabe zu Prüfungspunkt n =„nicht geprüft“ DANN Ausgabe „Verf. prüft Prüfungspunkt n nicht.“

In the operating mode "communication mode", both the creator of the test and the corrective force or forces can use a representation of texts generated automatically by the system, which reflect the evaluations of the respective examination examinations recorded. For this purpose, the system has an algorithm which is either freely programmable by the creator or by the creators of the test or can be selected as a preformulated module within the scope of the subject area operating mode. For example, in the operating mode "Law, 1st State Examination, Federal Republic of Germany":

• IF input to checkpoint n = "not checked" THEN edition "Verf. does not check exam point n. "

The system described in the present disclosure can be implemented and operated on a variety of hardware platforms. For example, the system can be fully installed and operated on a single device, such as a personal computer (PC), a mobile phone (smartphone), a tablet computer, or a personal digital assistant (PDA). However, it may also be installed and operated on a server / host combination, with the program being installed and operated on a server computer, and the users (the creator or examiners of the tests, and the correction force or correction forces) via a Network on host computers. In this case, the network can be, for example, the Internet or the intranet of a university. It is also possible, for example, to install and operate only parts of the program on the server computer and other parts on the host computers. Here, the access control system may provide passwords. The system underlying this disclosure may have been programmed in a variety of programming languages and / or created using a variety of programs, such as C, C ++, Basic, Visual Basic, Java, Java Script, MS Excel, MS Access.

The modes of operation, modes of operation, and embodiments described in this disclosure are merely exemplary and are for purposes of description only. Such modifications, variations, or modes that may be made by one skilled in the art without departing from the spirit and / or scope of the present disclosure are within the scope of the disclosure.

Claims (12)

Automated device for independently recording, evaluating, evaluating and communicating assessment services based on one or more examination questions in the form of one open or several open questions in free text format and communicating the assessment, the Device has the following features: a computer with programmed, discipline-independent correction software, which is able to represent one or more correction forces in relation to a test all or essential for the evaluation of the performance of an examination candidate required examination requirements and which allows the correction force or the correction forces to make by means of an input mechanism quantitative and qualitative information about the examinations of a particular candidate and to store these entries, the information of the correction force or the correction forces in particular by selecting from predetermined choices, the programmed computer is designed to the inputs of the To value the correction force or the correction forces with respect to the test performance (s) to store these ratings, the programmed computer is designed to the stored rating data of several Prüfun evaluate and output in systematized form on an output device connected to the computer, the programmed computer being capable of displaying to the correction force (s) on an output device connected to the computer a text reflecting the assessment of the test performance (s) and wherein the computer-programmed correction software has access to stored data, the predetermined response options to be displayed to the correction force or forces, internal criteria for rating and grading exam performance, inputs made by the correction force (s) and from which the computer-programmed correction software contains stored ratings. Device after Claim 1 in that the computer-programmed correction software is capable of offering inputs of the creator or the creator of a check by means of an input mechanism to the correction force or the correction forces, predetermined choices, and to the correction forces not to be displayed, internal criteria for evaluation and grading to record and save exams. Device after Claim 2 according to which the programmed, independent proofing software is able to give the creator of a test the typical and qualitative choice of the examination subject (s) to be offered in terms of the corrective or corrective force; to display the internal criteria for assessing and grading examinations, which are not to be displayed to the correctional staff, and allows the author of the exam to select or adapt and save them. Device after Claim 2 according to which the programmed computer is adapted to evaluate the inputs of the correction force (s) with respect to the test performance (s), the programmed computer having access to the evaluation criteria previously entered or selected by the creator of the test and the computer saves this rating. Device after Claim 2 according to which the programmed computer is adapted to evaluate the stored evaluation data of a plurality of examination services and to display or output in a systemized form to an output device connected to the computer. Device after Claim 4 wherein the programmed, pro-independent correction software has access to the stored test performance evaluation data and is capable of evaluating the correction force (s) based on the stored evaluation data on an output device connected to the computer Examination performance (s) of a single exam candidate to reflect or output automatically generated by the computer-programmed correction software automatically generated texts. Device after Claim 1 According to which the computer can be used by several correctional staff involved in the correction of examinations based on the same examination task (s) at the same time and / or in parallel with the input and storage of quantitative and qualitative information on examinations. Device after Claim 1 According to which the computer programmed with the correction software can be used by several creators of different examinations to offer input by means of an input mechanism to the correction force or the correction forces, given choices and internal criteria for total evaluation and grading not to be displayed on the correction forces to record and save exams. Device after Claim 1 according to which the correction software programmed in the computer can be operated in the following operating modes: (i) in the input mode, information of the creator of the test or the creator of the test are sent to the frame data of the test, the content of the test, to the correction force to be displayed or corrected the response options to be displayed and the internal evaluation criteria are recorded and stored; (ii) in the correction mode, inputs of a correction force are captured and stored based on predetermined choices on quantitative and qualitative aspects of the examinations of a particular candidate; (iii) in the evaluation mode, the individual inputs to the respective examinations made by the correction force or correction forces are assessed on the basis of the assessment criteria made or selected by the examiner or examiners of the examination and assigned to the respective examiner; (iv) in the evaluation mode, the stored rating data of a plurality of exam performances are evaluated and displayed or output in a systemized form to an output device connected to the computer; (v) in the communication mode, the correction force or correction forces based on the stored evaluation data are displayed on an output device connected to the computer, respectively, the evaluation of the examination performance (s) of a single exam candidate reflective, automatically generated by the computer programmed in the correction software texts or output. Device after Claim 2 according to which the computer programmed with the correction software can be operated in different, subject-specific operating modes, in which the choice of qualitative and quantitative assessment of examination achievement (s) from the respective, typical to the creator of examinations typical, the correction force or the correction forces offered The department as well as the correctional forces not to be displayed, internal criteria for the overall assessment and grading of examination results from the respective subject area are displayed and put to the selection. Device after Claim 1 according to which the computer is a personal computer (PC) and / or a server / host combination and / or a mobile phone (smartphone) and / or a tablet computer and / or a personal digital assistant (PDA). Device after Claim 1 according to which the program runs on one or more computers and / or on a host and / or entirely or at least partially on a server, via a network with the host, the network being an intranet and / or the Internet.

Images