WO2019162792A2 - Système et procédé de test personnalisé et de notation de test - Google Patents

Système et procédé de test personnalisé et de notation de test Download PDF

Info

Publication number
WO2019162792A2
WO2019162792A2 PCT/IB2019/051062 IB2019051062W WO2019162792A2 WO 2019162792 A2 WO2019162792 A2 WO 2019162792A2 IB 2019051062 W IB2019051062 W IB 2019051062W WO 2019162792 A2 WO2019162792 A2 WO 2019162792A2
Authority
WO
WIPO (PCT)
Prior art keywords
test
personalized
module
personalized mass
hints
Prior art date
Application number
PCT/IB2019/051062
Other languages
English (en)
Other versions
WO2019162792A3 (fr
Inventor
Guy Salomon
Original Assignee
Guy Salomon
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Guy Salomon filed Critical Guy Salomon
Publication of WO2019162792A2 publication Critical patent/WO2019162792A2/fr
Publication of WO2019162792A3 publication Critical patent/WO2019162792A3/fr

Links

Classifications

    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09B—EDUCATIONAL OR DEMONSTRATION APPLIANCES; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND, DEAF OR MUTE; MODELS; PLANETARIA; GLOBES; MAPS; DIAGRAMS
    • G09B7/00—Electrically-operated teaching apparatus or devices working with questions and answers
    • G09B7/02—Electrically-operated teaching apparatus or devices working with questions and answers of the type wherein the student is expected to construct an answer to the question which is presented or wherein the machine gives an answer to the question presented by a student
    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09B—EDUCATIONAL OR DEMONSTRATION APPLIANCES; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND, DEAF OR MUTE; MODELS; PLANETARIA; GLOBES; MAPS; DIAGRAMS
    • G09B3/00—Manually or mechanically operated teaching appliances working with questions and answers
    • G09B3/02—Manually or mechanically operated teaching appliances working with questions and answers of the type wherein the student is expected to construct an answer to the question which is presented or wherein the machine gives an answer to the question presented by a student

Definitions

  • a system for personalized mass testing includes a personalized mass test production module that includes a file with instructions to execute commands to enable generation of a personalized mass test paper; a personalized mass test production module that includes a file with instructions to execute commands to enable generation of a personalized mass test paper; a personalized mass test production module that includes a file with instructions to execute commands to enable generation of a personalized mass test paper; a
  • test paper module where the test paper includes questions and one or more question related hints, and wherein the hints are not visible, yet may be accessed by an examinee; and a personalized mass test scoring module that includes a file with instructions to execute commands to enable personalized scoring of a personalized mass test examination.
  • the system for personalized mass testing includes a plurality of hints, wherein each hint that is opened triggers a cost in test points, and optionally each hint may trigger a different number of points, according to its position, obviousness, importance etc.
  • each hint is covered up by an opaque covering that may be accessed by the user, and after usage, cannot be re-covered.
  • the personalized mass test production module includes a test writing module and a hint writing module, and further includes a test printing module for printing out a test paper including questions and hints.
  • the personalized mass test paper module includes test questions, test hints. In further embodiments, the personalized mass test paper module includes a test verification module.
  • the personalized mass test scoring module includes a test scoring module, and hint scoring module, and a test results module, for calculating a total test result consolidating question answering and hint usage.
  • the personalized mass test scoring module further includes a test diagnostics module.
  • the personalized mass test scoring module further includes a test analytics module.
  • the system further includes a personalized mass test server and a personalized mass test database, the database including a memory having stored thereon mass test related data.
  • the personalized mass test server and a personalized mass test database are based on a communications cloud.
  • the personalized mass test is examinee condition specific.
  • a method for personalized mass testing includes designing a test paper; producing test questions; providing scores related to the questions; producing one or more test question related hints; and providing scores related to the hints, the hint scores to be deducted from the question scores for hints that are accessed by an examinee.
  • each hint produced is obscured from view, yet each hint is individually accessible to an examinee.
  • the method further includes scoring a completed test based on an examinee's answers and an examinee's usage of one or more hints.
  • the personalized mass testing is used to analyze examinee abilities and knowledge.
  • the personalized mass testing is used to diagnose examinee learning disabilities.
  • the personalized mass testing is designed for one or more examinee conditions.
  • the personalized mass testing is used to enhance test development.
  • Fig. 1 is a schematic system diagram depicting components of a personalized mass testing system, according to some embodiments
  • Fig. 2 is a schematic system diagram depicting components of a cloud based personalized mass testing system, according to some embodiments;
  • Fig. 3 is a flow diagram indicating the process by which a personalized mass test preparation method may be executed, according to some embodiments;
  • Fig. 4 is a flow diagram indicating the process by which a personalized mass test is written, according to some embodiments.
  • Fig. 5 is a flow diagram indicating the process by which a personalized mass test scoring method may be executed, according to some embodiments.
  • testing refers to written tests or examinations, whether tested as questions, multiple choice or other. When defined within an educational setting, assessment, evaluation, and testing are all used to measure how much of the assigned materials students are mastering, how well a student is learning the materials, and how well a student is meeting the stated goals and objectives. Further, a test or examination (informally, exam or evaluation) is an assessment intended to measure a test-taker's knowledge, skill, aptitude, physical fitness, or classification in many other topics.
  • mass testing as used herein refers to standardized tests given to multiple people being tested.
  • the term“mass scoring” refers to test systems that are designed to be scored or marked in a standardized way, optionally automatically.
  • score refers to a grade or evaluation given to a person who is being tested to see how much they know about a subject or what they can do.
  • examinee is used herein to refer to a person who is being tested to see how much they know about a subject or what they can do, for example a person who is taking an exam.
  • the test papers are configured to include clues or hints, that may optionally be utilized, and if they are utilized, to have an impact on the scores.
  • a clue may cost a student x points in a test, but the student may not lose all the marks on a question.
  • Such a testing system may help reduce the drop out rates of students, and better test the true knowledge and understanding of students being tested.
  • personalized mass testing and scoring may
  • analyses may be run on students from different backgrounds, geographies etc., to learn about the impacts of such variables based on their
  • an analysis of such a personalized test may introduce a new or different testing index, for example, an educational intelligence indicator, reflecting, for example, coping with pressure, test taking skills, creativity for generating answers based on different hint types etc.
  • examinees may be identified as having a weakness in a certain field if they require hints substantially in that filed, for example, in a math test they substantially require hints only in geometry.
  • personalized mass testing and scoring may
  • test testing diagnostics based on more information about the students testing and their knowledge of the subject being tested. For example, if a typical student taking a math test gets a simple number or mark in their test, the tester using the personalized test system described herein may run diagnostic checks and analyses to generate a broader and deeper perspective of the examinees
  • educational, psychological, knowledge, intelligence or other hints or guidelines can assist with identifying, filtering, and/or diagnosing a variety of examinee conditions or scenarios. Further, test taking with hints can help examinees with various challenges, limitations, conditions etc. to perform better, achieve more, and express themselves in a more complete fashion. In some examples,
  • ADHD, test anxiety, test blackouts, etc. may be identified, diagnosed and/or supported in their test taking. For example, specific hints may be generated to provide support to examinees with specific challenges, to encourage or optimize examinee participation, and thereby enhance such examinee's focus, motivation, interaction etc. with the test.
  • provision of such support can be provided without special examiners being in the examination, and further, such support can be systematically provided, such that a precise hint is accessed, rather than relying on a special examiner, who may reveal too much or too little when
  • modified grades to students requiring hints may provide a fairer way of marking papers, and not penalizing students who do not require usage of hints.
  • a personalized mass testing system 100 includes a personalized mass test production module 105, for assisting an examiner or test generation person or team to prepare a personalized mass test paper.
  • Mass test production module may include, for example, a test writing module 110, a hint writing module 115, and a test printing module 120.
  • test writing module 110 may include document generation software for preparing a test paper with questions.
  • hint writing module 115 may include software for enabling adding of selected hints to a test paper being prepared, wherein the hint is covered, masked or otherwise not openly visible to a paper viewer, yet is accessible to a paper viewer, for example, by scratching away an opaque layer, a sticker or other obscuring object or effect to view the hint. Further, the obscuring object or effect should not be able to be re-applied or returned to its previous form, to obviate the usage thereof.
  • personalized mass testing system 100 includes a personalized mass test paper module 125, for assisting an examiner or test generation person or team to print out or otherwise produce a personalized mass test paper.
  • Mass test paper module 125 may include, for example, a test questions element 130, where test questions are listed; a test hints element, where one or more hints to help users answer questions are placed in proximity to their associated questions; and optionally a test verification module 135, for checking the security and/or relevance of the respective hints placed in the test paper.
  • personalized mass testing system 100 includes a personalized mass test scoring module 145, for assisting an examiner or tester to score or review a test that has been handed in for examination.
  • Mass test scoring module 145 may include, for example, a test scoring module 150, for enabling a tester to assign score points to answers in the test, optionally in combination with a pre-configures tester kit or code; a hint scoring module 155, for enabling a tester to modify, reduce or otherwise refine test scores in light of the hints used by the person being tested; and a test results module 160, for enabling the tester to combine the test scores, hint scores, and optionally other aspects, into an overall test result.
  • a test scoring module 150 for enabling a tester to assign score points to answers in the test, optionally in combination with a pre-configures tester kit or code
  • a hint scoring module 155 for enabling a tester to modify, reduce or otherwise refine test scores in light of the hints used by the person being tested
  • test results module 160 for enabling the tester to combine the test scores,
  • a personalized mass testing system 200 includes a personalized mass test production module 205, in association with a communications platform 260, including a cloud based personalized mass test server 270 and database 265, for assisting an examiner or test generation person or team to prepare a
  • Mass test production module may include, for example, a test writing module 210, a hint writing module 215, and a test printing module 220.
  • test writing module 210 may include document generation software for preparing a test paper with questions.
  • hint writing module 215 may include software for enabling adding of selected hints to a test paper being prepared, wherein the hint is covered, masked or otherwise not openly visible to a paper viewer, yet is accessible to a paper viewer, for example, by scratching away an opaque layer, a sticker or other obscuring object or effect to view the hint. Further, the obscuring object or effect should not be able to be re-applied or returned to its previous form, to obviate the usage thereof.
  • production module 205 and/or its respective components, test writer module 210, hint writer module 215 and/or test printer module 220 may be communicatively connected to cloud based personalized mass test server 270 and database 265.
  • personalized mass testing system 200 includes a personalized mass test paper module 225, in association with a communications platform 260, including a cloud based personalized mass test server 270 and database 265, for assisting an examiner or test generation person or team to print out or otherwise produce a personalized mass test paper.
  • Mass test paper module 225 may include, for example, a test questions element 230, where test questions are listed; a test hints element, where one or more hints to help users answer questions are placed in proximity to their associated questions; and optionally a test verification module 235, for checking the security and/or relevance of the respective hints placed in the test paper.
  • test paper module 225 and/or its respective components, test questions element 230, test hints element 240 and/or test verification module 235 may be communicatively connected to cloud based personalized mass test server 270 and database 265.
  • personalized mass testing system 200 includes a personalized mass test scoring module 245, in association with a communications platform 260, including a cloud based personalized mass test server 270 and database 265, for assisting an examiner or tester to score or review a test that has been handed in for examination.
  • Mass test scoring module 245 may include, for example, a test scoring module 250, for enabling a tester to assign score points to answers in the test, optionally in combination with a pre-configures tester kit or code; a hint scoring module 255, for enabling a tester to modify, reduce or otherwise refine test scores in light of the hints used by the person being tested; and a test results module 260, for enabling the tester to combine the test scores, hint scores, and optionally other aspects, into an overall test result.
  • scoring module 245 and/or its respective components, test scoring module 250, hint scoring module 255 and/or test results module 260 may be communicatively connected to cloud based personalized mass test server 270 and database 265.
  • cloud based personalized mass test server 270 and database 265 may be connected to a mass test platform that may integrate multiple users, institutions, past test papers, and other relevant resources for facilitating examination paper generation.
  • Fig. 3 is a flow diagram indicating the process by which a personalized mass testing paper may be generated, according to some embodiments.
  • an examiner designs a test paper, including designing a points structure for
  • the examiner writes or produces multiple
  • the examiner provides a score to be provided to one or more correct answers given to one or more questions.
  • the examiner writes or produces one or more hints to be associated with one or more
  • the examiner provides a score to be assigned to one or more hints given to one or more questions.
  • the scores given to hints may change in accordance with the level of help provided, level of obviousness, stage of question, level of difficulty etc.
  • the examiner can send to the test paper for printing or production, during which the questions and associated hints are included in the test paper.
  • the hints in the test paper are obscured or covered in order to hide them from the viewer, wherein the viewer has an option to reveal the hints, and thereby reduce the test score by the amount of points used up by accessing the hint(s).
  • Fig. 4 is a flow diagram indicating the process by which a personalized mass testing method may be executed, according to some embodiments.
  • a person being examined hereinafter referred to as the examinee
  • the examinee handles the test questions, completing the answers as in a conventional test.
  • the examinee accesses one or more hints, to support answering one or more questions, for example, by scratching away or otherwise revealing a covered hint.
  • Fig. 5 is a flow diagram indicating the process by which a personalized mass test scoring method may be executed, according to some embodiments.
  • an examiner reviews the test answers and provide scores for answers provided, optionally in accordance with a scoring code or template.
  • the examiner reviews the hint elements, to reveal which have been revealed by the examinee.
  • the examiner counts the hints revealed, and optionally the scores provided for the respective hints revealed.
  • the examiner adds the scores earned by the examinees answers and reduces the score in accordance with the hint scores used up by the accessed hints, to provide a final test score.
  • the examiner may add notes, comments, score points or other indicators of examinee understanding, skills and problems etc., based on the examinees usage of hints.
  • the number of points lost if a tester uses a clue depends on the level of importance, clarity, stage etc. of the clue.
  • the above described system and method can be used to enhance test development and reliability, for example, by analyzing tests taken and the number and type of hints required by the examinees or beta testers.
  • mass personalized testing may be used in multiple subject fields, for example, in Language, Science, Technology, Engineering, and Mathematics tests. Of course, other subjects may likewise be tested using mass personalized tests.
  • Appendix 1 shows an example of two questions of a first sample Math test.
  • Appendix 1 shows an example of two questions of a first sample Math test.
  • other questions, versions, types etc. may be used, and other subjects, languages etc. may be used.
  • Appendix 2 shows an example of two questions of a second sample Math test.
  • Appendix 2 shows an example of two questions of a second sample Math test.
  • other questions, versions, types etc. may be used, and other subjects, languages etc. may be used.
  • Appendix 3 shows an example of a Clues sheet related to the example questions in Appendix 1 and Appendix 2.
  • Appendix 3 shows an example of a Clues sheet related to the example questions in Appendix 1 and Appendix 2.
  • other hints, versions, types etc. may be used, and other subjects, languages etc. may be used.
  • ABCD ABCD below is a trapezoid.
  • MN is a midsegment.
  • AD and BC are diagonals.
  • Clue 1 (hidden): Denote one of the numbers by x and express the other one in terms of v
  • Clue 2 (hidden): Denote the sum of the numbers by y and express y in terms of x. Using the clue will reduce 5 points from the question score.
  • Clue 2 (revealed): Denote the sum of the numbers by y and express y in terms of .
  • ABCD ABCD below is a trapezoid.
  • MN is a midsegment.
  • AD and BC are diagonals.
  • Clue 1 (hidden): Denote one of the numbers by x and express the other one in terms of v
  • Clue 1 (revealed): Denote one of the numbers by x and express the other one in terms of v
  • Clue 2 (hidden): Denote the sum of the numbers by y and express y in terms of x. Using the clue will reduce 5 points from the question score.
  • Clue 2 (revealed): Denote the sum of the numbers by y and express y in terms of .

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Business, Economics & Management (AREA)
  • Physics & Mathematics (AREA)
  • Educational Administration (AREA)
  • Educational Technology (AREA)
  • General Physics & Mathematics (AREA)
  • Electrically Operated Instructional Devices (AREA)

Abstract

L'invention concerne un appareil, un système et un procédé permettant un test de masse personnalisé et une notation de test. Selon certains modes de réalisation, le système de test de masse personnalisé comprend un module de production de test de masse personnalisé qui comprend un fichier contenant des ordres servant à exécuter des instructions pour permettre une génération d'un papier de test de masse personnalisé ; un module de papier de test de masse personnalisé, le papier de test comprenant des questions et une ou plusieurs indications liées à des questions, et les indications n'étant pas visibles, mais pouvant faire l'objet d'un accès par un candidat ; et un module de notation de test de masse personnalisé qui comprend un fichier contenant des ordres pour exécuter des instructions pour permettre une notation personnalisée d'un examen de test de masse personnalisé.
PCT/IB2019/051062 2018-02-21 2019-02-09 Système et procédé de test personnalisé et de notation de test WO2019162792A2 (fr)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US201862633585P 2018-02-21 2018-02-21
US62/633,585 2018-02-21

Publications (2)

Publication Number Publication Date
WO2019162792A2 true WO2019162792A2 (fr) 2019-08-29
WO2019162792A3 WO2019162792A3 (fr) 2019-10-03

Family

ID=67687502

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/IB2019/051062 WO2019162792A2 (fr) 2018-02-21 2019-02-09 Système et procédé de test personnalisé et de notation de test

Country Status (1)

Country Link
WO (1) WO2019162792A2 (fr)

Family Cites Families (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9892650B2 (en) * 2006-09-11 2018-02-13 Houghton Mifflin Harcourt Publishing Company Recovery of polled data after an online test platform failure
US20090035733A1 (en) * 2007-08-01 2009-02-05 Shmuel Meitar Device, system, and method of adaptive teaching and learning
US10672286B2 (en) * 2010-03-14 2020-06-02 Kryterion, Inc. Cloud based test environment
US20130323703A1 (en) * 2012-06-05 2013-12-05 Foothills Education, Llc Study Aid for Academic Competition
KR20140032726A (ko) * 2012-09-07 2014-03-17 메가스터디(주) 전자문제집 상에서의 힌트 제시 및 채점 점수 차등화 방법 및 그 장치
US9082309B1 (en) * 2013-03-15 2015-07-14 Querium Corporation Dynamic question template system and architecture
KR101887409B1 (ko) * 2016-04-29 2018-08-13 한밭대학교 산학협력단 미세 oid 코드가 기록된 인쇄물 및 그에 대응되는 전자문서 파일의 정보를 포함하여 구축한 객체정보 데이터베이스에 기반한 콘텐츠 마켓 서비스 시스템

Also Published As

Publication number Publication date
WO2019162792A3 (fr) 2019-10-03

Similar Documents

Publication Publication Date Title
Brown et al. Criterion-referenced language testing
Mumford A descriptive study of the readability of patient information leaflets designed by nurses
Martínez Melis et al. Assessment in translation studies: Research needs
Resnick et al. Tests as Standards of Achievement in Schools.
Sweet Forensic neuropsychology: Fundamentals and practice
Masterson et al. Spelling assessment: Charting a path to optimal intervention
Hambleton et al. Item response theory models and testing practices: Current international status and future directions
Vrana et al. Can a computer administer a Wechsler Intelligence Test?
Manalu An Analysis of Students Reading Final Examination by Using Item Analysis Program on Eleventh Grade of SMA Negeri 8 Medan.
Lal Educational measurement and evaluation
Krishna Examination system
WO2019162792A2 (fr) Système et procédé de test personnalisé et de notation de test
Zare et al. Reading strategy use and field of study: A mixed-methods study
Hashamdar et al. The effects of the instruction of self-regulation strategies and critical thinking strategies on the second language vocabulary achievement among Iranian EFL learners
Waseem et al. Does schooling make a difference in English Language Proficiency? A comparison of Pakistani undergraduate students coming from English and Urdu medium schools
U’um Qomariyah et al. Effective sentence assignment as the key to improve skill of writing exposition with online learning media Quipper
Engel et al. Assessment of medical students in a new curriculum
Fenton et al. An introduction to educational measurements
KR20200000936A (ko) 분석키트와 그룹별 활동 및 게임세트를 이용한 성격 및 성향 분석시스템
Esfandiari Cloze-Elide Test as an Alternative Test Method: Linking Personality Types to Test Method Performance
Tanjung et al. Feasibility Analysis Test of Computer Based Testing (CBT) System for General Physics Exam
Moto et al. Developing Item Analysis of Teacher–Made Test for Summative Assessment of Seventh Grade of SMPN 8 Komodo in Academic Year 2020/2021
KL Ensuring Quality of a Large-Scale Online Assessment for Nursing Students in the 21st Century: A Case Study
Moto et al. Developing Item Analysis of Teacher–Made Test for Summative Assessment of Seventh Grade of SMPN 8 Komodo in Academic
Zulfa Developing higher order thinking skill (HOTS)-based reading assessment instrument of analytical exposition text using Google form

Legal Events

Date Code Title Description
NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 19756854

Country of ref document: EP

Kind code of ref document: A2