WO2011122930A1 - Système et procédé d'évaluation pour un apprentissage innovant - Google Patents

Système et procédé d'évaluation pour un apprentissage innovant Download PDF

Info

Publication number
WO2011122930A1
WO2011122930A1 PCT/MY2010/000185 MY2010000185W WO2011122930A1 WO 2011122930 A1 WO2011122930 A1 WO 2011122930A1 MY 2010000185 W MY2010000185 W MY 2010000185W WO 2011122930 A1 WO2011122930 A1 WO 2011122930A1
Authority
WO
WIPO (PCT)
Prior art keywords
user
assessment
learning
module
level
Prior art date
Application number
PCT/MY2010/000185
Other languages
English (en)
Inventor
Yon Haniza
Pek Kuan Ng
Lukose Dickson
Original Assignee
Mimos Berhad
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Mimos Berhad filed Critical Mimos Berhad
Publication of WO2011122930A1 publication Critical patent/WO2011122930A1/fr

Links

Classifications

    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09B—EDUCATIONAL OR DEMONSTRATION APPLIANCES; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND, DEAF OR MUTE; MODELS; PLANETARIA; GLOBES; MAPS; DIAGRAMS
    • G09B7/00—Electrically-operated teaching apparatus or devices working with questions and answers
    • G09B7/02—Electrically-operated teaching apparatus or devices working with questions and answers of the type wherein the student is expected to construct an answer to the question which is presented or wherein the machine gives an answer to the question presented by a student
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q50/00—Information and communication technology [ICT] specially adapted for implementation of business processes of specific business sectors, e.g. utilities or tourism
    • G06Q50/10—Services
    • G06Q50/20—Education
    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09B—EDUCATIONAL OR DEMONSTRATION APPLIANCES; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND, DEAF OR MUTE; MODELS; PLANETARIA; GLOBES; MAPS; DIAGRAMS
    • G09B7/00—Electrically-operated teaching apparatus or devices working with questions and answers
    • G09B7/06—Electrically-operated teaching apparatus or devices working with questions and answers of the multiple-choice answer-type, i.e. where a given question is provided with a series of answers and a choice has to be made from the answers

Definitions

  • the present invention relates to an assessment system and method for innovative learning using an e-Iearning system.
  • the system comprises a profiling module, a planning module, a display module and an assessment module.
  • the profiling module comprises means for profiling the user based on a psychometric profile.
  • the planning module comprises means for selecting learning material based on the psychometric profile.
  • the display module comprises means for displaying the learning material to the user.
  • the assessment module comprises means for assessing the user by randomly selecting a plurality of questions for display to the user, scoring a plurality of answers from the user using weighted scoring, determining a proficiency level of the user and suggesting a learning pathway to the user based on the proficiency level.
  • an assessment method for innovative learning using an e-learning system comprises the steps of profiling the user based on a psychometric profile, selecting learning material based on the psychometric profile, displaying the learning material to the user and assessing the user by randomly selecting a plurality of questions for display to the user, scoring a plurality of answers from the user using weighted scoring, determining a proficiency level of the user and suggesting a learning pathway to the user based on the proficiency level.
  • FIG. 1 is an illustration of the overview of an e-learning system with an assessment system and method for innovative learning.
  • FIG. 2 is a flowchart illustrating the development of an assessment engine.
  • FIG. 3 is an illustration of the architecture of an assessment engine.
  • FIG. 4 is a flowchart illustrating the assessment flow in an assessment engine.
  • the present invention relates to an assessment system and method for innovative learning.
  • this specification will describe the present invention according to the preferred embodiments of the present invention.
  • limiting the description to the preferred embodiments of the invention is merely to facilitate discussion of the present invention and it is envisioned that those skilled in the art may devise various modifications and equivalents without departing from the scope of the appended claims.
  • the assessment system and method for innovative learning of the present invention relates to an e-assessment system and method that utilizes assessment results effectively to improve quality of learning.
  • the assessment system and method provides multiple learning pathways based on the assessment results to cater for individual user's or student's learning needs. For instance, a student will be provided with different remedial lessons depending on their proficiency level gauged based on the assessment results.
  • the assessment system and method of the present invention also provides different learning pace by allowing students to either proceed to learn a subsequent lesson i.e. the next topic or chapter or to repeat learning areas in the same topic or chapter which students are still weak in.
  • the assessment system and method for innovative learning of the present invention applies randomized questions and weighted scoring method to more accurately estimate the proficiency level of the students and to promote fair assessment. Randomized questions reduce memory effects or cheating which will result in an unfair comparison of proficiency level between students across all assessments. Randomization comprises setting each assessment from randomly selected questions. However, the distribution of questions with different difficulty levels is pre-determined. Weighted scoring ensures different weights are assigned to questions with different difficulty levels in order to promote fair comparison of proficiency level between students.
  • the assessment system and method for innovative learning provide personalized learning material and assessment questions are randomly assigned to each individual student based on the student's proficiency level. Personalization is according to students' weak areas and level of mastery. Based on the assessment results, assessment system and method identify the areas that the student is weak in and selects appropriate learning materials for remedial lessons based on the level of mastery in the weak areas. Thereafter, the students will be assessed using questions which are related to their weak areas.
  • FIG. 1 is an illustration of the overview of an e-learning system with an assessment system and method for innovative learning.
  • the system (102) comprises a profiling module (104), a planning module (106), a display module (108) and an assessment module (110).
  • the profiling module (104) comprises means for profiling the user based on a psychometric profile (112).
  • the planning module (106) comprises means for selecting learning material based on the psychometric profile (114).
  • the display module (108) comprises means for displaying the learning material to the user (116).
  • the assessment module (110) comprises means for assessing the user by randomly selecting a plurality of questions for display to the user (118), scoring a plurality of answers from the user using weighted scoring (120), determining a proficiency level of the user (120) and suggesting a learning pathway to the user based on the proficiency level.
  • the proficiency level of the user may be determined as either advanced.proficient or basic. There are 2 predefined thresholds i.e.
  • the planning module (106) selects a subsequent learning material based on the psychometric profile.
  • the display module (108) displays the subsequent learning material to the user.
  • the assessment module (110) further assesses the user by randomly selecting a subsequent plurality of questions for display to the user, scoring a subsequent plurality of answers from the user using weighted scoring, determining a subsequent proficiency level of the user and suggesting a subsequent learning pathway to the user based on the proficiency level.
  • the assessment system further identifies a plurality of weak areas of the user based on the plurality of answers from the user (124), assesses a level of mastery for*each of the plurality of weak areas (126) and maps the level of mastery to a remedial lesson selection scheme (128).
  • the planning module (106) selects a remedial lesson material based on the psychometric profile, the plurality of weak areas and the remedial lesson selection scheme (130) for display to the user (132) by the display module (108).
  • the assessment module (110) selects a plurality of questions based on the plurality of weak areas and a question selection scheme for display to the user (134) the display module (108).
  • the assessment module (110) further scores the plurality of answers from the user using weighted scoring (136), determines the proficiency level of the user and suggests the learning pathway to the user based on the proficiency level.
  • FIG. 2 is a flowchart illustrating the development of an assessment engine.
  • the development or preparation of the e-assessment engine comprises suggesting annotation properties for the question (202), suggesting schema of the difficulty level (204), suggesting score for each difficulty level (206), annotating questions with difficulty level and other annotation properties (208), suggesting scheme for level of mastery (210), suggesting remedial lesson selection scheme (212), suggesting question selection scheme (214), suggesting proficiency level scheme (216), laying-out weighted scoring algorithm and formulas (218) and finally developing the e- assessment engine (220).
  • the annotation properties for the plurality of questions are suggested (202) by a domain expert, psychometrician and a researcher based on the curriculum specified by a statutory body. It not only includes academic annotations regarding the content and learning objectives of the syllabus, but also the skills and values which need to be cultivated through learning.
  • the schema of difficulty level is prepared and defined (204) by the domain expert to enable a consistent annotation of the questions.
  • the suggested schema of difficulty level is based on Bloom's taxonomy.
  • the difficulty level is mapped to the cognitive process dimensions in the taxonomy as shown in Table 1.
  • the scheme for identifying the level of mastery (210) of the identified weak areas is suggested by the domain expert and measurement experts based on the complexity level of the area. Score range that depicts different level of mastery is suggested for each complexity level.
  • Remedial lesson selection scheme (212) is suggested by the domain expert. A mapping between the level of mastery of the identified weak areas to the difficulty level and fulfilled learning outcome of the learning materials is provided for the remedial lesson selection.
  • Question selection scheme (214) is suggested by the domain expert and measurement experts. A control on the distribution of the difficulty level of the question in the test set is made configurable. The questions are selected based on the learning outcomes, difficulty level and whether the questions are answered previously by the students or not. The second round assessment questions are personalized to cater for areas that students are weak in, which have been identified in the previous test.
  • the proficiency level scheme (216) is suggested by the domain expert and measurement experts by taking into consideration the fact that the score range for each proficiency level might be different depending on the subject-matter and the grade level of study.
  • FIG. 3 is an illustration of the architecture of the assessment engine.
  • FIG. 4 is a flowchart illustrating the assessment flow in the assessment engine.
  • the test set fetcher module (302) will select and fetch the questions from an item bank (206) to be displayed to the student while the test set scorer module (304) will score the answers submitted by the student based on the predefined scoring model and identify the areas that students are weak in.
  • the test set fetcher module (302) comprises an ontology loader module (308), a scheme loader module (310), a question selection module (312), a randomization module (314) and a question fetcher module (3 6).
  • the ontology loader module (308) loads the item bank into the assessment system (402).
  • the scheme loader module (310) loads all the schemes used in the assessment system (404).
  • the question selection module (312) selects the questions for test set composition (406).
  • the randomization module (314) randomizes the question selection and order of display (408).
  • the question fetcher module (316) fetches the questions and its annotation from the item bank (410).
  • the test set scorer module (304) comprises an ontology loader module (318), a response collector module (320), an answer retrieval module (322), a scoring module (324), a proficiency level determination module (326), a weak area identification module (328), a level of mastery identification module (330), a mapping of the level of mastery to selection scheme module (332) and an answer key fetcher module (324).
  • the ontology loader module (318) loads the item bank into the assessment system.
  • the response collector module (320) collects the students' responses or answers (412).
  • the answer retrieval module (322) retrieves answers and scores assigned to the questions from the item bank (414).
  • the scoring module (324) scores the students' responses using weighted scoring (416).
  • the proficiency level determination module ⁇ 326) determines the proficiency level of the student on a certain topic or chapter based on the score (418).
  • the weak area identification module (328) identifies the weak area of the students (420).
  • the level of mastery identification module (330) identifies the level of mastery of each weak area based on the scheme (422).
  • the mapping of the level of mastery to selection scheme module (332) maps the level of mastery to the selection scheme of the remedial lesson and the subsequent plurality of questions (424).
  • the answer key fetcher module (334) retrieves the answer key from the item bank which consists of the correct answer and the explanation for the answer key (426).

Landscapes

  • Engineering & Computer Science (AREA)
  • Business, Economics & Management (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Educational Administration (AREA)
  • Educational Technology (AREA)
  • General Physics & Mathematics (AREA)
  • Tourism & Hospitality (AREA)
  • Human Resources & Organizations (AREA)
  • Marketing (AREA)
  • Primary Health Care (AREA)
  • Strategic Management (AREA)
  • General Health & Medical Sciences (AREA)
  • General Business, Economics & Management (AREA)
  • Economics (AREA)
  • Health & Medical Sciences (AREA)
  • Management, Administration, Business Operations System, And Electronic Commerce (AREA)
  • Electrically Operated Instructional Devices (AREA)
  • Measurement Of The Respiration, Hearing Ability, Form, And Blood Characteristics Of Living Organisms (AREA)

Abstract

La présente invention porte sur des système (102) et procédé d'évaluation pour un apprentissage innovant dans un système d'apprentissage en ligne, lequel système d'évaluation (102) comprend un module de profilage (104), un module de planification (106), un module d'affichage (108) et un module d'évaluation (110). Le module de profilage (104) comprend des moyens destinés à profiler l'utilisateur sur la base d'un profil psychométrique. Le module de planification (106) comprend des moyens destinés à sélectionner une documentation d'apprentissage sur la base du profil psychométrique. Le module d'affichage (108) comprend des moyens destinés à présenter la documentation d'apprentissage à l'utilisateur. Le module d'évaluation (110) comprend des moyens destinés à évaluer l'utilisateur par sélection aléatoire d'une pluralité de questions à présenter à l'utilisateur, comptage des points d'une pluralité de réponses données par l'utilisateur à l'aide d'un comptage de points pondéré, détermination d'un niveau de compétence de l'utilisateur et suggestion d'un parcours d'apprentissage pour l'utilisateur sur la base du niveau de compétence.
PCT/MY2010/000185 2010-03-29 2010-09-30 Système et procédé d'évaluation pour un apprentissage innovant WO2011122930A1 (fr)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
MYPI2010001390 2010-03-29
MYPI2010001390 MY150352A (en) 2010-03-29 2010-03-29 Assessment system and method for innovative learning

Publications (1)

Publication Number Publication Date
WO2011122930A1 true WO2011122930A1 (fr) 2011-10-06

Family

ID=44712427

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/MY2010/000185 WO2011122930A1 (fr) 2010-03-29 2010-09-30 Système et procédé d'évaluation pour un apprentissage innovant

Country Status (2)

Country Link
MY (1) MY150352A (fr)
WO (1) WO2011122930A1 (fr)

Cited By (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2013175443A2 (fr) * 2012-05-25 2013-11-28 Modlin David Méthode de test et de diagnostic informatisée et système
TWI478122B (zh) * 2012-12-25 2015-03-21 Univ Chienkuo Technology All-round care counseling system
WO2015099810A1 (fr) * 2013-12-29 2015-07-02 Hewlett-Packard Development Company, L.P. Graphe d'apprentissage
WO2018089133A1 (fr) 2016-11-08 2018-05-17 Pearson Education, Inc. Mesure d'apprentissage de langue utilisant des échelles de scores standardisées et des moteurs d'évaluation adaptative
US10885024B2 (en) 2016-11-03 2021-01-05 Pearson Education, Inc. Mapping data resources to requested objectives

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR20030040236A (ko) * 2003-02-13 2003-05-22 (주)카프나 인공지능기법을 이용한 통합 에너지 교육훈련 시스템
WO2003100746A2 (fr) * 2002-05-24 2003-12-04 Smtm Technologies Llc Technique et systeme de controle et de formation fondes sur les competences
KR100675438B1 (ko) * 2006-06-20 2007-01-30 주식회사 채널큐 강의 조합에 의한 온라인 맞춤형 학습 방법
KR100862040B1 (ko) * 2007-11-26 2008-10-09 심영섭 자기주도적 순환 학습 방법 및 그 시스템

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2003100746A2 (fr) * 2002-05-24 2003-12-04 Smtm Technologies Llc Technique et systeme de controle et de formation fondes sur les competences
KR20030040236A (ko) * 2003-02-13 2003-05-22 (주)카프나 인공지능기법을 이용한 통합 에너지 교육훈련 시스템
KR100675438B1 (ko) * 2006-06-20 2007-01-30 주식회사 채널큐 강의 조합에 의한 온라인 맞춤형 학습 방법
KR100862040B1 (ko) * 2007-11-26 2008-10-09 심영섭 자기주도적 순환 학습 방법 및 그 시스템

Cited By (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2013175443A2 (fr) * 2012-05-25 2013-11-28 Modlin David Méthode de test et de diagnostic informatisée et système
WO2013175443A3 (fr) * 2012-05-25 2014-01-23 Modlin David Méthode de test et de diagnostic informatisée et système
TWI478122B (zh) * 2012-12-25 2015-03-21 Univ Chienkuo Technology All-round care counseling system
WO2015099810A1 (fr) * 2013-12-29 2015-07-02 Hewlett-Packard Development Company, L.P. Graphe d'apprentissage
US10885024B2 (en) 2016-11-03 2021-01-05 Pearson Education, Inc. Mapping data resources to requested objectives
WO2018089133A1 (fr) 2016-11-08 2018-05-17 Pearson Education, Inc. Mesure d'apprentissage de langue utilisant des échelles de scores standardisées et des moteurs d'évaluation adaptative
EP3539116A4 (fr) * 2016-11-08 2020-05-27 Pearson Education, Inc. Mesure d'apprentissage de langue utilisant des échelles de scores standardisées et des moteurs d'évaluation adaptative
US11030919B2 (en) 2016-11-08 2021-06-08 Pearson Education, Inc. Measuring language learning using standardized score scales and adaptive assessment engines

Also Published As

Publication number Publication date
MY150352A (en) 2013-12-31

Similar Documents

Publication Publication Date Title
Kim et al. The influence of content knowledge on pedagogical content knowledge: An evidence-based practice for physical education
Van Seters et al. The influence of student characteristics on the use of adaptive e-learning material
Johnson et al. Effects of classwide peer tutoring on correct performance of striking skills in 3rd grade physical education
Marzano Formative assessment & standards-based grading
Alvarado et al. New CS1 pedagogies and curriculum, the same success factors?
Yoon et al. Development of the teaching engineering self-efficacy scale (TESS) for k-12 teachers
Baghurst Assessment of effort and participation in physical education
Dugdale The design of computer-based mathematics instruction
Powell et al. Early numerical competencies and students with mathematics difficulty
Rink Instruction from a learning perspective
WO2011122930A1 (fr) Système et procédé d'évaluation pour un apprentissage innovant
Maaß et al. Designing a teacher questionnaire to evaluate professional development in modelling
Newton et al. Assessment for and of learning
Pour-Mohammadi et al. Attitudes towards teaching and learning test-taking strategies for reading comprehension tests: The case of Iranian EFL undergraduates
Royal et al. Using Rasch measurement to score, evaluate, and improve examinations in an anatomy course
Miyajima et al. How do young residents practice laparoscopic surgical skills?
Vásquez-Colina et al. Achievement Goals, Motivation to Learn, and Mathematics Anxiety among Pre-Service Teachers.
Ponton Motivating students by building self-efficacy
Van Merriënboer et al. Performance assessment and learning task selection in environments for complex learning
Wolfe et al. Not all curves are the same: Left-of-center grading and student motivation
Ward et al. Evaluating the Content Knowledge of Preservice Physical Education Teachers
Ward The future direction of physical education teacher education: It’s all in the details
van Vuuren-Cassar et al. The assessment of athletics ‘knowledge’with written and video tests
Salemi A model teacher-education program for economics
Vidoni Teaching social skills in middle school physical education

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 10849087

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 10849087

Country of ref document: EP

Kind code of ref document: A1