WO2015114658A2 - An assessment system and method for assessing educational institutes - Google Patents
An assessment system and method for assessing educational institutes Download PDFInfo
- Publication number
- WO2015114658A2 WO2015114658A2 PCT/IN2015/000036 IN2015000036W WO2015114658A2 WO 2015114658 A2 WO2015114658 A2 WO 2015114658A2 IN 2015000036 W IN2015000036 W IN 2015000036W WO 2015114658 A2 WO2015114658 A2 WO 2015114658A2
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- parameter
- score
- parameters
- assessment
- level
- Prior art date
Links
Classifications
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09B—EDUCATIONAL OR DEMONSTRATION APPLIANCES; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND, DEAF OR MUTE; MODELS; PLANETARIA; GLOBES; MAPS; DIAGRAMS
- G09B7/00—Electrically-operated teaching apparatus or devices working with questions and answers
- G09B7/02—Electrically-operated teaching apparatus or devices working with questions and answers of the type wherein the student is expected to construct an answer to the question which is presented or wherein the machine gives an answer to the question presented by a student
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09B—EDUCATIONAL OR DEMONSTRATION APPLIANCES; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND, DEAF OR MUTE; MODELS; PLANETARIA; GLOBES; MAPS; DIAGRAMS
- G09B5/00—Electrically-operated educational appliances
Definitions
- This invention relates to the field of computational systems.
- this invention relates to an assessment system and method for assessing educational institutes.
- An educational institution is a place where people of different ages gain an education, including preschools, childcare, elementary schools, and universities.
- an educational institute there are at least five pillars of support: a) Students; b) Teachers; c) Parents; d) Institute; and e) Supporting environment.
- educations institutes provide school degrees, high school degrees, diplomas, degrees, certificates, after a course of curriculum is taught.
- An educational institute is subjectively ranked in terms of output of students in a particular grade or in a particular sport or in a particular extra-curricular activity.
- each centre of educational institute or school or centre of institution is the quality of the coursework or curriculum, the teachers available to teach it, the facilities available for curricular and extra-curricular activities. There are many and more of such parameters. Some are tracked, randomly. Some are left alone. There is no holistic and objective mechanism to rate an educational institute. There is no channel or platform which adjudges an educational institute on these parameters and / or displays them.
- the criteria for better education are not limited only to academics but also include intelligence, creativity, curiosity, social values, and professional values. When assessing these parameters emphasis is on understanding strengths and creating awareness about not-so-stronger traits.
- assessments are based on individual parameters without considering other affecting parameters; e.g. IQ tests or Personality tests. These tests are carried out in isolation. This eliminates other factors responsible for it and therefore it is insufficient to find the underlying reasons. Also, this fails to give an over-all trend across the institute.
- Some of the institute assessments are based only on academic results of students. Accreditation measures the efficiency of the institute based on the resources provided by the institute, i.e. accreditations mainly look for infrastructure that a school can provide. Accreditation does not provide any clue or understanding of actual quality learning happening within the institute. These accreditations are more related to compliance rather than quality learning.
- Some of the assessment works only of measuring certain skill-sets such as improving academic subjects, memory or IQ etc. Lot of software resources are available that help the institute management to share the data among parents, students and teachers. Those tools are a platform to share the data hassle free and not focused on the learning outcomes and efficiency of the institute.
- An object of the invention is to provide a system and method for an assessment model and solution that assesses the strengths and developmental areas of an educational institute system in order to achieve quality learning outcomes for students and identify areas of growth for the institute.
- Still another object of the invention is to provide a system and method which bases its analysis about an educational institute based on at least the institute's assets, which includes institute's brand and infrastructure.
- An additional object of the invention is to provide a system and method which bases its analysis about an educational institute based on at least the teaching quality, which assesses current teaching capabilities and gaps in teaching and teachers' professional growth potential, and teachers' competency and life skills.
- Yet an additional object of the invention is to provide a system and method which bases its analysis about an educational institute based on at least its students' performance, which includes assessment of students' competency and life skills and their relation to their academic performance.
- Still an additional object of the invention is to provide a system and method which bases its analysis about an educational institute based on at least supporting data of students and teachers, which help in quality learning.
- Another additional object of the invention is to provide a system and method which bases its analysis about an educational institute's pedagogical ability.
- Another additional object of the invention is to provide a system and method which provides a quantifiable number for an institute's growth.
- an assessment system for assessing educational institutes comprising:
- a scoring mechanism adapted to score each of said pre-defined sub- parameters based on at least a source, to score each of said pre-defined parameters based on at least a source, to score each of said factors cumulative to said group of pre-defined parameters, to score each of said aspects from a parameter-specific performance based on said correlating tests conducted for each of said aspects, characterised in that, said scores being first derived at a parameter level (level 3), then at a factor level (level 2), and then at an aspect level (level 1), said scores being cumulated to form a report of said educational institute.
- the said report is also generated using the Relationship Builder Mechanism (RB) which consumes the scores of parameter level (LeveB), Factor level (Level 2) and Aspect level (Level 1).
- RB Relationship Builder Mechanism
- said system comprises at least a pre-defined assessment matrix to assess quality of learning being imparted in said educational institute, said predefined matrix comprising at least an assessment mechanism, at least a scoring mechanism, and at least a relationship builder mechanism.
- said system comprises at least a pre-defined assessment matrix to assess quality of learning being imparted in said educational institute, said predefined matrix comprising at least an assessment mechanism, at least a scoring mechanism, and at least a relationship builder mechanism, characterized in that, said assessment mechanism being configured to collect inputs for each of said pre-defined set of parameters and each of said sub-parameters from said correlating tests.
- said system comprises at least a pre-defined assessment matrix to assess quality of learning being imparted in said educational institute, said predefined matrix comprising at least an assessment mechanism, at least a scoring mechanism, and at least a relationship builder mechanism, characterized in that, said scoring mechanism comprising: - at least a parameter scoring mechanism (PSM) configured to provide single parameter score that is generated through at least one source which is derived from at least one pre-defined test, said mechanism comprising a hierarchal model using pre-defined percentage ( ⁇ );
- PSM parameter scoring mechanism
- FSM factor scoring mechanism
- ASM aspect scoring mechanism
- said aspects are evaluation functions relating to an educational institute, characterised in that, said aspects comprising at least one or more of the following items:
- said database of tests comprises at least a test item selected from a group of test items consisting of feedback archiving test items, data archiving tests, ability diagnosing test items, written assessment test items, interview test items, activities test items, games test items, and audit test items.
- each of said parameters is a weight-assigned attribute which quantifies subjective and objective content in relation to assessing the learning system or educational institute.
- each of said sub-parameters is a weight-assigned attribute which quantifies subjective and objective content in relation to assessing the learning system or educational institute.
- said scoring mechanism comprises at least a segregation mechanism in order to segregate inputs in the form of primary data, secondary data, tertiary data, and such hierarchy based data, characterised in that, each input is converted into a single parameter-factor-aspect score by using pre-defined percentage ( ⁇ ) and / or pre-defined weights ( ⁇ ).
- said scoring mechanism comprises at least an aspect scoring mechanism such that the scores of interrelated or standalone factors are processed in this mechanism in order to generate an aspect score (level 1) further wherein, at least a weight assignment mechanism is used in a correlational manner with said aspect scoring mechanism in order to provide a weighted aspect score (level 1).
- said scoring mechanism comprises at least a Factor Scoring Mechanism (FSM) such that the parameter score is converted to a factor score (level 2) using pre-defined weights ( ⁇ ) which is assigned to each parameter further wherein, at least a weight assignment mechanism is used in a correlational manner with said factor scoring mechanism in order to provide a weighted factor score (level 2).
- FSM Factor Scoring Mechanism
- said scoring mechanism comprises at least a Factor Scoring Mechanism (FSM) such that the parameter score is converted to a factor score (level 2) using pre-defined weights ( ⁇ ) characterised in that said factor score is obtained by normalizing parameter scores based on weights assigned to sources using which parameter and optionally to sub-parameter scores.
- said scoring mechanism comprises at least a Factor Scoring Mechanism (FSM) such that the parameter score is converted to a factor score (level 2) using pre-defined weights ( ⁇ ) characterised in that said factor score is obtained by normalizing parameter scores based on weights assigned to sources using which parameter and optionally to sub-parameter scores, said normalization function being:
- Factor Score ⁇ [ ⁇ * (parameter A Score)] + [5 '* (parameter B Score)] + [5"*(parameter C Score)] + ... ⁇
- said scoring mechanism comprises at least a Parameter Scoring Mechanism (PSM) such that data is converted to parameter score (level 3) using pre-defined percentages ( ⁇ ) further wherein, at least a weight assignment mechanism is used in a correlational manner with said parameter scoring mechanism in order to provide a weighted parameter score (level 3).
- PSM Parameter Scoring Mechanism
- said scoring mechanism comprises at least a Parameter Scoring Mechanism (PSM) such that data is converted to parameter score (level 3) using pre-defined percentages ( ⁇ ) characterised in that said parameter score is obtained by normalizing test scores based on weights assigned to sources using which test scores are obtained.
- PSM Parameter Scoring Mechanism
- said system comprises at least a pre-defined assessment matrix to assess quality of learning being imparted in said educational institute, said predefined matrix comprising at least an assessment mechanism, at least a scoring mechanism, and at least a relationship builder mechanism, characterised in that, said relationship builder mechanism is configured to consume scores from said scoring mechanism and further configured to provide various relationship based data, said scores from relationship based data also comprising reports at parameter level, sub-parameter level, factor level, and / or aspect level and individual teacher and student level.
- said system comprises a weight assignment mechanism configured to assign weights to each of said pre-defined parameters, said pre-defined sub- parameters, said pre-defined factors, and said pre-defined aspects , said weight being dependent on the importance and priority of said parameter, said sub- parameter weight being dependent on the importance and priority of said sub- parameter, said factor weight being dependent on the importance and priority of said factor, said aspect weight being dependent on the importance and priority of said aspect.
- said scoring mechanism is characterised by at least a pre-defined percentage ( ⁇ ) which is the percentage factor applied to inputs from at least an assessment mechanism in order to get at least a parameter score and which score varies from 0-100% depending on parameter.
- said scoring mechanism is characterised by at least a pre-weighted number of function ( ⁇ ) which is a factor applied to inputs from at least an assessment mechanism in order to get at least a factor score.
- an assessment method for assessing educational institutes comprising the steps of:
- pre-defined parameters being correlated to at least one of said predefined aspects, wherein a group of pre-defined parameters form one of said pre-defined factors
- pre-defined sub-parameters being correlated to at least one of said predefined parameters, wherein a group of sub-parameters form one of said predefined parameters
- pre-defined sources being correlated to at least one of said pre-defined parameters and / or at least one of said pre-defined sub-parameters
- said method comprises a step of assessing quality of learning being imparted in said educational institute, using at least a pre-defined assessment matrix, said pre-defined matrix comprising at least an assessment mechanism, at least a scoring mechanism, and at least a relationship builder mechanism.
- said method comprises a step of assessing quality of learning being imparted in said educational institute, using at least a pre-defined assessment matrix, said pre-defined matrix comprising at least an assessment mechanism, at least a scoring mechanism, and at least a relationship builder mechanism, characterized in that, said step of assessing further comprising a step of collecting inputs for each of said pre-defined set of parameters and each of said sub-parameters from said correlating tests.
- said method comprises a step of assessing quality of learning being imparted in said educational institute, using at least a pre-defined assessment matrix, said pre-defined matrix comprising at least an assessment mechanism, at least a scoring mechanism, and at least a relationship builder mechanism, characterized in that, said scoring mechanism further being configured to perform the steps comprising:
- said aspects are evaluation functions relating to an educational institute, characterised in that, said aspects comprising at least one or more of the following items:
- said step of storing tests comprises a step of selecting a test item from a group of tests consisting of feedback archiving test items, data archiving tests, ability diagnosing test items, written assessment test items, interview test items, activities test items, games test items, and audit test items.
- each of said parameters is a weight-assigned attribute which quantifies subjective and objective content in relation to assessing the learning system or educational institute.
- each of said sub-parameters is a weight-assigned attribute which quantifies subjective and objective content in relation to assessing the learning system or educational institute.
- said step of scoring comprises an additional step of segregating inputs in the form of primary data, secondary data, tertiary data, and such hierarchy based data, characterised in that, each input is converted into a single parameter-factor-aspect score by using pre-defined percentage ( ⁇ ) and / or predefined weights ( ⁇ ).
- said step of scoring comprises an additional step of processing scores of interrelated or standalone factors are processed in this mechanism in order to generate an aspect score (level 1) further wherein, at least a weight assignment mechanism is used in a correlational manner with said aspect scoring mechanism in order to provide a weighted aspect score (level 1).
- said step of scoring comprises an additional step of converting parameter score to a factor score (level 2) using pre-defined weights ( ⁇ ) which is assigned to each parameter further wherein, at least a weight assignment mechanism is used in a correlational manner with said factor scoring mechanism in order to provide a weighted factor score (level 2).
- said step of scoring comprises an additional step of converting parameter score to a factor score (level 2) using pre-defined weights ( ⁇ ) characterised in that said factor score is obtained by normalizing parameter scores based on weights assigned to sources using which parameter and optionally to sub-parameter scores.
- said step of scoring comprises an additional step of converting parameter score to a factor score (level 2) using pre-defined weights ( ⁇ ) characterised in that said factor score is obtained by normalizing parameter scores based on weights assigned to sources using which parameter and optionally to sub-parameter scores, said normalization function being:
- said step of scoring comprises an additional step of converting data to parameter score (level 3) using pre- defined percentages ( ⁇ ) further wherein, at least a weight assignment mechanism is used in a correlational manner with said parameter scoring mechanism in order to provide a weighted parameter score (level 3).
- said step of scoring comprises an additional step of converting data is to parameter score (level 3) using pre- defined percentages ( ⁇ ) characterised in that said parameter score is obtained by normalizing test scores based on weights assigned to sources using which test scores are obtained.
- said step of scoring comprises an additional step of converting data to parameter score (level 3) using pre- defined percentages ( ⁇ ) characterised in that said parameter score is obtained by normalizing test scores based on weights assigned to sources using which test scores are obtained, said normalization function being:
- Parameter Score [(Primary TS* ⁇ )+(Secondary ⁇ 8* ⁇ ')+ (tertiary TS* ⁇ ")+ ⁇ ⁇ ,]/ ⁇ .
- said method comprises a step of assessing quality of learning being imparted in said educational institute, using at least a pre-defined assessment matrix, said pre-defined matrix comprising at least an assessment mechanism, at least a scoring mechanism, and at least a relationship builder mechanism, characterised in that, said relationship builder mechanism being configured to perform a step of consuming scores from said scoring mechanism and further configured to provide various relationship based data, said scores from relationship based data also comprising reports at parameter level, sub- parameter level, factor level, and / or aspect level and individual teacher and student level.
- said method comprises a step of assigning weights to each of said pre-defined parameters, said pre-defined sub-parameters, said pre-defined factors, and said pre-defined aspects, said weight being dependent on the importance and priority of said parameter, said sub-parameter weight being dependent on the importance and priority of said sub-parameter, said factor weight being dependent on the importance and priority of said factor, said aspect weight being dependent on the importance and priority of said aspect.
- said step of scoring is characterised by at least a pre- defined percentage ( ⁇ ) which is the percentage factor applied to inputs from at least an assessment mechanism in order to get at least a parameter score and which score varies from 0-100% depending on parameter.
- said step of scoring is characterised by at least a pre-weighted number of function ( ⁇ ) which is a factor applied to inputs from at least an ' assessment mechanism in order to get at least a factor score.
- Figure 1 illustrates a schematic block diagram for an assessment system and method for assessing educational institutes
- Figure 2 illustrates a schematic block diagram of an assessment mechanism
- Figure 3 illustrates a graphical diagram of aspects, factors, and parameters / sub- parameters and levels associated, thereof;
- Figure 4 illustrates a flowchart relating to generation of report using a relationship builder mechanism and data from an assessment mechanism and from a scoring mechanism
- Figure 5 illustrates that a report is generated by scores received from a Parameter Scoring Mechanism, Factor Scoring Mechanism, Aspect Scoring Mechanism, and Relationship Builder Mechanism.
- education institute is intended to mean any educational institution such as a school, a university, a graduate school, a college for any stream of study, or the like.
- aspects relates to an entity relating to an educational institution which is to be assessed using the system and method of this invention.
- aspects comprise teacher, students, educational institutions, and the like. Each of these aspects can be individually assessed.
- factor relates to pre-defined items that are to be assessed in relation to a selected aspect.
- factors comprise parameters and sub-parameters, as described below.
- factors comprise a list of skills that are required for development of an aspect and these skills are to be evaluated using the system and method of this invention.
- parameter relates to an item which corresponds towards development and rating of an aspect.
- parameters comprise a list of sub-skills that are required or contribute towards each skill i.e. towards each factor for development of an aspect and these sub- skills are to be evaluated using the system and method of this invention.
- sub-parameter relates to sub- skills that are required or contribute towards each skill or Parameter i.e. towards each factor for development of an aspect and these sub-skills are to be evaluated using the system and method of this invention.
- sub- parameters comprise a list of items which are used in order to assess a parameter and, in turn, a factor.
- source relates to an origin or item from where data is collated or from which data is extracted using tests.
- tests relates to tests, feedbacks / activities / audits / administrative data, academic data, and the like.
- an assessment system and method for assessing educational institutes there is provided an assessment system and method for assessing educational institutes.
- Figure 1 illustrates a schematic block diagram for an assessment system and method for assessing educational institutes.
- a database of pre-defined Aspects adapted to be correlated to an educational institute.
- These aspects are items relating to an educational institute.
- this list of pre-defined aspects is classified as follows: i) educational institute's assets, which includes institute's brand and infrastructure; ii) teacher and / or teaching quality, which assesses current teaching capabilities and competency and life skills and gaps in teaching and teachers' professional growth potential; iii) student's performance, which includes assessment of student's competency and life skills; and iv) supporting data of students and teachers, which help in quality learning process.
- tests comprise the use of written assessment, interviews, activities, games, and the like.
- feedbacks comprise the use of written assessment, and interviews.
- data comprises factual data / non-personal data or data from audit conducted.
- written tests, interviews, projects work, team exercise, and personal interviews may be used but are not limited only to these modes of assessment.
- Competency skills of students are defined as the skill-set required for a student to learn.
- Competency skills of a teacher are defined as the skill-set required for a teacher to convert information (text book or reference books) into knowledge and delivering it effectively to students so that quality learning can take place.
- the term, 'teacher' is not limited only to teaching staff; it includes faculty members who contribute to the learning process.
- the term 'Teacher' is additionally used for teaching aid or a virtual teaching assistant, which can be a human or non human entity.
- This pre-defined set of aspects / factors / parameters / sub-parameters is used to assess a learning system or an educational institute. This set of aspects is used in the following assessment process.
- Each defined aspect is a weight-assigned entity of the learning system or educational institute.
- the essential aspects are, but not limited to: - 1) The learner or a student; 2) Teacher or learning facilitator (human or non-human); 3) the system or/and infrastructure in which the learning takes place; 4) Supporting parameters of learners and teachers; and 5) Parents.
- supporting parameters comprise a set of Parameters and Sub-parameters which are directly or indirectly associated with the process of learning and rolls up to the Factors and Aspects.
- the Parameters and Sub-parameters include the one that are in action within an education institute and also the one that are in action outside of the education institute.
- FD factors database
- Each Aspect has various sub-aspects called as factors.
- Each defined factor is a weight-assigned attribute which quantifies subjective and objective content in relation to assessing the learning system or educational institute.
- Each factor is related to a particular aspect and directly or indirectly impacts users of the learning system or educational institute.
- Each factor is a group of related parameters.
- a set of parameters and sub- parameters are defined and stored respectively in a parameters database (PD) and a sub-parameters database (SPD).
- the defined parameter and sub-parameter are further comprised of various skills / traits / facilities / processes / values / learning aids, involved or supporting in the learning process or educational institute.
- Each defined parameter and sub-parameter is a weight-assigned attribute which quantifies subjective and objective content in relation to assessing the learning system or educational institute.
- a parameter is defined which is to be assessed.
- a set of sub-parameters are defined which cumulatively contribute to the parameter.
- SD sources database
- sources are items such as persons or facts collection methods through which data is gathered.
- a set of sources may be defined from which data is to be gathered.
- TD tests database
- the present invention provides a matrix to assess if quality learning is being imparted in a given system. Since, this is a subjective question with a subjective answer.
- This invention objectifies and quantifies the data in the form of an assessment matrix with weight-assigned attributes and with associated functions, thereof, in order to provide a repeatable holistic view of the learning process or educational institute. In other words, the matrix provides a 360° view in relation to the strengths and development areas of a given system with an objective to benefit the entire learning system or educational institute.
- a scoring mechanism adapted to provide a score for each of said predefined parameters from a parameter-specific performance based on written, verbal, and activity-based tests conducted for students, teachers, and the institute. These scores are then marked in a pre-defined scoring system.
- a scorecard for each of the Parameters, each of the Factors, and each of the Aspects is generated.
- quality learning in a system is defined as a cumulative score of the scores of all aspects involved in the learning process or educational institute.
- This assessment matrix broadly has at least three major mechanisms - Assessment Mechanism (AM), Scoring Mechanism (SM) [includes, but is not limited to, Parameter Scoring Mechanism (PSM), Factor Scoring Mechanism (FSM), Aspect Scoring Mechanism (ASM)] , and Relationship Builder Mechanism (RB).
- AM - Assessment Mechanism
- SMM Parameter Scoring Mechanism
- FSM Factor Scoring Mechanism
- ASM Aspect Scoring Mechanism
- RB Relationship Builder Mechanism
- FIG. 5 illustrates that a report is generated by scores received from a Parameter Scoring Mechanism (PSM), Factor Scoring Mechanism (FSM), Aspect Scoring Mechanism (ASM), and Relationship Builder Mechanism (RB).
- PSM Parameter Scoring Mechanism
- FSM Factor Scoring Mechanism
- ASM Aspect Scoring Mechanism
- RB Relationship Builder Mechanism
- All sub-mechanisms of the scoring mechanism use pre-defined weights to generate scores.
- an Assessment Mechanism collects inputs for the pre-defined set of parameters and sub- parameters from mechanisms such as, but not limited to, actual tests, feedbacks, discussions, observations, audits, data, and the like.
- the pre-defined sets of parameters and sub-parameters are all parameters associated with a learning system or educational institute and are essential for quality learning and efficient functioning of the learning system or educational institute.
- the current invention connects / facilitates collection of inputs from multiple sources for a parameter or sub-parameter.
- the inputs from the assessment mechanism (AM) are then sent to the scoring mechanism (SM).
- the inputs are segregated in form of Primary data (PD), Secondary data (SD), Tertiary data (TD), and so on.
- PD Primary data
- SD Secondary data
- TD Tertiary data
- Each input primary, secondary, tertiary data
- ⁇ pre-defined percentage
- ⁇ pre-defined weights
- the scoring mechanism comprises at least an aspect scoring mechanism (ASM), at least a factor scoring mechanism (FSM), and at least a parameter scoring mechanism (PSM).
- ASM aspect scoring mechanism
- FSM factor scoring mechanism
- PSM parameter scoring mechanism
- an Aspect Scoring Mechanism (ASM).
- the scores of interrelated or standalone factors are processed in this mechanism to generate an aspect score (level 1).
- At least a weight assignment mechanism (WAM) is used in a correlational manner with the aspect scoring mechanism (ASM) in order to provide a weighted aspect score (level 1).
- the Aspect Scoring Mechanism is a scoring mechanism through which a single aspect score is generated by combination of one or more factor scores of related factors
- a Factor Scoring Mechanism FSM
- the parameter score is converted to a factor score (level 2) using pre-defined weights ( ⁇ ) which is assigned to each parameter.
- At least a weight assignment mechanism WAM is used in a correlational manner with the factor scoring mechanism (FSM) in order to provide a weighted factor score (level 2).
- the factor scoring mechanism is a scoring mechanism through which a single factor score is generated by combination of one or more parameter scores of related parameters or sub parameters.
- a Parameter Scoring Mechanism In the parameter scoring mechanism, inputs are segregated in to primary secondary, tertiary data, and the like. This data is converted to parameter score (level 3) using pre-defined percentages ( ⁇ ). If learning matrix is applied to more than one learners, then Average Parameter Score is generated for the learning system or educational institute. At least a weight assignment mechanism (WAM) is used in a correlational manner with the parameter scoring mechanism (PSM) in order to provide a weighted parameter score (level 3).
- WAM weight assignment mechanism
- the parameter scoring mechanism is a scoring mechanism through which a single parameter score is generated using one or more sources which are derived from which are derived from tests as defined in this specification. These may be in the form of written tests, interview tests, game tests, activity tests, and the like. A hierarchal model using pre-defined percentage ( ⁇ ) is used.
- Figure 3 illustrates a graphical diagram of aspects, factors, and parameters / sub- parameters and levels associated, thereof.
- Scores are first derived at Parameter level (level 3), then at Factor (level 2), and then at Aspect level (level 1). They are cumulated as they are derived from Parameter level (level 3) to Factor level (level 2) to Aspect level (level 1) in order to form a report (R).
- parameters and sub- parameters may comprise conceptual learning (al . l), PSS (al .2), brain flexibility (a 1.3), analytical reasoning (al .4), creativity (al .5), curiosity (al .6), interpersonal skills (a2.1), communication skills (a2.2), hard working (a2.3), and the like.
- factors may comprise competency skills for a student (al ), life skills for a student (a2), competency skills for a teacher (bl), and professional skills for a teacher (b2).
- aspects may comprise student performance (A), teacher contribution (B), support factor for teachers and students (C), school infrastructure (D), and school brand (E).
- a relationship builder mechanism consumes scores in correlation with parameters, factors, and aspects i.e. from the parameter scoring mechanism (PSM), the factor scoring mechanism (FSM), and the aspects scoring mechanism (ASM). Further, the relationship builder mechanism (RB) establishes correlations and trends based on, but not limited to, various data analysis, data mining, data interpretation techniques such as, but not limited to, statistical, cognitive models, linear and non-linear modeling, predictive techniques, and so on. The relations can be built at Parameter, Factor, and / or Aspect level.
- Figure 4 illustrates a flowchart relating to generation of report using a relationship builder mechanism and data from an assessment mechanism and from a scoring mechanism.
- the scores correlating to Aspects, Factors, and Parameters are used to derive meaningful correlations, trends, and statistical insights.
- the insights are derived based on, but not limited to, various data analysis, data mining, data interpretation techniques such as, but not limited to, statistical, cognitive models, linear and non-linear modeling, predictive techniques, and so on.
- the insights are used to bring out the strengths, development areas, possible risks and opportunities for learner, learning facilitator, and the learning system as a whole.
- the insights from the relationship builder mechanism (RB) are then compiled into a report.
- the current invention facilitates to generate report at a plurality of levels; such as individual level, parameter level, factor level, aspect level, and / or learning system level. It also allows the report at much wider level that covers more than one learning systems.
- a weight assignment mechanism adapted to assign weights to each of the pre-defined parameters.
- a parameter weight is dependent on the importance and priority of the parameter.
- This weight assignment mechanism provides a non-equal model for assessment so that the parameters are graded and not given equal weightage.
- Pre-defined set of weights in the assessment depend on their importance and can range from 0-100%.
- the parameters and sub-parameters are analyzed based on pre-defined set of weights built into the assessment model. Each parameter, skill, or sub-skill has unique pre-defined weight which is used to compute the score of the parameter.
- the score of each parameter and sub- parameter, thereof is calculated using the assessment model. These scores are used to generate an overall score of the institute. After this computation, a report (R) is generated depicting the parameter score, general trend across the educational institute, correlation of skills, and interpretation of the trends and scores.
- R Report (R) of the analysis is generated at individual student and teacher level, Parameter level (level 1), Factor level (level 2), and / or Aspect level (level 3) with the appropriate data representation techniques.
- Primary / Secondary / tertiary data of each of the parameters or the sub- parameters is the actual score obtained by assessment through methods such as, but not limited to, written test, feedback, discussion, activities, observation, and audit.
- the parameters or the sub-parameters can be of living and non-living entities, such as but not limited to, physical asset or technology or personal traits / skills / learning aids / processes / facility which helps or is a requirement in learning process.
- the number of parameters included can be from zero (or 1) to any number.
- the pre-defined percentage ( ⁇ ) is the percentage factor applied to inputs from the assessment mechanism (AM) to get parameter score and can vary from 0-100% depending on parameter. It can also be a mathematical expression used as a factor. The number of primary / secondary / tertiary may vary.
- the Parameter or sub-parameter Score for an individual can represented as:
- FSM factor scoring mechanism
- the symbol, ' ⁇ ', involved in calculating the factor score can be a number or a mathematical function or expression.
- the mathematical representation can be used for more than one individual to derive population-level insights.
- the use of the present invention's assessment mechanism is that it gives factual data that provides objectivity to the assessment. For example, communication skills of a teacher are normally assessed based on general and communication with students in a class. This might not necessary tell the level of expertise of a teacher. In at least one embodiment of this invention, this parameter is assessed on verbal and written communication test. The results of these parameters are validated with students' learning parameters. This gives a factual data on which teacher can relate and work on so that there is improvement in skills, and hence in the score related to that parameter.
- the use of this invention also provides assessment that is output based i.e.
- the assessment mechanism assesses the output of an educational institute rather than inputs (such as resources). For example, most of the accreditations (of the prior art) assess the educational institute based on the resources available at the institute. The present invention measures the quality learning with these resources and compares these outcomes with efficiency of operation of an educational institute.
- This present invention provides assessment which helps an educational institute to identify its strengths and challenging areas.
- students' and teachers' performances are assessed based on the parameter specific tests carried out using written tests, discussions (interviews), projects, and games which can be activity based.
- the INVENTIVE STEP of this invention lies in providing a system and method which provides a holistic, dynamic, and customized assessment for educational institutes based on a plurality of parameters (including skills and sub-skills) and their correlations, thereof.
- This provides fact based assessment which may include both subjective as well as objective assessment from output based perspective of the educational institute.
- the assessment contains at least these four aspects: i) institute's assets, which includes institute's brand and infrastructure; ii) teaching quality, which asses current teaching capabilities, teachers' competency and life skills, gaps in teaching and teachers' professional growth potential; iii) students' performance, which includes assessment of student's competency and, life skills; and iv) supporting data of students and teachers, which help in quality learning process.
- the system and method of this invention also provide a methodical correlation of parameters and sub- parameters which gives analytical insights that helps students / institute in actual learning process. It also helps schools to understand their overall trends and helps schools towards their overall (or 360 degree) growth.
- the data, in each of the components, means, modules, mechanisms, units, devices of the system and method may be 'encrypted' and suitably 'decrypted' when required.
- the systems described herein can be made accessible through a portal or an interface which is a part of, or may be connected to, an internal network or an external network, such as the Internet or any similar portal.
- the portals or interfaces are accessed by one or more of users through an electronic device, whereby the user may send and receive data to the portal or interface which gets stored in at least one memory device or at least one data storage device or at least one server, and utilises at least one processing unit.
- the portal or interface in combination with one or more of memory device, data storage device, processing unit and serves, form an embedded computing setup, and may be used by, or used in, one or more of a non-transitory, computer readable medium.
- the embedded computing setup and optionally one or more of a non-transitory, computer readable medium, in relation with, and in combination with the said portal or interface forms one of the systems of the invention.
- Typical examples of a portal or interface may be selected from but is not limited to a website, an executable software program or a software application.
- the systems and methods may simultaneously involve more than one user or more than one data storage device or more than one host server or any combination thereof.
- a user may provide user input through any suitable input device or input mechanism such as but not limited to a keyboard, a mouse, a joystick, a touchpad, a virtual keyboard, a virtual data entry user interface, a virtual dial pad, a software or a program, a scanner, a remote device, a microphone, a webcam, a camera, a fingerprint scanner, a cave, pointing stick
- the systems and methods can be practiced using any electronic device which may be connected to one or more of other electronic device with wires or wirelessly which may use technologies such as but not limited to, NFC, Bluetooth, Wi-Fi, Wimax. This will also extend to use of the aforesaid technologies to provide an authentication key or access key or electronic device based unique key or any combination thereof.
- one or more user can be blocked or denied access to one or more of the aspects of the invention.
- Encryption can be accomplished using any encryption technology, such as the process of converting digital information into a new form using a key or a code or a program, wherein the new form is unintelligible or indecipherable to a user or a thief or a hacker or a spammer.
- the term 'encryption' includes encoding, compressing, or any other translating of the digital content.
- the encryption of the digital media content can be performed in accordance with any technology including utilizing an encryption algorithm.
- the encryption algorithm utilized is not hardware dependent and may change depending on the digital content. For example, a different algorithm may be utilized for different websites or programs.
- the term 'encryption' further includes one or more aspects of authentication, entitlement, data integrity, access control, confidentiality, segmentation, information control, and combinations thereof.
- the described embodiments may be implemented as a system, method, apparatus or article of manufacture using standard programming and/or engineering techniques related to software, firmware, hardware, or any combination thereof.
- the described operations may be implemented as code maintained in a "non-transitory, computer readable medium", where a processor may read and execute the code from the non-transitory, computer readable medium.
- a non-transitory, computer readable medium may comprise media such as magnetic storage medium (e.g., hard disk drives, floppy disks, tape, etc.), optical storage (CD-ROMs, DVDs, optical disks, etc.), volatile and nonvolatile memory devices (e.g., EEPROMs, ROMs, PROMs, RAMs, DRAMs, SRAMs, Flash Memory, firmware, programmable logic, etc.), etc.
- the code implementing the described operations may further be implemented in hardware logic (e.g., an integrated circuit chip, Programmable Gate Array (PGA), Application Specific Integrated Circuit (ASIC), etc.).
- PGA Programmable Gate Array
- ASIC Application Specific Integrated Circuit
- the code implementing the described operations may be implemented in "transmission signals", where transmission signals may propagate through space or through a transmission media, such as an optical fibre, copper wire, etc.
- the transmission signals in which the code or logic is encoded may further comprise a wireless signal, satellite transmission, radio waves, infrared signals, Bluetooth, etc.
- the transmission signals in which the code or logic is encoded is capable of being transmitted by a transmitting station and received by a receiving station, where the code or logic encoded in the transmission signal may be decoded and stored in hardware or a non-transitory, computer readable medium at the receiving and transmitting stations or devices.
- An “article of manufacture” comprises non-transitory, computer readable medium or hardware logic, and/or transmission signals in which code may be implemented.
- a device in which the code implementing the described embodiments of operations is encoded may comprise a non-transitory, computer readable medium or hardware logic.
- code implementing the described embodiments of operations may comprise a non-transitory, computer readable medium or hardware logic.
- the article of manufacture may comprise suitable information bearing medium known in the art.
- network means a system allowing interaction between two or more electronic devices, and includes any form of inter/intra enterprise environment such as the world wide web, Local Area Network (LAN) , Wide Area Network (WAN) , Storage Area Network (SAN) or any form of Intranet and Internet.
- LAN Local Area Network
- WAN Wide Area Network
- SAN Storage Area Network
- An electronic device for the purpose of this invention is selected from any device capable of processing or representing data to a user and providing access to a network or any system similar to the internet, wherein the electronic device may be selected from but not limited to, personal computers, tablet computers, mobile phones, laptop computers, palmtops, portable media players, and personal digital assistants.
- the computer readable medium data storage unit or data storage device is selected from a set of but not limited to USB flash drive (pen drive), memory card, optical data storage discs, hard disk drive, magnetic disk, magnetic tape data storage device, data server and molecular memory.
Abstract
Description
Claims
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
IN225MU2014 | 2014-01-22 | ||
IN225/MUM/2014 | 2014-01-22 |
Publications (2)
Publication Number | Publication Date |
---|---|
WO2015114658A2 true WO2015114658A2 (en) | 2015-08-06 |
WO2015114658A3 WO2015114658A3 (en) | 2015-10-08 |
Family
ID=53757864
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
PCT/IN2015/000036 WO2015114658A2 (en) | 2014-01-22 | 2015-01-21 | An assessment system and method for assessing educational institutes |
Country Status (1)
Country | Link |
---|---|
WO (1) | WO2015114658A2 (en) |
Cited By (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN108460139A (en) * | 2018-03-09 | 2018-08-28 | 上海开放大学 | Based on web crawlers data mining online course Management System for Evaluation Teaching Quality |
CN109784731A (en) * | 2019-01-17 | 2019-05-21 | 上海三零卫士信息安全有限公司 | A kind of private education mechanism credit scoring system and its construction method |
Family Cites Families (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP2004279808A (en) * | 2003-03-17 | 2004-10-07 | Univ Saga | Telelearning system |
CN101937554A (en) * | 2010-09-15 | 2011-01-05 | 西安电子科技大学 | AHP (Analytic Hierarchy Process) based assessment method of teaching quality of fuzzy comprehensive remote education |
CN103226796A (en) * | 2013-04-02 | 2013-07-31 | 浙江大学 | Method for evaluating quality of whole process of on-line education service |
-
2015
- 2015-01-21 WO PCT/IN2015/000036 patent/WO2015114658A2/en active Application Filing
Cited By (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN108460139A (en) * | 2018-03-09 | 2018-08-28 | 上海开放大学 | Based on web crawlers data mining online course Management System for Evaluation Teaching Quality |
CN108460139B (en) * | 2018-03-09 | 2022-09-06 | 上海开放大学 | Online course teaching quality assessment management system based on web crawler data mining |
CN109784731A (en) * | 2019-01-17 | 2019-05-21 | 上海三零卫士信息安全有限公司 | A kind of private education mechanism credit scoring system and its construction method |
Also Published As
Publication number | Publication date |
---|---|
WO2015114658A3 (en) | 2015-10-08 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
Falloon | An analysis of young students' thinking when completing basic coding tasks using Scratch Jnr. On the iPad | |
Riel et al. | Charting digital literacy: A framework for information technology and digital skills education in the community college | |
Natia et al. | Promoting teaching and learning in Ghanaian Basic Schools through ICT | |
US20130096892A1 (en) | Systems and methods for monitoring and predicting user performance | |
Bamiah et al. | Big data technology in education: Advantages, implementations, and challenges | |
US20120164619A1 (en) | Educational Assessment System and Associated Methods | |
Hilliger et al. | Towards learning analytics adoption: A mixed methods study of data‐related practices and policies in Latin American universities | |
Liu et al. | Mining online discussion data for understanding teachers reflective thinking | |
Ye et al. | Expanding approaches for understanding impact: integrating technology, curriculum, and open educational resources in science education | |
Cobo et al. | Building capacity for learning analytics in Latin America | |
Brohi et al. | Accuracy comparison of machine learning algorithms for predictive analytics in higher education | |
Smith et al. | Assistive technology for students with visual impairments: A research agenda | |
Hristova et al. | Prediction of engineering students’ virtual lab understanding and implementation rates using SVM classification | |
Muslim et al. | Open learning analytics: a systematic literature review and future perspectives | |
AU2017276298A1 (en) | Systems and methods for monitoring and predicting user performance | |
Fasasi et al. | ICT: performance evaluation of community development worker’s in South Africa on e-skills | |
US20150019452A1 (en) | System and method for evaluating assessments | |
WO2015114658A2 (en) | An assessment system and method for assessing educational institutes | |
Efiloğlu Kurt | Learning with smartphones: the acceptance of m-learning in higher education | |
Hargreaves | Digital forensics education: A new source of forensic evidence | |
Swaffield et al. | Educational Assessment in Latin America | |
Foltz et al. | Data mining large-scale formative writing | |
Cubeles et al. | Teachers' use of technology in the university classroom | |
Shapsough et al. | Using machine learning to automate classroom observation for low-resource environments | |
Hendri et al. | A Novel Algorithm for Monitoring Field Data Collection Officers of Indonesia's Central Statistics Agency (BPS) Using Web-Based Digital Technology |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
NENP | Non-entry into the national phase in: |
Ref country code: DE |
|
122 | Ep: pct application non-entry in european phase |
Ref document number: 15742717 Country of ref document: EP Kind code of ref document: A2 |
|
122 | Ep: pct application non-entry in european phase |
Ref document number: 15742717 Country of ref document: EP Kind code of ref document: A2 |
|
32PN | Ep: public notification in the ep bulletin as address of the adressee cannot be established |
Free format text: NOTING OF LOSS OF RIGHTS PURSUANT TO RULE 112(1) EPC (EPO FORM 1205N DATED 28.09.2016) |
|
122 | Ep: pct application non-entry in european phase |
Ref document number: 15742717 Country of ref document: EP Kind code of ref document: A2 |