US20140188849A1 - Item banking system for standards-based assessment - Google Patents

Item banking system for standards-based assessment Download PDF

Info

Publication number
US20140188849A1
US20140188849A1 US14/091,165 US201314091165A US2014188849A1 US 20140188849 A1 US20140188849 A1 US 20140188849A1 US 201314091165 A US201314091165 A US 201314091165A US 2014188849 A1 US2014188849 A1 US 2014188849A1
Authority
US
United States
Prior art keywords
item
standards
test
specification
items
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Abandoned
Application number
US14/091,165
Inventor
Brian Benson
John Robert Bergan
Scott Cunningham
Karyn Nochumsun
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Assessment Tech Inc
Original Assignee
Assessment Tech Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Priority to US96367507P priority Critical
Priority to US96367607P priority
Priority to US12/222,384 priority patent/US8630577B2/en
Application filed by Assessment Tech Inc filed Critical Assessment Tech Inc
Priority to US14/091,165 priority patent/US20140188849A1/en
Publication of US20140188849A1 publication Critical patent/US20140188849A1/en
Application status is Abandoned legal-status Critical

Links

Images

Classifications

    • G06F17/30598
    • GPHYSICS
    • G06COMPUTING; CALCULATING; COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/28Databases characterised by their database models, e.g. relational or object models
    • G06F16/284Relational databases
    • G06F16/285Clustering or classification
    • GPHYSICS
    • G09EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09BEDUCATIONAL OR DEMONSTRATION APPLIANCES; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND, DEAF OR MUTE; MODELS; PLANETARIA; GLOBES; MAPS; DIAGRAMS
    • G09B7/00Electrically-operated teaching apparatus or devices working with questions and answers
    • G09B7/02Electrically-operated teaching apparatus or devices working with questions and answers of the type wherein the student is expected to construct an answer to the question which is presented or wherein the machine gives an answer to the question presented by a student

Abstract

An computer item banking system for standards-based assessments has test items used in standards-based assessments wherein a plurality of item specifications are developed using a specification building feature to create new, edit, move, and delete specifications and to assign specifications to one or more standards; a plurality of test items are constructed and edited using a test building feature to specify the type of item being constructed, points available for the item, and the type of bank to which the item is assigned; bank types include agency-wide assessments including benchmark tests and end-of-course examinations, and formative assessments such as classroom quizzes. The system includes means for certification of test items and preventing use of uncertified test items to be used in agency-wide assessments under construction.

Description

    RELATED APPLICATION
  • This application is a continuation of U.S. Ser. No. 12/222,374 filed on Aug. 7, 2008 is expressly incorporated in its entirety herein.
  • Cross-Reference to Related Applications
  • This application is related to U.S. Pat. Nos. 6,322,366, 6,468,085 and 7,065,516 and 8,529,270, all of which patents and application are expressly incorporated in their entirety herein. This application claims benefit under 35 U.S.C. §119(e)(1) of U.S. Provisional Patent Applications 60/963,675 and 60/963,676 which are expressly incorporated in their entirety herein. Additionally the disclosure in U.S. Published Patent Application 200300044762 is expressly incorporated in its entirety herein.
  • Copyright Notice© 2002-2013 Assessment Technology, Inc. A portion of the disclosure of this patent document contains material which is subject to copyright protection. The copyright owner has no objection to the facsimile reproduction by anyone of the patent document or the patent disclosure, as it appears in the Patent and Trademark Office patent file or records, but otherwise reserves all copyright rights whatsoever. 37 CFR §1.71(d).
  • BACKGROUND OF THE INVENTION
  • A major challenge facing educational programs in the 21.sup.st century is to promote learning aimed at the achievement of valued goals or standards. In an effort to assist educators to meet this challenge, an educational management system has been designed to assist programs to promote goal-directed standards-based learning for example as described in U.S. Pat. No. 6,322,366 and No. 6,468,085. The present patent application details additional innovations that enhance the usefulness of the system for learners involved in a variety of standards-based educational programs. A particularly important group of such learners is comprised of elementary and secondary school students receiving instruction aimed at the achievement of federal, state, and local standards.
  • In one educational management system, instruction to promote goal-directed learning is informed by assessment information indicating the capabilities that a learner has acquired and those that the learner will be ready to learn in the future. Item Response Theory (IRT) is used to estimate the probability that a learner will be ready to acquire capabilities reflecting goals that have not yet been mastered. There is room for innovations that enhance the construction of assessments and the use of assessment information to inform goal-directed standards-based learning.
  • SUMMARY OF THE INVENTION
  • The present invention includes new technology to enhance the efficiency of constructing and maintaining item banks containing collections of items used in assessment initiatives requiring that test items be aligned to standards. Standards-based assessment initiatives provide a particularly important example of circumstances calling for the alignment of items to standards (e.g., Ravitch, 2001). In order to construct standards-based assessments using an item bank, bank information must include information on the standards to which the items are aligned.
  • The present invention can be summarized in an item banking system for test items used in standards-based assessments including: (a) Item specifications developed using a Bank Builder feature to create new, edit, move, or delete specifications or assign specifications to one or more standards. (b) Test items constructed and edited using a Bank Builder feature to specify the type of item being constructed, points available for the item, and the type of bank to which the item is assigned. Bank types include: (i) Agency-wide assessments such as benchmark tests and end-of-course examinations. (ii) Formative assessments such as classroom quizzes. (c) Item review and certification, including: (i) In-system item review, directly linked to an item specification and including all items associated with the selected specification. (ii) Allowance for the reviewer to classify items in terms of review categories, e.g. Not Reviewed, Needs Modification, Accept, and Accept and Certify. (iii) Item display by category. (iv) Ability for item reviewers to include comments on the item being reviewed. (v) Item writer response to review comments and direct access to the reviewed item for editing. (vi) System protection from using not yet certified items to be used in assessments under construction. (d) Classification and mapping procedures that make it possible to efficiently map items to multiple sets of standards. Items may be mapped to item specifications, which are then mapped to standards in multiple states. (i) Data objects are classified as test items, item attributes, and item specifications using a hierarchical tree structure. (ii) Sets of items may be matched to each standard. (iii) An item and a specification can be mapped to only one class. (iv) An item class can be mapped to only one standard within a given set of standards. (v) Sets of items can be mapped to more than one standard when each standard is in a different set of standards. (vi) This hierarchal model method differs from cross-indexed mapping of items to multiple-state standards. (vii) Provides increased information for the alignment of a set of items to a particular standard. (e) The ability to leverage the formative item bank as an element of K-12 instruction.
  • BRIEF DESCRIPTION OF THE DRAWINGS
  • FIGS. 1, 4, 7, 10, 13, 17, 20, 23, 26 and 29 are step diagrams setting forth the operation and construction of the item banking system for standards-based assessment of the present invention.
  • FIGS. 2, 3, 5, 6, 8, 9, 11, 12, 14, 15, 16, 18, 19, 21, 22, 24, 25, 27, 28, 30, 31, 32 and 33 are illustrations of computer screens of the item banking system for standards-based assessment of the present invention setting forth various steps the above step diagrams.
  • DETAILED DESCRIPTION OF THE INVENTION
  • The assessment innovations include new technology to enhance the efficiency of constructing and maintaining item banks containing collections of items used in assessment initiatives requiring that test items be aligned to standards. Standards-based assessment initiatives provide a particularly important example of circumstances calling for the alignment of items to standards (e.g., Ravitch, 2001). In order to construct standards-based assessments using an item bank, bank information must include information on the standards to which the items are aligned.
  • The task of constructing item banks containing information aligning items to standards can be complex. The complexity arises from the fact that item banks must accommodate varying sets of standards generated by multiple agencies (e.g., state departments of education) using different terminology to label standards. For example, consider the following excerpt from a Massachusetts Learning Standard: “Accurately and efficiently add, subtract, multiply, and divide positive fractions and mixed numbers. Simplify fractions.” This standard covers multiple skills. By contrast the following Arizona Performance Objective covers one capability: “Multiply proper fractions.” This capability is included in the specification of the more complex Massachusetts Learning Standard. The material that follows outlines an innovative system for developing and maintaining item banks for standards-based Assessment initiatives requiring the alignment of items to multiple sets of standards.
  • The material in this section discusses innovations aimed at meeting the unique requirements associated with the construction and maintenance of item banks designed to serve standards-based assessment initiatives. The major tasks associated with the construction and maintenance of item banks include procedures to construct new items, to edit existing items, to delete items or make them inactive, to review items, to enter item attributes such as parameter estimates, and to enter the history of item administration. The system is unique in that all of the procedures involved in bank construction and maintenance are designed to support standards-based assessment initiatives involving the alignment of sets of items to multiple sets of standards. The discussion that follows details the innovative tools that have been developed for item construction and maintenance and spells out the ways in which those tools contribute to construction and maintenance efficiency and quality assurance in standards-based assessment.
  • Item Specifications Guiding Item Construction and Maintenance
  • All of the procedures involved in item construction and maintenance are guided by detailed sets of item specifications providing precise information regarding the required characteristics of the items included in the bank (e.g. Millman & Greene, 1989). Each item specification defines an item class comprised of sets of items conforming to the requirements of the specification. Item specifications are developed using the Bank Builder module of the Educational Management System. Bank Builder allows the user to create a new specification, edit a specification, delete a specification, move a specification to a different folder, or assign the specification to one or more standards.
  • The item specification screen for creating and editing specifications allows the user to enter a title for the specification, the description of the item class defined by the specification and the requirements that must be met for membership in the class. In addition, the user can assign a prototype item to the specification to serve as a model for the construction of items meeting specification requirements. Each item specification may be assigned to one or more sets of learning standards and to one standard within each set of standards. The standards and sets of standards to which the specification has been assigned are listed on the item specification screen.
  • In the system, item specifications are linked directly to item construction, item editing, and item review. These links promote the direct application of specifications during the construction, editing, and review processes. Most importantly, they are the key to making it possible to link sets of items to multiple sets of standards.
  • Item Construction and Editing Procedures
  • Item construction and editing are carried out using Bank Builder. Bank Builder allows the user to specify the type of item to be constructed, the points available for the item, and the type of bank to which the item is assigned. The system accommodates two types of banks: One includes items to be used in extended formal agency-wide assessments such as benchmark tests and end-of-course examinations. The second type contains items used in formative assessments such as classroom quizzes.
  • Bank Builder provides standard text editing and equation editing features that can be used to construct a broad range of item types including multiple choice items, true-false items, yes-no items, short answer items, extended constructed response items, and work samples. The system is also capable of importing items involving animation. In addition, Bank Builder can automatically generate various kinds of charts and can import images and assign them to particular components of an item. For example, a multiple-choice item might include an image attached to the item stem and images attached to each of the alternatives. Bank Builder includes an Item Family feature that makes it possible to link a set of items to a text or image. Items linked in this fashion are displayed along with the linked text or image, which appears only once. For multiple-choice items, Bank Builder includes the option of randomizing the order in which alternatives are displayed. For constructed response and work sample items, Bank Builder allows the item writer to specify scoring rules for assigning points to examinee responses.
  • The link binding each item created in Bank Builder to an item specification is established when a new item is created. Bank Builder requires that each new item be assigned to an item specification. As soon as the assignment is made, the specification can be linked to all bank construction and maintenance procedures. The item specification can be displayed in a popup window as a new item is written or as an item is edited. The easy availability of the specification enhances efficiency during the item creation and item editing processes. When a specification is not readily available, it may take time to retrieve it. Moreover, in some instances the specification may not be found, in which case there will likely be a temptation to write items based on the writer's memory of the specification. This may lead to the production of items that do not match specification requirements.
  • Item editing tools in the system include the capability to edit one item displayed on a single screen or to edit on a screen displaying all of the items included in an item specification. The screen displaying all items is particularly useful for making edits to insure consistent adherence to specification requirements. The item writer using this screen is able to view the specification, make a series of edits to multiple items and save all of the edits at once.
  • Item Review and Certification Procedures
  • Item review and certification processes in the system provide information on the extent to which items meet specifications. The item-review feature of the system contains a number of unique features:
  • The item review screen displays items directly linked to an item specification. The set of items that can be displayed includes all items associated with the selected specification.
  • The item specification can be displayed in a popup window linked to the review screen.
  • The item review screen allows the reviewer to classify items in terms of review categories. For example, items may be classified in terms of the following categories: Not Reviewed, Needs Modification, Accept, and Accept and Certify.
  • Items can be displayed by category. For example, a reviewer may elect to display only those items already classified as needing modification.
  • A comment box allows the reviewer to explain the basis for the selected classification.
  • An item writer responding to a review may click on an item displayed in the review screen and be taken directly to a screen allowing the writer to edit the item.
  • The system automatically prevents items that have not been certified from being used in assessments under construction.
  • Classification and Mapping Procedures
  • Unique classification and mapping procedures have been developed to make it possible to efficiently map items to multiple sets of standards. The procedures classify data objects including test items, item attributes, and item specifications (e.g. Millman & Greene, 1989) using a standard hierarchical tree structure. The leaf nodes in the structure are data objects containing items and their attributes. Each data object belongs to a single item class specified in a parent node, which contains one unique item specification and one class label. For example, a set of items might be included in a class labeled Multiplication of Proper Fractions. A standard item specification (e.g. Millman & Greene, 1989) defines the requirements for membership in the class and provides a prototype item illustrative of class membership.
  • The procedures make it possible to map an item class including the item specification, class label, and the sets of data objects (items and attributes) included in the class to different sets of standards. For example, items and attributes in the Multiplication of Proper Fractions class could be mapped to a standard in Arizona and to a standard in Massachusetts. The technology restricts the mapping to one standard within a standard set. Thus, if items in the Multiplication of Proper Fractions class were mapped to a particular performance objective in Arizona, they could not be mapped to another performance objective in that state.
  • The classification and mapping procedures increase efficiency in item bank construction and maintenance in the following ways:
  • Sets of items rather than individual items are mapped to each standard. This reduces that labor involved in aligning items to a standard.
  • An item can belong to only one class and an item specification can belong to only one class. This reduces the likelihood of creating duplicate items and assigning duplicate items to the same standard.
  • An item class can be mapped to only one standard within a given set of standards. This reduces the likelihood of assigning duplicate items to different standards measured on the same assessment. It also helps to insure that any given standard will be assessed by a unique set of items.
  • Sets of items can be mapped to more than one standard when each standard is in a different set of standards. This increases the number of items available for assessments constructed using different sets of standards.
  • Many variations, modifications and changes may be made in the above described example without departing from the scope and spirit of the invention.

Claims (16)

1. A computer-implemented item banking system for test items used in standards-based student assessments comprising:
a plurality of item specifications, wherein each item specification is associated to exactly one performance objective of a predetermined educational standard, wherein
each item specification is arranged to inform an author in creating a corresponding class of assessment items suitable for assessing student ability relative to the corresponding performance objective, wherein the item specification includes a title, a description of an item class defined by the item specification, and a set of requirements for an assessment item to be included in the corresponding class;
each item specification stored in a digital library of the item banking system with a link, identifier or other association to the corresponding performance objective; and
a plurality of test items each constructed so as to comply with a selected one of the item specifications, whereby a user of the banking system can construct a test aligned to one performance objective by selecting at least one of the test items that are compliant with the corresponding item specification.
2. The computer-implemented item banking system of claim 1 further comprising:
an interactive test building feature further enabling a user to specify a type of test item being constructed, points available for the test item, and a selected type of item bank to which the test item is assigned; and
wherein the item bank type is selectable from available item bank types including an agency-wide benchmark assessments item bank type, and a formative assessments item bank type.
3. The computer-implemented item banking system according to claim 1 wherein a test item and an item specification are each mapped to only one item class, and an item class is mapped to only one standard within a single set of standards.
4. The computer-implemented item banking system according to claim 1 wherein a set of test items, via mapping to an item specification, are mapped to more than one standard only when each of the standards is in a different set of standards.
5. A non-transitory computer-readable medium encoded with a computer executable instructions for implementing the recited features of claim 1.
6. The computer-implemented item banking system according to claim 1 including a test item review feature, to confirm compliance of a test item with an associated item specification, wherein the system is configured to generate a display of a selected item specification in a popup window within a review screen of the test item review feature.
7. A computer-implemented item banking system for test items used in standards-based assessments comprising:
a plurality of item specifications developed using a specification building feature to create new, edit, move, and delete specifications and to assign each item specification to exactly one corresponding performance objective of each of multiple different standards;
a plurality of test items each constructed and edited using a test building feature so as to comply with a selected one of the item specifications;
a test item review and certification feature for certifications of test items, wherein said test item review and certification feature is configured to generate:
a graphical screen display that displays all of the test items linked to a selected one of the plurality of item specifications, so as to assist a user of the system in constructing tests aligned to educational standards; and
a display of available item classifications for a selected test item to enable a reviewer to classify the selected test item in terms of a selected one of a predetermined set of review categories, wherein said set of review categories include Not Reviewed, Needs Modification, and Certify review categories.
8. The computer-implemented item banking system according to claim 7 including system protection for preventing use of test items that are not classified in the Certify category for inclusion in an agency-wide assessment under construction.
9. The computer-implemented item banking system according to claim 7 wherein the system is configured to display the corresponding item specification while a user is using the test building feature to create a new test item, to help ensure compliance with the item specification.
10. A computer-implemented method to construct a test aligned to educational standards in the K-12 domain, the method comprising:
(a) storing, in a memory, first data comprising a first set of educational standards promulgated by a first agency, each one of the first set of standards comprising at least one corresponding performance objective PO;
(b) in a user interface, displaying at least one of the stored performance objectives of the first set of educational standards;
(c) for each of the displayed performance objectives, specifying the PO in the screen display by corresponding subject, scale, concept, and brief description; [for example, M07-S1C2-01. Express fractions as decimals.]
(d) receving, via the user interface, a user selection of one of the displayed performance objectives;
(e) searching an electronic databank of assessment items to idenfify are linked or related in the database to the selected performance objective;
(f) responsive to the user selection and the user search request, searching the database to find assessment items that are linked to the selected performance objective;
(g) in the user interface, displaying results of the search, including in the search results display at least one assessment item that is linked to the selected performance objective;
(h) receving via the user interface, a user selection of one item from the displayed search results; and
(i) responsive to a user input request, adding the user-selected item to the Dialog, thereby enabling the user to include in the dialog an assessment item aligned to the selected performance objective of the first set of educational standards.
11. A computer-implemented method for mapping assessment items across educational performance standards, the method comprising:
(a) storing, in a storage, first data comprising a first set of educational standards promulgated by a first agency, each one of the first set of standards comprising at least one corresponding performance objective;
(b) storing, in said storage, second data comprising a second set of educational standards promulgated by a second agency, each one of the second set of standards comprising at least one corresponding performance objective;
(c) using a computer having access to the storage, creating at least one item specification, the item specification including a title for the item specification, a description of an item class defined by the item specification, and requirements for membership of an assessment item in the item class, the requirements including at least one specified performance objective; and
(d) using the computer, assigning the item specification to exactly one performance objective in the first set of educational standards, and to exactly one performance objective in the second set of educational standards.
12. The method of claim 11 and further comprising:
(e) using the computer, storing the item specification in association with a selected library of test items;
(f) using the computer, creating a new item to add to a selected library of test items, wherein creating said new item includes selecting an item bank question type, entering a point value for the new item, and the selecting a type of bank to which the new item is assigned; and
(g) using the computer, mapping the new item to a selected item specification, whereby the item is automatically and correctly associated to both the first set of standards and the second set of standards.
13. The method of claim 11 wherein the first and second agencies are different educational entities within the U.S. federal government.
14. The method of claim 11 wherein the first and second agencies are different state education agencies.
15. The method of claim 11 wherein exactly one of the first and second agencies are different local education agencies.
16. The method of claim 11 wherein one of the first and second agencies is a state, local or federal education agency within a different parent agency than the other one of the first and second agencies.
US14/091,165 2007-08-07 2013-11-26 Item banking system for standards-based assessment Abandoned US20140188849A1 (en)

Priority Applications (4)

Application Number Priority Date Filing Date Title
US96367507P true 2007-08-07 2007-08-07
US96367607P true 2007-08-07 2007-08-07
US12/222,384 US8630577B2 (en) 2007-08-07 2008-08-07 Item banking system for standards-based assessment
US14/091,165 US20140188849A1 (en) 2007-08-07 2013-11-26 Item banking system for standards-based assessment

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
US14/091,165 US20140188849A1 (en) 2007-08-07 2013-11-26 Item banking system for standards-based assessment

Related Parent Applications (1)

Application Number Title Priority Date Filing Date
US12/222,384 Continuation US8630577B2 (en) 2007-08-07 2008-08-07 Item banking system for standards-based assessment

Publications (1)

Publication Number Publication Date
US20140188849A1 true US20140188849A1 (en) 2014-07-03

Family

ID=40789087

Family Applications (3)

Application Number Title Priority Date Filing Date
US12/222,385 Abandoned US20090162827A1 (en) 2007-08-07 2008-08-07 Integrated assessment system for standards-based assessments
US12/222,384 Active 2030-03-19 US8630577B2 (en) 2007-08-07 2008-08-07 Item banking system for standards-based assessment
US14/091,165 Abandoned US20140188849A1 (en) 2007-08-07 2013-11-26 Item banking system for standards-based assessment

Family Applications Before (2)

Application Number Title Priority Date Filing Date
US12/222,385 Abandoned US20090162827A1 (en) 2007-08-07 2008-08-07 Integrated assessment system for standards-based assessments
US12/222,384 Active 2030-03-19 US8630577B2 (en) 2007-08-07 2008-08-07 Item banking system for standards-based assessment

Country Status (1)

Country Link
US (3) US20090162827A1 (en)

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20090162827A1 (en) * 2007-08-07 2009-06-25 Brian Benson Integrated assessment system for standards-based assessments
US20110200978A1 (en) * 2010-02-16 2011-08-18 Assessment Technology Incorporated Online instructional dialog books
US20140188746A1 (en) * 2012-12-31 2014-07-03 Jiaojiao Li Systems, methods, and devices for determining alignment of education content to one or more education standards
CN105373564A (en) * 2014-08-29 2016-03-02 深圳锐取信息技术股份有限公司 Objective structured clinical examination framework based examination station table generation method and apparatus

Families Citing this family (12)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8529270B2 (en) 2003-12-12 2013-09-10 Assessment Technology, Inc. Interactive computer system for instructor-student teaching and assessment of preschool children
US20110200979A1 (en) * 2007-09-04 2011-08-18 Brian Benson Online instructional dialogs
US8798522B2 (en) * 2008-04-28 2014-08-05 Nexlearn, Llc Simulation authoring tool
US20100062411A1 (en) * 2008-09-08 2010-03-11 Rashad Jovan Bartholomew Device system and method to provide feedback for educators
WO2010065553A2 (en) * 2008-12-01 2010-06-10 Trinity Education Group, Inc. Methods and systems for creating educational resources and aligning educational resources with benchmarks
US20110066476A1 (en) * 2009-09-15 2011-03-17 Joseph Fernard Lewis Business management assessment and consulting assistance system and associated method
US9299266B2 (en) 2010-09-24 2016-03-29 Lexia Learning Systems Llc System for performing assessment without testing
US20120214147A1 (en) * 2011-02-16 2012-08-23 Knowledge Factor, Inc. System and Method for Adaptive Knowledge Assessment And Learning
CA2854639A1 (en) 2011-10-25 2013-05-02 Aquimo, Llc Method to provide dynamic customized sports instruction responsive to motion of a mobile device
WO2013126701A1 (en) * 2012-02-24 2013-08-29 National Assoc. Of Boards Of Pharmacy Test pallet assembly and family assignment
US20140272892A1 (en) * 2013-03-15 2014-09-18 Edison Learning Inc. On-line custom course builder
WO2017074169A1 (en) * 2015-10-28 2017-05-04 PACHECO NAVARRO, Diana Method implemented by a computing unit for the classification and pairing of mathematics learning packets with classes of students

Family Cites Families (106)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US4967354A (en) * 1987-06-18 1990-10-30 Tescor, Inc. Method of preparing customized written examinations
US5174759A (en) 1988-08-04 1992-12-29 Preston Frank S TV animation interactively controlled by the viewer through input above a book page
US5059127A (en) 1989-10-26 1991-10-22 Educational Testing Service Computerized mastery testing system, a computer administered variable length sequential testing system for making pass/fail decisions
JPH04113385A (en) 1990-09-03 1992-04-14 Fujitsu Ltd Remote lecture system
US5122952A (en) * 1990-10-22 1992-06-16 Minkus Leslie S Method and apparatus for automated learning tool selection for child development
JPH04241381A (en) * 1991-01-16 1992-08-28 Brother Ind Ltd Electronic learning machine
US5326270A (en) * 1991-08-29 1994-07-05 Introspect Technologies, Inc. System and method for assessing an individual's task-processing style
US5173051B1 (en) * 1991-10-15 1997-06-10 Optical Data Corp Curriculum planning and publishing method
US5267865A (en) 1992-02-11 1993-12-07 John R. Lee Interactive computer aided natural learning method and apparatus
US5310349A (en) 1992-04-30 1994-05-10 Jostens Learning Corporation Instructional management system
US5411271A (en) * 1994-01-03 1995-05-02 Coastal Amusement Distributors, Inc. Electronic video match game
US5893717A (en) * 1994-02-01 1999-04-13 Educational Testing Service Computerized method and system for teaching prose, document and quantitative literacy
US5810605A (en) * 1994-03-24 1998-09-22 Ncr Corporation Computerized repositories applied to education
US5537587A (en) * 1994-05-11 1996-07-16 International Business Machines Corporation File record maintenance in a data processing system by synchronization of menus with corresponding data files
CA2151527C (en) 1994-06-13 2009-08-18 Michael E. Jay Method and apparatus for correlating educational requirements
US5558520A (en) 1994-08-23 1996-09-24 Werzberger; Bernice F. Interactive book assembly
JPH0876680A (en) * 1994-09-02 1996-03-22 Fujitsu Ltd Management education system
US5835758A (en) * 1995-02-28 1998-11-10 Vidya Technologies, Inc. Method and system for respresenting and processing physical and conceptual entities
US6315572B1 (en) * 1995-03-22 2001-11-13 William M. Bancroft Method and system for computerized authoring, learning, and evaluation
US5823788A (en) 1995-11-13 1998-10-20 Lemelson; Jerome H. Interactive educational system and method
US6139330A (en) * 1996-03-19 2000-10-31 Ho; Chi Fai Computer-aided learning system and method
US5779486A (en) 1996-03-19 1998-07-14 Ho; Chi Fai Methods and apparatus to assess and enhance a student's understanding in a subject
IL126331A (en) * 1996-03-27 2003-02-12 Michael Hersh Application of multi-media technology to psychological and educational assessment tools
US5743746A (en) 1996-04-17 1998-04-28 Ho; Chi Fai Reward enriched learning system and method
US6120300A (en) 1996-04-17 2000-09-19 Ho; Chi Fai Reward enriched learning system and method II
US6535713B1 (en) * 1996-05-09 2003-03-18 Verizon Services Corp. Interactive training application
US5727950A (en) * 1996-05-22 1998-03-17 Netsage Corporation Agent based instruction system and method
US5727951A (en) 1996-05-28 1998-03-17 Ho; Chi Fai Relationship-based computer-aided-educational system
US5864869A (en) 1996-07-18 1999-01-26 Doak; Ron K. Method and manufacture of lesson plans and classroom organizers utilizing computers and software
WO1998013807A1 (en) 1996-09-25 1998-04-02 Sylvan Learning Systems, Inc. Automated testing and electronic instructional delivery and student management system
US6202060B1 (en) 1996-10-29 2001-03-13 Bao Q. Tran Data management system
US6091930A (en) 1997-03-04 2000-07-18 Case Western Reserve University Customizable interactive textbook
US20020182579A1 (en) * 1997-03-27 2002-12-05 Driscoll Gary F. System and method for computer based creation of tests formatted to facilitate computer based testing
JPH10333538A (en) * 1997-05-29 1998-12-18 Fujitsu Ltd Network type education system, record medium recording instructor side program of network type education system and record medium recording participant side program
US6044387A (en) * 1997-09-10 2000-03-28 Microsoft Corporation Single command editing of multiple files
US6112049A (en) 1997-10-21 2000-08-29 The Riverside Publishing Company Computer network based testing system
US5927988A (en) * 1997-12-17 1999-07-27 Jenkins; William M. Method and apparatus for training of sensory and perceptual systems in LLI subjects
US6029043A (en) 1998-01-29 2000-02-22 Ho; Chi Fai Computer-aided group-learning methods and systems
US6077085A (en) * 1998-05-19 2000-06-20 Intellectual Reserve, Inc. Technology assisted learning
US6322366B1 (en) * 1998-06-30 2001-11-27 Assessment Technology Inc. Instructional management system
US6042384A (en) 1998-06-30 2000-03-28 Bookette Software Company Computerized systems for optically scanning and electronically scoring and reporting test results
US6398556B1 (en) 1998-07-06 2002-06-04 Chi Fai Ho Inexpensive computer-aided learning methods and apparatus for learners
US6471521B1 (en) 1998-07-31 2002-10-29 Athenium, L.L.C. System for implementing collaborative training and online learning over a computer network and related techniques
US6511324B1 (en) * 1998-10-07 2003-01-28 Cognitive Concepts, Inc. Phonological awareness, phonological processing, and reading skill training system and method
US6149441A (en) * 1998-11-06 2000-11-21 Technology For Connecticut, Inc. Computer-based educational system
US6305942B1 (en) * 1998-11-12 2001-10-23 Metalearning Systems, Inc. Method and apparatus for increased language fluency through interactive comprehension, recognition and generation of sounds, words and sentences
US6353447B1 (en) 1999-01-26 2002-03-05 Microsoft Corporation Study planner system and method
US6261103B1 (en) * 1999-04-15 2001-07-17 Cb Sciences, Inc. System for analyzing and/or effecting experimental data from a remote location
US6269355B1 (en) * 1999-04-15 2001-07-31 Kadiri, Inc. Automated process guidance system and method using knowledge management system
US6263434B1 (en) * 1999-09-21 2001-07-17 Sun Microsystems, Inc. Signed group criteria
US6282404B1 (en) 1999-09-22 2001-08-28 Chet D. Linton Method and system for accessing multimedia data in an interactive format having reporting capabilities
US6341212B1 (en) * 1999-12-17 2002-01-22 Virginia Foundation For Independent Colleges System and method for certifying information technology skill through internet distribution examination
US6898411B2 (en) 2000-02-10 2005-05-24 Educational Testing Service Method and system for online teaching using web pages
US6505031B1 (en) 2000-02-25 2003-01-07 Robert Slider System and method for providing a virtual school environment
US20010039000A1 (en) * 2000-02-29 2001-11-08 Parsons Thomas Gregory Reading tutor for infants
US6498920B1 (en) 2000-04-18 2002-12-24 We-Comply, Inc. Customizable web-based training system
US7031651B2 (en) 2000-07-21 2006-04-18 Englishtown, Inc. System and method of matching teachers with students to facilitate conducting online private instruction over a global network
US6468085B1 (en) * 2000-07-28 2002-10-22 Assessment Technology Inc. Scale builder and method
US20030028588A1 (en) * 2000-08-01 2003-02-06 Mcconnell Evan Mobile teaching system
EP1320841A1 (en) * 2000-09-28 2003-06-25 Scientific Learning Corp. Method and apparatus for automated training of language learning skills
US6547568B1 (en) 2000-10-12 2003-04-15 Kiyokazu Yamano Education intermediary system and method
US6561812B1 (en) 2000-10-30 2003-05-13 Learncity, Inc. System and method of correlating learning materials with educational objectives
US20020086271A1 (en) 2000-12-28 2002-07-04 Murgia Paula J. Interactive system for personal life patterns
IL156583D0 (en) * 2001-01-09 2004-01-04 Prep4 Ltd Training system and method for improving user knowledge and skills
US20020199118A1 (en) * 2001-02-02 2002-12-26 Medinservice.Com, Inc. Internet training course system and methods
US20060014129A1 (en) 2001-02-09 2006-01-19 Grow.Net, Inc. System and method for processing test reports
US6813474B2 (en) 2001-02-24 2004-11-02 Echalk: L.L.C. System and method for creating, processing and managing educational content within and between schools
US6789047B1 (en) 2001-04-17 2004-09-07 Unext.Com Llc Method and system for evaluating the performance of an instructor of an electronic course
US6554618B1 (en) * 2001-04-20 2003-04-29 Cheryl B. Lockwood Managed integrated teaching providing individualized instruction
US20030039949A1 (en) 2001-04-23 2003-02-27 David Cappellucci Method and system for correlating a plurality of information resources
US20020192631A1 (en) * 2001-05-23 2002-12-19 Chase Weir Method and system for interactive teaching
US20030017442A1 (en) * 2001-06-15 2003-01-23 Tudor William P. Standards-based adaptive educational measurement and assessment system and method
US6904263B2 (en) 2001-08-01 2005-06-07 Paul Grudnitski Method and system for interactive case and video-based teacher training
US6793129B2 (en) 2001-08-17 2004-09-21 Leapfrog Enterprises, Inc. Study aid apparatus and method of using study aid apparatus
US20030044762A1 (en) * 2001-08-29 2003-03-06 Assessment Technology Inc. Educational management system
TW520099U (en) * 2001-12-28 2003-02-01 Hon Hai Prec Ind Co Ltd Board-to-board connector
US7311524B2 (en) * 2002-01-17 2007-12-25 Harcourt Assessment, Inc. System and method assessing student achievement
US20030180703A1 (en) 2002-01-28 2003-09-25 Edusoft Student assessment system
US20040076930A1 (en) * 2002-02-22 2004-04-22 Steinberg Linda S. Partal assessment design system for educational testing
US6676413B1 (en) * 2002-04-17 2004-01-13 Voyager Expanded Learning, Inc. Method and system for preventing illiteracy in substantially all members of a predetermined set
US7860736B2 (en) * 2002-06-28 2010-12-28 Accenture Global Services Gmbh Course content development method and computer readable medium for business driven learning solutions
US7733366B2 (en) * 2002-07-01 2010-06-08 Microsoft Corporation Computer network-based, interactive, multimedia learning system and process
US20040115608A1 (en) 2002-08-29 2004-06-17 Paul Meyer System and method for delivering, receiving and managing continuing educational and training services
US6808267B2 (en) * 2002-10-18 2004-10-26 Childsplay Vision Systems Method for automated mass screening for visual dysfunction in children
US20040229199A1 (en) * 2003-04-16 2004-11-18 Measured Progress, Inc. Computer-based standardized test administration, scoring and analysis system
CA2427786A1 (en) * 2003-05-02 2004-11-02 Auckland Uniservices Limited System, method and computer program for student assessment
AU2004246432A1 (en) 2003-05-14 2004-12-16 Gautam Dharamdas Goradia Interactive system for building, organising, and sharing one's own databank of questions and answers in a variety of questioning formats, on any subject in one or more languages
US20050114160A1 (en) * 2003-11-26 2005-05-26 International Business Machines Corporation Method, apparatus and computer program code for automation of assessment using rubrics
US20050125196A1 (en) * 2003-12-09 2005-06-09 Len Swanson Method and system for computer-assisted test construction performing specification matching during test item selection
US20050221266A1 (en) * 2004-04-02 2005-10-06 Mislevy Robert J System and method for assessment design
US7362997B2 (en) 2004-04-22 2008-04-22 Aurelia Hartenberger Methods and apparatus for curriculum planning
US20060003306A1 (en) * 2004-07-02 2006-01-05 Mcginley Michael P Unified web-based system for the delivery, scoring, and reporting of on-line and paper-based assessments
US7927105B2 (en) * 2004-09-02 2011-04-19 International Business Machines Incorporated Method and system for creating and delivering prescriptive learning
US8385810B2 (en) * 2004-12-30 2013-02-26 Norman J. Nolasco System and method for real time tracking of student performance based on state educational standards
US20060199163A1 (en) * 2005-03-04 2006-09-07 Johnson Andrea L Dynamic teaching method
CA2549438A1 (en) * 2005-06-27 2006-12-27 Mark R. Swanson Wireless classroom response system
US20070111180A1 (en) 2005-10-24 2007-05-17 Sperle Robin U Delivery methods for remote learning system courses
US20070099169A1 (en) * 2005-10-27 2007-05-03 Darin Beamish Software product and methods for recording and improving student performance
US20070122788A1 (en) * 2005-11-28 2007-05-31 Microsoft Corporation Virtual teaching assistant
US20070160969A1 (en) * 2006-01-11 2007-07-12 Barton Benny M Method and Apparatus for Associating User Evaluations with Independent Content Sources
US20070178432A1 (en) * 2006-02-02 2007-08-02 Les Davis Test management and assessment system and method
US9241039B2 (en) 2006-07-11 2016-01-19 West Virginia University Automated tracking of class attendance
US20080038705A1 (en) * 2006-07-14 2008-02-14 Kerns Daniel R System and method for assessing student progress and delivering appropriate content
US20080124696A1 (en) * 2006-10-26 2008-05-29 Houser Ronald L Empirical development of learning content using educational measurement scales
US20080187893A1 (en) * 2007-02-02 2008-08-07 Network For Instructional Tv, Inc. Determining developmental progress for preschool children
US20090162827A1 (en) * 2007-08-07 2009-06-25 Brian Benson Integrated assessment system for standards-based assessments

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20090162827A1 (en) * 2007-08-07 2009-06-25 Brian Benson Integrated assessment system for standards-based assessments
US20110200978A1 (en) * 2010-02-16 2011-08-18 Assessment Technology Incorporated Online instructional dialog books
US20140188746A1 (en) * 2012-12-31 2014-07-03 Jiaojiao Li Systems, methods, and devices for determining alignment of education content to one or more education standards
CN105373564A (en) * 2014-08-29 2016-03-02 深圳锐取信息技术股份有限公司 Objective structured clinical examination framework based examination station table generation method and apparatus

Also Published As

Publication number Publication date
US8630577B2 (en) 2014-01-14
US20090164406A1 (en) 2009-06-25
US20090162827A1 (en) 2009-06-25

Similar Documents

Publication Publication Date Title
Borrego et al. Systematic literature reviews in engineering education and other developing interdisciplinary fields
Kulik Effects of using instructional technology in elementary and secondary schools: What controlled evaluation studies say
Mertler Action research: Teachers as researchers in the classroom
Goddard et al. A theoretical and empirical analysis of the roles of instructional leadership, teacher collaboration, and collective efficacy beliefs in support of student learning
Hyland et al. EAP: Issues and directions
Griffiths* Knowledge production and the research–teaching nexus: The case of the built environment disciplines
Mandinach et al. A theoretical framework for data-driven decision making
O'Sullivan et al. Research methods for public administrators
Stake Multiple case study analysis
Green IELTS washback in context: Preparation for academic writing in higher education
Morreale et al. Why communication education is important: The centrality of the discipline in the 21st century
Mertler Action research: Improving schools and empowering educators
Bachman Modern language testing at the turn of the century: Assuring that what we count counts
Solem et al. Skills in professional geography: An assessment of workforce needs and expectations
Breiter et al. Data for school improvement: Factors for designing effective information systems to support decision-making in schools
Nieveen et al. Formative evaluation in educational design research
Carr et al. Succeeding with standards: Linking curriculum, assessment, and action planning
Duschl Science education in three-part harmony: Balancing conceptual, epistemic, and social learning goals
Murray et al. Research into initial teacher education in Australia: A survey of the literature 1995–2004
Hernon et al. An action plan for outcomes assessment in your library
Lee Exploring kindergarten teachers’ pedagogical content knowledge of mathematics
US20080227079A1 (en) Method, Apparatus and Computer Program Code for Automation of Assessment Using Rubrics
Schildkamp et al. Data-based decision making in education: Challenges and opportunities
US7362997B2 (en) Methods and apparatus for curriculum planning
Siccama et al. Enhancing validity of a qualitative dissertation research study by using NVivo

Legal Events

Date Code Title Description
STCB Information on status: application discontinuation

Free format text: ABANDONED -- FAILURE TO RESPOND TO AN OFFICE ACTION