US20140188849A1 - Item banking system for standards-based assessment - Google Patents
Item banking system for standards-based assessment Download PDFInfo
- Publication number
- US20140188849A1 US20140188849A1 US14/091,165 US201314091165A US2014188849A1 US 20140188849 A1 US20140188849 A1 US 20140188849A1 US 201314091165 A US201314091165 A US 201314091165A US 2014188849 A1 US2014188849 A1 US 2014188849A1
- Authority
- US
- United States
- Prior art keywords
- item
- standards
- test
- items
- computer
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Abandoned
Links
Images
Classifications
-
- G06F17/30598—
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/28—Databases characterised by their database models, e.g. relational or object models
- G06F16/284—Relational databases
- G06F16/285—Clustering or classification
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09B—EDUCATIONAL OR DEMONSTRATION APPLIANCES; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND, DEAF OR MUTE; MODELS; PLANETARIA; GLOBES; MAPS; DIAGRAMS
- G09B7/00—Electrically-operated teaching apparatus or devices working with questions and answers
- G09B7/02—Electrically-operated teaching apparatus or devices working with questions and answers of the type wherein the student is expected to construct an answer to the question which is presented or wherein the machine gives an answer to the question presented by a student
Definitions
- a major challenge facing educational programs in the 21.sup.st century is to promote learning aimed at the achievement of valued goals or standards.
- an educational management system has been designed to assist programs to promote goal-directed standards-based learning for example as described in U.S. Pat. No. 6,322,366 and No. 6,468,085.
- the present patent application details additional innovations that enhance the usefulness of the system for learners involved in a variety of standards-based educational programs.
- a particularly important group of such learners is comprised of elementary and secondary school students receiving instruction aimed at the achievement of federal, state, and local standards.
- Item Response Theory is used to estimate the probability that a learner will be ready to acquire capabilities reflecting goals that have not yet been mastered.
- the present invention includes new technology to enhance the efficiency of constructing and maintaining item banks containing collections of items used in assessment initiatives requiring that test items be aligned to standards.
- Standards-based assessment initiatives provide a particularly important example of circumstances calling for the alignment of items to standards (e.g., Ravitch, 2001).
- bank information In order to construct standards-based assessments using an item bank, bank information must include information on the standards to which the items are aligned.
- the present invention can be summarized in an item banking system for test items used in standards-based assessments including: (a) Item specifications developed using a Bank Builder feature to create new, edit, move, or delete specifications or assign specifications to one or more standards. (b) Test items constructed and edited using a Bank Builder feature to specify the type of item being constructed, points available for the item, and the type of bank to which the item is assigned. Bank types include: (i) Agency-wide assessments such as benchmark tests and end-of-course examinations. (ii) Formative assessments such as classroom quizzes. (c) Item review and certification, including: (i) In-system item review, directly linked to an item specification and including all items associated with the selected specification.
- FIGS. 1 , 4 , 7 , 10 , 13 , 17 , 20 , 23 , 26 and 29 are step diagrams setting forth the operation and construction of the item banking system for standards-based assessment of the present invention.
- FIGS. 2 , 3 , 5 , 6 , 8 , 9 , 11 , 12 , 14 , 15 , 16 , 18 , 19 , 21 , 22 , 24 , 25 , 27 , 28 , 30 , 31 , 32 and 33 are illustrations of computer screens of the item banking system for standards-based assessment of the present invention setting forth various steps the above step diagrams.
- the assessment innovations include new technology to enhance the efficiency of constructing and maintaining item banks containing collections of items used in assessment initiatives requiring that test items be aligned to standards.
- Standards-based assessment initiatives provide a particularly important example of circumstances calling for the alignment of items to standards (e.g., Ravitch, 2001).
- bank information In order to construct standards-based assessments using an item bank, bank information must include information on the standards to which the items are aligned.
- the task of constructing item banks containing information aligning items to standards can be complex.
- the complexity arises from the fact that item banks must accommodate varying sets of standards generated by multiple agencies (e.g., state departments of education) using different terminology to label standards.
- multiple agencies e.g., state departments of education
- Arizona Performance Objective covers one capability: “Multiply proper fractions.” This capability is included in the specification of the more complex Massachusetts Learning Standard.
- the material that follows outlines an innovative system for developing and maintaining item banks for standards-based Assessment initiatives requiring the alignment of items to multiple sets of standards.
- the material in this section discusses innovations aimed at meeting the unique requirements associated with the construction and maintenance of item banks designed to serve standards-based assessment initiatives.
- the major tasks associated with the construction and maintenance of item banks include procedures to construct new items, to edit existing items, to delete items or make them inactive, to review items, to enter item attributes such as parameter estimates, and to enter the history of item administration.
- the system is unique in that all of the procedures involved in bank construction and maintenance are designed to support standards-based assessment initiatives involving the alignment of sets of items to multiple sets of standards.
- the discussion that follows details the innovative tools that have been developed for item construction and maintenance and spells out the ways in which those tools contribute to construction and maintenance efficiency and quality assurance in standards-based assessment.
- Each item specification defines an item class comprised of sets of items conforming to the requirements of the specification.
- Item specifications are developed using the Bank Builder module of the Educational Management System. Bank Builder allows the user to create a new specification, edit a specification, delete a specification, move a specification to a different folder, or assign the specification to one or more standards.
- the item specification screen for creating and editing specifications allows the user to enter a title for the specification, the description of the item class defined by the specification and the requirements that must be met for membership in the class.
- the user can assign a prototype item to the specification to serve as a model for the construction of items meeting specification requirements.
- Each item specification may be assigned to one or more sets of learning standards and to one standard within each set of standards. The standards and sets of standards to which the specification has been assigned are listed on the item specification screen.
- item specifications are linked directly to item construction, item editing, and item review. These links promote the direct application of specifications during the construction, editing, and review processes. Most importantly, they are the key to making it possible to link sets of items to multiple sets of standards.
- Bank Builder allows the user to specify the type of item to be constructed, the points available for the item, and the type of bank to which the item is assigned.
- the system accommodates two types of banks: One includes items to be used in extended formal agency-wide assessments such as benchmark tests and end-of-course examinations.
- the second type contains items used in formative assessments such as classroom quizzes.
- Bank Builder provides standard text editing and equation editing features that can be used to construct a broad range of item types including multiple choice items, true-false items, yes-no items, short answer items, extended constructed response items, and work samples.
- the system is also capable of importing items involving animation.
- Bank Builder can automatically generate various kinds of charts and can import images and assign them to particular components of an item.
- a multiple-choice item might include an image attached to the item stem and images attached to each of the alternatives.
- Bank Builder includes an Item Family feature that makes it possible to link a set of items to a text or image. Items linked in this fashion are displayed along with the linked text or image, which appears only once.
- Bank Builder includes the option of randomizing the order in which alternatives are displayed.
- Bank Builder allows the item writer to specify scoring rules for assigning points to examinee responses.
- Item editing tools in the system include the capability to edit one item displayed on a single screen or to edit on a screen displaying all of the items included in an item specification.
- the screen displaying all items is particularly useful for making edits to insure consistent adherence to specification requirements.
- the item writer using this screen is able to view the specification, make a series of edits to multiple items and save all of the edits at once.
- Item review and certification processes in the system provide information on the extent to which items meet specifications.
- the item-review feature of the system contains a number of unique features:
- the item review screen displays items directly linked to an item specification.
- the set of items that can be displayed includes all items associated with the selected specification.
- the item specification can be displayed in a popup window linked to the review screen.
- the item review screen allows the reviewer to classify items in terms of review categories. For example, items may be classified in terms of the following categories: Not Reviewed, Needs Modification, Accept, and Accept and Certify.
- Items can be displayed by category. For example, a reviewer may elect to display only those items already classified as needing modification.
- a comment box allows the reviewer to explain the basis for the selected classification.
- An item writer responding to a review may click on an item displayed in the review screen and be taken directly to a screen allowing the writer to edit the item.
- the system automatically prevents items that have not been certified from being used in assessments under construction.
- the procedures classify data objects including test items, item attributes, and item specifications (e.g. Millman & Greene, 1989) using a standard hierarchical tree structure.
- the leaf nodes in the structure are data objects containing items and their attributes.
- Each data object belongs to a single item class specified in a parent node, which contains one unique item specification and one class label. For example, a set of items might be included in a class labeled Multiplication of Proper Fractions.
- a standard item specification (e.g. Millman & Greene, 1989) defines the requirements for membership in the class and provides a prototype item illustrative of class membership.
- An item can belong to only one class and an item specification can belong to only one class. This reduces the likelihood of creating duplicate items and assigning duplicate items to the same standard.
- An item class can be mapped to only one standard within a given set of standards. This reduces the likelihood of assigning duplicate items to different standards measured on the same assessment. It also helps to insure that any given standard will be assessed by a unique set of items.
- Sets of items can be mapped to more than one standard when each standard is in a different set of standards. This increases the number of items available for assessments constructed using different sets of standards.
Abstract
An computer item banking system for standards-based assessments has test items used in standards-based assessments wherein a plurality of item specifications are developed using a specification building feature to create new, edit, move, and delete specifications and to assign specifications to one or more standards; a plurality of test items are constructed and edited using a test building feature to specify the type of item being constructed, points available for the item, and the type of bank to which the item is assigned; bank types include agency-wide assessments including benchmark tests and end-of-course examinations, and formative assessments such as classroom quizzes. The system includes means for certification of test items and preventing use of uncertified test items to be used in agency-wide assessments under construction.
Description
- This application is a continuation of U.S. Ser. No. 12/222,374 filed on Aug. 7, 2008 is expressly incorporated in its entirety herein.
- This application is related to U.S. Pat. Nos. 6,322,366, 6,468,085 and 7,065,516 and 8,529,270, all of which patents and application are expressly incorporated in their entirety herein. This application claims benefit under 35 U.S.C. §119(e)(1) of U.S. Provisional Patent Applications 60/963,675 and 60/963,676 which are expressly incorporated in their entirety herein. Additionally the disclosure in U.S. Published Patent Application 200300044762 is expressly incorporated in its entirety herein.
- Copyright Notice© 2002-2013 Assessment Technology, Inc. A portion of the disclosure of this patent document contains material which is subject to copyright protection. The copyright owner has no objection to the facsimile reproduction by anyone of the patent document or the patent disclosure, as it appears in the Patent and Trademark Office patent file or records, but otherwise reserves all copyright rights whatsoever. 37 CFR §1.71(d).
- A major challenge facing educational programs in the 21.sup.st century is to promote learning aimed at the achievement of valued goals or standards. In an effort to assist educators to meet this challenge, an educational management system has been designed to assist programs to promote goal-directed standards-based learning for example as described in U.S. Pat. No. 6,322,366 and No. 6,468,085. The present patent application details additional innovations that enhance the usefulness of the system for learners involved in a variety of standards-based educational programs. A particularly important group of such learners is comprised of elementary and secondary school students receiving instruction aimed at the achievement of federal, state, and local standards.
- In one educational management system, instruction to promote goal-directed learning is informed by assessment information indicating the capabilities that a learner has acquired and those that the learner will be ready to learn in the future. Item Response Theory (IRT) is used to estimate the probability that a learner will be ready to acquire capabilities reflecting goals that have not yet been mastered. There is room for innovations that enhance the construction of assessments and the use of assessment information to inform goal-directed standards-based learning.
- The present invention includes new technology to enhance the efficiency of constructing and maintaining item banks containing collections of items used in assessment initiatives requiring that test items be aligned to standards. Standards-based assessment initiatives provide a particularly important example of circumstances calling for the alignment of items to standards (e.g., Ravitch, 2001). In order to construct standards-based assessments using an item bank, bank information must include information on the standards to which the items are aligned.
- The present invention can be summarized in an item banking system for test items used in standards-based assessments including: (a) Item specifications developed using a Bank Builder feature to create new, edit, move, or delete specifications or assign specifications to one or more standards. (b) Test items constructed and edited using a Bank Builder feature to specify the type of item being constructed, points available for the item, and the type of bank to which the item is assigned. Bank types include: (i) Agency-wide assessments such as benchmark tests and end-of-course examinations. (ii) Formative assessments such as classroom quizzes. (c) Item review and certification, including: (i) In-system item review, directly linked to an item specification and including all items associated with the selected specification. (ii) Allowance for the reviewer to classify items in terms of review categories, e.g. Not Reviewed, Needs Modification, Accept, and Accept and Certify. (iii) Item display by category. (iv) Ability for item reviewers to include comments on the item being reviewed. (v) Item writer response to review comments and direct access to the reviewed item for editing. (vi) System protection from using not yet certified items to be used in assessments under construction. (d) Classification and mapping procedures that make it possible to efficiently map items to multiple sets of standards. Items may be mapped to item specifications, which are then mapped to standards in multiple states. (i) Data objects are classified as test items, item attributes, and item specifications using a hierarchical tree structure. (ii) Sets of items may be matched to each standard. (iii) An item and a specification can be mapped to only one class. (iv) An item class can be mapped to only one standard within a given set of standards. (v) Sets of items can be mapped to more than one standard when each standard is in a different set of standards. (vi) This hierarchal model method differs from cross-indexed mapping of items to multiple-state standards. (vii) Provides increased information for the alignment of a set of items to a particular standard. (e) The ability to leverage the formative item bank as an element of K-12 instruction.
-
FIGS. 1 , 4, 7, 10, 13, 17, 20, 23, 26 and 29 are step diagrams setting forth the operation and construction of the item banking system for standards-based assessment of the present invention. -
FIGS. 2 , 3, 5, 6, 8, 9, 11, 12, 14, 15, 16, 18, 19, 21, 22, 24, 25, 27, 28, 30, 31, 32 and 33 are illustrations of computer screens of the item banking system for standards-based assessment of the present invention setting forth various steps the above step diagrams. - The assessment innovations include new technology to enhance the efficiency of constructing and maintaining item banks containing collections of items used in assessment initiatives requiring that test items be aligned to standards. Standards-based assessment initiatives provide a particularly important example of circumstances calling for the alignment of items to standards (e.g., Ravitch, 2001). In order to construct standards-based assessments using an item bank, bank information must include information on the standards to which the items are aligned.
- The task of constructing item banks containing information aligning items to standards can be complex. The complexity arises from the fact that item banks must accommodate varying sets of standards generated by multiple agencies (e.g., state departments of education) using different terminology to label standards. For example, consider the following excerpt from a Massachusetts Learning Standard: “Accurately and efficiently add, subtract, multiply, and divide positive fractions and mixed numbers. Simplify fractions.” This standard covers multiple skills. By contrast the following Arizona Performance Objective covers one capability: “Multiply proper fractions.” This capability is included in the specification of the more complex Massachusetts Learning Standard. The material that follows outlines an innovative system for developing and maintaining item banks for standards-based Assessment initiatives requiring the alignment of items to multiple sets of standards.
- The material in this section discusses innovations aimed at meeting the unique requirements associated with the construction and maintenance of item banks designed to serve standards-based assessment initiatives. The major tasks associated with the construction and maintenance of item banks include procedures to construct new items, to edit existing items, to delete items or make them inactive, to review items, to enter item attributes such as parameter estimates, and to enter the history of item administration. The system is unique in that all of the procedures involved in bank construction and maintenance are designed to support standards-based assessment initiatives involving the alignment of sets of items to multiple sets of standards. The discussion that follows details the innovative tools that have been developed for item construction and maintenance and spells out the ways in which those tools contribute to construction and maintenance efficiency and quality assurance in standards-based assessment.
- All of the procedures involved in item construction and maintenance are guided by detailed sets of item specifications providing precise information regarding the required characteristics of the items included in the bank (e.g. Millman & Greene, 1989). Each item specification defines an item class comprised of sets of items conforming to the requirements of the specification. Item specifications are developed using the Bank Builder module of the Educational Management System. Bank Builder allows the user to create a new specification, edit a specification, delete a specification, move a specification to a different folder, or assign the specification to one or more standards.
- The item specification screen for creating and editing specifications allows the user to enter a title for the specification, the description of the item class defined by the specification and the requirements that must be met for membership in the class. In addition, the user can assign a prototype item to the specification to serve as a model for the construction of items meeting specification requirements. Each item specification may be assigned to one or more sets of learning standards and to one standard within each set of standards. The standards and sets of standards to which the specification has been assigned are listed on the item specification screen.
- In the system, item specifications are linked directly to item construction, item editing, and item review. These links promote the direct application of specifications during the construction, editing, and review processes. Most importantly, they are the key to making it possible to link sets of items to multiple sets of standards.
- Item construction and editing are carried out using Bank Builder. Bank Builder allows the user to specify the type of item to be constructed, the points available for the item, and the type of bank to which the item is assigned. The system accommodates two types of banks: One includes items to be used in extended formal agency-wide assessments such as benchmark tests and end-of-course examinations. The second type contains items used in formative assessments such as classroom quizzes.
- Bank Builder provides standard text editing and equation editing features that can be used to construct a broad range of item types including multiple choice items, true-false items, yes-no items, short answer items, extended constructed response items, and work samples. The system is also capable of importing items involving animation. In addition, Bank Builder can automatically generate various kinds of charts and can import images and assign them to particular components of an item. For example, a multiple-choice item might include an image attached to the item stem and images attached to each of the alternatives. Bank Builder includes an Item Family feature that makes it possible to link a set of items to a text or image. Items linked in this fashion are displayed along with the linked text or image, which appears only once. For multiple-choice items, Bank Builder includes the option of randomizing the order in which alternatives are displayed. For constructed response and work sample items, Bank Builder allows the item writer to specify scoring rules for assigning points to examinee responses.
- The link binding each item created in Bank Builder to an item specification is established when a new item is created. Bank Builder requires that each new item be assigned to an item specification. As soon as the assignment is made, the specification can be linked to all bank construction and maintenance procedures. The item specification can be displayed in a popup window as a new item is written or as an item is edited. The easy availability of the specification enhances efficiency during the item creation and item editing processes. When a specification is not readily available, it may take time to retrieve it. Moreover, in some instances the specification may not be found, in which case there will likely be a temptation to write items based on the writer's memory of the specification. This may lead to the production of items that do not match specification requirements.
- Item editing tools in the system include the capability to edit one item displayed on a single screen or to edit on a screen displaying all of the items included in an item specification. The screen displaying all items is particularly useful for making edits to insure consistent adherence to specification requirements. The item writer using this screen is able to view the specification, make a series of edits to multiple items and save all of the edits at once.
- Item review and certification processes in the system provide information on the extent to which items meet specifications. The item-review feature of the system contains a number of unique features:
- The item review screen displays items directly linked to an item specification. The set of items that can be displayed includes all items associated with the selected specification.
- The item specification can be displayed in a popup window linked to the review screen.
- The item review screen allows the reviewer to classify items in terms of review categories. For example, items may be classified in terms of the following categories: Not Reviewed, Needs Modification, Accept, and Accept and Certify.
- Items can be displayed by category. For example, a reviewer may elect to display only those items already classified as needing modification.
- A comment box allows the reviewer to explain the basis for the selected classification.
- An item writer responding to a review may click on an item displayed in the review screen and be taken directly to a screen allowing the writer to edit the item.
- The system automatically prevents items that have not been certified from being used in assessments under construction.
- Unique classification and mapping procedures have been developed to make it possible to efficiently map items to multiple sets of standards. The procedures classify data objects including test items, item attributes, and item specifications (e.g. Millman & Greene, 1989) using a standard hierarchical tree structure. The leaf nodes in the structure are data objects containing items and their attributes. Each data object belongs to a single item class specified in a parent node, which contains one unique item specification and one class label. For example, a set of items might be included in a class labeled Multiplication of Proper Fractions. A standard item specification (e.g. Millman & Greene, 1989) defines the requirements for membership in the class and provides a prototype item illustrative of class membership.
- The procedures make it possible to map an item class including the item specification, class label, and the sets of data objects (items and attributes) included in the class to different sets of standards. For example, items and attributes in the Multiplication of Proper Fractions class could be mapped to a standard in Arizona and to a standard in Massachusetts. The technology restricts the mapping to one standard within a standard set. Thus, if items in the Multiplication of Proper Fractions class were mapped to a particular performance objective in Arizona, they could not be mapped to another performance objective in that state.
- The classification and mapping procedures increase efficiency in item bank construction and maintenance in the following ways:
- Sets of items rather than individual items are mapped to each standard. This reduces that labor involved in aligning items to a standard.
- An item can belong to only one class and an item specification can belong to only one class. This reduces the likelihood of creating duplicate items and assigning duplicate items to the same standard.
- An item class can be mapped to only one standard within a given set of standards. This reduces the likelihood of assigning duplicate items to different standards measured on the same assessment. It also helps to insure that any given standard will be assessed by a unique set of items.
- Sets of items can be mapped to more than one standard when each standard is in a different set of standards. This increases the number of items available for assessments constructed using different sets of standards.
- Many variations, modifications and changes may be made in the above described example without departing from the scope and spirit of the invention.
Claims (16)
1. A computer-implemented item banking system for test items used in standards-based student assessments comprising:
a plurality of item specifications, wherein each item specification is associated to exactly one performance objective of a predetermined educational standard, wherein
each item specification is arranged to inform an author in creating a corresponding class of assessment items suitable for assessing student ability relative to the corresponding performance objective, wherein the item specification includes a title, a description of an item class defined by the item specification, and a set of requirements for an assessment item to be included in the corresponding class;
each item specification stored in a digital library of the item banking system with a link, identifier or other association to the corresponding performance objective; and
a plurality of test items each constructed so as to comply with a selected one of the item specifications, whereby a user of the banking system can construct a test aligned to one performance objective by selecting at least one of the test items that are compliant with the corresponding item specification.
2. The computer-implemented item banking system of claim 1 further comprising:
an interactive test building feature further enabling a user to specify a type of test item being constructed, points available for the test item, and a selected type of item bank to which the test item is assigned; and
wherein the item bank type is selectable from available item bank types including an agency-wide benchmark assessments item bank type, and a formative assessments item bank type.
3. The computer-implemented item banking system according to claim 1 wherein a test item and an item specification are each mapped to only one item class, and an item class is mapped to only one standard within a single set of standards.
4. The computer-implemented item banking system according to claim 1 wherein a set of test items, via mapping to an item specification, are mapped to more than one standard only when each of the standards is in a different set of standards.
5. A non-transitory computer-readable medium encoded with a computer executable instructions for implementing the recited features of claim 1 .
6. The computer-implemented item banking system according to claim 1 including a test item review feature, to confirm compliance of a test item with an associated item specification, wherein the system is configured to generate a display of a selected item specification in a popup window within a review screen of the test item review feature.
7. A computer-implemented item banking system for test items used in standards-based assessments comprising:
a plurality of item specifications developed using a specification building feature to create new, edit, move, and delete specifications and to assign each item specification to exactly one corresponding performance objective of each of multiple different standards;
a plurality of test items each constructed and edited using a test building feature so as to comply with a selected one of the item specifications;
a test item review and certification feature for certifications of test items, wherein said test item review and certification feature is configured to generate:
a graphical screen display that displays all of the test items linked to a selected one of the plurality of item specifications, so as to assist a user of the system in constructing tests aligned to educational standards; and
a display of available item classifications for a selected test item to enable a reviewer to classify the selected test item in terms of a selected one of a predetermined set of review categories, wherein said set of review categories include Not Reviewed, Needs Modification, and Certify review categories.
8. The computer-implemented item banking system according to claim 7 including system protection for preventing use of test items that are not classified in the Certify category for inclusion in an agency-wide assessment under construction.
9. The computer-implemented item banking system according to claim 7 wherein the system is configured to display the corresponding item specification while a user is using the test building feature to create a new test item, to help ensure compliance with the item specification.
10. A computer-implemented method to construct a test aligned to educational standards in the K-12 domain, the method comprising:
(a) storing, in a memory, first data comprising a first set of educational standards promulgated by a first agency, each one of the first set of standards comprising at least one corresponding performance objective PO;
(b) in a user interface, displaying at least one of the stored performance objectives of the first set of educational standards;
(c) for each of the displayed performance objectives, specifying the PO in the screen display by corresponding subject, scale, concept, and brief description; [for example, M07-S1C2-01. Express fractions as decimals.]
(d) receving, via the user interface, a user selection of one of the displayed performance objectives;
(e) searching an electronic databank of assessment items to idenfify are linked or related in the database to the selected performance objective;
(f) responsive to the user selection and the user search request, searching the database to find assessment items that are linked to the selected performance objective;
(g) in the user interface, displaying results of the search, including in the search results display at least one assessment item that is linked to the selected performance objective;
(h) receving via the user interface, a user selection of one item from the displayed search results; and
(i) responsive to a user input request, adding the user-selected item to the Dialog, thereby enabling the user to include in the dialog an assessment item aligned to the selected performance objective of the first set of educational standards.
11. A computer-implemented method for mapping assessment items across educational performance standards, the method comprising:
(a) storing, in a storage, first data comprising a first set of educational standards promulgated by a first agency, each one of the first set of standards comprising at least one corresponding performance objective;
(b) storing, in said storage, second data comprising a second set of educational standards promulgated by a second agency, each one of the second set of standards comprising at least one corresponding performance objective;
(c) using a computer having access to the storage, creating at least one item specification, the item specification including a title for the item specification, a description of an item class defined by the item specification, and requirements for membership of an assessment item in the item class, the requirements including at least one specified performance objective; and
(d) using the computer, assigning the item specification to exactly one performance objective in the first set of educational standards, and to exactly one performance objective in the second set of educational standards.
12. The method of claim 11 and further comprising:
(e) using the computer, storing the item specification in association with a selected library of test items;
(f) using the computer, creating a new item to add to a selected library of test items, wherein creating said new item includes selecting an item bank question type, entering a point value for the new item, and the selecting a type of bank to which the new item is assigned; and
(g) using the computer, mapping the new item to a selected item specification, whereby the item is automatically and correctly associated to both the first set of standards and the second set of standards.
13. The method of claim 11 wherein the first and second agencies are different educational entities within the U.S. federal government.
14. The method of claim 11 wherein the first and second agencies are different state education agencies.
15. The method of claim 11 wherein exactly one of the first and second agencies are different local education agencies.
16. The method of claim 11 wherein one of the first and second agencies is a state, local or federal education agency within a different parent agency than the other one of the first and second agencies.
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US14/091,165 US20140188849A1 (en) | 2007-08-07 | 2013-11-26 | Item banking system for standards-based assessment |
Applications Claiming Priority (4)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US96367507P | 2007-08-07 | 2007-08-07 | |
US96367607P | 2007-08-07 | 2007-08-07 | |
US12/222,384 US8630577B2 (en) | 2007-08-07 | 2008-08-07 | Item banking system for standards-based assessment |
US14/091,165 US20140188849A1 (en) | 2007-08-07 | 2013-11-26 | Item banking system for standards-based assessment |
Related Parent Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US12/222,384 Continuation US8630577B2 (en) | 2007-08-07 | 2008-08-07 | Item banking system for standards-based assessment |
Publications (1)
Publication Number | Publication Date |
---|---|
US20140188849A1 true US20140188849A1 (en) | 2014-07-03 |
Family
ID=40789087
Family Applications (3)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US12/222,385 Abandoned US20090162827A1 (en) | 2007-08-07 | 2008-08-07 | Integrated assessment system for standards-based assessments |
US12/222,384 Expired - Fee Related US8630577B2 (en) | 2007-08-07 | 2008-08-07 | Item banking system for standards-based assessment |
US14/091,165 Abandoned US20140188849A1 (en) | 2007-08-07 | 2013-11-26 | Item banking system for standards-based assessment |
Family Applications Before (2)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US12/222,385 Abandoned US20090162827A1 (en) | 2007-08-07 | 2008-08-07 | Integrated assessment system for standards-based assessments |
US12/222,384 Expired - Fee Related US8630577B2 (en) | 2007-08-07 | 2008-08-07 | Item banking system for standards-based assessment |
Country Status (1)
Country | Link |
---|---|
US (3) | US20090162827A1 (en) |
Cited By (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20090162827A1 (en) * | 2007-08-07 | 2009-06-25 | Brian Benson | Integrated assessment system for standards-based assessments |
US20110200978A1 (en) * | 2010-02-16 | 2011-08-18 | Assessment Technology Incorporated | Online instructional dialog books |
US20140188746A1 (en) * | 2012-12-31 | 2014-07-03 | Jiaojiao Li | Systems, methods, and devices for determining alignment of education content to one or more education standards |
CN105373564A (en) * | 2014-08-29 | 2016-03-02 | 深圳锐取信息技术股份有限公司 | Objective structured clinical examination framework based examination station table generation method and apparatus |
Families Citing this family (24)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US8529270B2 (en) | 2003-12-12 | 2013-09-10 | Assessment Technology, Inc. | Interactive computer system for instructor-student teaching and assessment of preschool children |
US20110200979A1 (en) * | 2007-09-04 | 2011-08-18 | Brian Benson | Online instructional dialogs |
US8798522B2 (en) * | 2008-04-28 | 2014-08-05 | Nexlearn, Llc | Simulation authoring tool |
US20100062411A1 (en) * | 2008-09-08 | 2010-03-11 | Rashad Jovan Bartholomew | Device system and method to provide feedback for educators |
US20100167257A1 (en) * | 2008-12-01 | 2010-07-01 | Hugh Norwood | Methods and systems for creating educational resources and aligning educational resources with benchmarks |
US20110066476A1 (en) * | 2009-09-15 | 2011-03-17 | Joseph Fernard Lewis | Business management assessment and consulting assistance system and associated method |
US9299266B2 (en) | 2010-09-24 | 2016-03-29 | Lexia Learning Systems Llc | System for performing assessment without testing |
US20120214147A1 (en) * | 2011-02-16 | 2012-08-23 | Knowledge Factor, Inc. | System and Method for Adaptive Knowledge Assessment And Learning |
US9064017B2 (en) * | 2011-06-01 | 2015-06-23 | D2L Corporation | Systems and methods for providing information incorporating reinforcement-based learning and feedback |
CA2854639C (en) | 2011-10-25 | 2020-10-20 | Aquimo, Llc | Method to provide dynamic customized sports instruction responsive to motion of a mobile device |
WO2013126782A1 (en) | 2012-02-24 | 2013-08-29 | National Assoc. Of Boards Of Pharmacy | Outlier detection tool |
US20140272892A1 (en) * | 2013-03-15 | 2014-09-18 | Edison Learning Inc. | On-line custom course builder |
JP6209098B2 (en) * | 2014-02-07 | 2017-10-04 | 富士通株式会社 | Data management program, data management method, and data management system |
WO2017074169A1 (en) * | 2015-10-28 | 2017-05-04 | PACHECO NAVARRO, Diana | Method implemented by a computing unit for the classification and pairing of mathematics learning packets with classes of students |
CN107240340B (en) * | 2017-07-20 | 2020-08-28 | 国网山东省电力公司潍坊供电公司 | Five-prevention operation exercise examination device for power grid transformation system |
US10866956B2 (en) * | 2017-10-12 | 2020-12-15 | Pearson Education, Inc. | Optimizing user time and resources |
US10432478B2 (en) | 2017-10-12 | 2019-10-01 | Pearson Education, Inc. | Simulating a user score from input objectives |
US11449762B2 (en) | 2018-02-20 | 2022-09-20 | Pearson Education, Inc. | Real time development of auto scoring essay models for custom created prompts |
US11443140B2 (en) | 2018-02-20 | 2022-09-13 | Pearson Education, Inc. | Systems and methods for automated machine learning model training for a custom authored prompt |
US11422989B2 (en) | 2019-02-04 | 2022-08-23 | Pearson Education, Inc. | Scoring system for digital assessment quality |
US11423035B2 (en) * | 2019-02-04 | 2022-08-23 | Pearson Education, Inc. | Scoring system for digital assessment quality with harmonic averaging |
US11854433B2 (en) * | 2019-02-04 | 2023-12-26 | Pearson Education, Inc. | Systems and methods for item response modelling of digital assessments |
US20210382865A1 (en) * | 2020-06-09 | 2021-12-09 | Act, Inc. | Secure model item tracking system |
US20220092690A1 (en) * | 2020-09-22 | 2022-03-24 | Briza, Inc. | Evaluation response system and method |
Family Cites Families (106)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US4967354A (en) * | 1987-06-18 | 1990-10-30 | Tescor, Inc. | Method of preparing customized written examinations |
US5174759A (en) * | 1988-08-04 | 1992-12-29 | Preston Frank S | TV animation interactively controlled by the viewer through input above a book page |
US5059127A (en) * | 1989-10-26 | 1991-10-22 | Educational Testing Service | Computerized mastery testing system, a computer administered variable length sequential testing system for making pass/fail decisions |
JPH04113385A (en) * | 1990-09-03 | 1992-04-14 | Fujitsu Ltd | Remote lecture system |
US5122952A (en) * | 1990-10-22 | 1992-06-16 | Minkus Leslie S | Method and apparatus for automated learning tool selection for child development |
JPH04241381A (en) * | 1991-01-16 | 1992-08-28 | Brother Ind Ltd | Electronic learning machine |
US5326270A (en) * | 1991-08-29 | 1994-07-05 | Introspect Technologies, Inc. | System and method for assessing an individual's task-processing style |
US5173051B1 (en) * | 1991-10-15 | 1997-06-10 | Optical Data Corp | Curriculum planning and publishing method |
US5267865A (en) * | 1992-02-11 | 1993-12-07 | John R. Lee | Interactive computer aided natural learning method and apparatus |
US5310349A (en) * | 1992-04-30 | 1994-05-10 | Jostens Learning Corporation | Instructional management system |
US5411271A (en) * | 1994-01-03 | 1995-05-02 | Coastal Amusement Distributors, Inc. | Electronic video match game |
US5893717A (en) * | 1994-02-01 | 1999-04-13 | Educational Testing Service | Computerized method and system for teaching prose, document and quantitative literacy |
US5904485A (en) * | 1994-03-24 | 1999-05-18 | Ncr Corporation | Automated lesson selection and examination in computer-assisted education |
US5537587A (en) * | 1994-05-11 | 1996-07-16 | International Business Machines Corporation | File record maintenance in a data processing system by synchronization of menus with corresponding data files |
CA2151527C (en) * | 1994-06-13 | 2009-08-18 | Michael E. Jay | Method and apparatus for correlating educational requirements |
US5558520A (en) * | 1994-08-23 | 1996-09-24 | Werzberger; Bernice F. | Interactive book assembly |
JPH0876680A (en) * | 1994-09-02 | 1996-03-22 | Fujitsu Ltd | Management education system |
US5835758A (en) * | 1995-02-28 | 1998-11-10 | Vidya Technologies, Inc. | Method and system for respresenting and processing physical and conceptual entities |
US6315572B1 (en) * | 1995-03-22 | 2001-11-13 | William M. Bancroft | Method and system for computerized authoring, learning, and evaluation |
US5823788A (en) * | 1995-11-13 | 1998-10-20 | Lemelson; Jerome H. | Interactive educational system and method |
US5779486A (en) * | 1996-03-19 | 1998-07-14 | Ho; Chi Fai | Methods and apparatus to assess and enhance a student's understanding in a subject |
US5727951A (en) * | 1996-05-28 | 1998-03-17 | Ho; Chi Fai | Relationship-based computer-aided-educational system |
US6139330A (en) * | 1996-03-19 | 2000-10-31 | Ho; Chi Fai | Computer-aided learning system and method |
US5743746A (en) * | 1996-04-17 | 1998-04-28 | Ho; Chi Fai | Reward enriched learning system and method |
US6030226A (en) * | 1996-03-27 | 2000-02-29 | Hersh; Michael | Application of multi-media technology to psychological and educational assessment tools |
US6120300A (en) * | 1996-04-17 | 2000-09-19 | Ho; Chi Fai | Reward enriched learning system and method II |
US6535713B1 (en) * | 1996-05-09 | 2003-03-18 | Verizon Services Corp. | Interactive training application |
US5727950A (en) * | 1996-05-22 | 1998-03-17 | Netsage Corporation | Agent based instruction system and method |
US5864869A (en) * | 1996-07-18 | 1999-01-26 | Doak; Ron K. | Method and manufacture of lesson plans and classroom organizers utilizing computers and software |
BR9713230A (en) * | 1996-09-25 | 2000-04-04 | Sylvan Learning Systems Inc | System for electronic sending of instruction and automatic application of test and student management |
US6202060B1 (en) * | 1996-10-29 | 2001-03-13 | Bao Q. Tran | Data management system |
US6091930A (en) * | 1997-03-04 | 2000-07-18 | Case Western Reserve University | Customizable interactive textbook |
US20020182579A1 (en) * | 1997-03-27 | 2002-12-05 | Driscoll Gary F. | System and method for computer based creation of tests formatted to facilitate computer based testing |
JPH10333538A (en) * | 1997-05-29 | 1998-12-18 | Fujitsu Ltd | Network type education system, record medium recording instructor side program of network type education system and record medium recording participant side program |
US6044387A (en) * | 1997-09-10 | 2000-03-28 | Microsoft Corporation | Single command editing of multiple files |
US6112049A (en) * | 1997-10-21 | 2000-08-29 | The Riverside Publishing Company | Computer network based testing system |
US5927988A (en) * | 1997-12-17 | 1999-07-27 | Jenkins; William M. | Method and apparatus for training of sensory and perceptual systems in LLI subjects |
US6029043A (en) * | 1998-01-29 | 2000-02-22 | Ho; Chi Fai | Computer-aided group-learning methods and systems |
US6077085A (en) * | 1998-05-19 | 2000-06-20 | Intellectual Reserve, Inc. | Technology assisted learning |
US6042384A (en) * | 1998-06-30 | 2000-03-28 | Bookette Software Company | Computerized systems for optically scanning and electronically scoring and reporting test results |
US6322366B1 (en) * | 1998-06-30 | 2001-11-27 | Assessment Technology Inc. | Instructional management system |
US6398556B1 (en) * | 1998-07-06 | 2002-06-04 | Chi Fai Ho | Inexpensive computer-aided learning methods and apparatus for learners |
US6471521B1 (en) * | 1998-07-31 | 2002-10-29 | Athenium, L.L.C. | System for implementing collaborative training and online learning over a computer network and related techniques |
US6511324B1 (en) * | 1998-10-07 | 2003-01-28 | Cognitive Concepts, Inc. | Phonological awareness, phonological processing, and reading skill training system and method |
US6149441A (en) * | 1998-11-06 | 2000-11-21 | Technology For Connecticut, Inc. | Computer-based educational system |
US6305942B1 (en) * | 1998-11-12 | 2001-10-23 | Metalearning Systems, Inc. | Method and apparatus for increased language fluency through interactive comprehension, recognition and generation of sounds, words and sentences |
US6353447B1 (en) * | 1999-01-26 | 2002-03-05 | Microsoft Corporation | Study planner system and method |
US6269355B1 (en) * | 1999-04-15 | 2001-07-31 | Kadiri, Inc. | Automated process guidance system and method using knowledge management system |
US6261103B1 (en) * | 1999-04-15 | 2001-07-17 | Cb Sciences, Inc. | System for analyzing and/or effecting experimental data from a remote location |
US6263434B1 (en) * | 1999-09-21 | 2001-07-17 | Sun Microsystems, Inc. | Signed group criteria |
US6282404B1 (en) * | 1999-09-22 | 2001-08-28 | Chet D. Linton | Method and system for accessing multimedia data in an interactive format having reporting capabilities |
US6341212B1 (en) * | 1999-12-17 | 2002-01-22 | Virginia Foundation For Independent Colleges | System and method for certifying information technology skill through internet distribution examination |
US6898411B2 (en) * | 2000-02-10 | 2005-05-24 | Educational Testing Service | Method and system for online teaching using web pages |
US6505031B1 (en) * | 2000-02-25 | 2003-01-07 | Robert Slider | System and method for providing a virtual school environment |
US20010039000A1 (en) * | 2000-02-29 | 2001-11-08 | Parsons Thomas Gregory | Reading tutor for infants |
US6498920B1 (en) * | 2000-04-18 | 2002-12-24 | We-Comply, Inc. | Customizable web-based training system |
US7031651B2 (en) | 2000-07-21 | 2006-04-18 | Englishtown, Inc. | System and method of matching teachers with students to facilitate conducting online private instruction over a global network |
US6468085B1 (en) * | 2000-07-28 | 2002-10-22 | Assessment Technology Inc. | Scale builder and method |
US20030028588A1 (en) * | 2000-08-01 | 2003-02-06 | Mcconnell Evan | Mobile teaching system |
EP1320841A1 (en) * | 2000-09-28 | 2003-06-25 | Scientific Learning Corp. | Method and apparatus for automated training of language learning skills |
US6547568B1 (en) * | 2000-10-12 | 2003-04-15 | Kiyokazu Yamano | Education intermediary system and method |
US6561812B1 (en) * | 2000-10-30 | 2003-05-13 | Learncity, Inc. | System and method of correlating learning materials with educational objectives |
US20020086271A1 (en) * | 2000-12-28 | 2002-07-04 | Murgia Paula J. | Interactive system for personal life patterns |
WO2002056279A1 (en) * | 2001-01-09 | 2002-07-18 | Prep4 Ltd. | Training system and method for improving user knowledge and skills |
US20020199118A1 (en) * | 2001-02-02 | 2002-12-26 | Medinservice.Com, Inc. | Internet training course system and methods |
US20060014129A1 (en) * | 2001-02-09 | 2006-01-19 | Grow.Net, Inc. | System and method for processing test reports |
US6813474B2 (en) * | 2001-02-24 | 2004-11-02 | Echalk: L.L.C. | System and method for creating, processing and managing educational content within and between schools |
US6789047B1 (en) * | 2001-04-17 | 2004-09-07 | Unext.Com Llc | Method and system for evaluating the performance of an instructor of an electronic course |
US6554618B1 (en) * | 2001-04-20 | 2003-04-29 | Cheryl B. Lockwood | Managed integrated teaching providing individualized instruction |
US20030039949A1 (en) * | 2001-04-23 | 2003-02-27 | David Cappellucci | Method and system for correlating a plurality of information resources |
US20020192631A1 (en) * | 2001-05-23 | 2002-12-19 | Chase Weir | Method and system for interactive teaching |
US20030017442A1 (en) * | 2001-06-15 | 2003-01-23 | Tudor William P. | Standards-based adaptive educational measurement and assessment system and method |
US6904263B2 (en) * | 2001-08-01 | 2005-06-07 | Paul Grudnitski | Method and system for interactive case and video-based teacher training |
US6793129B2 (en) * | 2001-08-17 | 2004-09-21 | Leapfrog Enterprises, Inc. | Study aid apparatus and method of using study aid apparatus |
US20030044762A1 (en) * | 2001-08-29 | 2003-03-06 | Assessment Technology Inc. | Educational management system |
TW520099U (en) * | 2001-12-28 | 2003-02-01 | Hon Hai Prec Ind Co Ltd | Board-to-board connector |
US7311524B2 (en) * | 2002-01-17 | 2007-12-25 | Harcourt Assessment, Inc. | System and method assessing student achievement |
US20030180703A1 (en) * | 2002-01-28 | 2003-09-25 | Edusoft | Student assessment system |
US20040076930A1 (en) * | 2002-02-22 | 2004-04-22 | Steinberg Linda S. | Partal assessment design system for educational testing |
US6676413B1 (en) * | 2002-04-17 | 2004-01-13 | Voyager Expanded Learning, Inc. | Method and system for preventing illiteracy in substantially all members of a predetermined set |
US7860736B2 (en) * | 2002-06-28 | 2010-12-28 | Accenture Global Services Gmbh | Course content development method and computer readable medium for business driven learning solutions |
US7733366B2 (en) * | 2002-07-01 | 2010-06-08 | Microsoft Corporation | Computer network-based, interactive, multimedia learning system and process |
AU2003260136A1 (en) * | 2002-08-29 | 2004-03-19 | Voxiva Inc. | System and method for delivering, receiving and managing continuing educational and training services |
US6808267B2 (en) * | 2002-10-18 | 2004-10-26 | Childsplay Vision Systems | Method for automated mass screening for visual dysfunction in children |
US20040229199A1 (en) * | 2003-04-16 | 2004-11-18 | Measured Progress, Inc. | Computer-based standardized test administration, scoring and analysis system |
CA2427786A1 (en) * | 2003-05-02 | 2004-11-02 | Auckland Uniservices Limited | System, method and computer program for student assessment |
AU2004246432A1 (en) * | 2003-05-14 | 2004-12-16 | Gautam Dharamdas Goradia | Interactive system for building, organising, and sharing one's own databank of questions and answers in a variety of questioning formats, on any subject in one or more languages |
US20070111180A1 (en) * | 2005-10-24 | 2007-05-17 | Sperle Robin U | Delivery methods for remote learning system courses |
US20050114160A1 (en) * | 2003-11-26 | 2005-05-26 | International Business Machines Corporation | Method, apparatus and computer program code for automation of assessment using rubrics |
US20050125196A1 (en) * | 2003-12-09 | 2005-06-09 | Len Swanson | Method and system for computer-assisted test construction performing specification matching during test item selection |
US20050221266A1 (en) * | 2004-04-02 | 2005-10-06 | Mislevy Robert J | System and method for assessment design |
US7362997B2 (en) * | 2004-04-22 | 2008-04-22 | Aurelia Hartenberger | Methods and apparatus for curriculum planning |
US20060003306A1 (en) * | 2004-07-02 | 2006-01-05 | Mcginley Michael P | Unified web-based system for the delivery, scoring, and reporting of on-line and paper-based assessments |
US7927105B2 (en) * | 2004-09-02 | 2011-04-19 | International Business Machines Incorporated | Method and system for creating and delivering prescriptive learning |
US8385810B2 (en) * | 2004-12-30 | 2013-02-26 | Norman J. Nolasco | System and method for real time tracking of student performance based on state educational standards |
US20060199163A1 (en) * | 2005-03-04 | 2006-09-07 | Johnson Andrea L | Dynamic teaching method |
CA2549438A1 (en) * | 2005-06-27 | 2006-12-27 | Mark R. Swanson | Wireless classroom response system |
US20070099169A1 (en) * | 2005-10-27 | 2007-05-03 | Darin Beamish | Software product and methods for recording and improving student performance |
US20070122788A1 (en) * | 2005-11-28 | 2007-05-31 | Microsoft Corporation | Virtual teaching assistant |
US20070160969A1 (en) * | 2006-01-11 | 2007-07-12 | Barton Benny M | Method and Apparatus for Associating User Evaluations with Independent Content Sources |
US20070178432A1 (en) | 2006-02-02 | 2007-08-02 | Les Davis | Test management and assessment system and method |
US9241039B2 (en) * | 2006-07-11 | 2016-01-19 | West Virginia University | Automated tracking of class attendance |
US20080038705A1 (en) * | 2006-07-14 | 2008-02-14 | Kerns Daniel R | System and method for assessing student progress and delivering appropriate content |
US20080124696A1 (en) * | 2006-10-26 | 2008-05-29 | Houser Ronald L | Empirical development of learning content using educational measurement scales |
US20080187893A1 (en) * | 2007-02-02 | 2008-08-07 | Network For Instructional Tv, Inc. | Determining developmental progress for preschool children |
US20090162827A1 (en) * | 2007-08-07 | 2009-06-25 | Brian Benson | Integrated assessment system for standards-based assessments |
-
2008
- 2008-08-07 US US12/222,385 patent/US20090162827A1/en not_active Abandoned
- 2008-08-07 US US12/222,384 patent/US8630577B2/en not_active Expired - Fee Related
-
2013
- 2013-11-26 US US14/091,165 patent/US20140188849A1/en not_active Abandoned
Cited By (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20090162827A1 (en) * | 2007-08-07 | 2009-06-25 | Brian Benson | Integrated assessment system for standards-based assessments |
US20110200978A1 (en) * | 2010-02-16 | 2011-08-18 | Assessment Technology Incorporated | Online instructional dialog books |
US20140188746A1 (en) * | 2012-12-31 | 2014-07-03 | Jiaojiao Li | Systems, methods, and devices for determining alignment of education content to one or more education standards |
CN105373564A (en) * | 2014-08-29 | 2016-03-02 | 深圳锐取信息技术股份有限公司 | Objective structured clinical examination framework based examination station table generation method and apparatus |
Also Published As
Publication number | Publication date |
---|---|
US20090162827A1 (en) | 2009-06-25 |
US8630577B2 (en) | 2014-01-14 |
US20090164406A1 (en) | 2009-06-25 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US8630577B2 (en) | Item banking system for standards-based assessment | |
Kremmel et al. | Towards a comprehensive, empirical model of language assessment literacy across stakeholder groups: Developing the language assessment literacy survey | |
Strang | Beyond engagement analytics: Which online mixed-data factors predict student learning outcomes? | |
Moody et al. | Evaluating the quality of information models: empirical testing of a conceptual model quality framework | |
Caputo et al. | School improvement plans and student achievement: Preliminary evidence from the Quality and Merit Project in Italy | |
Breakstone | Try, try, try again: The process of designing new history assessments | |
US20080227079A1 (en) | Method, Apparatus and Computer Program Code for Automation of Assessment Using Rubrics | |
Won et al. | Science teachers’ use of a concept map marking guide as a formative assessment tool for the concept of energy | |
Warr et al. | Integrating the discourse on teachers and design: An analysis of ten years of scholarship | |
Supriadi et al. | University's Enterprise Architecture Design Using Enterprise Architecture Planning (EAP) Based on the Zachman's Framework Approach. | |
Hack | An instructional design model for blended higher education | |
Achari | Research methodology | |
Atabekova | Employers’ contribution to law students’ multilingual communication skills training in remote mode due to pandemic emergency: Pilot study | |
Ullah Ibne Hossain et al. | The effect of an individual's education level on their systems skills in the system of systems domain | |
Strang | How student behavior and reflective learning impact grades in online business courses | |
Kallemeyn et al. | Ambitious US history teachers bringing professional development into the classroom: A mixed methods study | |
ÇINAR | Thematic content analysis of postgraduate dissertations on technological pedagogical content knowledge: The case of Turkey | |
Öztürk et al. | Design thinking customized to support STEM teachers: Co-developing and implementing STEM activities for fifth graders in Turkey | |
Quinton et al. | The troublesome triplets: issues in teaching reliability, validity and generalisation to business students | |
Sikurajapathi et al. | Students' Perceptions of Enhanced e-Assessment Feedback Addressing Common Student Errors in Mathematics. | |
Graf | Organizing and conducting scholarly literature reviews | |
Ljung | Clean Code in Practice: Developers perception of clean code | |
Halász et al. | Who is innovating and how in the education sector? Combining subject and object approaches | |
Zhang et al. | A review of reviews on computational thinking assessment in higher education | |
Koponen | Investigating mathematical knowledge for teaching and mathematics teacher education |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
STCB | Information on status: application discontinuation |
Free format text: ABANDONED -- FAILURE TO RESPOND TO AN OFFICE ACTION |