Automated individualized learning program creation system and associated methods
- Publication number
- WO2002037447A2 WO2002037447A2 PCT/US2001/045318 US0145318W WO2002037447A2 WO 2002037447 A2 WO2002037447 A2 WO 2002037447A2 US 0145318 W US0145318 W US 0145318W WO 2002037447 A2 WO2002037447 A2 WO 2002037447A2
- Grant status
- Patent type
- Prior art keywords
- Prior art date
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09B—EDUCATIONAL OR DEMONSTRATION APPLIANCES; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND, DEAF OR MUTE; MODELS; PLANETARIA; GLOBES; MAPS; DIAGRAMS
- G09B7/00—Electrically-operated teaching apparatus or devices working with questions and answers
- G09B7/02—Electrically-operated teaching apparatus or devices working with questions and answers of the type wherein the student is expected to construct an answer to the question which is presented or wherein the machine gives an answer to the question presented by a student
AUTOMATED INDIVIDUALIZED LEARNING PROGRAM CREATION SYSTEM AND ASSOCIATED METHODS
Cross-Reference to Related Application
This application claims priority from copending application 09/705,153, "Automated System and Methods for Creating an Individualized Learning Program," filed November 2, 2000, the disclosure of which is hereby incorporated by reference hereinto.
Field of the Invention
The invention pertains to automated interactive training prescription systems and methods. More particularly, the invention pertains to skills management and learning management systems and methods that perform employee job and/or skills assessments. Most particularly, the invention establishes a system and method for identifying skill gaps in a user and automatically mapping a precise training regimen to the identified skill gaps.
Background of the Invention Traditionally, organizations have focused their workforce by creating fairly narrowly defined jobs and improving skill-sets of the individuals in those jobs by using periodic training. However, as the workplace environment becomes ever more dynamic, job requirements are becoming increasingly more fluid with corresponding employee skill deficiencies that need to be identified in near real-time. Modern-day organizations require their workforce to have varying levels of knowledge and skills in the same subjects. Organizations are posturing themselves to develop accurate profiles of their employees, knowing what knowledge and skills are present within the organization, the competency levels required for each job, where the deficiencies are, and how to provide timely skills upgrading. The traditional manual association (i.e., linkage) of knowledge and skill-set requirements to training interventions is a resource-intensive activity that cannot provide timely responses to ever-changing job requirements. Automated tools and procedures are needed to assist organizations in prescribing the exact training interventions that are needed to satisfy employee skill deficiencies. Thus, in order to fulfill these needs, skills management systems and learning management systems must incorporate an automated system and method that can perform the analysis of employee skill deficiencies and provide a precise training regimen that will bring the employee to the desired competency level. This system and method must also be responsive to organizational skill changes/upgrading and the introduction of new/changed training programs.
Summary of the Invention It is therefore an object of the present invention to provide a system and method that identify a gap between skills possessed by a user and those desired by an organization for the user to possess.
It is also an object to provide such a system and method that creates a training regimen to fill the identified skill gap. It is a further object to provide such a system and method for creating an interactive learning environment that is specific to a skill desired to be learned and to a skill level already possessed by the user.
It is another object is to provide such a system and method for maintaining and upgrading the linkages between skilling objects, which comprise integral skills, and training interventions commensurate with an introduction of new skilling objects or training interventions or changes to existing ones.
In accordance with the present invention, an interactive learning system and method are provided that identify a "gap" between the skill(s) possessed by the individual and those required by an organization and then creates a training regimen to fill that gap. The system and method precisely map the training to the defined required skills. In one aspect of the invention, an individualized learning sequence can be developed and presented to the user for the purpose of improving a user's skill and understanding with respect to selected subject matter. While known prior art systems use manual linking of recommended training elements with a desired skill to be learned, the present automatic invention reduces, by at least 95%, the time required to create a link. Numerous other advantages and features of the present invention will become readily apparent from the following detailed description of the invention and the embodiments thereof, from the claims and from the accompanying drawings in which the details of the invention are fully and completely disclosed as a part of this specification.
Brief Description of the Drawings
FIG. 1 A is a schematic diagram of an exemplary architecture for the system of the present invention. FIG. 1 B is a schematic diagram of a typical flow for a user through the functional components of the system of FIG. 1A.
FIG. 1C is a schematic diagram of the functional components of the system of FIG. 1A.
FIG. 1D is a flow diagram of the details of the matching process. FIG. 1E is a flow diagram of the details of the gap analysis process.
FIG. 1F is a schematic diagram of a typical flow through the gap analysis process and a resultant recommendation.
FIG. 2 is a flow diagram of the method for creating an individual development plan. FIGS. 3A and 3B illustrate in tabular fashion the data flow for creating a customized individual learning plan.
FIG. 4 is a schematic diagram of automatic matching, automatic linkage, and semiautomatic linkage for creating a training regimen.
FIG. 5 is a block diagram of the updating process. FIG.6 is a flow diagram of a process of selecting learning objects for the creation of a personalized learning experience.
Detailed Description of the Preferred Embodiments
A description of the preferred embodiments of the present invention will now be presented with reference to FIGS. 1-6.
FIGURE 1A is a schematic diagram of the hardware of a preferred embodiment of a system 10 to address the problem solved by the present invention; FIG. 1 B is a schematic diagram of a typical flow for a user through the functional components of the system; FIG. 1C is a schematic diagram of the functional components.
The system 10 incorporates a plurality of components (FIGS. 1A and 1C), including a control unit 12, comprising, for example, a microprocessor. Associated with the microprocessor 12 are read-only memory 14 and read-write memory RAM 16, which communicate with the processor 12 via a bidirectional bus structure 18. The memories 14,16, as is known in the art, can be used to permanently or temporarily store constants, programs being executed, or related data.
Also coupled to the bus 18 is a monitor, such as a CRT-type display 20, disk drive 24, CD-ROM drive 26, and a user input device 28. The user input device 28 may comprise, for example, a keyboard; it could alternately or in addition comprise a pointing device, such as a mouse, or touch screen.
A local area network (LAN) interface 30 enables the system 10 to communicate with the local network 31 (e.g., intranet). Further, a remote network interface 32 provides bidirectional communication with the World Wide Web or other remote networks (e.g., Internet), either through telecommunications or through other forms of data transmission without limitation.
In normal operation, software programs can be stored on and read from disk drive 24 or CD-ROM drive 26. Information can also be read from the CD-ROM drive 26. Both the disk drive 24 and the CD-ROM drive 26 can be used as sources from which databases can be accessed; alternatively, databases may be accessed via the LAN interface 30 or the remote network interface 32.
During normal operation of the system 10, visual information can be displayed on the display unit 20, whether being used by a user or management personnel, under control of the processor 12. Information can be read from disk drive 24 or CD-ROM drive 26 for the purpose of displaying same to the user/manager. A control program, or a suite of such programs, for the purpose of carrying out the processes of the present invention can be stored on one or both of disk drive 24 or CD-ROM 26 for access by processor 12. Processor 12 is thus able to carry out any of a number of prestored processes that provide forthe multiplicity of functions to be described herein.
A overall interactive schematic of one aspect of the invention, which comprises a computer-based method of automatically determining and providing an individualized learning sequence, is illustrated in FIG. 1 B. In this embodiment of the method, an organization has identified a skill area in which it desires for a known individual to gain proficiency, and learning tools are available for addressing this need.
In the system 10, the skills are assembled in a skills database 200. When an individual is needed to perform what may be a new skill or an existing skill at a higher skill level, an analysis of the skill possessed already by the individual 204 is performed to determine whether a "gap" 206 exists between the skill 204 and that needed by the organization 202. Preferably this analysis is performed electronically, with the use of gap generator software. The system 10, through the use of gap analysis software of the present invention, creates a complete set of training recommendations to satisfy the gap. An individual development plan 208 for the given skill comprises these training recommendations.
The system's 10 gap analysis software (FIGS. 1E and 1F) converts the two incoming competency levels 80, the user's current level and the desired level to be attained, to a decimal equivalent (percent) 81 (block 660). This normalizes the values so that proper comparison may be made between different competency rating scales. These percentages are then compared with all training interventions linked to the desired skilling object (block 661) in the training intervention metadata database 82. Linked training interventions whose competency levels are within the range set by the incoming levels (i.e., ≤ the desired level and > current level) are identified as the initial set of training recommendations 83 (block 662).
A "complete" set of training recommendations 84 is accomplished by examining the prerequisite training intervention metadata element of each of the initial set of training recommendations. Prerequisites 85 are added to the initial set of training recommendations (block 663), and are indented or highlighted to indicate that they are
"prerequisites" and not the primary training recommendations required to fill a skill gap.
The information contained in each training recommendation comprises the training intervention ID and the competency level and the prerequisite training intervention IDs. If a gap 206 exists, data representative of the linkage between the required skill and skill level (i.e., competency level) to the appropriate set of training interventions in the training intervention metadata database 207 are used to create an "individual development plan" (IDP) 208. When desired, the course(s) to be taken from the regimen may be accessed from the course database 209.
Typically, not only a particular skill will be required, but also a predetermined level of skill. To this end the skills database 200 will also comprise the individual's skill level for each skill. In this case, the "gap" 206 further comprises a difference in skill level between that which the individual possesses in that skill and that desired by the organization.
FIGURE 2 is a flow diagram of the method 40 for creating an individual development plan. In this aspect of the method the organization, typically by way of a supervisor or manager, identifies a skill and skill level desired to be possessed by the user 401. The system 10 then accesses the skills database 402 and retrieves the user's skills and skill levels 403. If the desired skill is not already possessed by user 404, the desired skill is mapped with the appropriate training regimen 406. If the desired skill is already possessed by the user 404, the system then checks whether the desired skill level is less than or equal to the user's skill level 405. If so, the system exits 408. If the desired skill level is greater than that possessed by the user 405, the desired skill is mapped with the appropriate training regimen 406; that is, the skills domain is mapped to the training domain.
In some cases the gap 206 is sufficiently great that a plurality of courses will need to be assigned to the user. For example, if the user has a skill level of "1" for a particular skill, and the desired skill level is "5," the user will be assigned a training regimen comprising courses matched to skill levels 1 through 5 of that skill, so that all prerequisites are met en route to achieving the desired skill level.
Once the mapping has occurred 406, the training regimen is presented to the user 407. The types of information that may be obtained by the user is accessed via the metadata resident in a third database 207. The metadata comprise information that describes the attributes of a resource, the training regimen, and here serve as a link between the skills database and the mapping function of the system. Examples of metadata elements include, but are not intended to be limited to, an identifier (ID), a title of the training regimen, a description thereof, objectives therefor, duration, version, size, platform requirements, and prerequisites. A tabular depiction of the data flow comprising the mapping is given in FIGS. 3A and 3B, wherein a first table 41 contains the user skills and organization requirements from databases 204,202, including a column of skills 411, the user's current skill level 412, and the organization's desired skill level 413. From these data is generated a second table 42, demonstrating the "skills gap" for each skill, the first column 421 again comprising the skills, the second column 422 the user's current skill level, and the third column 423 the desired skill level. In this table 42, the rows of table 41 have been deleted wherein the user's skill levels matched or exceeded those required.
In a third table 43 a training map is formed, wherein each skill 431 that appears in the second table 42 is located in the metadata database, and mapped to all available courses 433 and their respective skill levels 432. Another important aspect of the invention is that a multiplicity of courses on the same skill having ascending skill levels may be defined hierarchically, so that an entry level is predefined for each course and a series of courses with ascending prerequisite skill levels included in the mapping. For example, in the table 44, five levels of courses, AA, FA, FB, AB, and AC, are recommended to achieve the desired skill level of 5 for Knowledge 1.
It should also be noted that an important aspect of the present invention is that the source of each course 433 is immaterial, as is the skill level range, and that any number of courses, levels, and sources thereof are in principle accessible by the system, so long as the metadata have been entered into the third database so that they may be accessed by the system 10.
As described previously, the metadata included in the metadata database 207 preferably include a "natural language" description 502 of each course. A schematic diagram of automatic matching, automatic linkage, and semiautomatic linkage (FIG.4) indicates that, at this point in the process, an ID 501 of a skill in natural language in the individual's skills database 204 is automatically matched with a course description 502, as well as other metadata elements, such as title 512, also in a natural language, which is an element of the metadata set 500 for a course 510 (here Course AA) in the metadata database 207. A matching algorithm 503 resident in a processor provides the exemplary results shown in block 504. An important feature of the present invention is the ability forthe administrator to select which training metadata element(s) and skilling object metadata element(s) the matching software examines, from one element to all elements. The matching algorithm 503 establishes probable matches between skills and training elements on the basis of probable relevancy, creating a match table with probability scores that provide a high level of certainty for making links of training elements to skills during the linking process.
To describe the matching process in more detail (FIG. 1 D), the administrator performs a "setup" procedure, which comprises selecting metadata elements for each course and skill that are to be considered, such as course title, course description, objectives, etc. (block 680). These selected "operating elements" (Table 1), such as title, description, discipline, etc., are taken from a table containing course information (Table 2) and skills (Table 3). The selected operating elements are then fed to a "harvest" program, which searches through all the words in the operating elements (block 681) and establishes a table (block 682) that contains a list of words found, the number of times each word occurred, and position of each word in the searchable operating elements. The positions of the words may be used during the matching step to give "bonus" points to matches that contain like phrases or word groupings. For example, "software programming" found in a training element and a skill element would provide bonus points in the match score.
The administrator then runs a weighting program (block 685), which compares the words in the word table with a word skip table, which contains a list of words that are to be ignored in the weighting process, such as "a," "an," "the," etc. If desired (block 683), the administrator can modify the word skip table (block 684) prior to running the weighting program (block 685). The weighting program assigns a value to the word, shown as a "1" in Table 4, to those words that should be skipped during the matching process.
The weighting program also creates a phrases table, Table 5, that contains two-, three-, and four-word phrases or word groupings. These phrases are used during the matching program to give "bonus" points to the total match score. For example, "software programming" in a training intervention element and a skilling object element would provide additional bonus points in the total match score.
The weighting program further contains a function that allows the administrator to insert words into a word weight table and assign a weight (normally a value other than the default weight value of "1") to these words. This table, an example of which is found in Table 6, thereby allows the administrator to enhance the probability of valid matches due to known words in the training intervention metadata elements that are used by many different training interventions. For example, if the word "Microsoft" were used in describing many training interventions, the weight may be reduced to a value less than "1." The administrator would complete the word weight table before running the matching program.
Another aspect of the present invention includes a system and method for creating the word skip and word weight tables. The guidelines are presented in Table 6A, along with examples for each type of word that is expected to be encountered. As a general rule, words in the word skip table have a point value of zero (0), while words in the word weight table can have any value. Words that are not placed in one of these tables are assigned a default weight of three (3), as indicated in the "Neither" column in Table 6A.
Exceptions to these general rules are as follows:
If the word is a proper noun such as, for example, acompany name that appears many times in the training intervention metadata elements (e.g., Microsoft, Lotus) in conjunction with a product (e.g., Microsoft Excel) but only a few times in the skilling object metadata elements, then the word should be placed in the word weight table with a point value of "0.006." In cases such as these, the company name is viewed as an '"adjective-like word" and, as such, is given a weight of close to the adjective weight (0.004) or 0.006. If the word is not a proper noun but is used often in the training intervention metadata, a weight of 0.05 is assigned.
If a word (or words) is used to describe a product/technology or an entity (e.g., Dolby, Visual Basic, Virtual Reality, and pneumonia), then the word (or words) should be placed in the word weight table. When assigning point values, caution should be exercised because common usage of these words will cause a higher than normal match scores for invalid associations between the skilling object and the training intervention. It is preferable that the administrator check the results of such action by running a harvest and then examine the results of such settings on the match scores. It may be necessary for the administrator to examine the words in the skilling objects. Adjustments (e.g., lowering of the point value or moving words between the word skip and word weight tables) may be necessary. Typically, technical terms such as "Windows," "server," "Basic," or "Notes" that appear often in the training interventions' metadata are placed in the word weight table with a value of 0.50 and their singular/plural forms are assigned a weight according to the guidelines contained herein. Examples include: "Basic" = 0.50 and "basics" = 0.54; "Notes" = 0.50 and "note" = 0.55; "Access" = 0.50 and "accesses" = 0.55.
Unique words and abbreviations such as "Dolby," "PowerPoint," "NASA," or
"pneumonia" would follow the guideline in Row 15 in Table 6A.
It will be understood by one of skill in the art that, although the exemplary words above primarily occur in the software and computer science arts, they are not intended to limit the breadth of the present invention, and that other subject areas will have their own terms of art for addition to the word skip and word weight tables.
Following the application of the weighting program, the match program is then utilized to perform a mathematical calculation on the tables (block 686) and create a match table (block 687) that shows which training interventions are matched to skilling objects with corresponding scores reflecting the probability of valid matches (Table 7).
A score is calculated that, in an exemplary embodiment, is the sum of three scores.
The higher the score, the higher the probability that a selected course supports the skill desired.
Score 1. An exemplary algorithm for calculating Score 1 is as follows, with the calculation performed for each word from word #1 to word #n in the desired skill and every course (i.e., training intervention). This score looks at each word in the skilling object and compares it to the words in each training intervention. If words are duplicated in the skilling object's words, the calculation is only performed once for each word. The software adjusts for singular and/or plurals. For example, a singular form of a word found in the training intervention and a plural form found in the skilling object are treated as equal. A default word weight value of "1" is given for each word unless modified by the word weight table.
Score 1 = [(count of word #1 in course operating elements)(weight of word #1)] + [(count of word #2 in course operating elements)(weight of word #2)] + ••• + [(count of word #n in course operating elements)(weight of word #t?)]
Score 2. For each combination of two, three, orfourwords in the skilling object's words that match two, three, or four word combinations in the training intervention's words, bonus points (normally 500 for each match) are added to Score 2. The maximum score for Score 2 is set to 9000 (500 x 18 occurrences). The value of the bonus points for the two-, three-, or four-word phrase matches is adjustable by the administrator, but the maximum score for Score 2 cannot exceed 9000. Score 3. Score 3 is obtained by comparing the words in the skilling object's and training intervention's "discipline" elements. An exact match places 10,000 points into Score 3. Score 3 may or may not be used, at the discretion of the administrator during the setup procedure. If the administrator knows that a common "discipline" element exists for some or all skilling objects and training interventions, he/she would select the elements that will be compared for establishing Score 3. If the element is selected for establishing Score 3, the element cannot be used in the Score 1 or Score 2 calculations.
In this method, Score 1 alone shows the relationship of words, without a high probability of the same contextual meaning between the skilling object and training intervention. A Score 1 value above 10 is typically a good indicator that a valid relationship exists.
A Score 2 value between 500 and 9000 indicates an increased probability of a valid relationship because of the combination of words or "like phrases." The higherthe score for Score 2, the higher the probability of a valid relationship. By adding Score 3 to Score 1 and Score 2, the probability of a valid relationship increases dramatically, because it tells us that the skilling object and the training intervention involve the same subject matter (e.g., mathematics, chemistry, information technology, leadership, etc.). For example, a total score of 19,053 would indicate a valid relationship of the skilling object and the training intervention. In this example, both the skilling object and the training intervention could have indicated that the discipline is "IT Tools" (Score 3 = 10,000). There are at least 18 occurrences of matched two-word phrases such as "Microsoft Access" (Score 2 = 500 x 18 = 9000), and 53 occurrences of a word in the training intervention elements that match a word in the skilling object (Score 1 = 53). Table 7 is an example of a Match Table showing a total score consisting of Score
1 + Score 2 and all word weights equal to "1." This table is the result of running the matching software of the present invention on the operating elements of Table 1 ; the training intervention used is shown in Table 2; the skilling objects in Table 3; the results of the word skip table on the words table in Table 4, with the "1"s indicating that the words were not used in the calculation; and Table 5 showing the phrases.
Specifically, the administrator creates links along the semiautomatic pathway 511 by a combination of:
1. Selecting all matches for a range of scores (i.e., setting the lower and higher scores results in all matches equal to or greater than the lower score but less than or equal to the higher score to be linked) or above a selectable threshold level;
2. Selecting one match at a time (i.e., link the one match selected); or
3. Selecting multiple matches (i.e., highlighting various matches and then linking them all simultaneously). The linking software of the present invention permits the administrator to view matches in a "linking screen," a portion of which is illustrated in Table 8.
The administrator may view matches on the linking screen in a plurality of ways, including: by skilling object type; by skilling object identifier or group (e.g., "KNOW5**" displays all matches of skilling objects with IDs of "KNOWδxx"); by training intervention ID or group (e.g., "123**" displays all matches of training interventions with IDs of "123xx"); by match scores above or below a score; by exact match score or group (e.g., "5*" displays all scores between 50.0 and 59.9); all matches by skilling object or training intervention. The linking software further permits sorting the information in any column, in ascending or descending order.
When the administrator makes a link, by selecting a "Link" button on the screen, the match is removed from the match table so that the administrator can continue the linking process on remaining matches if desired. If the administrator subsequently removes a link, the match information is restored into the match table.
When the linking process is complete, the metadata for each course are accessed, and the competency level of each skill linked to a course is set 509, as stated above. The administrator then can call up a screen that permits viewing the training intervention metadata elements. When a particulartraining intervention is selected, the metadata are displayed along with all links to skilling objects. The administrator can then insert or modify the competency level for any linked training intervention. If the administrator wishes, he/she can also select a skilling object to see which training interventions are linked to it and insert or modify the competency level for any linked training intervention.
Returning to FIG. 3B, in a fourth table 44 a training plan is formulated, containing a column 441 of required skills and a column 442 of respective courses to be taken by the user. Thus it may be seen that the system precisely maps the training to the desired tasks, tools, and knowledge required by the organization. The table 44 is created dynamically, based on the user's gap information received by the gap analysis software and the links that were established during the linking process. Another aspect of the present invention comprises a system and method for creating/updating the skilling object metadata database 204 and training metadata database 207, including creating skilling object linkages within the training metadata database 207, which is an integral feature to providing an automated or semiautomated linking framework for creating individualized training regimens. Creating/updating the training metadata database 207 is accomplished by importing training intervention metadata from any desired source into an input means of the system 10 as is known in the art, or, in some cases, providing a linkage to an external source, such as via an intranet or internet. In an automated linking framework the results of a matching algorithm are fed to a system 508 for updating the metadata database 207. In a semiautomated matching framework the results of the matching algorithm are passed to an intermediate step 509, wherein competency level(s) may be set prior to updating the metadata database 207. Also, setting a competency level may be accomplished anytime after links have been established through automatic linkage 507.
More specifically, the software adapted to perform updates when a user adds or changes a training intervention or a skilling object. This software reconciles the differences and focuses on the impact of the new or changed training intervention or skilling object on linkages and/or competency levels. If the administrator initiates a transfer of revised information from an external source (e.g., a learning management system, human resource system, skills management system, CD-ROM, etc.), the update software compares the new information with previously archived information to determine if changes exist and allows the administrator to make necessary updates to the linkages. This process (FIG. 5) comprises the following steps in an exemplary embodiment:
1. The administrator initiates an input of a new training intervention and skilling object element through the input/output interface (block 620). If there is an existing archive (block 621), the software queries the administrator as to whether it is desired to "compare" for differences or to "replace" (block 622). "Replace" removes all matching and linking information in the database (block 623).
2. If the administrator selects "compare" (block 622), the software compares the new information in the current database with the archive (block 624). If there are no differences, the software notifies the administrator (block 625) and then branches to the "main menu" screen (block 626). If there are differences, the software records the identifiers (IDs) of the objects (either new or modified objects) (block 627) and creates a "change table" that lists the IDs of the subject objects (block 628). 3. The software then performs a word harvest on the current database for the IDs contained in the change table (block 629) and a word harvest on the archive for any IDs in the change table that exist in the archive (block 630).
4. The software then compares the two word harvests and creates a "change word table" that reflects the differences in word counts, word positions, and phrases (block 631).
5. After allowing the administrator the opportunity to view the change word table and to make any desired adjustments to the word skip or word weight tables, the software then modifies the words table based on the differences in the change word table (block 632). 6. The software then runs the matching utility, and places the results in the match table (block 633).
7. The software then allows the administrator to view a screen that shows the changes by training intervention (Table 9) or skilling object (Table 10; block 634).
The example shown in Tables 9 and 10 assumes that the information in training intervention "T1" and skilling object "C" has been modified and that there are two new skilling objects, "F" and "G."
8. Both views display every object affected by the changes, the titles of the object and training intervention, the archive match score, the new match score, any links that were previously made, and the corresponding competency levels. Additional features of these views include: a. Modified and new objects are highlighted (here shown in boldface) to make it easy for the administrator to identify them from unchanged objects (block 635). b. Double clicking on an object (training intervention or skilling object) displays a window that shows the archive information and the new information (block 636). This allows the administrator to make judgments on the impact of the new information on links. Obviously, new objects would not have previous information. c. The provision to link (either by individual selections or between
scores) and to set the competency levels provided (block 637). d. The link for each new or modified object is initially shown as a question mark (?), and its corresponding competency level is shown as a dash (-) (block 638). This facilitates the administrator's being able to see which links and competency levels have to be made. e. All links and competency levels for the changed objects should be
made before exiting the update software (block 639). If the administrator exits the update software without making a link and competency determination for every new object (i.e., changing the "Link" column to either "N" or "Y" and setting the competency level for every Y), the software prompts the administrator (block
640), indicating that all links and competency levels forthe changed objects were not made and that the working data will be saved to be worked on at a later time. 9. If the administrator exits the update software without completing the links and competency levels, the software provides a prompt to the administrator each time the program is entered.
FIGURE 1 C represents the functional interplay between system elements for two anticipated accessors of the system 10: an administrator and a user/employee. The administrator's tasks include: (1) load/manage training metadata database; (2) load/manage skilling object metadata database; (3) maintain system configurations; (4) view training intervention metadata elements; (5) view skilling object metadata elements; (6) run software utilities; (7) link training interventions to skilling objects and set corresponding competency levels; and (8) prepare reports. The manager's tasks include: (1) view available courses; (2) view available skills; (3) search courses; (4) create/manage collections of courses based on existing objects; (5) match skills to courses; and (6) report progress. The user's tasks include: (1) select skills needed based on the gap analysis; (2) generate an individual development plan; and (3) send a curriculum to a course management system. The division of tasks within the system 10 are summarized in Table 11.
Function The Administrator
1. Input Updated Skilling 1. Initiates the input of the new training intervention and skilling Object and Training object elements through the Input/Output Interface. Intervention Metadata 2. If there is an existing archive (i.e., Precision Skilling has Elements previously operated on the elements), the Update Software queries the administrator as to whether he/she wants to "Compare" for differences or to "Replace". "Replace" removes all matching and linking information in the current database. NOTE: Replacement is not normally done in an operational environment.
3. If the administrator selects "Replace", the software branches to the 'Main Menu' screen.
4. If the administrator selects 'Compare', the software compares the new information in the current database with the archive. a) If there are no differences, the software notifies the administrator and then branches to the 'Main Menu' screen b) If there are differences, the software records the identifiers (ID's) of the objects (either new or modified objects) and creates a "Change Table" that lists the ID's of the subject objects.
1) The software then performs a word harvest on the current database for the ID's contained in the Change Table and a word harvest on the archive for any ID's in the Change Table that exist in the archive.
2) The software then compares the two harvests and creates a "Change Word Table" that reflects the differences in word counts.
3) The software pauses to allow the administrator the opportunity to view the Change Word Table and to make any adjustments to the Word Skip or Word Weight tables
2. Adjust Word Skip and The administrator views the Change Word Table and to make Word Weight Tables any adjustments to the Word Skip or Word Weight tables.
The administrator's interactions include a login 701 to the processor 12, which typically includes an entry of a password. The administrator is permitted by the system to access the user management subsystem 702 and a user database 703 thereby.
The administrator is responsible for automatically loading the desired skilling object metadata elements into the skilling object metadata database 200, via a routine 704 adapted therefor. The administrator is also responsible for automatically loading training intervention metadata elements into the training intervention metadata database 207 via a routine 706 adapted therefor. Help files 707 are also provided for guiding the administratorthrough the system. For courses that do not contain assessment features therewith, the administrator can use an assessment architect 708 to create them. The administrator uses the matching routine 503 to match training interventions in the training intervention metadata database 207 to skilling objects in the skilling object metadata database 200. The matching routine 503 creates a Match Table 504 that contains scores for each match; the higher the score, the higher the probability of a valid association. Help files 709 are also provided here. The linking software 711 establishes a link and competency table (actually a subset of the training intervention metadata database) that reflects the valid association of skilling objects to training interventions. These associations and corresponding competency levels are used during the gap analysis process 202-207.
The user/employee accesses the system 10 and initiates the gap analysis process 202 - 207, as described earlier. The gap analysis software establishes an individual development plan 208 for the incoming skill gap. The system 10 exports the individual development plan 208 to an external learning management system 710, which the user accesses to take or register for the prescribed training interventions (courses).
From the foregoing, it will be observed that numerous variations and modifications may be effected without departing from the spirit and scope of the invention. It is to be understood that no limitation with respect to the specific apparatus illustrated herein is intended or should be inferred. It is, of course, intended to cover by the appended claims all such modifications as fall within the scope of the claims.
Priority Applications (2)
|Application Number||Priority Date||Filing Date||Title|
|US09705153 US6606480B1 (en)||2000-11-02||2000-11-02||Automated system and method for creating an individualized learning program|
|Publication Number||Publication Date|
|WO2002037447A2 true true WO2002037447A2 (en)||2002-05-10|
|WO2002037447A8 true WO2002037447A8 (en)||2002-09-06|
Family Applications (1)
|Application Number||Title||Priority Date||Filing Date|
|PCT/US2001/045318 WO2002037447A8 (en)||2000-11-02||2001-11-02||Automated individualized learning program creation system and associated methods|
Country Status (2)
|US (2)||US6606480B1 (en)|
|WO (1)||WO2002037447A8 (en)|
Cited By (1)
|Publication number||Priority date||Publication date||Assignee||Title|
|US7937348B2 (en)||2006-11-30||2011-05-03||Iti Scotland Limited||User profiles|
Families Citing this family (171)
|Publication number||Priority date||Publication date||Assignee||Title|
|US7260355B2 (en) *||2000-11-02||2007-08-21||Skillsoft Corporation||Automated individualized learning program creation system and associated methods|
|US6606480B1 (en) *||2000-11-02||2003-08-12||National Education Training Group, Inc.||Automated system and method for creating an individualized learning program|
|US20050287510A1 (en) *||2000-11-10||2005-12-29||Sumrall Kenneth A||Integrated instructional management system and method|
|US20020086267A1 (en) *||2000-11-24||2002-07-04||Thomas Birkhoelzer||Apparatus and method for determining an individually adapted, non-prefabricated training unit|
|US20040221239A1 (en) *||2000-12-20||2004-11-04||Michael Hachigian||System and method for customizing an interactive training sequence|
|US20060014129A1 (en) *||2001-02-09||2006-01-19||Grow.Net, Inc.||System and method for processing test reports|
|JP2003006391A (en) *||2001-03-30||2003-01-10||Fujitsu Ltd||Talent mix education method, talent mix education planning device and program|
|US7181413B2 (en) *||2001-04-18||2007-02-20||Capital Analytics, Inc.||Performance-based training assessment|
|JP2002323847A (en) *||2001-04-26||2002-11-08||Hitachi Ltd||Cooperative learning system and system therefor|
|US7286793B1 (en) *||2001-05-07||2007-10-23||Miele Frank R||Method and apparatus for evaluating educational performance|
|US7210938B2 (en) *||2001-05-09||2007-05-01||K12.Com||System and method of virtual schooling|
|US20030064354A1 (en) *||2001-09-28||2003-04-03||Lewis Daniel M.||System and method for linking content standards, curriculum, instructions and assessment|
|US6999954B2 (en) *||2001-10-10||2006-02-14||The Mcgraw-Hill Companies, Inc.||Modular instruction using cognitive constructs|
|US20030130836A1 (en) *||2002-01-07||2003-07-10||Inventec Corporation||Evaluation system of vocabulary knowledge level and the method thereof|
|US20030139965A1 (en) *||2002-01-22||2003-07-24||Latin Commodities S.A.||Method for evaluating corporate network users knowledge level through an on-line query system|
|US6975833B2 (en) *||2002-02-07||2005-12-13||Sap Aktiengesellschaft||Structural elements for a collaborative e-learning system|
|US7369808B2 (en) *||2002-02-07||2008-05-06||Sap Aktiengesellschaft||Instructional architecture for collaborative e-learning|
|US20030154176A1 (en) *||2002-02-11||2003-08-14||Krebs Andreas S.||E-learning authoring tool|
|US20030152905A1 (en) *||2002-02-11||2003-08-14||Michael Altenhofen||E-learning system|
|US6884074B2 (en)||2002-02-11||2005-04-26||Sap Aktiengesellschaft||Dynamic composition of restricted e-learning courses|
|US7237189B2 (en) *||2002-02-11||2007-06-26||Sap Aktiengesellschaft||Offline e-learning system|
|US7153137B2 (en) *||2002-02-11||2006-12-26||Sap Ag||Offline e-courses|
|US7029280B2 (en)||2002-02-11||2006-04-18||Sap Ag||E-learning course editor|
|US7014467B2 (en)||2002-02-11||2006-03-21||Sap Ag||E-learning course structure|
|US6827578B2 (en) *||2002-02-11||2004-12-07||Sap Aktiengesellschaft||Navigating e-learning course materials|
|US20030152900A1 (en) *||2002-02-11||2003-08-14||Andreas Krebs||E-learning strategies|
|US20030152902A1 (en) *||2002-02-11||2003-08-14||Michael Altenhofen||Offline e-learning|
|JP3915011B2 (en) *||2002-03-20||2007-05-16||富士通株式会社||Skills analysis method, skill analysis program and skill analyzer|
|JP3735307B2 (en) *||2002-03-20||2006-01-18||富士通株式会社||Learning support methods and learning support program|
|JP3995081B2 (en) *||2002-03-27||2007-10-24||富士通株式会社||Learning support methods and learning support program|
|US20070218434A1 (en) *||2002-03-29||2007-09-20||Juergen Habichler||Using skill level history information|
|JP2003296520A (en) *||2002-03-29||2003-10-17||Fujitsu Ltd||Personnel training plan support method, personnel training plan support program and personnel training plan support device|
|US7736150B2 (en) *||2002-06-13||2010-06-15||Pfund Jeffrey A||Module-based education|
|US20070203786A1 (en) *||2002-06-27||2007-08-30||Nation Mark S||Learning-based performance reporting|
|EP1378850A1 (en) *||2002-07-03||2004-01-07||Dr. Hein GmbH||Method and system for the creation of a therapy training program|
|EP1378852A1 (en) *||2002-07-03||2004-01-07||Dr. Hein GmbH||Method and system for therapy planning for persons having multiple disabilities|
|US7264475B1 (en)||2002-07-17||2007-09-04||Sap Ag||Curriculum management|
|US6892049B2 (en) *||2002-07-22||2005-05-10||Sun Microsystems, Inc.||Method and system for selecting training materials|
|US8128414B1 (en) *||2002-08-20||2012-03-06||Ctb/Mcgraw-Hill||System and method for the development of instructional and testing materials|
|US6925601B2 (en) *||2002-08-28||2005-08-02||Kelly Properties, Inc.||Adaptive testing and training tool|
|US20040044892A1 (en) *||2002-09-03||2004-03-04||Elmar Dorner||Content based messaging for e-learning|
|US7146616B2 (en) *||2002-09-03||2006-12-05||Sap Aktiengesellschaft||Content based messaging for e-learning including the extension of a remote procedure call|
|US20040043363A1 (en) *||2002-09-03||2004-03-04||Elmar Dorner||Tutor interface with content based messaging|
|US20040076941A1 (en) *||2002-10-16||2004-04-22||Kaplan, Inc.||Online curriculum handling system including content assembly from structured storage of reusable components|
|US20040126750A1 (en) *||2002-11-15||2004-07-01||Wolfgang Theilmann||Versioning electronic learning objects|
|WO2004075015A3 (en) *||2003-02-14||2005-01-27||Ctb Mcgraw Hill||System and method for creating, assessing, modifying, and using a learning map|
|US8224757B2 (en)||2003-04-15||2012-07-17||Sap Ag||Curriculum management system|
|WO2004109425A2 (en) *||2003-05-14||2004-12-16||Dharamdas Gautam Goradia||Interactive system for building, organising, and sharing one's own databank of questions and answers in a variety of questioning formats, on any subject in one or more languages|
|US20040259068A1 (en) *||2003-06-17||2004-12-23||Marcus Philipp||Configuring an electronic course|
|US20050014121A1 (en) *||2003-07-15||2005-01-20||Hagen Eck||Integrating an external course into an electronic learning system|
|US7878808B1 (en)||2003-09-19||2011-02-01||Sap Ag||Multiple application interactive tutorial player|
|US20050097343A1 (en) *||2003-10-31||2005-05-05||Michael Altenhofen||Secure user-specific application versions|
|US7287066B2 (en) *||2003-10-31||2007-10-23||Sap Aktiengesellschaft||Publish-subscribe system having a reliability mechanism|
|CA2546507A1 (en) *||2003-11-18||2005-07-07||Laureate Education, Inc.||System and method for planning and tracking certification|
|US20050108030A1 (en) *||2003-11-18||2005-05-19||Sylvan Learning Systems, Inc.||System and method for planning and tracking certification plans|
|US7702532B2 (en) *||2003-12-12||2010-04-20||At&T Intellectual Property, I, L.P.||Method, system and storage medium for utilizing training roadmaps in a call center|
|US20050216320A1 (en) *||2004-01-12||2005-09-29||Brian Hattaway||Method of determining requirements for modification of a business operation|
|US9652032B2 (en) *||2004-03-02||2017-05-16||Brian T. Mitchell||Simulated training environments based upon fixated objects in specified regions|
|US20050216506A1 (en) *||2004-03-25||2005-09-29||Wolfgang Theilmann||Versioning electronic learning objects using project objects|
|US20080268417A1 (en) *||2004-03-30||2008-10-30||Peter Hearn||Method and System for On-Line and In-Person Skills Training|
|US20050222899A1 (en) *||2004-03-31||2005-10-06||Satyam Computer Services Inc.||System and method for skill managememt of knowledge workers in a software industry|
|US7957996B2 (en) *||2004-03-31||2011-06-07||International Business Machines Corporation||Market expansion through optimized resource placement|
|US7980855B1 (en)||2004-05-21||2011-07-19||Ctb/Mcgraw-Hill||Student reporting systems and methods|
|US8554130B1 (en) *||2004-09-15||2013-10-08||Cadence Design Systems, Inc.||Method and apparatus to provide machine-assisted training|
|US7914288B2 (en) *||2004-10-07||2011-03-29||International Bussiness Machines Corporation||On demand learning|
|US20060141441A1 (en) *||2004-12-29||2006-06-29||Foundation For Behavioral Resources||Programmed classroom instruction|
|US8568144B2 (en) *||2005-05-09||2013-10-29||Altis Avante Corp.||Comprehension instruction system and method|
|US8764455B1 (en) *||2005-05-09||2014-07-01||Altis Avante Corp.||Comprehension instruction system and method|
|US7870079B2 (en) *||2005-04-11||2011-01-11||Jobfox, Inc.||Method and apparatus for employment system distributed hiring and co-operative pooling|
|US20060247949A1 (en) *||2005-04-29||2006-11-02||Paul Shorrosh||Method for ensuring accuracy of medical patient intake data|
|US8170466B2 (en) *||2005-05-27||2012-05-01||Ctb/Mcgraw-Hill||System and method for automated assessment of constrained constructed responses|
|US20070009871A1 (en) *||2005-05-28||2007-01-11||Ctb/Mcgraw-Hill||System and method for improved cumulative assessment|
|US8175511B1 (en) *||2005-06-08||2012-05-08||Globalenglish Corporation||Techniques for intelligent network-based teaching|
|US7596507B2 (en) *||2005-06-10||2009-09-29||At&T Intellectual Property, I,L.P.||Methods, systems, and storage mediums for managing accelerated performance|
|US20070031801A1 (en) *||2005-06-16||2007-02-08||Ctb Mcgraw Hill||Patterned response system and method|
|US20070009872A1 (en) *||2005-06-21||2007-01-11||Sonsteng John O||System and method for teaching|
|US20070048710A1 (en) *||2005-08-09||2007-03-01||The University Of North Dakota||Bioterrorism and disaster response system|
|US20070048722A1 (en) *||2005-08-26||2007-03-01||Donald Spector||Methods and system for implementing a self-improvement curriculum|
|US20070050238A1 (en) *||2005-09-01||2007-03-01||Michael Carr||Computer-implemented apparatus and method for capturing and monitoring employee development and performance in a call center|
|US7593860B2 (en) *||2005-09-12||2009-09-22||International Business Machines Corporation||Career analysis method and system|
|EP1764760A1 (en) *||2005-09-16||2007-03-21||Sap Ag||An e-learning system and a method of e-learning|
|US20070065788A1 (en) *||2005-09-20||2007-03-22||Inscape Publishing, Inc.||Method for developing a curriculum|
|GB0519234D0 (en) *||2005-09-21||2005-10-26||Ibm||Content management system|
|US7552199B2 (en) *||2005-09-22||2009-06-23||International Business Machines Corporation||Method for automatic skill-gap evaluation|
|US20070087317A1 (en) *||2005-10-14||2007-04-19||Taheri Paul A||Method of providing a non-core curriculum|
|US20070088809A1 (en) *||2005-10-17||2007-04-19||Mapas Syd Ab||Control system for controlling, accelerating and distributing of competence development|
|US20070088562A1 (en) *||2005-10-18||2007-04-19||International Business Machines Corporation||Method and program product for identifying educational content for a business initiative|
|US20070111180A1 (en) *||2005-10-24||2007-05-17||Sperle Robin U||Delivery methods for remote learning system courses|
|US8121985B2 (en)||2005-10-24||2012-02-21||Sap Aktiengesellschaft||Delta versioning for learning objects|
|US20070111183A1 (en) *||2005-10-24||2007-05-17||Krebs Andreas S||Marking training content for limited access|
|US7840175B2 (en) *||2005-10-24||2010-11-23||S&P Aktiengesellschaft||Method and system for changing learning strategies|
|US8571462B2 (en)||2005-10-24||2013-10-29||Sap Aktiengesellschaft||Method and system for constraining learning strategies|
|US7757234B2 (en) *||2005-10-24||2010-07-13||Sap Aktiengesellschaft||Methods and software for a batch processing framework for wizard-based processes|
|US7467947B2 (en) *||2005-10-24||2008-12-23||Sap Aktiengesellschaft||External course catalog updates|
|US20070099165A1 (en) *||2005-10-31||2007-05-03||Sap Ag||Method and system for computer assisted training and credentialing with follow-up control|
|US20070099161A1 (en) *||2005-10-31||2007-05-03||Krebs Andreas S||Dynamic learning courses|
|US20070100882A1 (en) *||2005-10-31||2007-05-03||Christian Hochwarth||Content control of a user interface|
|US7516274B2 (en) *||2005-11-15||2009-04-07||Sun Microsystems, Inc.||Power conservation via DRAM access reduction|
|US20070196798A1 (en) *||2006-02-17||2007-08-23||Innertalent Corporation||Self-improvement system and method|
|US20070224585A1 (en) *||2006-03-13||2007-09-27||Wolfgang Gerteis||User-managed learning strategies|
|US20080014568A1 (en) *||2006-07-12||2008-01-17||Theodore Craig Hilton||Method and apparatus for correlating and aligning educational curriculum goals with learning content, entity standards and underlying precedents|
|GB0616107D0 (en) *||2006-08-15||2006-09-20||Iti Scotland Ltd||Games-based learning|
|US7818164B2 (en)||2006-08-21||2010-10-19||K12 Inc.||Method and system for teaching a foreign language|
|US20080126319A1 (en) *||2006-08-25||2008-05-29||Ohad Lisral Bukai||Automated short free-text scoring method and system|
|US20080059292A1 (en) *||2006-08-29||2008-03-06||Myers Lloyd N||Systems and methods related to continuous performance improvement|
|WO2008027053A1 (en) *||2006-08-31||2008-03-06||Achieve3000, Inc.||System and method for providing differentiated content based on skill level|
|US20080059484A1 (en) *||2006-09-06||2008-03-06||K12 Inc.||Multimedia system and method for teaching in a hybrid learning environment|
|US20080077920A1 (en) *||2006-09-21||2008-03-27||Andreas Faatz||System for suggesting training|
|US7869988B2 (en)||2006-11-03||2011-01-11||K12 Inc.||Group foreign language teaching system and method|
|GB0624033D0 (en) *||2006-12-01||2007-01-10||Iti Scotland Ltd||Dynamic intervention with software applications|
|WO2008086240A3 (en) *||2007-01-04||2008-09-18||Dreambox Learning Inc||Dashboard for monitoring a child's interaction with a network-based educational system|
|US8251704B2 (en)||2007-04-12||2012-08-28||Microsoft Corporation||Instrumentation and schematization of learning application programs in a computerized learning environment|
|US8137112B2 (en)||2007-04-12||2012-03-20||Microsoft Corporation||Scaffolding support for learning application programs in a computerized learning environment|
|US20080254432A1 (en) *||2007-04-13||2008-10-16||Microsoft Corporation||Evaluating learning progress and making recommendations in a computerized learning environment|
|US20080261194A1 (en) *||2007-04-18||2008-10-23||Theodore Craig Hilton||Method and apparatus for implementing an independent learning plan (ILP) based on academic standards|
|US8725059B2 (en) *||2007-05-16||2014-05-13||Xerox Corporation||System and method for recommending educational resources|
|US8503924B2 (en) *||2007-06-22||2013-08-06||Kenneth W. Dion||Method and system for education compliance and competency management|
|US20090081628A1 (en) *||2007-09-24||2009-03-26||Roy Leban||System and method for creating a lesson|
|US9542853B1 (en)||2007-12-10||2017-01-10||Accella Learning, LLC||Instruction based on competency assessment and prediction|
|US8356997B1 (en) *||2007-12-10||2013-01-22||Accella Learning, LLC||Intelligent tutoring system|
|US20090246744A1 (en) *||2008-03-25||2009-10-01||Xerox Corporation||Method of reading instruction|
|US8798522B2 (en) *||2008-04-28||2014-08-05||Nexlearn, Llc||Simulation authoring tool|
|US8155948B2 (en) *||2008-07-14||2012-04-10||International Business Machines Corporation||System and method for user skill determination|
|WO2010011972A8 (en) *||2008-07-24||2010-05-20||Headsprout, Inc.||Teaching reading comprehension|
|US7920935B2 (en) *||2008-08-19||2011-04-05||International Business Machines Corporation||Activity based real-time production instruction adaptation|
|US20100075290A1 (en) *||2008-09-25||2010-03-25||Xerox Corporation||Automatic Educational Assessment Service|
|US20100075291A1 (en) *||2008-09-25||2010-03-25||Deyoung Dennis C||Automatic educational assessment service|
|US8644755B2 (en)||2008-09-30||2014-02-04||Sap Ag||Method and system for managing learning materials presented offline|
|US20100105017A1 (en) *||2008-10-28||2010-04-29||Siemens Aktiengesellschaft||Central control for web-based health care training|
|US20100120000A1 (en) *||2008-11-11||2010-05-13||Valorie Bellamy||Method and Business Form for Employee Management and Improvement|
|US8460000B2 (en) *||2008-11-18||2013-06-11||Tariq Farid||Computer implemented method for facilitating proscribed business operations|
|US8699939B2 (en) *||2008-12-19||2014-04-15||Xerox Corporation||System and method for recommending educational resources|
|US20100159437A1 (en) *||2008-12-19||2010-06-24||Xerox Corporation||System and method for recommending educational resources|
|US8457544B2 (en) *||2008-12-19||2013-06-04||Xerox Corporation||System and method for recommending educational resources|
|US20100157345A1 (en) *||2008-12-22||2010-06-24||Xerox Corporation||System for authoring educational assessments|
|US20100190142A1 (en) *||2009-01-28||2010-07-29||Time To Know Ltd.||Device, system, and method of automatic assessment of pedagogic parameters|
|US20100190143A1 (en) *||2009-01-28||2010-07-29||Time To Know Ltd.||Adaptive teaching and learning utilizing smart digital learning objects|
|WO2011019754A3 (en) *||2009-08-13||2011-04-21||Blake Dickeson||Apparatus, system, and method for determining a change in test results|
|US8838015B2 (en) *||2009-08-14||2014-09-16||K12 Inc.||Systems and methods for producing, delivering and managing educational material|
|US20110039246A1 (en) *||2009-08-14||2011-02-17||Ronald Jay Packard||Systems and methods for producing, delivering and managing educational material|
|US8768240B2 (en) *||2009-08-14||2014-07-01||K12 Inc.||Systems and methods for producing, delivering and managing educational material|
|US20110039249A1 (en) *||2009-08-14||2011-02-17||Ronald Jay Packard||Systems and methods for producing, delivering and managing educational material|
|US20110077989A1 (en) *||2009-09-24||2011-03-31||Accenture Global Services Limited||System for valuating employees|
|US20110076654A1 (en) *||2009-09-30||2011-03-31||Green Nigel J||Methods and systems to generate personalised e-content|
|US8768241B2 (en) *||2009-12-17||2014-07-01||Xerox Corporation||System and method for representing digital assessments|
|CA2723653A1 (en) *||2010-01-07||2011-07-07||Desire2Learn Incorporated||Systems and methods for guided instructional design in electronic learning systems|
|US20110177480A1 (en)||2010-01-15||2011-07-21||Satish Menon||Dynamically recommending learning content|
|US20120329030A1 (en) *||2010-01-29||2012-12-27||Dan Joseph Leininger||System and method of knowledge assessment|
|US20110189645A1 (en) *||2010-01-29||2011-08-04||Daniel Leininger||System and method of knowledge assessment|
|US20110195389A1 (en) *||2010-02-08||2011-08-11||Xerox Corporation||System and method for tracking progression through an educational curriculum|
|US20110236870A1 (en) *||2010-03-26||2011-09-29||Mentormob, Inc.||System and method for learning|
|US8521077B2 (en)||2010-07-21||2013-08-27||Xerox Corporation||System and method for detecting unauthorized collaboration on educational assessments|
|US20120066017A1 (en) *||2010-09-09||2012-03-15||Siegel Paul E||System and Method for Utilizing Industry Specific Competencies to Maximize Resource Utilization|
|US20120171648A1 (en) *||2010-12-29||2012-07-05||Paula Price||System for increasing the probability of success and identifying required preparation for service in lifestyle occupations|
|US8543515B2 (en)||2011-02-25||2013-09-24||Career Management Solutions, Llc||System and method for social recruiting|
|US20130101975A1 (en) *||2011-09-20||2013-04-25||Lumos Labs, Inc.||System and Method for Targeting Specific Benefits with Cognitive Training|
|US20130095461A1 (en) *||2011-10-12||2013-04-18||Satish Menon||Course skeleton for adaptive learning|
|US8738364B2 (en) *||2011-12-14||2014-05-27||International Business Machines Corporation||Adaptation of vocabulary levels for enhanced collaboration|
|US20130224719A1 (en) *||2012-02-27||2013-08-29||Gove N. Allen||Digital assignment administration|
|CA2781394A1 (en) *||2012-04-23||2013-10-23||Mambourin Enterprises Inc.||Goal-oriented planning system|
|US8821242B2 (en) *||2012-07-25||2014-09-02||Lumos Labs, Inc.||Systems and methods for enhancing cognition|
|US20140052659A1 (en) *||2012-08-14||2014-02-20||Accenture Global Services Limited||Learning management|
|US20140120514A1 (en) *||2012-10-26||2014-05-01||Cheng Hua YUAN||Cloud Learning System Capable of Enhancing Learner's Capability Based on Then-Current Contour or Profile of Levels or Capabilities of the Learner|
|WO2014092456A1 (en) *||2012-12-14||2014-06-19||주식회사 테라클||Method and device for providing study content|
|US9009028B2 (en)||2012-12-14||2015-04-14||Google Inc.||Custom dictionaries for E-books|
|US20140287399A1 (en) *||2013-03-21||2014-09-25||Infosys Limited||Systems and methods for learning and learning oriented assessment|
|US9116509B2 (en)||2013-06-03||2015-08-25||Lumos Labs, Inc.||Rhythm brain fitness processes and systems|
|US20150149378A1 (en) *||2013-11-26||2015-05-28||Chegg, Inc.||Job recall services in online education platforms|
|US20160012395A1 (en) *||2014-07-08||2016-01-14||Morphlynx, Inc.||Human Capital Rating, Ranking and Assessment System and Method|
|US9646512B2 (en) *||2014-10-24||2017-05-09||Lingualeo, Inc.||System and method for automated teaching of languages based on frequency of syntactic models|
|US20160358493A1 (en) *||2015-06-03||2016-12-08||D2L Corporation||Methods and systems for modifying a learning path for a user of an electronic learning system|
Family Cites Families (39)
|Publication number||Priority date||Publication date||Assignee||Title|
|US5437553A (en)||1991-04-08||1995-08-01||Collins; Deborah L.||Method and apparatus for automated learning and performance evaluation|
|US6162060A (en) *||1991-08-09||2000-12-19||Texas Instruments Incorporated||System and method for the delivery, authoring, and management of courseware over a computer network|
|US5267865A (en)||1992-02-11||1993-12-07||John R. Lee||Interactive computer aided natural learning method and apparatus|
|US5446891A (en)||1992-02-26||1995-08-29||International Business Machines Corporation||System for adjusting hypertext links with weighed user goals and activities|
|US5302132A (en)||1992-04-01||1994-04-12||Corder Paul R||Instructional system and method for improving communication skills|
|US5692906A (en)||1992-04-01||1997-12-02||Corder; Paul R.||Method of diagnosing and remediating a deficiency in communications skills|
|US5416694A (en) *||1994-02-28||1995-05-16||Hughes Training, Inc.||Computer-based data integration and management process for workforce planning and occupational readjustment|
|US6334779B1 (en) *||1994-03-24||2002-01-01||Ncr Corporation||Computer-assisted curriculum|
|US6336813B1 (en) *||1994-03-24||2002-01-08||Ncr Corporation||Computer-assisted education using video conferencing|
|US6386883B2 (en) *||1994-03-24||2002-05-14||Ncr Corporation||Computer-assisted education|
|CA2151527C (en)||1994-06-13||2009-08-18||Michael E. Jay||Method and apparatus for correlating educational requirements|
|EP0760313A3 (en) *||1995-08-25||1998-11-11||Mannesmann VDO AG||Electrical distribution centre for vehicles|
|US6139330A (en) *||1996-03-19||2000-10-31||Ho; Chi Fai||Computer-aided learning system and method|
|US5779486A (en) *||1996-03-19||1998-07-14||Ho; Chi Fai||Methods and apparatus to assess and enhance a student's understanding in a subject|
|US5879165A (en)||1996-03-20||1999-03-09||Brunkow; Brian||Method for comprehensive integrated assessment in a course of study or occupation|
|US6427063B1 (en) *||1997-05-22||2002-07-30||Finali Corporation||Agent based instruction system and method|
|US6157808A (en) *||1996-07-17||2000-12-05||Gpu, Inc.||Computerized employee certification and training system|
|US5823781A (en) *||1996-07-29||1998-10-20||Electronic Data Systems Coporation||Electronic mentor training system and method|
|US8342854B2 (en) *||1996-09-25||2013-01-01||Educate Online Technology, Llc||Language-based computer generated instructional material|
|CN1171187C (en) *||1996-09-25||2004-10-13||教育公司||Automated testing and electronic instructional delivery and student management system|
|US6039575A (en) *||1996-10-24||2000-03-21||National Education Corporation||Interactive learning system with pretest|
|US6091930A (en) *||1997-03-04||2000-07-18||Case Western Reserve University||Customizable interactive textbook|
|US6270351B1 (en) *||1997-05-16||2001-08-07||Mci Communications Corporation||Individual education program tracking system|
|US6347943B1 (en) *||1997-10-20||2002-02-19||Vuepoint Corporation||Method and system for creating an individualized course of instruction for each user|
|US6322366B1 (en) *||1998-06-30||2001-11-27||Assessment Technology Inc.||Instructional management system|
|US6126448A (en) *||1998-07-06||2000-10-03||Ho; Chi Fai||Computer-aided learning methods and apparatus for a job|
|US6149441A (en) *||1998-11-06||2000-11-21||Technology For Connecticut, Inc.||Computer-based educational system|
|US6275812B1 (en)||1998-12-08||2001-08-14||Lucent Technologies, Inc.||Intelligent system for dynamic resource management|
|US6164975A (en) *||1998-12-11||2000-12-26||Marshall Weingarden||Interactive instructional system using adaptive cognitive profiling|
|US6301462B1 (en) *||1999-01-15||2001-10-09||Unext. Com||Online collaborative apprenticeship|
|US20020026452A1 (en) *||2000-05-17||2002-02-28||Jason Baumgarten||Internet based employee/executive recruiting system and method|
|US20020064766A1 (en) *||2000-05-19||2002-05-30||Kerri Cozens||Method and apparatus for managing enterprise employee training systems|
|US20020022999A1 (en) *||2000-06-23||2002-02-21||Shuster Brian Mark||Method and apparatus for providing audio advertisements in a computer network|
|US6651071B1 (en) *||2000-08-04||2003-11-18||Alverno College||User interface educational database system for monitoring proficiency, performance and evaluation of student|
|US6622003B1 (en)||2000-08-14||2003-09-16||Unext.Com Llc||Method for developing or providing an electronic course|
|US6606480B1 (en) *||2000-11-02||2003-08-12||National Education Training Group, Inc.||Automated system and method for creating an individualized learning program|
|US20020098468A1 (en) *||2001-01-23||2002-07-25||Avatar Technology, Inc.||Method for constructing and teaching a curriculum|
|US6554618B1 (en) *||2001-04-20||2003-04-29||Cheryl B. Lockwood||Managed integrated teaching providing individualized instruction|
|US6587668B1 (en)||2001-04-30||2003-07-01||Cyberu, Inc.||Method and apparatus for a corporate education system|
Non-Patent Citations (1)
|No Search *|
Cited By (1)
|Publication number||Priority date||Publication date||Assignee||Title|
|US7937348B2 (en)||2006-11-30||2011-05-03||Iti Scotland Limited||User profiles|
Also Published As
|Publication number||Publication date||Type|
|US6199067B1 (en)||System and method for generating personalized user profiles and for utilizing the generated user profiles to perform adaptive internet searches|
|Alavi et al.||A review of MIS research and disciplinary development|
|Mousseau et al.||A user-oriented implementation of the ELECTRE-TRI method integrating preference elicitation support|
|US6944609B2 (en)||Search results using editor feedback|
|US6725232B2 (en)||Database system for laboratory management and knowledge exchange|
|US5263167A (en)||User interface for a relational database using a task object for defining search queries in response to a profile object which describes user proficiency|
|US6052676A (en)||Adaptive hypermedia presentation method and system|
|US20020198750A1 (en)||Risk management application and method|
|US4954981A (en)||Method and apparatus for accessing and manipulating time series|
|US6519578B1 (en)||System and method for processing knowledge items of a knowledge warehouse|
|US20030088567A1 (en)||Methods of providing computer systems with bundled access to restricted-access databases|
|US5809297A (en)||Semantic object modeling system for creating relational database schemas|
|US7555441B2 (en)||Conceptualization of job candidate information|
|US20090192966A1 (en)||Cost-benefit approach to automatically composing answers to questions by extracting information from large unstructured corpora|
|US6212518B1 (en)||System and method for retrieval of data from related databases based upon database association model|
|US5517405A (en)||Expert system for providing interactive assistance in solving problems such as health care management|
|US20010031451A1 (en)||Method for interactively monitoring and changing the behavior, attitude or educational state of an individual, in particular an individual related to an organization|
|US7216121B2 (en)||Search engine facility with automated knowledge retrieval, generation and maintenance|
|US5566291A (en)||Method and apparatus for implementing user feedback|
|US20050060205A1 (en)||Systems and methods for a graphical input display in an insurance processing system|
|US5832494A (en)||Method and apparatus for indexing, searching and displaying data|
|Katz et al.||Effects of scent and breadth on use of site-specific search on e-commerce Web sites|
|US7567953B2 (en)||System and method for retrieving and organizing information from disparate computer network information sources|
|US20030191780A1 (en)||Computer system and method for the search statistical evaluation and analysis of documents|
|US5566333A (en)||Relational database information management system for facilitating normalization of a relational database|
|D17||Declaration under article 17(2)a|
|DFPE||Request for preliminary examination filed prior to expiration of 19th month from priority date (pct application filed before 20040101)|
|121||Ep: the epo has been informed by wipo that ep was designated in this application|
|REG||Reference to national code||
Ref country code: DE
Ref legal event code: 8642
|122||Ep: pct application non-entry in european phase|
|WWW||Wipo information: withdrawn in national office||
Country of ref document: JP
|NENP||Non-entry into the national phase in:||
Ref country code: JP