WO2000077672A2 - Procede et systeme destines a evaluer des connaissances - Google Patents

Procede et systeme destines a evaluer des connaissances Download PDF

Info

Publication number
WO2000077672A2
WO2000077672A2 PCT/US2000/016547 US0016547W WO0077672A2 WO 2000077672 A2 WO2000077672 A2 WO 2000077672A2 US 0016547 W US0016547 W US 0016547W WO 0077672 A2 WO0077672 A2 WO 0077672A2
Authority
WO
WIPO (PCT)
Prior art keywords
exam
candidate
candidates
assessment
client
Prior art date
Application number
PCT/US2000/016547
Other languages
English (en)
Other versions
WO2000077672A3 (fr
Inventor
Robert W. Hatton
Original Assignee
Knowledgebase.Com
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Knowledgebase.Com filed Critical Knowledgebase.Com
Priority to AU57420/00A priority Critical patent/AU5742000A/en
Publication of WO2000077672A2 publication Critical patent/WO2000077672A2/fr
Publication of WO2000077672A3 publication Critical patent/WO2000077672A3/fr

Links

Classifications

    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09B—EDUCATIONAL OR DEMONSTRATION APPLIANCES; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND, DEAF OR MUTE; MODELS; PLANETARIA; GLOBES; MAPS; DIAGRAMS
    • G09B7/00—Electrically-operated teaching apparatus or devices working with questions and answers
    • G09B7/02—Electrically-operated teaching apparatus or devices working with questions and answers of the type wherein the student is expected to construct an answer to the question which is presented or wherein the machine gives an answer to the question presented by a student
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q99/00—Subject matter not provided for in other groups of this subclass

Definitions

  • TITLE METHOD AND SYSTEM FOR SKILLS ASSESSMENT
  • the present invention is drawn to a system to allow clients, such as recruiters and prospective employers, to screen the skills of candidates without havmg to tie up their own employees More particularly, it is drawn to usmg the Internet to administer and evaluate the results of a broad database of skills assessment exams
  • Figure 1 illustrates a first embodiment of the present mvention Figure 2 discloses some examples of the subjects to be covered by the present mvention Figure 3 shows a possible grouping of exams for a techmcal support candidate in accordance with the present invention
  • Figure 4 shows a groupmg of tests exemplary of the present mvention
  • Figure 5 shows some of the tests for office skills of the present invention
  • Figure 6 shows one sample of the results report of the present invention
  • Figure 7 shows another sample of the results report of the present invention
  • Figure 8 illustrates a page for viewing a selected exam and the associated candidates for the administration of the present invention
  • Figure 9 illustrates an exam taker management area page of the present invention
  • Figure 10 illustrates an exam modification or deletion page of the present mvention DETAILED DESCRIPTION OF THE INVENTION
  • the present system starts with one or more databases of assessment exams.
  • Exams covering similar subject matter can be grouped together on separate databases if desired for access speed or other functional reasons.
  • Figure 2 gives some examples of the subjects to be covered. Additional subjects are added as the need arises or as the technology develops. This listing is intended to provide examples and not as limiting the scope of the invention. Some of these tests are grouped together for certain job specifications.
  • figure 3 shows the possible grouping of exams for a technical support candidate.
  • Figure 4 shows a grouping of tests designed to evaluate the skills and knowledge of those candidates applying for entry level positions in a computer or information technology group. While the system is particularly helpful for computer technology employment, it is also utilized for testing for various other skills such as office worker, medical staff, legal assistants, litigation support staff, accounting personnel, customer service and the like.
  • Figure 5 shows some of the tests for office skills.
  • the tests are designed to provide the most information in the shortest test period. Feedback from the test results is utilized to modify and optimize the test. Additionally, a customer or client can supply their own private test to be added to the database.
  • the present system provides recruiters with the flexibility of designing a customized technical exam in a very short period of time. In accordance with one embodiment, the customization can take place in less than three minutes.
  • the system provides an extremely user-friendly interface that requires only a very few steps to create an exam. The following outline describes the five easy steps to create one of the exams in accordance with one embodiment of the invention. 1. After entry into the Internet web site, the user would click on the "Create An Exam" icon and type in the usemame and password.
  • the program will then generate a page that would allow the user to view every subject and skill level. 2.
  • the user chooses the subjects and skill levels that are desired for the exam. In accordance with one embodiment of the invention, there are three skill levels for each exam. The user may give exams in all three skill levels if desired. 3.
  • the program will then generate an outline of the customized exam that was just created. The program will then ask if the user wishes to make any changes to the exam. 4. If the exam outline is acceptable, the user is prompted to give the exam a name in a special field. If the exam outline is not acceptable, the user clicks on a "Back" button on the desktop computer to make changes. 5.
  • an "Okay” button is clicked by the user.
  • the program will then give the user a code number which is utilized by the user to give to the candidates whenever the user wishes one candidate to take that specific exam.
  • the program will also email the user this information for their records.
  • a user may design as many exams as are desired by clicking on the "Create An Exam” icon. The above five steps are repeated for each type of exam created.
  • a candidate can take the exam, once they have the code number, at any time by accessing the database from any site. Since the test does not have to be administered at the prospective employers site, taking the test can be done 24 hours a day, all days of the year. Accessing the test site over the Internet is the preferred method. This allows access by the largest number of potential candidates.
  • Those candidates that do not have access to the Internet can still utilize the system at the employer's site or other sites available to the public.
  • the ability to access the system over the Internet also bridges geographic boundaries.
  • the test is available to the candidate at any time from anywhere in the world that has Internet connection. Once the candidate takes the exam, the test creator is automatically notified via email.
  • the process allows users to customize their own exams. This is advantageous, because a recruiter cannot be an expert in every release of every product in every environment.
  • the system of the present invention provides an online screening tool to combat that very challenge. With the present invention, a recruiter can design an exam that is specific to the particular technical needs. The system can handle a significant number of different subjects available in various difficulty levels.
  • a recruiter may utilize exams covering over 100 different subjects available in three different difficulty levels.
  • the recruiter can pick and choose the skill requirements to match the needs. This flexibility gives the recruiter great advantage when interviewing a candidate. It allows the recruiter to already know where the weak points are with the candidate as they apply to the specific requirements. Additionally, others in the organization may have reviewed the technical results of the technical exams.
  • the exams are structured in such a way as to provide additional validation to candidates' statements on their resumes regarding their technical abilities before an organization invests additional time and effort in the interview process
  • the results of the exams m accordance with the present invention would eliminate wasted time in the interview process and, at a minimum, reduce the amount of time spent in interviewing by allowing some external feedback about the candidates p ⁇ or to the personal mterview process Additionally, the ability to verify a candidate's claims on their resume eliminates future problems in case the candidate has exaggerated or misrepresented their qualifications
  • the exams are structured to give va ⁇ ous exams directed to va ⁇ ous levels of expertise in any one particular subject For example, three separate skill levels are provided for each subject These levels are put m place so that recruiters can measure their candidate at the true level that is desired for each specific position For example, when a requirement calls for a basic understanding of a subject matter, a beginner level or basic level exam is structured for these purposes On the other hand, if the position requires three years of heavy expe ⁇ ence.
  • the basic level test would not provide the proper feedback for such a requirement
  • the recruiter can design the exam around the specific levels of skill sets that are needed and save the time and aggravation of trying to decide if a candidate has enough ability to perform the specific tasks required
  • va ⁇ ous levels most subjects can be tested at three levels: a basic level, an intermediate level, and an advanced level These levels can be modified m accordance with the subject to be tested
  • a basic level question is utilized when the applicant has to demonstrate that they understand the functionality of the subject or have a comprehension of how to use the fundamentals of the subject
  • a basic skill set would be a person who has used the subject between one to six months, or someone who has formerly studied the subject but has not yet had a professional job in the topic area
  • An intermediate level question is utilized when the applicant needs to demonstrate that they understand how to operate the commonly used functions in the subject, and how to troubleshoot common issues of the subject
  • An intermediate skill set would be a person who works with the subject on a daily basis
  • each exam question is set on a 80 second timer, to allow the candidate ample time to answer the question
  • the set time for each question is mtended to make it difficult to cheat by utilizing manual
  • the client can create as many selected exams as desired and each is given a different access code
  • the client passes the access code to any candidate 140 that the client wishes to be tested (step 7)
  • the candidate 140 utilizes the access code to connect to the server 120 and access the selected exam 130 (step 8)
  • access to the exam can be made at any time from any location, preferably usmg any standard browser software
  • the client may request that the exam be accessed only du ⁇ ng a limited time pe ⁇ od either to duration or to time of the day
  • the candidate is asked to provide identification so that the employer can tie the results to the candidate Examination centers can be set up at ⁇ a ⁇ ous locations where the identity of the candidate taking the exam can be ve ⁇ fied
  • This is utilized where the candidate is suspected of havmg someone else take the exam for him or her or to prevent a group from assisting in taking the exam
  • other secu ⁇ ty means including biometrics like voice signatures
  • the client 100 can also access the actual selected exam taken by the candidate to review the specific answers
  • Figure 6 shows one sample of the results report for a candidate taking va ⁇ ous skill level exams for the Microsoft® family of software products
  • Figure 7 shows one sample of the results report for a candidate taking the basic skills level exam for HTML 4 0 knowledge
  • the recruiter sees all the exams they created, the number of candidates viewed, the number of candidates whose results have not been viewed and the exam passed number
  • the recruiter can see the date when the candidate took the test, how long it took the candidate to complete the test and the date when the recruiter viewed the results Results may also be deleted from this page
  • the system can offer the customer the ability to reset candidate's results through the "Manage Exam Takers" area of the site, as illustrated in figure 9 Now if a candidate loses their connection while taking a test, the recruiter can reset the candidate so they can retake the test
  • the system includes means to reduce the likelihood of cheating.
  • the product has timed questions and mcludes codes to prevent pnnting. Specifically, the "print screen" function is blocked.
  • the system also mcludes random question selection so that duplicate tests will be infrequent 2.
  • the present system provides for exams covering an unlimited number of subjects. For each subject, a large number of questions are generated. In one embodiment, each subject would include about 300 questions The actual exam given to any candidate would not include all of the questions. In one embodiment, each exam is 17 questions. 3.
  • the present invention allows the client to tailor the exam set to the particular candidate. In today's environment, each candidate is umque m their qualifications and often would have expertise in more than one techmcal field or disciplme. 4.
  • the client can load their own exam to the system for their own p ⁇ vate use.
  • Feedback from the candidates is sought in order to continually optimize and modify the exams to meet the need of both the target candidates and the client.
  • the exam preparation is a process involving both techmcal experts and promment authors m the subject field. The exams are subjected to several review stages p ⁇ or to blind testmg. The results of testing are utilized to enhance the product exam, where needed, p ⁇ or to placmg on the server system for use by clients. 7.
  • the participation by the authors or experts m the subject field is encouraged by providing the experts with economic incentive tied to the net mcome of the system.
  • Examples include computer technology, programming, network applications, office skills, scientific disciplines, medical fields, accounting and the like
  • the hardware components utilized m the present invention are readily identifiable by a person skilled m the art
  • a Pentium II 400 mhz with 30 gig of disk space is utilized with 3 Tl connections
  • the web server is runnmg Wmdows NT and SQL 6.5.
  • the exams application is implemented using ASP (Active Server Pages)
  • ASP Active Server Pages
  • Other systems can be utilized to improve speed and storage capabilities
  • Additional Internet connections can also be provided dependmg on traffic requirements
  • the present mvention has been desc ⁇ bed above as employed on the Internet, the term Internet, as used herem. is also meant to include future developments, such as the Next Generation Internet (NGI) or Intemet2

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Business, Economics & Management (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • General Business, Economics & Management (AREA)
  • Educational Administration (AREA)
  • Educational Technology (AREA)
  • Management, Administration, Business Operations System, And Electronic Commerce (AREA)

Abstract

L'invention concerne des examens servant à évaluer les connaissances de candidats potentiels (140) à un emploi pour des clients, de préférence sur un réseau (110) tel que l'Internet. Un serveur (120) est connecté à une base de données comprenant des examens d'évaluation de connaissances. Ainsi, les candidats peuvent accéder au serveur (120) se trouvant sur le réseau (110) au moyen d'un navigateur et d'un code fourni par un client afin de passer un examen choisi (130). Le serveur (120) note immédiatement les examens et avertit le client (100) lorsqu'un candidat (140) a terminé un examen d'évaluation. Les résultats peuvent être visualisés et gérés par le client (100) sur le réseau (110). Les clients (100) peuvent choisir des examens standard ou créer des examens personnalisés pour des candidats potentiels (140).
PCT/US2000/016547 1999-06-16 2000-06-15 Procede et systeme destines a evaluer des connaissances WO2000077672A2 (fr)

Priority Applications (1)

Application Number Priority Date Filing Date Title
AU57420/00A AU5742000A (en) 1999-06-16 2000-06-15 Method and system for skills assessment

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US13930099P 1999-06-16 1999-06-16
US60/139,300 1999-06-16

Publications (2)

Publication Number Publication Date
WO2000077672A2 true WO2000077672A2 (fr) 2000-12-21
WO2000077672A3 WO2000077672A3 (fr) 2001-05-10

Family

ID=22485994

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/US2000/016547 WO2000077672A2 (fr) 1999-06-16 2000-06-15 Procede et systeme destines a evaluer des connaissances

Country Status (2)

Country Link
AU (1) AU5742000A (fr)
WO (1) WO2000077672A2 (fr)

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2002077770A2 (fr) * 2001-03-22 2002-10-03 Prorail Systeme et procede de realisation de suivi de verification
EP1251477A2 (fr) * 2001-04-20 2002-10-23 Cognisco Limited Appareil permettant d'évaluer la compétence d'un candidat
US7295991B1 (en) * 2000-11-10 2007-11-13 Erc Dataplus, Inc. Employment sourcing system
WO2016020940A1 (fr) * 2014-08-07 2016-02-11 Saini Pramod Systèmes et procédés d'évaluation électronique de candidats

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US4820167A (en) * 1987-01-14 1989-04-11 Nobles Anthony A Electronic school teaching system
US5326270A (en) * 1991-08-29 1994-07-05 Introspect Technologies, Inc. System and method for assessing an individual's task-processing style
US5823781A (en) * 1996-07-29 1998-10-20 Electronic Data Systems Coporation Electronic mentor training system and method

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US4820167A (en) * 1987-01-14 1989-04-11 Nobles Anthony A Electronic school teaching system
US5326270A (en) * 1991-08-29 1994-07-05 Introspect Technologies, Inc. System and method for assessing an individual's task-processing style
US5823781A (en) * 1996-07-29 1998-10-20 Electronic Data Systems Coporation Electronic mentor training system and method

Cited By (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7295991B1 (en) * 2000-11-10 2007-11-13 Erc Dataplus, Inc. Employment sourcing system
WO2002077770A2 (fr) * 2001-03-22 2002-10-03 Prorail Systeme et procede de realisation de suivi de verification
WO2002077770A3 (fr) * 2001-03-22 2003-05-22 Prorail Systeme et procede de realisation de suivi de verification
EP1251477A2 (fr) * 2001-04-20 2002-10-23 Cognisco Limited Appareil permettant d'évaluer la compétence d'un candidat
EP1256920A2 (fr) * 2001-04-20 2002-11-13 Cognisco Limited Système d'évaluation
EP1251477A3 (fr) * 2001-04-20 2008-05-28 Cognisco Limited Appareil permettant d'évaluer la compétence d'un candidat
EP1256920A3 (fr) * 2001-04-20 2009-03-11 Cognisco Limited Système d'évaluation
WO2016020940A1 (fr) * 2014-08-07 2016-02-11 Saini Pramod Systèmes et procédés d'évaluation électronique de candidats

Also Published As

Publication number Publication date
AU5742000A (en) 2001-01-02
WO2000077672A3 (fr) 2001-05-10

Similar Documents

Publication Publication Date Title
Saks Longitudinal field investigation of the moderating and mediating effects of self-efficacy on the relationship between training and newcomer adjustment.
US7383251B2 (en) Method and apparatus for gathering and evaluating information
Wehman et al. A supported work approach to competitive employment of individuals with moderate and severe handicaps
Wildman et al. Performance measurement at work: A multilevel perspective.
US20030101091A1 (en) System and method for interactive on-line performance assessment and appraisal
Schmitt et al. Computer‐based testing applied to selection of secretarial applicants
Knapp et al. 4. Practice Analysis: Building The Foundation For Validity
Arvey et al. Goal-setting attributes, personality variables, and job satisfaction
Hanson et al. Answers to questions most frequently asked about organization development
JP2005018274A (ja) 人材マッチング方法及び人材マッチングシステム
Bargerstock The HRM effectiveness audit: A tool for managing accountability in HRM
Burke et al. Management and organization development: What is the target of change?
WO2000077672A2 (fr) Procede et systeme destines a evaluer des connaissances
Woosley et al. Q sort and student affairs: A viable partnership?
Brownstein Practicum issues: A placement planning model
JP2003308000A (ja) 研修コースデザイン方法、研修方法、学習効果確認方法及びプログラム
Smith Jr et al. Preparing marriage and family therapy students to become employee assistance professionals
Akinrata et al. Appraisal of measures in enhancing professionalism and ethical conducts among Quantity Surveyors in Nigerian Construction Industry
Jenkins et al. Adapting job analysis methodology to improve evaluation practice
Brody et al. An approach to reviewing the effectiveness of programs
Obermeyer Certification and accreditation in GIS: Prospects and pitfalls
Pogue Employee Assistance Programs on Liberal Arts Campuses
Kemp et al. A comparison between two placement programs for hard‐core unemployed persons
Chalupsky Competency Measurement in Vocational Education: A Review of the State of the Art.
Burns Perceptions of new employee orientation

Legal Events

Date Code Title Description
AK Designated states

Kind code of ref document: A2

Designated state(s): AE AG AL AM AT AU AZ BA BB BG BR BY CA CH CN CR CU CZ DE DK DM DZ EE ES FI GB GD GE GH GM HR HU ID IL IN IS JP KE KG KP KR KZ LC LK LR LS LT LU LV MA MD MG MK MN MW MX MZ NO NZ PL PT RO RU SD SE SG SI SK SL TJ TM TR TT TZ UA UG UZ VN YU ZA ZW

AL Designated countries for regional patents

Kind code of ref document: A2

Designated state(s): GH GM KE LS MW MZ SD SL SZ TZ UG ZW AM AZ BY KG KZ MD RU TJ TM AT BE CH CY DE DK ES FI FR GB GR IE IT LU MC NL PT SE BF BJ CF CG CI CM GA GN GW ML MR NE SN TD TG

121 Ep: the epo has been informed by wipo that ep was designated in this application
DFPE Request for preliminary examination filed prior to expiration of 19th month from priority date (pct application filed before 20040101)
AK Designated states

Kind code of ref document: A3

Designated state(s): AE AG AL AM AT AU AZ BA BB BG BR BY CA CH CN CR CU CZ DE DK DM DZ EE ES FI GB GD GE GH GM HR HU ID IL IN IS JP KE KG KP KR KZ LC LK LR LS LT LU LV MA MD MG MK MN MW MX MZ NO NZ PL PT RO RU SD SE SG SI SK SL TJ TM TR TT TZ UA UG UZ VN YU ZA ZW

AL Designated countries for regional patents

Kind code of ref document: A3

Designated state(s): GH GM KE LS MW MZ SD SL SZ TZ UG ZW AM AZ BY KG KZ MD RU TJ TM AT BE CH CY DE DK ES FI FR GB GR IE IT LU MC NL PT SE BF BJ CF CG CI CM GA GN GW ML MR NE SN TD TG

REG Reference to national code

Ref country code: DE

Ref legal event code: 8642

122 Ep: pct application non-entry in european phase
NENP Non-entry into the national phase in:

Ref country code: JP