CN104008453A - Vocational ability evaluation simulation system - Google Patents

Vocational ability evaluation simulation system Download PDF

Info

Publication number
CN104008453A
CN104008453A CN201410234916.3A CN201410234916A CN104008453A CN 104008453 A CN104008453 A CN 104008453A CN 201410234916 A CN201410234916 A CN 201410234916A CN 104008453 A CN104008453 A CN 104008453A
Authority
CN
China
Prior art keywords
examination
test
paper
appraisal
module
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201410234916.3A
Other languages
Chinese (zh)
Inventor
王国文
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Qixiu Technology (beijing) Co Ltd
Original Assignee
Qixiu Technology (beijing) Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Qixiu Technology (beijing) Co Ltd filed Critical Qixiu Technology (beijing) Co Ltd
Priority to CN201410234916.3A priority Critical patent/CN104008453A/en
Publication of CN104008453A publication Critical patent/CN104008453A/en
Pending legal-status Critical Current

Links

Landscapes

  • Management, Administration, Business Operations System, And Electronic Commerce (AREA)

Abstract

The invention relates to a vocational ability evaluation simulation system which can simulate evaluation in real life, and the vocational ability evaluation simulation system is a simulation software system which achieves various evaluation data, evaluation content and evaluation organization modes. A real environment operation simulation technology is used in the system, limitation of a traditional exam technology is pushed through, various application operation skills can be tested, and paperless exams, intelligent network remote control and management are achieved. The system uses a perfect database management system as a foundation, an intelligent test paper composition algorithm is used as a core, various functions used in evaluation are unified organically, and the flexible and perfect evaluation simulation system is formed.

Description

Vocational ability test and appraisal analogue system
Technical field
The present invention relates to a kind of vocational ability test and appraisal analogue system, belong to analogue system technical field.
Background technology
Along with the development of network technology, multimedia technology, database technology, examination test and appraisal progressively transfer robotization test and appraisal, network test and appraisal to from papery test and appraisal.Perfect, a sound evaluation system has great meaning to the development of educational cause of China and vocational ability assessment.
Current many colleges and universities, enterprise have all made very large effort in order to realize online test and appraisal, and have obtained good effect.But by the investigation to existing evaluation system, we find the shortcomings such as current evaluation system also exists a lot of problems, as single in test subject, system performance is poor, security is bad, flexibility ratio is not high, have restricted to a great extent promoting the use of of evaluation system.
Concrete manifestation has the following aspects:
1. system performance is limited:
Existing evaluation system all can have a restriction that is simultaneously supported in informant's number, if number increases, can cause the speed of the system even fault that slows down, and can only solve by increasing the hardware configuration such as server.
Existing evaluation system generally adopts load-balancing technique to solve the performance issue of evaluation system.
Load balancing (being called again load balancing), its meaning is exactly load (task) to carry out balance, share and on a plurality of operating units, carry out (as Fig. 1), such as Web server, ftp server, the crucial application server of enterprise and other mission critical server etc., thus jointly finish the work task.Along with the raising of system business amount, the processing power of the visit capacity of system and data traffic rapid growth, server and calculating strength also correspondingly increase, and single server apparatus cannot be born at all.In the case, by load balancing, on the basis of existing service architecture, by increasing the mode of the network equipment, server, the network bandwidth, server handling ability, handling capacity etc. are expanded.
The shortcoming of this traditional load-balancing technique is that the performance that improves system can only realize by the increase of service end hardware, along with participating in the increase of test and appraisal number, the supporting hardware system of software systems needs constantly to expand, and huge hardware system has increased purchase cost and the operating cost of system.For evaluation system, according to batch arrangement of the tests, in the time of system, the moving scope of the upper and lower width of online number is very large, this technology can not solve the situation of the unexpected increase of number of users.For the equipment increasing in order to increase support number, after reducing, the online number of test and appraisal also can not reduce at any time.
2. topic type is single:
Evaluation system is developed for specific subject conventionally, and to support the objective master of being entitled as, as single choice, multiselect, judgement etc., minority evaluation system is supported subjective item, but also only limits to support to fill a vacancy and letter is answered, and for other special topic type, cannot meet.Especially for test and appraisal person's practical operation and manipulative ability, cannot test and assess, can not realize the thoroughly evaluating to test and appraisal person's integration capability.
3. examination question form is single:
Examination question in evaluation system forms with word substantially, can not support all kinds of multi-medium datas.The test and appraisal project that we can not be needed in real work, study presents completely.
4. group volume function is simple:
Most of evaluation system still be take manual group volume as main, supports on a small quantity the evaluation system of automatic volume group function also cannot meet the Intelligent Auto-generating Test Paper requirement of many topics type, multidisciplinary, many knowledge points, minute weight, many difficulty levels.
Existing evaluation system generally adopts random approach to organize volume, according to group volume parameter, passes through random device, randomly draws the examination question of respective numbers from existing exam pool.The advantage of method of randomization is to realize simply, and speed is fast, but also has his limitation.
Random device is to be based upon on the supposition of certain input distributed intelligence, averages on this basis the time complexity that situation analysis obtains method.So it is enough large that the volume that uses random approach to organize rollback request test item bank is wanted, and will distribute rationally.This comprehensive test for each side ability is difficult to accomplish, finally can cause the paper knowledge point coverage rate of composition little or more concentrated, does not reach comprehensive ability test and appraisal and analysis to test and appraisal person.
The group respectively that cannot realize different ability measurement systems by random device is in addition rolled up, and can not according to respective weights group, roll up according to the corresponding subject of each capacity index, knowledge point, difficulty etc.
Only have the real Intelligent Auto-generating Test Paper of having realized, teacher could be freed from heavy group volume work, could solve the difficulty of each examination, the problem that discrimination is consistent.
5. lack test and appraisal person's systematic analysis and evaluation:
The object of examination is for test and appraisal person is carried out to comprehensive evaluation.Screening and learning guide the enterprising administrative staff in the basis of comprehensive evaluation.Existing evaluation system just provides examination result mostly, and the situation of test and appraisal person's integral body is not carried out to correct effectively assay.
Summary of the invention
In order to solve technical matters of the prior art, the present invention proposes a kind of vocational ability test and appraisal analogue system.The present invention completely can simulating reality test and appraisal in life, realize the Simulation Software System of all kinds of test and appraisal data, test and appraisal content, test and appraisal organizational form.
Particularly, the present invention adopts following technical scheme:
Vocational ability test and appraisal analogue system provided by the invention, comprises exam pool administration module, managing test paper module, measurement and management module, examination monitoring module, paper judge module, test report administration module and Configuration Manager;
Exam pool administration module is that a plurality of sections various examination questions of object are carried out to typing, storage, inquiry and management;
Managing test paper module can be according to tactic of generating test paper, and the various examination questions that intelligence extracts under multidimensional exam pool form paper;
Measurement and management module, for taking an examination by foundation, distributes examinee and examination monitor to specifying examination hall, specifically comprises and sets up examination hall, sets up examination, distributes examinee, distributes invigilator, distributes the person of going over examination papers, the setting of examination classification;
Examination monitoring module provides the monitoring page to show how many examinees and start answer, has answered how many roads exercise question, the information such as whether finishes, and after examination finishes, submits an examination hall report to;
It is to the judgement of marking of examinee's test paper that paper is passed judgment on module, and is that subjective item and objective item are manually appraised or intelligence is appraised according to topic types;
Test and evaluation report administration module is provided test and evaluation report according to examinee's examination result and index system;
Configuration Manager manages the role of system, authority, personnel and grouping.
In addition, various dimensions Intelligent Auto-generating Test Paper method based on vocational ability test and appraisal analogue system pilot scale volume management module, from a plurality of dimensions, extract examination question, and in algorithm, introduce artificial intelligence, when making the test, can extract suitable examination question according to the intelligence in exam pool such as different tactic of generating test paper, different post, rank, knowledge point, topic type, difficulty, mark, frequency of utilization; The exercise question being drawn into is carried out to Classifying Sum according to topic type, form paper; Same tactic of generating test paper can generate many cover papers, and each content and knowledge point of overlapping difficulty between paper, discrimination, examination is all consistent.
Finally, provide a kind of vocational ability assessment method:
Step 1, carries out typing, storage, inquiry and management to a plurality of sections various examination questions of object;
Step 2, according to tactic of generating test paper, the various examination questions that intelligence extracts under multidimensional exam pool form paper;
Step 3, takes an examination by foundation, distributes examinee and examination monitor to specifying examination hall, specifically comprises and sets up examination hall, sets up examination, distributes examinee, distributes invigilator, distributes the person of going over examination papers, the setting of examination classification;
Step 4, provides the monitoring page to show how many examinees and start answer, has answered how many roads exercise question, the information such as whether finishes, and after examination finishes, submits an examination hall report to;
Step 5 to the judgement of marking of examinee's test paper, and is that subjective item and objective item are manually appraised or intelligence is appraised according to topic types;
Step 6, provides test and evaluation report according to examinee's examination result and index system;
Step 7, manages the role of system, authority, personnel and grouping.
This system adopts real environmental operations analogue technique, has broken through the restriction of traditional examination technology, can take an exam to various application operating technical ability, has realized with no paper examination, intelligent network Long-distance Control and management.This system be take perfect data base management system (DBMS) as basis, take Intelligent Auto-generating Test Paper algorithm as core, the types of functionality that uses in test and appraisal is organically unified, formed one flexibly, perfect test and appraisal analogue system.
Accompanying drawing explanation
Fig. 1 is conventional load balancing technique device structure schematic diagram.
Fig. 2 is vocational ability test and appraisal analogue system illustrative view of functional configuration.
Fig. 3 is the overall load balancing technique structural representation based on cloud.
Fig. 4 is shirtsleeve operation topic flow of task and Task-decomposing schematic diagram.
Fig. 5 is the major function schematic diagram of exam pool administration module.
Fig. 6 is the major function schematic diagram of managing test paper module.
Fig. 7 is the major function schematic diagram of measurement and management module.
Fig. 8 is the major function schematic diagram of examination monitoring module.
Fig. 9 is the major function schematic diagram that paper is passed judgment on module.
Figure 10 is the workflow diagram of exam pool management.
Figure 11 is the workflow diagram of managing test paper.
Figure 12 is the workflow diagram of measurement and management.
Figure 13 is the workflow diagram of examination monitoring.
Figure 14 is the workflow diagram that paper is passed judgment on.
Figure 15 is Comprehensive Vocation Ability test and evaluation report schematic diagram.
Figure 16 is Intelligent Auto-generating Test Paper method flow diagram.
Embodiment
Below in conjunction with the drawings and specific embodiments, technical scheme of the present invention is described in detail.
As shown in Figure 2, vocational ability test and appraisal analogue system of the present invention comprises as lower module: exam pool administration module, and managing test paper module, measurement and management module, examination monitoring module, paper is passed judgment on module, test report administration module and Configuration Manager.Wherein, the overall load equalizing structure implementation based on cloud, as shown in Figure 3:
Overall load balancing technique based on cloud has retained the dilatation way of conventional load balancing technique at server end, in the situation that not affecting original system, on the basis of existing service architecture, by increasing the mode of the network equipment, server, the network bandwidth, server handling ability, handling capacity etc. are expanded.
The present invention also brings the device resource of user side into whole load balancing scope by cloud, thereby make the expanded range of load balancing, reduced the pressure of server end, naturally reduce the hardware device requirement to server end, reduced buying and the maintenance cost of the hardware devices such as server.Meanwhile, the user side resource of introducing can guarantee that system tests and assesses number when many at the same time online, and the user side resource that system can be allocated also increases thereupon, and the system of assurance has the performance that abundant available resources maintain system; And when online test and appraisal number is few, when not high to the performance requirement of system, user side resource also declines thereupon, reduce management and the allotment workload of server.
The available user side resource of system comprises the various kinds of equipment such as the LAN server, user's desktop computer, notebook, PDA of user side.Ustomer premises access equipment is after the system of entering, and system can be included this ustomer premises access equipment in the holistic management of cloud by cloud, forms reticulate texture with other ustomer premises access equipments, server end equipment, and unification provides service to user.The equipment performance of considering different user is different with network condition, and optimization method can, according to factors such as the equipment performance of user side, network conditions, be classified and grading to user.Simultaneity factor also by the relevant task of all test and appraisal according to the degree of association with user, security level, to the requirement of equipment performance, the requirement of network condition etc. has been carried out to classification.Method can, automatically according to the classification of user side and rating result, distribute the task of appropriate level to process to user side.And also task can be distributed to each user side in LAN (Local Area Network) according to this principle after taking task for the server of user side.
For example, for certain user, show that this user oneself participates in the paper of test and appraisal and reclaims examination result is the task that priority is the highest.And this task can be subdivided into N one-level subtask, under different one-level subtasks, also can be subdivided into M secondary subtask, the rest may be inferred, can constantly segment.That task, subtask or joint knot task all can have corresponding careful, different requirement.
The mode that this technology has solved conventional load balancing technique completely can only be increased by service end hardware solves the shortcoming of performance issue.Increase along with online participation test and appraisal number, system can be utilized user side resource automatically, and the performance of system is expanded, and guarantees travelling speed and the reliability of system, reduce the equipment purchase demand of server end, reduced the operation expense of server end.And this technology also increased system dirigibility adaptive ability, even if user number has significantly, increase suddenly or reduction, can guarantee the normal operation of system.
For certain one three grades of operation questions task, below this task, can also be subdivided into again exercise question extraction, examination question demonstration, result recovery, according to result, judge the steps such as branch condition by step.The task of operation questions of take is below flow of task and the task division of example description operation topic.
As shown in Figure 4, after task is carried out to refinement and decomposition, each little task still can be decomposed.In order to make the description of example more simple, only consider now that device memory and two factors of network speed distribute the task of this operation questions example.If the device memory of user A and network speed are all fine, now method can, automatically according to this condition of user A, all send to user side by all the elements of this operation questions and process.The system that is to say can disposablely all send to user side contents such as operation questions all resources used and decision conditions, by user side, carry out voluntarily the processing of whole flow process, and the net result return service device end after operation questions is completed reclaims, the benefit of doing is like this during user A operates this topic, and server end does not need to carry out any processing completely again.And the device memory of user B is very little, and network speed is very fast, now method can be automatically according to the condition of user B, to the large task of memory demand be placed on to server end, substep sends to user B to process, and so can guarantee to only have a step in the internal memory of user B at every turn, and two do not need branch's content of carrying out not need to store in the internal memory of user B for those yet again, thereby reduce the requirement to user B internal memory, improve the travelling speed of system.
In like manner, expand in all tasks, each task can have the requirement of oneself, and method can according to circumstances select corresponding optimal case to dispatch automatically.
This scheme not only can solve the continuous expansion to evaluation system performance in the situation that not affecting original system, also hardware purchase and the maintenance cost of equipment have been reduced simultaneously, strengthened dirigibility and the adaptive ability of system performance, can ensure that all users have optimum experience.
Exam pool administration module is that a plurality of sections various examination questions of object are carried out to the making of simple and flexible the module that it is carried out to effective management, makes the making management easier, examination question of examination question more flexible.
The topic type that this exam pool is supported: have objective item type, subjective questions and self-defined topic type.
Objective item comprises single choice, multiple choice, True-False, the topic of filling a vacancy, line topic, typewriting topic.
Subjective item comprises simple answer, discussion topic, operation questions.
Self-defined topic type comprises as combination topic etc.
Wherein, operation questions is adopted and is carried out in two ways the Realization of Simulation.
A kind of is to adopt picture to combine, and for each step is set the content of input, and according to decision condition, determines next step trend.It is the simulation operations that a kind of means by " picture+animation+programmed control+program verification " realize.
Another kind is to adopt virtual reality technology, and operating environment that is virtually reality like reality operates.For example, examination student network environment build with allocative abilities time, adopt emulation technology, realize network environment built to full-range simulation.Test and appraisal person can pull, be placed on suitable position disparate networks equipment in operation questions; Can between each equipment, build link; Can debug and configuration each equipment, and can automatically mark according to student's operational circumstances.
The examination question form of this exam pool support comprises word, all kinds of multimedia elements such as picture, audio frequency, video, form, formula, animation, drawing.
This exam pool adopts multidimensional digitalized electron exam pool, for guaranteeing dirigibility and the preciseness of Intelligent Auto-generating Test Paper, raising group volume extracts accuracy and the success ratio of examination question, exam pool adopts subject knowledge point to carry out tree-shaped classification, also supports to be undertaken by difficulty, topic type, institutional affiliation, score value etc. the tissue typing of multidimensional.To the multidimensional of exam pool, to divide be meticulously the later stage according to tactic of generating test paper intelligence, to generate the basis of the paper that preparation rate is high.
Managing test paper module can be according to tactic of generating test paper, and the various examination questions that intelligence extracts under multidimensional exam pool form paper, paper length, paper flexible form.
Measurement and management module, for taking an examination by foundation, distributes examinee and examination monitor to specifying examination hall.Measurement and management module comprises sets up examination hall, sets up examination, distributes examinee, distributes invigilator, distributes the person of going over examination papers, and examination classification such as arranges at the function.
Examination monitoring module provides the monitoring page to show how many examinees and start answer, has answered how many roads exercise question, the information such as whether finishes, and after examination finishes, submits an examination hall report to.
It is to the judgement of marking of examinee's test paper that paper is passed judgment on module, and is that subjective item and objective item are manually appraised or intelligence is appraised according to topic types.Subjective exercise question is adopted to the mode of manually appraising, the mode that adopts intelligence to appraise to objective exercise question.Test and evaluation report administration module is provided test and evaluation report according to examinee's examination result and index system.
Configuration Manager manages the role of system, authority, personnel and grouping.
Modules has respectively function separately, as described below:
Exam pool administration module mainly comprises following function, as shown in Figure 5:
Exam pool structure management: exam pool division of discipline knowledge hierarchy is configured and is safeguarded; Exam pool is organized with subject, knowledge point, is tree structure.
Exam pool typing: can carry out typing one by one, also support to import in batches; In record topic process, look into heavy function; Examination question in exam pool can be derived in batches according to querying condition.
Exam pool audit: in exam pool, all examination questions all need can formally use by audit.
Exam pool query statistic: can inquire about and statistical study the data in exam pool, can add up utilization rate, answer accuracy of each exercise question etc.; Out-of-date examination question filling can be abolished to mark.
Managing test paper module mainly comprises following function, as shown in Figure 6:
Tactic of generating test paper management: for completing the test and appraisal to different posies and rank personnel vocational ability, the tactic of generating test paper of system divides two parts content.A part is index system part, for defining other personnel's vocational ability of specific post a specific order, forms structure and requirement, and index system is hierarchy, can divide Pyatyi at most, the corresponding subject of one-level, divides into multistage knowledge point, and corresponding weight can be set in each knowledge point.Another part is that exercise question is selected scheme, and all index system final stage knowledge points are the strategy of selecting that examination question is set of correspondence all.System can arrange different index systems and examination question is selected strategy for different posies, rank.
Various dimensions Intelligent Auto-generating Test Paper: evaluation system automatically selects a certain amount of examination question to form the paper that meets check requirements from test item bank according to certain constraint condition (tactic of generating test paper), and by system, completed the design of paper content, make every effort to reflect test and appraisal person's level of knowledge authentic and validly, thereby improve examination quality, alleviate the workload that expert sets a question.
Paper audit: the paper of all compositions need be examined, and auditing result is for formal test and appraisal.
Query statistic: carry out paper service condition, total marks of the examination distribution.
Measurement and management module mainly comprises following function, as shown in Figure 7:
Set up examination hall: before setting up examination, judge in system whether have the examination hall that meets examination request, if there is no meet the examination hall of submitting to, must first establish examination hall.Set up test and appraisal, approval individual member participates in these test and appraisal, for examinee carries out examination hall arrangement, the setting test time.The test and appraisal monitor of these test and appraisal can be set while setting up examination hall, distribute monitoring examination hall, and the test and appraisal person of going over examination papers of these test and appraisal is set, distribute the task of going over examination papers.
Set up examination: examination management person can set up test and appraisal by this module, approval individual member participates in this test and appraisal, and time and the examination hall of examination are set.
Distribute examinee: the examinee who is used for that audit is passed through is assigned to the examination hall of appointment.
Distribute examination monitor: for specifying monitor staff in the examination hall of this examination.
Distribute the person of going over examination papers: after waiting student to hand in an examination paper, for effectively answering the questions in a test paper, distribute the person of going over examination papers, specify the task of going over examination papers of the person of going over examination papers.
Examination classification setting: keeper can arrange examination classification at this, for the Classification Management of all kinds of examinations, the type of differentiation examination and mechanism etc.
Examination monitoring module mainly comprises following function, as shown in Figure 8:
Monitoring: check that whether examinee's number is consistent with examination in field, examinee's the process of answering, whether examinee finishes whole exercise questions.
Examination hall report: monitoring management person summarizes to this examination by this module after examination finishes, the problem occurring in input examination hall, submits examination hall report to.
Paper is passed judgment on module and is mainly comprised following function, as shown in Figure 9:
Appraise by hand: the situation of answering according to examinee that receives input provides the score value of this exercise question, and score value input system.
Intelligence is appraised: system provides score value according to examinee's the situation of answering and model answer.
Mark is adjusted: the person of going over examination papers can be passed through this module adjustment examinee's answer mark.
Utilize the concrete steps of realization of modules as follows:
Exam pool management process, as shown in figure 10, sets up exam pool classification according to subject, knowledge point.Typing examination question under the concrete classification of exam pool, the examination question of typing need to through audit, examine errorless after, can formally use.
Managing test paper flow process, as shown in figure 11, sets up post according to post information, according to index system information, under post, sets up index system.Select the manual group volume of test question information, also can be according to condition Intelligent Auto-generating Test Papers such as post, index system, knowledge point, topic type, difficulty, marks, the paper of organize need to be through examining, examine errorless after, generation paper, can formally be used.
Measurement and management flow process as shown in figure 12, is first selected examination hall when setting up examination, if examination hall does not exist, notifies examination hall keeper to set up examination hall.Set up after examination, by individual member, selected to take an examination.Approval individual member take an examination, and distributes examinee to specifying examination hall, distributes monitor to specifying examination hall, treats for examinee answers the questions in a test paper, to specify the personnel that go over examination papers after examination finishes, and distributes the task of going over examination papers.
Examination monitoring flow process, as shown in figure 13, is responsible for the examination hall monitoring that takes an exam to me, checks examinee's the progress of answering, and fills in the examination hall report in this examination hall, detailed description examination hall situation after examination finishes.
Paper is passed judgment on flow process, as shown in figure 14, examinee's test paper is appraised.If exercise question is objective item, system auto judge goes out mark.If subjective item, the mark of being passed judgment on according to answer situation by the person of going over examination papers input.If need to adjust the mark after passing judgment on, can adjust by the function of adjusting mark.
Test and evaluation report management process, system is according to test and appraisal person's answer situation, according to index system, automatically generate the comprehensive evaluation to test and appraisal person, content comprises that the Grasping level of test and appraisal person's overall scores, marks sequencing, each subject knowledge point and technical ability compares assessment of levels, comprehensive A+E test and appraisal person being carried out for every level of skill of test and appraisal person, the contents such as study suggestion that test and appraisal person is provided with score, each subject ability level with the student of the same examination of participation.Real realization carried out comprehensive ability test and appraisal to test and appraisal person.After test and appraisal person's login system, can check the exam score of oneself, test and evaluation report, complete test and evaluation report as shown in figure 15.
The method extracts examination question from a plurality of dimensions, and in method, introduce artificial intelligence, when making the test, can extract suitable examination question according to the intelligence in exam pool such as different tactic of generating test paper, different post, rank, knowledge point, topic type, difficulty, mark, frequency of utilization.Then the exercise question being drawn into is carried out to Classifying Sum according to topic type, form paper.Same tactic of generating test paper can generate many cover papers, and each content and knowledge point of overlapping difficulty between paper, discrimination, examination is all consistent.The paper that each Intelligent Auto-generating Test Paper generates is after for test and appraisal, system all can add up targetedly and analyze, from a large amount of usage datas, find and excavate the content of directive significance, system can automatically be revised and adjust tactic of generating test paper according to the result of data mining, continues to optimize the method for group volume.
The flow process of various dimensions Intelligent Auto-generating Test Paper method is as follows, as shown in figure 16:
The first, the index system being comprised of a plurality of constraint condition that group volume needs, then the specific strategy during according to above-mentioned each constraint condition formulation group volume, afterwards, carry out the extraction of examination question according to the requirement of index system according to specific strategy.The second, unsuccessful if examination question extracts, namely there is no satisfactory examination question, display reminding problem, and according to these problem adjustment index system and specific strategy, if examination question extracts successfully, be defined as the examination question in paper.The 3rd, examination question after extracting gathers all examination questions that are defined as in paper in second step, finally forms complete paper.The 4th, for the paper obtaining, check, if there is paper also to have problems, adjusts and revise, if no problem, the group that has completed paper is rolled up.
In Intelligent Auto-generating Test Paper step, index system and specific strategy step that concrete constraint condition forms are as follows:
During group volume, to define the various constraint condition that affects group volume problem according to the requirement of test and appraisal, reach group volume target.The constraint condition of group volume has following several respects generally: knowledge point constraint, the constraint of topic type, volume constraint, Reaction time constraint, difficulty constraint, score value constraint, discrimination constraint, service efficiency constraint.
Analysis from above constraint condition, in the process of group volume, system is often selected examination question one, all to be subject to the restriction of some constraint condition, if each item constraint is all regarded as to local restriction, paper finally will meet every constraint condition simultaneously so, has just formed the global constraints of paper.At this, define four vectors:
Property set: s={s1, s2 ..., sn}, the attribute variable of examination question (content, topic type, knowledge point, difficulty, score value ...) or their values after quantizing;
Value collection: L={l1, l2 ..., ln}, every kind of attribute variable's of corresponding examination question span;
Constraint set: R={r1, r2 ..., rn}, the restriction relation between corresponding each examination question attribute variable's value;
Examination question collection: I={i1, i2 ..., in}, the corresponding examination question that meets certain constraint condition of selecting from test item bank.
Illustrate:
Property set (the s={s1 of examination question, s2,, in native system, be sn}): S={ topic type, difficulty, institutional affiliation, affiliated knowledge point, the knowledge point degree of correlation, key word, recommender score, recommendation Reaction time, whether share, examination question state, source, founder, creation-time ...
The value collection of examination question has respectively different value collection according to different property sets.The value collection L1={ single choice of topic type, multiple choice, the topic of filling a vacancy, True-False, simple answer, discussion topic, line topic, typewriting topic, audio frequency topic ...; The value collection L2={ of difficulty easily, easier, medium, more difficult, difficulty; The value collection L3{ of examination question state keeps in, submission is examined, return to modification, audit is passed through, inactive, deletion ....
Constraint set is the restriction relation between attribute variable's value, and for lower topic, we have following constraint:
Which is not in iOS, to obtain positioning service assembly () in the following option?
A, RS remote sensing B, WIFI C, cellular basestation D, gps satellite
R={ topic type=single choice, difficulty=easily, and institutional affiliation=Test Centre, affiliated knowledge point=positioning service, the knowledge point degree of correlation=height ...
One group of examination question set that examination question collection I selects according to the requirement of constraint set R, all examination questions in this set all meet the constraint condition of constraint set R.
Hence one can see that, and group volume problem is exactly, and selects at random one group of I from test item bank, makes its all attribute variable S in the span of L, all meet the constraint of R, and just can be described as be the problem of a multiple constraint goal satisfaction to automatic volume group like this.The mathematical model of group volume also can be thought a constraint satisfaction problem.According to constrained type, can be divided into hard constraint and soft-constraint.Wherein hard constraint refers in group and licks and in journey, reach desired value completely, and soft-constraint refers to that those not exclusively reach the constraint of desired value.
It is that the knowledge point that must require in strict accordance with index system is chosen that the knowledge point of paper examination question is selected; And the summation of the recommendation score value of examination question, and the summation of recommendation Reaction time all allows the error of certain limit.
Group licks journey, will from exam pool, select to meet the exercise question of each item constraint in fact exactly simultaneously.Form so always total m road examination question of a set of paper, every one examination question all needs to meet n index.Built the objective matrix of a m*n as follows.
Wherein, each exercise question in each line display exam pool, and first row represents the value of each attribute of exercise question.Objective matrix should meet a series of constraint condition, as:
Σ ai1=t (t is the test time, and ai1 represents the recommendation Reaction time of i examination question)
Σ ai2=G (G is paper total points, and ai2 represents the recommender score of i examination question)
(Pk is that the topic that k item knowledge point requires is divided to Σ c3i*ai4=Pk, and wherein C3i=1 or 0 gets 1 when ai3=k; During ai3 ≠ k, get 0; Ai2 represents the recommender score of i examination question) (explain: ai3 represents the knowledge point contents of i examination question, if the knowledge point of this examination question conforms to k item knowledge point, C3i is 1, illustrates that this examination question belongs to k item knowledge point in index system; If the knowledge point of this examination question does not conform to k item knowledge point, C3i is 0, illustrates that this examination question does not belong to k item knowledge point in index system, calculates under k item knowledge point and inscribes timesharing, does not comprise this recommender score.)
In like manner for the difficulty of examination question, topic type, exercise question quantity, discrimination, frequency of utilization etc., there is too similar constraint requirements.The multi-constraint condition of group volume has determined the various dimensions division of exam pool, examination question in exam pool has formed the space of a various dimensions variable, each problem structure point in this hyperspace of knowing clearly, the work of group volume is exactly from this space, to choose several suitable points, to meet given constraint condition.
The method has realized common random approach group and has rolled up multidisciplinary, the many knowledge points that cannot realize, the comprehensive comprehensive test of multinomial ability.Simultaneously the method does not have strict restriction to the distribution situation of exercise question in exam pool yet, can guarantee that the structure of knowledge, topic type, difficulty, discrimination etc. of each group volume examination are consistent.
The beneficial effect that the present invention brings has following several aspect:
1. solved the limited problem of systemic-function:
Native system designed and developed the overall load balancing technique scheme based on cloud, and the mode that this technology has solved conventional load balancing technique completely can only be increased by service end hardware solves the shortcoming of performance issue.Increase along with online participation test and appraisal number, system can be utilized user side resource automatically, and the performance of system is expanded, and guarantees travelling speed and the reliability of system, reduce the equipment purchase demand of server end, reduced the operation expense of server end.And this technology also increased system dirigibility adaptive ability, even if user number has significantly, increase suddenly or reduction, can guarantee the normal operation of system.
2. solved the single problem of topic type:
Native system is divided into different modules by different topic types, the real-life examination question situation of complete simulation, supports single choice, multiple choice, True-False, the topic of filling a vacancy, line topic, typewriting topic, simple answer, discussion topic, operation questions, self-defined topic type (combination topic etc.).
Native system adopts picture combination technique and Virtual Simulation to make operation questions, and equipment and scene in the complete simulating reality of operation questions are supported that test and appraisal person carries out various debugging and configuration to virtual unit, and carried out automatic scoring.
3. solved the single problem of examination question form:
For the online examination of the Realization of Simulation test and appraisal, native system examination question is except supporting word examination question, also support picture, audio frequency. all kinds of multimedia problems such as video, form, formula, animation, drawing: element.
4. solved group volume function simple question:
Native system adopts various dimensions Intelligent Auto-generating Test Paper algorithm, algorithm extracts examination question from a plurality of dimensions, and in algorithm, introduce artificial intelligence, when making the test, can extract suitable examination question according to the intelligence in exam pool such as different tactic of generating test paper, different post, rank, knowledge point, topic type, difficulty, mark, frequency of utilization.
5. solved and lacked the problem to test and appraisal person's systematic analysis and evaluation:
System, after test and appraisal complete, can, according to test and appraisal person's answer situation, generate the comprehensive evaluation to test and appraisal person according to index system automatically.Content comprises that Grasping level and the score of test and appraisal person's overall scores, marks sequencing, each subject knowledge point and technical ability, each subject ability level compare assessment of levels, comprehensive A+E test and appraisal person being carried out for every level of skill of test and appraisal person, the contents such as study suggestion that test and appraisal person is provided with the student who participates in same examination.Real realization carried out comprehensive ability test and appraisal to test and appraisal person.

Claims (9)

1. a vocational ability test and appraisal analogue system, is characterized in that: this system comprises exam pool administration module, managing test paper module, measurement and management module, examination monitoring module, paper judge module, test report administration module and Configuration Manager;
Exam pool administration module is that a plurality of sections various examination questions of object are carried out to typing, storage, inquiry and management; Managing test paper module can be according to tactic of generating test paper, and the various examination questions that intelligence extracts under multidimensional exam pool form paper;
Measurement and management module, for taking an examination by foundation, distributes examinee and examination monitor to specifying examination hall, specifically comprises and sets up examination hall, sets up examination, distributes examinee, distributes invigilator, distributes the person of going over examination papers, the setting of examination classification;
Examination monitoring module provides the monitoring page to show how many examinees and start answer, has answered how many roads exercise question, the information such as whether finishes, and after examination finishes, submits an examination hall report to;
It is to the judgement of marking of examinee's test paper that paper is passed judgment on module, and is that subjective item and objective item are manually appraised or intelligence is appraised according to topic types;
Test and evaluation report administration module is provided test and evaluation report according to examinee's examination result and index system;
Configuration Manager manages the role of system, authority, personnel and grouping.
2. vocational ability as claimed in claim 1 test and appraisal analogue system, it is characterized in that: the overall load equilibrium based on cloud is that the device resource of user side is brought in whole load balancing, by cloud, include the holistic management of cloud in, form reticulate texture with other ustomer premises access equipments, server end equipment, unification provides service to user.
3. vocational ability test and appraisal analogue system as claimed in claim 1, is characterized in that: the function of exam pool administration module comprises exam pool structure management, exam pool typing, exam pool audit and exam pool query statistic.
4. vocational ability test and appraisal analogue system as claimed in claim 1, is characterized in that: the function of managing test paper module comprises tactic of generating test paper management, various dimensions Intelligent Auto-generating Test Paper, paper audit and query statistic.
5. vocational ability test and appraisal analogue system as claimed in claim 1, is characterized in that: the function of measurement and management module comprises sets up examination hall, sets up examination, distributes examinee, distributes examination monitor, distributes the person of going over examination papers, the setting of examination classification.
6. vocational ability test and appraisal analogue system as claimed in claim 1, is characterized in that: the function of examination monitoring module comprises monitoring and examination hall report.
7. vocational ability test and appraisal analogue system as claimed in claim 1, is characterized in that: the function that paper is passed judgment on module comprises that craft is appraised, intelligence is appraised and mark adjustment.
8. the various dimensions Intelligent Auto-generating Test Paper method based on vocational ability claimed in claim 1 test and appraisal analogue system pilot scale volume management module, is characterized in that:
The first, the index system being comprised of a plurality of constraint condition that group volume needs, then the specific strategy during according to above-mentioned each constraint condition formulation group volume, afterwards, carry out the extraction of examination question according to the requirement of index system according to specific strategy;
The second, unsuccessful if examination question extracts, namely there is no satisfactory examination question, display reminding problem, and according to these problem adjustment index system and specific strategy, if examination question extracts successfully, be defined as the examination question in paper;
The 3rd, examination question after extracting gathers all examination questions that are defined as in paper in second step, finally forms complete paper;
The 4th, for the paper obtaining, check, if there is paper also to have problems, adjusts and revise, if no problem, the group that has completed paper is rolled up.
9. a vocational ability assessment method, is characterized in that:
Step 1, carries out typing, storage, inquiry and management to a plurality of sections various examination questions of object;
Step 2, according to tactic of generating test paper, the various examination questions that intelligence extracts under multidimensional exam pool form paper;
Step 3, takes an examination by foundation, distributes examinee and examination monitor to specifying examination hall, specifically comprises and sets up examination hall, sets up examination, distributes examinee, distributes invigilator, distributes the person of going over examination papers, the setting of examination classification;
Step 4, provides the monitoring page to show how many examinees and start answer, has answered how many roads exercise question, the information such as whether finishes, and after examination finishes, submits an examination hall report to;
Step 5 to the judgement of marking of examinee's test paper, and is that subjective item and objective item are manually appraised or intelligence is appraised according to topic types;
Step 6, provides test and evaluation report according to examinee's examination result and index system;
Step 7, manages the role of system, authority, personnel and grouping.
CN201410234916.3A 2014-05-29 2014-05-29 Vocational ability evaluation simulation system Pending CN104008453A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201410234916.3A CN104008453A (en) 2014-05-29 2014-05-29 Vocational ability evaluation simulation system

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201410234916.3A CN104008453A (en) 2014-05-29 2014-05-29 Vocational ability evaluation simulation system

Publications (1)

Publication Number Publication Date
CN104008453A true CN104008453A (en) 2014-08-27

Family

ID=51369101

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201410234916.3A Pending CN104008453A (en) 2014-05-29 2014-05-29 Vocational ability evaluation simulation system

Country Status (1)

Country Link
CN (1) CN104008453A (en)

Cited By (24)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104200413A (en) * 2014-08-28 2014-12-10 张家精 Web-based test paper auditing system
CN104318496A (en) * 2014-09-27 2015-01-28 昆明钢铁集团有限责任公司 Paperless semi-artificial marking system and paperless semi-artificial marking method
CN104317825A (en) * 2014-09-30 2015-01-28 武汉天量数据技术有限公司 Method and system for quantitatively analyzing knowledge point
CN104462228A (en) * 2014-11-13 2015-03-25 中国信息安全测评中心 Semantics-based registration information security officer authentication capability evaluation method and system
CN104574241A (en) * 2015-02-03 2015-04-29 陈飞鸣 Online education assessment system and method
CN104809558A (en) * 2015-04-23 2015-07-29 姚宇 System of testing the influence of income distribution and social security system on personal sense of fairness
CN105575205A (en) * 2015-12-12 2016-05-11 赵守盈 Computer self-adaption test system and method
CN105897732A (en) * 2016-05-12 2016-08-24 湖南汇博电子技术有限公司 Method for competition through network and server
CN106682768A (en) * 2016-12-08 2017-05-17 北京粉笔蓝天科技有限公司 Prediction method, system, terminal and server of test score
CN107239897A (en) * 2017-05-31 2017-10-10 中南大学 A kind of personality occupation type method of testing and system
CN107292464A (en) * 2016-03-30 2017-10-24 北京矩道优达网络科技有限公司 Automation assessment method and system based on directed acyclic graph and topological sorting
CN107483397A (en) * 2017-06-19 2017-12-15 上海高顿教育培训有限公司 A kind of examinee's self-test assessment method based on B/S framework
CN108154733A (en) * 2018-02-05 2018-06-12 无锡科技职业学院 Foreigh-language oral-speech test device and the Foreigh-language oral-speech test method using the device
CN108492041A (en) * 2018-03-29 2018-09-04 常州市钱璟康复股份有限公司 A kind of evaluation system and assessment method
CN108573051A (en) * 2018-04-23 2018-09-25 温州市鹿城区中津先进科技研究院 Knowledge point collection of illustrative plates based on big data analysis
CN108615209A (en) * 2016-12-13 2018-10-02 航天信息股份有限公司 Capability comparison reports Mass production and management system and method
CN108681804A (en) * 2018-03-29 2018-10-19 常州市钱璟康复股份有限公司 One kind being used for somatopsychic disturbance person's vocational ability physics evaluation system and assessment method
CN109241506A (en) * 2018-06-11 2019-01-18 深圳市海云天教育测评有限公司 A kind of questionnaire generation method, device and computer readable storage medium
CN109544414A (en) * 2018-10-23 2019-03-29 平安医疗健康管理股份有限公司 Data processing method, device, server and computer readable storage medium
CN109712044A (en) * 2018-12-29 2019-05-03 华中师范大学 Program assessment method, device and read/write memory medium
CN110147953A (en) * 2019-05-16 2019-08-20 电子科技大学 A kind of questionnaire automatic generation method
WO2020006756A1 (en) * 2018-07-06 2020-01-09 道鑛有限公司 Examination/selection system, examination/selection device, and examination/selection method
CN111507872A (en) * 2020-04-09 2020-08-07 圆梦共享教育科技(深圳)有限公司 Artificial intelligence-based accurate test difficulty classification method
CN111913570A (en) * 2020-05-28 2020-11-10 董淑娟 Immersive virtual reality examination method and system, terminal equipment and storage medium

Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101866561A (en) * 2010-06-11 2010-10-20 哈尔滨工程大学 Device and method for intellectually composing test paper by adjustable multi-variable asymptotic optimizing algorithm
CN101964152A (en) * 2010-10-27 2011-02-02 昆明冶金高等专科学校 Local area network-based network examination system and implementation method thereof

Patent Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101866561A (en) * 2010-06-11 2010-10-20 哈尔滨工程大学 Device and method for intellectually composing test paper by adjustable multi-variable asymptotic optimizing algorithm
CN101964152A (en) * 2010-10-27 2011-02-02 昆明冶金高等专科学校 Local area network-based network examination system and implementation method thereof

Non-Patent Citations (3)

* Cited by examiner, † Cited by third party
Title
吴静霞: "基于智能组卷的在线考试系统的设计与实现", 《中国优秀硕士学位论文全文数据库 信息科技辑》 *
汪卫星: "云计算技术在WEB考试系统中的应用", 《PROCEEDINGS OF 2010 ASIA-PACIFIC CONFERENCE ON INFORMATION NETWORK AND DIGITAL CONTENT SECURITY》 *
陈盈盈: "具有云服务特征的远程在线考试系统的设计与实现", 《中国优秀硕士学位论文全文数据库 信息科技辑》 *

Cited By (29)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104200413A (en) * 2014-08-28 2014-12-10 张家精 Web-based test paper auditing system
CN104318496B (en) * 2014-09-27 2018-07-13 昆明钢铁集团有限责任公司 A kind of paperless semi-artificial examination paper marking system and method
CN104318496A (en) * 2014-09-27 2015-01-28 昆明钢铁集团有限责任公司 Paperless semi-artificial marking system and paperless semi-artificial marking method
CN104317825A (en) * 2014-09-30 2015-01-28 武汉天量数据技术有限公司 Method and system for quantitatively analyzing knowledge point
CN104317825B (en) * 2014-09-30 2017-06-20 武汉天量数据技术有限公司 A kind of knowledge point quantitative analysis method and system
CN104462228A (en) * 2014-11-13 2015-03-25 中国信息安全测评中心 Semantics-based registration information security officer authentication capability evaluation method and system
CN104462228B (en) * 2014-11-13 2019-01-29 中国信息安全测评中心 Semantic-based registration information Security Officer authentication capability assessment method and system
CN104574241A (en) * 2015-02-03 2015-04-29 陈飞鸣 Online education assessment system and method
CN104809558A (en) * 2015-04-23 2015-07-29 姚宇 System of testing the influence of income distribution and social security system on personal sense of fairness
CN105575205A (en) * 2015-12-12 2016-05-11 赵守盈 Computer self-adaption test system and method
CN107292464B (en) * 2016-03-30 2020-09-29 北京矩道优达网络科技有限公司 Automatic evaluation method and system based on directed acyclic graph and topological sorting
CN107292464A (en) * 2016-03-30 2017-10-24 北京矩道优达网络科技有限公司 Automation assessment method and system based on directed acyclic graph and topological sorting
CN105897732A (en) * 2016-05-12 2016-08-24 湖南汇博电子技术有限公司 Method for competition through network and server
CN106682768A (en) * 2016-12-08 2017-05-17 北京粉笔蓝天科技有限公司 Prediction method, system, terminal and server of test score
CN108615209A (en) * 2016-12-13 2018-10-02 航天信息股份有限公司 Capability comparison reports Mass production and management system and method
CN107239897A (en) * 2017-05-31 2017-10-10 中南大学 A kind of personality occupation type method of testing and system
CN107483397A (en) * 2017-06-19 2017-12-15 上海高顿教育培训有限公司 A kind of examinee's self-test assessment method based on B/S framework
CN108154733A (en) * 2018-02-05 2018-06-12 无锡科技职业学院 Foreigh-language oral-speech test device and the Foreigh-language oral-speech test method using the device
CN108492041A (en) * 2018-03-29 2018-09-04 常州市钱璟康复股份有限公司 A kind of evaluation system and assessment method
CN108681804A (en) * 2018-03-29 2018-10-19 常州市钱璟康复股份有限公司 One kind being used for somatopsychic disturbance person's vocational ability physics evaluation system and assessment method
CN108573051A (en) * 2018-04-23 2018-09-25 温州市鹿城区中津先进科技研究院 Knowledge point collection of illustrative plates based on big data analysis
CN109241506A (en) * 2018-06-11 2019-01-18 深圳市海云天教育测评有限公司 A kind of questionnaire generation method, device and computer readable storage medium
WO2020006756A1 (en) * 2018-07-06 2020-01-09 道鑛有限公司 Examination/selection system, examination/selection device, and examination/selection method
CN109544414A (en) * 2018-10-23 2019-03-29 平安医疗健康管理股份有限公司 Data processing method, device, server and computer readable storage medium
CN109712044A (en) * 2018-12-29 2019-05-03 华中师范大学 Program assessment method, device and read/write memory medium
CN110147953A (en) * 2019-05-16 2019-08-20 电子科技大学 A kind of questionnaire automatic generation method
CN111507872A (en) * 2020-04-09 2020-08-07 圆梦共享教育科技(深圳)有限公司 Artificial intelligence-based accurate test difficulty classification method
CN111507872B (en) * 2020-04-09 2023-04-07 圆梦共享教育科技(深圳)有限公司 Artificial intelligence-based accurate test difficulty classification method
CN111913570A (en) * 2020-05-28 2020-11-10 董淑娟 Immersive virtual reality examination method and system, terminal equipment and storage medium

Similar Documents

Publication Publication Date Title
CN104008453A (en) Vocational ability evaluation simulation system
Huang Analysis and design of university teaching evaluation system based on JSP platform
CN102346977A (en) Software development practical ability training and evaluation system
Atstaja et al. The role of economics in education for sustainable development; the baltic states’ experience
Kuchkarova et al. Quality management of engineering graphics teaching
Chen et al. An analytic knowledge network process for construction entrepreneurship education
CN116402391A (en) Comprehensive capability evaluation method and system based on big data
CN114090526B (en) Cloud education resource management system
Jiang University ideological and political multimedia network teaching based on MOOC
Sierra et al. Establishment EHEA for telecommunication technologies engineering degree
Zhou Virtual Reality Revolutionizing Digital Marketing Design and Optimization of Online English Teaching in Universities with Wireless Network Technology Support in the Context of 5G
Jiaxin An Evaluation Method of English Teaching Based on Machine Learning
Gao et al. Evaluation method of creative dance teaching quality based on fuzzy comprehensive evaluation
Mondal et al. Prediction of NAAC Grades for Affiliated Institute with the help of Statistical MultiCriteria Decision Analysis
Zhao et al. On-line teaching appraisal system of vocational education based on convolutional neural network and big data platform
KR101245824B1 (en) Method, system and computer-readable recording medium for providing study information
Yang Design on generating test paper based on simulated annealing algorithm
Shi et al. Research and design of teaching evaluation system based on fuzzy model
Okolocha et al. Extent of information and communication technology skills possessed by office technology andmanagement graduate workers in the civil service of Enugu State
Chen et al. [Retracted] Application of 5G Combined Wireless Interconnection Technology in the Reform of English Education in Colleges and Universities
Kang et al. A study of the current status of teachers’ Core qualities and abilities and the importance of their background factors in primary and secondary schools in Tianjin
Qi Investigation and analysis of classroom teaching quality in universities in an interval intuitionistic fuzzy environment
Wulandari et al. Utilization of Artificial Intelligence Model for Mapping Information and Communication Technology in Education
Zhang Design and implementation of college physical education intelligent management system based on big data cloud platform
Zhang et al. Application of AHP-fuzzy comprehensive evaluation method in students assessment

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
RJ01 Rejection of invention patent application after publication

Application publication date: 20140827

RJ01 Rejection of invention patent application after publication