CN105427695B - Program class examination paper automatic assessment method and system - Google Patents

Program class examination paper automatic assessment method and system Download PDF

Info

Publication number
CN105427695B
CN105427695B CN201510740357.8A CN201510740357A CN105427695B CN 105427695 B CN105427695 B CN 105427695B CN 201510740357 A CN201510740357 A CN 201510740357A CN 105427695 B CN105427695 B CN 105427695B
Authority
CN
China
Prior art keywords
code
tested
assessed
test case
client
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Expired - Fee Related
Application number
CN201510740357.8A
Other languages
Chinese (zh)
Other versions
CN105427695A (en
Inventor
高万林
胡慧
郑立华
陈瑛
吕春利
冀荣华
李鑫
李静
段晶洁
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
China Agricultural University
Original Assignee
China Agricultural University
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by China Agricultural University filed Critical China Agricultural University
Priority to CN201510740357.8A priority Critical patent/CN105427695B/en
Publication of CN105427695A publication Critical patent/CN105427695A/en
Application granted granted Critical
Publication of CN105427695B publication Critical patent/CN105427695B/en
Expired - Fee Related legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • GPHYSICS
    • G09EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09BEDUCATIONAL OR DEMONSTRATION APPLIANCES; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND, DEAF OR MUTE; MODELS; PLANETARIA; GLOBES; MAPS; DIAGRAMS
    • G09B7/00Electrically-operated teaching apparatus or devices working with questions and answers
    • G09B7/02Electrically-operated teaching apparatus or devices working with questions and answers of the type wherein the student is expected to construct an answer to the question which is presented or wherein the machine gives an answer to the question presented by a student
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F11/00Error detection; Error correction; Monitoring
    • G06F11/36Preventing errors by testing or debugging software
    • G06F11/362Software debugging
    • G06F11/3624Software debugging by performing operations on the source code, e.g. via a compiler

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Business, Economics & Management (AREA)
  • Educational Administration (AREA)
  • Educational Technology (AREA)
  • Computer Hardware Design (AREA)
  • Quality & Reliability (AREA)
  • General Engineering & Computer Science (AREA)
  • Management, Administration, Business Operations System, And Electronic Commerce (AREA)

Abstract

The present invention relates to a kind of programming class examination paper automatic assessment methods, including:S1:Server end obtains the code to be tested and assessed and preset test case that client is sent;S2:Determine the corresponding input of the test case, output, weight and score;S3:According to the input of the test case, code to be tested and assessed described in operation obtains the output result of the code to be tested and assessed;S4:The output result of the code to be tested and assessed is matched with the desired output of the test case, and according to the weight and score of the test case, the score of code to be tested and assessed described in calculating.Using programming class examination paper automatic assessment method provided by the present invention, it can be according to preset test case, automatically judge program correctness, and return to corresponding score, can effectively solve the problem that programming that teacher submits student inscribe operation cumbersome verification, cannot be effectively objective to point problem, to preferably provide service for programming language class course.

Description

Program class examination paper automatic assessment method and system
Technical field
The present invention relates to educational applications field more particularly to a kind of programming class examination paper automatic assessment method and systems.
Background technology
In recent years, a kind of new Web-based Curriculum Teaching pattern MOOC (Massive Open Online Course, on a large scale Online Open Course) it is risen in education sector.By taking edx as an example, because countless young students freely, is openly invited competitively to pursue, User also gradually increases, and has had more than 900,000 registrant at present.For extensive online education, " extensive " means The quantity of participant is unrestricted;Open to the outside world means that anyone can participate in learning, and is free;" online " meaning It participant and course is participated in by network, without geographical restrictions.C language, C Plus Plus, Java language are current computer programs Widely used programming language in design, in the computer of all kinds of institution of higher learning and relevant speciality, the language such as C, C++ are required Basic course.
Currently, school is for programming based on the test and appraisal of class examination paper are all manually corrected with teacher, the artificial mood etc. when scoring Reason causes the deviation of scoring, these are all inequitable for student.Student needs when learning to program in computer room or individual Integrated Development Environment, editing procedure, compiler, operation program are installed on computer, and asked encountering common compiling, operation etc. When topic, it tends to be difficult to set about to solve.In addition, teacher when operation is inscribed in the programming for judging student, needs program of file copy, compiling journey Score, heavy workload, and time-consuming effort can be just provided after sequence, operation program.
To sum up, a kind of programming class examination paper automatic assessment method is designed, the workload to reduce teacher has highly important Effect.
Invention content
The technical problem to be solved by the present invention is to how provide a kind of method tested and assessed automatically to programming class examination paper.
For this purpose, the present invention proposes a kind of programming class examination paper automatic assessment method, include the following steps:
S1:Server end obtains the code to be tested and assessed and preset test case that client is sent;
S2:Determine the corresponding input of the test case, output, weight and score;
S3:According to the input of the test case, code to be tested and assessed described in operation obtains the output of the code to be tested and assessed As a result;
S4:The output result of the code to be tested and assessed is matched with the desired output of the test case, and According to the weight and score of the test case, the score of code to be tested and assessed described in calculating.
Preferably, the step S1 further includes:Whether include forbidden system command in code to be tested and assessed described in judgement, If including forbidden system command, stop described in code to be tested and assessed operation.
Preferably, the step S1 further includes:Code to be tested and assessed described in compiling, and compiling is obtained as a result, if compiling out It is wrong then return to error message.
Preferably, further include before step S1:
Operating file is written in the process number of the program of the server end by the program for running the server end;And it opens Start shipment line program monitoring thread;
Socket is created by main thread, binding Socket, monitors the ports Socket, and waits for the connection of the client Request;Wherein, after the connection for receiving a client, the connection request that a thread continues with another client is created.
Preferably, the step S3 further includes:
The operation program that the title of the code to be tested and assessed is sent to the server end by message queue monitors line Journey passes through the operational process of code to be tested and assessed described in the operation program monitoring thread monitoring.
Preferably, the operational process of code to be tested and assessed described in the operation program monitoring thread monitoring specifically includes following step Suddenly:
S301:Open the message queue;
S302:Etc. the message queue to be received;
S303:The first preset time of suspend mode;
S304:Whether code to be tested and assessed described in judgement is still running;If out of service, step is gone successively to S302;If still run, continue the second preset time of suspend mode;
S305:After between suspend mode second is default, if the code to be tested and assessed still is being run, described in forced termination The operation of code to be tested and assessed;If out of service, step S302 is gone successively to.
In another aspect, the present invention also provides a kind of automatic evaluation system of programming class examination paper, including server end and client End, the server end includes receiving unit, resolution unit, running unit and comparing unit;
The receiving unit is for obtaining the code to be tested and assessed and preset test case that client is sent;
The resolution unit is for determining the corresponding input of the test case, output, weight and score;
The running unit is used for according to the input of the test case, code test and assess described in operation, obtain described in wait for The output result of test and appraisal code;
The comparing unit is used for the output result of the code to be tested and assessed is desired described defeated with the test case Go out to be matched, and according to the weight and score of the test case, the score of code to be tested and assessed described in calculating.
Preferably, the client includes set a question module, answer module;
The module of setting a question to the server end for submitting programming examination question and the preset test case;
The answer module is used for code to be tested and assessed described in server end submission.
Preferably, the client further includes anti-plagiarism module, and the anti-plagiarism module is for calculating described in arbitrary two parts The similarity of code to be tested and assessed.
Preferably, the server end is distributed cluster system, including evaluation and test management node, program operation node, work Industry management node, task node, data management node and back end;The data management node and back end constitute distribution Formula file system provides save routine code and the environment of other data for other each node processing data;
The evaluation and test management node is used for after receiving the connection request of client, will wait testing and assessing by data management node Code is saved in the distributed file system, and distributes the journey to the code to be tested and assessed according to current loading condition Sort run node;
Described program operation node for compile, run described in code test and assess, and will compiling, run output result guarantor There are in the distributed file system;
The job management node distributes operation to each task section for submitting search inquiry code operation Point concurrently returns to the work by each task node into the search of the big data of line code, matching, and by matching result Industry management node;
The evaluation and test management node is additionally operable to the result of the operation output and matching result returning to the client End.
Can be online education platform by using programming class examination paper automatic assessment method provided by the present invention and system Learning computer Programming Courses, such as c program design, C++ Programming Courses provide online editing program, compiling journey Sequence, the distributed type assemblies test environment for running program;The program use-case that can be arranged according to teacher, in real time, is automatically judged Program correctness, and return to corresponding score;Big data analysis can also be carried out to the program code of submission, analyze student's generation The likelihood of code, achievees the purpose that anti-plagiarism, can effectively solve the problem that the cumbersome verification, no that teacher submits programming to inscribe operation student Can effectively it is objective to point, cannot provide compilation run error help information, the problems such as procedure reference code cannot be provided, to Preferably service is provided for programming language class course.
Description of the drawings
The features and advantages of the present invention can be more clearly understood by reference to attached drawing, attached drawing is schematically without that should manage Solution is carries out any restrictions to the present invention, in the accompanying drawings:
Fig. 1 shows the flow diagram of present invention programming class examination paper automatic assessment method;
Fig. 2 shows the schematic diagrames of server end distributed cluster system of the present invention;
Fig. 3 shows that present invention operation program monitoring thread monitors the operational process schematic diagram of code to be tested and assessed.
Specific implementation mode
Below in conjunction with attached drawing, embodiments of the present invention is described in detail.
Embodiment 1
As shown in Figure 1, the present invention provides a kind of programming class examination paper automatic assessment method, include the following steps:
Operating file is written in the process number of the program of server end by the program at runtime server end;And open operation journey Sequence monitoring thread;
Socket is created by main thread, binding Socket, monitors the ports Socket, and the connection of client is waited for ask It asks;Wherein, after the connection for receiving a client, the connection request that a thread continues with another client is created.
S1:Server end obtains the code to be tested and assessed and preset test case that client is sent;Judge described to be measured Whether comment in code includes forbidden system command.For example, by parsing json character strings, identify whether (hard comprising fdisk Disk subregion), the forbidden system command such as shutdown (shutdown), if including forbidden system command, stop described in The operation of code to be tested and assessed.According to method methods, selects compiler, compiles option, code to be tested and assessed described in compiling, and obtain Compiling if compiling and malfunctioning as a result, return to error message.
S2:Determine the corresponding input of the test case, output, weight and score;Wherein, test case can be arranged more Group, every group of test case have different inputs, desired output;Every group of test case, can be arranged different weights, to To different score values.Also it just says, even if program in machine code is by can only be by one group of test case, no if opportunistic mode All or part of test cases may be passed through.
S3:According to the input of the test case, code to be tested and assessed described in operation obtains the output of the code to be tested and assessed As a result;For the robustness of strengthening system program, stability, safety, the operation of monitoring evaluation and test service is needed, once evaluation and test clothes Business program breaks down or is maliciously done destruction for some reason, and system can be restored to start automatically.So in operation test and appraisal code Before program, the operation program that the title of the code to be tested and assessed is sent to the server end by IPC message queues is supervised Thread is controlled, the operational process of code to be tested and assessed described in the operation program monitoring thread monitoring is passed through.The generation that client is submitted Code runs the operation that program monitoring thread monitors these codes there are one needing, including:In virus, maliciously generation, are carried out to program code Code scanography;The system command that executed to program code calls special system API (application programming interface) to carry out Scanography;To program code Memory Allocation, release, inspection, the end of the program system should discharge recycling user program automatically The memory of release is not shown;To problematic in program code or have design defect, for example program endless loop, operation program hinder always It fills in, waste cpu resource etc. and checked, once detecting some operation program exception, then terminate the operation of the program at once.This Outside, do not allow program use sleep suspend mode functions, if some program runtime is more than 1000 milliseconds, we if think this Program enters endless loop, and system background is by the operation of the forced termination program, to ensure the safety of evaluating system.
As shown in figure 3, it is described operation program monitoring thread monitoring described in code to be tested and assessed operational process specifically include with Lower step:
S301:Open the message queue;
S302:Etc. the message queue to be received;
S303:The first preset time of suspend mode;
S304:Whether code to be tested and assessed described in judgement is still running;If out of service, step is gone successively to S302;If still run, continue the second preset time of suspend mode;
S305:After between suspend mode second is default, if the code to be tested and assessed still is being run, described in forced termination The operation of code to be tested and assessed;If out of service, step S302 is gone successively to.Wherein, the first preset time can be 300ms (millisecond), the second preset time can be 1s (second).
S4:The output result of the code to be tested and assessed is matched with the desired output of the test case, and according to The weight and score of the test case, the score of code to be tested and assessed described in calculating.
Embodiment 2
Using programming class examination paper automatic assessment method described in embodiment 1, the present invention also provides a kind of programming class examination paper Automatic evaluation system, including server end and client, the server end include receiving unit, resolution unit, running unit And comparing unit;
The receiving unit is for obtaining the code to be tested and assessed and preset test case that client is sent;
The resolution unit is for determining the corresponding input of the test case, output, weight and score;
The running unit is used for according to the input of the test case, code test and assess described in operation, and described in obtaining The output result of code to be tested and assessed;
The comparing unit be used for by the output result of code test and assess and the test case it is desired export into Row matching, and according to the weight and score of the test case, the score of code to be tested and assessed described in calculating.
Wherein preferably, the client may include set a question module, answer module;The module of setting a question is used for described Server end submits programming examination question and the preset test case;The answer module is used to submit to the server end The code to be tested and assessed.The client further includes anti-plagiarism module, and the anti-plagiarism module is for calculating described in arbitrary two parts The similarity of code to be tested and assessed.
As shown in Fig. 2, the server end is distributed cluster system, including evaluation and test management node, program operation node, work Industry management node, task node, data management node and back end;The data management node and back end constitute distribution Formula file system provides save routine code and the environment of other data for other each node processing data;
The evaluation and test management node is used for after receiving the connection request of client, will wait testing and assessing by data management node Code is saved in the distributed file system, and distributes the journey to the code to be tested and assessed according to current loading condition Sort run node;
Described program operation node for compile, run described in code test and assess, and will compiling, run output result guarantor There are in the distributed file system;
The job management node distributes operation to each task section for submitting search inquiry code operation Point concurrently returns to the work by each task node into the search of the big data of line code, matching, and by matching result Industry management node;
The evaluation and test management node is additionally operable to the result of the operation output and matching result returning to the client End.
Specifically, in module of setting a question, teacher can add programming and inscribe, setting programming topic type, score, beginning and ending time etc., Programming topic, problem description are filled in, test case is clicked and submitted, you can generates one of programming topic.Wherein, test case can be with It is arranged multigroup, every group of test case has different inputs, desired output;Every group of test case, can be arranged different weights, To obtain different score values.And in answer module, student can carry out the volume of code to be tested and assessed in " edit code " region Volume, if code input value in need, can also fill in corresponding input value, " RUN " button can be clicked, code is compiled It translates, if code is problematic, can show that compiling reports an error;If compiling does not pass through, " compiling result " output box can provide accordingly Diagnostics prompt.If code normal operation, operation result is only shown, do not show compiling result.When student's point " submission " button is hit, i.e., code is uploaded onto the server end, server end is then given and carries out automatic judgment, it is advance according to teacher The test case of setting is output and input, and fuzzy matching is carried out with the code to be tested and assessed that student submits, if source code passes through Before multigroup test case for being arranged, you can obtaining full marks if there is one group of test case does not pass through that is, can be according to corresponding Densimeter point counting number.
Anti- plagiarism module is primarily to facilitate the identical situation that teacher checks programming topic operation between student.It learns arbitrary two Raw A carries out similarity calculation with the B operations that programming is inscribed with along with, and every line code of A classmates operation to be detected and B classmates are made Every line code of industry calculates similarity (number of words is less than the code line of 15 words without calculating), and peak should as two people's operations The similarity of line code calculates similarity of the average value of all line code similarities as two classmates road programming topic operation.
Can be online education platform by using programming class examination paper automatic assessment method provided by the present invention and system Learning computer Programming Courses, such as c program design, C++ Programming Courses provide online editing program, compiling journey Sequence, the distributed type assemblies test environment for running program;The program use-case that can be arranged according to teacher, in real time, is automatically judged Program correctness, and return to corresponding score;Big data analysis can also be carried out to the program code of submission, analyze student's generation The likelihood of code, achievees the purpose that anti-plagiarism, can effectively solve the problem that the cumbersome verification, no that teacher submits programming to inscribe operation student Can effectively it is objective to point, cannot provide compilation run error help information, the problems such as procedure reference code cannot be provided, to Preferably service is provided for programming language class course.
Through the above description of the embodiments, those skilled in the art can be understood that the present invention can lead to Hardware realization is crossed, can also be realized by the mode of software and necessary general hardware platform.Based on this understanding, this hair Bright technical solution can be expressed in the form of software products, which can be stored in a non-volatile memories In medium (can be CD-ROM, USB flash disk, mobile hard disk etc.), including some instructions are used so that a computer equipment (can be Personal computer, server or network equipment etc.) execute method described in each embodiment of the present invention.
Although the embodiments of the invention are described in conjunction with the attached drawings, but those skilled in the art can not depart from this hair Various modifications and variations are made in the case of bright spirit and scope, such modifications and variations are each fallen within by appended claims Within limited range.

Claims (8)

1. a kind of programming class examination paper automatic assessment method, which is characterized in that include the following steps:
S1:Server end obtains the code to be tested and assessed and preset test case that client is sent;
S2:Determine the corresponding input of the test case, output, weight and score;
S3:According to the input of the test case, code to be tested and assessed described in operation obtains the output knot of the code to be tested and assessed Fruit;
S4:The output result of the code to be tested and assessed is matched with the desired output of the test case, and according to The weight and score of the test case, the score of code to be tested and assessed described in calculating;
Wherein, the step S3 further includes:
The title of the code to be tested and assessed is sent to the operation program monitoring thread of the server end by message queue, is led to Cross the operational process of code to be tested and assessed described in the operation program monitoring thread monitoring;
Wherein, the operational process of code to be tested and assessed described in the operation program monitoring thread monitoring specifically includes following steps:
S301:Open the message queue;
S302:Etc. the message queue to be received;
S303:The first preset time of suspend mode;
S304:Whether code to be tested and assessed described in judgement is still running;If out of service, step S302 is gone successively to; If still run, continue the second preset time of suspend mode;
S305:It is to be measured described in forced termination if the code to be tested and assessed still is being run after between suspend mode second is default Comment the operation of code;If out of service, step S302 is gone successively to.
2. a kind of programming class examination paper automatic assessment method according to claim 1, which is characterized in that the step S1 is also wrapped It includes:Whether include forbidden system command in code to be tested and assessed described in judgement, if including forbidden system command, stops The only operation of the code to be tested and assessed.
3. a kind of programming class examination paper automatic assessment method according to claim 1 or 2, which is characterized in that the step S1 Further include:Code to be tested and assessed described in compiling, and compiling is obtained as a result, returning to error message if compiling and malfunctioning.
4. a kind of programming class examination paper automatic assessment method according to claim 1 or 2, which is characterized in that step S1 it Before further include:
Operating file is written in the process number of the program of the server end by the program for running the server end;And open fortune Line program monitoring thread;
Socket is created by main thread, binding Socket, monitors the ports Socket, and the connection of the client is waited for ask It asks;Wherein, after the connection for receiving a client, the connection request that a thread continues with another client is created.
5. a kind of automatic evaluation system of programming class examination paper, which is characterized in that including server end and client, the server end Including receiving unit, resolution unit, running unit and comparing unit;
The receiving unit is for obtaining the code to be tested and assessed and preset test case that client is sent;
The resolution unit is for determining the corresponding input of the test case, output, weight and score;
The running unit is used for according to the input of the test case, code test and assess described in operation, obtain described in wait testing and assessing The output result of code;
The comparing unit be used for by the output result of code test and assess and the test case it is desired it is described export into Row matching, and according to the weight and score of the test case, the score of code to be tested and assessed described in calculating;
Wherein, the running unit is additionally operable to:
The title of the code to be tested and assessed is sent to the operation program monitoring thread of the server end by message queue, is led to Cross the operational process of code to be tested and assessed described in the operation program monitoring thread monitoring;
Wherein, the operational process of code to be tested and assessed described in the operation program monitoring thread monitoring specifically includes following steps:
S301:Open the message queue;
S302:Etc. the message queue to be received;
S303:The first preset time of suspend mode;
S304:Whether code to be tested and assessed described in judgement is still running;If out of service, step S302 is gone successively to; If still run, continue the second preset time of suspend mode;
S305:It is to be measured described in forced termination if the code to be tested and assessed still is being run after between suspend mode second is default Comment the operation of code;If out of service, step S302 is gone successively to.
6. the automatic evaluation system of programming class examination paper according to claim 5, which is characterized in that the client includes setting a question Module, answer module;
The module of setting a question to the server end for submitting programming examination question and the preset test case;
The answer module is used for code to be tested and assessed described in server end submission.
7. the automatic evaluation system of programming class examination paper according to claim 6, which is characterized in that the client further includes preventing Plagiarize module, the anti-similarity plagiarized module and be used to calculate code to be tested and assessed described in arbitrary two parts.
8. the automatic evaluation system of programming class examination paper according to claim 5 or 6, which is characterized in that
The server end is distributed cluster system, including evaluation and test management node, program operation node, job management node, Task node, data management node and back end;The data management node and back end constitute distributed file system, Save routine code and the environment of other data are provided for other each node processing data;
The evaluation and test management node is used for after receiving the connection request of client, will code be tested and assessed by data management node It is saved in the distributed file system, and according to current loading condition to the code distribution described program fortune to be tested and assessed Row node;
Described program operation node for compile, run described in code test and assess, and will compile, run output result be stored in In the distributed file system;
The job management node distributes operation to each task node for submitting search inquiry code operation, leads to It crosses each task node and concurrently returns to the working pipe into the search of the big data of line code, matching, and by matching result Manage node;
The evaluation and test management node is additionally operable to the output result and matching result of the operation returning to the client.
CN201510740357.8A 2015-11-03 2015-11-03 Program class examination paper automatic assessment method and system Expired - Fee Related CN105427695B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201510740357.8A CN105427695B (en) 2015-11-03 2015-11-03 Program class examination paper automatic assessment method and system

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201510740357.8A CN105427695B (en) 2015-11-03 2015-11-03 Program class examination paper automatic assessment method and system

Publications (2)

Publication Number Publication Date
CN105427695A CN105427695A (en) 2016-03-23
CN105427695B true CN105427695B (en) 2018-11-02

Family

ID=55505868

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201510740357.8A Expired - Fee Related CN105427695B (en) 2015-11-03 2015-11-03 Program class examination paper automatic assessment method and system

Country Status (1)

Country Link
CN (1) CN105427695B (en)

Families Citing this family (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106326112B (en) * 2016-08-15 2019-02-15 江苏海事职业技术学院 A kind of method and apparatus that procedure operation is corrected automatically
CN107678954A (en) * 2017-09-22 2018-02-09 江苏海事职业技术学院 A kind of procedure operation evaluating method and device
CN109144496A (en) * 2018-08-23 2019-01-04 广州慧通编程教育科技有限公司 The generation method and generating means for program of testing and assessing
CN109243249B (en) * 2018-08-23 2021-07-06 广州慧通编程教育科技有限公司 Method and device for generating evaluation program
CN110633072B (en) * 2019-07-30 2023-01-20 广东工业大学 Programming training question construction method and device for automatic correction
CN110427325A (en) * 2019-07-31 2019-11-08 中国联合网络通信集团有限公司 Online testing method and device
CN111459841A (en) * 2020-04-30 2020-07-28 成都海纳智博科技有限公司 Automatic evaluation method and system for general program language
CN112035371B (en) * 2020-09-04 2022-10-04 江苏海事职业技术学院 Automatic scoring method for web application operation
WO2022051974A1 (en) * 2020-09-10 2022-03-17 深圳市大疆创新科技有限公司 Code inspection method and apparatus applied to embedded platform, device and computer-readable storage medium
CN112799675A (en) * 2021-01-22 2021-05-14 中森云链(成都)科技有限责任公司 Automatic evaluation method for drawing programming examination questions
CN117215901B (en) * 2023-11-09 2024-03-08 华南师范大学 Programming exercise evaluation method, system, equipment and medium based on dynamic tracking

Citations (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1503951A (en) * 2001-01-09 2004-06-09 托普科德公司 Systems and methods for coding competitions
CN101014002A (en) * 2006-12-12 2007-08-08 华为技术有限公司 Cluster message transmitting method and distributed cluster system
CN101398758A (en) * 2008-10-30 2009-04-01 北京航空航天大学 Detection method of code copy
CN101464922A (en) * 2009-01-22 2009-06-24 中国人民解放军国防科学技术大学 Computer architecture scheme parallel simulation optimization method based on cluster system
CN101702276A (en) * 2009-11-17 2010-05-05 吉林大学 Method for automatically evaluating computer program source codes using mass data processing as core
CN101719087A (en) * 2009-11-26 2010-06-02 中国科学院计算技术研究所 Microprocessor reliability evaluating method and system thereof
CN102480560A (en) * 2010-11-26 2012-05-30 上海晨兴希姆通电子科技有限公司 PND (portable navigation device), mobile terminal, information synchronization system and information synchronization method
CN104111888A (en) * 2014-07-03 2014-10-22 曹建楠 Code evaluation method, device and system for teaching
CN104239219A (en) * 2014-10-21 2014-12-24 中国科学院软件研究所 Software defect positioning technology on-line evaluating and experimenting platform and method based on coverage
CN104239050A (en) * 2014-09-10 2014-12-24 中国科学技术大学 Method and system for ranking users in online program evaluation system
CN104850411A (en) * 2015-06-10 2015-08-19 清华大学 Storage system reference evaluation program generating method and apparatus

Family Cites Families (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1235142C (en) * 2002-08-20 2006-01-04 华为技术有限公司 Embedded sorftware task endless loop monitoring method
CN100543686C (en) * 2007-11-15 2009-09-23 上海华为技术有限公司 A kind of method and system that detect task closed loop
CN101504615A (en) * 2009-03-24 2009-08-12 杭州华三通信技术有限公司 Method and apparatus for providing positioning information for task endless loop
US8589898B2 (en) * 2010-03-29 2013-11-19 GM Global Technology Operations LLC Method and apparatus for analyzing software including a calibrated value
CN101853191B (en) * 2010-06-23 2013-02-20 迈普通信技术股份有限公司 Method for detecting task endless loop in operating system and operating system
CN102495793B (en) * 2011-11-11 2014-11-05 迈普通信技术股份有限公司 Method for detecting endless loop task
CN103164332B (en) * 2011-12-15 2015-11-18 迈普通信技术股份有限公司 The detection of endless loop task and disposal route

Patent Citations (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1503951A (en) * 2001-01-09 2004-06-09 托普科德公司 Systems and methods for coding competitions
CN101014002A (en) * 2006-12-12 2007-08-08 华为技术有限公司 Cluster message transmitting method and distributed cluster system
CN101398758A (en) * 2008-10-30 2009-04-01 北京航空航天大学 Detection method of code copy
CN101464922A (en) * 2009-01-22 2009-06-24 中国人民解放军国防科学技术大学 Computer architecture scheme parallel simulation optimization method based on cluster system
CN101702276A (en) * 2009-11-17 2010-05-05 吉林大学 Method for automatically evaluating computer program source codes using mass data processing as core
CN101719087A (en) * 2009-11-26 2010-06-02 中国科学院计算技术研究所 Microprocessor reliability evaluating method and system thereof
CN102480560A (en) * 2010-11-26 2012-05-30 上海晨兴希姆通电子科技有限公司 PND (portable navigation device), mobile terminal, information synchronization system and information synchronization method
CN104111888A (en) * 2014-07-03 2014-10-22 曹建楠 Code evaluation method, device and system for teaching
CN104239050A (en) * 2014-09-10 2014-12-24 中国科学技术大学 Method and system for ranking users in online program evaluation system
CN104239219A (en) * 2014-10-21 2014-12-24 中国科学院软件研究所 Software defect positioning technology on-line evaluating and experimenting platform and method based on coverage
CN104850411A (en) * 2015-06-10 2015-08-19 清华大学 Storage system reference evaluation program generating method and apparatus

Also Published As

Publication number Publication date
CN105427695A (en) 2016-03-23

Similar Documents

Publication Publication Date Title
CN105427695B (en) Program class examination paper automatic assessment method and system
Restrepo‐Calle et al. Continuous assessment in a computer programming course supported by a software tool
CN111026664B (en) Program detection method and detection system based on ANN and application
US20090070734A1 (en) Systems and methods for monitoring software application quality
US20140033174A1 (en) Software bug predicting
CN110413316B (en) Non-invasive testing system and method for intelligent contracts of block chain
CN108614777A (en) A kind of financial transaction test system and test method based on actual services
US8458663B2 (en) Static code analysis
Haendler et al. Serious refactoring games
CN111752833B (en) Software quality system approval method, device, server and storage medium
Madeyski The impact of pair programming and test-driven development on package dependencies in object-oriented design—an experiment
CN105468507A (en) Branch fulfillment detection method and apparatus
Denger et al. Testing and inspecting reusable product line components: first empirical results
Koyya et al. Feedback for Programming Assignments Using Software‐Metrics and Reference Code
Insa et al. Semiautomatic generation and assessment of Java exercises in engineering education
CN114090733A (en) Learning resource recommendation method and device, storage medium and electronic equipment
Saleh Software Quality Framework
Misra et al. A simplified model for software inspection
CN113094095B (en) Agile development progress determining method and device
Bye Informing HRA by Empirical Data, Halden Reactor Project Lessons Learned and Future Direction
Bondi et al. Early Progress on Enhancing Existing Software Engineering Courses to Cultivate Performance Awareness
CN111651349B (en) Test method and device
Nagappan et al. " Good enough" software reliability estimation plug-in for Eclipse
CN114840428A (en) Data evaluation method and device, electronic equipment and storage medium
Damm Evaluating and Improving Test Efficiency

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant
CF01 Termination of patent right due to non-payment of annual fee
CF01 Termination of patent right due to non-payment of annual fee

Granted publication date: 20181102

Termination date: 20191103