CN101866315B - Test method and system of software development tool - Google Patents

Test method and system of software development tool Download PDF

Info

Publication number
CN101866315B
CN101866315B CN 201010204249 CN201010204249A CN101866315B CN 101866315 B CN101866315 B CN 101866315B CN 201010204249 CN201010204249 CN 201010204249 CN 201010204249 A CN201010204249 A CN 201010204249A CN 101866315 B CN101866315 B CN 101866315B
Authority
CN
China
Prior art keywords
test
command
module
command stream
open source
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN 201010204249
Other languages
Chinese (zh)
Other versions
CN101866315A (en
Inventor
霍玮
丁兆伟
于洪涛
李丰
陈聪明
王雪
张兆庆
冯晓兵
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Institute of Computing Technology of CAS
Original Assignee
Institute of Computing Technology of CAS
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Institute of Computing Technology of CAS filed Critical Institute of Computing Technology of CAS
Priority to CN 201010204249 priority Critical patent/CN101866315B/en
Publication of CN101866315A publication Critical patent/CN101866315A/en
Application granted granted Critical
Publication of CN101866315B publication Critical patent/CN101866315B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Landscapes

  • Debugging And Monitoring (AREA)

Abstract

The invention relates to a test method and a system of a software development tool. The method comprises the following steps that: 1. a configuring module obtains and stores a construction command of an open source software item, and stores the configured modification mode on the construction command; 2. a test execution module reads the stored construction command, and modifies the construction command stream according to the configuration modification mode for converting the construction command stream into a test command stream; 3. the test execution module invokes the software development tool to be tested for executing the test command stream for carrying out construction process replay; and 4. the test execution module monitors the construction process replay, and a test report generation module generates a test report according to the monitoring results output by the test execution module. The invention can improve the test efficiency on the software development tool.

Description

The method of testing of SDK (Software Development Kit) and system
Technical field
The present invention relates to field of software development, relate in particular to method of testing and the system of SDK (Software Development Kit).
Background technology
SDK (Software Development Kit), instruments such as advanced compilers, Program Static Analysis and error detection as the input data, by source program is processed, is finished the functions such as compiling, process analysis with source program.In the performance history of this class SDK (Software Development Kit), Black-box Testing is widely used.Adopt Black-box Testing need in the test process of SDK (Software Development Kit), use a large amount of test cases.Since this class SDK (Software Development Kit) with source program as input, so existing a large amount of open source software project becomes the natural alternative of test set.Yet the open source software project can't directly apply to test.
Usually the program scale of open source software project does not wait from several ten thousand to millions of line codes, complicated source file institutional framework and dependence are arranged, so the software developer is for effective management project and carry out fast the project compiling, use project build language compilation project build mechanism description document, description entry purpose institutional framework and dependence, control item purpose compiling progress, for example the C C++ project under Linux can be described build mechanism with the Makefile file, carries out structure with the make instrument.
In the prior art, directly there are the following problems in order to make up test set take the open source software project: (1) can directly write test script for certain project and finish test, but because the source file of disparity items has different institutional frameworks and dependence, the test script that is common to a plurality of projects is difficult for realizing; (2) the build mechanism description document of open source software project generally is to create along with the exploitation of project, revise and organize, so its content and distribution mode and procedural item be closely related, and does not have general amending method to make it satisfy the needs of test; (3) for extensive open source software project, project build mechanism description document enormous amount revises requiring a great deal of time and manpower one by one; (4) this mechanism is served the project compiling, and the analysis of source program is not identical with the progress monitoring of compiling with the error detection progress monitoring, therefore this mechanism can't be directly used in the test to process analysis and testing tool.
Summary of the invention
For addressing the above problem, the invention provides method of testing and the system of SDK (Software Development Kit), utilize the build mechanism of open source software project, improve the efficient to the test of SDK (Software Development Kit).
The invention discloses a kind of method of testing of SDK (Software Development Kit), comprising:
Step 1, configuration module obtains and stores the structure order of open source software project, preserves the alter mode to described structure order of configuration;
Step 2, testing execution module read the structure order of storage, revise described structure command stream according to the alter mode of configuration, are converted into test command stream will make up command stream;
Step 3, testing execution module are called SDK (Software Development Kit) to be tested and are carried out described test command stream, carry out building process and reset;
Step 4, testing execution module monitoring building process is reset, and test report generation module generates test report according to the monitored results of testing execution module output.
Described step 1 further is,
Step 21, for selected open source software project, call the selected the build tool of open source software project and carry out the build mechanism description document, make up whole open source software project, the order that the application build instrument will call in the building process outputs to the standard output stream of operating system, and the stream redirection mechanism that application operating system provides obtains the structure command stream of open source software project;
Step 22 to each open source software project, indicates the alter mode of command name, parameter and/or effective object to each type command.
Described testing execution module comprises playback driver module and command process standalone module;
Described step 2 further is,
Step 31, playback driver module read the test profile of storage and make up the command line parameter of command stream, and so that running environment to be set, described test profile comprises the registration table of open source software project;
Step 32, playback driver module read the alter mode that makes up command stream and configuration, and carry out normalized to making up order;
Step 33, the playback driver module is according to making up the open source software project registration table in the command line parameter inquiry test profile in the command stream, know the open source software project of current use, command process standalone module corresponding to described open source software project imported in every order that will make up successively command stream into, and the running environment parameter is provided;
Step 34, described command process standalone module carries out initialization according to the parameter of described running environment, by the alter mode that disposes described structure command stream is converted into test command stream.
Described testing execution module also comprises the command process sharing module,
Described step 3 is further called SDK (Software Development Kit) to be tested for the command process sharing module and is carried out described test command stream, carries out building process and resets.
Described step 4 further is,
Step 51, testing execution module is carried out Real Time Monitoring to the implementation status of test command, the output test log
Step 52, the text of the defect report of SDK (Software Development Kit) is set up in the daily record of test report generation module analytical test;
Step 53, test report generation module travels through each failed part that makes up playback procedure, failed part to described structure playback procedure, if the explanation of corresponding error message is caused by tested Software Testing Tool defective, then with the information recording/of described failure part in described text, simultaneously the test command of the execution failure of correspondence is attached to unsuccessfully after the partial information, obtain the defect report of SDK (Software Development Kit).
Described step 3 also comprises, building process is reset, and charges to the breakpoint log file with carrying out failed test command;
After executing at least one times test, carry out following incremental testing process,
Step 61, the playback driver module is by reading the breakpoint log file, from the breakpoint log file, obtain successively the structure order of the open source software project of execution single-step operation, form and make up command stream, call the breakpoint execution module, the breakpoint execution module is converted into test command stream according to described alter mode with described structure command stream;
Step 62, breakpoint execution module call instruction processing sharing module are carried out described test command and are carried out the building process playback, and the monitoring building process is reset;
Step 63, test report generation module generates test report according to the monitored results of testing execution module output.
The invention also discloses a kind of test macro of SDK (Software Development Kit), comprising:
Configuration module is used for the structure order of acquisition and storage open source software project, preserves the alter mode to described structure order of configuration;
Testing execution module for the structure order of reading storage, is revised described structure command stream according to the alter mode of configuration, is converted into test command stream will make up command stream; Call SDK (Software Development Kit) to be tested and carry out described test command stream, carry out building process and reset; The monitoring building process is reset;
Test report generation module is used for generating test report according to the monitored results of testing execution module output.
Described configuration module is further used for for selected open source software project, call the selected the build tool of open source software project and carry out the build mechanism description document, make up whole open source software project, the order that the application build instrument will call in the building process outputs to the standard output stream of operating system, and the stream redirection mechanism that application operating system provides obtains the structure command stream of open source software project; To each open source software project, indicate the alter mode of command name, parameter and/or effective object to each type command.
Described testing execution module comprises playback driver module and command process standalone module;
The playback driver module, the command line parameter that is used for reading the test profile of storage and makes up command stream, so that running environment to be set, described test profile comprises the registration table of open source software project; Read the alter mode that makes up command stream and configuration, and carry out normalized to making up order; According to making up the open source software project registration table in the command line parameter inquiry test profile in the command stream, know the open source software project of current use, command process standalone module corresponding to described open source software project imported in every order that will make up successively command stream into, and the running environment parameter is provided;
The command process standalone module is used for carrying out initialization according to the parameter of described running environment, by the alter mode that disposes described structure command stream is converted into test command stream.
Described testing execution module also comprises the command process sharing module,
The command process sharing module is used for calling SDK (Software Development Kit) to be tested and carries out described test command stream, carries out building process and resets.
The command process sharing module also is used for the implementation status of test command is carried out Real Time Monitoring, returns test log to the playback driver module;
The playback driver module also is used for exporting described test log;
Test report generation module is used for the text that the defect report of SDK (Software Development Kit) is set up in the analytical test daily record; Travel through the failed part that each makes up playback procedure, failed part to described structure playback procedure, if the explanation of corresponding error message is caused by tested Software Testing Tool defective, then with the information recording/of described failure part in described text, simultaneously the test command of the execution failure of correspondence is attached to unsuccessfully after the partial information, obtains the defect report of SDK (Software Development Kit).
The command process sharing module also is used for building process is reset, and charges to the breakpoint log file with carrying out failed test command;
The playback driver module also is used for obtaining successively the structure order of the open source software project of execution single-step operation by reading the breakpoint log file from the breakpoint log file, forms and makes up command stream, calls the breakpoint execution module;
The breakpoint execution module flows for according to described alter mode described structure command stream being converted into test command, and call instruction processing sharing module is finished the described test command of execution and carried out building process playback and the playback of monitoring building process.
Beneficial effect of the present invention is, utilize the project build mechanism of open source software project dynamically to form test procedure and testing procedure, robotization and finish efficiently test to SDK (Software Development Kit) in its building process of simulation improves the efficient of SDK (Software Development Kit) test; The conversion project build command stream that the present invention proposes is that the method for test command stream is so that the user only need write a small amount of code according to the mode of standard, just the open source software project of a complexity can be used for test, avoided that source code is made a large amount of modifications or adjustment and be distributed in a plurality of project build mechanism description document in the project, reduced the required cost of extend testing collection; Provide standard interface and the reference of project build command process to realize, so that the user does not need to understand in depth the open source software project that will use, also needn't grasp various project build mechanism descriptive languages, just can formulate neatly test plan, control easily test process; By the incremental testing mode, carry out failed order in the playback procedure as the test breakpoint with making up, the breakpoint record that keeps each test iteration, it is used for subsequently test iteration as special structure command stream, the result of checking defective, the breakpoint record of each iteration must be the subset of its test command stream, can effectively shorten and test the required time.
Description of drawings
Fig. 1 is the process flow diagram of the method for testing of SDK (Software Development Kit) of the present invention;
Fig. 2 is the embodiment synoptic diagram that building process is reset;
Fig. 3 is the embodiment synoptic diagram of incremental testing;
Fig. 4 is the structural drawing of the test macro of SDK (Software Development Kit) of the present invention;
Fig. 5 is the structural drawing of testing execution module in the embodiment;
Fig. 6 is the synoptic diagram of the embodiment of system of the present invention.
Embodiment
Below in conjunction with accompanying drawing, the present invention is described in further detail.
The structure command stream of open source software project refers to make up the sequential list of order.Wherein make up order and refer in the process of utilizing project build instrument execution build mechanism description document, compiling and the whole open source software project of deployment, the order that the build tool is performed comprises command name, parameter and effective object three parts.
The invention provides an interface specification and reference realization thereof, by the user for each open source software project, indicate the processing mode to special type of commands, comprise the modification of command name, parameter and effective object etc., such order can be carried out according to user's testing requirement.The present invention to be making up command stream as input, and each the bar order in the convection current is judged its type and screened and revise according to the mode of customization, is converted to test command stream and carried out.The implementation of test command stream can be regarded the simulation to the project build process as, but serves test purpose, therefore is called the playback of building process.Playback along with building process, the open source software project dynamically is converted into the test procedure that can be used for testing, be applied to simultaneously test, when finishing when resetting, test process is also finished thereupon, obtain test result, generate test report, and can utilize as required test result to do further statistical study.
The flow process of the method for testing of SDK (Software Development Kit) of the present invention as shown in Figure 1.
Step S100, configuration module obtains and stores the structure order of open source software project, and preserves the alter mode to described structure order of configuration.
Step S100 is as described below in one embodiment.
Step S110, the structure order of configuration module acquisition and storage open source software project is further for selected open source software project, call the selected the build tool of open source software project and carry out the build mechanism description document, make up whole open source software project, the order that the application build instrument will call in the building process outputs to the standard output stream of operating system, and the stream redirection mechanism that application operating system provides obtains the structure command stream of open source software project.
The order that the build tool calls each step in building process such as changing current directory, compiling source file, hyperlink target file etc., outputs to the standard output stream of operating system.The stream redirection mechanism that utilizes operating system to provide sequentially is saved in these orders in the file, and the present invention is called buildlog file (structure journal file) with this document, and then obtains the structure command stream of open source software project.
With respect to machine-processed by the described abstract project build of file that is distributed in the open source software project different levels, the project build command stream is its concrete enforcement record.
One preferred embodiment in, when structure project in advance obtains the structure command stream of project, generate temporary file, and store this temporary file in ad-hoc location.Large-scale open source software project can dynamically generate a large amount of temporary files, for example header file, script or implementing procedure in building process.Generally be indifferent to these temporary files in the test of prior art, but temporary file is the part of whole project build process, the disappearance of certain file can cause some command execution failure, affects the playback of whole building process, makes test result invalid.Because the command process mode of customization generally can be ignored the generation temporary file, so need to essential temporary file be generated and place the position that needs by this step.Carry out in the process of test command stream at step S300, temporary file can become with source file the effective object of some test command.
Step S120 to each open source software project, indicates the alter mode of command name, parameter and/or effective object to each type command.
Every the structure order that makes up in the command stream is comprised of command name, parameter and effective object three parts, is expressed as respectively C, P, O.One of described configuration is exemplified below described.
Different according to C and P will make up order and be divided into four classifications:
Catalogue change order---change the current place catalogue of building process;
Compiler directive---source files of program is compiled as file destination;
Chained command---file destination is linked as executable file or library file;
Other order---the order except above-mentioned three classes, for example the establishment order of temporary file.
Because making up the performance history of command stream and open source software project is closely related, can't be directly used in test, disposed the interface specification that comprises one group of function interface among the embodiment, be used for to make up command stream and be converted to test command stream, the effective object of test command stream is a subset of open source software project, test command stream is a series of testing procedures on this test procedure, is used to form test procedure.
Configuration is carried out following modification to catalogue change order and is processed.
Catalogue change order only is comprised of C and P, and wherein, C represents that catalogue enters or withdraw from operation, the indicate catalogue that enters or withdraw from of P.During implementation, to catalogue change order alter mode comprise and safeguard a catalogue storehouse, at first C is replaced with the catalogue change command name C ' of operating system; If C then with the current directory pop down, obtains test command<C ', P for entering operation 〉; If C is for withdrawing from operation, the P current directory of indicating to withdraw from then, the first catalogue of stack that should eject the catalogue storehouse replaces P as parameter P ', the test command that obtains is expressed as<C ', P ' 〉.
Configuration is carried out following modification to compiler directive and is processed.
The C of compiler directive, P, O respectively corresponding compilation operations, pass to the parameter of compiler and source file.Alter mode to compiler directive comprises: the respective operations title C ' that at first C is replaced with the tested software developing instrument; Safeguard simultaneously two parameter set Pn and Pm by user's appointment, comprise respectively the tested software developing instrument and do not allow the parameter of using and the required argument that is used for setting software developing instrument state, to the parameters among the P, if belong to Pn then from P, delete, then each parameter among the Pm is inserted P, the P ' after being adjusted revises the test command that obtains and is expressed as<C ', P ', O 〉.
If the tested software developing instrument is Program Static Analysis and error detection SDK (Software Development Kit), then alter mode also comprises the corresponding relation of recording between source file and the file destination, and so that test command is converted to the acceptable file layout of tested software developing instrument with source file.
Configuration is carried out following modification to chained command and is processed.
The C of chained command, P, O respectively corresponding linked operation, pass to the parameter of compiler and one group of file destination.Alter mode to chained command comprises: the respective operations title C ' that at first C is replaced with the tested software developing instrument; Safeguard simultaneously two parameter set Pn and Pm by user's appointment, comprise respectively the tested software developing instrument and do not allow the parameter of using and the required argument that is used for setting software developing instrument state, to the parameters among the P, if belong to Pn then from P, delete, then each parameter among the Pm is inserted P, the P ' after being adjusted.O is filtered and adjusts, comprise and revise nonconforming filename suffix; Ignore the effective object that does not generate; Perhaps replace with another group effective object, if for example the tested software developing instrument is Program Static Analysis and error detection SDK (Software Development Kit), then should according to the corresponding relation record between source file and the file destination, file destination be replaced with pretreated source file.Obtain test command after the modification and be expressed as<C ', P ', O ' 〉.
Following modification is carried out in other order to be processed.
Alter mode to other order comprises the command type collection T that safeguards user's appointment, wherein comprise and need other command type of carrying out in the playback procedure, during modification command type is judged, if command type belongs to the command type that comprises among the T, then carry out corresponding modification, otherwise this order is left in the basket.For example there is archive order ar in the building process of certain class open source software project, the one group of Piece file mergence that is used for inputting is a file, the effective object of this order be before the file destinations of many compiler directives output, and the files that generate after merging as after the effective object of chained command.If the file layout of exporting when the tested software developing instrument is carried out by compiler directive is different from file destination, then the user need to specify the processing mode of ar order, concrete operations comprise ignoring carries out the ar order, preserve simultaneously the mapping relations between import file name and the export file name, if occurred the export file name of this ar order in the chained command afterwards, then can by the mapping relations of inquiry preservation, replace with the title of corresponding former input file.
Step S200, testing execution module reads the structure order of storage, revises described structure command stream according to the alter mode of configuration, is converted into test command stream will make up command stream.
Testing execution module comprises command process standalone module, playback driver module, command process sharing module.
Step S210, playback driver module read the test profile of storage and make up the command line parameter of command stream, so that running environment to be set; Described test profile comprises the registration table of open source software project.
The registration table of open source software project, be used for depositing all open source software projects of test set<title, the position〉right, the playback driver module is known open source software project and the position thereof that will use by scanning this registration table.
In an embodiment, test profile also comprises the position of open source software project, tested software developing instrument and test script.
Test profile is used for describing in detail the institutional framework of test program set, the position that comprises open source software project, tested software developing instrument and test script, and the registration table of open source software project, and one group of default playback control option, whether the control option of for example resetting comprises chained library file when carrying out chained command.
The registration table of open source software project, be used for depositing all open source software projects of test set<title, the position〉right, the playback driver module is known open source software project and the position thereof that will use by scanning this registration table.
Command line parameter is used for making things convenient for user's Iterim Change when test to reset and controls option, or selects other special test mode, for example incremental testing in the preferred implementation.
In addition, when test environment is set, also need to be redirected output stream according to the needs that generate test log the information when redirected output stream is carried out unsuccessfully for hold-over command.
Step S220, playback driver module read the alter mode that makes up command stream and configuration, and carry out normalized to making up order.
By reading the buildlog file of storage, obtain successively the structure order of the open source software project of execution single-step operation among the embodiment, form and make up command stream.
Read the delegation's text among the buildlog at every turn.Generally, delegation's text is exactly an order of carrying out single-step operation, directly appends to the tabulation end that representative makes up command stream.
Two kinds of situations are carried out special processing:
Situation one, line of text is with the ending of ' ' character.
This explanation command description is crossed over multiline text, and driver module need to continue to read in, until line of text is no longer with ' ' EOC, and each style of writing originally coupled together treats as a whole.
Situation two contains ’ ﹠amp in the order; ﹠amp; ' or ' || ' connector.
This explanation order is to comprise the interdictum duplex that multistep operates, needs should order at the connector place to disconnect, until obtain respectively to carry out the order of single-step operation, and sequentially add the structure command stream.If the dependence between the structure order that connector represents is influential to test process, then directly interdictum duplex is added the structure command stream, revised as other type command when configuration makes up the order alter mode by the user.
Step S230, the playback driver module is according to making up the open source software project registration table in the command line parameter inquiry test profile in the command stream, know the open source software project of current use, command process standalone module corresponding to this open source software project imported in every order that will make up successively command stream into, and the running environment parameter is provided.
Step S240, the command process standalone module carries out initialization according to the parameter of described running environment, by the alter mode that disposes described structure command stream is converted into test command stream.
The command process standalone module call by the user realize corresponding to the command process interface that makes up command stream, by the alter mode of configuration described structure command stream is converted into test command stream, and in the test command with the parameter read-in test command stream of running environment.
Step S300, the command process sharing module is called SDK (Software Development Kit) to be tested and is carried out described test command stream, carries out building process and resets.
Call SDK (Software Development Kit) to be tested and carry out the test command that obtains.
The implementation of test command stream can be regarded the simulation to the project build process as.
Step S400, testing execution module monitoring building process is reset, and test report generation module generates test report according to the monitored results of testing execution module output.
In making up playback procedure, the command process sharing module is carried out Real Time Monitoring to the implementation status of test command, the output test log.
Make up the playback daily record---the test command stream after record is adjusted;
Error message daily record---the error message that the record test command is carried out;
Test crash daily record---unsanctioned part in the record test procedure;
The source code attribute data that data acquisition daily record---record will gather.
Test report generation module is carried out Macro or mass analysis to test log, forms test report.
Test report generation module at first analytical test daily record is set up the text of SDK (Software Development Kit) defect report, then each is made up the failed part of playback procedure, if the explanation of corresponding error message causes by being surveyed the instrument defective by software, then will be somebody's turn to do unsuccessfully the information recording/of part in file, the test command of the execution failure of correspondence is attached to unsuccessfully after the partial information simultaneously, travel through according to this failed part that each makes up playback procedure, obtain at last the SDK (Software Development Kit) defect report.
In the embodiment, generate the report of two class testings.
The first kind is the SDK (Software Development Kit) defect report.Know the part that makes up the playback procedure failure by the test crash daily record, corresponding to an assembly or the source file in the open source software project, then judge whether it is that defective by the tested software developing instrument causes according to the information in the error message daily record, simultaneously inquiring structuring playback daily record obtains to carry out failed test command.Above information has consisted of the context environmental when defective manifests jointly, generates on this basis the SDK (Software Development Kit) defect report, in order to help the developer defective is done targetedly debugging.
The source code of open source software project generally is divided into the assembly of different levels according to tree structure, building process is bottom-up to be finished.Assembly is common one group of source file realizing a certain function, usually is organized under the same catalogue.Make up playback daily record, error message daily record and test crash daily record and be single daily record, wherein can reflect this process to the record of catalogue change, according to the catalogue change record daily record result is divided into different granularities, can more accurately locates the corresponding relation between the assembly of the test command that makes up reset unsuccessfully part, error message, execution failure and open source software project.The part that makes up a playback failure has for example been arranged, test report generation module need in another error message daily record, inquire about which error message be this part failed Times out, this just need to know which message is to belong to this part, have to set up the each other way of corresponding relation.
Equations of The Second Kind is the report of source code analytical test.By collecting the data acquisition daily record, call the statistical study callback interface, form the source code analysis report.
The data acquisition daily record comprises a plurality of journal files, difference according to acquisition target, corresponding one by one with each assembly or source file respectively, be distributed in its residing position, each sub-directory by traversal open source software project gets up the data acquisition log collection of disperseing, and then calls the statistical study interface and processes.
The statistical study callback interface is the spare interface of test report generation module, needs the user for the character of tested software developing instrument and source code attribute to be analyzed, writes code and realizes.
The source code attribute of research open source software project is the closing to reality development activities more, grasps the characteristics that the real world Program has, modal RAM leakage approach for example, the perhaps frequency of utilization of certain class pointer etc.
One preferred embodiment in, the present invention also comprises the execution incremental testing.
The playback of an open source software project build process is accompanied by once complete test, every the order that makes up in the command stream is sequentially made amendment, be converted to test command by modification, these are revised each playback is identical, therefore repeats and can bring unnecessary computing expense.
In addition, one or more test command that exists the tested software developing instrument of defective can cause making up in the playback procedure is carried out unsuccessfully, among the present invention these orders is called breakpoint.In the process of the defective of debugging software developing instrument, the test iteration that is used for each time the verifying and debugging result is only paid close attention to the command execution situation at these breakpoint places, after eliminating all breakpoints, reset to verify whether when debugging, introduced other defective, produced new breakpoint by complete building process again.
More than two kinds of situations require between twice open source software project build process reset, to provide a kind of incremental testing mode, each iteration is only carried out the breakpoint of previous iteration.
This method will be from step S100 to S400 once complete structure reset and the test report generative process is called and once tests iteration.
Described step S300 also comprises, building process is reset, and carries out failed test command and charges to the breakpoint log file.
In the test iterative process, if certain bar test command is carried out unsuccessfully, the command process sharing module is charged to this test command in the breakpoint log file (breaklog).
The process of incremental testing mode is as described below.
Step S510, the playback driver module is by reading the breakpoint log file, from the breakpoint log file, obtain successively the structure order of the open source software project of execution single-step operation, form and make up command stream, call the breakpoint execution module, the breakpoint execution module is converted into test command stream according to described alter mode with described structure command stream.
The playback driver module is by reading the breaklog file of storage, from the breaklog file, obtain successively the structure order of the open source software project of execution single-step operation, form and make up command stream, and call the breakpoint execution module, should make up command stream and be converted into test command stream.
This step is carried out according to the described mode of step S220, but replaces buildlog as the input data of playback driver module with breaklog.
The playback driver module can read in a test command from breaklog at every turn, calls the breakpoint execution module and processes.
Step S520, breakpoint execution module call instruction processing sharing module is carried out described test command and is carried out the building process playback, and command process sharing module monitoring building process is reset.
The command process sharing module is carried out described test command with described in the step S300, and the command process sharing module is carried out the test command that imports into.
Step S530, test report generation module generates test report according to the monitored results of testing execution module output.
The effect of above process interrupt-contact execution module is similar to a kind of special command process standalone module, and difference is not rely on any structure command stream, only processes breakpoint, can reflect the test result of this increment iterative and be used for incremental testing afterwards.
Embodiment
Be example below by setting up the Black-box Testing procedure set comprise an open source software project at (SuSE) Linux OS, illustrate the present invention.
The test set framework comprises progs, modules, three sub-directories of results, is respectively applied to deposit open source software project, module and daily record.Comprise command process sharing module shared_adapter.py, playback driver module build.py, command process standalone module sendmail_adapter.py, breakpoint execution module inc_adapter.py, test report generation module report.py under the modules, and test profile config.py.Each module uses python (a kind of DYNAMIC PROGRAMMING language of explaining execution) to write, and corresponds respectively to a program file take .py as suffix.
Interface specification comprises such as lower interface:
Enter_dir: adjust and carry out the catalogue change order that enters particular category.
Exit_dir: adjust and carry out the catalogue change order of withdrawing from current directory.
Compile: adjust and carry out the order that source file is compiled as file destination.
Archive: adjust and carry out the order of the files that create one group of file.
Link: adjust and carry out the order that file destination is linked as executable file or library file.
Other_cmd: adjust and carry out other order.
The command process sharing module also comprises one group of daily record output call back function take log as prefix except realizing above interface:
Log_cmd: structure simulation daily record is charged in the current instruction that will be performed.
Log_fail: if instruction is carried out unsuccessfully, current place directory path is charged to the test crash daily record.
Log_err_cmd: if instruction is carried out unsuccessfully, charge to the increment execution journal with carrying out failed instruction.
Environmental information when test profile is set test execution by one group of name-value pair and a test procedure registration table, wherein main name-value pair comprises:
BASEDIR=test set root directory.
The storing directory of PROGS_BASEDIR=open source software project.
The storing directory of RESULTS_BASEDIR=test log, breakpoint record and test report.
The storing directory of MODULES_BASEDIR=module.
The path of TARGET_TOOL=tested software developing instrument.
The required argument during operation of SPECIAL_FLAGS=tested software developing instrument.
The test procedure registration table is realized with the dictionary structure in the python language, the abbreviation of the test procedure of every a pair of element representation in the dictionary and the source code bag title in test set thereof:
REGTAB={
’icecast’:’icecast-2.3.1’,\
’wine’:’wine-0.9.24’,\
}
The abbreviation that the playback driver module is inputted in order line according to the user, PROGS_BASEDIR and REGTAB in the query configuration file connect PROGS_BASEDIR with the source code bag title corresponding with abbreviation, just determined the particular location of test procedure.
The playback driver module is the processing command line parameter at first, and read test environment configurations file arranges test environment.Utilize the operating system built-in function of python language, wrong output stream is redirected to the error message daily record, the error message when making the command execution failure can be recorded in this daily record:
Err=os.open (errlog, os.O_WRONLY|os.O_CREAT) # creates the error message daily record
Os.dup2 (err, 2) # is redirected to the error message daily record with wrong output stream
Then be written into command process standalone module or breakpoint execution module:
If the test of if not do_inc:# complete then is written into the command process standalone module
processor=_import_(prog+’_adapter’)
If else:# carries out incremental testing, then be written into the breakpoint execution module
processor=_import_(’inc_adapter’)
Then the initialization of execution module: processor.init (env, prog), wherein env is test environment parameter.
To each the bar order among the test procedure buildlog, standalone module: processor.proc (cmd) is processed in call instruction at last.
The user realizes with lower interface according to writing command process standalone module sendmail_adapter.py with reference to realization:
Init is when being reproduced driver module and being written into, according to the environment configurations parameter initialization module of importing into.
Entrance function when proc is reproduced driver module and calls, the recognition command type is called corresponding Processing Interface.
Enter_dir, exit_dir, compile, archive, link are responsible for the respective type order is divided into command name, parameter and effective object three parts, carry out specific to the adjustment that makes up command stream, and the interface of the same name of sharing module are processed in call instruction.
At last sendmail_adapter.py is deposited under the modules sub-directory.
The breakpoint execution module has the interface identical with the command process standalone module, it is a kind of special command processing module that is independent of any open source software project, treatment mechanism is basic identical, what difference was to process is trained order in the last test, therefore at first to therefrom filter out SPECIAL_FLAGS, avoid after processing procedure in repeat insertion.
Suppose that the user wishes to create test procedure and carry out test based on mail server open source software project sendmail-2.6.31, as shown in Figure 2.
S201 obtains to make up command stream.
The user places the progs catalogue with the source code bag of sendmail-2.6.31, fill order make clean ﹠amp under sendmail-2.6.31 source code bag; ﹠amp; Make ﹠amp; Buildlog, check buildlog, guarantee the success of program actual implementation.
Step S202 returns buildlog.
Step S203 arranges running environment.
The user adds sendmail-2.6.31 and is called for short sendmail in the open source software project registration table of test profile.
The playback driver module reads the test profile of storage and makes up the command line parameter of command stream, so that running environment to be set; Described test profile comprises the registration table of open source software project.
Step S204 starts and carries out the building process playback.
Fill order ./build.py-p sendmail starts the playback driver module, wherein-and p parameter nominative testing program name.
Step S205 reads buildlog.
The buildlog that playback driver module read step S201 generates
Step S206, conversion makes up order and is test command.
The playback driver module is according to the sendmail of step S202 registration, the alter mode of inquiry sendmail, and call instruction is processed standalone module and will be made up to order according to this mode and be converted to test command.
Step S207 finishes order conversion and execution.
After finishing order conversion, the call instruction of command process standalone module is processed sharing module to the test command execution of resetting.
Step S208, test command stream is finished.
The command process sharing module is finished behind the test command stream, and execution result is returned to the playback driver module.
Step S209 returns daily record and breakpoint record.
After playback procedure is finished, playback daily record sendmail-build.log appears under the results sub-directory making up, error message daily record sendmail-err.log, test crash daily record sendmail-fail.log, data acquisition daily record sendmail-data.log and breakpoint record breaklog.
Step S210 generates test report.
The playback driver module sends to test report generation module with test log and breakpoint record.
Step S211 returns instrument defect report or source code analysis report.
Test report generation module reads daily record, obtains reflecting compiler instrument defect report.If generate the source code analysis report, the user need to write code, realizes the statistical study interface among the report.py.
Carry out incremental testing as shown in Figure 3.
Step S301 starts and carries out the increment execution.
User's fill order ./build.py-r-p sendmail starts the playback driver module.Wherein-and the r parameter shows that this time test is incremental mode, driver module will be written into the breakpoint execution module.
Step S302 reads the breakpoint record.
The playback driver module reads the breakpoint record breaklog of generation.And pass to the breakpoint execution module and process.
Step S303 processes and carries out breakpoint command.
The playback driver module read will read the breakpoint record pass to the breakpoint execution module and process.
Step S304 finishes order conversion and execution.
The breakpoint execution module is according to the sendmail of registration, and the alter mode of inquiry sendmail will make up order and be converted to test command, and pass to the command process sharing module.
Step S305, test command stream is finished.
The command process sharing module is finished behind the test command stream, and execution result is returned to the playback driver module.
Step S306 returns daily record and new breakpoint record
After playback procedure is finished, playback daily record sendmail-build.log appears under the results sub-directory making up, error message daily record sendmail-err.log, test crash daily record sendmail-fail.log, data acquisition daily record sendmail-data.log and breakpoint record breaklog.
Step S307 starts the generation test report.
The playback driver module is passed to test report generation module with test log and breakpoint record.
Step S308 returns test report.
Test report comprises instrument defect report or source code analysis report.
Test report generation module reads daily record, obtains reflecting compiler instrument defect report.If generate the source code analysis report, the user need to write code, realizes the statistical study interface among the report.py.
The present invention is applied to the development﹠ testing of advanced compilers and process analysis and error detection instrument.Use the present invention, the user can Rapid Establishment and expansion Black-box Testing procedure set, combines closely with the practical service environment of tested software developing instrument, reflects in time variation and the demand change of tested software developing instrument.The present invention can independently use, and also can be dissolved in other test process.
Be applied to the program's source code analysis.The present invention is by adjusting and simulation project building process, source file in the open source software project is treated as an organic whole, the data acquisition daily record of output is the result after whole program is analyzed, can help the user that the characteristic of the program in the real world is carried out statistical study, assist the exploitation of associated subject study and SDK (Software Development Kit).
The test macro of SDK (Software Development Kit) of the present invention as shown in Figure 4.
Configuration module 100 is used for the structure order of acquisition and storage open source software project, preserves the alter mode to described structure order of configuration.
Testing execution module 200 for the structure order of reading storage, is revised described structure command stream according to the alter mode of configuration, is converted into test command stream will make up command stream; Call SDK (Software Development Kit) to be tested and carry out described test command stream, carry out building process and reset; The monitoring building process is reset.
Test report generation module 300 is used for generating test report according to the monitored results of testing execution module 200 outputs.
In an embodiment, configuration module 100 is further used for for selected open source software project, call the selected the build tool of open source software project and carry out the build mechanism description document, make up whole open source software project, the order that the application build instrument will call in the building process outputs to the standard output stream of operating system, and the stream redirection mechanism that application operating system provides obtains the structure command stream of open source software project; To each open source software project, indicate the alter mode of command name, parameter and/or effective object to each type command.
With the structure of testing execution module in the embodiment specifically as shown in Figure 5.
Testing execution module 200 comprises playback driver module 210 and command process standalone module 220.
Playback driver module 210, the command line parameter that is used for reading the test profile of storage and makes up command stream, so that running environment to be set, described test profile comprises the registration table of open source software project; Read the alter mode that makes up command stream and configuration, and carry out normalized to making up order; According to making up the open source software project registration table in the command line parameter inquiry test profile in the command stream, know the open source software project of current use, command process standalone module 220 corresponding to described open source software project imported in every order that will make up successively command stream into, and the running environment parameter is provided.
Command process standalone module 220 is used for carrying out initialization according to the parameter of described running environment, by the alter mode that disposes described structure command stream is converted into test command stream.
Testing execution module 200 also comprises command process sharing module 230.
Command process sharing module 230 is used for calling SDK (Software Development Kit) to be tested and carries out described test command stream, carries out building process and resets.
Command process sharing module 230 also is used for the implementation status of test command is carried out Real Time Monitoring, returns test log to playback driver module 210.
Playback driver module 210 also is used for exporting described test log.
In an embodiment, test report generation module 300 is used for the text that the defect report of SDK (Software Development Kit) is set up in the analytical test daily record; Travel through the failed part that each makes up playback procedure, failed part to described structure playback procedure, if the explanation of corresponding error message is caused by tested Software Testing Tool defective, then with the information recording/of described failure part in described text, simultaneously the test command of the execution failure of correspondence is attached to unsuccessfully after the partial information, obtains the defect report of SDK (Software Development Kit).
One preferred embodiment
The command process sharing module also is used for building process is reset, and charges to the breakpoint log file with carrying out failed test command.
The playback driver module also is used for obtaining successively the structure order of the open source software project of execution single-step operation by reading the breakpoint log file from the breakpoint log file, forms and makes up command stream, calls the breakpoint execution module.
The breakpoint execution module flows for according to described alter mode described structure command stream being converted into test command, and call instruction processing sharing module is finished the described test command of execution and carried out building process playback and the playback of monitoring building process.
The institutional framework of the test set that creates in the specific embodiment of the invention as shown in Figure 6, the semanteme of each shape conforms to the component diagram standard of unified modeling language UML among the figure, wherein reset driver module, command processing function interface, command process sharing module, breakpoint execution module, test report generation module by the invention provides, the open source software project is added according to testing requirement by the user, be stored in the configuration module, and by revising the reference realization of command processing function interface, create the command process standalone module corresponding to the open source software project.The present invention comprises two main flow processs: resetting based on building process creates and the use test program, and the incremental testing iteration; Shown in accompanying drawing 2 and accompanying drawing 3, the semanteme of each shape conforms to the sequence chart standard of unified modeling language UML among the figure respectively.Wherein the key step based on building process playback establishment and use test program comprises: obtain to make up command stream, customized command processing mode, carry out building process playback and generation test report, the key step of incremental testing iteration comprises to be carried out incremental testing and generates test report.Below by introducing each key step, the effect of each module and interface is described, and two large flow processs are done detailed explanation.
The modification process that makes up command stream is specifically passed through a recognition function e and four adjustment function f d, fc, fl, fo finishes.Wherein e judges command type according to C, P, calls corresponding adjustment function; Fd, fc, fl, fo process respectively the order of Four types, finish the adjustment to its C, P, O, and carry out the order after adjusting.The present invention requires the user for the structure command stream of open source software project, and this group function interface is embodied as corresponding command process standalone module.Simultaneously, the present invention will extract the adjusting operation that arbitrary structure command stream all must be carried out, be embodied as the command process sharing module, so that the user only needs to finish the special processing relevant with the particular build command stream in standalone module, then call final conversion and execution that sharing module is finished order.The present invention realizes that for the user provides the reference of command process standalone module the user revises or adds a small amount of code, can finish the establishment of command process standalone module in reference to the portion copy of realizing.
Those skilled in the art can also carry out various modifications to above content under the condition that does not break away from the definite the spirit and scope of the present invention of claims.Therefore scope of the present invention is not limited in above explanation, but determined by the scope of claims.

Claims (12)

1. the method for testing of a SDK (Software Development Kit) is characterized in that, comprising:
Step 1, configuration module obtains and stores the structure command stream of open source software project, preserves the alter mode to described structure command stream of configuration;
Step 2, testing execution module read the described structure command stream of storage, revise described structure command stream according to the alter mode of configuration, described structure command stream is converted into test command stream;
Step 3, testing execution module are called SDK (Software Development Kit) to be tested and are carried out described test command stream, carry out building process and reset;
Step 4, testing execution module monitoring building process is reset, and test report generation module generates test report according to the monitored results of testing execution module output.
2. the method for testing of SDK (Software Development Kit) as claimed in claim 1 is characterized in that,
Described step 1 further is,
Step 21, for selected open source software project, call the selected the build tool of open source software project and carry out the build mechanism description document, make up whole open source software project, the order that the application build instrument will call in the building process outputs to the standard output stream of operating system, and the stream redirection mechanism that application operating system provides obtains the described structure command stream of open source software project;
Step 22 to each open source software project, indicates the alter mode of command name, parameter and/or effective object to each type command.
3. the method for testing of SDK (Software Development Kit) as claimed in claim 1 is characterized in that,
Described testing execution module comprises playback driver module and command process standalone module;
Described step 2 further is,
Step 31, playback driver module read the command line parameter of test profile and the described structure command stream of storage, and so that running environment to be set, described test profile comprises the registration table of open source software project;
Step 32, playback driver module read the alter mode of described structure command stream and configuration, and described structure command stream is carried out normalized;
Step 33, the playback driver module is according to the open source software project registration table in the command line parameter inquiry test profile in the described structure command stream, know the open source software project of current use, successively every order of described structure command stream is imported into command process standalone module corresponding to described open source software project, and the running environment parameter is provided;
Step 34, described command process standalone module carries out initialization according to the parameter of described running environment, by the alter mode that disposes described structure command stream is converted into test command stream.
4. the method for testing of SDK (Software Development Kit) as claimed in claim 3 is characterized in that,
Described testing execution module also comprises the command process sharing module,
Described step 3 is further called SDK (Software Development Kit) to be tested for the command process sharing module and is carried out described test command stream, carries out building process and resets.
5. the method for testing of SDK (Software Development Kit) as claimed in claim 1 is characterized in that,
Described step 4 further is,
Step 51, testing execution module is carried out Real Time Monitoring to the implementation status of test command, the output test log;
Step 52, the text of the defect report of SDK (Software Development Kit) is set up in the daily record of test report generation module analytical test;
Step 53, test report generation module travels through each failed part that makes up playback procedure, failed part to described structure playback procedure, if the explanation of corresponding error message is caused by tested Software Testing Tool defective, then with the information recording/of described failure part in described text, simultaneously the test command of the execution failure of correspondence is attached to unsuccessfully after the partial information, obtain the defect report of SDK (Software Development Kit).
6. the method for testing of SDK (Software Development Kit) as claimed in claim 3 is characterized in that,
Described step 3 also comprises, building process is reset, and charges to the breakpoint log file with carrying out failed test command;
After executing at least one times test, carry out following incremental testing process,
Step 61, the playback driver module is by reading the breakpoint log file, from the breakpoint log file, obtain successively the structure order of the open source software project of execution single-step operation, form described structure command stream, call the breakpoint execution module, the breakpoint execution module is converted into test command stream according to described alter mode with described structure command stream;
Step 62, breakpoint execution module call instruction processing sharing module are carried out described test command and are carried out the building process playback, and the monitoring building process is reset;
Step 63, test report generation module generates test report according to the monitored results of testing execution module output.
7. the test macro of a SDK (Software Development Kit) is characterized in that, comprising:
Configuration module for the structure command stream that obtains and store the open source software project, is preserved the alter mode to described structure command stream of configuration;
Testing execution module is used for reading the structure command stream of storage, revises described structure command stream according to the alter mode of configuration, is converted into test command stream will make up command stream; Call SDK (Software Development Kit) to be tested and carry out described test command stream, carry out building process and reset; The monitoring building process is reset;
Test report generation module is used for generating test report according to the monitored results of testing execution module output.
8. the test macro of SDK (Software Development Kit) as claimed in claim 7 is characterized in that,
Described configuration module is further used for for selected open source software project, call the selected the build tool of open source software project and carry out the build mechanism description document, make up whole open source software project, the order that the application build instrument will call in the building process outputs to the standard output stream of operating system, and the stream redirection mechanism that application operating system provides obtains the described structure command stream of open source software project; To each open source software project, indicate the alter mode of command name, parameter and/or effective object to each type command.
9. the test macro of SDK (Software Development Kit) as claimed in claim 7 is characterized in that,
Described testing execution module comprises playback driver module and command process standalone module;
The playback driver module, for the command line parameter of the test profile and the described structure command stream that read storage, so that running environment to be set, described test profile comprises the registration table of open source software project; Read the alter mode of described structure command stream and configuration, and described structure command stream is carried out normalized; According to the open source software project registration table in the command line parameter inquiry test profile in the described structure command stream, know the open source software project of current use, successively every order of described structure command stream is imported into command process standalone module corresponding to described open source software project, and the running environment parameter is provided;
The command process standalone module is used for carrying out initialization according to the parameter of described running environment, by the alter mode that disposes described structure command stream is converted into test command stream.
10. the test macro of SDK (Software Development Kit) as claimed in claim 9 is characterized in that,
Described testing execution module also comprises the command process sharing module,
The command process sharing module is used for calling SDK (Software Development Kit) to be tested and carries out described test command stream, carries out building process and resets.
11. the test macro of SDK (Software Development Kit) as claimed in claim 10 is characterized in that,
The command process sharing module also is used for the implementation status of test command is carried out Real Time Monitoring, returns test log to the playback driver module;
The playback driver module also is used for exporting described test log;
Test report generation module is used for the text that the defect report of SDK (Software Development Kit) is set up in the analytical test daily record; Travel through the failed part that each makes up playback procedure, failed part to described structure playback procedure, if the explanation of corresponding error message is caused by tested Software Testing Tool defective, then with the information recording/of described failure part in described text, simultaneously the test command of the execution failure of correspondence is attached to unsuccessfully after the partial information, obtains the defect report of SDK (Software Development Kit).
12. the test macro of SDK (Software Development Kit) as claimed in claim 10 is characterized in that,
The command process sharing module also is used for building process is reset, and charges to the breakpoint log file with carrying out failed test command;
The playback driver module also is used for obtaining successively the structure order of the open source software project of execution single-step operation by reading the breakpoint log file from the breakpoint log file, forms described structure command stream, calls the breakpoint execution module;
The breakpoint execution module flows for according to described alter mode described structure command stream being converted into test command, and call instruction processing sharing module is finished the described test command of execution and carried out building process playback and the playback of monitoring building process.
CN 201010204249 2010-06-11 2010-06-11 Test method and system of software development tool Active CN101866315B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN 201010204249 CN101866315B (en) 2010-06-11 2010-06-11 Test method and system of software development tool

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN 201010204249 CN101866315B (en) 2010-06-11 2010-06-11 Test method and system of software development tool

Publications (2)

Publication Number Publication Date
CN101866315A CN101866315A (en) 2010-10-20
CN101866315B true CN101866315B (en) 2013-01-02

Family

ID=42958047

Family Applications (1)

Application Number Title Priority Date Filing Date
CN 201010204249 Active CN101866315B (en) 2010-06-11 2010-06-11 Test method and system of software development tool

Country Status (1)

Country Link
CN (1) CN101866315B (en)

Families Citing this family (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2012059026A (en) * 2010-09-09 2012-03-22 Hitachi Ltd Source code conversion method and source code conversion program
CN102567164A (en) * 2011-12-23 2012-07-11 中国科学院自动化研究所 Instruction set batch testing device and method for processor
CN103220163B (en) * 2012-01-19 2017-03-01 阿里巴巴集团控股有限公司 The update method of configuration information and system
CN106297242A (en) * 2016-08-26 2017-01-04 美的智慧家居科技有限公司 The method and apparatus controlling home appliance
CN109871312B (en) * 2017-12-05 2022-08-12 航天信息股份有限公司 Interface testing method, device, equipment and readable storage medium
CN108920377B (en) * 2018-07-16 2022-03-04 杭州安恒信息技术股份有限公司 Log playback test method, system and device and readable storage medium
CN109240932A (en) * 2018-09-21 2019-01-18 郑州云海信息技术有限公司 A kind of test method, device and the equipment of unified storage management software
US11455237B2 (en) 2020-06-01 2022-09-27 Agora Lab, Inc. Highly scalable system and method for automated SDK testing
CN112363729B (en) * 2020-11-23 2024-05-14 北京轩宇信息技术有限公司 Monitoring method and device for mixed compiling of multiple compilers for static analysis
KR102392469B1 (en) * 2021-05-04 2022-04-29 에스디티 주식회사 Method for replicating a project server for trouble-shooting and a cloud development platform system using the same

Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5805795A (en) * 1996-01-05 1998-09-08 Sun Microsystems, Inc. Method and computer program product for generating a computer program product test that includes an optimized set of computer program product test cases, and method for selecting same
CN1971535A (en) * 2005-11-21 2007-05-30 中国科学院软件研究所 Testing method and system of safety input output automation based on time

Family Cites Families (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
GB0221257D0 (en) * 2002-09-13 2002-10-23 Ibm Automated testing

Patent Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5805795A (en) * 1996-01-05 1998-09-08 Sun Microsystems, Inc. Method and computer program product for generating a computer program product test that includes an optimized set of computer program product test cases, and method for selecting same
CN1971535A (en) * 2005-11-21 2007-05-30 中国科学院软件研究所 Testing method and system of safety input output automation based on time

Also Published As

Publication number Publication date
CN101866315A (en) 2010-10-20

Similar Documents

Publication Publication Date Title
CN101866315B (en) Test method and system of software development tool
CN110309071B (en) Test code generation method and module, and test method and system
CN108885545B (en) Tools and methods for real-time dataflow programming languages
US20190034189A1 (en) Systems and methods for transformation of reporting schema
US7716254B2 (en) System for modeling architecture for business systems and methods thereof
Miles et al. Prime: A methodology for developing provenance-aware applications
CN111832236B (en) Chip regression testing method and system, electronic equipment and storage medium
US6922827B2 (en) Iterative software development environment with prioritized build rules
Biehl et al. Integrating safety analysis into the model-based development toolchain of automotive embedded systems
Kazman et al. Architecture reconstruction guidelines
CN108845940B (en) Enterprise-level information system automatic function testing method and system
EP3491527B1 (en) Debugging tool for a jit compiler
US20040153830A1 (en) Method and system for object level software testing
Becker et al. Reverse engineering component models for quality predictions
CN102270128A (en) Library conformity checker
Guessi et al. Architectural description of embedded systems: a systematic review
US11327720B2 (en) Automated generation of software bindings
US9524366B1 (en) Annotations to identify objects in design generated by high level synthesis (HLS)
US20030051230A1 (en) Code management software fast transactions using state table technology
US20200097260A1 (en) Software application developer tools platform
US10656922B2 (en) Systems and methods for providing an application transformation tool
CN114356964A (en) Data blood margin construction method and device, storage medium and electronic equipment
CN117707499A (en) Multi-source model algorithm analyzer plug-in and compiling algorithm based on virtualization technology
CN108304184B (en) Compiling method and device
Zhang et al. How Effective Are They? Exploring Large Language Model Based Fuzz Driver Generation

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
C14 Grant of patent or utility model
GR01 Patent grant