CN102880543B - For the test data supply chain manager of integration testing platform - Google Patents
For the test data supply chain manager of integration testing platform Download PDFInfo
- Publication number
- CN102880543B CN102880543B CN201210127009.XA CN201210127009A CN102880543B CN 102880543 B CN102880543 B CN 102880543B CN 201210127009 A CN201210127009 A CN 201210127009A CN 102880543 B CN102880543 B CN 102880543B
- Authority
- CN
- China
- Prior art keywords
- test
- input data
- data set
- test script
- script
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Landscapes
- Debugging And Monitoring (AREA)
Abstract
The present invention relates to the test data supply chain manager for integration testing platform.Provide a kind of in integration testing platform the method for test script supply test data, wherein said test platform comprises the priorization that is configured to test script is transmitted to selected test individuality and assigns manager.If the input data set of correspondence closes available, then each test script is mapped to input data set and closes.Monitor to described priorization and the request to test script of assigning manager proposition, and if treat that the input data set in response to the described test script of described request supply with corresponding mapping closes, the input data set conjunction of described correspondence is then obtained from database, and before the described test script of execution, provide described input data set to close to described test script.
Description
the cross reference of related application
This application claims in that submit, that sequence number is the U.S. Provisional Patent Application of 61/476,489 rights and interests on April 18th, 2011, by reference this application is incorporated into this in full at this.
Technical field
The disclosure relates to software test, and more specifically, the disclosure relates to for developing, debugging and perform test to guarantee the integrality of software systems and functional integrated platform.
Background technology
The exploitation of computer software relates to strict test process, to guarantee that software runs as expected.During test process, tester writes various test script, guarantees that computer software is by the dissimilar test needed for design and operation to perform.Tester is also arranged and testing results script, follows the trail of result simultaneously, and reports test result to suitable personnel.This process efficiency is not high and consuming time, and needs a large amount of tester to participate in.
In addition, along with business continues to depend on computer software and complicated software package, the computer software of more and more high complexity has been developed to meet business demand.Due to complexity and the scale of increase, this type of software program requires large-scale test process, and this test process relates to than previous required more tester and test script.This type of increases and to put together with by their test and to transfer to the tissue of outsourcing test model relevant.For in the system development life cycle (SDLC) of each project, and now there is " discrete " test function concentrated in traditional test " embedding ", it tests across multiple project and issue (release) in the tissue.
Develop each step that the testing tool person that comes subtest performs test process.But existing testing tool can not be provided as the function needed for challenge and efficiency that overcome and caused by large scale test process.
The complexity of test various product and/or software product and scope increase.In the past, the deviser of relative groupuscule (number may be 10 to 30) and developer's exploitation are for testing the various tests with the function of verifying software module or code segment.The groupuscule of this type of individuality was once easy to management.But the number along with the individuality contributed to project becomes large, redundancy and complexity increase, and this causes the increase of cost and the error number increased.Therefore, there are the needs to process the problems referred to above.
Summary of the invention
Next generation test system (NGT) is provided for the exploitation of concentrating of software test, the management service platform of debugging and realization, wherein hundreds of or may can cooperate to develop and realize to form the module of protos test suite PROTOS or the large-scale array of test script by several thousand individualities.Next generation test system is not limited only to testing software module, but can also be used for testing hardware, and prerequisite is the test result signal from the state of reflection hardware to test macro and the designator that provide.
Such as, next generation test system can by organize or software development mechanism uses, to test and to verify function and the operation of the set (such as accounting system, JXC System (invoicingsystem), operating system version are issued or any other system) of large software bag or application or application.Next generation test system can use in test " factory ", and in this factory, a good hundreds of individuality performs final test or quality control test to identical or like product, such as, and the PC operating system testing before issuing.
Next generation test system may be used for exploitation and debugging test, and can also be used to realize final test program, controls with the issue or final mass of verifying the actual product tested before shipment.The test that next generation test system can be used for a) planning and develops for the product issued; B) plan and estimate the effort needed for development and testing process or manpower; C) set-up procedure is managed; D) management testing script is to the distribution of tester; And e) robotization is carried out to test process.
In integrated test platform, provide a kind of method for test script supply test data, wherein test platform is configured to tissue, management and promotes by the individual debugging to test script prepared of test.The method comprises test data supply chain, if the input data set that this test data supply chain is configured to correspondence closes available, is then closed by this input data set and is mapped to each test script.Monitor priorization and the request for test script of assigning manager proposition, and if the input data set test script supplied in response to request with corresponding mapping closes, then obtain corresponding input data set from database to close, and provide input data set to close at the forward direction test script performing this test script.
After having checked accompanying drawing and having described in detail, other embodiments of system, method, feature and the advantage of correspondence thereof will be easy to understand to those skilled in the art.Be intended to make all this type of additional system, method, feature and advantage to be included in this instructions, within the scope of the invention and make them be protected by following claim.
Accompanying drawing explanation
With reference to the following drawings and description, this system can be understood better.Parts in the accompanying drawings may not be drawn in proportion, but are emphasized diagram principle of the present invention.In addition, in the accompanying drawings, similar reference marker runs through different views and refers to corresponding parts.
Fig. 1 shows the high level block diagram of the embodiment of the critical piece of next generation test system;
Fig. 2 is the diagram of the integrated testability process using next generation test system;
Fig. 3 is the logic diagram of the user interface of the embodiment of Modular script designer;
Fig. 4 is the screenshot capture of the embodiment of Modular script designer;
Fig. 5 is the screenshot capture of the embodiment of Modular script designer;
Fig. 6 shows the high level block diagram of the machine environment that next generation test system can operate wherein;
Fig. 7 is the high level block diagram of computer system;
Fig. 8 is the logic diagram of the embodiment of NGT system;
Fig. 9 is the logic diagram of the embodiment of NGT system; And
Figure 10 is the higher level hardware block diagram of another embodiment of NGT system.
Embodiment
Fig. 1 shows the high level block diagram of 8 parts of next generation test system 100, and it comprises: test-schedule instrument 110, Modular script designer 120, priorization and appointment manager (PAM) 130, test execution toolbar 140, automation controller 150, test data supply chain controller 160, reporting portal 170 and bug management tool 180.
Next generation test system 100 can be and suite of tools that is existing or bottom basic test Tool integration.Therefore, next generation test system 100 is not to substitute existing management tool and developing instrument, but promotes the ability increasing this type of existing instrument of expansion.Next generation test system 100 serves as the layer at existing management tool and developing instrument top.
Fig. 2 is the diagram of the integrated testability process using next generation test system 100.Test process can comprise: test-schedule stage 202, test preparatory stage 204 and test execution stage 206.From the test-schedule stage 202 to the test preparatory stage 204, and work appointment 208 can be related to from the conversion in test preparatory stage 204 to test execution stage 206.The test-schedule stage 202 can comprise delimitation (scoping) 210, estimate 212 and searching resource 214.The test preparatory stage 204 can comprise: design new script 222, optimized regression bag 224, setup test data 226 and exploitation automatic test 228.The test execution stage 206 can comprise: allocation for test data 232, execution manual test 234, execution automatic test 236 and defect management 238.Next generation test system 100 can also comprise the reporting capabilities 240 in all stages of running through test process.Next generation test system 100 can provide the efficiency of increase and functional across all test phases.
Get back to Fig. 1, test-schedule instrument 110 is estimated and is planned the preparation involved when specific software issues beginning, work and manpower requirement.Test-schedule instrument 110 provides the multiple skill collection needed for each test script of test and the instruction of different technical ability groups that is associated from available tester.Test-schedule instrument 110 also provides auxiliary estimation.Test-schedule instrument can use three phase process to provide estimation with the accuracy level increased.The information from previously issuing is used to improve estimation.The pluggable framework specifically calculated for client can be used.Test-schedule instrument 110 also provides demand to arrive the destructing of test.
Requirement Decomposition becomes requisite number object to test by test-schedule instrument 110 assisted user.Cooperative work ability allows (divideandconquer) approach of dividing and rule.Test-schedule instrument 110 also provides resources by technical ability.Test-schedule instrument 110 can allow the early prediction of the technical ability supported needed for test activity and present the graphic software platform of availability contrast demand.Test-schedule instrument 110 is also by promoting that intersection technical ability (cross-skilling) is helped test organization and is shaped.Test-schedule instrument 110 also provides and returns bag suggestion.Use metadata driven approach, the recurrence bag that system recommendations are suitable.Test result based on risk can be used for correspondingly determining the size of wrapping.Test-schedule instrument 110 mainly to needing to test which project, perform and whether there is required technical ability in test which skill collection of needs and the resource that provides and quantize.
Modular script designer 120 is for designing new test or test script in modular fashion, and the efficiency by making the benefit maximization of the test script write by other devisers, slip-stick artist or test individuality increase test attempts and tissue.This is avoided redundancy by reusing that be functionally verified, that other people have created test script.Modular script designer 120 also provides module instead of reusing complete script, and this is because script is made up of several test modules, and wherein each module represents the logical gate of test, such as, to the login of application.
Modular script designer 120 is coordinated all testers that the establishment of the new test script created and existence are associated with same next generation test system 100, and validation test script is suitable for its test purpose.Which reduce one of the individual chance creating the test script of redundancy of test, and to the individual instruction providing considered test script to be suitable for his or she object in goal systems of test.
Each test script that individual or test founder uses Modular script designer 120 to create by test comprises associated data, these data correspond to test script accreditation history (approvalhistory) and relative to the POF of test script before considered test script or for other test scripts performed afterwards and grade.The associated data of test script also comprises the description of the function to test script, and mark uses the description of the product of test script for it.
Once use Modular script designer 120 to devise test script, just preserved and finally upload to standard testing instrument, standard testing instrument can be the separate and distinct commercially available testing apparatus or system that are used by next generation test system 100.As mentioned above, next generation test system 100 does not substitute low layer or basic test instrument.Such as, basic test instrument can be HewlettPackardHPQualityCenter
tMtesting tool, IBMRationalQualityManager or other commercially available basic test instruments, these basic test instruments can run in the control of next generation test system 100 with under instructing.Next generation test system 100 together with all various basic test Tool integration, and allows the communication to and from various basic test instrument.
Fig. 3 is the logic diagram of the user interface of the embodiment of MSD120.MSD120 can allow tester based on existing module library rapid Design new script.When needs new module, tester can create this module in MSD120.Use MSD120, tester can typing about test information and perform test needed for technical ability (304).Tester can select the type (306) of test data from data directory.Tester can also typing about current block metadata and the input parameter (308) of module is set.MSD120 can also illustrate the general introduction of current test script.General introduction can illustrate for the module (310) selected by current test script.MSD120 can be used when needed to create new module (312), and tester can search for concrete module (314).MSD120 can also illustrate front 5 immediately modules thereafter automatically, and next tester probably uses these modules (316).The possible immediately module thereafter that can show any other number.Knowledge based on existing test determines most probable immediately module thereafter.MSD120 can allow tester module to be dragged and dropped into (318) in script.MSD120 can also show testing procedure information for tester with reference to (320).
Fig. 4 shows the screenshot capture of the embodiment of MSD120.User interface can comprise multiple screen or label, and these screens or label comprising details label 402, prerequisite Tag 404, script tag 406, output/output label 408 as being shown in further detail in the diagram, completing label 410.Multiple screen or label can by pointing out user's input information to create to user's Show Options and information or design script and guide user to complete script formulation process.Such as, user can by clicking the drop-down list of file button and access function and carrying out wherein selecting and start on details label 402, the drop-down list of function comprise open script, new script, check script, clone's script or preserve rough draft.Tester can also input the key message about script on details label 402.Key message can comprise script head 414, script name 416, script describe 418, the title of testing attribute and value 420, complete script perform needed for technical ability 422 and demand reference for script.User can select required technical ability 422 from the technical ability list shown at details label 402.Required technical ability 422 can be used for script to be assigned to relevant tester and licensor or qualified tester and licensor after a while.Details label 402 can also comprise preserves rough draft button 424, and user can click this button to preserve the script information of institute's typing.On prerequisite Tag 404, MSD120 can show and allow the prerequisite of user's amendment for performing script, and it can comprise data type, data notes and other prerequisites.Other embodiments can comprise less, additional or alternative screen or label, with to user's display script option and information, and input with the user received about script.
As shown in Figure 5, script tag 406 can be presented at all modules in test script to user, and allows user to pass through create new module, edit existing module or clone existing module and add module to script.User can also input the data about module, comprises such as module title 502, module status 504, module release 506 and module and describes 508.User interface can also show multiple option to user in pane (pane), comprises the module 510 of the suggestion in script, and for the option 512 of search module.
User can select module by clicking and drag in selected module to current Script Field 514 from the module 510 of suggestion.User can input the additional information about module, comprise Module Links to parts (pulling out from Configuration Management Database (CMDB) (CMDB) and any other metadata).User interface to user's display about other information of script, can comprise such as module step 516, the testing procedure 518 for each module step, the expected results 520 for each module step, current script step 514, Property Name 522, property value 524 and parameter 526.User can click " adding script to ", and button 528 adds module to script.
Priorization and appointment manager 130 are critical elements of next generation test system 100.Priorization and appointment manager 130 are followed the trail of as all tests in the protos test suite PROTOS of a part for the list in database or test script, and assign the given set of the factor to each individual test script assigned priority based on priorization Summing Factor.
The priorization factor can be script attribute, comprise the impact of such as fault, fault likelihood, time in advance (leadtime), business priority, estimation effort and test the Close Date.Priorization and appointment manager 130 can use the priorization factor to assign numeral grading to script, for stack sequence, such as, to assess the priority of the execution of script.
Assign the factor can be evaluated with the user property be weighted user relative to the script set that can be used for testing, and can be the digital value of the script being assigned to individual consumer.Assign the factor can comprise such as, the previous experience of the technical ability of required technical ability, tester, script status, script workflow, tester's workflow, scenarist, user and script or its predecessor and the information of tester be assigned to about script.Priorization and appointment manager 130 can use assigns the factor to come to assign digital value to the script of individual consumer.The priority of fc-specific test FC script determines its position in test queue.Priorization and appointment manager 130 can use priorization Summing Factor to assign the factor to come together mate script when asking and be assigned to user.
Priorization and appointment manager 130 utilize real-time assignment logic to provide the priorization of the robotization of concentrating of test script.All test scripts all carry out priorization based on the concentrated set of the factor, and it can be configured to intensively affect whole test operation (such as, to improve the performance relative to KPI (critical process designator)).Priorization and appointment manager 130 also provide the appointment based on technical ability, and provide pull-out instead of press-in approach.Tester can click " obtain immediately thereafter " icon on their desktop computer screen to be assigned to pending immediately script thereafter.Immediately script is thereafter selected in real time by based on the weight assignment factor.
Being used for assigned priority can be weighted to each factor of script.In one example, the screen of multiple slide block or the button had corresponding to each test script can be presented to developer.The slide block that moves right can increase the levels of priority be associated with corresponding test script, and is moved to the left the levels of priority that slide block can reduce to be associated with corresponding test script.Therefore, tester can based on the judgement of tester and professional skill to test script assigned priority level.The priorization of each test script can affect relation between each test scripts all and mutual.Priorization and appointment manager 130 can perform prioritization function with batch mode after receiving input from test script founder.
Some factor be associated with the priority of assigning of test script can have to be fed back or decision tree ability, if thus make such as to perform test and return indicating fault, then priorization and assign manager 130 to identify may by other test scripts of this fault effects.
Priorization and appointment manager 130 also assign skill collection, to optimize the use to manpower personnel to each test script in next generation test system 100.Such as, each test script is assigned to tester by the skill collection based on fc-specific test FC individuality.
Such as, tester can click " obtain immediately thereafter " button on screen or icon, to ask new test script to send to this tester.Priorization and appointment manager 130 can access the database of the skill collection comprising each tester, and next limit priority test script is assigned to this tester based on the skill set needed for the skill collection of tester and test script is incompatible, thus the throughput rate of optimization system and tester's entirety.Once tester receives test script, he or she by testing results script.
Priorization and appointment manager 130 can also provide the pluggable framework for the new factor.New decision factor can by defining new factor type to add.This factor can be presented by user interface, and can weighting in decision logic.This can be used for supporting senior " Statistics Application " decision model.
Test execution toolbar 140 is visible toolbars on the computer screen of tester, and its provide to tester can each main tool, and the instruction of each main test that tester may or must call.It shows expediently to tester, to increase efficiency.Test execution toolbar 140 can provide (in-line) test execution on line.The state that test execution toolbar 140 allows tester to load test, perform test and record from toolbar.
Directly can open test script in toolbar, this saves the space on the desktop computer of tester, and avoids some keystroke (such as ALT-Tab) between screen.Defect generation and screen capture can be parts for this process.Test execution toolbar 140 can also provide the accreditation list of embedding.The accreditation of all modules/script can shown in toolbar, and licensor can open relevant script/module fast for accreditation.Test execution toolbar 140 also allows all NGT instruments of fast access.Can provide and start hurdle fast, with the NGT instrument supporting tester's fast access all.Toolbar can also process the login management of NGT.User profiles part can in order to change user profile.Test execution toolbar 140 can also be anchored in automatic hidden function.Test execution toolbar 140 can be anchored in the left side of screen, and it can be selected to and hides as seen or automatically.Extensible framework allows to add additional panel to toolbar.Test execution toolbar 140 can with priorization and assign manager 130 integrated, the immediately test thereafter of asking to allow tester to run.
Automation controller 150 is the application that can run on a virtual machine, in the computing machine such as in server zone or " cloud " environment.Automation controller 150 can with priorization with assign manager 130 and communicate, with the immediately test script thereafter in request for test queue, and promote to use the basic test instrument of such as HPQuickTestPro and so on described above to open test script.
Automation controller 150 can use basic test instrument to perform test script, and outcome record is got back in basic test instrument.Then, request immediately test script thereafter, and repeat this process.Automation controller 150 also provides modular design and partial automation.Automatized script can be developed to module, and each robotization module can have the one or more hand-held block mapped to it.Partial automation supports the quick execution to the automatic part of script.Substantially, when feasible, use Automated condtrol 150 to carry out robotization to the execution of test script.
The supplementary features of automation controller 150 attempt " investment repayment " (or " ROI ") be associated with each test script automatically run is maximized.Automation controller 150 is selected jointly to provide the test script of maximum ROI to carry out robotization.Whether use automation controller 150 to carry out the selection of robotization to fc-specific test FC script can based on the ROI be associated with test script.Such as, fc-specific test FC script can be the test script processing the initial log of being undertaken by user.Do not change because the test script processing the initial log of being undertaken by user can be used by individual different test script up to a hundred, so this test script provides higher ROI, this test script can be the good candidate for robotization thus.ROI is the measurement to the efficiency increased realized by the robotization of test script substantially.
Fig. 6 shows the high level block diagram of the interconnection between machine environment and various hardware and software parts that next generation test system 100 can operate wherein.Each test individuality can have special PC or other computing machines, is called unified desktop computer 630.Unified desktop computer 630 comprises the various modules of next generation test system 100, and such as test-schedule instrument 110, Modular script designer 120, executing means hurdle 140 and bug management tool 180, it runs as " .Net " client.
Priorization with assign manager 130, test data supply chain 160 and the controller that is associated thereof and can reside on server 632 or central server together with the Workflow system of the execution processing various task with being configured to dispatch.But, multiple server can also be used.Workflow system can be provided by MicrosoftWindowsWorkflowFoundation, and it can also perform on one or more server of server.
Integrated layer 634 provides communication between unified desktop computer 630, database 636, priorization and appointment manager 130 and test data supply chain 160 and function.Database 636 stores all test scripts and other desired datas.Integrated layer 634 can be reside on server 632 and " dll " file on client machine (such as unified desktop computer 630), and can be used as common api interface.Integrated layer 634 separates coupling by means of pluggable framework from downstream basic test instrument 638 (such as HPQualityCenter instrument 644 or IBMRationalQualityManager646).
Priorization and assign manager 130 and test data supply chain 160 and the controller that is associated thereof to perform under Workflow system, it resides on server 632.Automation controller 150 preferably resides on separate and distinct server or server set 650.The server running automation controller 150 can unify the seemingly computer of desktop computer 630 with operation, this is because automation controller 150 mainly emulates unified desktop computer when performing test script.
Automation controller 150 is from priorization and assign manager 130 to receive the test script of priorization, and accesses multiple virtual machine 640 to perform its test.Virtual machine 640 can be the machine of " based on cloud ".Each virtual machine 640 comprises functional test automation tools, such as HPQuickTestPro (being called QTP), and it is from priorization and assign manager 130 to receive test script, and then performs the test script of this reality.The result carrying out self-test is returned by integrated layer 634 report.
Test data supply chain 160 monitors amount and the type of the test data needed for each test script, and monitors the current available amount of available this data.If the stock of data available is about to use up, then test data supply chain 160 asks additional test data.Test data supply chain 160 creates the type of test script and the data needed for this test script and the mapping between measuring, so that correctly and perform efficiently.Test data supply chain 160 promotes the robotization of demand management and supplies required test data to test script.
Database 636 comprises data directory, and it stores corresponding to various test script and the list of various types of data of modeling and storage and/or definition.This can increase throughput rate and efficiency, because test is individual or deviser can consult data directory, and if feasible, then select to correspond to " (canned) of sizing " set that the data input of the new test script created and/or expection export, instead of to design particularly and the data of filing for each test script input.Database 636 can also comprise warehouse, and it stores the example of available data type, or the stock of data.
When using Modular script designer 120 to create test script, the type of the data needed for script founder nominative testing script, and also can specify the desired type of the output data generated owing to running this test script.Such as, as shown in Figure 5, founder can specify script module to comprise testing procedure 1 (528), and it requires input telephone number, and step 2 (530), the expected results 520 clicking search button is in this step display client details.Then, the type of the test data needed for test comprises telephone number and client's details.This quantizes the input and output parameter of test script in essence.Due to treating by priorization and assigning manager 130 to process and the test script queue after this performed with the addition of different test scripts, so test data supply chain 160 in an efficient way harpoon to the corresponding data of test script, to optimize the management of the input data needed for corresponding test script.
If between the exploitation and startup stage of test script, test is individual determines that specific test script can utilize the specific data model be stored in data directory, then the desired data input from data directory is mapped directly to test script, to avoid manual intervention by test data supply chain 160 automatically.Alternatively, test individuality can importation request of data, and based on partial data request, test data supply chain 160 can determine whether the particular data model be stored in data directory comprises the desired data of test script.Partial data request can carry out the input of self-test individuality, all in this way to the selection for one or more the concrete entity needed for test script possibility or attribute.In response to partial data request, test data supply chain 160 can by for comprise to be found by test one or more concrete entity of individual typing or the data type search data catalogue of attribute and automatically by DATATYPES TO to test script.Therefore, when perform test script time, test data supply chain 160 in due course between automatically provide desired data.In addition, the rule supporting master data mining ability can be specified.
Such as, if 50 concrete test scripts require input data type " A " and 27 concrete test scripts requirement input data type " B ", then test data supply chain 160 can harpoon to the desired data type of each script, and to provide to test script in " just-in-time (just-in-time) " mode and input data type " A " or " B " data accordingly, to avoid redundancy, increase efficiency and reduce complexity.
Additionally, run through the life cycle of test process, this test data can change based on the result of fc-specific test FC script.Therefore, test data supply chain 160 follows the trail of required change, and upgrades the corresponding data acquisition needed for test script, thus makes when test script is performed, and along with the execution of test script, up-to-date test data can be used.
As mentioned above, test data supply chain 160 provides suitable data at reasonable time to test script.Some test script can require the order supply of data, and this can change along with the execution of test script.Therefore, test data supply chain 160 is monitored the demand of this data capacity compared to all types of data.Along with data are consumed by test script, test data supply chain 160 is monitored and is upgraded the level of the data available from data directory.
Test data supply chain 160 can also manage the inventory level of available data types by the data type of assigning greater amount to store.When test data supply chain 160 receiving unit request of data, test data supply chain 160 can determine which data type in data directory comprises required entity or attribute.Then, test data supply chain 160 can determine that data type which comprises required entity or attribute has the available stock of highest level, and this data type is assigned or map to test script.
Such as, data type " A " can comprise clients account information, such as customer identifier, Billing Address, telephone number, birthday and the credit rating for multiple client.Data type " B " can also comprise clients account information, but only comprises customer name, Billing Address and telephone number.If test script only requires telephone number, then both data type " A " and " B " are suitable data type.Test data supply chain 160 can based on the demand of each data type and inventory level determine to assign in these two kinds of data types which kind of.
Test data supply chain 160 and priorization with assign manager 130 and communicate, to avoid performing the test script without available required input data type, or the test script that the inventory level of this input data is lower.If test script requires additional test data and this test data is current unavailable, then test data supply chain 160 is asked priorization and is assigned the request of manager 130 release tasks to testing individuality, thus makes the test data that the test individuality with required level of skill can add for the test script preparation of this test data of request.Alternatively, prepare in full automatic situation in test data, this request will propose to automation controller 150 instead of to priorization and appointment manager 130.
Test data supply chain 160 can also provide following functions: predict the demand of each data type, mark when drop to for this data type forecast demand for the inventory level of data type under, determined contingency needed for data (contingency) based on previously issuing, the data that trigger robotization provide and accept the state providing the new data item of process, determine data item based on testing procedure and parameter when data item is returned to warehouse from robotization.
The user of test data supply chain 160 can comprise tester or test is individual, and test data Team Member.Following table depict the function that test data supply chain 160 can provide to user.Other implementations of test data supply chain 160 can comprise less, additional or other functions and user.
Test data supply chain menu
Reporting portal 170 processes the function of reporting of next generation test system 100.Reporting portal 170 can based on MicrosoftBusinessIntelligence system, and this system is commercially available software package.Reporting portal 170 also comprises off-line data warehouse (" DW ") to avoid testing tool to degenerate.Off-line DW can be safeguarded, to avoid the inquiry directly to external test tools.Data model based on dimension is used for the report simplified.In addition, by data prepolymerization in multidimensional Data Environments (" MOLAP ") database, to provide express-analysis.Reporting portal 170 also provides based on cube tolerance of (cube-based) and a KPI.Use SS Analysis Service, can predefine measurement and target, it can be included in report.The electronic chart plug-in unit PowerPivot that can obtain from MicrosoftCorporation allows at such as MicrosoftExcel
tMand so on spread sheet in express-analysis data for special (ad-hoc) report.In addition, reporting portal 170 provides and such as MicrosoftSharePoint
tMand so on solution integrated.When needs from HPQualityCenter
tMduring data (such as, finance/production data) of different systems, this solution can from such as MicrosoftSharePoint
tMand so on solution receive data.SSIS parts allow this solution easily to expand to immediate data source when needed.Reporting portal 170 is provided to the interface of the modules of next generation test system 100, and processes all report generations, reporting format manipulation and other function of reporting.
Bug management tool 180 allows each test individuality fast identification and tracking defect in test process.Based on the current test performed, by each field of pre-filled defect.Bug management tool 180 can simplify generation, follow the trail of and upgrade the process of defect.Bug management tool 180 can provide Observation of Defects list.The defect list based on toolbar utilizing real-time redness, amber or green (RAG) status indicator can be provided.Red status instruction excessive risk or serious project problem, amber state instruction medium risk, and green state instruction low-risk.Bug management tool 180 can allow the full detail of fast access defect, to check last state.
Bug management tool 180 can also utilize test history to provide defect on line to produce.When performing test by toolbar, testing procedure and screenshot capture can be caught.When a defect occurs, by this pre-populated with information in defect.Screenshot capture and other annexes can directly upgrade.Bug management tool 180 also reduces " alt-tab " operation.By comprising heart defect management at toolbar, bug management tool 180 can reduce " alt-tab " to outer testing system (such as HPQualityCenter
tM) needs.Bug management tool 180 also supports that the robotization of script unblocks, to avoid the time spent on outer testing system further.Bug management tool 180 also provides the view based on team.Supvr has " team's view ", to support that they check the current relative dimensions and the state that affect the defect of their team.
Next generation test system 100 can be embodied as the system that cooperates with computer hardware component and/or be presented as computer implemented method.Next generation test system 100 can comprise multiple software module or subsystem.Module or subsystem at hardware, software, firmware, or can realize in any combination of hardware, software and firmware, and can reside in single physical or logical space, can not also reside in wherein.Such as, relate in the literature, can be shown in the drawings or can not module illustrated in the accompanying drawings or subsystem can remotely locate each other, and can be coupled by communication network.
Fig. 7 is the higher level hardware block diagram of an embodiment of computing machine or machine 700, and computing machine or machine be server 632 and 650, the PC performing unified desktop computer 630 and virtual machine 640 such as.Next generation test system 100 can be embodied as the system that cooperates with computer hardware component and/or be presented as computer implemented method.Next generation test system 100 can comprise multiple software module or system.Module or subsystem at hardware, software, firmware, or can realize in any combination of hardware, software and firmware, and can reside in single physical or logical space, can not also reside in wherein.Such as, relate in the literature, can be shown in the drawings or can not module illustrated in the accompanying drawings or subsystem can remotely locate each other, and can be coupled by communication network.
Computing machine or machine 700 can be personal computer or server, and various hardware component can be comprised, such as RAM714, ROM716, hard disk storage devices 718, cache memory 720, database storage device 722 etc. (being also called " memory sub-system 726 ").Computing machine 700 can comprise any suitable treatment facility 728, all computing machines as known in the art, microprocessor, risc processor (Reduced Instruction Set Computer), cisc processor (complex instruction set computer (CISC)), mainframe computer, workstation, single-chip microcomputer, distributed processors, server, controller, microcontroller, discrete logic computer etc.Such as, treatment facility 728 can be Intel
microprocessor, x86 can compatible microprocessors or equivalent of the apparatus, and can be incorporated in server, personal computer or any suitable computing platform.
Memory sub-system 726 can comprise any suitable memory unit, such as RAM, EPROM (electrically programmable ROM), flash memory, dynamic storage, static memory, FIFO (first in first out) storer, LIFO (last in, first out) storer, ring storer, semiconductor memory, magnetic bubble memory, buffer memory, disk storage, optical memory, cache memory etc.Can use the storer of any appropriate format, no matter it is the fixed memory device on magnetic medium, the memory device in semiconductor equipment, or by communication link access remote storage device.User or system interface 730 can be coupled to computing machine 700, and can comprise various input equipment 736, the switch such as can selected by system administration manager and/or keyboard.User interface can also comprise suitable output device 740, all LCD display as known in the art, CRT, various LED light, printer and/or voice-output device.
In order to promote the communication between computing machine 700 and external source, communication interface 742 operationally can be coupled to computer system.Communication interface 742 can be such as, LAN (Local Area Network), such as Ethernet, Intranet, the Internet or other suitable networks 744.Communication interface 742 can also be connected to PSTN (PSTN) 746 or POTS (plain-old telephone system), and it can promote the communication via the Internet 744.Any suitable commercially available communication facilities or network can be used.
Fig. 8 shows the schematic diagram of the embodiment of NGT system 100.As shown in Figure 8, NGT system 100 can comprise presentation layer 810, commercial components layer 820, integrated layer 634 and data Layer 840.Presentation layer 810 comprises user interface (UI) parts 812, its data are played up and format for comprising project administrator, the user 802 of tester and test lead shows, and to obtain and the data of authentication of users 802 typing.Presentation layer 810 also comprises UI processing element 814, and it uses the user's processing element be separated to drive this process, to avoid the hard coded of process streams in UI element itself and condition managing logic.Commercial components layer 820 realizes business logic and workflow.Commercial components layer 820 comprises commercial components 822, and it realizes the business logic of application.Commercial components layer 820 also comprises commercial entity 824 and commercial pursuit stream 826.Commercial entity is the data connection object in commercial components layer 820.These can use across each layer (comprising presentation layer 810) with the shared object transmitting data everywhere.
Integrated layer 634 is provided to the unknowable access in rear end of upstream layer (commercial components layer 820 and presentation layer 810), and supports the ability inserted of one or more back-end system (such as QC, RationalandTeamFoundationServer) via common interface.Integrated layer 634 realizes following Design Mode: abstract base class (its be Microsoft .Net framework can class) inherit from ProvideBase; Each specific implementation device transfers to inherit from above-mentioned abstract class; Based in .config file type definition load AppropriatedProvider (its be Microsoft .Net framework can class).Integrated layer 634 also comprises the integrated shop front 832.The integrated shop front 832 exposes the interface simplified to commercial components layer 820, and from from one or more storehouse, rear end or high-speed cache (such as, data are read in the combination of data connection object WindowsServerR2), and they are merged into common super data connection object, to turn back to commercial components layer 820.Integrated layer 634 also comprises NGT parts 834, and these NGT parts 834 dock with between data Layer 840 in the integrated shop front 832, and can provide the mapping function of integrated layer 634 when needed.Integrated layer 634 also comprises cache portion 836 and testing tool parts 838.Testing tool parts 838 are the suppliers for the request service to digital independent/input from testing tool 804.
Data Layer 840 comprises data access component 842, and it by the logical centralization needed for access bottom NGT data storage area, thus exposes the method allowing the simpler and transparent access to database.It also comprises digital assistants/utility 844, and it is for concentrating the general test platform function of such as managed database and so on.Data Layer 840 also comprises service broker 836, and it provides WindowsCommunicationFoundation service broker, for application server Service Call.Data Layer 840 can be EnterpriseLibraryDataAccessApplicationBlock, or the data Layer of Custom Design.Alternatively, the mapping tool that object is relevant, such as (can from EntitySpaces, LLP obtains) EntitySpaces, (can from TechTalk, GmbH obtain) Genome, (can obtain from MicrosoftCorporation) LINQ-to-SQL, (also can obtain from MicrosoftCorporation) EntityFramework or (can obtain from SolutionsDesign) LLBLGenPro can be used for generating data Layer 840 parts.
Crosscut (crosscutting) function 805 in NGT100 can comprise such as, safety, Exception handling, locking and communication.NGT100 can also comprise local cache 806.Output from NGT100 can comprise such as, e-mail function 807 or other info-communication function.Email can comprise to tester about script refusal or accreditation notice, to the notice about the script being ready to check of licensor and about security consideration, system exception and audit notice.Information can also be sent to testing tool 330 and NGT database 636 by NGT100.
Fig. 9 shows the logic diagram of the embodiment of NGT system 100.In this embodiment, presentation layer 1410 can comprise multiple UI parts 1412 and UI process 1414, comprises management interface 911, executing means hurdle 912, script module designer 913, unified desktop computer 102, defect tracking interface 914, KPI view 915 and accreditation examination interface 916.Commercial components layer 1420 can comprise multiple parts, comprises user profile component 921, search service parts 922, workflow service parts 923, business rules parts 924, time holding member 925, authorizes parts 926, certification parts 927.Integrated layer 634 can comprise the integrated shop front 1432, and it can comprise polymerization 931, integrated API932 and decompose 933.Integrated layer 634 can also comprise supplier 934, high-speed cache 935 and data transformation 936.Data Layer 1440 can provide the access to data supplier 941, digital assistants/utility 942 and data, services API943.
Figure 10 is the higher level hardware block diagram of another embodiment of NGT system.NGT system 100 and critical component 110,120,130,140,150,160,170 and 180 thereof can be presented as and the system that computer hardware component (such as treatment facility 728) cooperates, and/or are presented as computer implemented method.NGT system 100 can comprise multiple software part or subsystem.These parts or subsystem (such as test-schedule instrument 110, Modular script designer 120, priorization and appointment manager 130, test execution toolbar 140, automation controller 150, test data supply chain 160, reporting portal 170 and/or bug management tool 180) can at hardware, software, firmwares, or realize in any combination of hardware, software and firmware, and can reside in physics or logical space, can not also reside in wherein.Such as, relate in the literature, can be shown in the drawings or can not module illustrated in the accompanying drawings or subsystem can remotely locate each other, and can be coupled by communication network.
Machine readable or computer-readable medium (such as compact disk ROM (read-only memory) (CDROM), disk or CD, flash memory, random access memory (RAM) or ROM (read-only memory) (ROM), Erasable Programmable Read Only Memory EPROM (EPROM) or other machines computer-readable recording medium) can be encoded or be stored in above-mentioned logic, circuit and process using as the instruction such as being performed by processor, controller or other treatment facilities.
Medium may be implemented as and comprises, stores, transmits, propagates or transport executable instruction for instruction executable system, device or equipment use or any equipment relevant with it.Alternatively or additionally, logic may be implemented as the simulation or Digital Logic, such as one or more integrated circuit that use hardware, or performs one or more processor of instruction; Or be implemented in the software of application programming interface (API) or dynamic link library (DLL), function available in shared storage, or be defined as this locality or remote procedure call; Or as the combination of hardware and software.
In other implementations, logic can be indicated in signal or transmitting signal medium.Such as, the instruction realizing the logic of any preset sequence can take the form of signal of electricity, magnetic, optical, electrical magnetic, infrared or other types.Said system can at such as optical fiber interface, antenna or other are simulated or the communication interface place of digital signal interface receives this signal, instruction is recovered from signal, they are stored in computer-readable memory, and/or utilize processor to perform these instructions.
System can comprise additional or different logic, and can realize according to various ways.Processor may be implemented as controller, microprocessor, microcontroller, special IC (ASIC), discrete logic or the circuit of other types or the combination of logic.Similarly, storer can be the storer of DRAM, SRAM, flash memory or other types.Parameter (such as, condition and threshold value) and other data structures can separated ground store and managements, can be incorporated in single memory or database, or according to many different modes logics and physically can organize.Program and instruction can be a part for single program, the program that is separated, or can across some storeies and processor distribution.
Although described each embodiment of the present invention, will be apparent that to have many more embodiments and implementation within the scope of the invention to those of ordinary skill in the art.Therefore, except in view of except claims and their equivalent way, the present invention is also unrestricted.
Claims (20)
1. be a method for test script supply test data in integration testing platform, described test platform has the priorization and appointment manager that are configured to test script is transmitted to selected test individuality, and described method comprises:
On-hand level based on the data acquisition in data directory selects input data set to close from described data directory;
The demand that input data set selected by prediction closes;
If the input data set of correspondence closes available, then closed by selected input data set and be mapped to each test script, described mapping is performed automatically to provide input data to avoid manual intervention directly to described test script;
Monitor to described priorization and the request to test script of assigning manager proposition;
If treat that the input data set in response to the described test script of described request supply with mapping closes, then obtain the input data set conjunction of described correspondence from database, and determine whether the on-hand described level of described data acquisition drops under predicted demand; And
Before the described test script of execution, obtained input data set is provided to close to described test script.
2. method according to claim 1, if wherein treat that not having corresponding input data set in response to the described test script of described request supply closes, then asks described priorization and assigns manager to issue the task of closing for generating described input data set.
3. method according to claim 2, it is individual that the described task of wherein closing for generating described input data set is forwarded to test, described test is individual has the skill collection mated with the skill collection corresponding to test script, generates described input data set close for described test script.
4. method according to claim 1, wherein said database comprises multiple input data sets corresponding with multiple test script respectively and closes.
5. method according to claim 1, wherein said priorization and appointment manager arrange low priority for closing disabled test script for its input data set.
6. the system for being test script supply test data in integration testing platform, described test platform has the priorization and appointment manager that are configured to test script is transmitted to selected test individuality, and described system comprises:
Computer processor, it is coupled with storer, network interface and test data supply chain parts, and wherein said test data supply chain member being operable is to perform following operation:
Multiple test script and input data set conjunction is obtained from described storer;
On-hand level based on the data acquisition in the data directory in described storer selects input data set to close from described data directory;
If the input data set of correspondence closes and can use from described storer, then closed by selected input data set and be mapped to each test script, described input data set closes by automatic mapping to provide input data to avoid manual intervention directly to described test script;
The demand that input data set selected by prediction closes;
On described computer processor, monitor to described priorization and the request to test script of assigning manager proposition;
If treat that the input data set in response to the described test script of described request supply with mapping closes, then obtain the input data set conjunction of described correspondence from the database be stored in described storer, and determine whether the on-hand described level of described data acquisition drops under predicted demand; And
At described network interface place, before performing described test script by described computer processor, obtained input data set is provided to close to described test script.
7. system according to claim 6, if wherein treat that not having corresponding input data set in response to the described test script of described request supply closes, then asks described priorization and assigns manager to issue the task of closing for generating described input data set.
8. system according to claim 7, it is individual that the described task of wherein closing for generating described input data set is forwarded to test, described test is individual has the skill collection mated with the skill collection corresponding to test script, generates described input data set close for described test script.
9. system according to claim 6, wherein said database comprises multiple input data sets corresponding with multiple test script respectively and closes.
10. system according to claim 6, wherein said priorization and appointment manager arrange low priority for closing disabled test script for its input data set.
11. 1 kinds is the method that test script supplies test data in integration testing platform, and described test platform has the priorization and appointment manager that are configured to test script is transmitted to selected test individuality, and described method comprises:
Determine the supply that input data set closes, wherein said input data set closes and comprises input data type and input data volume;
Monitor to described priorization and the request to test script of assigning manager proposition;
If supply supplied test script in response to the described request for test script, then for described supplied test script, determine required test data set, wherein said required test data set comprises test data type and amount of test data;
Predict the demand that described input data set closes;
If described input data type and described test data type matching, and if described input data volume and described test data flux matched, then based on the on-hand level that described input data set closes, obtain described input data set from database to close, and described input data set is closed and is mapped to asked test script, and determine whether the on-hand described level of described data acquisition drops under predicted demand, described mapping is performed automatically to provide input data to avoid manual intervention directly to asked test script; And
Before the described test script of execution, obtained input data set is provided to close to described test script.
12. methods according to claim 11, if wherein described input data type is not mated with described test data type, if or described input data volume is not mated with described amount of test data, then ask described priorization and assign manager to issue the task of closing for generating new input data set, wherein said new input data set closes and comprises the new input data type with described test data type matching.
13. methods according to claim 12, it is individual that the described task of wherein closing for generating described new input data set is forwarded to test, described test is individual has the skill collection mated with the skill collection corresponding to described supplied test script, generates described new input data set close for described supplied test script.
14. methods according to claim 11, wherein said database comprises multiple input data sets corresponding with multiple test script respectively and closes.
15. methods according to claim 11, wherein said priorization and assign manager to be that the execution of closing disabled test script for its input data set arranges low priority.
16. 1 kinds of methods for being test script supply test data in integration testing platform, described test platform has the priorization and appointment manager that are configured to test script is transmitted to selected test individuality, and described method comprises:
Determine the supply that input data set closes, wherein said input data set closes and comprises input data type and input data volume;
Monitor to described priorization and the request to test script of assigning manager proposition;
If supply supplied test script in response to the described request for described test script, then for described supplied test script, determine required test data set, wherein required data acquisition comprises test data type and amount of test data;
Predict the demand that described input data set closes;
If described input data type and described test data type matching, and if described input data volume and described test data flux matched, then based on the on-hand level that described input data set closes, obtain described input data set from database to close, and described input data set is closed and is mapped to asked test script, and determine whether the on-hand described level of required data acquisition drops under predicted demand, described mapping is performed automatically to provide input data to avoid manual intervention directly to asked test script; And
Before the described test script of execution, obtained input data set is provided to close to described test script.
17. methods according to claim 16, if wherein described input data type is not mated with described test data type, if or described input data volume is not mated with described amount of test data, then ask described priorization and assign manager to issue the task of closing for generating new input data set, wherein said new input data set closes and comprises the new input data type with described test data type matching.
18. methods according to claim 17, it is individual that the described task of wherein closing for generating described new input data set is forwarded to test, described test is individual has the skill collection mated with the skill collection corresponding to described supplied test script, generates described new input data set close for described supplied test script.
19. methods according to claim 16, wherein said database comprises multiple input data sets corresponding with multiple test script respectively and closes.
20. methods according to claim 16, wherein said priorization and assign manager to be that the execution of closing disabled test script for its input data set arranges low priority.
Applications Claiming Priority (4)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| US201161476489P | 2011-04-18 | 2011-04-18 | |
| US61/476,489 | 2011-04-18 | ||
| US13/446,298 | 2012-04-13 | ||
| US13/446,298 US20130104105A1 (en) | 2011-04-18 | 2012-04-13 | Test data supply chain manager for an integrated testing platform |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN102880543A CN102880543A (en) | 2013-01-16 |
| CN102880543B true CN102880543B (en) | 2016-01-13 |
Family
ID=47022413
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201210127009.XA Active CN102880543B (en) | 2011-04-18 | 2012-04-18 | For the test data supply chain manager of integration testing platform |
Country Status (2)
| Country | Link |
|---|---|
| CN (1) | CN102880543B (en) |
| CA (1) | CA2775162C (en) |
Families Citing this family (11)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109040155B (en) * | 2017-06-08 | 2021-06-08 | 中国移动通信集团浙江有限公司 | Asset identification method and computer equipment |
| CN107832230B (en) * | 2017-12-04 | 2021-01-01 | 中国工商银行股份有限公司 | Test method, equipment and system based on data tuning |
| CN109857656A (en) * | 2019-01-18 | 2019-06-07 | 深圳壹账通智能科技有限公司 | Adaptation method, device, computer equipment and storage medium based on test |
| CN110347564A (en) * | 2019-05-24 | 2019-10-18 | 平安普惠企业管理有限公司 | Data creation method and device, electronic equipment, storage medium |
| CN111126963A (en) * | 2019-12-24 | 2020-05-08 | 微创(上海)网络技术股份有限公司 | Dynamic integration method of heterogeneous multi-source data |
| CN113448822B (en) * | 2020-03-25 | 2024-05-17 | 北京同邦卓益科技有限公司 | Test method, test device, computer readable medium and electronic equipment |
| CN113760733A (en) * | 2021-02-02 | 2021-12-07 | 北京沃东天骏信息技术有限公司 | Unit testing method and device |
| CN113133039B (en) * | 2021-05-11 | 2022-07-12 | 武汉迎风聚智科技有限公司 | Performance test method and device of gateway system |
| CN113407445B (en) * | 2021-06-03 | 2022-11-22 | 拉扎斯网络科技（上海）有限公司 | End-to-end automatic testing method and device and electronic equipment |
| CN114254985A (en) * | 2021-09-21 | 2022-03-29 | 毛海亮 | Intelligent financial service method and system based on supply chain |
| CN117453575B (en) * | 2023-12-25 | 2024-09-06 | 百信信息技术有限公司 | Computer batch test method and device, electronic equipment and storage medium |
Family Cites Families (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CA2393043A1 (en) * | 2002-07-11 | 2004-01-11 | Luiz Marcelo Aucelio Paternostro | Formal test case definitions |
| US8621475B2 (en) * | 2007-12-06 | 2013-12-31 | International Business Machines Corporation | Responsive task scheduling in cooperative multi-tasking environments |
| FI20080095A0 (en) * | 2008-02-11 | 2008-02-11 | Codenomicon Oy | Method and system for generating test cases |
| CN101876934B (en) * | 2009-04-30 | 2013-08-21 | 国际商业机器公司 | Method and system for sampling input data |
-
2012
- 2012-04-17 CA CA2775162A patent/CA2775162C/en active Active
- 2012-04-18 CN CN201210127009.XA patent/CN102880543B/en active Active
Also Published As
| Publication number | Publication date |
|---|---|
| CN102880543A (en) | 2013-01-16 |
| CA2775162A1 (en) | 2012-10-18 |
| CA2775162C (en) | 2016-12-13 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN102880543B (en) | For the test data supply chain manager of integration testing platform | |
| AU2012202261B2 (en) | Test data supply chain manager for an integrated testing platform | |
| CN102789415B (en) | The Modular script designer of test system is generated for the next generation | |
| CN102789414B (en) | For prioritization and the appointment manager of integration testing platform | |
| US8635056B2 (en) | System and method for system integration test (SIT) planning | |
| CN110347395A (en) | Software distribution method and device based on cloud computing platform | |
| CN107516192A (en) | Management method, device, system, electronic equipment, the storage medium of quick project | |
| CN109977012A (en) | Joint debugging test method, device, equipment and the computer readable storage medium of system | |
| CN102841842B (en) | For the automation controller of next generation test system | |
| CN113392002A (en) | Test system construction method, device, equipment and storage medium | |
| Sai et al. | Driving component selection through actor-oriented models and use cases | |
| WO2013019200A1 (en) | Systems and methods of knowledge transfer | |
| CN117667192A (en) | Sustained delivery method, device, equipment and storage medium based on Devops | |
| White et al. | Surveying the LLNL WSC/CP DevOps Landscape-FY23 DevOps L2: Advanced Simulation and Computing (ASC) L2 Milestone 8542," Spack Utilization in IC Code Projects” | |
| Groenda et al. | Model integration method and supporting tooling: project deliverable D5. 1 | |
| Aloysius | Contrast IT Solution System For Contrast Trading | |
| Oswald et al. | SAP Enterprise Support | |
| Kusnezov et al. | Advanced Simulation and Computing FY07-08 Implementation Plan Volume 2 | |
| Zalewski et al. | Feature-Based Architecture Reviews | |
| Baron | FY07-08 Implementation Plan Volume 2, Rev. 0.5 | |
| Kusnezov et al. | Advanced Simulation and Computing FY08-09 Implementation Plan, Volume 2, Revision 0.5 | |
| Hoang et al. | Fiscal Year 15-19 Program Notebook for Advanced Simulation and Computing | |
| Niemann | Goals: Doing the Right Things Right | |
| Gan | Supermarket Inventory System/Gan Jit Sin | |
| Tuzmen | Project Manager 2007 (Master of Softwware Engineering) |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C14 | Grant of patent or utility model | ||
| GR01 | Patent grant |