CN108255720A - Software automatic test system based on cloud computing framework - Google Patents

Software automatic test system based on cloud computing framework Download PDF

Info

Publication number
CN108255720A
CN108255720A CN201810029578.8A CN201810029578A CN108255720A CN 108255720 A CN108255720 A CN 108255720A CN 201810029578 A CN201810029578 A CN 201810029578A CN 108255720 A CN108255720 A CN 108255720A
Authority
CN
China
Prior art keywords
test
server
software
equipment
user
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201810029578.8A
Other languages
Chinese (zh)
Inventor
陆慧娟
严珂
金群
高波涌
叶敏超
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
China Jiliang University
Original Assignee
China Jiliang University
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by China Jiliang University filed Critical China Jiliang University
Priority to CN201810029578.8A priority Critical patent/CN108255720A/en
Publication of CN108255720A publication Critical patent/CN108255720A/en
Pending legal-status Critical Current

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F11/00Error detection; Error correction; Monitoring
    • G06F11/36Preventing errors by testing or debugging software
    • G06F11/3668Software testing
    • G06F11/3672Test management
    • G06F11/3688Test management for test execution, e.g. scheduling of test suites
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F11/00Error detection; Error correction; Monitoring
    • G06F11/36Preventing errors by testing or debugging software
    • G06F11/3668Software testing
    • G06F11/3672Test management
    • G06F11/3684Test management for test design, e.g. generating new test cases
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F11/00Error detection; Error correction; Monitoring
    • G06F11/36Preventing errors by testing or debugging software
    • G06F11/3668Software testing
    • G06F11/3672Test management
    • G06F11/3692Test management for test results analysis

Abstract

The invention discloses a kind of software automatic test system based on cloud computing framework, including:Client, application server, service dispatch system and device server;The service dispatch system includes file server, actuator, device management server and database;A kind of software automatic test system based on cloud computing framework provided by the invention first, will build cloud platform to ensure the reasonable distribution of the storage of data and resource.The realization of cloud platform is equally beneficial for the promotion of the fault-tolerant and efficiency in software test.Secondly as cloud computing is included in, single software test procedure can be uploaded to by internet with result and resource-sharing is carried out in cloud platform storage space.Finally, after the software test path of magnanimity is analyzed, the software developed can automatically analyze out feasible test path, so as to fulfill the purpose of automation software testing.

Description

Software automatic test system based on cloud computing framework
Technical field
The present invention relates to field of computer technology, specifically, more particularly to a kind of software based on cloud computing framework is certainly Dynamic test system.
Background technology
Software test is a kind of audit to reality output and anticipated output or comparison procedure, be ensure software quality, Improve the key of software reliability.With the fast development of science and technology, domestic and international related check testing agency is to newly developed Software quality proposes increasingly higher demands, and the degree of automation of software test is also increasingly paid attention to.Software test not only into For an organic component of software development, and in occupation of sizable proportion in the software systems of exploitation.With the U.S. Software development and production average fund input for, usual ratio is:Demand analysis and planning are determining respectively to account for 3 percent, Design accounts for 5 percent, and programming accounts for 7 percent, and test accounts for 1 15, goes into operation and maintenance accounts for six or seven ten percent.Test Status in software development is self-evident.
In recent years, the appearance of cloud computing technology brings tremendous influence to software organization of production and Software Architecture Design. The appearance of this emerging service pattern of cloud computing changes the production and consumption mode of software product.And the method for software test, Technology and tool are also required to change therewith.Under cloud computing environment, software test procedure can be moved in cloud, and applies cloud meter The resources such as calculating and the storage of platform offer are provided and carry out various test activities.This be a kind of novel software test mode and One whole new set of applications of cloud computing technology.
Existing cloud test system is in the starting stage, although can meet some specialized market's demands, still deposits In many deficiencies, including:
(1) access time is long, and testing efficiency is low to wait the unacceptable problem of users.
(2) test system configurations are complicated, wherein both included complicated test environment configuration, once also relate to portion during operation Divide function or component error, cause to test system outage, test system crash and test interface confusion etc..
(3) problem analysis of the test content with demand when inconsistent shows as actual demand and expected test in test As a result when inconsistent, how to search and the position of Wrong localization and reason.
Invention content
In order to solve problem of the prior art, an embodiment of the present invention provides the software automatic tests based on cloud computing framework System.The technical solution is as follows:
On the one hand, a kind of software automatic test system based on cloud computing framework is provided, including:Client, using clothes Business device, service dispatch system and device server;
The service dispatch system includes file server, actuator, device management server and database;
The client creates, test case creation, equipment connection, the recording of script, script for completing test event Editor, resource/component edits, script perform, operation is checked in report;
The application server receives the behaviour of user using real-time messages agreement or scalable message processing Presence Protocol It asks, and device directive is forwarded to the actuator in the service dispatch system;The actuator is by the device directive It is sent to device management server;
Test module is provided in the device server, the test module is described automatic using the mechanism that automatically configures Configuration mechanism includes test pattern customization, Resources Customization, error handle, isolation and tracking;The test module uses black box certainly Dynamicization measuring technology.
Further, when client be desktop application, then on the basis of having primary customer end function, increase equipment The function of management server, client at this time also become an equipment manager, pass through input/output interface technology of new generation It is attached with device management server, user can come out the collaborative share connected on oneself computer.
Further, the application server uses distributed deployment.
Further, the actuator is used to manage the device directive concentratedly;
The device management server is for centralized management equipment server;
The file server uses distributed file server for preserving user file.
Further, it is connect between the device server, device management server, actuator by input and output of new generation Vocal imitation skill communicates.
Further, the device management server monitors the equipment state that all devices server connects, The state of each device server is sent to Web server end in real time by the actuator, it will by Web server Equipment state informs client in real time;
The device management server by the device directive received be sent on the device server specified and by Device server gives the equipment specified to perform operation by novel mobile equipment debugging mechanics of communication.
Further, it when test pattern customizes, according to the test that the current software under testing needs of user carry out, selects different At the time of test pattern will influence the type, quantity and use of used resource.
Further, the black box automatization testing technique during iterative development using carrying out regression test.
Further, described the step of regression test is carried out during iterative development, specifically includes:
User is recorded per single stepping first;
Secondly, all records are converted into a kind of process of script description, with the operation of analog subscriber;Then it plays back When the described process of script is converted to operation on screen;
Finally, the output record of system under test (SUT) is obtained.
Further, in Black-box Testing, according to feedack in test and the information of test result, into Row mistake positioning and to test result carry out aggregative quantity evaluation.
The advantageous effect that technical solution provided in an embodiment of the present invention is brought is:
A kind of software automatic test system based on cloud computing framework provided by the invention first, will build cloud platform Ensure the storage of data and the reasonable distribution of resource.The realization of cloud platform is equally beneficial for the fault-tolerant and efficiency in software test It is promoted.Secondly as cloud computing is included in, single software test procedure can upload to cloud platform with result by internet Resource-sharing is carried out in storage space.Finally, after the software test path of magnanimity is analyzed, the software developed can be certainly It is dynamic to analyze feasible test path, so as to fulfill the purpose of automation software testing.
Description of the drawings
To describe the technical solutions in the embodiments of the present invention more clearly, make required in being described below to embodiment Attached drawing is briefly described, it should be apparent that, the accompanying drawings in the following description is only some embodiments of the present invention, for For those of ordinary skill in the art, without creative efforts, other are can also be obtained according to these attached drawings Attached drawing.
Fig. 1 is the schematic diagram of the software automatic test system based on cloud computing framework in the embodiment of the present invention;
Fig. 2 is the software automatic test system hierarchical chart based on cloud computing framework in the embodiment of the present invention;
Fig. 3 is the flow chart of medium cloud test Solution of the embodiment of the present invention;
Fig. 4 is the flow chart of medium cloud testing service flow profiling of the embodiment of the present invention.
Specific embodiment
To make the object, technical solutions and advantages of the present invention clearer, below in conjunction with attached drawing to embodiment party of the present invention Formula is described in further detail.
The present invention provides a kind of software automatic test system based on cloud computing framework, referring to Fig. 1, including:Client, Application server, service dispatch system and device server;
The service dispatch system includes file server, actuator, device management server and database;
The client creates, test case creation, equipment connection, the recording of script, script for completing test event The operations such as editor, resource/component edits, script perform, report is checked;
The application server receives the behaviour of user using real-time messages agreement or scalable message processing Presence Protocol It asks, and device directive is forwarded to the actuator in the service dispatch system;The actuator is by the device directive It is sent to device management server;
Test module is provided in the device server, the test module is described automatic using the mechanism that automatically configures Configuration mechanism includes test pattern customization, Resources Customization, error handle, isolation and tracking;The test module uses black box certainly Dynamicization measuring technology.
Specifically, client (webpage) is the operation interface of user, completes test event on the surface and creates, test is used Example (script) establishments, the recording of script, scripting editing, resource/component edits, script execution, is reported and the behaviour such as checks equipment connection Make.If user installation is Fat Client (desktop application), on the basis of having primary customer end function, increases and set The function of standby management server, client at this time also become an equipment manager, pass through input/output interface skill of new generation Art is attached with device management server, and user can come out the collaborative share connected on oneself computer.
Web server (Apache, Squid) receives client and the request at interface is operated, such as webpage, picture.
Using RTMP, (Real Time Messaging Protocol's application server (Red5, Openfire) disappear in real time Cease agreement) or XMPP (Extensible Messaging and Presence Protocol scalable messages processing scenes Agreement) receive user's operation request and device directive is transmitted to actuator, actuator sends an instruction to equipment management service Device.Application server can be with distributed deployment, to carry the concurrency of bigger.
Actuator is the centralized management part of all instructions, and such as the project that user creates, test case data needs to issue Device directive, the equipment that is being lined up uses request etc..
Device management server is the centralized management to equipment, the equipment of all devices server connection all concentrate herein into Row management.
File server is to preserve user file (script file, document scene, resource file, the application program uploaded Deng).Using distributed file server Windows DFS, FastDFS or HDFS (Hadoop Distributed File System)。
Device management server is to monitor the equipment state that all devices server connects first, by each equipment State be sent to Web server end in real time by actuator, equipment state is informed into client in real time by Web server. Secondly, the instruction received is sent on the device server specified and is passed through by device server new by device management server The mobile equipment debugging mechanics of communication of type gives the equipment specified to perform operation.Device server, device management server, actuator Between communicated by input/output interface technology of new generation.
Modules can carry out distributed deployment, while role can also mutually convert, to improve the covering model of cloud It encloses, theoretically, all client computer devices can convert the device server in framework thus, that is to say, that User in cloud community can come out the collaborative share of oneself, and be connected on the computer of oneself, then the users to share Mobile equipment just becomes an equipment in test cloud, and the user in other clouds is it is seen that the equipment, and on the device It carries out the automatic test of oneself needs and obtains test report.
In the present embodiment, referring to Fig. 2, the software automatic test system based on cloud computing structure is divided into IaaS, PaaS, SaaS With tetra- layers of TaaS;
(1)IaaS(Infrastructure as a Service):It is calculating, storage, network and build test wrapper Some tools needed for border are supplied to user as service, allow users to obtain IT infrastructure on demand.Pass through this core group Part is by the computing resource of hardware, Internet resources and memory resource pool.
(2)PaaS(Platform as a Service):Using the exploitation, test and deployed environment of test software as clothes Business, is supplied to user based on internet, provides database, operating system, test development environment etc. to the user.
(3)SaaS(Software as a Service):User does not grasp operating system, hardware or cloud computing and puts down The network infrastructure of platform, only using only application program.It is that a kind of software service providers are supplied to user in a manner of leasing The concept of service, this pattern usually have customizable, configurable, multi-tenant efficiency and expansible characteristic, often by The form of account number cipher or certificate is supplied to user.By taking cloud tests website Sauce Labs as an example, http:// As portal, user can be tested www.saucelabs.com by uploading test script.Registered user, by purchasing on demand Resource is bought, by assigned user class, and user class determines the resources of virtual machine and testing time that user can be assigned to.
(4) TaaS (Testing as a servie) tests service:It is that a kind of internet that is based on provides software test clothes The application model of business, user can use various testing services online, such as test Automated Design, automated function test, testing tube Reason etc..The function distributing of management to test event and test script pretreatment in the application server, application server For the demand of response test person.The corresponding priority and dependence for obtaining test script of analysis and pretreatment to test script Etc. information, convert local standard compliant test script so that it can perform test in cloud.
(5) cloud security management:User is helped to ensure to include identity combination certification, record management, user management, web access The safety of cloud service of management and configuration etc., global visual angle is provided for administrative staff, it is ensured that the uninterrupted operation security of customer service, And provide the cloud internal and external environment of reliable safety.
(6) cloud service management:The platform of operation cloud testing service from service request, monitoring management to service, it can be achieved that tie All activities of beam are the management of an automation.
Further, when client be desktop application, then on the basis of having primary customer end function, increase equipment The function of management server, client at this time also become an equipment manager, pass through input/output interface technology of new generation It is attached with device management server, user can come out the collaborative share connected on oneself computer.
Further, the application server uses distributed deployment.
Further, the actuator is used to manage the device directive concentratedly;
The device management server is for centralized management equipment server;
The file server uses distributed file server for preserving user file.
Further, it is connect between the device server, device management server, actuator by input and output of new generation Vocal imitation skill communicates.
Further, the device management server monitors the equipment state that all devices server connects, The state of each device server is sent to Web server end in real time by the actuator, it will by Web server Equipment state informs client in real time;
The device management server by the device directive received be sent on the device server specified and by Device server gives the equipment specified to perform operation by novel mobile equipment debugging mechanics of communication.
Further, the function that automatically configures in cloud test platform includes test pattern customization, Resources Customization, at mistake Reason, isolation and tracking etc..
When test pattern customizes, according to the test that the current software under testing needs of user carry out, different test patterns is selected Used in will influencing at the time of the type of resource, quantity and use.For example, if unit testing, then system needs Resource carry load the function module of tape test and its required resource of test module, and system testing then needs to expend more More resources.After test pattern configuration, according to the environmental requirement under the test pattern, system running environment configuration is carried out, The combination and configuration of test cases, configuration of software under testing etc., and the corresponding calculating of distribution and storage resource beyond the clouds, so as to complete Into the customization of resource.The processing of mistake and the configuration of test pattern and test cases are closely related.This project is tested in processing When mistake, intend the resource requirement according to module and importance, different weights is assigned to module, then according to the ratio of weight Whether rate decision module can be reassembled as the module of a bigger.The processing of mistake is carried out in module level, is conducive to be properly positioned The position of mistake.When division module, according to concurrency, alternative, importance between module etc., which mistake determined Must stop testing, and handled during appearance, can ignore when which mistake occurs, when which mistake occurs can temporarily every From, and other tests are carried out, so as to efficiently use cloud test resource, improve the flexibility of test, accelerated test progress.
Cloud computing technology possesses the parallel computation of high speed and the advantage of mass storage.Software test code and configuration data are made For one kind of big data, high in the clouds will be uploaded to and stored and shared.Particularly cross-system platform is shared, can will be various Terminal links together, and there is stronger durability can simultaneously effectively reduce cost.
Further, the black box automatization testing technique in the application is returned using during iterative development Test, so as to greatly reduce the workload of Black-box Testing.Its specific steps can be divided into the following steps:We can will use first It is all recorded per single stepping at family;Secondly, all records are converted into a kind of process of script description, with analog subscriber Operation;Script described process is converted to the operation on screen when then playing back;Finally, system under test (SUT) is obtained Output record.
After test result generation, test result is compared and evaluated with expected results.In different test moulds Under formula, the evaluation of test result has the characteristics that different.Such as when unit testing, it is preferred that emphasis is just whether to-be-measured cell Function needed for really completing, correctness and fault-tolerant ability for being exported under different input conditions etc.;And when performance test, Whether the performance for focusing on system offer of test meets in many aspects such as maximum throughput, number of users, connection numbers prominent Requirement on hair and maximum performance.This project intends the difference according to test pattern, sets the scoring mark of module or system to be measured Standard, after testing is complete, according to the TOP SCORES of system and distribution of grading, whether evaluation system meets wanting for design The reason of asking and failing to meet design requirement, so as to provide support for further improvement.
Occur partially or wholly failure during the test, cause some or all different by occurring in test Chang Shi, this project is intended carrying out data analysis according to the mass data stored in cloud platform, using self-adapted genetic algorithm, fault tree The methods of positioning failure the reason of, for design and developer solve the problems, such as, so as to continue test job.
The key technology of the software automatic test system based on cloud computing framework in the application is as follows:
(1) distribution, deployment, the scheduling of virtual test node
Cloud test platform can build test environment automatically, and primary work is distribution virtual test node.According to test need Ask quantity, configuration of the empty machine of application etc.;Then according to environment configurations template automatic distributing deployment operation system, software systems and Test system etc., to complete building for test environment;In addition cloud test platform can be according to virtual test node during the test State and resource Expenditure Levels, dynamic dispatching void machine operation, stop and redistribute, so as to reach test need It will.
(2) test case deployment, scheduling, collection
Before test implementation, it is necessary first to formulate test concrete scheme, be concentrated mainly on deployment scheduling strategy, i.e., which is virtual Which script test node performs, collects and surveyed on which information, the execution sequence of each test node and same test node Sequencing that example on probation performs etc.;Then test script deployment, scheduling are carried out according to deployment scheduling strategy;Finally perform survey Examination, the result information for collecting needs are analyzed.Certainly this is different from the deployment scheduling of virtual test node, but there is also Certain association, such as when the failure of virtual test node or inadequate resource, cloud test platform can Dynamical Deployment, schedule virtual Test node may relate to the stopping of certain test nodes, redistribute, at this moment deployment, scheduling and the result of test case Collection be also required to carry out corresponding dynamic and adjust.
(3) cross-platform data is shared
The process and result of software test each time will be all passed to by internet in the storage space of cloud platform.Work as phase When needing test like software, software testing system will automatically analyze feasible test path and expected results and automate soft Part is tested.Since such data sharing is based on technique of internet, the software development of cross-system platform just seems particularly heavy It will.
This project will connect different soft ware platforms based on cloud computing technology, carry out integrated management. During software test, if test software is cross-system platform software, corresponding software testing system also exists test The operational effect of the software under each system platform, and carry out comprehensive assessment.Current multisystem platform (Windows, Linux, Android, iOS etc.) together under winged background, meaning that the software test of cross-system platform has its special.
The software automatic test system based on cloud computing framework in the application has the beneficial effect that:
(1) rounded system structure
The cloud computing theory of mainstream is combined by this project with the actual demand of software test.Propose cloud test platform Architecture, including client part, application server, service dispatch system and device server etc..Testing service by Client part is submitted, and by service dispatch system configuration and distributes corresponding test resource, and test control is sent out to device server Message processed, and collect test result and return to service dispatch system, so as to complete testing service.The architecture has resource sequentially Distribution, customization flexibly, high degree of automation, the features such as scalability is strong, fault freedom is strong, be test architecture based on cloud One innovation of aspect.
(2) sound test module configuration
In the configuration of automatic test, under different test patterns, by different test modules according to computing resource, net The demand of network resource, storage resource etc. and the difference of importance set weight, so as to whether determine complementary module Can combine and intermodule it is parallel, can isolated relation, reasonably carry out test module arrangement, be testing scheme it is flexible, Healthy and strong, reusable lays the foundation, and is an innovation in terms of testing scheme configuration.
(3) the test result evaluation of system
In Black-box Testing, according to feedack in test and the information of test result, determining for mistake is carried out Position and aggregative quantity evaluation is carried out to test result, be test result processing so as to scientifically and rationally evaluating and testing test result One innovation of aspect.
(4) cross-platform method for testing software
In today of multisystem platform joint development, more and more software developments are required cross-platform operation.Correspondingly, Method for testing software is also required to the requirement that can reach cross-platform test.At present the method for testing software of mainstream do not refer to across The concept of platform test, the multi-platform software test method that this project proposes can also be seen as a kind of innovation.
In the present embodiment, software test with cloud computing technology is combined, is to solve traditional software test process In the building of the installation of such as system that encounters and environment, the installation of testing tool and configuration and the study of testing tool and make With etc. variety of problems.Interaction platform is tested by analyzing and designing cloud, management cloud infrastructure resource that can be unified provides firmly The support of part by friendly Web interactive interfaces and is the service interface that testing service provides, and can be realized a kind of efficient The test process of rate, low complex degree.Interaction platform can be tested by cloud to realize a kind of cloud testing service.User is tested to submit After test request, cloud test platform scheduling virtual machine is simultaneously tested on a virtual machine, and test result is fed back after the completion of test To user.
In order to solve the problems, such as that traditional software is tested, the scheme of the system is provided, first, in traditional test frame The problem of static resource efficiency of management is low improves the utilization ratio of resource with reference to virtualization technology.With the substantially single of virtualization Test platform based on first virtual instance VM (Virtual Machine) carries out the hardware resource on server abundant Utilization.Then, for test assignment execution efficiency it is low the problem of, used using independent test in test assignment is concurrently performed Example, the resource of dispersion is integrated, this relates to distributed calculating.Meanwhile provide the interactive survey based on Web service Interface is tried, bringing more easily test to tester experiences.
One synthesis of these solutions is exactly a test cloud, and the equilibrium of resource is provided by a test cloud One easy-to-use test platform of optimization and offer.Fig. 3 is cloud test Solution.
Interaction platform is tested by cloud and provides cloud testing service for test user, the web interface that platform provides close friend can be with Easily receive the test request of user, so solicited message is stored for virtual machine test call, later according to The request scale at family carries out the configuration and scheduling of virtual machine by interaction platform, is then just tested beyond the clouds, and test is completed Test result is collected afterwards and generates corresponding report and feeds back to user, sees Fig. 4.
(1) receive user test request
First, the testing service needed is selected.User can select and subscribe required test according to the demand of oneself Service.Two kinds of involved testing tools before such as, such as pressure test is carried out to website using AB (ApacheBench), It then needs to submit the relevant parameters such as the request number of test, the request number once generated, number of concurrent, testing time. System can be accordingly configured according to the request scale parameter of user later, selection such as the quantity, operating system of virtual machine, CPU configurations of virtual machine etc.;It is the conceivable result parameter of user, such as number of transactions per second, the average transaction corresponding time, average per second The parameters such as the flow on network.Secondly, test target is set.User needs to set test target, and such as website is carried out The performance test of pressure will then set corresponding target URL;To carry out relevant functional test, may be related to corresponding Test script will then upload corresponding software test script as needed.
(2) request data storage and analysis
Server needs the testing service demand information uploaded to user and corresponding test target information to carry out data and deposit Storage.Database is directly possibly stored to for some users request, virtual generator terminal test case AGENT is waited for call later;And The test script information uploaded to user also needs to carry out relevant analysis, and storing or be converted into dependence test tool can recognize With matched test script, the software test after being is ready.
(3) configuration and scheduling virtual machine
First, virtual machine is taken to be configured from resources of virtual machine pond.Resources of virtual machine pond, it can be with logical abstraction Mode neatly manages resource.Virtual machine pool pattern is a kind of basic cloud computing architecture mode, and this pattern provides one Kind can quickly supply the mechanism of required virtual machine, and this mechanism is by resources of virtual machine pond is safeguarded, to manage the whole of virtual machine A life cycle.
Secondly, the Web service interface of cloud operating system is called to carry out stand-alone configuration, starts virtual machine instance.
Again, virtual machine AGENT obtains test data from server by API, reports final state to server, goes forward side by side Enter armed state.AGENT is the software with franchise (administrator right) operated on VME operating system, passes through API Test data is passed to AGENT, test command is performed by AGENT in virtual generator terminal.
AGENT is deployed in operation system image by the system preparation stage in virtual instance, when virtual machine instance starts Afterwards, AGENT can receive test command in the case where cloud tests the control of interaction platform and perform test assignment, and be able to carry out ordering Enable the management configuration and environment configurations completed to virtual machine.
Then, startup of server institute virtual machine in need, after obtaining last consistent virtual machine confirmation message, publication is most The whole testing time.After server starts required virtual machine, virtual machine just enters test armed state, most Whole server will obtain the consistent confirmation message of awaiting orders of virtual machine, then according to the operation conditions of virtual machine and the demand of test Condition, server can issue the exact testing time to virtual machine instance.
(4) cloud is tested and collects result generation report
First, AGENT obtains timeline, sets the test starting time.AGENT passes through the interface with cloud test interaction platform The final test timeline of server publication is obtained, then AGENT sets the corresponding test starting time according to timeline.
Secondly, AGENT at the appointed time starts to be tested by being pre-configured with.AGENT is set virtually according to timeline The corresponding test starting time of example, such AGENT can at the appointed time start thread according to test configurations, test request Corresponding test request is tested.
Again, AGENT monitors test process and finally collects result and report server.AGENT can during the test To be monitored to test process, last test result is just collected by AGENT by testing requirement after the completion of test And report to server, after server receives the test result that AGENT is sent, and then corresponding test result is analyzed And statistics.
Then, server is counted, and generates result form and chart.The test result number that server reports AGENT According to being summarized and being counted, report or chart are ultimately generated according to the relevant parameter of the requirement of test, test result, is most surveyed at last Test result is presented to the user.
Specifically, AGENT is the software with franchise (administrator right) operated on VME operating system.
The apparatus embodiments described above are merely exemplary, wherein can be as the unit that separating component illustrates Or may not be physically separate, the component shown as unit may or may not be physical unit, i.e., A place can be located at or can also be distributed in multiple network element.It can select according to the actual needs therein Some or all of module realizes the purpose of this embodiment scheme.Those of ordinary skill in the art are not paying creative labor In the case of dynamic, you can to understand and implement.
The foregoing is merely a prefered embodiment of the invention, is not intended to limit the invention, all in the spirit and principles in the present invention Within, any modification, equivalent replacement, improvement and so on should all be included in the protection scope of the present invention.

Claims (10)

1. a kind of software automatic test system based on cloud computing framework, which is characterized in that including:Client, application server, Service dispatch system and device server;
The service dispatch system includes file server, actuator, device management server and database;
The client creates for completing test event, and test case creation, equipment connection, the recording of script, script are compiled It collects, resource/component edits, script perform, operation is checked in report;
The operation that the application server receives user using real-time messages agreement or scalable message processing Presence Protocol please It asks, and device directive is forwarded to the actuator in the service dispatch system;The actuator sends the device directive To device management server;
Test module is provided in the device server, the test module uses and automatically configures mechanism, described to automatically configure Mechanism includes test pattern customization, Resources Customization, error handle, isolation and tracking;The test module is automated using black box Measuring technology.
2. the system as claimed in claim 1, which is characterized in that when client be desktop application, then having primary customer end On the basis of function, the function of device management server is increased, client at this time also becomes an equipment manager, passes through Input/output interface technology of new generation is attached with device management server, the equipment that user can will connect on oneself computer It shares out.
3. system as claimed in claim 2, which is characterized in that the application server uses distributed deployment.
4. system as claimed in claim 3, which is characterized in that the actuator is used to manage the device directive concentratedly;
The device management server is for centralized management equipment server;
The file server uses distributed file server for preserving user file.
5. system as claimed in claim 4, which is characterized in that the device server, device management server, actuator it Between communicated by input/output interface technology of new generation.
6. system as claimed in claim 5, which is characterized in that the device management server connects all devices server The equipment state connect is monitored, and the state of each device server is sent to Web in real time by the actuator Equipment state is informed client by server end in real time by Web server;
The device directive received is sent on the device server specified and by equipment by the device management server Server gives the equipment specified to perform operation by novel mobile equipment debugging mechanics of communication.
7. system as claimed in claim 6, which is characterized in that when test pattern customizes, according to the current software under testing need of user The test to be carried out, at the time of selecting different test patterns that will influence the type, quantity and use of used resource.
8. system as claimed in claim 7, which is characterized in that the black box automatization testing technique is opened using in iteration Regression test is carried out during hair.
9. system as claimed in claim 8, which is characterized in that described the step of regression test is carried out during iterative development It specifically includes:
User is recorded per single stepping first;
Secondly, all records are converted into a kind of process of script description, with the operation of analog subscriber;It will when then playing back The described process of script is converted to the operation on screen;
Finally, the output record of system under test (SUT) is obtained.
10. system as claimed in claim 9, which is characterized in that in Black-box Testing, according to the letter fed back in test The information of breath and test result carries out the positioning of mistake and carries out aggregative quantity evaluation to test result.
CN201810029578.8A 2018-01-12 2018-01-12 Software automatic test system based on cloud computing framework Pending CN108255720A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201810029578.8A CN108255720A (en) 2018-01-12 2018-01-12 Software automatic test system based on cloud computing framework

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201810029578.8A CN108255720A (en) 2018-01-12 2018-01-12 Software automatic test system based on cloud computing framework

Publications (1)

Publication Number Publication Date
CN108255720A true CN108255720A (en) 2018-07-06

Family

ID=62727129

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201810029578.8A Pending CN108255720A (en) 2018-01-12 2018-01-12 Software automatic test system based on cloud computing framework

Country Status (1)

Country Link
CN (1) CN108255720A (en)

Cited By (16)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110188034A (en) * 2019-05-10 2019-08-30 广州高鸿信息科技有限公司 A kind of method for testing software based on information sharing
CN110412389A (en) * 2019-08-23 2019-11-05 中国南方电网有限责任公司超高压输电公司南宁局 String mends protective device and the string based on cloud computing mends protection test macro
CN110413525A (en) * 2019-07-29 2019-11-05 国网新疆电力有限公司电力科学研究院 Safety detecting method and device
CN110471719A (en) * 2019-08-16 2019-11-19 北京明略软件系统有限公司 Operation method and device, storage medium, the electronic device of script file
CN110708210A (en) * 2019-08-30 2020-01-17 深圳壹账通智能科技有限公司 Cloud test configuration method and device, computer equipment and storage medium
CN111159003A (en) * 2018-11-07 2020-05-15 马上消费金融股份有限公司 Batch processing test method and device
CN111290937A (en) * 2018-12-08 2020-06-16 南京慕测信息科技有限公司 Extensible mobile application automatic test platform based on hybrid cloud
CN111338930A (en) * 2019-12-19 2020-06-26 烽火通信科技股份有限公司 Automatic test system and method based on multiple processes and multiple tenants
CN111581158A (en) * 2020-05-04 2020-08-25 上海维信荟智金融科技有限公司 Distributed file storage method and system
CN111651357A (en) * 2020-06-03 2020-09-11 厦门力含信息技术服务有限公司 Software automation testing method based on cloud computing
CN111767225A (en) * 2020-06-29 2020-10-13 厦门力含信息技术服务有限公司 Third-party software testing system and method in cloud computing environment
CN111800310A (en) * 2020-06-17 2020-10-20 北京智网信测科技有限公司 Scheduling algorithm for task management module of Internet of things testing cloud platform
CN112379864A (en) * 2020-10-26 2021-02-19 合科软件(北京)有限责任公司 Software system
CN114143222A (en) * 2021-12-07 2022-03-04 无锡物联网产业研究院 Internet of things key equipment cloud testing method for typical application of smart city
CN115150298A (en) * 2021-03-31 2022-10-04 北京金山云网络技术有限公司 Virtual gateway testing method and device, storage medium and electronic equipment
CN116450400A (en) * 2023-06-19 2023-07-18 北京翼辉信息技术有限公司 Application program abnormality analysis method and device, electronic equipment and storage medium

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20150186252A1 (en) * 2013-12-31 2015-07-02 International Business Machines Corporation Testing of transaction tracking software
CN105302718A (en) * 2015-10-26 2016-02-03 浪潮电子信息产业股份有限公司 Reusable software-oriented test model design method
CN105607998A (en) * 2015-12-11 2016-05-25 成都新兴信息技术研究所 System and method for performing embedded software debug online
CN106649085A (en) * 2016-09-23 2017-05-10 郑州云海信息技术有限公司 Cloud computing-based software test system

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20150186252A1 (en) * 2013-12-31 2015-07-02 International Business Machines Corporation Testing of transaction tracking software
CN105302718A (en) * 2015-10-26 2016-02-03 浪潮电子信息产业股份有限公司 Reusable software-oriented test model design method
CN105607998A (en) * 2015-12-11 2016-05-25 成都新兴信息技术研究所 System and method for performing embedded software debug online
CN106649085A (en) * 2016-09-23 2017-05-10 郑州云海信息技术有限公司 Cloud computing-based software test system

Cited By (23)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111159003B (en) * 2018-11-07 2021-03-16 马上消费金融股份有限公司 Batch processing test method and device
CN111159003A (en) * 2018-11-07 2020-05-15 马上消费金融股份有限公司 Batch processing test method and device
CN111290937A (en) * 2018-12-08 2020-06-16 南京慕测信息科技有限公司 Extensible mobile application automatic test platform based on hybrid cloud
CN111290937B (en) * 2018-12-08 2024-01-30 深圳慕智科技有限公司 Extensible mobile application automation test platform based on hybrid cloud
CN110188034A (en) * 2019-05-10 2019-08-30 广州高鸿信息科技有限公司 A kind of method for testing software based on information sharing
CN110413525A (en) * 2019-07-29 2019-11-05 国网新疆电力有限公司电力科学研究院 Safety detecting method and device
CN110471719A (en) * 2019-08-16 2019-11-19 北京明略软件系统有限公司 Operation method and device, storage medium, the electronic device of script file
CN110412389A (en) * 2019-08-23 2019-11-05 中国南方电网有限责任公司超高压输电公司南宁局 String mends protective device and the string based on cloud computing mends protection test macro
CN110708210A (en) * 2019-08-30 2020-01-17 深圳壹账通智能科技有限公司 Cloud test configuration method and device, computer equipment and storage medium
CN110708210B (en) * 2019-08-30 2022-05-03 深圳壹账通智能科技有限公司 Cloud test configuration method and device, computer equipment and storage medium
CN111338930A (en) * 2019-12-19 2020-06-26 烽火通信科技股份有限公司 Automatic test system and method based on multiple processes and multiple tenants
CN111581158A (en) * 2020-05-04 2020-08-25 上海维信荟智金融科技有限公司 Distributed file storage method and system
CN111651357A (en) * 2020-06-03 2020-09-11 厦门力含信息技术服务有限公司 Software automation testing method based on cloud computing
CN111651357B (en) * 2020-06-03 2023-04-07 厦门力含信息技术服务有限公司 Software automation testing method based on cloud computing
CN111800310B (en) * 2020-06-17 2021-11-26 北京智网信测科技有限公司 Scheduling method for task management module of Internet of things test cloud platform
CN111800310A (en) * 2020-06-17 2020-10-20 北京智网信测科技有限公司 Scheduling algorithm for task management module of Internet of things testing cloud platform
CN111767225B (en) * 2020-06-29 2021-05-07 厦门力含信息技术服务有限公司 Third-party software testing system and method in cloud computing environment
CN111767225A (en) * 2020-06-29 2020-10-13 厦门力含信息技术服务有限公司 Third-party software testing system and method in cloud computing environment
CN112379864A (en) * 2020-10-26 2021-02-19 合科软件(北京)有限责任公司 Software system
CN115150298A (en) * 2021-03-31 2022-10-04 北京金山云网络技术有限公司 Virtual gateway testing method and device, storage medium and electronic equipment
CN115150298B (en) * 2021-03-31 2023-11-03 北京金山云网络技术有限公司 Virtual gateway testing method and device, storage medium and electronic equipment
CN114143222A (en) * 2021-12-07 2022-03-04 无锡物联网产业研究院 Internet of things key equipment cloud testing method for typical application of smart city
CN116450400A (en) * 2023-06-19 2023-07-18 北京翼辉信息技术有限公司 Application program abnormality analysis method and device, electronic equipment and storage medium

Similar Documents

Publication Publication Date Title
CN108255720A (en) Software automatic test system based on cloud computing framework
CN101946258B (en) Model based deployment of computer based business process on dedicated hardware
EP2026212B1 (en) Automatic test generation for reference testing
CN105359102B (en) Advanced customer support service-advanced support cloud portal
CN105027108B (en) Example host is configured
CN110221962A (en) A kind of centralization software testing management system and method
US20190065351A1 (en) System and method for providing a test manager for use with a mainframe rehosting platform
CN105308577B (en) For providing the method, system and computer-readable memory of load testing service
CN110162471A (en) A kind of method for testing pressure and system based on container cloud
US7827273B2 (en) Machine cluster topology representation for automated testing
CN106844198A (en) Distributed dispatching automation test platform and method
CN105487977A (en) Agility-oriented automatic test management system and method
WO2009082381A1 (en) Incorporating development tools in system for deploying computer based process on shared infrastructure
CN106484623A (en) A kind of method of software test, apparatus and system
CN116466959A (en) Deployment method and device of micro-service system, readable storage medium and electronic equipment
CA2775162C (en) Test data supply chain manager for an integrated testing platform
CN109977012A (en) Joint debugging test method, device, equipment and the computer readable storage medium of system
Lei et al. Performance and scalability testing strategy based on kubemark
Gaisbauer et al. Vats: Virtualized-aware automated test service
Codispoti et al. CRAB: a CMS application for distributed analysis
Lu et al. CF4BDA: A conceptual framework for big data analytics applications in the cloud
Denaro et al. Performance testing of distributed component architectures
Heilig et al. Building clouds: An integrative approach for an automated deployment of elastic cloud services
Yu et al. Qos-based scheduling of workflows on global grids
CN109995617A (en) Automated testing method, device, equipment and the storage medium of Host Administration characteristic

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
RJ01 Rejection of invention patent application after publication

Application publication date: 20180706

RJ01 Rejection of invention patent application after publication