CN101140541A - Integration test system of distributed software system and method thereof - Google Patents
Integration test system of distributed software system and method thereof Download PDFInfo
- Publication number
- CN101140541A CN101140541A CNA2007101237705A CN200710123770A CN101140541A CN 101140541 A CN101140541 A CN 101140541A CN A2007101237705 A CNA2007101237705 A CN A2007101237705A CN 200710123770 A CN200710123770 A CN 200710123770A CN 101140541 A CN101140541 A CN 101140541A
- Authority
- CN
- China
- Prior art keywords
- test
- module
- client
- sut
- detecting information
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Images
Abstract
The invention discloses an integrated test system and a relevant method for distributed software systems. The system comprises a test server, at least one test client end and at least one test agent; the test server is respectively connected with the test client end and the test agent, in order to fulfill test on external systems under test according to test information; meanwhile, feed the test results back to the test client end; the test client end is used to receive and transmit test information, control the test server to perform tests, and receive test results; the test agent is also linked to a system under test through an interface for the system under test, in order to monitor message that are received and transmitted through the interface; meanwhile, the test agent is respectively interactive and adaptive with the test server and the system under test, and receives and transmits test message as well as relevant response message. Therefore, the invention adapts to test the second generation of distributed software systems that are fulfilled with distributed computation technology, increases and improves test tool expansibility and integrated test efficiency, and makes for execution of all types of integrated tests and guarantees quality of software products.
Description
Technical field
The present invention relates to the software test field, in particular, the integration testing to the distributed software system of second generation distributed computing technology provides a kind of new integrated test system and method.
Background technology
Distributed computing technology (DC, Distributed Computing) from producing till now, three developing stage are roughly arranged: the 1) first generation (in the eighties～nineties): mainly be to have proposed classical C/S computation model, utilize traditional calculating notion and design to solve the problem of information sharing; 2) second generation (nineties so far): mainly be that traditional two-layer C/S computation model is improved to OO multi-layer C/S computation model, distributed objects computing technique (the DOC of Object-oriented Technique has been merged in utilization, Distributed Object Computing) solves the interoperability problem under the isomerous environment, and become the core technology of soft component development.3) third generation (after 2000): proposed autonomous multi-Agent computation model, utilize the personalize interactive environment of intelligent agent technology structure towards Agent, mainly be in order to solve intelligentized collaborative work problem, third generation method also is in the Proof of Concept stage at present, is not used widely as yet.
The distributed software system that employing first generation distributed computing technology is realized as shown in Figure 1, method of testing commonly used is to allow among testing tool is bridged to the client and the communication of server is connected, the docking port message monitors or simulates, and tests at this subsystem level interface between client and the server.The client directly links to each other by the network application DLL (dynamic link library) with server, and client and server need be paid close attention to the details of network communication; The client has comprised a large amount of service logics, and it realizes also seriously depending on data in server storage and organizational form; The service that server provides is based on process, and all services all are integrated in the middle of the process.Each module coupling of composition system is very tight, can't be with the operation of detached process, and interface each other also lacks standardization.Therefore, the measurability of this type systematic is poor, and the means of integration testing are also very limited.
The distributed software system that adopts second generation distributed computing technology to realize: the communication of client and server adopts middleware to realize; Total system can be made up of service processes and client process any amount, that can independently carry out, and these processes can be distributed on the different computing machines.In OO multi-layer C/S computation model, not only can be accessed by the remote object (RO, Remote Object) of server establishment and maintenance, and may be as the client of other objects.From the description of These characteristics as can be seen, the complexity of second-generation system has increased many, the integration test method that first generation system adopts can't satisfy second-generation system, such as: the communication details of second-generation system has been encapsulated by middleware, and testing tool is difficult to insert system under test (SUT) with bridge joint communication ways of connecting; The complexity of second-generation system is bigger, and interface to be measured also is not only a subsystem level, also comprise object, module grade other.The test environment of second-generation system is complicated more, such as the multi-user concurrent visit etc.
Second-generation system has following superiority in integration testing.
1) sharpness of border: concept structure, management with object are distributed in the various resources on the network, and each remote object has all defined access interface clearly.Providing and visiting of any service is based on interface.It is exactly the various interface of system under test (SUT) that integration testing is paid close attention to, comprising the interface between the remote object, interface between the functional module and the interface between the subsystem.
2) service is autonomous: form each remote object of system or functional module can distribute deployment, isolated operation, this not only helps balanced loaded distribution, also helps reducing the coupling of system.The autonomous characteristics of service are very beneficial for developing, disposing integration testing required test driving and detective pole.
3) flexible configuration: decide system to form and relation between objects by configuration, promptly pass through the characteristic of collocation strategy customize services by which object.The characteristics of flexible configuration facilitate for the integration testing (top-down system, bottom-up mode, mixing propagation mode) of implementing the propagation formula.
4) platform independence: stride isomerous environment (different type of machines, different operating system, different network protocol) operation, attributes such as the geographic position of remote object, system platform, programming language all are transparent to the client.The characteristics of platform independence realize providing bigger degree of freedom for the technology of integrated test tools.
At present, there is the technical standard of several main flows in second generation distributed computing technology field: Object Management Group (OMG, Object Management Group) Common Object Request Broker Architecture (CORBA, Common Object Request Broker Architecture), The Component Object Model/distributed component object model (COM/DCOM of Microsoft company, Component ObjectModel/Distributed COM) standard, Java remote method invocation (RMI) (the Java RMI of Sun Microsystems, Java Remote Method Invocation) and Java enterprise handle (EJB, Enterprise JavaBeans) technology.These several persons are closely similar on the realization principle, and development trend also is to realize appearance intercommunication mutually between the distributed software system that adopts different technologies to realize.The principle of work of second-generation system specifies as follows as shown in Figure 2.
1) before externally providing service, remote object needs externally logical name of issue, and the existence of quoting of this logical name and remote object concerns one to one.The client gets access to quoting of remote object by the logical name of remote object, and promptly remote object is at the counterfoil (Stub) of client's side.
2) Stub has the interface identical with remote object, and the client is according to the interface of the interface interchange Stub correspondence of remote object.
3) Stub is being become the packet of specific format by information package such as the title of transfer mouth and request messages, and the architecture of giving client's side sends to server by network.Architecture has promptly realized the middleware of CORBA, COM/DCOM, JMI (Java Metadata Interface, Java metadata interface)/technical standards such as EJB, for example, and Object Request Broker (ORB, Object RequestBroker)
4) architecture of server side can be distributed to the framework (Skeleton) of remote object at server side after receiving packet, Skeleton will solve by information such as the title of transfer mouth and request messages from packet, then with the interface that calls the remote object correspondence.
5) if remote object has response message after executing solicit operation, it can pass to Skeleton with response message.
6) Skeleton will be packaged into response message the packet of specific format, and the architecture of giving server side then sends to the client by network.
7) architecture of client's side can be distributed to Stub after receiving packet, and Stub will solve information such as response message from packet, passes to the client then.
But prior art lacks the integrated test tools and the method for the distributed software system of realizing for second generation distributed computing technology, and therefore, there is defective in prior art, needs to improve.
Summary of the invention
The object of the present invention is to provide a kind of integrated test system and method for distributed software system, be used to test the distributed software system that second generation distributed computing technology is realized, thereby improve the efficient of integration testing, guarantee the quality of software product.
Technical scheme of the present invention is as follows:
A kind of integrated test system of distributed software system wherein, comprises testing server, at least one test client and at least one test agent person; Described testing server is connected with described test client, described test agent person respectively, is used for according to detecting information the system under test (SUT) of outside being tested, and test result is fed back to described test client; Wherein, described detecting information comprise at least steering order, test request, test connection, test packet, test script, test case one of them; Described test client is used to receive and dispatch described detecting information, controls described testing server and tests, and receive described test result; Described test agent person also is connected with described system under test (SUT) by the interface of described system under test (SUT), be used to monitor transmitting-receiving message by described interface, mutual with described testing server, described system under test (SUT) respectively, adaptive and receive and dispatch described test packet and response message thereof.
Described integrated test system, wherein, described test client comprise client receiver module, the sending module that is used to send described detecting information, the execution module that is used to carry out test, the monitoring module that is used for the control and measuring process that are used to receive described detecting information at least, the analysis module that is used for the analysis and evaluation test result one of them.
Described integrated test system, wherein, described testing server comprise server receiver module, the control module that is used to control described test, the forwarding module that is used to send described test packet and described test result, the execution module that is used to carry out described test case, the access module that is used for the described detecting information of access that are used to receive described transmitting-receiving message, described test packet and response message and other detecting information at least, be used to analyze described transmitting-receiving message, described test packet and response message and other detecting information analysis module one of them.
Described integrated test system, wherein, described testing server also comprises reporting modules, is used for generating test report according to described test result, and sends to described test client by described forwarding module.
Described integrated test system, wherein, described test agent person comprises the monitor module that is used to monitor described transmitting-receiving message at least, be used to receive and dispatch the transceiver module of described test packet and response message and other detecting information, the adaptation module that is used for adaptive described test packet, be used to receive described transmitting-receiving message and externally issue the interface module of quoting, be used to judge described transmitting-receiving message, the judge module whether described test packet and response message thereof and other detecting information be available, be used to handle described transmitting-receiving message, the processing module of described test packet and response message thereof and other detecting information one of them.
A kind of integration test method of distributed software system, be used to comprise testing server, at least one test client and at least one test agent person's integrated test system, it may further comprise the steps: A1, configuration also start described test agent person, described test client, described testing server, connect mutually; A2, by described test client input test information; Wherein, described detecting information comprise at least steering order, test request, test connection, test packet, test script, test case one of them; A3, described testing server send described detecting information to described test agent person; Described test packet in A4, the adaptive described detecting information of described test agent person, the interface of the system under test (SUT) by the outside sends to described system under test (SUT) and tests, and receives the response message of described system under test (SUT) to described test packet; A5, described testing server feed back to described test client with described test agent person's test result.
Described integration test method, wherein, steps A 4 also comprises steps A 41: described test agent person monitors by the transmitting-receiving message of the interface of described system under test (SUT), sends to described testing server.
Described integration test method, wherein, go back execution in step A42 after the steps A 41: described test agent person judges that described transmitting-receiving message needs to handle, and then according to described test request it is handled.
Described integration test method wherein, is also carried out the interface that following steps: B 1, described test agent person are connected to described system under test (SUT) server end before the steps A 4; B2, described test agent person be when externally issue is quoted, first logical name that adopts the external issue of described system under test (SUT) server end to quote; B3, described system under test (SUT) server end adopt second logical name externally to issue and quote; B4, described test agent person adopt second logical name to initiate calling described system under test (SUT) server end.
Described integration test method, wherein, steps A 5 specifically may further comprise the steps: described testing server generates test report according to described test agent person's test result, feeds back to described test client.
Adopt such scheme, the present invention can be the different TA of dissimilar tested interface exploitations, as the adapter that connects TS and SUT, reduces the correlativity of TC, TS and system under test (SUT), improves the extendability of testing tool; The mode that TA inserts SUT can be supported the integration testing of interface at all levels, this be very beneficial for implementing top-down, bottom-up, mix the integration testing of types such as propagation; Can construct the test environment of the multi-user concurrent of distributed software system by the function of many TC, many TA on-line testing simultaneously, this meets the integration testing demand of distributed software system very much.
Description of drawings
Fig. 1 is the integration testing synoptic diagram of the first generation distributed software system of prior art;
Fig. 2 is the structural representation of the second generation distributed software system of prior art;
Fig. 3 is the structural representation of integrated test system of the second generation distributed software system of apparatus of the present invention;
Fig. 4 is the process flow diagram of the inventive method;
Fig. 5 is a kind of embodiment synoptic diagram of the inventive method.
Embodiment
Below in conjunction with accompanying drawing and preferred embodiment, the present invention is described in detail.
As shown in Figure 3, the invention provides a kind of integrated test system of distributed software system, it comprises testing server, at least one test client and at least one test agent person; Wherein, test client and test agent person concern one to one.
Testing server (TS, Test Server), it is the function maincenter of system of the present invention, its management is connected with test client, test agent person's, supports many test clients, many test agent person on-line testing simultaneously, for example, be responsible for the forwarding of test packet, the execution of test case, the generation of test report, and the access of test data in file system or Database Systems etc.Described testing server adopts communication modes to be connected with described test client, described test agent person respectively, is used for according to detecting information the system under test (SUT) of outside being tested, and test result is fed back to described test client; Wherein, described detecting information comprise at least steering order, test request, test connection, test packet, test script, test case one of them.Certainly, according to actual needs, described detecting information can comprise above-mentioned multinomial or full detail.
Test client (TC, Test Client) adopts human-computer interaction interface, constructs test data for the user, carries out test operation, control and measuring process, and assessment test report.For example, according to test case, structure monitors the test case of the tested interface driving of test case, the constructing analog of tested interface or the test case of the tested interface stake of constructing analog etc.; Described test client is used to receive and dispatch described detecting information, and, according to the steering order in the described detecting information, control described testing server and test, and receive described test result.
Be more preferably, described testing server generates test report according to described test agent person's test result, feeds back to described test client.For example, described testing server also comprises reporting modules, is used for generating test report according to described test result, and sends to described test client by described forwarding module.
Test agent person (TA, Test Agent) is linked in the middle of the system under test (SUT) (SUT, System UnderTest), monitors the message in the middle of the tested interface, and analog message (being test packet) is injected in the middle of the interface.As the adapter that connects TS and SUT, be responsible for the mutual message between adaptive and transfer TS and the SUT.Described test agent person also is connected with described system under test (SUT) by the interface of described system under test (SUT), be used to monitor transmitting-receiving message by described interface, mutual with described testing server, described system under test (SUT) respectively, adaptive and receive and dispatch described test packet and response message thereof.
Specifically, described test client comprise client receiver module, the sending module that is used to send described detecting information, the execution module that is used to carry out test, the monitoring module that is used for the control and measuring process that are used to receive described detecting information at least, the analysis module that is used for the analysis and evaluation test result one of them.The client receiver module receives described detecting information, sends to the server receiver module of testing server by sending module; Execution module is carried out test according to steering order control testing server, for example, carries out the required described test case of this test; Monitoring module control and measuring process, the user can check the progress and when needed of test execution, according to the execution of user's steering order interrupt test; Analysis module analysis and evaluation test result, if when having test report, analysis module analysis and evaluation test report is analyzed and is assessed test result on this basis.
Described testing server comprises at least and is used to receive described transmitting-receiving message, the server receiver module of described test packet and response message thereof and other detecting information, be used to control the control module of described test, be used to send the forwarding module of described test packet and described test result, be used to carry out the execution module of described test case, the access module that is used for the described detecting information of access, be used to analyze described transmitting-receiving message, the analysis module of described test packet and response message thereof and other detecting information one of them.
Wherein, the server receiver module receives described transmitting-receiving message, described test packet and response message thereof and other detecting information, thereby obtain test result, can store described detecting information, even store the response message of described transmitting-receiving message and described test packet by access module; Particular content by analysis module analysis transmitting-receiving message, detecting information and response message thereof calls execution module, forwarding module etc. respectively and carries out concrete operations, for example, according to described detecting information, carries out described test case by execution module; Perhaps, according to described detecting information, send described test packet to described test agent person by forwarding module; Perhaps, send the client receiver module of described test result by forwarding module to test client.Can also generate test report by above-mentioned reporting modules, send the client receiver module of described test report to test client by forwarding module.
Described test agent person comprises the monitor module that is used to monitor described transmitting-receiving message at least, be used to receive and dispatch the transceiver module of described test packet and response message and other detecting information, the adaptation module that is used for adaptive described test packet, be used to receive described transmitting-receiving message and externally issue the interface module of quoting, be used to judge described transmitting-receiving message, the judge module whether described test packet and response message thereof and other detecting information be available, be used to handle described transmitting-receiving message, the processing module of described test packet and response message thereof and other detecting information one of them.
Transceiver module is received the test packet of testing server, call judge module by processing module and judge whether whether correct, the described test packet of form of described test packet is available, otherwise need call the form of the described test packet of the adaptive modification of adaptation module, perhaps abandon described test packet.Monitor module monitors the described transmitting-receiving message that receives by interface module, calls judge module by processing module and judges whether described transmitting-receiving message is available, and be then to handle described transmitting-receiving message according to test request.
As shown in Figure 4, the present invention also provides a kind of integration test method of distributed software system, is used to comprise testing server, at least one test client and at least one test agent person's integrated test system, and it may further comprise the steps.
A1, configuration also start described test agent person, described test client, described testing server, connect mutually; For example, the start-up parameter of configuration TA, TS, TC, and TA is configured in the middle of the SUT; Allow it can monitor message in the middle of the tested interface, and analog message is injected in the middle of the tested interface; Thereby built test environment.Need to prove that TA generally starts with SUT, SUT, TS, TC boot sequence can be in no particular order, and, between TA and TS, TS and TC, set up communication and be connected.
A2, by described test client input test information; Wherein, described detecting information comprise at least steering order, test request, test connection, test packet, test script, test case one of them.
For example, the test case of the tested interface of structure supervision in TC; The test case that the tested interface of constructing analog drives in TC; Test case of the tested interface stake of constructing analog etc. in TC.Need to prove that the step of above-mentioned each test case of structure can be carried out separately also and can carry out respectively, the step of each structure test case can be operated repeatedly, and sequence of operation in no particular order.
Then, in TC, select this to carry out required test case, implementation of test cases; For example, in TC, start test execution, and can in TC, check the process of test execution, simultaneously, whether can determine that according to procedural information interrupt test is carried out in TC.
Client receives described detecting information, sends to testing server; And can control testing server according to steering order and carry out test, for example, carry out the required described test case of this test; Control and measuring process simultaneously, the user can check the progress of test execution and when needed, according to the execution of user's steering order interrupt test; Analysis and evaluation test result afterwards, if when having test report, can the analysis and evaluation test report, on this basis test result is analyzed and assessed.
A3, described testing server send described detecting information to described test agent person.Wherein, comprised the test packet that needs test, and the control test steering order of carrying out etc.
Testing server receives described transmitting-receiving message, described test packet and response message thereof and other detecting information, thereby obtains test result; And can store described detecting information, even store the response message of described transmitting-receiving message and described test packet; By analyzing the particular content of transmitting-receiving message, detecting information and response message thereof, carry out described test case, perhaps, send described test packet to described test agent person, perhaps, send described test result to test client.Can also generate test report, send to test client.
Described test packet in A4, the adaptive described detecting information of described test agent person, the interface of the system under test (SUT) by the outside sends to described system under test (SUT) and tests, and receives the response message of described system under test (SUT) to described test packet.
Test agent person receives the test packet of testing server, judges whether whether correct, the described test packet of form of described test packet is available, otherwise needs the form of the described test packet of adaptive modification, perhaps abandons described test packet.Can also monitor by the described transmitting-receiving message by described interface judge whether described transmitting-receiving message is available, be then to handle described transmitting-receiving message according to test request.
Before steps A 4, can also carry out following steps, TA is configured in the middle of the SUT.B1, described test agent person are connected to the interface of described system under test (SUT) server end; B2, described test agent person be when externally issue is quoted, first logical name that adopts the external issue of described system under test (SUT) server end to quote; B3, described system under test (SUT) server end adopt second logical name externally to issue and quote; B4, described test agent person adopt second logical name to initiate calling described system under test (SUT) server end.
Specifically, the method that TA inserts SUT is one of key content of the present invention, and concrete technology realizes being described as follows: because any one remote object RO can externally send out a logical name X, exist one to one between the quoting of X and RO and concern.In order to visit RO, the client at first needs to get access to quoting of RO by X, and then visits RO by quoting of RO.Like this, TA can be linked in the middle of the SUT by following step:
1) TA realizes the interface of RO, and this can make TA become another central remote object of SUT;
2) TA usurp RO logical name X externally issue quote;
3) RO use instead another logical name Y externally issue quote;
4) TA notes the new logical name Y of RO, so that TA initiates calling RO.
When the client continues to obtain when quoting with logical name X, it will obtain quoting of TA.Because TA has also realized the interface same with RO, so the client can visit the interface that TA quotes as usual.By quoting of TA, client's request message will be passed to TA, and this moment, TA just can intercept request message.After intercepting request message, TA can carry out specific processing to it according to test request.Then, TA can remove to call RO by logical name Y and processed request message.If RO has response message after executing solicit operation, that RO also can return to TA with response message.Equally, TA can carry out specific processing to response message according to test request, and then returns to the client.
And all right execution in step A41 when execution in step A4: described test agent person monitors by the transmitting-receiving message of the interface of described system under test (SUT), sends to described testing server.Can also execution in step A42 after rapid A41: described test agent person judges that described transmitting-receiving message needs processing, then handles it according to described test request.
A5, described testing server feed back to described test client with described test agent person's test result.For example, steps A 5 specifically can may further comprise the steps: described testing server generates test report according to described test agent person's test result, feeds back to described test client.In TC, check the test report that TS generates; And analyze, assess test result.
As shown in Figure 5, further specify the implementation detail of integration test method of the present invention below by the integration testing embodiment of optical transport network management system T3.T3 adopts distributed software system of CORBA technological development, is used to administer and maintain optical transport network.Remote object in the T3 server is by ORB (Object Request Broker, Object Request Broker), adopt IIOP (InternetInter-ORB Protocol, Internet ORB interchange agreement) connects, externally issue to the mode of CORBA name service (Naming Service) registration logical name and self quote.By configuration file (context.xml), the T3 server can static configuration which remote object be made of, and assigning remote object used logical name when Naming Service registers.
The test target of this embodiment is the interface T3:Command that alarm component AlarmServant realizes, interface T3:Command is defined as follows in idl file:
module?T3
{
interface?Command：Base::Base_I
{
void?Set(in?Base::T3Header?header，in?Base::T3Buf?body)
Raises (Base::General Exception); //---method l
Base::T3Buf?Get(in?Base::T3Header?header，in?Base::T3Buf?body)
Raises (Base::GeneralException); //---method 2
}；
}；
This interface has been stated two method Set and Get, and wherein Set is a unresponsive method, and Get is a method that band is replied.By calling these two methods in this interface, the T3 client can be provided with the mode of operation of A1armServant and the various warning information that the inquiry optical transport network produces.
AlarmServant is " Alarm " at the logical name of configuration file (context.xml) configuration.Intercept and capture message among the interface T3:Command in the T3 system in order to be linked into, or analog message is injected among the interface T3:Command, TA adopts programming language C++ to realize this interface, and is published in the server directory of T3 with the form of dynamic link libraries (TestAgent.dll).Next just can begin to have tested:
1) build test environment:
A) TA is configured into the T3 system: increase the relevant information of TA at configuration file (context.xml), and the logical name of TA is configured to " Alarm ", the logical name of AlarmServant is modified as " Real-Alarm ", specifies the configuration file of TA to be " TestAgent.xml " simultaneously.Can load TA automatically the T3 startup of server time like this, and allow TA become a remote object in the T3 server.Specific configuration information as follows:
<servant?id＝″Alarm″>
<class>T3.Context.Servant.TestAgent</class>
<config-file>TestAgent.xml</config-file>
</servant>
<servant?id＝″Real-Alarm″>
<class>T3.Context.Servant.AlarmServant</class>
<config-file>AlarmServant.xml</config-file>
</servant>
B) start-up parameter of configuration TA, TS, TC: the new logic title " Real-Alarm " of record AlarmServant in the configuration file (TestAgent.xml) of TA, and the bind address of configuration TS use.In the configuration file (TestServer.xml) of TS, the bind address of self, the information such as storage mode of test data are set; The bind address that configuration TS uses in the configuration file (TestClient.xml) of TC.
C) start T3 (TA starts with the T3 server), TS, TC, boot sequence in no particular order.
D) setting up communication between TA and TS, TS and TC is connected.
2) structure test case, following a), b), c) substep can singly select or multiselect, each substep can be operated repeatedly, sequence of operation in no particular order:
A) test case of the tested interface of structure supervision in TC: this type of use-case mainly is made of test script, and the user can create test case by script-editor, the use-case editing machine of TC.Test script mainly is to specify TA to monitor which class message among the tested interface T3:Command.
B) test case that the tested interface of constructing analog drives in TC: this type of use-case mainly is made of simulation request message and test script two parts, and the user can create test case by message editing device, script-editor, the use-case editing machine of TC.The simulation request message will be as the request message that calls AlarmServant interface T3:Command.Test script mainly is to allow TA will simulate request message on the opportunity of appointment send to AlarmServant.In addition, this type of use-case can also possess the function that monitors tested interface.
C) test case of the tested interface stake of constructing analog in TC: this type of use-case mainly is made of analog answer message and test script two parts, and the user can create test case by message editing device, script-editor, the use-case editing machine of TC.The analog answer message will be as the response message of T3 client call AlarmServant interface T3:Command.Test script mainly is to allow TA on the opportunity of appointment the analog answer message be sent to the T3 client.In addition, this type of use-case can also possess the function that monitors tested interface.
3) implementation of test cases:
A) select this to carry out required test case in TC: this embodiment has selected supervision, driving, three use-cases of stake.The effect that monitors use-case is that all messages among the AlarmServant interface T3:Command are all made a copy for to TS.The effect that drives use-case is the interface method Set that AlarmServant is called in simulation, and the alarm filter condition of AlarmServant is set.The effect of stake use-case is the simulation alarm information that provides when the interface method Get of T3 client call AlarmServant inquiry current alarm.
B) start test execution in TC, TC will send to TS to the relevant information of test case, and TS will carry out this three test cases respectively.TS can send to progress msg TC and shows in the implementation, complete or in the TS that has no progeny can generate test report.
C) check the process of test execution in TC: after monitoring that use-case begins to carry out, the user can operate the query history alarm function of T3 client, and TC can be shown to the user with the request message of query history alarm and response message and checked this moment.After the driving use-case was complete, the user can operate the query warning filtercondition function of T3 client, and the user can judge whether drive use-case runs succeeded by the message information that shows among the TC.After the stake use-case began to carry out, the user can operate the inquiry current alarm function of T3 client, and the current alarm that show in the T3 client this moment will be user's simulation alarm of structure before.In addition, whether the user can carry out the step d) operation according to the procedural information decision.
D) interrupt test is carried out in TC, and this substep is optional substep.
4) assessment test result:
A) check the test report that TS generates in TC: the user can see the total interface message that monitors in the whole test process in test report, and sends information such as time of reception.
B) assessment test result: the integrality of the interface packets that the user can monitor by checking and correctness judge that whether the T3 system is by test.
Like this, adopt system and method for the present invention can be the different TA of dissimilar tested interface exploitations,, reduce the correlativity of TC, TS and system under test (SUT), improve the extendability of testing tool as the adapter that connects TS and SUT; And the mode that TA inserts SUT can be supported the integration testing of interface at all levels, this be very beneficial for implementing top-down, bottom-up, mix the integration testing of types such as propagation; And, can construct the test environment of the multi-user concurrent of distributed software system by the function of many TC, many TA on-line testing simultaneously, this meets the integration testing demand of distributed software system very much.Be applicable to the distributed software system that test second generation distributed computing technology is realized, and improved the efficient of integration testing, guaranteed the quality of software product.
Should be understood that, for those of ordinary skills, can be improved according to the above description or conversion, and all these improvement and conversion all should belong to the protection domain of claims of the present invention.
Claims (10)
1. the integrated test system of a distributed software system is characterized in that, comprises testing server, at least one test client and at least one test agent person;
Described testing server is connected with described test client, described test agent person respectively, is used for according to detecting information the system under test (SUT) of outside being tested, and test result is fed back to described test client; Wherein, described detecting information comprise at least steering order, test request, test connection, test packet, test script, test case one of them;
Described test client is used to receive and dispatch described detecting information, controls described testing server and tests, and receive described test result;
Described test agent person also is connected with described system under test (SUT) by the interface of described system under test (SUT), be used to monitor transmitting-receiving message by described interface, mutual with described testing server, described system under test (SUT) respectively, adaptive and receive and dispatch described test packet and response message thereof.
2. integrated test system according to claim 1, it is characterized in that, the analysis module that described test client comprises client receiver module, the sending module that is used to send described detecting information, the execution module that is used to carry out test, the monitoring module that is used for the control and measuring process that are used to receive described detecting information at least, be used for the analysis and evaluation test result one of them.
3. integrated test system according to claim 1, it is characterized in that described testing server comprises at least and is used to receive described transmitting-receiving message, the server receiver module of described test packet and response message thereof and other detecting information, be used to control the control module of described test, be used to send the forwarding module of described test packet and described test result, be used to carry out the execution module of described test case, the access module that is used for the described detecting information of access, be used to analyze described transmitting-receiving message, the analysis module of described test packet and response message thereof and other detecting information one of them.
4. integrated test system according to claim 3 is characterized in that described testing server also comprises reporting modules, is used for generating test report according to described test result, and sends to described test client by described forwarding module.
5. integrated test system according to claim 1, it is characterized in that described test agent person comprises the monitor module that is used to monitor described transmitting-receiving message at least, be used to receive and dispatch the transceiver module of described test packet and response message and other detecting information, the adaptation module that is used for adaptive described test packet, be used to receive described transmitting-receiving message and externally issue the interface module of quoting, be used to judge described transmitting-receiving message, the judge module whether described test packet and response message thereof and other detecting information be available, be used to handle described transmitting-receiving message, the processing module of described test packet and response message thereof and other detecting information one of them.
6. the integration test method of a distributed software system is used to comprise it is characterized in that testing server, at least one test client and at least one test agent person's integrated test system, may further comprise the steps:
A1, configuration also start described test agent person, described test client, described testing server, connect mutually;
A2, by described test client input test information; Wherein, described detecting information comprise at least steering order, test request, test connection, test packet, test script, test case one of them;
A3, described testing server send described detecting information to described test agent person;
Described test packet in A4, the adaptive described detecting information of described test agent person, the interface of the system under test (SUT) by the outside sends to described system under test (SUT) and tests, and receives the response message of described system under test (SUT) to described test packet;
A5, described testing server feed back to described test client with described test agent person's test result.
7. integration test method according to claim 6 is characterized in that, steps A 4 also comprises steps A 41: described test agent person monitors by the transmitting-receiving message of the interface of described system under test (SUT), sends to described testing server.
8. integration test method according to claim 7 is characterized in that, goes back execution in step A42 after the steps A 41: described test agent person judges that described transmitting-receiving message needs to handle, and then according to described test request it is handled.
9. according to the arbitrary described integration test method of claim 6 to 8, it is characterized in that, also carry out following steps before the steps A 4:
B1, described test agent person are connected to the interface of described system under test (SUT) server end;
B2, described test agent person be when externally issue is quoted, first logical name that adopts the external issue of described system under test (SUT) server end to quote;
B3, described system under test (SUT) server end adopt second logical name externally to issue and quote;
B4, described test agent person adopt second logical name to initiate calling described system under test (SUT) server end.
10. integration test method according to claim 9 is characterized in that, steps A 5 specifically may further comprise the steps: described testing server generates test report according to described test agent person's test result, feeds back to described test client.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CNB2007101237705A CN100543698C (en) | 2007-09-29 | 2007-09-29 | A kind of integrated test system of distributed software system and method |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CNB2007101237705A CN100543698C (en) | 2007-09-29 | 2007-09-29 | A kind of integrated test system of distributed software system and method |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN101140541A true CN101140541A (en) | 2008-03-12 |
| CN100543698C CN100543698C (en) | 2009-09-23 |
Family
ID=39192500
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CNB2007101237705A Expired - Fee Related CN100543698C (en) | 2007-09-29 | 2007-09-29 | A kind of integrated test system of distributed software system and method |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN100543698C (en) |
Cited By (32)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2011060642A1 (en) * | 2009-11-23 | 2011-05-26 | 中兴通讯股份有限公司 | Automatic test system for distributed comprehensive service and method thereof |
| CN102103540A (en) * | 2011-03-23 | 2011-06-22 | 镇江睿泰信息科技有限公司 | Cloud test device and method for general software system |
| CN101414935B (en) * | 2008-07-09 | 2011-06-22 | 北京星网锐捷网络技术有限公司 | Method and system for generating test case |
| CN102141962A (en) * | 2011-04-07 | 2011-08-03 | 北京航空航天大学 | Safety distributed test framework system and test method thereof |
| CN102185734A (en) * | 2011-04-18 | 2011-09-14 | 华为软件技术有限公司 | Automatic interface testing method and server |
| CN101447892B (en) * | 2008-11-24 | 2011-12-28 | 中兴通讯股份有限公司 | Distributed test method, system and test server |
| CN102467442A (en) * | 2010-11-02 | 2012-05-23 | 腾讯科技（深圳）有限公司 | Software testing method, system and equipment |
| CN102495799A (en) * | 2011-12-02 | 2012-06-13 | 刘伟 | Automatic test system and method of movable terminal |
| CN101483562B (en) * | 2009-02-19 | 2012-07-18 | 中兴通讯股份有限公司 | Method, system and related equipment for routine test |
| CN101316202B (en) * | 2008-07-03 | 2012-10-10 | 中兴通讯股份有限公司 | On-line diagnosis method and system of embedded software, embedded software device |
| CN103257917A (en) * | 2012-02-16 | 2013-08-21 | 广州博纳信息技术有限公司 | Management method for software evaluation system |
| CN103298016A (en) * | 2012-02-27 | 2013-09-11 | 展讯通信（上海）有限公司 | Test system for mobile terminals |
| CN103870301A (en) * | 2012-12-15 | 2014-06-18 | 国际商业机器公司 | Software Installation Method, Apparatus and Program Product |
| CN103902446A (en) * | 2012-12-27 | 2014-07-02 | 北京新媒传信科技有限公司 | Network server automated testing method and device |
| CN104077219A (en) * | 2013-04-23 | 2014-10-01 | 腾讯科技（深圳）有限公司 | Software testing method and device |
| CN104125116A (en) * | 2014-08-04 | 2014-10-29 | 上海斐讯数据通信技术有限公司 | Method and system for testing protocol conformance |
| CN104391787A (en) * | 2014-11-13 | 2015-03-04 | 华为软件技术有限公司 | Monitoring method aiming at target method as well as thermal cutting-in method and device |
| CN104426715A (en) * | 2013-09-03 | 2015-03-18 | 北京信威通信技术股份有限公司 | Distributed testing tool control method |
| CN104850491A (en) * | 2014-02-19 | 2015-08-19 | 深圳中兴网信科技有限公司 | Software test method, equipment and system |
| CN105302721A (en) * | 2015-10-29 | 2016-02-03 | 普元信息技术股份有限公司 | System and method for realizing integration testing of centralized analog server in cloud computing platform |
| CN105721239A (en) * | 2016-01-18 | 2016-06-29 | 网易（杭州）网络有限公司 | Game test method, device and game system |
| CN106055466A (en) * | 2015-04-13 | 2016-10-26 | 中兴通讯股份有限公司 | Method for implementing server testing, testing server and to-be-tested server |
| CN106970880A (en) * | 2017-04-28 | 2017-07-21 | 中国科学院软件研究所 | A kind of distributed automatization method for testing software and system |
| CN108388501A (en) * | 2018-01-10 | 2018-08-10 | 链家网（北京）科技有限公司 | Integration test method between a kind of system |
| CN109144866A (en) * | 2018-08-15 | 2019-01-04 | 广东美的厨房电器制造有限公司 | Method for testing software and software testing device based on household electrical appliance |
| CN109582588A (en) * | 2018-12-25 | 2019-04-05 | 迈普通信技术股份有限公司 | Method for generating test case, device and electronic equipment |
| WO2019085290A1 (en) * | 2017-10-31 | 2019-05-09 | 平安科技（深圳）有限公司 | Test preparation method and apparatus, terminal device, and storage medium |
| CN109828914A (en) * | 2018-12-28 | 2019-05-31 | 宁波瓜瓜农业科技有限公司 | Whole process distributed system automated testing method and test macro |
| CN110213119A (en) * | 2018-03-07 | 2019-09-06 | 财付通支付科技有限公司 | Test pile generation method, test macro, test method and equipment |
| CN112819605A (en) * | 2021-01-29 | 2021-05-18 | 山东浪潮通软信息科技有限公司 | Method and device for testing fund settlement service and computer readable medium |
| CN113419946A (en) * | 2021-05-31 | 2021-09-21 | 西南电子技术研究所（中国电子科技集团公司第十研究所） | Ice interface test case and test script automatic generation method |
| CN117093503A (en) * | 2023-10-17 | 2023-11-21 | 杭银消费金融股份有限公司 | Client test management method and system |
-
2007
- 2007-09-29 CN CNB2007101237705A patent/CN100543698C/en not_active Expired - Fee Related
Cited By (49)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101316202B (en) * | 2008-07-03 | 2012-10-10 | 中兴通讯股份有限公司 | On-line diagnosis method and system of embedded software, embedded software device |
| CN101414935B (en) * | 2008-07-09 | 2011-06-22 | 北京星网锐捷网络技术有限公司 | Method and system for generating test case |
| CN101447892B (en) * | 2008-11-24 | 2011-12-28 | 中兴通讯股份有限公司 | Distributed test method, system and test server |
| CN101483562B (en) * | 2009-02-19 | 2012-07-18 | 中兴通讯股份有限公司 | Method, system and related equipment for routine test |
| WO2011060642A1 (en) * | 2009-11-23 | 2011-05-26 | 中兴通讯股份有限公司 | Automatic test system for distributed comprehensive service and method thereof |
| US9189374B2 (en) | 2009-11-23 | 2015-11-17 | Zte Corporation | Automatic test system for distributed comprehensive service and method thereof |
| CN102467442A (en) * | 2010-11-02 | 2012-05-23 | 腾讯科技（深圳）有限公司 | Software testing method, system and equipment |
| CN102467442B (en) * | 2010-11-02 | 2015-04-29 | 腾讯科技（深圳）有限公司 | Software testing method, system and equipment |
| CN102103540A (en) * | 2011-03-23 | 2011-06-22 | 镇江睿泰信息科技有限公司 | Cloud test device and method for general software system |
| CN102141962A (en) * | 2011-04-07 | 2011-08-03 | 北京航空航天大学 | Safety distributed test framework system and test method thereof |
| CN102141962B (en) * | 2011-04-07 | 2013-06-19 | 北京航空航天大学 | Safety distributed test framework system and test method thereof |
| CN102185734A (en) * | 2011-04-18 | 2011-09-14 | 华为软件技术有限公司 | Automatic interface testing method and server |
| CN102495799A (en) * | 2011-12-02 | 2012-06-13 | 刘伟 | Automatic test system and method of movable terminal |
| CN103257917A (en) * | 2012-02-16 | 2013-08-21 | 广州博纳信息技术有限公司 | Management method for software evaluation system |
| CN103257917B (en) * | 2012-02-16 | 2016-08-03 | 广州博纳信息技术有限公司 | Management method for software evaluation system |
| CN103298016A (en) * | 2012-02-27 | 2013-09-11 | 展讯通信（上海）有限公司 | Test system for mobile terminals |
| CN103298016B (en) * | 2012-02-27 | 2016-12-14 | 展讯通信（上海）有限公司 | the test system of mobile terminal |
| CN103870301A (en) * | 2012-12-15 | 2014-06-18 | 国际商业机器公司 | Software Installation Method, Apparatus and Program Product |
| CN103870301B (en) * | 2012-12-15 | 2017-04-12 | 国际商业机器公司 | Software Installation Method and Apparatus |
| CN103902446A (en) * | 2012-12-27 | 2014-07-02 | 北京新媒传信科技有限公司 | Network server automated testing method and device |
| CN103902446B (en) * | 2012-12-27 | 2017-04-05 | 北京新媒传信科技有限公司 | A kind of method and apparatus of webserver automatic test |
| CN104077219A (en) * | 2013-04-23 | 2014-10-01 | 腾讯科技（深圳）有限公司 | Software testing method and device |
| CN104077219B (en) * | 2013-04-23 | 2015-08-12 | 腾讯科技（深圳）有限公司 | A kind of method for testing software and device |
| CN104426715B (en) * | 2013-09-03 | 2018-03-09 | 北京信威通信技术股份有限公司 | A kind of distributed testing tool control method |
| CN104426715A (en) * | 2013-09-03 | 2015-03-18 | 北京信威通信技术股份有限公司 | Distributed testing tool control method |
| CN104850491A (en) * | 2014-02-19 | 2015-08-19 | 深圳中兴网信科技有限公司 | Software test method, equipment and system |
| CN104125116A (en) * | 2014-08-04 | 2014-10-29 | 上海斐讯数据通信技术有限公司 | Method and system for testing protocol conformance |
| CN104391787A (en) * | 2014-11-13 | 2015-03-04 | 华为软件技术有限公司 | Monitoring method aiming at target method as well as thermal cutting-in method and device |
| CN104391787B (en) * | 2014-11-13 | 2017-04-26 | 华为软件技术有限公司 | Monitoring method aiming at target method as well as thermal cutting-in method and device |
| CN106055466A (en) * | 2015-04-13 | 2016-10-26 | 中兴通讯股份有限公司 | Method for implementing server testing, testing server and to-be-tested server |
| CN105302721A (en) * | 2015-10-29 | 2016-02-03 | 普元信息技术股份有限公司 | System and method for realizing integration testing of centralized analog server in cloud computing platform |
| CN105302721B (en) * | 2015-10-29 | 2018-06-19 | 普元信息技术股份有限公司 | The system and method for lumped modelling server integration testing is realized in cloud computing platform |
| CN105721239A (en) * | 2016-01-18 | 2016-06-29 | 网易（杭州）网络有限公司 | Game test method, device and game system |
| CN106970880B (en) * | 2017-04-28 | 2021-01-01 | 中国科学院软件研究所 | Distributed automatic software testing method and system |
| CN106970880A (en) * | 2017-04-28 | 2017-07-21 | 中国科学院软件研究所 | A kind of distributed automatization method for testing software and system |
| WO2019085290A1 (en) * | 2017-10-31 | 2019-05-09 | 平安科技（深圳）有限公司 | Test preparation method and apparatus, terminal device, and storage medium |
| CN108388501A (en) * | 2018-01-10 | 2018-08-10 | 链家网（北京）科技有限公司 | Integration test method between a kind of system |
| CN108388501B (en) * | 2018-01-10 | 2021-09-17 | 贝壳找房(北京)科技有限公司 | Intersystem integration test method |
| CN110213119B (en) * | 2018-03-07 | 2022-02-22 | 财付通支付科技有限公司 | Test pile generation method, test system, test method and test equipment |
| CN110213119A (en) * | 2018-03-07 | 2019-09-06 | 财付通支付科技有限公司 | Test pile generation method, test macro, test method and equipment |
| CN109144866A (en) * | 2018-08-15 | 2019-01-04 | 广东美的厨房电器制造有限公司 | Method for testing software and software testing device based on household electrical appliance |
| CN109144866B (en) * | 2018-08-15 | 2022-08-16 | 广东美的厨房电器制造有限公司 | Software testing method and software testing device based on household appliances |
| CN109582588A (en) * | 2018-12-25 | 2019-04-05 | 迈普通信技术股份有限公司 | Method for generating test case, device and electronic equipment |
| CN109582588B (en) * | 2018-12-25 | 2022-02-22 | 迈普通信技术股份有限公司 | Test case generation method and device and electronic equipment |
| CN109828914A (en) * | 2018-12-28 | 2019-05-31 | 宁波瓜瓜农业科技有限公司 | Whole process distributed system automated testing method and test macro |
| CN112819605A (en) * | 2021-01-29 | 2021-05-18 | 山东浪潮通软信息科技有限公司 | Method and device for testing fund settlement service and computer readable medium |
| CN113419946A (en) * | 2021-05-31 | 2021-09-21 | 西南电子技术研究所（中国电子科技集团公司第十研究所） | Ice interface test case and test script automatic generation method |
| CN117093503A (en) * | 2023-10-17 | 2023-11-21 | 杭银消费金融股份有限公司 | Client test management method and system |
| CN117093503B (en) * | 2023-10-17 | 2024-02-06 | 杭银消费金融股份有限公司 | Client test management method and system |
Also Published As
| Publication number | Publication date |
|---|---|
| CN100543698C (en) | 2009-09-23 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN100543698C (en) | A kind of integrated test system of distributed software system and method | |
| US8065657B2 (en) | Exchange infrastructure system and method | |
| KR100724522B1 (en) | Method and system for automatically generating service interfaces for a service oriented architecture | |
| CN101529382B (en) | Common component framework | |
| US5546584A (en) | System and method for establishing communication protocols between application programs | |
| AU2004200731B2 (en) | Transmitting and receiving messages through a customizable communication channel and programming model | |
| US20060224702A1 (en) | Local workflows in a business process management system | |
| US20060080117A1 (en) | Maintaining integrity within an adaptive value chain involving cross enterprise interactions | |
| WO2001025919A2 (en) | Architectures for netcentric computing systems | |
| AU2003231295A8 (en) | Systems and methods for collaborative business plug-ins | |
| CN103336705A (en) | Automatic transcoding and semantic adaptation between scripting and workflow systems | |
| Cámara et al. | Formalizing wsbpel business processes using process algebra | |
| JPH11134219A (en) | Device and method for simulating multiple nodes on single machine | |
| Medvidovic et al. | A family of software architecture implementation frameworks | |
| Cho et al. | A protocol based approach to specifying interoperability between objects | |
| AU2003223040B2 (en) | Exchange infrastructure system and method | |
| CN100401259C (en) | Method for providing service in distribution type service system | |
| US20030208641A1 (en) | Software components as virtual processors | |
| Umar | The emerging role of the Web for enterprise applications and ASPs | |
| JP2002358199A (en) | Component system and component preparing method | |
| Siegel | An overview of CORBA 3 | |
| Gannod et al. | Automated support for service-based software development and integration | |
| Zheng et al. | MobiGATE: a mobile computing middleware for the active deployment of transport services | |
| Nowostawski et al. | A multi-level approach and infrastructure for agent-oriented software development | |
| Arnold et al. | Integrating, Customizing, and Extending Environments with a Message-Based Architecture |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C14 | Grant of patent or utility model | ||
| GR01 | Patent grant | ||
| CF01 | Termination of patent right due to non-payment of annual fee | ||
| CF01 | Termination of patent right due to non-payment of annual fee |
Granted publication date: 20090923 Termination date: 20190929 |