CN1780236A - Universal testing system and method for telecommunication intelligent service - Google Patents
Universal testing system and method for telecommunication intelligent service Download PDFInfo
- Publication number
- CN1780236A CN1780236A CN 200410091102 CN200410091102A CN1780236A CN 1780236 A CN1780236 A CN 1780236A CN 200410091102 CN200410091102 CN 200410091102 CN 200410091102 A CN200410091102 A CN 200410091102A CN 1780236 A CN1780236 A CN 1780236A
- Authority
- CN
- China
- Prior art keywords
- test
- test case
- data
- definition
- information
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Images
Abstract
A universal test system for intelligent telecommunication service is composed of a development unit of graphic test example, an executing unit of test example and a test task managing unit. Its method is also disclosed.
Description
Technical field
The invention belongs to the telecommunications field tests, relate to the measuring technology and the device of teledata business and equipment.
Background technology
The competition situation of increasingly sharpening along with telecommunications industry, service content, method of service, service quality to domestic telecommunication operator have proposed stern challenge, promoting telecom operators and constantly releasing new telecommunication service, keeping Enterprises'Competitiveness with the contention customer resources.In recent years, intelligent network technology is fast development in the world, and fundamentally having changed telecommunications network provides professional traditional approach, makes fast, generates and realize flexibly, economically that various telecommunication services become possibility.
The operation of IN service is to be based upon in the intelligent network between each functional entity mutually on the basis of communication, and the IN service of a complexity often needs to carry out alternately with various software and hardware system, receives or send to ask to obtain information.These had both comprised inner take place mutual of intelligent network alternately, also comprise and various system or system (as voice system, content supplier etc.), even with different communication network (as telecommunications and mobile, UNICOM etc.) between communication.In this complicated communication network, exist multiple kinds simultaneously, moving a large amount of carrier class application software.These hardware and software equipment are finished exploitation by the telecom equipment vendor, and paying formal use of telecom operators' input all needs to carry out strict test before in each link.Particularly, occur when IN service under the situation of a large amount of call losses, because functional module is numerous in the intelligent network, be difficult to accurate fault location reason, therefore be badly in need of a kind of testing tool, can between different links, test point be set, and generate different test cases flexibly, each module is carried out functional test and Bulk Call test, and the fault location reason is found out performance bottleneck.
Relative with the flexibility of IN service exploitation is that the exploitation of testing tool but is difficult to satisfy present demand.No matter be that the telecom equipment vendor is in the process of exploitation or in the process of telecom operators at equipment acceptance, all have at different communications protocol, the different special testing tools of application layer service logic exploitation, and the exploitation of these testing tools, itself just needs to drop into a large amount of human and material resources.Especially when change takes place the IN service of high flexible, have to again revise testing tool, to produce new test case in the source code level.The difficulty of test directly has influence on intelligent net system and professional stablizing, and becomes equipment high one of the main reasons of failure rate in operation.
On article of publishing and patent documentation, do not see at present the universal test system and the method for telecommunication intelligent service as yet.
Summary of the invention
One of technical problem that the present invention solves has provided a kind of test macro that possesses the versatility telecommunication intelligent service, to adapt to the flexibility requirement to the telecommunication intelligent service testing tool.
Another technical problem that the present invention solves provides a kind of method of testing of telecommunication intelligent service, make telecom operators and telecommunication apparatus manufacturer can create neatly and implementation of test cases, the statistical test data, make the Test Engineer can understand and assess the performance of system under test (SUT) accurately, objectively, and its applicability is not subjected to the restriction of concrete communications protocol and concrete tested operation flow.
Telecommunication intelligent service universal test system of the present invention comprises: a graphical test case development device has a graphical interfaces storehouse, the basic functional units in the storehouse in the corresponding at least test case implementation of each figure; Also have a graphical editing interface, patterned basic functional units is connected into flow chart; And many graphical interfaces, be used for the data and the attribute setting of each basic functional units; With all information translation of editing the test case that produces is the test case execute file;
The test case execute file that is generated by the test case development device is resolved and carried out to one test case final controlling element; According to the definition in the test case execute file, create the network connection and be connected with database; According to protocol definition information, carry out login, authentication and link maintenance flow process; The database manipulation that defines in the implementation of test cases execute file; Mutual with the test assignment management devices, accept the control of test assignment management devices;
One test assignment management devices transmits the test case execute file to the test case final controlling element; By the number of times of nominative testing time or execution testing process, editor's test assignment also orders the test case final controlling element to be carried out; The interface of revising the data in the test case is provided; The tracking message that acceptance test use-case final controlling element sends, and show to the user; After test assignment is complete, the statistics that the read test use-case produces, and be shown to the user with the form of chart.
Graphical test case development device also comprises a communications protocol definition device, is used to provide a data input interface, with the critical field information in the definition agreement; Adopt described graphical interfaces storehouse and graphical editing interface, with login, authentication, the link maintenance flow process of editor's agreement regulation; The protocol definition information that generates can export as the protocol definition file separately, can import in different test cases and reuse.
Graphical test case development device also comprises a data definition device, is used for defining data and the memory cell that test case is carried out to be needed, and comprising: management data, can revise by the test assignment management devices, with the control testing process; The session shared data offers exchange message between the different instances of same test case; The session private data is deposited session data and ephemeral data for the example of test case when moving.
Graphical test case development device comprises that also a network connects definition device, is used to be provided with information such as IP address that network connects needs, port numbers, and specifies this network to connect the procotol that goes up execution.
Graphical test case development device also comprises an error detector element, and before generating test case, whether the attribute setting and the flow process that detect basic functional units be correct.
Graphical test case development device also comprises a test case execute file generating apparatus, and graphical test case flow process and all descriptors are converted to binary file, offers the test case final controlling element and carries out.
The test case final controlling element also comprises a file interface device, to read and to resolve the test case descriptor in the test case execute file; A kind of multithreading time-division processing mechanism and task scheduling apparatus are assigned to each test case example in each thread and carry out according to the load principle of shared contribution by the task scheduling apparatus unification; One protocol execution means, login, authentication, the link maintenance flow process of definition in carrying on an agreement realize the versatility of the present invention to different communications protocol; One flow process tracking means, to the implementation status of test assignment management devices transmission trace information and detecting information and testing process, these information will be shown by the test assignment management devices.
The test assignment management devices also comprises a test assignment editing device, and a test assignment comprises at least: the time that test case sign, test starting finish or the execution number of times of testing process; One test case management data editor, be used for the management data that shows that the test case execute file defines, the value that provides editing interface to revise management data with the communication of test case final controlling element, refreshes management data value in the execution environment with amended value; The tracking means that one test case is carried out shows the trace information that is sended over by the test case final controlling element to the user; An and test data statistic device.
Telecommunication intelligent service universal testing method of the present invention comprises:
Define the data structure and the graph of a correspondence interface of the basic functional units of using in many tests;
Be connected to become flow chart by many basic functional units;
The data, procotol, network and the database that need in the definition flow process are connected, and define required statistical item;
Flow chart, data definition, protocol definition, network and database connection and statistical item definition are output as file;
Read information in the file by a final controlling element, and carry out flow process wherein; By a test assignment management devices,, provide the interface of revising data value to the user according to the data definition information in the file;
The test assignment management devices shows the trace information that final controlling element produces to the user in the process of execution flow process.
The statistics that also comprises test data, by defining a kind of data structure, this data structure comprises enough preliminary data items, and these data item can be given its meaning by the user, become statistical items; The statistical function unit is provided, and the user can upgrade defined statistical items by the statistical function unit when design cycle; By setting different test conditions, draw the test statistics data under the different condition, read these statisticss by the test assignment management devices, with chart etc. intuitively form show test results to the user.
Beneficial effect of the present invention shows: 1) can be directly applied for any application layer protocol based on TCP/IP; 2) by communication front end processor technology, can be applicable to any communications protocol, comprise No.7, No.1 signaling etc., make the Test Engineer only need energy is placed on the writing of application layer test case; 3) provide patterned test case developing instrument, make the test case clear process of writing, be convenient to safeguard and revise, adapted to the flexibility demand of telecommunication intelligent service; 4) provide the test data statistical function of user customizable, the Test Engineer can freely add up any data in the test process, to obtain first hand test data, is convenient to the system under test (SUT) performance is assessed, and fault is carried out statistic of classification; 5) possess the ability that testing process is followed the tracks of, make the Test Engineer can grasp the ruuning situation of test assignment at any time; 6) by test assignment is customized, but parameters such as flexible configuration call volume, session number, the number of calls, testing time realize the automation of test.Simultaneously, in conjunction with statistical function, can simulate different site environments and compare test.
Description of drawings
Fig. 1 is internal module relation of the present invention and method overall process schematic diagram;
Fig. 2 is the connection diagram that adopts direct connected mode between native system and system under test (SUT);
Fig. 3 be native system with system under test (SUT) between the schematic diagram that is connected by the communication interface machine.
Embodiment
For ease of narration, be " CDD " (Custom Defined Data) hereinafter to be referred as the user definition data; Being called for short basic functional units is " BFU " (Basic Function Unit);
As shown in Figure 1, be further elaborated with regard to described three modules respectively below.
(1) test case development environment
The test case development environment comprises following functional module: 1, graphics edition function; 2, protocol definition function; 3, data definition facility; 4, database is connected defined function with network; 5, test case execute file systematic function.
The graphics edition function
Be responsible in editor, drawing the connection between BFU and BFU, simple explanatory note, the preservation of figure with open UNDO, REDO, the moving of BFU, duplicate, shear, stickup, deletion action, the establishment of BFU object and safeguard preservation and the management of data in internal memory that then relates generally to BFU.Be connected to oriented connection between BFU, a connection of pointing to certain BFU is called fan-in, and the connection of pointing to other BFU is called fan-out.
The creation operation of BFU: the user then creates a BFU object at the newly-built BFU of editing interface in internal memory, and its pointer is appended in the array of pointers (claiming the BFU tabulation), all preserves the address of this array of pointers in each BFU object.Each BFU object has all been preserved one " fan-out connection array " with " fan-in is connected array " and from the index in the BFU tabulation.
The attended operation of BFU: to a BFU a, connection of every increase to other BFU b, then the fan-out at a connects the BFU list index that writes down b in the array, the BFU list index of record a in the fan-in connection array of b.
The BFU deletion action: delete a BFU, the fan-out that needs to revise this BFU connects array is connected all BFU in the array with fan-in fan-in, fan-out information.
Some BFU that link together constitute a mapping use-case flow chart.
Data definition facility
The invention provides an operation interface for user definition CDD data, the CDD data are used for preserving the required session data of test session one time.
Among the present invention, CDD data are characterized by type and length.CDD provides three kinds of fundamental types: integer, character string type, binary block, each fundamental type all have corresponding array class.The test case build environment is real these CDD that create in internal memory not, and it just is kept at the descriptor of CDD in the structural array, and use then when the user edits service needed, select for the user with the form of drop-down list.The descriptor of CDD defines with a class CDataInfo, the corresponding CDataInfo object of each CDD, and its data member comprises: data type, data word joint number, initial value data.
CDD is divided into again:
(1) management data (MCDD): the test assignment management environment is by revising management data, the execution flow process of control test;
(2) session shared data (SCDD):, make the collaborative test assignment of finishing of different sessions for different running examples (abbreviation session) data sharing of same test case in test execution environments;
(3) session private data (PCDD): the data that are used for test case example buffer memory self needs.
Data definition facility comprises the setting to the BFU attribute, and the BFU attribute data is kept in the BFU object as the member variable of BFU class.
The protocol definition function
Among the present invention, agreement is by following data representation:
(1) agreement essential information comprises protocol name, whether needs the session support;
(2) protocol characteristic field is as the position of length, message type field in each protocol message and byte number etc.;
(3) receiving-transmitting chain of stipulating in the agreement detects the flow process (claiming the link maintenance flow process) of bag.The edit mode of this flow process is consistent with the edit mode of test case flow process.
The inlet of the link detecting flow process of agreement is divided into service end inlet and client inlet, when editor's test case, according to the role of test lead in communication, specifies different agreement inlets respectively.In general, the client inlet comprises login (LOGIN IN) flow process to service end, and the service end inlet comprises the identifying procedure to the customer side logging request.Login required username and password information and can be appointed as management data, so that carry out online modification by the test assignment management environment.
The protocol definition module is to the test case execution environment length field information that gives information, for the test case execution environment with the communication of system under test (SUT) in finish the intercepting that receives packet; The message type field information that provides is extracted type of message for the test case execution environment from packet, and packet delivery is given the link detecting flow processing of test case flow process or agreement according to the type of message decision.The test case execution environment is according to the link detecting flow process in the protocol definition, finish and system under test (SUT) between the transmitting-receiving of link detecting bag, to keep communication link.
Defined agreement can export as the protocol definition file separately, and can load for other test cases.
Network connects and the database definition function
An operation interface is provided, is connected with network for the database connection that will use in the user definition business.
By operation interface, the user can preserve following link information:
Peer IP address
The service end port numbers
Connection type (as service end or client)
Wherein, IP address and port numbers can be appointed as management data, before starting test assignment, can make amendment by the test assignment management environment.
The user can define a plurality of networks and connect in test case, each network connects corresponding procotol, when the test assignment management environment after the test case execution environment is initiated enabled instruction, execution environment is according to link information, setting up SOCKET with tested element is connected, and login process that defines in the execution procotol (or identifying procedure) and link maintenance flow process, thereby finish the network establishment of connection.
Consider that some complicated test cases may need to utilize database to preserve information, universal test system of the present invention provides the database manipulation interface.In the WINDOWS system, system drives by ODBC and is connected with various databases.By the interface that the test case development environment provides, the user can preserve following database linkage information:
The system data parent name
Be connected similarly with network, the user can define a plurality of databases and connect in business.
Test case execute file systematic function
The test case execute file is preserved test case information with the internal system form, and the test case execute file can tested use-case execution environment and the parsing of test assignment management environment.
The test case execute file is made up of following each several part data:
The test case development environment at first carries out error detection to test case each several part data, judge in the test case flow process the message groups bag with whether inconsistently unpack with protocol definition, judge whether the attribute setting of each functional unit correct.If by error detection, then the each several part data with test case are written in the test case execute file with binary format.
(2) test case execution environment
Test case execution environment of the present invention has designed a C++ class for each basic functional units (BFU), by from the test case execute file, reading information, the BFU class is instantiated as the BFU object, and utilizes the link information that is stored among each BFU, the BFU object is connected to directed tree.
The data definition information of test case execution environment reading and saving in the test case execute file, and in internal memory the memory allocated unit, preserve the descriptor and the initial value of data.Protocol definition, network connect, database linkage information also reads and is kept in the internal memory from the test case execute file.
BFU class in the test case execution environment is corresponding with the BFU class in the test case development environment, comprises that network data receives class, network data sends class, calculating operation class, timer class, flow process control class (comprising condition judgment, branch and redirect), testing process tracking class (sending trace debug information to the test assignment management environment), database manipulation class, encryption and decryption class of operation, daily record class, statistics class.Wherein calculating operation comprises: add, subtract, multiplication and division, memory copying, string operation etc.Execution environment is carried out with the oriented order that is connected in the process of carrying out, and according to the branch of the conditional decision flow process of BFU of branch and condition judgment BFU.
Execution environment is instantiated as the test case object with test case, and test case can corresponding a plurality of test case objects, and each test case object carries out alternately as a session instance and tested element, thereby realizes the test of simulation Bulk Call.The test case object is made of BFU directed tree, user definition data and the buffering area that is used for buffered message, and its function is exactly according to the flow process that designs in the test case, calls the operation-interface function of each BFU object successively, thereby finishes the execution to test case.In the test case execution environment, a plurality of professional threads are formed thread pool, by the service dispatching module test case object are assigned to professional thread and carry out the timesharing execution, realize the concurrent mutual of a plurality of test case objects and tested element.Execution environment is corresponding one by one with the identification field of primary network session with the test case object, be kept in the HASH table, after execution environment is received internet message, according to protocol definition information, from packet, parse session identity fields, and with this field as key assignments, from HASH table, search and finally navigate to the test case object in the look-up table, then the internet message of receiving is given this tested object and is handled.
The data that statistics BFU in the test case will need to add up are written in the statistics task table of database.The list structure of statistics task table is as follows:
Test assignment ID: the unique identification of a test assignment, distribute by the test assignment management environment, be generally the analysis system under test (SUT), each test assignment is set different test conditions.
Testing process is carried out number of times: the number of times of this test case example implementation of test cases flow process.
The User Defined statistical items is defined voluntarily by the user, and the user is customizable statistics item in the test case development environment, the corresponding title of each statistical items, and this title is read by the test assignment management environment, and shows to the user when generating statistics.
(3) test assignment management environment
The test assignment management environment provides an operation interface, load test case file for the user to the test case execution environment, revise the test case management data, editor's test assignment, start the execution of test case, in test process, follow the tracks of and show the output information of test case, finish test back demonstration statistics.
Test assignment can be defined as by the time and carry out and carry out dual mode by number of times, and when being set to carry out by the time, the user passes through the startup and the dwell time of management environment nominative testing task; When being set to carry out in due order, the user is by the execution number of times of management environment nominative testing use-case.A test assignment comprises following information:
Test case ID, test case of unique identification
The executive mode of test case: expression is carried out or is pressed number of times and carries out by the time
The test assignment management environment connects to test case execution environment test transmission use-case execute file by SOCKET, read management data information, statistics task information in the execute file simultaneously, and these information are kept in the internal memory of management environment, thereby finish the loading of test case execute file.
Management environment can be revised the value of management data, and to refreshing the management data value of preserving in the execution environment by sending the Data Update instruction request to execution environment, the Data Update instruction both can be used before test case is carried out, and also can use in the process of implementation.
Finish the editor of test assignment in the test assignment management environment after, test assignment information is sent to the test assignment execution environment, can start the execution of test assignment then at any time.
Execution environment sends a notification message to management environment after finishing the execution of test assignment, and management environment shows the statistics that produces in the test process according to statistics task information to the user, finishes a test process.
(4) implementation step
Method of testing based on telecommunication intelligent service test macro of the present invention may further comprise the steps:
(1) communications protocol of using at system under test (SUT) with the test case development environment among the present invention, is carried out the application layer protocol customization; If the agreement outside the TCP/IP is adopted in the communication of system under test (SUT) bottom, then write communication interface machine retransmission protocol bag; If this protocol requirement link detecting is then in test case development environment inediting link detecting flow process; The communications protocol of customization can export as document of agreement separately, and can directly reuse when other test cases of exploitation;
(2) according to the test specification of system under test (SUT),, and generate executable test case in test case development environment inediting test case;
(3) will set up physical connection between described physical testing system and system under test (SUT), for example local area network (LAN) connects, relaying E1/T1 connects etc., and moves the test case execution environment in the physical testing system;
(4), load the test case that generates by the test assignment management environment.In the test assignment administration module, at this test case test assignment is set, and revises in the test case in order to control the management data of testing process;
(5) shown in accompanying drawing 2,3, universal test system of the present invention directly is connected with system under test (SUT) by TCP/IP, or links to each other with system under test (SUT) by the communication interface machine.This universal test system will automatically perform the link detecting flow process, to keep the communication link between system and system under test (SUT);
(6) survey and draw the use-case execution environment mutually by the test assignment management environment and send the beginning test instruction, start test assignment;
(7) in the test assignment implementation, the test case execution environment sends various instructions, request by the test physical system to system under test (SUT), multichannel session or calling are carried out in initiation, and collect replying of system under test (SUT), judge and reply the requirement of whether satisfying test specification, and in database, write down judged result according to the requirement of test case;
(8) in the test assignment implementation, the test case execution environment is according to the requirement of test case, and the detecting information in test assignment management environment transmission test process is shown in real time by the test assignment management environment, and testing process is carried out real-time tracking.
(9) test assignment complete after, the test assignment management environment automatically to the record test data add up.A test assignment can comprise the repeatedly test that is provided with under the different test conditions, the test data of these tests will finish the back in test assignment and collect by the test assignment management environment is unified, and add up, curve plotting figure, reflect the various performance parameters of system under test (SUT) and the correlation between the test condition, obtain the performance index of system under test (SUT) in running environment that is virtually reality like reality.
Method of the present invention and universal test system can be simulated the input when reality is runed of system under test (SUT) and equipment fully, And the output of reception system under test (SUT). Therefore, adopt method and system of the present invention to system under test (SUT) be objectively, can Letter. This universal test system has solved present telecommunication intelligent service and has lacked problems flexible, objective examination's means, and because Flexibility of the present invention and applicability widely greatly reduce the cost of test. Method and system of the present invention is complete Can be by equipment manufacturers and the telecom operators instrument as functional test, performance test and interoperability test.
Claims (10)
1, a kind of universal test system of telecommunication intelligent service is characterized in that, comprising:
One graphical test case development device has a graphical interfaces storehouse, the basic functional units in the storehouse in the corresponding at least test case implementation of each figure; Also have a graphical editing interface, patterned basic functional units is connected into flow chart; And many graphical interfaces, be used for the data and the attribute setting of each basic functional units; With all information translation of editing the test case that produces is the test case execute file;
The test case execute file that is generated by the test case development device is resolved and carried out to one test case final controlling element; According to the definition in the test case execute file, create the network connection and be connected with database; According to protocol definition information, carry out login, authentication and link maintenance flow process; The database manipulation that defines in the implementation of test cases execute file; Mutual with the test assignment management devices, accept the control of test assignment management devices;
One test assignment management devices transmits the test case execute file to the test case final controlling element; By the number of times of nominative testing time or execution testing process, editor's test assignment also orders the test case final controlling element to be carried out; The interface of revising the data in the test case is provided; The tracking message that acceptance test use-case final controlling element sends, and show to the user; After test assignment is complete, the statistics that the read test use-case produces, and be shown to the user with the form of chart.
2, the system as claimed in claim 1 is characterized in that, described graphical test case development device also comprises a communications protocol definition device, is used to provide a data input interface, with the critical field information in the definition agreement; Adopt described graphical interfaces storehouse and graphical editing interface, with login, authentication, the link maintenance flow process of editor's agreement regulation; The protocol definition information that generates can export as the protocol definition file separately, can import in different test cases and reuse.
3, the system as claimed in claim 1, it is characterized in that, described graphical test case development device also comprises a data definition device, be used for defining data and the memory cell that test case is carried out to be needed, comprise: management data, can revise by the test assignment management devices, with the control testing process; The session shared data offers exchange message between the different instances of same test case; The session private data is deposited session data and ephemeral data for the example of test case when moving.
4, the system as claimed in claim 1, it is characterized in that, described graphical test case development device comprises that also a network connects definition device, is used to be provided with information such as IP address that network connects needs, port numbers, and specifies this network to connect the procotol that goes up execution.
5, the system as claimed in claim 1 is characterized in that, described graphical test case development device also comprises an error detector element, and before generating test case, whether the attribute setting and the flow process that detect basic functional units be correct.
6, the system as claimed in claim 1, it is characterized in that, described graphical test case development device also comprises a test case execute file generating apparatus, and graphical test case flow process and all descriptors are converted to binary file, offers the test case final controlling element and carries out.
7, as the arbitrary described system of claim 1 to 6, it is characterized in that, described that the test case final controlling element also comprises a file interface device, to read and to resolve the test case descriptor in the test case execute file; A kind of multithreading time-division processing mechanism and task scheduling apparatus are assigned to each test case example in each thread and carry out according to the load principle of shared contribution by the task scheduling apparatus unification; One protocol execution means, login, authentication, the link maintenance flow process of definition in carrying on an agreement realize the versatility of the present invention to different communications protocol; One flow process tracking means, to the implementation status of test assignment management devices transmission trace information and detecting information and testing process, these information will be shown by the test assignment management devices.
8, as the arbitrary described system of claim 1 to 6, it is characterized in that, described test assignment management devices also comprises a test assignment editing device, and a test assignment comprises at least: the time that test case sign, test starting finish or the execution number of times of testing process; One test case management data editor, be used for the management data that shows that the test case execute file defines, the value that provides editing interface to revise management data with the communication of test case final controlling element, refreshes management data value in the execution environment with amended value; The tracking means that one test case is carried out shows the trace information that is sended over by the test case final controlling element to the user; An and test data statistic device.
9, a kind of universal testing method of telecommunication intelligent service is characterized in that, described method comprises the steps:
Define the data structure and the graph of a correspondence interface of the basic functional units of using in many tests;
Be connected to become flow chart by many basic functional units;
The data, procotol, network and the database that need in the definition flow process are connected, and define required statistical item;
Flow chart, data definition, protocol definition, network and database connection and statistical item definition are output as file;
Read information in the file by a final controlling element, and carry out flow process wherein; By a test assignment management devices,, provide the interface of revising data value to the user according to the data definition information in the file;
The test assignment management devices shows the trace information that final controlling element produces to the user in the process of execution flow process.
10, method of testing as claimed in claim 9 is characterized in that, also comprises the statistics of test data, and by defining a kind of data structure, this data structure comprises enough preliminary data items, and these data item can be given its meaning by the user, become statistical items; The statistical function unit is provided, and the user can upgrade defined statistical items by the statistical function unit when design cycle; By setting different test conditions, draw the test statistics data under the different condition, read these statisticss by the test assignment management devices, with chart etc. intuitively form show test results to the user.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN2004100911025A CN100407663C (en) | 2004-11-17 | 2004-11-17 | Universal testing system and method for telecommunication intelligent service |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN2004100911025A CN100407663C (en) | 2004-11-17 | 2004-11-17 | Universal testing system and method for telecommunication intelligent service |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN1780236A true CN1780236A (en) | 2006-05-31 |
| CN100407663C CN100407663C (en) | 2008-07-30 |
Family
ID=36770361
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN2004100911025A Active CN100407663C (en) | 2004-11-17 | 2004-11-17 | Universal testing system and method for telecommunication intelligent service |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN100407663C (en) |
Cited By (14)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101022375B (en) * | 2007-04-04 | 2010-05-26 | 杭州华三通信技术有限公司 | Centralizing automatic testing device and method for testing radio local network |
| CN101221530B (en) * | 2008-01-22 | 2010-06-16 | 中兴通讯股份有限公司 | Method for automatically leading in test cases |
| CN101788921A (en) * | 2010-02-08 | 2010-07-28 | 深圳市同洲电子股份有限公司 | Analog system of embedded equipment |
| CN101800680A (en) * | 2010-03-05 | 2010-08-11 | 中兴通讯股份有限公司 | Test device and test method of telecommunication system |
| CN101217400B (en) * | 2007-12-29 | 2010-11-03 | 北京亿阳信通软件研究院有限公司 | An integrated intelligent polling method and system |
| CN101098359B (en) * | 2006-06-27 | 2011-05-11 | 中兴通讯股份有限公司 | Time sharing test approach for tester |
| CN102426567A (en) * | 2011-09-15 | 2012-04-25 | 张德长 | Graphical editing and debugging system of automatic answer system |
| CN101686178B (en) * | 2008-09-28 | 2012-11-21 | 华为技术有限公司 | Method and system for improving multi-media connection quality, media control and processing equipment |
| CN102819488A (en) * | 2012-06-29 | 2012-12-12 | 用友软件股份有限公司 | Test processing device and test processing method |
| CN102968374A (en) * | 2012-11-29 | 2013-03-13 | 中国移动（深圳）有限公司 | Data warehouse testing method |
| CN103281221A (en) * | 2013-06-21 | 2013-09-04 | 成都信息工程学院 | Fire protection Internet-of-things system testing method |
| WO2014000269A1 (en) * | 2012-06-29 | 2014-01-03 | Hewlett-Packard Development Company, L.P. | Rule-based automated test data generation |
| CN106656680A (en) * | 2017-02-21 | 2017-05-10 | 张震 | VOIP (Voice over Internet Protocol) test platform and method |
| CN106776280A (en) * | 2016-11-24 | 2017-05-31 | 上海携程商务有限公司 | Configurable performance test device |
Family Cites Families (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US5883883A (en) * | 1996-10-18 | 1999-03-16 | Lucent Technologies Inc. | Apparatus and method for testing the administration of network based supplementary services |
| CN1464684A (en) * | 2002-06-25 | 2003-12-31 | 华为技术有限公司 | Intelligent network service simulation system and method for implementing communication mechanism |
| CN100421391C (en) * | 2003-02-14 | 2008-09-24 | 华为技术有限公司 | Method for implementing automatic test of intelligent service |
| CN100347991C (en) * | 2003-03-14 | 2007-11-07 | 吉林中软吉大信息技术有限公司 | Data network integrated monitoring and measuring system |
| CN100527650C (en) * | 2003-03-31 | 2009-08-12 | 华为技术有限公司 | Intelligent business testing method based on structural unit |
-
2004
- 2004-11-17 CN CN2004100911025A patent/CN100407663C/en active Active
Cited By (19)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101098359B (en) * | 2006-06-27 | 2011-05-11 | 中兴通讯股份有限公司 | Time sharing test approach for tester |
| CN101022375B (en) * | 2007-04-04 | 2010-05-26 | 杭州华三通信技术有限公司 | Centralizing automatic testing device and method for testing radio local network |
| CN101217400B (en) * | 2007-12-29 | 2010-11-03 | 北京亿阳信通软件研究院有限公司 | An integrated intelligent polling method and system |
| CN101221530B (en) * | 2008-01-22 | 2010-06-16 | 中兴通讯股份有限公司 | Method for automatically leading in test cases |
| CN101686178B (en) * | 2008-09-28 | 2012-11-21 | 华为技术有限公司 | Method and system for improving multi-media connection quality, media control and processing equipment |
| CN101788921B (en) * | 2010-02-08 | 2016-07-06 | 深圳市同洲电子股份有限公司 | A kind of analog system of embedded equipment |
| CN101788921A (en) * | 2010-02-08 | 2010-07-28 | 深圳市同洲电子股份有限公司 | Analog system of embedded equipment |
| CN101800680A (en) * | 2010-03-05 | 2010-08-11 | 中兴通讯股份有限公司 | Test device and test method of telecommunication system |
| CN102426567A (en) * | 2011-09-15 | 2012-04-25 | 张德长 | Graphical editing and debugging system of automatic answer system |
| CN102819488A (en) * | 2012-06-29 | 2012-12-12 | 用友软件股份有限公司 | Test processing device and test processing method |
| WO2014000269A1 (en) * | 2012-06-29 | 2014-01-03 | Hewlett-Packard Development Company, L.P. | Rule-based automated test data generation |
| CN102819488B (en) * | 2012-06-29 | 2016-01-20 | 用友网络科技股份有限公司 | Test processes device and test processing method |
| CN102968374B (en) * | 2012-11-29 | 2015-12-09 | 中国移动（深圳）有限公司 | A kind of data warehouse method of testing |
| CN102968374A (en) * | 2012-11-29 | 2013-03-13 | 中国移动（深圳）有限公司 | Data warehouse testing method |
| CN103281221A (en) * | 2013-06-21 | 2013-09-04 | 成都信息工程学院 | Fire protection Internet-of-things system testing method |
| CN103281221B (en) * | 2013-06-21 | 2016-08-10 | 成都信息工程学院 | Fire-fighting Internet of things system method of testing |
| CN106776280A (en) * | 2016-11-24 | 2017-05-31 | 上海携程商务有限公司 | Configurable performance test device |
| CN106776280B (en) * | 2016-11-24 | 2020-10-16 | 上海携程商务有限公司 | Configurable performance testing device |
| CN106656680A (en) * | 2017-02-21 | 2017-05-10 | 张震 | VOIP (Voice over Internet Protocol) test platform and method |
Also Published As
| Publication number | Publication date |
|---|---|
| CN100407663C (en) | 2008-07-30 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US20220253298A1 (en) | Systems and methods for transformation of reporting schema | |
| CN102693183B (en) | Method and system for realizing automatic software testing | |
| WO2019095936A1 (en) | Method and system for building container mirror image, and server, apparatus and storage medium | |
| CN110825369A (en) | Method for automatically generating codes based on java language | |
| Pamidighantam et al. | Community science exemplars in seagrid science gateway: Apache airavata based implementation of advanced infrastructure | |
| CN1780236A (en) | Universal testing system and method for telecommunication intelligent service | |
| CN1171145C (en) | Request dispatch sequence for automatic software configuration | |
| CN106777101B (en) | Data processing engine | |
| EP3731161A1 (en) | Model application method and system, and model management method and server | |
| CN104572122A (en) | Software application data generating device and method | |
| CN107807815A (en) | The method and apparatus of distributed treatment task | |
| CN1832433A (en) | Distribution structure test system and testing method of the test system | |
| CN110162980B (en) | One-stop safety testing and managing method in software development process | |
| US20060225042A1 (en) | Virtual threads in business process programs | |
| CN111666572B (en) | Automatic change infiltration test frame system | |
| US11750688B2 (en) | Cost-aware integration process modeling in multi-cloud computing environment | |
| CN108228464B (en) | Mobile application UI (user interface) testing framework based on data driving and implementation method thereof | |
| CN101042710A (en) | Method and system for implementing acquisition data sharing | |
| CN106484425A (en) | A kind of abnormality eliminating method of policy-based configuration | |
| US6275866B1 (en) | Manipulation and coupling of object oriented components | |
| US20200201660A1 (en) | Database systems and related methods for validation workflows | |
| CN114816499A (en) | Electronic resource sharing method and device and storage medium | |
| US11928083B2 (en) | Determining collaboration recommendations from file path information | |
| CN109840267A (en) | A kind of ETL process system and method | |
| CN112016256A (en) | Integrated circuit development platform, method, storage medium and equipment |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C14 | Grant of patent or utility model | ||
| GR01 | Patent grant |