CN104427547A - Business and network association test method, device and system - Google Patents
Business and network association test method, device and system Download PDFInfo
- Publication number
- CN104427547A CN104427547A CN201310384932.6A CN201310384932A CN104427547A CN 104427547 A CN104427547 A CN 104427547A CN 201310384932 A CN201310384932 A CN 201310384932A CN 104427547 A CN104427547 A CN 104427547A
- Authority
- CN
- China
- Prior art keywords
- test
- index
- terminal
- testing
- testing server
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04W—WIRELESS COMMUNICATION NETWORKS
- H04W24/00—Supervisory, monitoring or testing arrangements
- H04W24/02—Arrangements for optimising operational condition
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04W—WIRELESS COMMUNICATION NETWORKS
- H04W24/00—Supervisory, monitoring or testing arrangements
- H04W24/08—Testing, supervising or monitoring using real traffic
Abstract
The invention discloses a business and network association test method, device and system, and aims at solving a problem that part of complicated test indexes involving protocols in existing business test and network test schemes cannot be directly tested on a terminal. In the business and network association test method, the test indexes of a test task and attribute parameters and performance parameters of the terminal are inputted into a preset decision tree model by the terminal. The decision tree model is operated and test positions of the test indexes are confirmed and obtained. The test positions comprise the terminal and/or a test server. The test indexes are tested by the terminal according to the conformed test positions of the test indexes, or the test server is indicated to test the test indexes so that a test result is obtained, and the test result is analyzed and thus an analysis result is obtained. Therefore, test index testing which cannot be performed on the terminal is realized relying on processing capacity of the test server.
Description
Technical field
The present invention relates to the operational trials technology in mobile communication system, especially relate to a kind of business and network associate method of testing, Apparatus and system.
Background technology
In today of communication network high speed development, data service emerges in an endless stream, and how while guarantee networking, promotes rapidly quality and the network performance of data service, and it is growing to data service diversity and high reliability demand to meet user, become the problem that operator needs to solve.
In order to improve quality of service and network quality, need on business terminal the test carrying out the various index of multiple dimension in data traffic quality and network quality performance etc.
Current operator has following three kinds of schemes in the solution that field tests is main:
" test terminal+drive test software " pattern traditional in scheme one, network monitoring and field tests.This pattern mainly uses the test terminal of specific customization to test for the aspect such as Internet Transmission, signal quality, the data analysis that backstage is collected test terminal, but generally seldom directly to monitor for data traffic quality itself.
Scheme two, manual dialing test pattern are exactly that tester repeatedly uses the use test of general commercial terminal carrying out service, the then various test data of manual record.
Scheme three, intelligent terminal automatic test pattern, the automation testing instrument of such as test program or test agent etc. is installed in intelligent terminal, auto-dial testing instrument modelling customer behavior on intelligent terminal initiates business, then test is performed according to the testing process preset, and in conjunction with method finishing service quality tests such as screenshotss images match and identifications.
In such scheme, the test of network quality or quality of service is normally carried out in end side.
But for such scheme one, the test terminal in scheme one is generally the terminal of specific customization, usually not based on intelligent operating system common on market, do not belong to general commercial terminal yet.The network quality test that main execution is common in such terminal; In scheme one, if concrete a certain basic data business will be tested, then need the test terminal special according to protocol development.And some being carried to the business of client, such business is not special test terminal custom-made client-side program usually, therefore cannot carry out the testing of these business exactly.
For such scheme two, common network quality test also can only be carried out based on common business terminal.
For such scheme three, intelligent terminal is only tested the appreciable index of user in test data business usually, such as speed of download etc., comparatively deficient to the test function of the underlying protocol part of business and network.Further, for the test of subnetwork index, such as, carry out protocol layer analysis by capturing packet, need network side to perform corresponding operation and coordinate complete operation, the existing test function on intelligent terminal cannot complete this class testing.
As fully visible, existing business test and network test scheme at least there are the following problems:
The first, such scheme all can only be tested one of them of network quality and quality of service, all can not test both;
The second, be limited to the disposal ability of terminal, the test index relating to agreement of some of complex cannot directly be tested in terminal.
Summary of the invention
The embodiment of the present invention provides a kind of business and network associate method of testing, Apparatus and system, in order to solve existing operational trials and network test scheme in exist can only test one of them of network quality and quality of service, the problem all can not tested both, and the test index relating to agreement of some of complex cannot directly carry out in terminal the problem of testing one of at least.
Embodiment of the present invention technical scheme is as follows:
The correlation testing method of a kind of business and network, comprise: the test index of test assignment and the property parameters of terminal and performance parameter are input in default decision-tree model by terminal, operational decisions tree-model determines the test position obtaining test index, and test position comprises terminal and/or testing server; Wherein, described default decision-tree model carries out training study according to the classifying rules preset to historical test data to obtain, and the non-leaf nodes of described decision-tree model is classifying rules, leaf node is the test position of test index; Terminal is tested test index according to the test position of determined test index, or instruction testing server is tested test index, obtains test result, and carries out analysis to test result and obtain analysis result.
Wherein, terminal is tested test index according to the test position of determined test index, or instruction testing server is tested test index, obtain test result, specifically comprise: when the test position of determined test index is terminal, terminal is carried out test to test index and is obtained test result; When the test position of determined test index is testing server, terminal sends test post instruction testing server to testing server and tests this test index, and what reception testing server returned tests to this test index the test result obtained; In determined test index, the test position of a part of sub-index is terminal, the test position of another part index is when being testing server, terminal is tested needing the sub-index of testing in terminal, obtain terminal test result, send test post instruction testing server to testing server to test needing the sub-index of testing at testing server in test index, and receive that testing server returns the server test result obtained is tested to the sub-index of this test index; Terminal test result and server test result are merged into test result.
Preferably, described method also comprises: terminal receives and preserves the described default decision-tree model from testing server; Wherein, to be testing server carry out training study according to the classifying rules preset to historical test data to described default decision-tree model obtains.
Particularly, described test assignment comprises measure of the quality of service task or network quality test assignment.
Particularly, described classifying rules at least comprises one of following or combination: the classifying rules of the classifying rules of involved terminals attribute and performance, the classifying rules of relevant service quality, related network quality.
Preferably, described method also comprises: test data is sent to testing server by terminal, test data comprises the test index of test assignment, the property parameters of terminal and performance parameter, test result and analysis result, and test data provides reference for testing server upgrades decision-tree model according to this test data.
A kind of business associates testing apparatus with network, comprise: test position determination module, for the test index of test assignment and the property parameters of terminal and performance parameter are input in default decision-tree model, operational decisions tree-model determines the test position obtaining test index, and test position comprises terminal and/or testing server; Wherein, described default decision-tree model carries out training study according to the classifying rules preset to historical test data to obtain, and the non-leaf nodes of described decision-tree model is classifying rules, leaf node is the test position of test index; Testing execution module, for testing test index according to the test position of the determined test index of described test position determination module, or instruction testing server is tested test index, obtains test result, and carries out analysis to test result and obtain analysis result.
Particularly, testing execution module, specifically for: when the test position of determined test index is terminal, test is carried out to test index and obtains test result; When the test position of determined test index is testing server, send test post instruction testing server to testing server to test this test index, what reception testing server returned tests to this test index the test result obtained; In determined test index, the test position of a part of sub-index is terminal, the test position of another part index is when being testing server, test needing the sub-index of testing in terminal, obtain terminal test result, send test post instruction testing server to testing server to test needing the sub-index of testing at testing server in test index, and receive that testing server returns the server test result obtained is tested to the sub-index of this test index; Terminal test result and server test result are merged into test result.
Preferably, described device also comprises: preserve module, for receiving and preserving the described default decision-tree model from testing server; Wherein, to be testing server carry out training study according to the classifying rules preset to historical test data to described default decision-tree model obtains.Then, testing execution module, also for: test data is sent to testing server, test data comprises the test index of test assignment, the property parameters of terminal and performance parameter, test result and analysis result, and test data provides reference for testing server upgrades decision-tree model according to this test data.
A correlation testing method for business and network, comprising: the test to test index that testing server receives self terminal indicates; Testing server is tested the test index indicated by test instruction.
Particularly, testing server judges to test the need of gathering the relevant parameter of concrete business platform to test index, when being judged as YES, gathers relevant parameter to concrete business platform; Then, testing server is tested test index according to the relevant parameter from business platform collection, obtains test result; Test result is returned to terminal.
Preferably, described method also comprises: testing server carries out to historical test data the decision-tree model that training study obtains according to the classifying rules preset, and this decision tree module is sent to terminal.Testing server receives the test data of self terminal, upgrades decision tree module according to test data; Wherein, test data comprises the test index of test assignment, the property parameters of terminal and performance parameter, test result and analysis result.
Business associates a testing apparatus with network, comprising: transceiver module, indicates for the test to test index receiving self terminal; Test module, the test index indicated by the test for receiving receiver module indicates is tested.
Particularly, test module, also for: judging to test the need of gathering the relevant parameter of concrete business platform to test index, when being judged as YES, gathering relevant parameter to concrete business platform; Then, test module, concrete according to testing from the relevant parameter of business platform collection test index, obtain test result; Transceiver module, also tests test module the test result obtained and returns to terminal.
Preferably, described device also comprises: decision-tree model module, for carrying out to historical test data the decision-tree model that training study obtains according to the classifying rules preset; Then, transceiver module, the decision tree module also for decision-tree model module being obtained sends to terminal.
Preferably, transceiver module is also for receiving the test data of self terminal; Then, decision-tree model module also for: upgrade decision tree module according to test data; Wherein, test data comprises the test index of test assignment, the property parameters of terminal and performance parameter, test result and analysis result.
Business associates a test macro with network, comprising: terminal and testing server; Terminal, for being input in default decision-tree model by the test index of test assignment and the property parameters of terminal and performance parameter, operational decisions tree-model determines the test position obtaining test index, and test position comprises terminal and/or testing server; Wherein, described default decision-tree model carries out training study according to the classifying rules preset to historical test data to obtain, and the non-leaf nodes of described decision-tree model is classifying rules, leaf node is the test position of test index; Terminal is tested test index according to the test position of determined test index, or instruction testing server is tested test index, obtains test result, and carries out analysis to test result and obtain analysis result; Testing server, tests test index for the instruction according to terminal.
The test index of test assignment and the property parameters of terminal and performance parameter are input in default decision-tree model by terminal by the embodiment of the present invention, operational decisions tree-model determines the test position obtaining test index, and test position comprises terminal and/or testing server, wherein, described default decision-tree model carries out training study according to the classifying rules preset to historical test data to obtain, and the non-leaf nodes of described decision-tree model is classifying rules, leaf node is the test position of test index, terminal is tested test index according to the test position of determined test index, or instruction testing server is tested test index, obtains test result, and carries out analysis to test result and obtain analysis result, thus, can at the test position of end side determination test index, and, determine that test index is when testing server side is tested by decision-tree model, because the disposal ability of testing server is stronger than the disposal ability of terminal, can complete and capture the sophisticated functions that packet carries out protocal analysis etc., thus the disposal ability that can rely on testing server realizes the test to the test index cannot tested in terminal, and then the test index relating to agreement of existing some of complex directly cannot carry out the problem of testing in terminal in the scheme that can solve existing operational trials and network test.
Other features and advantages of the present invention will be set forth in the following description, and, partly become apparent from specification, or understand by implementing the present invention.Object of the present invention and other advantages realize by structure specifically noted in write specification, claims and accompanying drawing and obtain.
Accompanying drawing explanation
The structured flowchart associating test macro of the business that Fig. 1 provides for the embodiment of the present invention and network;
The workflow diagram of the correlation testing method of the kind business that Fig. 2 provides for the embodiment of the present invention and network;
Fig. 3 is the schematic diagram of decision-tree model;
Another workflow diagram of the correlation testing method of the kind business that Fig. 4 provides for the embodiment of the present invention and network;
The structured flowchart associating testing apparatus of the business that Fig. 5 provides for the embodiment of the present invention and network;
Another structured flowchart associating testing apparatus of the business that Fig. 6 provides for the embodiment of the present invention and network;
Another workflow diagram of the correlation testing method of the kind business that Fig. 7 a provides for the embodiment of the present invention and network;
Fig. 7 b is the workflow of method shown in Fig. 7 a in specific implementation process;
Another structured flowchart associating testing apparatus of the business that Fig. 8 provides for the embodiment of the present invention and network;
Another structured flowchart associating testing apparatus of the business that Fig. 9 provides for the embodiment of the present invention and network.
Embodiment
Below in conjunction with accompanying drawing, embodiments of the invention are described, should be appreciated that embodiment described herein is only for instruction and explanation of the present invention, is not intended to limit the present invention.
Can only test one of them of network quality and quality of service for existing in the scheme of existing operational trials and network test, all can not test both, and the test index relating to agreement of some of complex directly cannot carry out the problem of testing in terminal, embodiments provide a kind of business and network associate testing scheme, for solving this problem.
In the technical scheme of the embodiment of the present invention, the test index of test assignment and the property parameters of terminal and performance parameter are input in default decision-tree model by terminal, operational decisions tree-model determines the test position obtaining test index, and test position comprises terminal and/or testing server; Wherein, described default decision-tree model carries out training study according to the classifying rules preset to historical test data to obtain, and the non-leaf nodes of described decision-tree model is classifying rules, leaf node is the test position of test index; Terminal is tested test index according to the test position of determined test index, or instruction testing server is tested test index, obtains test result, and carries out analysis to test result and obtain analysis result; Thus, can at the test position of end side determination test index, and, determine that test index is when testing server side is tested by decision-tree model, because the disposal ability of testing server is stronger than the disposal ability of terminal, can complete and capture the sophisticated functions that packet carries out protocal analysis etc., thus the disposal ability that can rely on testing server realizes the test to the test index cannot tested in terminal;
Further, test assignment comprises measure of the quality of service task or network quality test assignment.Thus can realize all testing quality of service and network quality in end side, existing can only test one of them of network quality and quality of service can be solved in the scheme of existing operational trials and network test, the problem all can not tested both.
Below the technical scheme of the embodiment of the present invention is described in detail.
Fig. 1 shows the structured flowchart associating test macro of business that the embodiment of the present invention provides and network, and this system comprises: terminal 1 and testing server 2;
Terminal 1, for being input in default decision-tree model by the test index of test assignment and the property parameters of terminal and performance parameter, operational decisions tree-model determines the test position obtaining test index, and test position comprises terminal 1 and/or testing server 2; Wherein, described default decision-tree model carries out training study according to the classifying rules preset to historical test data to obtain, and the non-leaf nodes of described decision-tree model is classifying rules, leaf node is the test position of test index; Terminal 1 is tested test index according to the test position of determined test index, or instruction testing server 2 pairs of test indexs are tested, and obtain test result, and carries out analysis to test result and obtain analysis result;
Testing server 2, for testing test index according to the instruction of terminal 1.
(1), below the operation principle of terminal in Fig. 11 is described.
Fig. 2 shows the workflow diagram of the correlation testing method of kind business that the embodiment of the present invention provides and network, and the method comprises:
The test index of test assignment and the property parameters of terminal and performance parameter are input in default decision-tree model by step 201, terminal, operational decisions tree-model determines the test position obtaining test index, and test position comprises terminal and/or testing server;
Wherein, the decision-tree model preset is that terminal receives from testing server and preserves, to be testing server carry out training study according to default classifying rules to historical test data to this decision-tree model preset obtains, and the non-leaf nodes of described decision-tree model is classifying rules, leaf node is the test position of test index; Historical test data is test data passing in a large number;
Wherein, test assignment comprises measure of the quality of service task or network quality test assignment;
Fig. 3 shows the schematic diagram of decision-tree model, decision tree take the form of the tree structure being similar to flow chart, property value test is carried out at the internal node of decision tree, also namely according to classifying rules, attribute is classified, and the branch of being drawn by this node is judged according to property value, obtain conclusion at the leaf node of decision tree.Internal node (i.e. non-leaf nodes) is the set (i.e. the combination of classifying rules) of attribute or attribute, and the class belonging to leaf node representative sample or class distribution, such as, leaf node comprises four classes, category-A, category-B, C class, D class.
As long as with attribute---the mode of value is expressed, just this algorithm can be used learn based on the learning algorithm training sample of decision tree.In the training method of decision tree, the most classical method is ID3 method.ID3 algorithm is based on information theory, with comentropy and information gain degree for criterion, thus realizes the inducing classification to data, and it is a generalization procedure of from top to bottom, to divide and rule.The core of ID3 algorithm is: when selecting attribute on decision tree node at different levels, select attribute by computing information gain, to make, when each non-leaf node is tested, can obtain and record maximum classification information about tested.Its concrete grammar is: detect all attributes, the attribute selecting information gain maximum produces decision tree node, branch is set up by the different values of this attribute, again subset recursive call the method for each branch is set up to the branch of decision tree node, until all subsets only comprise other data of same class.
In embodiments of the present invention, predetermined in decision-tree model classifying rules (also namely the parameter of internal node to input of decision tree carries out the judgment condition of property value test) comprises one of at least following or combination: the classifying rules of the classifying rules of involved terminals attribute and performance, the classifying rules of relevant service quality, related network quality; Wherein, the classifying rules of involved terminals attribute and performance includes but not limited to: the model of terminal, the frequency of central processing unit (CPU) of terminal, the computing capability etc. of terminal, the classifying rules of relevant service quality includes but not limited to: be whether voice recognition tasks, whether for the task of testing the speed, whether be that FTP downloads and tests the speed etc., the classifying rules of related network quality includes but not limited to: whether test index comprises the sub-index, subzone network quality, busy duration etc. that needs are tested in testing server;
In the present invention, determine that according to decision-tree model the test position of the test index obtained comprises at least following three kinds of situations: test position is in terminal, test position is at testing server, the test position of the sub-index of a part of test index at the test position of terminal, the sub-index of another part at testing server, first two situation can be called independent test, and the third situation can be called association test; And, according to the difference of various terminal specific performance, the test position of test index can also be changed between the first situation and the second situation, particularly, when the performance of terminal is lower than predetermined performance standard, the test position of test index is testing server, when the performance of terminal is higher than predetermined performance standard, the test position of test index is terminal, thus guarantee that test index can be tested effectively, wherein, predetermined performance standard can be expressed by the attribute and performance defining terminal;
Composition graphs 3, the example shown in table 1 describes the classification situation of test position:
Table 1
Wherein, test index 1 will be tested the quality of FTP downloading service, the sub-index of this index comprises time delay and the speed of download, test position is terminal, do not comprise the sub-index needing testing server to test, computation complexity is low, the leaf node of test index 1 in decision-tree model be categorized as A;
Test index 2 will be tested the quality of WEB page downloading service, the sub-index of this index comprises: the quantity of the pagefile element downloaded, the duration of download, the speed of download, the parsing duration of IP packet, test position is terminal, do not comprise the sub-index that needs are tested at testing server, computation complexity is lower, the leaf node of test index 2 in decision-tree model be categorized as B;
Test index 3 will be tested the quality of voice Mytip business, the network that the index of testing comprises business sets up duration, language pack size, transmission of voice packets duration, speech recognition accuracy, wherein, sub-index: the network of business set up duration, language pack size, transmission of voice packets duration test position be terminal, sub-index: the test position of speech recognition accuracy is testing server, computation complexity is higher, the leaf node of test index 3 in decision-tree model be categorized as C;
Test index 4 will be tested the quality of video traffic, the index of test comprises: the quantity of the video packets of data that terminal receives and duration, parsing accuracy to protocol package, wherein, sub-index: the quantity of the video packets of data that terminal receives and the test position of duration are terminal, sub-index: be testing server to the test position of the parsing accuracy of protocol package, computation complexity is high, the leaf node of test index 4 in decision-tree model be categorized as D;
By the processing procedure of step 201, the test position obtaining the test index of quality of service or the test index of network quality effectively can be determined;
Step 202, terminal are tested test index according to the test position of determined test index, or instruction testing server is tested test index, obtains test result, and carries out analysis to test result and obtain analysis result.
Particularly, when the test position of determined test index is terminal, terminal is carried out test to test index and is obtained test result;
When the test position of determined test index is testing server, terminal sends test post instruction testing server to testing server and tests this test index, and what reception testing server returned tests to this test index the test result obtained;
In determined test index, the test position of a part of sub-index is terminal, the test position of another part index is when being testing server, terminal is tested needing the sub-index of testing in terminal, obtain terminal test result, send test post instruction testing server to testing server to test needing the sub-index of testing at testing server in test index, and receive that testing server returns the server test result obtained is tested to the sub-index of this test index; Terminal test result and server test result are merged into test result;
By step 202, according to the test position of determined test index, test index can be tested.
Visible, by the processing procedure shown in Fig. 2, by terminal, the test index of test assignment and the property parameters of terminal and performance parameter are input in default decision-tree model, operational decisions tree-model determines the test position obtaining test index, and test position comprises terminal and/or testing server, terminal is tested test index according to the test position of determined test index, or instruction testing server is tested test index, obtains test result, and carries out analysis to test result and obtain analysis result, thus, can at the test position of end side determination test index, and, determine that test index is when testing server side is tested by decision-tree model, because the disposal ability of testing server is stronger than the disposal ability of terminal, can complete and capture the sophisticated functions that packet carries out protocal analysis etc., thus the disposal ability that can rely on testing server realizes the test to the test index cannot tested in terminal, and then the test index relating to agreement of existing some of complex directly cannot carry out the problem of testing in terminal in the scheme that can solve existing operational trials and network test.
Further, test assignment comprises measure of the quality of service task or network quality test assignment.Thus can realize all testing quality of service and network quality in end side, existing can only test one of them of network quality and quality of service can be solved in the scheme of existing operational trials and network test, the problem all can not tested both.
Preferably, on the basis of method shown in Fig. 2, as shown in Figure 4, terminal is after completing the test to test index, and the method also comprises:
Test data is also sent to testing server by step 203, terminal, test data comprises the test index of test assignment, the property parameters of terminal and performance parameter, test result and analysis result, and test data provides reference for testing server upgrades decision-tree model according to this test data.
Thus test data is sent to testing service by terminal, provide Data support for testing server improves decision-tree model further.
Based on identical inventive concept, what the embodiment of the present invention additionally provided a kind of business and network associates testing apparatus, and this device is arranged in terminal.
Fig. 5 shows the structured flowchart associating testing apparatus of business that the embodiment of the present invention provides and network, and this device comprises:
Test position determination module 51, for the test index of test assignment and the property parameters of terminal and performance parameter are input in default decision-tree model, operational decisions tree-model determines the test position obtaining test index, and test position comprises terminal and/or testing server; Wherein, described default decision-tree model carries out training study according to the classifying rules preset to historical test data to obtain, and the non-leaf nodes of described decision-tree model is classifying rules, leaf node is the test position of test index;
Testing execution module 52, be connected to test position determination module 51, for testing test index according to the test position of the determined test index of described test position determination module 51, or instruction testing server is tested test index, obtain test result, and analysis is carried out to test result obtain analysis result;
Particularly, testing execution module 52, when the test position of determined test index is terminal, is carried out test to test index and is obtained test result;
When the test position of determined test index is testing server, send test post instruction testing server to testing server to test this test index, what reception testing server returned tests to this test index the test result obtained;
In determined test index, the test position of a part of sub-index is terminal, the test position of another part index is when being testing server, test needing the sub-index of testing in terminal, obtain terminal test result, send test post instruction testing server to testing server to test needing the sub-index of testing at testing server in test index, and receive that testing server returns the server test result obtained is tested to the sub-index of this test index; Terminal test result and server test result are merged into test result.
Preferably, as shown in Figure 6, on the basis of Fig. 5 shown device, the business that the embodiment of the present invention provides also comprises with the testing apparatus that associates of network:
Preserve module 53, be connected to test position determination module 51, for receiving and preserving the described default decision-tree model from testing server; Wherein, to be testing server carry out training study according to the classifying rules preset to historical test data to described default decision-tree model obtains.
Preferably, testing execution module 52, also for: test data is sent to testing server, test data comprises the test index of test assignment, the property parameters of terminal and performance parameter, test result and analysis result, and test data provides reference for testing server upgrades decision-tree model according to this test data.
By the device shown in Fig. 5 or Fig. 6, can realize all testing quality of service and network quality in end side, and, when determining that test index is tested in testing server side, because the disposal ability of testing server is stronger than the disposal ability of terminal, can complete and capture the sophisticated functions that packet carries out protocal analysis etc., thus the disposal ability that can rely on testing server realizes the test to the test index cannot tested in terminal.And then existingly in the scheme that can solve existing operational trials and network test can only to test one of them of network quality and quality of service, all can not test both, and the test index relating to agreement of some of complex directly cannot carry out the problem of testing in terminal.
(2), below the operation principle of testing server is described.
Fig. 7 a shows the workflow diagram of testing server in Fig. 1, is also the operation principle of testing server, comprises:
The test to test index that step 701, testing server receive self terminal indicates;
Step 702, testing server are tested the test index indicated by test instruction.
By above-mentioned processing procedure, the test that can realize the test index cannot tested in terminal by the disposal ability of testing server, thus the test index relating to agreement that can solve some of complex existing in the scheme of existing operational trials and network test directly cannot carry out the problem of testing in terminal.
Fig. 7 b shows the workflow of method shown in Fig. 7 a in specific implementation process, and this handling process comprises:
Step 7011, testing server receive the instruction of self terminal;
Step 7012, judge to test the need of gathering the relevant parameter of concrete business platform to the test index indicated by terminal, when being judged as YES, process proceeds to step 7013, and when being judged as NO, process proceeds to step 7022;
Step 7013, collection relevant parameter to concrete business platform;
Step 7021, basis are tested from the relevant parameter of business platform collection test index, obtain test result, and process proceeds to step 7023;
Step 7022, test index to be tested, obtain test result;
Step 7023, test result is returned to terminal.
By above-mentioned processing procedure, the test that can realize the test index cannot tested in terminal by the disposal ability of testing server, thus the test index relating to agreement that can solve some of complex existing in the scheme of existing operational trials and network test directly cannot carry out the problem of testing in terminal.
Preferably, testing server also carries out to historical test data the decision-tree model that training study obtains according to the classifying rules preset, and this decision tree module is sent to terminal.And, receive the test data of self terminal, upgrade decision tree module according to test data; Wherein, test data comprises the test index of test assignment, the property parameters of terminal and performance parameter, test result and analysis result.
Thus testing server can obtain the decision-tree model of the test position for determining test index.
Based on identical inventive concept, what the embodiment of the present invention additionally provided a kind of business and network associates testing apparatus, and this device is arranged in testing server.
Fig. 8 shows the structured flowchart associating testing apparatus of business that the embodiment of the present invention provides and network, and this device comprises:
Transceiver module 81, indicates for the test to test index receiving self terminal;
Test module 82, is connected to transceiver module 81, and the test index indicated by the test for receiving transceiver module 81 indicates is tested.
Particularly, test module 82, also for: judging to test the need of gathering the relevant parameter of concrete business platform to test index, when being judged as YES, gathering relevant parameter to concrete business platform; Then, test module 82, concrete according to testing from the relevant parameter of business platform collection test index, obtain test result; Transceiver module, also tests test module the test result obtained and returns to terminal.
Preferably, as shown in Figure 9, the business that the embodiment of the present invention provides also comprises with the testing apparatus that associates of network:
Decision-tree model module 83, for carrying out to historical test data the decision-tree model that training study obtains according to the classifying rules preset; Then, transceiver module 81, is also connected to decision-tree model module 83, and the decision tree module also for decision-tree model module 83 being obtained sends to terminal.
Transceiver module 81, also for receiving the test data of self terminal; Then,
Decision-tree model module 83 also for: upgrade decision tree module according to test data; Wherein, test data comprises the test index of test assignment, the property parameters of terminal and performance parameter, test result and analysis result.
By the device shown in Fig. 8 or Fig. 9, the test that also can realize the test index cannot tested in terminal by the disposal ability of testing server, thus the test index relating to agreement that can solve some of complex existing in the scheme of existing operational trials and network test directly cannot carry out the problem of testing in terminal.
In sum, the embodiment of the present invention determines the test position of the test index of quality of service or the test index of network quality according to the decision-tree model preset by terminal, and test accordingly according to determined test position, can only test quality of service or network quality compared to prior art, the breadth and depth of test can be expanded, and tested by the association of terminal and/or testing server, test by means of only terminal compared to existing technology, the test to the higher test index of computation complexity can be realized, thus existing can only test one of them of network quality and quality of service can be solved in the scheme of existing operational trials and network test, all can not test both, and the test index relating to agreement of some of complex directly cannot carry out the problem of testing in terminal.
One of ordinary skill in the art will appreciate that realizing all or part of step that above-described embodiment method carries is that the hardware that can carry out instruction relevant by program completes, described program can be stored in a kind of computer-readable recording medium, this program perform time, step comprising embodiment of the method one or a combination set of.
In addition, each functional unit in each embodiment of the present invention can be integrated in a processing module, also can be that the independent physics of unit exists, also can be integrated in a module by two or more unit.Above-mentioned integrated module both can adopt the form of hardware to realize, and the form of software function module also can be adopted to realize.If described integrated module using the form of software function module realize and as independently production marketing or use time, also can be stored in a computer read/write memory medium.
Those skilled in the art should understand, embodiments of the invention can be provided as method, system or computer program.Therefore, the present invention can adopt the form of complete hardware embodiment, completely software implementation or the embodiment in conjunction with software and hardware aspect.And the present invention can adopt in one or more form wherein including the upper computer program implemented of computer-usable storage medium (including but not limited to magnetic disc store and optical memory etc.) of computer usable program code.
The present invention describes with reference to according to the flow chart of the method for the embodiment of the present invention, equipment (system) and computer program and/or block diagram.Should understand can by the combination of the flow process in each flow process in computer program instructions realization flow figure and/or block diagram and/or square frame and flow chart and/or block diagram and/or square frame.These computer program instructions can being provided to the processor of all-purpose computer, special-purpose computer, Embedded Processor or other programmable data processing device to produce a machine, making the instruction performed by the processor of computer or other programmable data processing device produce device for realizing the function of specifying in flow chart flow process or multiple flow process and/or block diagram square frame or multiple square frame.
These computer program instructions also can be stored in can in the computer-readable memory that works in a specific way of vectoring computer or other programmable data processing device, the instruction making to be stored in this computer-readable memory produces the manufacture comprising command device, and this command device realizes the function of specifying in flow chart flow process or multiple flow process and/or block diagram square frame or multiple square frame.
These computer program instructions also can be loaded in computer or other programmable data processing device, make on computer or other programmable devices, to perform sequence of operations step to produce computer implemented process, thus the instruction performed on computer or other programmable devices is provided for the step realizing the function of specifying in flow chart flow process or multiple flow process and/or block diagram square frame or multiple square frame.
Obviously, those skilled in the art can carry out various change and modification to the present invention and not depart from the spirit and scope of the present invention.Like this, if these amendments of the present invention and modification belong within the scope of the claims in the present invention and equivalent technologies thereof, then the present invention is also intended to comprise these change and modification.
Claims (19)
1. a correlation testing method for business and network, is characterized in that, comprising:
The test index of test assignment and the property parameters of terminal and performance parameter are input in default decision-tree model by terminal, and operational decisions tree-model determines the test position obtaining test index, and test position comprises terminal and/or testing server; Wherein, described default decision-tree model carries out training study according to the classifying rules preset to historical test data to obtain, and the non-leaf nodes of described decision-tree model is classifying rules, leaf node is the test position of test index;
Terminal is tested test index according to the test position of determined test index, or instruction testing server is tested test index, obtains test result, and carries out analysis to test result and obtain analysis result.
2. method according to claim 1, is characterized in that, terminal is tested test index according to the test position of determined test index, or instruction testing server is tested test index, obtains test result, specifically comprises:
When the test position of determined test index is terminal, terminal is carried out test to test index and is obtained test result;
When the test position of determined test index is testing server, terminal sends test post instruction testing server to testing server and tests this test index, and what reception testing server returned tests to this test index the test result obtained;
In determined test index, the test position of a part of sub-index is terminal, the test position of another part index is when being testing server, terminal is tested needing the sub-index of testing in terminal, obtain terminal test result, send test post instruction testing server to testing server to test needing the sub-index of testing at testing server in test index, and receive that testing server returns the server test result obtained is tested to the sub-index of this test index; Terminal test result and server test result are merged into test result.
3. method according to claim 1, is characterized in that, described method also comprises:
Terminal receives and preserves the described default decision-tree model from testing server; Wherein, to be testing server carry out training study according to the classifying rules preset to historical test data to described default decision-tree model obtains.
4. method according to claim 1, is characterized in that, described test assignment comprises measure of the quality of service task or network quality test assignment.
5. method according to claim 1, is characterized in that, described classifying rules at least comprises one of following or combination:
The classifying rules of the classifying rules of involved terminals attribute and performance, the classifying rules of relevant service quality, related network quality.
6. method according to claim 3, is characterized in that, described method also comprises:
Test data is sent to testing server by terminal, test data comprises the test index of test assignment, the property parameters of terminal and performance parameter, test result and analysis result, and test data provides reference for testing server upgrades decision-tree model according to this test data.
7. business and network associate a testing apparatus, it is characterized in that, comprising:
Test position determination module, for the test index of test assignment and the property parameters of terminal and performance parameter are input in default decision-tree model, operational decisions tree-model determines the test position obtaining test index, and test position comprises terminal and/or testing server; Wherein, described default decision-tree model carries out training study according to the classifying rules preset to historical test data to obtain, and the non-leaf nodes of described decision-tree model is classifying rules, leaf node is the test position of test index;
Testing execution module, for testing test index according to the test position of the determined test index of described test position determination module, or instruction testing server is tested test index, obtains test result, and carries out analysis to test result and obtain analysis result.
8. device according to claim 7, is characterized in that, testing execution module, specifically for:
When the test position of determined test index is terminal, test is carried out to test index and obtains test result;
When the test position of determined test index is testing server, send test post instruction testing server to testing server to test this test index, what reception testing server returned tests to this test index the test result obtained;
In determined test index, the test position of a part of sub-index is terminal, the test position of another part index is when being testing server, test needing the sub-index of testing in terminal, obtain terminal test result, send test post instruction testing server to testing server to test needing the sub-index of testing at testing server in test index, and receive that testing server returns the server test result obtained is tested to the sub-index of this test index; Terminal test result and server test result are merged into test result.
9. device according to claim 7, is characterized in that, described device also comprises:
Preserve module, for receiving and preserving the described default decision-tree model from testing server; Wherein, to be testing server carry out training study according to the classifying rules preset to historical test data to described default decision-tree model obtains.
10. device according to claim 9, is characterized in that, testing execution module, also for:
Test data is sent to testing server, test data comprises the test index of test assignment, the property parameters of terminal and performance parameter, test result and analysis result, and test data provides reference for testing server upgrades decision-tree model according to this test data.
The correlation testing method of 11. 1 kinds of business and network, is characterized in that, comprising:
The test to test index that testing server receives self terminal indicates;
Testing server is tested the test index indicated by test instruction.
12. methods according to claim 11, is characterized in that, described method also comprises:
Testing server judges to test the need of gathering the relevant parameter of concrete business platform to test index, when being judged as YES, gathers relevant parameter to concrete business platform; Then,
Testing server is tested test index according to the relevant parameter from business platform collection, obtains test result;
Test result is returned to terminal.
13. methods according to claim 11, is characterized in that, described method also comprises:
Testing server carries out to historical test data the decision-tree model that training study obtains according to the classifying rules preset, and this decision tree module is sent to terminal.
14. methods according to claim 13, is characterized in that, described method also comprises:
Testing server receives the test data of self terminal, upgrades decision tree module according to test data; Wherein, test data comprises the test index of test assignment, the property parameters of terminal and performance parameter, test result and analysis result.
15. 1 kinds of business associate testing apparatus with network, it is characterized in that, comprising:
Transceiver module, indicates for the test to test index receiving self terminal;
Test module, the test index indicated by the test for receiving receiver module indicates is tested.
16. devices according to claim 15, is characterized in that, test module, also for:
Judging to test the need of gathering the relevant parameter of concrete business platform to test index, when being judged as YES, gathering relevant parameter to concrete business platform; Then,
Test module, concrete according to testing from the relevant parameter of business platform collection test index, obtain test result;
Transceiver module, also tests test module the test result obtained and returns to terminal.
17. devices according to claim 15, is characterized in that, described device also comprises:
Decision-tree model module, for carrying out to historical test data the decision-tree model that training study obtains according to the classifying rules preset; Then,
Transceiver module, the decision tree module also for decision-tree model module being obtained sends to terminal.
18. devices according to claim 17, is characterized in that, transceiver module is also for receiving the test data of self terminal; Then,
Decision-tree model module also for: upgrade decision tree module according to test data; Wherein, test data comprises the test index of test assignment, the property parameters of terminal and performance parameter, test result and analysis result.
19. 1 kinds of business associate test macro with network, it is characterized in that, comprising: terminal and testing server;
Terminal, for being input in default decision-tree model by the test index of test assignment and the property parameters of terminal and performance parameter, operational decisions tree-model determines the test position obtaining test index, and test position comprises terminal and/or testing server; Wherein, described default decision-tree model carries out training study according to the classifying rules preset to historical test data to obtain, and the non-leaf nodes of described decision-tree model is classifying rules, leaf node is the test position of test index; Terminal is tested test index according to the test position of determined test index, or instruction testing server is tested test index, obtains test result, and carries out analysis to test result and obtain analysis result;
Testing server, tests test index for the instruction according to terminal.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201310384932.6A CN104427547B (en) | 2013-08-29 | 2013-08-29 | Business and network associate method of testing, apparatus and system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201310384932.6A CN104427547B (en) | 2013-08-29 | 2013-08-29 | Business and network associate method of testing, apparatus and system |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN104427547A true CN104427547A (en) | 2015-03-18 |
| CN104427547B CN104427547B (en) | 2017-11-21 |
Family
ID=52975236
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201310384932.6A Active CN104427547B (en) | 2013-08-29 | 2013-08-29 | Business and network associate method of testing, apparatus and system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN104427547B (en) |
Cited By (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105281978A (en) * | 2015-10-23 | 2016-01-27 | 小米科技有限责任公司 | Performance test method, device and system |
| CN106803799A (en) * | 2015-11-26 | 2017-06-06 | 阿里巴巴集团控股有限公司 | A kind of performance test methods and device |
| CN107908558A (en) * | 2017-11-14 | 2018-04-13 | 广东华仝九方科技有限公司 | A kind of mobile phone client software quality automatic evaluating method |
| CN109902251A (en) * | 2019-01-17 | 2019-06-18 | 平安城市建设科技(深圳)有限公司 | Scheme Choice method, apparatus, terminal and readable storage medium storing program for executing based on decision tree |
| CN110445653A (en) * | 2019-08-12 | 2019-11-12 | 灵长智能科技(杭州)有限公司 | Network state prediction technique, device, equipment and medium |
| CN111400147A (en) * | 2019-01-02 | 2020-07-10 | 中国移动通信有限公司研究院 | Service quality testing method, device and system |
| CN112527621A (en) * | 2019-09-17 | 2021-03-19 | 中移动信息技术有限公司 | Test path construction method, device, equipment and storage medium |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20030163770A1 (en) * | 2002-02-28 | 2003-08-28 | Webster Robert Charles | Stochastic simulation of computer activity based on user categories |
| CN102014016A (en) * | 2010-08-31 | 2011-04-13 | 北京邮电大学 | System and method for testing defects of network protocol |
| CN102035698A (en) * | 2011-01-06 | 2011-04-27 | 西北工业大学 | HTTP tunnel detection method based on decision tree classification algorithm |
| CN102420727A (en) * | 2012-01-05 | 2012-04-18 | 北京邮电大学 | Distributed protocol test system and method |
| CN102740328A (en) * | 2011-04-13 | 2012-10-17 | 中国移动通信集团公司 | Remote test method, device thereof and system thereof |
-
2013
- 2013-08-29 CN CN201310384932.6A patent/CN104427547B/en active Active
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20030163770A1 (en) * | 2002-02-28 | 2003-08-28 | Webster Robert Charles | Stochastic simulation of computer activity based on user categories |
| CN102014016A (en) * | 2010-08-31 | 2011-04-13 | 北京邮电大学 | System and method for testing defects of network protocol |
| CN102035698A (en) * | 2011-01-06 | 2011-04-27 | 西北工业大学 | HTTP tunnel detection method based on decision tree classification algorithm |
| CN102740328A (en) * | 2011-04-13 | 2012-10-17 | 中国移动通信集团公司 | Remote test method, device thereof and system thereof |
| CN102420727A (en) * | 2012-01-05 | 2012-04-18 | 北京邮电大学 | Distributed protocol test system and method |
Cited By (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105281978A (en) * | 2015-10-23 | 2016-01-27 | 小米科技有限责任公司 | Performance test method, device and system |
| CN105281978B (en) * | 2015-10-23 | 2019-02-19 | 小米科技有限责任公司 | A kind of methods, devices and systems of performance test |
| CN106803799A (en) * | 2015-11-26 | 2017-06-06 | 阿里巴巴集团控股有限公司 | A kind of performance test methods and device |
| CN107908558A (en) * | 2017-11-14 | 2018-04-13 | 广东华仝九方科技有限公司 | A kind of mobile phone client software quality automatic evaluating method |
| CN111400147A (en) * | 2019-01-02 | 2020-07-10 | 中国移动通信有限公司研究院 | Service quality testing method, device and system |
| CN111400147B (en) * | 2019-01-02 | 2023-05-05 | 中国移动通信有限公司研究院 | Service quality testing method, device and system |
| CN109902251A (en) * | 2019-01-17 | 2019-06-18 | 平安城市建设科技(深圳)有限公司 | Scheme Choice method, apparatus, terminal and readable storage medium storing program for executing based on decision tree |
| CN110445653A (en) * | 2019-08-12 | 2019-11-12 | 灵长智能科技(杭州)有限公司 | Network state prediction technique, device, equipment and medium |
| CN110445653B (en) * | 2019-08-12 | 2022-03-29 | 灵长智能科技(杭州)有限公司 | Network state prediction method, device, equipment and medium |
| CN112527621A (en) * | 2019-09-17 | 2021-03-19 | 中移动信息技术有限公司 | Test path construction method, device, equipment and storage medium |
Also Published As
| Publication number | Publication date |
|---|---|
| CN104427547B (en) | 2017-11-21 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN104427547A (en) | Business and network association test method, device and system | |
| CN110365503B (en) | Index determination method and related equipment thereof | |
| TW201830929A (en) | Context-based detection of anomalous behavior in network traffic patterns | |
| US11539590B2 (en) | Detect impact of network maintenance in software defined infrastructure | |
| CN108399114A (en) | A kind of system performance testing method, apparatus and storage medium | |
| CN108681667A (en) | A kind of unit type recognition methods, device and processing equipment | |
| CN110147237A (en) | A kind of redundant resource minimizing technology and device | |
| WO2022001918A1 (en) | Method and apparatus for building predictive model, computing device, and storage medium | |
| CN108768695A (en) | The problem of KQI localization method and device | |
| CN109818820A (en) | Data on flows monitoring method, device, electronic equipment and storage medium | |
| CN108959048A (en) | The method for analyzing performance of modular environment, device and can storage medium | |
| CN104717670A (en) | Business quality testing method, device and system | |
| CN109743745A (en) | The recognition methods of mobile network's access style, device, electronic equipment and storage medium | |
| CN111163482B (en) | Data processing method, device and storage medium | |
| US11558769B2 (en) | Estimating apparatus, system, method, and computer-readable medium, and learning apparatus, method, and computer-readable medium | |
| CN109040744B (en) | Method, device and storage medium for predicting key quality index of video service | |
| CN106549827A (en) | The detection method and device of network state | |
| CN105721392B (en) | A kind of method, apparatus and system for recommending application | |
| CN113660687A (en) | Network difference cell processing method, device, equipment and storage medium | |
| CN116719750A (en) | Software testing method and device, server equipment and storage medium | |
| CN117042026A (en) | Business visualization model construction method, device, equipment, medium and program product | |
| CN112420019B (en) | Equipment testing method and device | |
| CN112488491B (en) | Petri network-based train control vehicle-mounted equipment access process reliability evaluation method | |
| CN106941705A (en) | A kind of network setting method and device | |
| CN111835541B (en) | Method, device, equipment and system for detecting aging of flow identification model |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |