CN104427547B - Business and network associate method of testing, apparatus and system - Google Patents
Business and network associate method of testing, apparatus and system Download PDFInfo
- Publication number
- CN104427547B CN104427547B CN201310384932.6A CN201310384932A CN104427547B CN 104427547 B CN104427547 B CN 104427547B CN 201310384932 A CN201310384932 A CN 201310384932A CN 104427547 B CN104427547 B CN 104427547B
- Authority
- CN
- China
- Prior art keywords
- test
- index
- terminal
- server
- tested
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04W—WIRELESS COMMUNICATION NETWORKS
- H04W24/00—Supervisory, monitoring or testing arrangements
- H04W24/02—Arrangements for optimising operational condition
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04W—WIRELESS COMMUNICATION NETWORKS
- H04W24/00—Supervisory, monitoring or testing arrangements
- H04W24/08—Testing, supervising or monitoring using real traffic
Landscapes
- Engineering & Computer Science (AREA)
- Computer Networks & Wireless Communication (AREA)
- Signal Processing (AREA)
- Data Exchanges In Wide-Area Networks (AREA)
Abstract
The invention discloses a kind of business and network associate method of testing, apparatus and system, to solve the problems, such as that the test index for being related to agreement of some of complex in the scheme of existing operational trials and network test can not be tested directly in terminal.In the present invention, the property parameters and performance parameter of the test index of test assignment and terminal are input in default decision-tree model by terminal, operational decisions tree-model determines to obtain the test position of test index, and test position includes terminal and/or test server；Terminal test position of test index determined by is tested test index, or instruction test server is tested test index, obtains test result, and test result is analyzed to obtain analysis result.Realized so as to rely on the disposal ability of test server to can not be in the test for the test index that terminal is tested.
Description
Technical field
The present invention relates to the operational trials technology in GSM, is surveyed more particularly, to a kind of business and network associate
Method for testing, apparatus and system.
Background technology
In today of communication network high speed development, data service emerges in an endless stream, fast how while networking is ensured
The quality and network performance of speed lifting data service, and meet that user is growing to data service diversity and high reliability
Demand, turning into operator needs to solve the problems, such as.
In order to improve quality of service and network quality, it is necessary to data traffic quality and network quality on business terminal
Energy etc. carries out the test of multiple various indexs of dimension.
Current operator has following three kinds of schemes in the main solution of testing field：
Traditional " test terminal+drive test software " pattern in scheme one, network monitoring and testing field.The pattern mainly makes
Tested for network transmission, signal quality etc. with the test terminal of specific customization, test terminal is collected into from the background
Data analyzed, but be typically seldom monitored in itself directly against data traffic quality.
Scheme two, manual dialing test pattern, it is exactly that tester repeatedly uses survey using general commercial terminal progress business
Try, then the various test datas of manual record.
Scheme three, intelligent terminal automatic test pattern, by the automation of test program or test agent etc.
Testing instrument is installed in intelligent terminal, and auto-dial testing instrument modelling customer behavior on intelligent terminal initiates business, then presses
The methods of performing test according to default testing process, and combining screenshotss images match and identification finishing service quality test.
In such scheme, the test to network quality or quality of service is typically to be carried out in end side.
But for such scheme one, the test terminal in scheme one is generally the terminal of specific customization, is generally not based on
The common intelligent operating system of in the market, is also not belonging to general commercial terminal.Common net is mainly performed in such terminal
Network quality test；In scheme one, if to test specific a certain basic data business, need special according to protocol development
Test terminal.And for some carry the business of client, such business is usually not whole for special test
Custom-made client-side program is held, therefore the testing of these business can not be carried out exactly.
For such scheme two, common network quality test can only be also carried out based on common business terminal.
For such scheme three, generally only the appreciable index of user in test data business is carried out on intelligent terminal
Test, such as speed of download etc. are comparatively deficient to the test function of business and the underlying protocol part of network.It is also, right
Protocol layer analysis is carried out, it is necessary to which network side performs corresponding behaviour in the test of subnetwork index, such as by capturing packet
Make to complete to operate to coordinate, the existing test function on intelligent terminal can not complete this class testing.
As fully visible, at least there are the following problems in the scheme of existing business test and network test：
Firstth, such scheme can only be tested one of network quality and quality of service, it is impossible to this two
Person is tested；
Secondth, the disposal ability of terminal is limited to, the test index for being related to agreement of some of complex can not be directly in terminal
On tested.
The content of the invention
The embodiment of the present invention provides a kind of business and network associate method of testing, apparatus and system, existing to solve
One of network quality and quality of service can only be tested present in the scheme of operational trials and network test, no
Can be to both testing the problem of, and the test index for being related to agreement of some of complex can not be directly enterprising in terminal
At least one of the problem of row test.
Technical scheme of the embodiment of the present invention is as follows：
A kind of correlation testing method of business and network, including：Terminal is by the test index of test assignment and terminal
Property parameters and performance parameter are input in default decision-tree model, and operational decisions tree-model determines to obtain the survey of test index
Position is tried, test position includes terminal and/or test server；Wherein, the default decision-tree model is according to default
Classifying rules is trained what study obtained to historical test data, and the non-leaf nodes of the decision-tree model is classification gauge
Then, leaf node is the test position of test index；The test position of terminal test index determined by is to test index
Tested, or instruction test server is tested test index, obtains test result, and test result is divided
Analysis obtains analysis result.
Wherein, terminal test position of test index determined by is tested test index, or instruction is surveyed
Examination server is tested test index, is obtained test result, is specifically included：In the test position of identified test index
In the case of terminal, terminal-pair test index is tested to obtain test result；In the test position of identified test index
In the case of being set to test server, terminal sends test post to test server and indicates test server to the test index
Tested, receive that test server returns is tested the test index obtained test result；In identified survey
The test position for trying a part of sub- index in index is terminal, the feelings that the test position of the sub- index of another part is test server
Under condition, the sub- index that terminal-pair needs to be tested in terminal is tested, and obtains terminal test result, is sent out to test server
Test post instruction test server is sent to test the sub- index for needing to be tested in test server in test index,
And the sub- index to the test index for receiving test server return is tested obtained server test result；By terminal
Test result and server test result merge into test result.
Preferably, methods described also includes：Terminal receives and preserves the default decision tree from test server
Model；Wherein, the default decision-tree model is that test server is entered according to default classifying rules to historical test data
Row training study obtains.
Specifically, the test assignment includes measure of the quality of service task or network quality test assignment.
Specifically, the classifying rules comprises at least one below or combination：Classification gauge about terminal attribute and performance
Then, the classifying rules about quality of service, the classifying rules of related network quality.
Preferably, methods described also includes：Test data is sent to test server by terminal, and test data includes test
The test index of task, the property parameters of terminal and performance parameter, test result and analysis result, test data are testing service
Device updates decision-tree model according to the test data and provides reference.
A kind of association test device of business and network, including：Test position determining module, for by the survey of test assignment
The property parameters and performance parameter of examination index and terminal are input in default decision-tree model, and operational decisions tree-model determines
The test position of test index is obtained, test position includes terminal and/or test server；Wherein, the default decision tree
Model is trained study to historical test data according to default classifying rules and obtained, the n omicronn-leaf of the decision-tree model
The test position that child node is classifying rules, leaf node is test index；Testing execution module, for according to the test position
The test position for putting test index determined by determining module is tested test index, or instruction test server is to surveying
Examination index is tested, and obtains test result, and test result is analyzed to obtain analysis result.
Specifically, testing execution module, it is specifically used for：In the situation that the test position of identified test index is terminal
Under, test index is tested to obtain test result；It is test server in the test position of identified test index
In the case of, send test post instruction test server to test server and the test index is tested, receive test clothes
What business device returned is tested the test index obtained test result；A part of sub- index in identified test index
Test position be in the case that terminal, the test position of the sub- index of another part are test server, to needing to enter in terminal
The sub- index of row test is tested, and obtains terminal test result, and test post instruction testing service is sent to test server
Device is tested the sub- index for needing to be tested in test server in test index, and receives test server return
Obtained server test result is tested to the sub- index of the test index；By terminal test result and server test knot
Fruit merges into test result.
Preferably, described device also includes：Preserving module, it is described default from test server for receiving and preserving
Decision-tree model；Wherein, the default decision-tree model is that test server is surveyed according to default classifying rules to history
Examination data are trained what study obtained.Then, testing execution module, it is additionally operable to：Test data is sent to test server, surveyed
Examination data include test index, the property parameters and performance parameter of terminal, the test result and analysis result of test assignment, test
Data update decision-tree model according to the test data for test server and provide reference.
A kind of correlation testing method of business and network, including：Test server receive come self terminal to test index
Test instruction；The test server test index indicated to test instruction is tested.
Specifically, test server judges test index is carried out testing whether to need the correlation for gathering specific business platform
Parameter, in the case where being judged as YES, relevant parameter is gathered to specific business platform；Then, test server is put down according to from business
The relevant parameter of platform collection is tested test index, obtains test result；Test result is returned into terminal.
Preferably, methods described also includes：Test server is carried out according to default classifying rules to historical test data
The decision-tree model that training study obtains, terminal is sent to by the decision tree module.Test server receives the survey for carrying out self terminal
Data are tried, decision tree module is updated according to test data；Wherein, the test index of test data including test assignment, terminal
Property parameters and performance parameter, test result and analysis result.
A kind of association test device of business and network, including：Transceiver module, carry out referring to test for self terminal for receiving
Target test instruction；Test module, the test for being received to receiving module indicate that indicated test index is tested.
Specifically, test module, it is additionally operable to：Judge test index is carried out testing whether to need to gather specific business platform
Relevant parameter, in the case where being judged as YES, to specific business platform gather relevant parameter；Then, test module, with specific reference to
Test index is tested from the relevant parameter of business platform collection, obtains test result；Transceiver module, also by test module
Test obtained test result and return to terminal.
Preferably, described device also includes：Decision-tree model module, for being tested according to default classifying rules history
Data are trained the decision-tree model that study obtains；Then, transceiver module, it is additionally operable to the decision-making for obtaining decision-tree model module
Tree module is sent to terminal.
Preferably, transceiver module is additionally operable to receive the test data for carrying out self terminal；Then, decision-tree model module is additionally operable to：
Decision tree module is updated according to test data；Wherein, test data includes the test index of test assignment, the property parameters of terminal
With performance parameter, test result and analysis result.
A kind of association test system of business and network, including：Terminal and test server；Terminal, for test to be appointed
The test index of business and the property parameters of terminal and performance parameter are input in default decision-tree model, operational decisions tree mould
Type determines to obtain the test position of test index, and test position includes terminal and/or test server；Wherein, it is described default
Decision-tree model is trained study to historical test data according to default classifying rules and obtained, the decision-tree model
Non-leaf nodes be classifying rules, the test position that leaf node is test index；Terminal test index determined by
Test position test index is tested, or instruction test server test index is tested, obtain test knot
Fruit, and test result is analyzed to obtain analysis result；Test server, test index is entered for the instruction according to terminal
Row test.
The embodiment of the present invention is by terminal by the property parameters and performance parameter of the test index of test assignment and terminal
It is input in default decision-tree model, operational decisions tree-model determines to obtain the test position of test index, test position bag
Include terminal and/or test server；Wherein, the default decision-tree model is that history is tested according to default classifying rules
Data are trained study and obtained, and the non-leaf nodes of the decision-tree model is classifying rules, leaf node is test refers to
Target test position；Terminal test position of test index determined by is tested test index, or instruction is surveyed
Examination server is tested test index, obtains test result, and test result is analyzed to obtain analysis result；From
And the test position of test index can be determined in end side, also, determine that test index is being tested by decision-tree model
In the case that server side is tested, because the disposal ability of test server is stronger than the disposal ability of terminal, it can complete
The sophisticated functions that packet carries out protocal analysis etc. is captured, is realized so as to rely on the disposal ability of test server to can not
In the test for the test index that terminal is tested, and then it can solve the problem that institute in the scheme of existing operational trials and network test
The test index for being related to agreement of existing some of complex can not be directly be tested the problem of in terminal.
Other features and advantages of the present invention will be illustrated in the following description, also, partly becomes from specification
Obtain it is clear that or being understood by implementing the present invention.The purpose of the present invention and other advantages can be by the explanations write
Specifically noted structure is realized and obtained in book, claims and accompanying drawing.
Brief description of the drawings
Fig. 1 is the structured flowchart that associates test system of the business provided in an embodiment of the present invention with network；
Fig. 2 is the workflow diagram of the correlation testing method of provided in an embodiment of the present invention kind of business and network；
Fig. 3 is the schematic diagram of decision-tree model；
Fig. 4 is another workflow diagram of the correlation testing method of provided in an embodiment of the present invention kind of business and network；
Fig. 5 is the structured flowchart that associates test device of the business provided in an embodiment of the present invention with network；
Fig. 6 is another structured flowchart that associates test device of the business provided in an embodiment of the present invention with network；
Fig. 7 a are another workflow diagram of the correlation testing method of provided in an embodiment of the present invention kind of business and network；
Fig. 7 b are workflow of the method in specific implementation process shown in Fig. 7 a；
Fig. 8 is another structured flowchart that associates test device of the business provided in an embodiment of the present invention with network；
Fig. 9 is another structured flowchart that associates test device of the business provided in an embodiment of the present invention with network.
Embodiment
Embodiments of the invention are illustrated below in conjunction with accompanying drawing, it will be appreciated that embodiment described herein is only used
In the description and interpretation present invention, it is not intended to limit the present invention.
For in the presence of the scheme of existing operational trials and network test can only be to network quality and quality of service
One of tested, it is impossible to both testing, and some of complex the test index for being related to agreement without
For method directly tested in terminal the problem of, the embodiments of the invention provide a kind of business and network associate testing scheme, uses
In the solution problem.
In the technical scheme of the embodiment of the present invention, terminal is by the property parameters of the test index of test assignment and terminal
It is input to performance parameter in default decision-tree model, operational decisions tree-model determines to obtain the test position of test index,
Test position includes terminal and/or test server；Wherein, the default decision-tree model is according to default classifying rules
It is trained what study obtained to historical test data, the non-leaf nodes of the decision-tree model is classifying rules, leaf section
Point is the test position of test index；Terminal test position of test index determined by is tested test index,
Or instruction test server is tested test index, obtains test result, and test result is analyzed point
Analyse result；Thus, it is possible to determine the test position of test index in end side, also, determine to test by decision-tree model
In the case that index is tested in test server side, due to test server disposal ability than terminal disposal ability
By force, can complete to capture the sophisticated functions that packet carries out protocal analysis etc., so as to rely on the processing energy of test server
Power is realized to can not be in the test for the test index that terminal is tested；
Also, test assignment includes measure of the quality of service task or network quality test assignment.So as in end side
Realization is all tested quality of service and network quality, can solve the problem that institute in the scheme of existing operational trials and network test
It is existing one of network quality and quality of service to be tested, it is impossible to ask what is both tested
Topic.
The technical scheme of the embodiment of the present invention is described in detail below.
Fig. 1 shows the structured flowchart that associates test system of the business provided in an embodiment of the present invention with network, the system
Including：Terminal 1 and test server 2；
Terminal 1, it is default for the property parameters of the test index of test assignment and terminal and performance parameter to be input to
Decision-tree model in, operational decisions tree-model determines to obtain the test position of test index, test position include terminal 1 and/
Or test server 2；Wherein, the default decision-tree model is that historical test data is carried out according to default classifying rules
Training study obtains, and the non-leaf nodes of the decision-tree model is classifying rules, test that leaf node is test index
Position；Terminal 1 is tested test index according to the test position of identified test index, or instruction test server
2 pairs of test indexs are tested, and obtain test result, and test result is analyzed to obtain analysis result；
Test server 2, for being tested according to the instruction of terminal 1 test index.
（One）, below the operation principle of terminal in Fig. 11 is illustrated.
Fig. 2 shows the workflow diagram of the correlation testing method of provided in an embodiment of the present invention kind of business and network, should
Method includes：
The property parameters and performance parameter of the test index of test assignment and terminal are input to pre- by step 201, terminal
If decision-tree model in, operational decisions tree-model determines to obtain the test position of test index, test position include terminal and/
Or test server；
Wherein, default decision-tree model is that terminal is received and preserved from test server, the default decision tree mould
Type, which is test server, to be trained study to historical test data according to default classifying rules and obtains, the decision tree mould
The test position that the non-leaf nodes of type is classifying rules, leaf node is test index；Historical test data is a large amount of mistakes
Past test data；
Wherein, test assignment includes measure of the quality of service task or network quality test assignment；
Fig. 3 shows the schematic diagram of decision-tree model, and the form of expression of decision tree is analogous to the tree construction of flow chart,
The internal node of decision tree carries out property value test, namely attribute is classified according to classifying rules, and is sentenced according to property value
The disconnected branch drawn by the node, decision tree leaf node it is concluded that.Internal node（That is non-leaf nodes）It is attribute
Or the set of attribute（That is the combination of classifying rules）, class or class distribution belonging to leaf node representative sample, for example, leaf node
Including four classes, A classes, B classes, C classes, D classes.
As long as the learning algorithm training sample based on decision tree can use attribute --- the mode of value is expressed, it is possible to is used
The algorithm learns.Most classical method is ID3 methods in the training method of decision tree.ID3 algorithms are using information theory as base
Plinth, using comentropy and information gain degree as criterion, so as to realize the inducing classification to data, it be one from top to bottom,
The generalization procedure divided and rule.The core of ID3 algorithms is：When selecting attribute on decision tree nodes at different levels, by calculating information
Gain selects attribute, when each non-leaf node is tested, to obtain the class maximum on being tested trial record
Other information.Its specific method is：All attributes are detected, select the maximum attribute of information gain to produce decision-making tree node, by this
The different values of attribute establish branch, then the branch of decision-making tree node is established to subset recursive call this method of each branch, directly
Untill all subsets only include same category of data.
In embodiments of the present invention, classifying rules predetermined in decision-tree model（Namely the internal node of decision tree is to defeated
The parameter entered carries out the judgment condition of property value test）Including at least one or combine：About terminal attribute and performance
Classifying rules, the classifying rules about quality of service, the classifying rules of related network quality；Wherein, about terminal attribute and property
The classifying rules of energy includes but is not limited to：The model of terminal, the central processing unit of terminal（CPU）Frequency, the calculating energy of terminal
Power etc., the classifying rules about quality of service include but is not limited to：Whether it is voice recognition tasks, whether be the task of testing the speed, is
No downloaded for FTP is tested the speed etc., and the classifying rules of related network quality includes but is not limited to：Whether test index, which includes, needs
The sub- index tested in test server, subzone network quality, busy duration etc.；
In the present invention, the test position for the test index for being determined to obtain according to decision-tree model includes at least following three kinds
Situation：Test position is in terminal, and test position is in test server, and the test position of a part of sub- index of test index is at end
End, the test position of the sub- index of another part are properly termed as independent test in test server, first two situation, the third situation
It is properly termed as association test；Also, according to the difference of various terminals specific performance, the test position of test index can also be
Changed between a kind of situation and second of situation, specifically, be less than the situation of predetermined performance standard in the performance of terminal
Under, the test position of test index is test server, in the case where the performance of terminal is higher than predetermined performance standard, test
The test position of index is terminal, so that it is guaranteed that test index can be tested effectively, wherein, predetermined performance standard can
To be expressed by defining attribute and the performance of terminal；
With reference to Fig. 3, the example shown in table 1 illustrates the classification situation of test position：
Table 1
Wherein, test index 1 will be tested the quality of FTP downloading services, and the sub- index of the index includes what is downloaded
Time delay and speed, test position are terminal, do not include the sub- index for needing test server to test, and computation complexity is low, is surveyed
That tries leaf node of the index 1 in decision-tree model is categorized as A；
Test index 2 will be tested the quality of WEB page downloading service, and the sub- index of the index includes：Downloaded
Pagefile element quantity, download duration, download speed, the parsing duration of IP packets, test position is terminal,
Do not include needing the sub- index in test server test, computation complexity is relatively low, leaf of the test index 2 in decision-tree model
Child node is categorized as B；
Test index 3 will be tested the quality of voice Mytip business, and network of the index including business of test is built
Length, language pack size, transmission of voice packets duration, speech recognition accuracy immediately, wherein, sub- index：When the network of business is established
Length, the test position of language pack size, transmission of voice packets duration are terminal, sub- index：The test position of speech recognition accuracy
For test server, computation complexity is higher, and leaf node of the test index 3 in decision-tree model is categorized as C；
Test index 4 will be tested the quality of video traffic, and the index of test includes：The video counts that terminal receives
According to the quantity and duration of bag, the parsing accuracy to protocol package, wherein, sub- index：The number for the video data bag that terminal receives
The test position of amount and duration is terminal, sub- index：The test position of parsing accuracy to protocol package is test server, meter
Calculate complexity and be categorized as D for height, leaf node of the test index 4 in decision-tree model；
By the processing procedure of step 201, can effectively determine to obtain the test index or network matter of quality of service
The test position of the test index of amount；
Step 202, the terminal test position of test index determined by are tested test index, or instruction
Test server is tested test index, obtains test result, and test result is analyzed to obtain analysis result.
Specifically, in the case where the test position of identified test index is terminal, terminal-pair test index is carried out
Test obtains test result；
In the case where the test position of identified test index is test server, terminal is sent to test server
Test post instruction test server is tested the test index, receives entering to the test index for test server return
The test result that row test obtains；
The test position of a part of sub- index is the test of terminal, the sub- index of another part in identified test index
In the case that position is test server, the sub- index that terminal-pair needs to be tested in terminal is tested, and obtains terminal survey
Test result, test post instruction test server is sent to needing to carry out in test server in test index to test server
The sub- index of test is tested, and the sub- index to the test index for receiving test server return is tested what is obtained
Server test result；Terminal test result and server test result are merged into test result；
By step 202, test index can be tested according to the test position of identified test index.
It can be seen that by the processing procedure shown in Fig. 2, by terminal by the attribute of the test index of test assignment and terminal
Parameter and performance parameter are input in default decision-tree model, and operational decisions tree-model determines to obtain the test position of test index
Put, test position includes terminal and/or test server；The test position of terminal test index determined by refers to test
Mark is tested, or instruction test server is tested test index, obtains test result, and test result is carried out
Analysis obtains analysis result；Thus, it is possible to determine the test position of test index in end side, also, pass through decision-tree model
In the case of determining that test index is tested in test server side, because the disposal ability of test server is than terminal
Disposal ability is strong, can complete to capture the sophisticated functions that packet carries out protocal analysis etc., so as to rely on test server
Disposal ability realize to can not be in the test for the test index that terminal is tested, and then can solve the problem that existing operational trials
Directly it can not be surveyed with the test index for being related to agreement of some of complex in the presence of the scheme of network test in terminal
The problem of examination.
Also, test assignment includes measure of the quality of service task or network quality test assignment.So as in end side
Realization is all tested quality of service and network quality, can solve the problem that institute in the scheme of existing operational trials and network test
It is existing one of network quality and quality of service to be tested, it is impossible to ask what is both tested
Topic.
Preferably, on the basis of method shown in Fig. 2, as shown in figure 4, terminal complete to the test of test index after,
This method also includes：
Test data is also sent to test server by step 203, terminal, and the test that test data includes test assignment refers to
Mark, the property parameters of terminal and performance parameter, test result and analysis result, test data are test server according to the test
Data renewal decision-tree model provides reference.
So as to which test data is sent to testing service by terminal, and decision-tree model is further improved for test server
Provide data support.
Based on identical inventive concept, the embodiment of the present invention additionally provides a kind of business and the association test device of network,
The device is located in terminal.
Fig. 5 shows the structured flowchart that associates test device of the business provided in an embodiment of the present invention with network, the device
Including：
Test position determining module 51, for the property parameters of the test index of test assignment and terminal and performance to be joined
Number is input in default decision-tree model, and operational decisions tree-model determines to obtain the test position of test index, test position
Including terminal and/or test server；Wherein, the default decision-tree model is that history is surveyed according to default classifying rules
Examination data are trained study and obtained, and the non-leaf nodes of the decision-tree model is classifying rules, leaf node is test
The test position of index；
Testing execution module 52, test position determining module 51 is connected to, for according to the test position determining module
The test position of test index determined by 51 is tested test index, or instruction test server is entered to test index
Row test, obtains test result, and test result is analyzed to obtain analysis result；
Specifically, testing execution module 52 is in the case where the test position of identified test index is terminal, to surveying
Examination index is tested to obtain test result；
In the case where the test position of identified test index is test server, sends and test to test server
Message instruction test server is tested the test index, receives being surveyed to the test index for test server return
Try obtained test result；
The test position of a part of sub- index is the test of terminal, the sub- index of another part in identified test index
In the case that position is test server, the sub- index tested in terminal needs is tested, and obtains terminal test knot
Fruit, send test post to test server and indicate test server to needing to test in test server in test index
Sub- index tested, and receive test server return the sub- index to the test index tested obtained service
Device test result；Terminal test result and server test result are merged into test result.
Preferably, as shown in fig. 6, on the basis of Fig. 5 shown devices, business provided in an embodiment of the present invention and network
Association test device also includes：
Preserving module 53, test position determining module 51 is connected to, for receiving and preserving the institute from test server
State default decision-tree model；Wherein, the default decision-tree model is test server according to default classifying rules pair
Historical test data is trained what study obtained.
Preferably, testing execution module 52, it is additionally operable to：Test data is sent to test server, test data includes
The test index of test assignment, the property parameters of terminal and performance parameter, test result and analysis result, test data are test
Server updates decision-tree model according to the test data and provides reference.
By the device shown in Fig. 5 or Fig. 6, it can be realized in end side and quality of service and network quality are all surveyed
Examination, also, in the case where determining that test index is tested in test server side, due to the processing energy of test server
Power is stronger than the disposal ability of terminal, can complete to capture the sophisticated functions that packet carries out protocal analysis etc., so as to rely on
The disposal ability of test server is realized to can not be in the test for the test index that terminal is tested.And then it can solve the problem that existing
Operational trials and network test scheme in the presence of one of network quality and quality of service can only be surveyed
Examination, it is impossible to which to both testing, and the test index for being related to agreement of some of complex can not be directly enterprising in terminal
The problem of row test.
（Two）, below the operation principle of test server is illustrated.
Fig. 7 a show the workflow diagram of test server in Fig. 1, namely the operation principle of test server, including：
Step 701, test server receive the instruction of the test to test index for carrying out self terminal；
Step 702, the test server test index indicated to test instruction are tested.
By above-mentioned processing procedure, can be realized by the disposal ability of test server to can not be tested in terminal
Test index test, so as to solve some of complex in the presence of the scheme of existing operational trials and network test
The test index for being related to agreement can not be directly be tested in terminal the problem of.
Fig. 7 b show workflow of the method in specific implementation process shown in Fig. 7 a, and the handling process includes：
Step 7011, test server receive the instruction for carrying out self terminal；
Step 7012, judge the test index indicated by terminal is carried out testing whether to need to gather specific business platform
Relevant parameter, in the case where being judged as YES, processing proceeds to step 7013, and in the case where being judged as NO, processing proceeds to
Step 7022；
Step 7013, the collection relevant parameter to specific business platform；
Step 7021, basis are tested test index from the relevant parameter of business platform collection, obtain test result,
Processing proceeds to step 7023；
Step 7022, test index is tested, obtain test result；
Step 7023, test result returned into terminal.
By above-mentioned processing procedure, can be realized by the disposal ability of test server to can not be tested in terminal
Test index test, so as to solve some of complex in the presence of the scheme of existing operational trials and network test
The test index for being related to agreement can not be directly be tested in terminal the problem of.
Preferably, test server is trained what study obtained always according to default classifying rules to historical test data
Decision-tree model, the decision tree module is sent to terminal.And the test data for carrying out self terminal is received, according to test data
Update decision tree module；Wherein, the test index of test data including test assignment, the property parameters of terminal and performance parameter,
Test result and analysis result.
So as to which test server can obtain the decision-tree model of the test position for determining test index.
Based on identical inventive concept, the embodiment of the present invention additionally provides a kind of business and the association test device of network,
The device is located in test server.
Fig. 8 shows the structured flowchart that associates test device of the business provided in an embodiment of the present invention with network, the device
Including：
Transceiver module 81, the instruction of the test to test index of self terminal is carried out for receiving；
Test module 82, transceiver module 81 is connected to, the test for being received to transceiver module 81 indicates indicated
Test index is tested.
Specifically, test module 82, it is additionally operable to：Judge test index test whether needing gathering specific business to put down
The relevant parameter of platform, in the case where being judged as YES, relevant parameter is gathered to specific business platform；Then, test module 82, specifically
Relevant parameter according to being gathered from business platform is tested test index, obtains test result；Transceiver module, will also test
The test result that module testing obtains returns to terminal.
Preferably, as shown in figure 9, business provided in an embodiment of the present invention and the association test device of network also include：
Decision-tree model module 83, obtained for being trained study to historical test data according to default classifying rules
Decision-tree model；Then, transceiver module 81, decision-tree model module 83 is additionally coupled to, be additionally operable to decision-tree model module 83
Obtained decision tree module is sent to terminal.
Transceiver module 81, it is additionally operable to receive the test data for carrying out self terminal；Then,
Decision-tree model module 83 is additionally operable to：Decision tree module is updated according to test data；Wherein, test data includes surveying
Test index, the property parameters and performance parameter of terminal, the test result and analysis result of trial business.
By the device shown in Fig. 8 or Fig. 9, can also be realized by the disposal ability of test server to can not be in terminal
The test for the test index tested, in the presence of solving the scheme of existing operational trials and network test
The test index for being related to agreement of some of complex can not be directly be tested the problem of in terminal.
In summary, the embodiment of the present invention determines the test of quality of service by terminal according to default decision-tree model
The test position of the test index of index or network quality, and tested accordingly according to identified test position, phase
Than can only be tested in prior art quality of service or network quality, the breadth and depth of test can be expanded, and lead to
The association test of terminal and/or test server is crossed, is only tested, can realized to calculating by terminal compared with prior art
The test of the higher test index of complexity, in the presence of solving the scheme of existing operational trials and network test
One of network quality and quality of service can only be tested, it is impossible to both testing, and part
The complicated test index for being related to agreement can not be directly be tested the problem of in terminal.
One of ordinary skill in the art will appreciate that all or part of step for realizing above-described embodiment method carrying is can
To instruct the hardware of correlation to complete by program, described program can be stored in a kind of computer-readable recording medium,
The program upon execution, including one or a combination set of the step of embodiment of the method.
In addition, each functional unit in each embodiment of the present invention can be integrated in a processing module, can also
That unit is individually physically present, can also two or more units be integrated in a module.Above-mentioned integrated mould
Block can both be realized in the form of hardware, can also be realized in the form of software function module.The integrated module is such as
Fruit is realized in the form of software function module and as independent production marketing or in use, can also be stored in a computer
In read/write memory medium.
It should be understood by those skilled in the art that, embodiments of the invention can be provided as method, system or computer program
Product.Therefore, the present invention can use the reality in terms of complete hardware embodiment, complete software embodiment or combination software and hardware
Apply the form of example.Moreover, the present invention can use the computer for wherein including computer usable program code in one or more
Usable storage medium（Including but not limited to magnetic disk storage and optical memory etc.）The shape of the computer program product of upper implementation
Formula.
The present invention is with reference to method according to embodiments of the present invention, equipment（System）And the flow of computer program product
Figure and/or block diagram describe.It should be understood that can be by every first-class in computer program instructions implementation process figure and/or block diagram
Journey and/or the flow in square frame and flow chart and/or block diagram and/or the combination of square frame.These computer programs can be provided
The processors of all-purpose computer, special-purpose computer, Embedded Processor or other programmable data processing devices is instructed to produce
A raw machine so that produced by the instruction of computer or the computing device of other programmable data processing devices for real
The device for the function of being specified in present one flow of flow chart or one square frame of multiple flows and/or block diagram or multiple square frames.
These computer program instructions, which may be alternatively stored in, can guide computer or other programmable data processing devices with spy
Determine in the computer-readable memory that mode works so that the instruction being stored in the computer-readable memory, which produces, to be included referring to
Make the manufacture of device, the command device realize in one flow of flow chart or multiple flows and/or one square frame of block diagram or
The function of being specified in multiple square frames.
These computer program instructions can be also loaded into computer or other programmable data processing devices so that counted
Series of operation steps is performed on calculation machine or other programmable devices to produce computer implemented processing, so as in computer or
The instruction performed on other programmable devices is provided for realizing in one flow of flow chart or multiple flows and/or block diagram one
The step of function of being specified in individual square frame or multiple square frames.
Obviously, those skilled in the art can carry out the essence of various changes and modification without departing from the present invention to the present invention
God and scope.So, if these modifications and variations of the present invention belong to the scope of the claims in the present invention and its equivalent technologies
Within, then the present invention is also intended to comprising including these changes and modification.
Claims (19)
- A kind of 1. correlation testing method of business and network, it is characterised in that including：The property parameters and performance parameter of the test index of test assignment and terminal are input to default decision tree mould by terminal In type, operational decisions tree-model determines to obtain the test position of test index, and test position includes terminal and/or testing service Device；Wherein, the default decision-tree model is that historical test data is trained according to default classifying rules to learn Arrive, the non-leaf nodes of the decision-tree model is classifying rules, the test position that leaf node is test index；Terminal test position of test index determined by is tested test index, or instruction test server pair Test index is tested, and obtains test result, and test result is analyzed to obtain analysis result.
- 2. according to the method for claim 1, it is characterised in that the test position pair of terminal test index determined by Test index is tested, or instruction test server is tested test index, is obtained test result, is specifically included：In the case where the test position of identified test index is terminal, terminal-pair test index is tested As a result；In the case where the test position of identified test index is test server, terminal sends to test server and tested Message instruction test server is tested the test index, receives being surveyed to the test index for test server return Try obtained test result；The test position of a part of sub- index is terminal, the test position of the sub- index of another part in identified test index In the case of test server, the sub- index that terminal-pair needs to be tested in terminal is tested, and obtains terminal test knot Fruit, send test post to test server and indicate test server to needing to test in test server in test index Sub- index tested, and receive test server return the sub- index to the test index tested obtained service Device test result；Terminal test result and server test result are merged into test result.
- 3. according to the method for claim 1, it is characterised in that methods described also includes：Terminal receives and preserves the default decision-tree model from test server；Wherein, the default decision tree Model, which is test server, to be trained study to historical test data according to default classifying rules and obtains.
- 4. according to the method for claim 1, it is characterised in that the test assignment includes measure of the quality of service task or net Network quality test task.
- 5. according to the method for claim 1, it is characterised in that the classifying rules comprises at least one below or combination：Classifying rules about terminal attribute and performance, the classifying rules about quality of service, the classification gauge of related network quality Then.
- 6. according to the method for claim 3, it is characterised in that methods described also includes：Test data is sent to test server by terminal, and test data includes the test index of test assignment, the attribute of terminal Parameter and performance parameter, test result and analysis result, test data are that test server updates decision-making according to the test data Tree-model provides reference.
- A kind of 7. association test device of business and network, it is characterised in that including：Test position determining module, for the property parameters of the test index of test assignment and terminal and performance parameter to be inputted Into default decision-tree model, operational decisions tree-model determines to obtain the test position of test index, and test position is included eventually End and/or test server；Wherein, the default decision-tree model is to historical test data according to default classifying rules It is trained study to obtain, the non-leaf nodes of the decision-tree model is classifying rules, leaf node is test index Test position；Testing execution module, the test position for the test index according to determined by the test position determining module is to test Index is tested, or instruction test server is tested test index, obtains test result, and test result is entered Row analysis obtains analysis result.
- 8. device according to claim 7, it is characterised in that testing execution module, be specifically used for：In the case where the test position of identified test index is terminal, test index is tested to obtain test knot Fruit；In the case where the test position of identified test index is test server, test post is sent to test server Instruction test server is tested the test index, and what reception test server returned to the test index test The test result arrived；The test position of a part of sub- index is terminal, the test position of the sub- index of another part in identified test index In the case of for test server, the sub- index tested in terminal needs is tested, and obtains terminal test result, to Test server sends test post instruction test server to the son that needs to be tested in test server in test index Index is tested, and the server that the sub- index to the test index for receiving test server return is tested to obtain is surveyed Test result；Terminal test result and server test result are merged into test result.
- 9. device according to claim 7, it is characterised in that described device also includes：Preserving module, for receiving and preserving the default decision-tree model from test server；Wherein, it is described default Decision-tree model to be test server be trained study to historical test data according to default classifying rules obtains.
- 10. device according to claim 9, it is characterised in that testing execution module, be additionally operable to：Test data is sent to test server, test data includes the test index of test assignment, the property parameters of terminal With performance parameter, test result and analysis result, test data is that test server updates decision tree mould according to the test data Type provides reference.
- A kind of 11. correlation testing method of business and network, it is characterised in that including：Test server receives the instruction of the test to test index for carrying out self terminal, will be tested wherein the test is designated as terminal The test index of task and the property parameters of terminal and performance parameter are input in default decision-tree model, operational decisions tree What model was sent in the case of determining to obtain the test position of test index as test server；The test server test index indicated to test instruction is tested.
- 12. according to the method for claim 11, it is characterised in that methods described also includes：Test server judges test index is carried out testing whether to need the relevant parameter for gathering specific business platform, judged In the case of being, relevant parameter is gathered to specific business platform；Then,Test server is tested test index according to the relevant parameter gathered from business platform, obtains test result；Test result is returned into terminal.
- 13. method according to claim 11, it is characterised in that methods described also includes：Test server is trained the decision-tree model that study obtains according to default classifying rules to historical test data, will The decision-tree model is sent to terminal.
- 14. according to the method for claim 13, it is characterised in that methods described also includes：Test server receives the test data for carrying out self terminal, updates decision-tree model according to test data；Wherein, test data Property parameters and performance parameter, the test result and analysis result of test index, terminal including test assignment.
- A kind of 15. association test device of business and network, it is characterised in that including：Transceiver module, the instruction of the test to test index of self terminal is carried out for receiving, is incited somebody to action wherein the test is designated as terminal The test index of test assignment and the property parameters of terminal and performance parameter are input in default decision-tree model, and operation is determined What plan tree-model was sent in the case of determining to obtain the test position of test index as test server；Test module, the test for being received to receiving module indicate that indicated test index is tested.
- 16. device according to claim 15, it is characterised in that test module, be additionally operable to：Judge test index is carried out testing whether to need the relevant parameter for gathering specific business platform, in situation about being judged as YES Under, gather relevant parameter to specific business platform；Then,Test module, test index is tested with specific reference to the relevant parameter gathered from business platform, obtains test result；Transceiver module, the test result that test module tests to obtain also is returned into terminal.
- 17. device according to claim 15, it is characterised in that described device also includes：Decision-tree model module, the decision-making obtained for being trained study to historical test data according to default classifying rules Tree-model；Then,Transceiver module, it is additionally operable to the decision-tree model that decision-tree model module obtains being sent to terminal.
- 18. device according to claim 17, it is characterised in that transceiver module is additionally operable to receive the test number for carrying out self terminal According to；Then,Decision-tree model module is additionally operable to：Decision-tree model is updated according to test data；Wherein, test data includes test assignment Test index, the property parameters and performance parameter of terminal, test result and analysis result.
- A kind of 19. association test system of business and network, it is characterised in that including：Terminal and test server；Terminal, for the property parameters of the test index of test assignment and terminal and performance parameter to be input into default decision-making In tree-model, operational decisions tree-model determines to obtain the test position of test index, and test position includes terminal and/or test clothes Business device；Wherein, the default decision-tree model is that study is trained to historical test data according to default classifying rules Obtain, the non-leaf nodes of the decision-tree model is classifying rules, the test position that leaf node is test index；Terminal Test index is tested according to the test position of identified test index, or instruction test server is to test index Tested, obtain test result, and test result is analyzed to obtain analysis result；Test server, test index is tested for the instruction according to terminal.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201310384932.6A CN104427547B (en) | 2013-08-29 | 2013-08-29 | Business and network associate method of testing, apparatus and system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201310384932.6A CN104427547B (en) | 2013-08-29 | 2013-08-29 | Business and network associate method of testing, apparatus and system |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN104427547A CN104427547A (en) | 2015-03-18 |
| CN104427547B true CN104427547B (en) | 2017-11-21 |
Family
ID=52975236
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201310384932.6A Active CN104427547B (en) | 2013-08-29 | 2013-08-29 | Business and network associate method of testing, apparatus and system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN104427547B (en) |
Families Citing this family (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105281978B (en) * | 2015-10-23 | 2019-02-19 | 小米科技有限责任公司 | A kind of methods, devices and systems of performance test |
| CN106803799B (en) * | 2015-11-26 | 2021-02-26 | 创新先进技术有限公司 | Performance test method and device |
| CN107908558B (en) * | 2017-11-14 | 2021-01-05 | 广东华仝九方科技有限公司 | Automatic evaluation method for mobile phone client software quality |
| CN111400147B (en) * | 2019-01-02 | 2023-05-05 | 中国移动通信有限公司研究院 | Service quality testing method, device and system |
| CN109902251A (en) * | 2019-01-17 | 2019-06-18 | 平安城市建设科技(深圳)有限公司 | Scheme Choice method, apparatus, terminal and readable storage medium storing program for executing based on decision tree |
| CN110445653B (en) * | 2019-08-12 | 2022-03-29 | 灵长智能科技(杭州)有限公司 | Network state prediction method, device, equipment and medium |
| CN112527621A (en) * | 2019-09-17 | 2021-03-19 | 中移动信息技术有限公司 | Test path construction method, device, equipment and storage medium |
| CN114392560B (en) * | 2021-11-08 | 2024-06-04 | 腾讯科技（深圳）有限公司 | Method, device, equipment and storage medium for processing running data of virtual scene |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102014016A (en) * | 2010-08-31 | 2011-04-13 | 北京邮电大学 | System and method for testing defects of network protocol |
| CN102035698A (en) * | 2011-01-06 | 2011-04-27 | 西北工业大学 | HTTP tunnel detection method based on decision tree classification algorithm |
| CN102420727A (en) * | 2012-01-05 | 2012-04-18 | 北京邮电大学 | Distributed protocol test system and method |
| CN102740328A (en) * | 2011-04-13 | 2012-10-17 | 中国移动通信集团公司 | Remote test method, device thereof and system thereof |
Family Cites Families (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US6907550B2 (en) * | 2002-02-28 | 2005-06-14 | Microsoft Corporation | Stochastic simulation of computer activity based on user categories |
-
2013
- 2013-08-29 CN CN201310384932.6A patent/CN104427547B/en active Active
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102014016A (en) * | 2010-08-31 | 2011-04-13 | 北京邮电大学 | System and method for testing defects of network protocol |
| CN102035698A (en) * | 2011-01-06 | 2011-04-27 | 西北工业大学 | HTTP tunnel detection method based on decision tree classification algorithm |
| CN102740328A (en) * | 2011-04-13 | 2012-10-17 | 中国移动通信集团公司 | Remote test method, device thereof and system thereof |
| CN102420727A (en) * | 2012-01-05 | 2012-04-18 | 北京邮电大学 | Distributed protocol test system and method |
Also Published As
| Publication number | Publication date |
|---|---|
| CN104427547A (en) | 2015-03-18 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN104427547B (en) | Business and network associate method of testing, apparatus and system | |
| CN108399114A (en) | A kind of system performance testing method, apparatus and storage medium | |
| CN108875525A (en) | Behavior prediction method, apparatus, system and storage medium | |
| CN106874190A (en) | The method of testing and server of user interface | |
| CN108470172A (en) | A kind of text information identification method and device | |
| CN109447156A (en) | Method and apparatus for generating model | |
| CN109688275A (en) | Harassing call recognition methods, device and storage medium | |
| CN107154859A (en) | Intelligent electric appliance distribution method of testing, system and control terminal | |
| CN109586952A (en) | Method of server expansion, device | |
| CN108712300A (en) | A kind of automated testing method and system of smart machine distribution | |
| CN102722577B (en) | The determination method and device of index changeable weight | |
| CN110152290A (en) | Game running method and device, storage medium and electronic device | |
| US11558769B2 (en) | Estimating apparatus, system, method, and computer-readable medium, and learning apparatus, method, and computer-readable medium | |
| CN106937303A (en) | A kind of base station test method and system, terminal, Cloud Server | |
| CN109858528A (en) | Recommender system training method, device, computer equipment and storage medium | |
| CN107330326A (en) | A kind of malice trojan horse detection processing method and processing device | |
| CN106056143A (en) | Terminal use data processing method, terminal use data processing device, anti-addiction method, anti-addiction device, anti-addiction system and terminal | |
| CN108768695A (en) | The problem of KQI localization method and device | |
| CN110399822A (en) | Action identification method of raising one's hand, device and storage medium based on deep learning | |
| CN107358346A (en) | It is directed to the evaluation information treating method and apparatus of communication quality | |
| CN107483267A (en) | A kind of EIGRP routing failures recognition methods | |
| CN110535850A (en) | Treating method and apparatus, storage medium and the electronic device that account number logs in | |
| CN109063433A (en) | Recognition methods, device and the readable storage medium storing program for executing of fictitious users | |
| CN108229289A (en) | Target retrieval method, apparatus and electronic equipment | |
| CN102075366A (en) | Method and equipment for processing data in communication network |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |