CN110445691B - Method and device for testing network service transmission performance by combining customization and playback - Google Patents
Method and device for testing network service transmission performance by combining customization and playback Download PDFInfo
- Publication number
- CN110445691B CN110445691B CN201910758257.6A CN201910758257A CN110445691B CN 110445691 B CN110445691 B CN 110445691B CN 201910758257 A CN201910758257 A CN 201910758257A CN 110445691 B CN110445691 B CN 110445691B
- Authority
- CN
- China
- Prior art keywords
- task
- flow
- test
- performance
- playback
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L43/00—Arrangements for monitoring or testing data switching networks
- H04L43/08—Monitoring or testing based on specific metrics, e.g. QoS, energy consumption or environmental parameters
- H04L43/0876—Network utilisation, e.g. volume of load or congestion level
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L43/00—Arrangements for monitoring or testing data switching networks
- H04L43/50—Testing arrangements
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L69/00—Network arrangements, protocols or services independent of the application payload and not provided for in the other groups of this subclass
- H04L69/16—Implementation or adaptation of Internet protocol [IP], of transmission control protocol [TCP] or of user datagram protocol [UDP]
- H04L69/161—Implementation details of TCP/IP or UDP/IP stack architecture; Specification of modified or new header fields
- H04L69/162—Implementation details of TCP/IP or UDP/IP stack architecture; Specification of modified or new header fields involving adaptations of sockets based mechanisms
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L69/00—Network arrangements, protocols or services independent of the application payload and not provided for in the other groups of this subclass
- H04L69/22—Parsing or analysis of headers
Landscapes
- Engineering & Computer Science (AREA)
- Computer Networks & Wireless Communication (AREA)
- Signal Processing (AREA)
- Computer Security & Cryptography (AREA)
- Environmental & Geological Engineering (AREA)
- Data Exchanges In Wide-Area Networks (AREA)
Abstract
The invention discloses a method and a device for testing the transmission performance of a network service by combining customization and playback. The coordination manager is responsible for making a service transmission performance test strategy, creating a test task in a customized or playback mode, selecting a network performance probe for executing the task according to task requirements, allocating the identity of the network performance probe to be a main control end or a controlled end, and then issuing the test task to the main control end probe in the form of a configuration file. And the master control end interacts with the controlled end to transmit the test parameters and data according to the task information in the configuration file. And finally, the controlled end counts the test result and sends the test result to the main control end, and the main control end collects the test result and sends the statistical result to the coordination manager. The invention realizes a network service transmission performance test mechanism with accurate flow characteristic depiction, flexible flow mode customization and good expansion capability to novel multimedia services by combining the customization mode and the playback mode.
Description
Technical Field
The invention relates to a method and a device for testing the transmission performance of a network service by combining customization and playback, which belong to the technical field of network data communication, in particular to a method for testing the transmission performance of a network service, which has the advantages of accurate flow characteristic depiction, flexible flow mode customization and good expansion capability to novel multimedia services, and is constructed by generating a specific network service test flow on the basis of the combination of customization and playback.
Background
With the rapid development of networks and the increasingly wide application of multimedia services, services such as video, audio, network video conference, images, navigation and the like are deeply involved in the aspects of daily work and life. However, due to the influence of the dynamic change of the transmission capability of the IP network, the efficient evaluation and guarantee of the multimedia service quality is a technical hotspot and difficulty.
Since the multimedia service is extremely sensitive to the fluctuation of the network performance, and the IP network is a complex system with resource competing use, the network performance is constantly in dynamic change. Therefore, the difficulty and key for realizing the performance guarantee, management and maintenance of the multimedia service lies in accurately measuring and evaluating the bearing capacity of the network service. The carrying capacity of the network for the upper layer service is also an important parameter for network management and traffic optimization. The main technical challenges include: the method generates detection flow matched with the complex characteristics of the multimedia service, reduces the interference of measurement on the normal service, establishes a multi-role cooperative measurement mechanism, and realizes the real-time positioning of link faults.
The traffic generator is a tool which can generate data packets with specific types, specific lengths and specific rates and collect and count relevant parameters for analyzing a tested object. The traffic generator plays a significant role in testing network products such as switches and routers and in developing new products and protocols. Because with it not only the actual network traffic can be simulated by customizing the data packets to be sent and their sending rate, but also new products and new protocol testing will be easier and easier. The tester can perform the test only by building a simple test environment for the tested object without putting the tested object into an actually-operated network.
The current traffic generators mainly have two types: one is a flow generator based on hardware implementation, such as an ixcia application layer performance testing software ixchar, a SmartBits network performance analysis system of the sback communication, and the like. The hardware-based test system has the characteristics of strong functions, better performance based on hardware functions, high reliability, more professional test indexes and the like, but because the hardware-based test system is high in price and high in system closure, the functions required by the product cannot be researched and developed; the other is a flow generator based on software implementation, and a typical representative in this respect is D-itg (distributed Internet traffic generator), which is more comprehensive than other open source flow generators (such as poisson flow generator) in function. At present, the D-ITG is mainly used for network analysis and performance estimation, such as testing the throughput, delay, packet loss rate, delay jitter and the like of a network, and can also test the QoS (quality of service) of a network layer, flow shaping and the like.
However, these technologies still have the problems of limited traffic model, difficulty in supporting the extension of adding new traffic models, insufficient support capability for user-defined test traffic, poor extension capability for new multimedia services, and lack of multi-point cooperative test capability.
Disclosure of Invention
The purpose of the invention is as follows: aiming at the defects that the traditional test mechanism is inaccurate in traffic characteristic depiction, cannot meet the flexible customization requirement of a user, is poor in the expansion capability of a novel multimedia service and the like, a network service transmission performance test method and a network service transmission performance test device combining customization and playback are provided.
The technical scheme is as follows: a method for testing the transmission performance of network service by combining customization and playback comprises the following steps:
step 1, initialization: a coordination manager and a plurality of network performance probes are deployed in the control system.
Step 2, customizing a service transmission performance test strategy of the coordination manager: the service transmission performance test supports two modes of playback and customization.
The playback mode needs to acquire flow in advance and generate a playback template (covering service types such as video conferences, video on demand, live video broadcast, video multicast and the like) through a template generator, and supports a user to select service flow of different templates for playback testing; the customized mode supports a user to customize different flow modes (each flow can define transport layer protocols, port numbers, duration, start time, grouping time interval distribution, grouping size distribution and the like, and specify statistical performance indexes of each test flow) for testing according to requirements, and supports testing of services synthesized by a plurality of flows. The coordination manager selects a test mode from the playback and customization modes that meets the user's requirements.
In the process of making the playback template, the original traffic data needs to be collected first, and then for the originally collected data stream, starting from the first packet, the time offset of the client-side and server-side communication packets relative to the first packet, the transport layer protocol used for communication, the port, the stream ID and the complete header information are extracted sequentially, so as to form the playback template file with these information.
Step 3, the coordination manager creates a test task: the coordination manager is responsible for coordinating the same probe to serve as a master control end and n probes to serve as controlled ends according to the requirements of the test tasks. If the user requirement is a playback test mode, the coordination manager selects a playback template appointed by the user for the user requirement, and appoints playback parameters such as flow, sending time interval and test duration; if the user requirement is a customized test mode, the coordination manager generates test flow according to a flow distribution model and parameter information input by the user and a specified flow model, wherein the flow model supported at present comprises Poisson distribution, uniform distribution, heavy tail distribution, binomial distribution and geometric distribution, and can be expanded at a later stage according to requirements. In the test, the test flow is bidirectional, so the direction and number of the test flow, such as the number of flows from the master to the slave and the number of flows from the slave to the master, are also specified in the test task. And then, packaging the information in a file task.xml to create a test task and transmitting the test task to a main control end.
Step 4, the main control end sends and receives a specific network service test flow: a) the main control end firstly checks whether a task file task.xml issued by a coordination manager exists or not through a self configuration file service _ perf.ini, if not, the main control end reports the test failure information to the coordination manager and exits the program; b) and if the task file exists, analyzing the task file (task. xml) into corresponding task class information, analyzing basic parameters of each data channel in the task, assigning values to corresponding attributes in the task class, and initializing a task environment. If the initialization of the task environment fails, the task environment is cleaned, the test failure information is reported to the coordination manager, and the program is exited; and if the task environment is initialized successfully, judging the task type. c) If the mode is the playback mode, extracting corresponding stream information according to a playback template in the task class, and if the playback template does not exist, reporting the test failure information to the coordination manager and exiting the program; if the mode is the customized mode, the corresponding stream information exists in the task class. d) According to the task file analysis information, a data receiving thread is established for the stream needing to receive data (namely the stream direction is from the controlled end to the main control end), a corresponding target thread is established for each controlled end, the task file is sent, then communication threads are respectively established with each controlled end, and specific flow is sent according to the task requirement. e) The main control end performance statistic analysis module counts the flow performance information received by the local end, summarizes the flow performance information and the performance flow information reported by the controlled end and then reports the information to the coordination manager.
Step 5, the controlled terminal receives and sends a specific network service test flow: a) after the controlled end is started, firstly establishing a socket communicated with the main control end, and monitoring the connection of the main control end; b) after receiving a task file sent by a main control end, analyzing the task file (task. xml) into corresponding task class information, analyzing basic parameters of each data channel in a task, assigning values to corresponding attributes in the task class, and initializing a task environment. If the initialization of the task environment fails, the task environment is cleaned, the test failure information is reported to the coordination manager, and the program is exited; and if the task environment is initialized successfully, judging the task type. c) If the mode is the playback mode, extracting corresponding stream information according to a playback template in the task class, and if the playback template does not exist, reporting the test failure information to the coordination manager and exiting the program; if the mode is the customized mode, the corresponding stream information exists in the task class. d) And analyzing the information according to the task file, creating a data receiving thread for the stream needing to receive data (namely the stream direction is from the main control end to the controlled end), monitoring, receiving the test flow sent by the main control end, and counting the stream performance information received by the local end by a performance statistical analysis module. e) And after the monitoring of the data to be received at the corresponding port is finished, creating a data sending thread for the stream needing to send the data, and sending specific flow to the main control end according to task requirements. f) And after all data are sent and received, the controlled end performance statistical analysis module sends the statistical flow performance information to the main control end.
Step 6, the coordination manager calculates the test performance index: and the coordination manager calculates the final test performance index according to the flow performance information reported by the main control end.
A network service transmission performance testing device combining customization and playback comprises a coordination manager and a plurality of network performance probes, wherein the coordination manager and the network performance probes are deployed in a control system; the coordination manager is responsible for coordinating the same probe to serve as a master control end and n probes to serve as controlled ends;
each network performance probe is provided with five functional modules of strategy management, flow generation, flow receiving, performance statistical analysis and resource management. The strategy management module is responsible for receiving a task strategy file issued by the analysis coordination manager and starting a corresponding flow generation module according to the definition of the strategy file; the flow generation module is responsible for receiving the test task transmitted by the strategy management module and calling a flow generation method such as playback or customization and the like to initiate analog flow transmission according to a flow generation mode specified by the test task; the flow receiving module is responsible for receiving the analog flow; the performance statistical analysis module is responsible for statistical analysis of test performance and forms a conclusive test index number aiming at the test task. And the resource management module is responsible for maintaining software and hardware resources on the probe so as to support the normal operation of the test task.
The coordination manager provides service transmission performance testing supporting both playback and customization modes. The playback mode needs a coordination manager to acquire flow in advance and generate a playback template through a template generator, and supports a user to select service flow of different templates for playback test; the customization mode supports a user to customize different flow modes for testing according to requirements, and supports the testing of complex services synthesized by a plurality of flows.
The coordination manager creates a test task: if the user requirement is a playback mode, the coordination manager loads a playback template specified by the user and specifies playback parameters such as flow, sending time interval and test duration; and if the user requirement is a customization mode, coordinating a flow distribution model and parameter information input by a manager user, and generating the test flow according to the specified flow model, wherein the currently supported flow model comprises Poisson distribution, uniform distribution, heavy tail distribution, binomial distribution and geometric distribution, and can be expanded at the later stage as required. In the test, the test flow is bidirectional, so the direction and number of the test flow, such as the number of flows from the master to the slave and the number of flows from the slave to the master, are also specified in the test task. And then, packaging the service transmission performance test information in a file task.
A policy management module of a main control end receives a task policy file, checks whether task file task.xml issued by a coordination manager exists or not through a configuration file service _ perf.ini of the main control end, and if not, reports test failure information to the coordination manager and exits a program; and if the task file exists, analyzing the task file (task. xml) into corresponding task class information, analyzing basic parameters of each data channel in the task, assigning values to corresponding attributes in the task class, and initializing a task environment. If the initialization of the task environment fails, the task environment is cleaned, the test failure information is reported to the coordination manager, and the program is exited; if the task environment is initialized successfully, starting a flow generation module;
the flow generation module judges the task type, if the task type is a playback mode, corresponding flow information is extracted according to a playback template in the task type, and if the playback template does not exist, the test failure information is reported to the coordination manager and the program is quitted; if the mode is the customized mode, the corresponding stream information exists in the task class. According to the task file analysis information, a data receiving thread is established for the stream needing to receive data (namely the stream direction is from the controlled end to the main control end), a corresponding target thread is established for each controlled end, the task file is sent to a strategy management module of the controlled end, then communication threads are respectively established with each controlled end, and specific flow is sent according to task requirements. Due to the bidirectional characteristic of network communication, the traffic receiving module needs to be started at both the master control end and the controlled end, and is responsible for receiving the network traffic generated and sent by the opposite-end traffic generating module and completing normal interaction of communication data of both parties.
The master control end performance statistical analysis module counts the flow performance information received by the local end, summarizes the flow performance information and the performance flow information reported by the controlled end performance statistical analysis module and then reports the summarized flow performance information and the performance flow information to the coordination manager.
After the controlled end is started, firstly establishing a socket communicated with the main control end, and monitoring the connection of the main control end; after the policy management module receives a task file sent by a main control end, the task file (task. xml) is analyzed into corresponding task class information, basic parameters of each data channel in a task are analyzed, corresponding attribute assignment is carried out on the task class, and a task environment is initialized. If the initialization of the task environment fails, the task environment is cleaned, the test failure information is reported to the coordination manager, and the program is exited; if the task environment is initialized successfully, starting a controlled end flow generation module; the flow generation module judges the task type, if the task type is a playback mode, corresponding flow information is extracted according to a playback template in the task type, and if the playback template does not exist, the test failure information is reported to the coordination manager and the program is quitted; if the mode is the customized mode, the corresponding stream information exists in the task class. According to the task file analysis information, on one hand, a flow receiving module of the controlled end is started to receive the test flow sent by a flow sending module of the main control end, on the other hand, the flow generating module of the controlled end sends the test flow to a flow receiving module of the main control end, after all data are sent and received, a performance statistical analysis module of the controlled end sends the statistical flow performance information to the main control end, and a performance statistical analysis module of the main control end carries out statistical analysis on the test performance.
And the coordination manager calculates the final test performance index according to the flow performance information reported by the main control end performance statistical analysis module.
Has the advantages that: compared with the prior art, the method and the device for testing the network service transmission performance by combining customization and playback provided by the invention have the following advantages:
1. accurate flow characteristic depiction
The playback mode is suitable for proprietary protocols or upper network application services (such as video conferences) which are complex, not regular and comprise a plurality of interaction modes. The playback mode adopts the real service flow collected in advance as a measurement template, and provides performance indexes according to the function types (such as data, voice, video and the like) provided by the service. The playback template of the playback mode comprises a plurality of network data transmission segments and related parameters thereof, and each network data transmission segment comprises: the type of transport layer protocol (TCP or UDP), the port of sending destination, the identification of data type, the sending time (relative offset), the content of the sending data, etc. Because the playback template is the real service flow collected in advance, the description of the flow characteristics by the playback template is most accurate.
2. Traffic pattern customization flexibility
The customized mode can be used for simulating VoIP voice service (SIP, RTP) and special network transmission service with moderate complexity, and supports the user to customize the flow generation parameters (duration, packet number, byte number, protocol type, TTL, packet distribution and load distribution) and generate specific flow for measurement. In a test task, the flow generation module generates the simulation flow and assembles the message in different modes according to the definition of a user, and the flow generation module has the characteristic of flexible customization and is specifically represented as follows:
analog traffic can be sent according to a single branch sequence, or a plurality of traffic sending branches can exist, and the analog traffic is sent in parallel among different branches;
analog data traffic of different protocol types (TCP or UDP) can be defined;
the data type identification defined in the test data template can be added into the analog data flow so as to distinguish different types of service flows (such as control flow and transmission flow) so as to respectively count the different types of service flows in the final performance test index statistics;
3. has good expansion capability to novel multimedia service
The playback mode allows a user to acquire real service flow as a playback template in advance, and the customization mode also allows the user to customize the flow template according to the characteristics of the service flow. Therefore, no matter which mode is adopted, the invention has good expansion capability to the novel multimedia service.
Drawings
FIG. 1 is a logical structure of the present invention;
FIG. 2 is a flow chart of the main control end of the present invention;
FIG. 3 is a flow chart of the controlled end of the present invention;
FIG. 4 is a timing diagram of the test interaction described in the present invention;
fig. 5 is a schematic diagram of the operation of the embodiment of the present invention.
Detailed Description
The present invention is further illustrated by the following examples, which are intended to be purely exemplary and are not intended to limit the scope of the invention, as various equivalent modifications of the invention will occur to those skilled in the art upon reading the present disclosure and fall within the scope of the appended claims.
As shown in fig. 1: the network service transmission performance testing device combining customization and playback deploys a coordination manager and a plurality of network performance probes in a testing network. The coordination manager is responsible for coordinating the same probe to serve as a master control end and n probes to serve as controlled ends. Each network performance probe is provided with five functional modules of strategy management, flow generation, flow receiving, performance statistical analysis and resource management.
The working flow of the main control end for operating the network service transmission performance test method provided by the invention is shown in fig. 2: firstly, a strategy management module of a main control end checks whether a task file issued by a coordination manager exists or not, if not, the strategy management module reports test failure information to the coordination manager and exits a program; and if the task file exists, analyzing the task information, analyzing the basic parameters of each data channel in the task, and initializing the task environment. If the initialization of the task environment fails, the task environment is cleaned, the test failure information is reported to the coordination manager, and the program is exited; if the task environment is initialized successfully, starting a flow generation module, then judging the task type, if the task type is a playback mode, extracting corresponding flow information according to a playback template, and if the playback template does not exist, reporting the test failure information to a main control end and exiting the program; if the task file is in the customized mode, the task file already contains corresponding stream information; then, according to the task file analysis information, a flow receiving module is established for receiving the data stream uploaded by the controlled end, sending the task file to each controlled end and starting the flow receiving module of each controlled end, then communication threads are respectively established with the flow receiving module of each controlled end, and specific flow is sent according to task requirements; and finally, the performance statistics and analysis module of the main control end counts the flow performance information received by the local end, summarizes the flow performance information and the performance flow information reported by the controlled end and then reports the information to the coordination manager.
The controlled end working flow for operating the network service transmission performance test method provided by the invention is shown in fig. 3: after the controlled end is started, a socket communicated with the main control end is established, and the connection of the main control end is monitored; after receiving the task file sent by the main control end, the strategy management module of the controlled end analyzes the task file, analyzes basic parameters of each data channel in the task and initializes the task environment. If the initialization of the task environment fails, the task environment is cleaned, the test failure information is reported to the coordination manager, and the program is exited; if the task environment is initialized successfully, starting a controlled end flow generation module; the flow generation module judges the task type, if the task type is a playback mode, corresponding flow information is extracted according to a playback template, if the playback template does not exist, the test failure information is reported to the coordination manager, and the program is exited; if the mode is the customized mode, corresponding flow information exists; and then, according to the analysis information of the task file, establishing a data receiving thread for the stream needing to receive data, monitoring, receiving the test flow sent by the main control end, and counting the stream performance information received by the local end by a performance statistical analysis module. After the monitoring of the data to be received at the corresponding port is finished, a data sending thread is established for the stream needing to send the data, and specific flow is sent to the main control end according to task requirements; and finally, after all data are sent and received, the controlled end performance statistical analysis module sends the statistical flow performance information to the main control end.
Fig. 4 shows a working sequence diagram of the network service transmission performance testing method provided by the present invention.
In step S1, the coordination manager customizes the service transmission performance test policy, creates a test task, and issues the test task to the main control end in the form of an XML file, and then performs step S2;
in step S2, after receiving the task file sent by the coordination manager, the main control end parses the policy and prepares a task environment. If the initialization of the task environment fails, the task environment is cleaned, the test failure information is reported to the coordination manager, and the program is exited; otherwise, go to step S3;
in step S3, the main control end determines the task type and starts the traffic generation module, if it is the playback mode, extracts the corresponding traffic information according to the playback template, if the playback template does not exist, reports the test failure information to the coordination manager and exits the program; if the mode is the customized mode, the corresponding flow information is already contained in the task file. The master control end further creates a flow receiving module for receiving the data flow uploaded by the controlled end according to the task file analysis information.
In step S4, the master sends a task instruction to each slave through the traffic generation module, and the slave parses the policy file and prepares a task environment. If the failure occurs, returning failure information and quitting the program, otherwise, returning a task receiving success message.
In step S5, the master end notifies the slaves to start a test task, creates a communication thread with the traffic receiving modules of the slaves respectively, sends a specific traffic according to the task requirement, and receives the traffic sent by the slaves. And if the process is abnormal, the main control end reports task failure information. Otherwise, after both the transmission and the reception are finished, the step S6 is performed.
In step S6, the slave transmits a message of sending end to the master, and the master ends the test task, and then performs step S7;
in step S7, the controlled end performs statistical analysis on the performance indexes of the test stream, and sends a performance data report to the main control end, and the main control end summarizes the statistical analysis data of the performance indexes of the local end and the controlled end, and performs step S8;
in step S8, the master reports the aggregated performance data report to the coordination manager, and the network service transmission performance test process is finished.
Examples
The embodiment provides an implementation method for testing the transmission performance of the network service based on the invention. First, we deploy 1 coordination manager C, 3 performance test probes P1, P2, P3 in the network, respectively, as shown in fig. 5. In order to test the network support capability for a specific traffic pattern service, a test task1 is edited and generated on a coordination manager C, in the task, a probe P1 is a master control end, P2 and P3 are controlled ends, an index distribution is selected by a traffic distribution model of the test task, and then the coordination manager C issues the task1 to the probe P1. After the P1 receives the test task, the task type is analyzed, communication is established with the probes P2 and P3, a traffic sending module and a traffic generating module are created for sending and receiving the test traffic, and the traffic size obeys the predefined exponential distribution. Meanwhile, the probes P2 and P3 also create a traffic transmission module and a traffic generation module, respectively, and transmit and receive test traffic also according to an exponential distribution. After the test task is completed, the probes P2 and P3 respectively count and analyze the performance indexes of the test stream, report the performance indexes to the probe P1 at the main control end, and report the information and the information counted by the probe P1 to the coordination manager C after summarizing, so that the test task is completed.
In addition, in order to test the network support capability for some complex traffic mode services, a replay test task2 may be edited and generated on the coordination manager C, in the task, the probe P1 is a master end, the probes P2 and P3 are slave ends, the traffic distribution model of the test task selects a replay mode and selects a predefined replay template Temp, and then the coordination manager C issues the task2 to the probe P1. After the P1 receives the test task, the task type is analyzed, communication is established with the probes P2 and P3, a flow sending module and a flow generating module are created for sending and receiving the test flow, and the flow is generated according to the playback flow template Temp. Meanwhile, the probes P2 and P3 also create a traffic sending module and a traffic generating module, respectively, and send and receive test traffic according to the playback traffic template Temp as well. After the test task is completed, the probes P2 and P3 respectively count and analyze the performance indexes of the test stream, report the performance indexes to the probe P1 at the main control end, and report the information and the information counted by the probe P1 to the coordination manager C after summarizing, so that the test task is completed.
The parts not involved in the present invention are the same as or can be implemented using the prior art.
Claims (9)
1. A method for testing the transmission performance of network service by combining customization and playback is characterized by comprising the following steps:
step 1, initialization: deploying a coordination manager and a plurality of network performance probes;
step 2, customizing a service transmission performance test strategy of the coordination manager: the service transmission performance test supports two modes of playback and customization;
step 3, the coordination manager creates a test task: the coordination manager is responsible for coordinating the same probe to serve as a main control end and n probes to serve as controlled ends according to the requirement of a test task; if the user requirement is a playback test mode, the coordination manager selects a corresponding playback template for the user requirement and specifies playback parameters; if the user requirement is a customized test mode, the coordination manager appoints a flow distribution model according to the requirement and gives flow parameters of the distribution model;
step 4, the main control end sends and receives a specific network service test flow, and the main control end counts the flow performance information received by the main control end, summarizes the flow performance information and the performance flow information reported by the controlled end and then reports the flow performance information and the performance flow information to the coordination manager;
step 5, the controlled terminal receives and sends the specific network service test flow, and after all data are sent and received, the controlled terminal sends the statistical flow performance information to the main control terminal;
step 6, the coordination manager calculates the test performance index: and the coordination manager calculates the final test performance index according to the flow performance information reported by the main control end.
2. The method for testing network service transmission performance combining customization and playback according to claim 1, wherein in step 2, the playback mode needs to collect traffic in advance and generate a playback template through a template generator, so as to support a user to select the traffic of different templates for playback test; the customized mode supports a user to customize different flow modes for testing according to requirements, supports the testing of complex services synthesized by a plurality of flows, and can define transport layer protocols, port numbers, duration, start time, grouping time interval distribution and grouping size distribution of each flow and specify statistical performance indexes of each test flow; the coordination manager selects a test mode from the playback and customization modes that meets the user's requirements.
3. The method for testing network service transmission performance in combination with customization and playback as claimed in claim 1, wherein in the step 3, the test flow is bidirectional during the test, so that the direction and number of the test flow, including the number of flows from the master to the slave and the number of flows from the slave to the master, are also specified in the test task; and then, packaging the direction and quantity information of the test flow in task file task.
4. The method for testing network service transmission performance in combination with customization and playback as claimed in claim 1, wherein step 4 specifically comprises the steps of: a) the main control end firstly checks whether a task file task.xml issued by a coordination manager exists or not through a self configuration file service _ perf.ini, if not, the main control end reports the test failure information to the coordination manager and exits the program; b) if the task file exists, analyzing the task file task.xml into corresponding task class information, analyzing basic parameters of each data channel in the task, assigning values to corresponding attributes in the task class, and initializing a task environment; if the initialization of the task environment fails, the task environment is cleaned, the test failure information is reported to the coordination manager, and the program is exited; if the task environment is initialized successfully, judging the task type; c) if the mode is the playback mode, extracting corresponding stream information according to a playback template in the task class, and if the playback template does not exist, reporting the test failure information to the coordination manager and exiting the program; if the mode is the customization mode, corresponding stream information exists in the task class; d) according to the task file analysis information, creating a data receiving thread for a stream needing to receive data, creating a corresponding target thread for each controlled terminal, sending a task file, then creating a communication thread with each controlled terminal respectively, and sending specific flow according to task requirements; e) the main control end performance statistic analysis module counts the flow performance information received by the local end, summarizes the flow performance information and the performance flow information reported by the controlled end and then reports the information to the coordination manager.
5. The method for testing network service transmission performance in combination with customization and playback as claimed in claim 1, wherein step 5 specifically comprises the steps of: a) after the controlled end is started, firstly establishing a socket communicated with the main control end, and monitoring the connection of the main control end; b) after receiving a task file sent by a main control end, analyzing task file task.xml into corresponding task class information, analyzing basic parameters of each data channel in a task, assigning values to corresponding attributes in the task class, and initializing a task environment; if the initialization of the task environment fails, the task environment is cleaned, the test failure information is reported to the coordination manager, and the program is exited; if the task environment is initialized successfully, judging the task type; c) if the mode is the playback mode, extracting corresponding stream information according to a playback template in the task class, and if the playback template does not exist, reporting the test failure information to the coordination manager and exiting the program; if the mode is the customization mode, corresponding stream information exists in the task class; d) according to the task file analysis information, a data receiving thread is established for the stream needing to receive data and monitored, the testing flow sent by the main control end is received, and the stream performance information received by the local end is counted by the performance statistical analysis module; e) after the monitoring of the data to be received at the corresponding port is finished, a data sending thread is established for the stream needing to send the data, and specific flow is sent to the main control end according to task requirements; f) and after all data are sent and received, the controlled end performance statistical analysis module sends the statistical flow performance information to the main control end.
6. The method for testing network traffic transmission performance of combination of customization and playback as claimed in claim 2, wherein in the process of generating the playback template, it is required to collect original traffic data first, and then for the original collected data stream, starting from the first packet, sequentially extract the time offset of the client-side and server-side communication packets with respect to the first packet, the transport layer protocol used for communication, the port, the stream ID and complete header information, and form a playback template file with these information.
7. A network service transmission performance testing device combining customization and playback is characterized by comprising a coordination manager and a plurality of network performance probes, wherein the coordination manager and the network performance probes are deployed in a control system; the coordination manager is responsible for coordinating the same probe to serve as a master control end and n probes to serve as controlled ends;
each network performance probe is provided with a strategy management module, a flow generation module, a flow receiving module, a performance statistic analysis module and a resource management module; the strategy management module is responsible for receiving a task strategy file issued by the analysis coordination manager and starting a corresponding flow generation module according to the definition of the strategy file; the flow generation module is responsible for receiving the test task transmitted by the strategy management module and calling different flow generation methods to initiate analog flow transmission according to a flow generation mode specified by the test task; the flow receiving module is responsible for receiving the analog flow; the performance statistical analysis module is responsible for statistical analysis of test performance to form a conclusive test index number for the test task;
the coordination manager provides service transmission performance tests supporting playback and customization modes; the playback mode needs a coordination manager to acquire flow in advance and generate a playback template through a template generator, and supports a user to select service flow of different templates for playback test; the customized mode supports a user to customize different flow modes for testing according to requirements, and supports the testing of complex services synthesized by a plurality of flows;
the coordination manager creates a test task: if the user requirement is a playback mode, the coordination manager selects a playback template for the user requirement and specifies playback parameters; if the user requirement is a customization mode, the coordination manager appoints a flow distribution model according to the requirement and gives related flow parameters of the distribution model; in the test, the test flow is bidirectional, so the direction and the number of the test flow, including the number of the flow from the master control end to the slave end and the number of the flow from the slave end to the master control end, need to be indicated in the test task; and then, packaging the service transmission performance test information in a file task.
8. The device for testing the transmission performance of the network service combining the customization and the playback as claimed in claim 7, wherein the policy management module of the main control end receives the task policy file, checks whether the task file task.xml issued by the coordination manager exists or not through the configuration file service _ perf.ini of the main control end, and if not, reports the test failure information to the coordination manager and exits the program; if the task file exists, analyzing the task file task.xml into corresponding task class information, analyzing basic parameters of each data channel in the task, assigning values to corresponding attributes in the task class, and initializing a task environment; if the initialization of the task environment fails, the task environment is cleaned, the test failure information is reported to the coordination manager, and the program is exited; if the task environment is initialized successfully, starting a flow generation module;
the flow generation module judges the task type, if the task type is a playback mode, corresponding flow information is extracted according to a playback template in the task type, and if the playback template does not exist, the test failure information is reported to the coordination manager and the program is quitted; if the mode is the customization mode, corresponding stream information exists in the task class; according to the analysis information of the task file, creating a data receiving thread for a stream needing to receive data, creating a corresponding target thread for each controlled terminal, sending the task file to a strategy management module of the controlled terminal, then creating a communication thread with each controlled terminal respectively, and sending specific flow according to task requirements;
the master control end performance statistical analysis module counts the flow performance information received by the local end, summarizes the flow performance information and the performance flow information reported by the controlled end performance statistical analysis module and then reports the summarized flow performance information and the performance flow information to the coordination manager.
9. The apparatus for testing network service transmission performance in combination with customization and playback as claimed in claim 7, wherein after the controlled end is started, a socket for communicating with the master end is first created, and the connection of the master end is monitored; after a policy management module receives a task file sent by a main control end, analyzing task file task.xml into corresponding task class information, analyzing basic parameters of each data channel in a task, assigning values to corresponding attributes in the task class, and initializing a task environment; if the initialization of the task environment fails, the task environment is cleaned, the test failure information is reported to the coordination manager, and the program is exited; if the task environment is initialized successfully, starting a controlled end flow generation module; the flow generation module judges the task type, if the task type is a playback mode, corresponding flow information is extracted according to a playback template in the task type, and if the playback template does not exist, the test failure information is reported to the coordination manager and the program is quitted; if the mode is the customization mode, corresponding stream information exists in the task class; according to the task file analysis information, a data receiving thread is established for the stream needing to receive data and monitored, the testing flow sent by the main control end is received, and the stream performance information received by the local end is counted by the performance statistical analysis module; after the monitoring of the data to be received at the corresponding port is finished, a data sending thread is established for the stream needing to send the data, and specific flow is sent to the main control end according to task requirements; after all data are sent and received, the performance statistics analysis module of the controlled end sends the statistical flow performance information to the main control end;
and the coordination manager calculates the final test performance index according to the flow performance information reported by the main control end performance statistical analysis module.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910758257.6A CN110445691B (en) | 2019-08-16 | 2019-08-16 | Method and device for testing network service transmission performance by combining customization and playback |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910758257.6A CN110445691B (en) | 2019-08-16 | 2019-08-16 | Method and device for testing network service transmission performance by combining customization and playback |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN110445691A CN110445691A (en) | 2019-11-12 |
| CN110445691B true CN110445691B (en) | 2020-03-24 |
Family
ID=68436120
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201910758257.6A Active CN110445691B (en) | 2019-08-16 | 2019-08-16 | Method and device for testing network service transmission performance by combining customization and playback |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN110445691B (en) |
Families Citing this family (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112491652B (en) * | 2020-11-18 | 2023-03-24 | 国家计算机网络与信息安全管理中心 | Network flow sample processing method and device for testing |
Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1503168A (en) * | 2002-11-22 | 2004-06-09 | 深圳市中兴通讯股份有限公司 | Automatic test method for system products |
| CN1750486A (en) * | 2005-08-16 | 2006-03-22 | 西安电子科技大学 | Network measuring system structure and its realizing method |
| US7222255B1 (en) * | 2001-02-28 | 2007-05-22 | 3Com Corporation | System and method for network performance testing |
| CN101252483A (en) * | 2008-04-10 | 2008-08-27 | 北京星网锐捷网络技术有限公司 | System and method for testing switch |
| CN105162664A (en) * | 2015-09-29 | 2015-12-16 | 上海斐讯数据通信技术有限公司 | Automatic platform testing method and system developed based on intermediate layers of instruments |
| CN105357036A (en) * | 2015-10-21 | 2016-02-24 | 盛科网络（苏州）有限公司 | Simulative object-oriented QoS (Quality of Service) verification model and method |
| CN106855795A (en) * | 2015-12-08 | 2017-06-16 | 上海复亚通信科技有限公司 | A kind of Proxy program operated between App and server software |
| CN109189519A (en) * | 2018-07-26 | 2019-01-11 | 哈尔滨工业大学（威海） | A kind of general user's desktop Behavior modeling system and method |
Family Cites Families (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN100561444C (en) * | 2006-11-15 | 2009-11-18 | 中兴通讯股份有限公司 | A kind of automatic test approach and test macro thereof that drives based on key word |
| CN201398196Y (en) * | 2009-05-14 | 2010-02-03 | 复旦大学 | Automatic monitoring system for communication network |
| CN102209006B (en) * | 2011-03-04 | 2014-09-03 | 北京神州绿盟信息安全科技股份有限公司 | Rule test equipment and method |
| US8782727B1 (en) * | 2012-04-04 | 2014-07-15 | Google Inc. | Adaptive video stream testing |
| CN108491319A (en) * | 2018-02-11 | 2018-09-04 | 广州小百合信息技术有限公司 | Web automated testing methods and system based on this method |
| CN109818822A (en) * | 2018-12-29 | 2019-05-28 | 冲石通信技术（北京）有限公司 | A kind of test method and system of the data readback using deep learning mechanism |
-
2019
- 2019-08-16 CN CN201910758257.6A patent/CN110445691B/en active Active
Patent Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US7222255B1 (en) * | 2001-02-28 | 2007-05-22 | 3Com Corporation | System and method for network performance testing |
| CN1503168A (en) * | 2002-11-22 | 2004-06-09 | 深圳市中兴通讯股份有限公司 | Automatic test method for system products |
| CN1750486A (en) * | 2005-08-16 | 2006-03-22 | 西安电子科技大学 | Network measuring system structure and its realizing method |
| CN101252483A (en) * | 2008-04-10 | 2008-08-27 | 北京星网锐捷网络技术有限公司 | System and method for testing switch |
| CN105162664A (en) * | 2015-09-29 | 2015-12-16 | 上海斐讯数据通信技术有限公司 | Automatic platform testing method and system developed based on intermediate layers of instruments |
| CN105357036A (en) * | 2015-10-21 | 2016-02-24 | 盛科网络（苏州）有限公司 | Simulative object-oriented QoS (Quality of Service) verification model and method |
| CN106855795A (en) * | 2015-12-08 | 2017-06-16 | 上海复亚通信科技有限公司 | A kind of Proxy program operated between App and server software |
| CN109189519A (en) * | 2018-07-26 | 2019-01-11 | 哈尔滨工业大学（威海） | A kind of general user's desktop Behavior modeling system and method |
Also Published As
| Publication number | Publication date |
|---|---|
| CN110445691A (en) | 2019-11-12 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN102017562B (en) | Quasi RTP metrics for non-RTP media flows | |
| US7461163B2 (en) | Real time mesh measurement system stream latency and jitter measurements | |
| CN101145977B (en) | A QoS monitoring system and its measuring method of IP data network | |
| US20060190594A1 (en) | Method and apparatus for evaluation of service quality of a real time application operating over a packet-based network | |
| CN108322356A (en) | A kind of industrial network gateway compatibility test method based on MQTT | |
| CN106535240B (en) | Mobile APP centralized performance analysis method based on cloud platform | |
| CN110048761A (en) | One kind is towards batch production satellite data transmission ground automation high speed data processing analysis system | |
| CN106411637A (en) | Internet-of-things device scenario testing method | |
| EP3310000A1 (en) | Methods and systems for analyzing streaming media sessions | |
| US9635569B2 (en) | Method and apparatus for measuring end-to-end service level agreement in service provider network | |
| JP2006311555A (en) | Device and method for correlating and displaying signal and network event | |
| CN102209010B (en) | Network test system and method | |
| CN110445691B (en) | Method and device for testing network service transmission performance by combining customization and playback | |
| Ruiz et al. | Modeling and assessing connectivity services performance in a sandbox domain | |
| CN108494625A (en) | A kind of analysis system on network performance evaluation | |
| Happenhofer et al. | Quality of signalling: A new concept for evaluating the performance of non-INVITE SIP transactions | |
| WO2023197498A1 (en) | Operation administration and maintenance information processing method, and network node and storage medium | |
| CN108449230B (en) | Network performance detection system, method and related device | |
| US20110153596A1 (en) | Scenario, Call, and Protocol Data Unit Hierarchical Comparator | |
| CN109831353B (en) | Automatic testing device for multiple network services | |
| Yang et al. | A technical research towards 5G SLA: System definition, sense and assurance solution | |
| Wang et al. | Ml-based application performance modelling over a sdn network using end-to-end and link metrics | |
| Cong et al. | A unified load generator based on formal load specification and load transformation | |
| Toll et al. | IoTreeplay: Synchronous Distributed Traffic Replay in IoT Environments | |
| Mohammadpour et al. | A zero-touch as-a-service active monitoring framework for virtualized network environments |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |