CN111404763B - A core network performance testing method, device and system - Google Patents

Abstract

The present invention provides a core network performance testing method, device and system, wherein the core network performance testing method includes: acquiring at least one message set to be tested; respectively performing test configuration on the at least one message set to be tested, and obtaining a test configuration result; According to the at least one message set to be tested and the test configuration result, the core network performance test is performed on the network element to be tested, and the test result is obtained. This solution obtains at least one set of messages to be tested; performs test configuration on at least one set of messages to be tested respectively, and obtains a test configuration result; Obtain the test results; thus, the message-based pressure loading method can implement directional testing for specific messages and specific behaviors, and realize flexible test capability scheduling; and the surrounding network elements are no longer simulated by commercial instruments for surround testing, which greatly reduces the number of tests. cost.

Description

A core network performance testing method, device and system

technical field

The present invention relates to the field of communication technology, in particular to a core network performance testing method, device and system.

Background technique

At present, the core network performance test is based on the full-envelopment test scheme of the existing instrument manufacturers, as shown in Figure 1: Based on a certain business model, the test is based on user behavior, and the network element under test (such as 4G core network) is simulated by commercial instruments. EPC, IP Multimedia Subsystem IMS, etc.) peripheral equipment to implement surround connection to the network elements under test (such as EPC, IMS, home subscriber server HSS, routing agent node DRA, etc.), through the proprietary hardware and software simulation of commercial instruments Millions of users put pressure on the network element under test. In Figure 1, BSC stands for Base Station Controller, RNC stands for Radio Network Controller, eNB stands for Evolved Base Station, HLR stands for Home Location Register, HSS stands for Home Subscriber Server, MME stands for Mobility Entity Management, SGSN stands for Serving GPRS Support Node, and SGW stands for Serving gateway, GGSN means gateway GPRS support node, eMSC means enhanced mobile switching center.

With the continuous increase of network capacity and the advancement of virtualization process, the above test method has the following disadvantages:

1. The load of the traditional test method is all based on the traffic model and the number of users. It is difficult to implement test cases (such as ping-pong switching, etc.) for specific messages and specific behaviors (especially abnormal behaviors), and it is impossible to achieve flexible test capacity scheduling.

2. The processing capacity of the core network card has been continuously enhanced, and the performance has been greatly improved. The number of users and traffic involved in performance test cases have also increased significantly (for example, the number of users processed by a single HSS at the same time reaches 30 million, and the number of users processed by the IP short message gateway at the same time needs to reach 60 million or more), the existing test method uses commercial instruments to simulate surrounding network elements to perform encirclement testing, and the traffic loading cost will increase significantly.

3. With the advancement of core network virtualization, more and more core network elements are migrated from equipment manufacturers' proprietary hardware platforms to X86 general-purpose platforms through software and hardware decoupling or three-layer decoupling. The pairing mode between different service layers, virtualization layers, and hardware layers is very flexible, and the traditional full-envelopment test cannot meet the requirements of the virtualized core network for performance testing of each layer.

4. Integration of R&D and operations and flexible deployment are important features of the virtualized core network, and performance testing is a necessary link after system deployment. Traditional hardware-based wrap-around testing methods cannot meet the "deployment-to-test" requirement of a virtualized core network.

Contents of the invention

The purpose of the present invention is to provide a core network performance testing method, device and system to solve the problems that the core network performance testing scheme in the prior art cannot realize flexible test capability scheduling and the test cost is constantly increasing significantly.

In order to solve the above technical problems, an embodiment of the present invention provides a core network performance testing method, including:

Obtain at least one message set to be tested;

Performing test configuration on the at least one message set to be tested respectively to obtain a test configuration result;

According to the at least one message set to be tested and the test configuration result, perform a core network performance test on the network element to be tested to obtain a test result.

Optionally, the acquiring at least one message set to be tested includes:

Obtain at least one message set to be tested according to the service volume requirement of the test and the topology structure of the networking.

Optionally, the acquisition of at least one message set to be tested according to the traffic requirements of the test and the topology of the networking includes:

Obtain at least one load pressure number according to the business volume requirements of the test and the topology of the network;

Acquire at least one message set to be tested according to the at least one load pressure number.

Optionally, performing test configuration on the at least one message set to be tested respectively to obtain a test configuration result includes:

Configure the network association IP address, port number and/or packet sending rate for the at least one message set to be tested, and obtain a test configuration result.

Optionally, performing a core network performance test on the network element to be tested according to the at least one message set to be tested and the test configuration result, to obtain a test result, including:

Performing a core network performance test on the network element to be tested according to the at least one message set to be tested and the test configuration result;

If the update information of at least one message set to be tested is obtained during the test, continue to perform core network performance on the network element to be tested according to the update information, the at least one message set to be tested, and the test configuration result. Test and get test results.

Optionally, the test results include:

The number of successfully sent messages and/or the successful sent ratio of the messages to be tested in each message set to be tested.

The embodiment of the present invention also provides a core network performance testing system, including:

a message layer and a user layer communicating with said message layer;

Wherein, the message layer is used to obtain at least one message set to be tested; perform test configuration on the at least one message set to be tested respectively, and obtain a test configuration result;

The user layer is configured to perform a core network performance test on the network element to be tested according to the at least one message set to be tested and the test configuration result, and obtain a test result.

Optionally, the message layer is specifically used for:

Obtain at least one message set to be tested according to the service volume requirement of the test and the topology structure of the networking.

Optionally, the message layer is specifically used for:

Obtain at least one load pressure number according to the business volume requirements of the test and the topology of the network;

Acquire at least one message set to be tested according to the at least one load pressure number.

Optionally, the message layer is specifically used for:

The network association IP address, port number and/or packet sending rate are respectively configured for the at least one message set to be tested.

Optionally, the user layer is specifically used for:

Performing a core network performance test on the network element to be tested according to the at least one message set to be tested and the test configuration result;

If the update information of at least one message set to be tested is obtained during the test, continue to perform core network performance on the network element to be tested according to the update information, the at least one message set to be tested, and the test configuration result. Test and get test results.

Optionally, the test results include:

The number of successfully sent messages and/or the successful sent ratio of the messages to be tested in each message set to be tested.

Optionally, also include:

a virtualization layer in communication with the messaging layer, and a physical layer in communication with the virtualization layer;

Wherein, the physical layer is used to provide test physical resources for the core network performance test system;

The virtualization layer is used to virtualize computing and storage network resources, and concentrate the virtualized network resources in a shared resource pool;

The message layer acquires at least one message set to be tested by invoking virtual resources in the shared resource pool; and performs test configuration on the at least one message set to be tested to obtain a test configuration result.

Optionally, the message layer is directly connected to a virtual network element in a network function virtualization NFV framework.

The embodiment of the present invention also provides a core network, the core network has a network function virtualization NFV framework, including: the above-mentioned core network performance testing system.

The embodiment of the present invention also provides a core network performance testing device, including:

A first processing module, configured to acquire at least one message set to be tested;

The second processing module is configured to respectively perform test configuration on the at least one message set to be tested, and obtain a test configuration result;

The third processing module is configured to perform a core network performance test on the network element to be tested according to the at least one message set to be tested and the test configuration result, and obtain a test result.

Optionally, the first processing module includes:

The first obtaining sub-module is used to obtain at least one message set to be tested according to the service volume requirement of the test and the topology structure of the networking.

Optionally, the first acquisition submodule includes:

The first processing unit is configured to obtain at least one load pressure number according to the traffic demand of the test and the topology of the networking;

The first acquiring unit is configured to acquire at least one message set to be tested according to the at least one load pressure number.

Optionally, the second processing module includes:

The first configuration sub-module is configured to respectively configure the network association IP address, port number and/or packet sending rate for the at least one message set to be tested, and obtain a test configuration result.

Optionally, the third processing module includes:

The first processing submodule is configured to perform a core network performance test on the network element to be tested according to the at least one message set to be tested and the test configuration result;

The second processing submodule is configured to: if the update information of at least one message set to be tested is obtained during the test, according to the update information, the at least one message set to be tested and the test configuration result, treat The test network element continues to perform the core network performance test, and obtains the test result.

Optionally, the test results include:

The number of successfully sent messages and/or the successful sent ratio of the messages to be tested in each message set to be tested.

An embodiment of the present invention also provides a core network performance testing system, including a memory, a processor, and a computer program stored on the memory and operable on the processor; when the processor executes the program, the The above core network performance testing method.

An embodiment of the present invention also provides a computer-readable storage medium, on which a computer program is stored, and when the program is executed by a processor, the steps in the above core network performance testing method are implemented.

The beneficial effects of above-mentioned technical scheme of the present invention are as follows:

In the above scheme, the core network performance testing method acquires at least one message set to be tested; performs test configuration on the at least one message set to be tested respectively to obtain a test configuration result; according to the at least one message set to be tested and the Based on the test configuration results described above, the core network performance test is performed on the network element to be tested, and the test results are obtained; thus, the directional test can be carried out for specific messages and specific behaviors based on the message-based pressure loading method, and flexible test capability scheduling can be realized; and no longer Surrounding tests are performed by simulating peripheral network elements through commercial instruments, which greatly reduces test costs.

Description of drawings

FIG. 1 is a schematic diagram of a core network performance test architecture in the prior art;

2 is a schematic flow chart of a core network performance testing method according to an embodiment of the present invention;

3 is a schematic structural diagram of a core network performance testing system according to an embodiment of the present invention;

4 is a schematic diagram of a specific application architecture of a core network performance testing system according to an embodiment of the present invention;

FIG. 5 is a schematic diagram of a business processing flow in an embodiment of the present invention;

6 is a schematic diagram of direct connection between the message layer and the virtual network element in the NFV framework of the embodiment of the present invention;

FIG. 7 is a schematic diagram of a core network performance testing process according to an embodiment of the present invention;

FIG. 8 is a schematic diagram of a test network according to an embodiment of the present invention;

FIG. 9 is a schematic diagram of a message group and a load pressure according to an embodiment of the present invention;

FIG. 10 is a schematic diagram of message configuration according to an embodiment of the present invention;

Fig. 11 is a schematic diagram of the start test and dynamic pressurization of the embodiment of the present invention;

Fig. 12 is a schematic diagram of a test report of an embodiment of the present invention;

FIG. 13 is a schematic structural diagram of a core network performance testing device according to an embodiment of the present invention.

Detailed ways

In order to make the technical problems, technical solutions and advantages to be solved by the present invention clearer, the following will describe in detail with reference to the drawings and specific embodiments.

The present invention aims at the problem that the core network performance test scheme in the existing technology cannot realize flexible test capability scheduling and the test cost increases continuously, and provides a core network performance test method, as shown in FIG. 2 , including:

Step 21: Obtain at least one message set to be tested;

Step 22: performing test configuration on the at least one message set to be tested respectively, and obtaining a test configuration result;

Step 23: Perform a core network performance test on the network element to be tested according to the at least one message set to be tested and the test configuration result, and obtain a test result.

The core network performance testing method provided by the embodiment of the present invention acquires at least one message set to be tested; respectively performs test configuration on the at least one message set to be tested to obtain a test configuration result; according to the at least one message set to be tested and the test configuration result, performing a core network performance test on the network element to be tested to obtain a test result; thereby being able to implement a directional test for a specific message and a specific behavior based on a message-based pressure loading method, and realize flexible test capability scheduling; and Surrounding tests are no longer performed by simulating surrounding network elements through commercial instruments, which greatly reduces test costs.

Wherein, said acquiring at least one message set to be tested includes: acquiring at least one message set to be tested according to the traffic requirement of the test and the topology of the networking.

Specifically, said obtaining at least one message set to be tested according to the traffic requirements of the test and the topology of the networking includes: obtaining at least one load pressure number according to the traffic requirements of the test and the topology of the networking; The at least one load pressure number is used to obtain at least one message set to be tested.

It may be that a corresponding message set to be tested is obtained according to a load pressure number, but it is not limited thereto.

In the embodiment of the present invention, said performing test configuration on said at least one message set to be tested respectively to obtain the test configuration result includes: respectively configuring network association IP addresses, port numbers and/or Packet sending rate, get test configuration results.

Specifically, performing the core network performance test on the network element to be tested according to the at least one message set to be tested and the test configuration result to obtain the test result includes: according to the at least one message set to be tested and the test configuration result As a result of the configuration, perform a core network performance test on the network element to be tested; if the update information of at least one message set to be tested is obtained during the test, then according to the update information, the at least one message set to be tested, and the Test the configuration results, continue to perform the core network performance test on the network element to be tested, and obtain the test results.

This enables dynamic pressurization.

In the embodiment of the present invention, the test result may include: the number of successfully sent messages and/or the ratio of successfully sent messages in each message set to be tested, but it is not limited thereto.

The embodiment of the present invention also provides a core network performance testing system, as shown in Figure 3, including:

a message layer 31 and a user layer 32 communicating with said message layer 31;

Wherein, the message layer 31 is configured to acquire at least one message set to be tested; perform test configuration on the at least one message set to be tested respectively, and obtain a test configuration result;

The user layer 32 is configured to perform a core network performance test on the network element to be tested according to the at least one message set to be tested and the test configuration result, and obtain a test result.

The core network performance testing system provided by the embodiment of the present invention acquires at least one message set to be tested; performs test configuration on the at least one message set to be tested respectively to obtain a test configuration result; according to the at least one message set to be tested and the test configuration result, performing a core network performance test on the network element to be tested to obtain a test result; thereby being able to implement a directional test for a specific message and a specific behavior based on a message-based pressure loading method, and realize flexible test capability scheduling; and Surrounding tests are no longer performed by simulating surrounding network elements through commercial instruments, which greatly reduces test costs.

Wherein, the message layer is specifically configured to: obtain at least one message set to be tested according to the service volume requirement of the test and the topology structure of the networking.

Specifically, the message layer is specifically configured to: obtain at least one load pressure number according to the test traffic requirement and the network topology; and obtain at least one message set to be tested according to the at least one load pressure number.

In the embodiment of the present invention, the message layer is specifically configured to: respectively configure the network association IP address, port number and/or packet sending rate for the at least one message set to be tested.

Specifically, the user layer is specifically configured to: perform a core network performance test on the network element to be tested according to the at least one message set to be tested and the test configuration result; if at least one of the network elements to be tested is obtained during the test For the update information of the message set, according to the update information, the at least one message set to be tested and the test configuration result, the network element to be tested continues to perform the core network performance test to obtain the test result.

In the embodiment of the present invention, the test result may include: the number of successfully sent messages and/or the ratio of successfully sent messages in each message set to be tested, but it is not limited thereto.

Further, the core network performance testing system also includes: a virtual layer communicating with the message layer, and a physical layer communicating with the virtual layer; wherein, the physical layer is used to provide the core network performance testing system with Test physical resources; the virtualization layer is used to virtualize computing and storage network resources, and concentrate the virtualized network resources in the shared resource pool; the message layer, by calling the shared resource pool virtual resources to obtain at least one message set to be tested; performing test configuration on the at least one message set to be tested to obtain a test configuration result.

Wherein, the message layer can be directly connected with the virtual network element in the network function virtualization NFV framework, so as to realize the test on the virtual network element.

Wherein, the implementation examples of the above-mentioned core network performance testing method are all applicable to the embodiments of the core network performance testing system, and can also achieve the same technical effect.

The core network performance testing system provided by the embodiment of the present invention will be further described with examples below.

In view of the above technical problems, the embodiment of the present invention provides a core network performance testing system, specifically, the corresponding message-based core network testing system architecture can be shown in Figure 4, the system is divided into four layers, respectively physical layer , virtual layer, message layer and user layer.

Among them, the physical layer: the physical layer mainly provides test physical resources for the entire test system, and the computing power and storage capacity of the general x86 server are the basis of the virtual layer (the physical layer uses a general x86 server).

Virtualization layer: Computing, storage, and network resources are virtualized through the hypervisor. Concentrate all virtual resources in a unified shared resource pool for easy scheduling.

Message layer: The message layer is the main control logic layer of the message-based virtualized core network test solution proposed in this solution. The message layer is divided into three modules: test engine, message group control and resource scheduling.

1. Test engine: The test engine mainly provides virtual user management and scheduling functions for testing, and is divided into two parts: load control and scheduling control. Among them, the load control mainly controls the number of virtual users and the loading speed according to the requirements of the test. Scheduling control mainly controls the running state of the message unit, such as running, pausing, stopping, etc. The test engine is loosely coupled with the message group, independent of the type of message processed, and has universality.

2. Message group control: A message group is a collection of all messages used to simulate the complete business process of the test, and each message is independent. The message group can simulate the business processes and interface protocols of all network elements around the network element under test to realize full-envelopment testing. Message group control includes two parts: message unit and message configuration.

The message unit can be a pair of sending and receiving messages or a combination of several pairs of sending and receiving messages customized by the user according to the test requirements. Usually, a message unit is a subset of a certain business process. Taking the new registration process of HSS network element VoLTE as an example, the definition of the message unit is explained. The overall business process is shown in Figure 5. The normal business process consists of four pairs of messages: UAR (User-Authoriization-Request, user authentication request) /UAA(User-Authoriization-Answer, User Authentication Response), MAR(Multimedia-Auth-Request, Multimedia Authentication Request)/MAA(Multimedia-Auth-Answer, Multimedia Authentication Response), UAR/UAA, SAR(Server -Assignment-Request, Server Assignment Request)/SAA (Server-Assignment-Answer, Server Assignment Response). Existing commercial meters also follow this process. This solution splits the messages in the business process into several message groups for management. In the process shown in Figure 5, four pairs of messages are used as four message units, and their loads are controlled respectively. When a pair of messages is abnormal, it does not affect the sending and receiving of other messages, which is convenient for exception handling. When a complete business process contains many message pairs, the user can choose to use multiple pairs of messages as a message unit, and the degree of message splitting is controllable.

Message configuration includes static configuration and dynamic library. The static configuration does not need to be modified during the test, such as IP address, port number and so on. The dynamic library mainly implements the docking function between the message unit and the test engine, including obtaining the sending content, encapsulating the request, sending the request, receiving the response, processing the response, etc. The test engine can realize the loading and dispatching of messages through the dynamic library.

3. Resource regulation: Resource regulation is mainly used to monitor resource usage and realize resource scheduling.

User layer: The user layer mainly provides users with a test operation interface, and users can perform operations such as formulating test cases, process control, monitoring the test process, and generating test reports.

The message-based core network test architecture proposed in this solution is highly consistent with the NFV core network architecture. The message layer of the test system can be directly connected to the virtual network elements in NFV (as shown in Figure 6). It can also directly integrate the test tool (this system) into the core network with the NFV framework, and directly call the test tool through MANO to realize "deployment is testing" (Mano is not a part of the system, but the NFV architecture Part of it realizes the orchestration and scheduling functions of network elements. Here it means that the message layer of this system can directly connect with the virtualized network function layer in the NFV architecture, and provide an interface that MANO can call, and MANO can directly schedule this system).

In Figure 6, EMS represents the network element management system, VNF represents the virtual network function, OSS represents the operation support system, and BSS represents the business support system.

Specifically, the testing process of this system can be shown in Figure 7, including:

Step 71: Calculating the load pressure of each message unit according to the test traffic requirement and the topology of the networking. Wherein, the test network diagram may be shown in FIG. 8 , and the message group and load pressure may be shown in FIG. 9 .

In Figure 8, MSC Server represents the Mobile Switching Center Server, HLR represents the Home Location Register, HSS represents the Home Subscriber Server, MME represents the Mobility Entity Management, SGSN represents the Serving GPRS Support Node, BOSS represents the Business Operation Support System, and TAS represents the Communication Application Server, I-CSCF stands for Interrogating Call Session Control Function, and S-CSCF stands for Serving Call Session Control Function.

In Fig. 9, CAPS represents the number of established calls per second.

Step 72: Configure the message group, including parameters such as IP, port number, and packet sending rate, as shown in FIG. 10 .

In Figure 10, DNS represents the domain name system, IP represents the network protocol, Value represents the value, and virip represents the variable name—virtual ip—customized by the test result.

Step 73: Perform load setting for each message unit through the test engine.

Step 74: Start the test and monitor the test indicators in real time, as shown in Figure 11 (the test can also be dynamically pressurized).

Specifically, the user layer schedules the message layer, the virtual layer, and the physical layer to execute the test cooperatively.

In Figure 11, EPC represents the core packet network evolution, and VOBB represents broadband voice.

Step 75: End the test, obtain a report (as shown in FIG. 12 ), and analyze problems (core network performance analysis).

Specifically, the user layer schedules the message layer, the virtual layer, and the physical layer for coordinated execution.

Figure 12 includes parameter testing capability Testing Capability, test start time Test Start Time, test end time Test End Time, and test duration Test Duration; where, IP-TRAFFIC-DNS means network protocol-traffic-domain name system.

It can be seen from the above that the embodiment of the present invention provides a message-based core network test load loading method, which abandons the traditional test scheme based on business models and user behaviors, and disassembles the business models required for testing into independent messages based on interfaces. unit, then combine messages, control them and test them. This test system can be deployed on a general-purpose X86 platform, get rid of the limitations of traditional instruments on software and hardware, and meet the test requirements of the virtualized core network.

Among them, this system: 1) sets the same four-layer structure as the NFV architecture, and can directly connect the message layer of the test system with the virtual network element in NFV to test the virtual network element; 2) perform load pressure calculation on the message layer , and use the message group to simulate the business process and interface protocol of all network elements around the network element under test, so as to realize the full-envelopment test.

To sum up, the framework for performance testing of core network elements and the load pressurization method based on message units provided by the embodiments of the present invention can realize flexible test capacity scheduling, and the load pressurization capability has also been greatly increased; while the general-purpose X86 server-based The deployment method can also meet the requirement of "deployment is testing" of virtualized core network elements, so as to truly realize the goal of virtualization of test capabilities.

The embodiment of the present invention also provides a core network, the core network has a network function virtualization NFV framework, including: the above-mentioned core network performance testing system.

Wherein, the implementation examples of the above-mentioned core network performance testing system are all applicable to the embodiments of the core network, and can also achieve the same technical effect.

The embodiment of the present invention also provides a core network performance testing device, as shown in Figure 13, including:

The first processing module 131 is configured to acquire at least one message set to be tested;

The second processing module 132 is configured to respectively perform test configuration on the at least one message set to be tested, and obtain a test configuration result;

The third processing module 133 is configured to perform a core network performance test on the network element to be tested according to the at least one message set to be tested and the test configuration result, and obtain a test result.

The core network performance testing device provided in the embodiment of the present invention acquires at least one message set to be tested; performs test configuration on the at least one message set to be tested respectively to obtain a test configuration result; according to the at least one message set to be tested and the test configuration result, performing a core network performance test on the network element to be tested to obtain a test result; thereby being able to implement a directional test for a specific message and a specific behavior based on a message-based pressure loading method, and realize flexible test capability scheduling; and Surrounding tests are no longer performed by simulating surrounding network elements through commercial instruments, which greatly reduces test costs.

Wherein, the first processing module includes: a first obtaining sub-module, configured to obtain at least one message set to be tested according to the traffic demand of the test and the topology of the networking.

Specifically, the first acquisition submodule includes: a first processing unit, configured to obtain at least one load pressure number according to the traffic demand of the test and the topology of the networking; a first acquisition unit, configured to obtain at least one load pressure number according to the At least one load pressure number to obtain at least one message set to be tested.

In the embodiment of the present invention, the second processing module includes: a first configuration submodule, configured to respectively configure the network association IP address, port number and/or packet sending rate for the at least one message set to be tested, and obtain the test configuration result.

Specifically, the third processing module includes: a first processing submodule, configured to perform a core network performance test on the network element to be tested according to the at least one message set to be tested and the test configuration result; the second processing submodule A module, configured to, if the update information of at least one message set to be tested is obtained during the test, proceed to the network element to be tested according to the update information, the at least one message set to be tested, and the test configuration result Conduct core network performance tests and obtain test results.

In the embodiment of the present invention, the test result may include: the number of successfully sent messages and/or the ratio of successfully sent messages in each message set to be tested.

Wherein, the implementation examples of the above-mentioned core network performance testing method are all applicable to the embodiments of the core network performance testing device, and can also achieve the same technical effect.

An embodiment of the present invention also provides a core network performance testing system, including a memory, a processor, and a computer program stored on the memory and operable on the processor; when the processor executes the program, the The above core network performance testing method.

Wherein, the implementation examples of the above-mentioned core network performance testing method are all applicable to the embodiments of the core network performance testing system, and can also achieve the same technical effect.

An embodiment of the present invention also provides a computer-readable storage medium, on which a computer program is stored, and when the program is executed by a processor, the steps in the above core network performance testing method are implemented.

Wherein, the above implementation examples of the core network performance testing method are all applicable to the examples of the computer-readable storage medium, and can also achieve the same technical effect.

It should be noted that many functional components described in this specification are referred to as modules/submodules/units, in order to more particularly emphasize the independence of their implementation.

In the embodiments of the present invention, the modules/submodules/units may be implemented by software so as to be executed by various types of processors. An identified module of executable code may, by way of example, comprise one or more physical or logical blocks of computer instructions which may, for example, be structured as an object, procedure, or function. Notwithstanding, the executable code of an identified module need not be physically located together, but may include distinct instructions stored in different bits which, when logically combined, constitute the module and implement the specified Purpose.

Indeed, a module of executable code may be a single instruction, or many instructions, and may even be distributed over several different code segments, among different programs and across multiple memory devices. Likewise, operational data may be identified within modules, and may be implemented in any suitable form and organized within any suitable type of data structure. The operational data may be collected as a single data set, or may be distributed in different locations (including on different storage devices), and may exist, at least in part, only as electronic signals on a system or network.

When the module can be realized by software, considering the level of the existing hardware technology, the module that can be realized by software, regardless of the cost, those skilled in the art can build the corresponding hardware circuit to realize the corresponding function. The hardware circuit includes conventional very large scale integration (VLSI) circuits or gate arrays as well as existing semiconductors such as logic chips, transistors, or other discrete components. A module may also be implemented in programmable hardware devices such as field programmable gate arrays, programmable array logic, programmable logic devices, and the like.

What has been described above is a preferred embodiment of the present invention. It should be pointed out that for those skilled in the art, some improvements and modifications can also be made without departing from the principle of the present invention. These improvements and modifications should also be considered as Be the protection scope of the present invention.

Claims (23)

1. A method for testing performance of a core network is characterized by comprising the following steps:

acquiring at least one message set to be tested, wherein each message set to be tested in the at least one message set to be tested is a subset of a business processing flow, and the subset of the business processing flow is obtained by splitting messages in the business processing flow;

respectively carrying out test configuration on the at least one message set to be tested to obtain a test configuration result;

and performing core network performance test on the network element to be tested according to the at least one message set to be tested and the test configuration result to obtain a test result.

2. The method according to claim 1, wherein the obtaining at least one set of messages to be tested comprises:

and acquiring at least one message set to be tested according to the tested traffic demand and the networking topological structure.

3. The method for testing the performance of the core network according to claim 2, wherein the obtaining of at least one message set to be tested according to the tested traffic demand and the networking topology comprises:

obtaining at least one load pressure number according to the tested traffic demand and the networking topological structure;

and acquiring at least one message set to be tested according to the at least one load pressure number.

4. The method according to claim 1, wherein the performing test configuration on the at least one message set to be tested respectively to obtain a test configuration result comprises:

and respectively configuring a network protocol IP address, a port number and/or a packet sending rate for the at least one message set to be tested to obtain a test configuration result.

5. The method according to claim 1, wherein the performing, according to the at least one message set to be tested and the test configuration result, a core network performance test on a network element to be tested to obtain a test result comprises:

performing core network performance test on the network element to be tested according to the at least one message set to be tested and the test configuration result;

and if the update information of at least one message set to be tested is acquired in the test process, continuously performing core network performance test on the network element to be tested according to the update information, the at least one message set to be tested and the test configuration result to obtain a test result.

6. The core network performance testing method of claim 1, wherein the test result comprises:

and the sending success quantity and/or the sending success ratio of the messages to be tested in each message set to be tested.

7. A core network performance testing system, comprising:

a message layer and a user layer in communication with the message layer;

the message layer is used for acquiring at least one message set to be tested; respectively carrying out test configuration on the at least one message set to be tested to obtain a test configuration result, wherein each message set to be tested in the at least one message set to be tested is a subset of a business processing flow, and the subset of the business processing flow is obtained by splitting messages in the business processing flow;

and the user layer is used for performing core network performance test on the network element to be tested according to the at least one message set to be tested and the test configuration result to obtain a test result.

8. The core network performance testing system of claim 7, wherein the message layer is specifically configured to:

and acquiring at least one message set to be tested according to the tested traffic demand and the networking topological structure.

9. The core network performance testing system of claim 8, wherein the message layer is specifically configured to:

obtaining at least one load pressure number according to the tested traffic demand and the networking topological structure;

and acquiring at least one message set to be tested according to the at least one load pressure number.

10. The core network performance testing system of claim 7, wherein the message layer is specifically configured to:

and respectively configuring a network protocol IP address, a port number and/or a packet sending rate for the at least one message set to be tested.

11. The core network performance testing system of claim 7, wherein the user layer is specifically configured to:

performing core network performance test on the network element to be tested according to the at least one message set to be tested and the test configuration result;

and if the updating information of at least one message set to be tested is acquired in the testing process, continuing the performance test of the core network on the network element to be tested according to the updating information, the at least one message set to be tested and the test configuration result to obtain a test result.

12. The core network performance testing system of claim 7, wherein the test results comprise:

the sending success quantity and/or the sending success ratio of the messages to be tested in each message set to be tested.

13. The core network performance testing system of any of claims 7-12, further comprising:

a virtual layer in communication with the message layer, and a physical layer in communication with the virtual layer;

the physical layer is used for providing test physical resources for a core network performance test system;

the virtual layer is used for virtualizing the calculated and stored network resources and centralizing the virtualized network resources in a shared resource pool;

the message layer acquires at least one message set to be tested by calling virtual resources in the shared resource pool; and respectively carrying out test configuration on the at least one message set to be tested to obtain a test configuration result.

14. The core network performance testing system of claim 13, wherein the message layer interfaces directly with virtual network elements in a network functions virtualization, NFV, framework.

15. A core network having a network function virtualization, NFV, framework, comprising: a core network performance test system as claimed in any one of claims 7 to 14.

16. A core network performance testing apparatus, comprising:

the system comprises a first processing module, a second processing module and a third processing module, wherein the first processing module is used for acquiring at least one message set to be tested, each message set to be tested in the at least one message set to be tested is a subset of a business processing flow, and the subset of the business processing flow is obtained by splitting messages in the business processing flow;

the second processing module is used for respectively carrying out test configuration on the at least one message set to be tested to obtain a test configuration result;

and the third processing module is used for performing core network performance test on the network element to be tested according to the at least one message set to be tested and the test configuration result to obtain a test result.

17. The core network performance testing apparatus of claim 16, wherein the first processing module comprises:

and the first acquisition submodule is used for acquiring at least one message set to be tested according to the tested traffic demand and the networking topological structure.

18. The core network performance testing apparatus of claim 17, wherein the first obtaining sub-module comprises:

the first processing unit is used for obtaining at least one load pressure number according to the tested traffic demand and the networking topological structure;

and the first acquisition unit is used for acquiring at least one message set to be tested according to the at least one load pressure number.

19. The core network performance testing apparatus of claim 16, wherein the second processing module comprises:

and the first configuration submodule is used for respectively configuring a network protocol IP address, a port number and/or a packet sending rate for the at least one message set to be tested to obtain a test configuration result.

20. The core network performance testing apparatus of claim 16, wherein the third processing module comprises:

the first processing submodule is used for carrying out core network performance test on the network element to be tested according to the at least one message set to be tested and the test configuration result;

and the second processing submodule is used for continuously carrying out the core network performance test on the network element to be tested according to the update information, the at least one message set to be tested and the test configuration result to obtain a test result if the update information of the at least one message set to be tested is obtained in the test process.

21. The core network performance testing apparatus of claim 16, wherein the test result comprises:

and the sending success quantity and/or the sending success ratio of the messages to be tested in each message set to be tested.

22. A core network performance testing system comprising a memory, a processor and a computer program stored on the memory and executable on the processor; a core network performance testing method according to any one of claims 1 to 6, when the processor executes the program.

23. A computer-readable storage medium, on which a computer program is stored, which, when being executed by a processor, carries out the steps in the core network performance testing method according to any one of claims 1 to 6.

Images