CN111404763B - Core network performance test method, device and system - Google Patents
Core network performance test method, device and system Download PDFInfo
- Publication number
- CN111404763B CN111404763B CN201910000937.1A CN201910000937A CN111404763B CN 111404763 B CN111404763 B CN 111404763B CN 201910000937 A CN201910000937 A CN 201910000937A CN 111404763 B CN111404763 B CN 111404763B
- Authority
- CN
- China
- Prior art keywords
- tested
- test
- message set
- core network
- message
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L43/00—Arrangements for monitoring or testing data switching networks
- H04L43/08—Monitoring or testing based on specific metrics, e.g. QoS, energy consumption or environmental parameters
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L43/00—Arrangements for monitoring or testing data switching networks
- H04L43/50—Testing arrangements
Landscapes
- Engineering & Computer Science (AREA)
- Computer Networks & Wireless Communication (AREA)
- Signal Processing (AREA)
- Environmental & Geological Engineering (AREA)
- Data Exchanges In Wide-Area Networks (AREA)
Abstract
The invention provides a method, a device and a system for testing the performance of a core network, wherein the method for testing the performance of the core network comprises the following steps: acquiring at least one message set to be tested; respectively carrying out test configuration on at least one message set to be tested to obtain a test configuration result; and performing core network performance test on the network element to be tested according to the at least one message set to be tested and the test configuration result to obtain a test result. The scheme includes that at least one message set to be tested is obtained; respectively carrying out test configuration on at least one message set to be tested to obtain a test configuration result; performing core network performance test on the network element to be tested according to the at least one message set to be tested and the test configuration result to obtain a test result; therefore, the directional test can be carried out aiming at specific messages and specific behaviors based on the message pressure loading method, and flexible test capability scheduling is realized; and the surrounding test is not performed by simulating peripheral network elements through a commercial instrument, so that the test cost is greatly reduced.
Description
Technical Field
The present invention relates to the field of communications technologies, and in particular, to a method, an apparatus, and a system for testing performance of a core network.
Background
At present, the core network performance test is based on a full-enclosure test scheme of the existing instrument manufacturer, as shown in fig. 1: based on a certain service model, a test is carried out based on user behaviors, peripheral equipment of a network element to be tested (such as an EPC (4G core network), an IP (Internet protocol) multimedia subsystem) IMS and the like) is simulated through a commercial instrument to carry out surrounding connection on the network element to be tested (such as the EPC, the IMS, a home subscriber server HSS, a routing agent node DRA and the like), and millions of users are simulated through special hardware and software of the commercial instrument to carry out pressure loading on the network element to be tested. In fig. 1, BSC denotes a base station controller, RNC denotes a radio network controller, eNB denotes an evolved base station, HLR denotes a home location register, HSS denotes a home subscriber server, MME denotes mobility entity management, SGSN denotes a serving GPRS support node, SGW denotes a serving gateway, GGSN denotes a gateway GPRS support node, and eMSC denotes an enhanced mobile switching center.
With the increasing network capacity and the advancement of virtualization process, the above test method has the following disadvantages:
1. the load of the traditional test method is all based on a telephone traffic model and the number of users, and the test case (such as ping-pong switching) of specific messages and specific behaviors (especially abnormal behaviors) is difficult to realize, and flexible test capability scheduling cannot be realized.
2. The processing capacity of the core network board card is continuously enhanced, the performance is greatly improved, the number of users involved in the performance test case and the flow are also greatly increased (if the number of users simultaneously processed by a single HSS reaches 3000 ten thousand, the number of users simultaneously processed by an IP short message gateway is more than 6000 ten thousand), and the flow loading cost of the existing test method for performing the enclosure test by simulating peripheral network elements through a commercial instrument is also greatly increased.
3. With the progress of the virtualization process of the core network, more and more core network elements are migrated from a hardware platform proprietary to an X86 universal platform in a software and hardware decoupling mode or a three-layer decoupling mode. Different service layers, virtual layers and hardware layers are paired in a flexible mode, and the traditional full-enclosure test cannot meet the requirement of a virtualized core network on performance test of each layer.
4. Research, development, operation, integration and flexible deployment are important characteristics of a virtualized core network, and performance testing is taken as a necessary link after system deployment. The traditional surrounding test method based on hardware cannot meet the requirement of 'deployment and test' of a virtualized core network.
Disclosure of Invention
The invention aims to provide a method, a device and a system for testing the performance of a core network, which solve the problems that the performance testing scheme of the core network in the prior art cannot realize flexible testing capability scheduling and the testing cost is continuously and greatly increased.
In order to solve the above technical problem, an embodiment of the present invention provides a method for testing performance of a core network, including:
acquiring at least one message set to be tested;
respectively carrying out test configuration on the at least one message set to be tested to obtain a test configuration result;
and performing core network performance test on the network element to be tested according to the at least one message set to be tested and the test configuration result to obtain a test result.
Optionally, the obtaining at least one message set to be tested includes:
and acquiring at least one message set to be tested according to the tested traffic demand and the networking topological structure.
Optionally, the obtaining at least one set of messages to be tested according to the tested traffic demand and the networking topology includes:
obtaining at least one load pressure number according to the tested traffic demand and the networking topological structure;
and acquiring at least one message set to be tested according to the at least one load pressure number.
Optionally, the performing test configuration on the at least one message set to be tested respectively to obtain a test configuration result includes:
and respectively configuring a network protocol IP address, a port number and/or a packet sending rate for the at least one message set to be tested to obtain a test configuration result.
Optionally, the performing, according to the at least one to-be-tested message set and the test configuration result, the core network performance test on the to-be-tested network element to obtain a test result includes:
performing core network performance test on the network element to be tested according to the at least one message set to be tested and the test configuration result;
and if the updating information of at least one message set to be tested is acquired in the testing process, continuing the performance test of the core network on the network element to be tested according to the updating information, the at least one message set to be tested and the test configuration result to obtain a test result.
Optionally, the test result includes:
the sending success quantity and/or the sending success ratio of the messages to be tested in each message set to be tested.
The embodiment of the invention also provides a core network performance test system, which comprises:
a message layer and a user layer in communication with the message layer;
the message layer is used for acquiring at least one message set to be tested; respectively carrying out test configuration on the at least one message set to be tested to obtain a test configuration result;
and the user layer is used for performing core network performance test on the network element to be tested according to the at least one message set to be tested and the test configuration result to obtain a test result.
Optionally, the message layer is specifically configured to:
and acquiring at least one message set to be tested according to the tested traffic demand and the networking topological structure.
Optionally, the message layer is specifically configured to:
obtaining at least one load pressure number according to the tested traffic demand and the networking topological structure;
and acquiring at least one message set to be tested according to the at least one load pressure number.
Optionally, the message layer is specifically configured to:
and respectively configuring a network protocol IP address, a port number and/or a packet sending rate for the at least one message set to be tested.
Optionally, the user layer is specifically configured to:
performing core network performance test on the network element to be tested according to the at least one message set to be tested and the test configuration result;
and if the update information of at least one message set to be tested is acquired in the test process, continuously performing core network performance test on the network element to be tested according to the update information, the at least one message set to be tested and the test configuration result to obtain a test result.
Optionally, the test result includes:
and the sending success quantity and/or the sending success ratio of the messages to be tested in each message set to be tested.
Optionally, the method further includes:
a virtual layer in communication with the message layer, and a physical layer in communication with the virtual layer;
the physical layer is used for providing test physical resources for a core network performance test system;
the virtual layer is used for virtualizing the calculated and stored network resources and centralizing the virtualized network resources in a shared resource pool;
the message layer acquires at least one message set to be tested by calling the virtual resources in the shared resource pool; and respectively carrying out test configuration on the at least one message set to be tested to obtain a test configuration result.
Optionally, the message layer is directly interfaced with a virtual network element in a Network Function Virtualization (NFV) framework.
An embodiment of the present invention further provides a core network, where the core network has a network function virtualization NFV framework, and the core network includes: the core network performance test system is described above.
The embodiment of the invention also provides a core network performance testing device, which comprises:
the first processing module is used for acquiring at least one message set to be tested;
the second processing module is used for respectively carrying out test configuration on the at least one message set to be tested to obtain a test configuration result;
and the third processing module is used for performing core network performance test on the network element to be tested according to the at least one message set to be tested and the test configuration result to obtain a test result.
Optionally, the first processing module includes:
and the first acquisition submodule is used for acquiring at least one message set to be tested according to the tested traffic demand and the networking topological structure.
Optionally, the first obtaining sub-module includes:
the first processing unit is used for obtaining at least one load pressure number according to the tested traffic demand and the networking topological structure;
and the first acquisition unit is used for acquiring at least one message set to be tested according to the at least one load pressure number.
Optionally, the second processing module includes:
and the first configuration submodule is used for respectively configuring the network protocol IP address, the port number and/or the packet sending rate for the at least one message set to be tested to obtain a test configuration result.
Optionally, the third processing module includes:
the first processing submodule is used for carrying out core network performance test on the network element to be tested according to the at least one message set to be tested and the test configuration result;
and the second processing submodule is used for continuously carrying out the core network performance test on the network element to be tested according to the update information, the at least one message set to be tested and the test configuration result to obtain a test result if the update information of the at least one message set to be tested is obtained in the test process.
Optionally, the test result includes:
and the sending success quantity and/or the sending success ratio of the messages to be tested in each message set to be tested.
The embodiment of the invention also provides a core network performance test system, which comprises a memory, a processor and a computer program which is stored on the memory and can run on the processor; and when the processor executes the program, the core network performance testing method is realized.
An embodiment of the present invention further provides a computer-readable storage medium, on which a computer program is stored, where the computer program, when executed by a processor, implements the steps in the core network performance testing method.
The technical scheme of the invention has the following beneficial effects:
in the above scheme, the core network performance testing method obtains at least one message set to be tested; respectively carrying out test configuration on the at least one message set to be tested to obtain a test configuration result; performing core network performance test on the network element to be tested according to the at least one message set to be tested and the test configuration result to obtain a test result; therefore, the directional test can be carried out aiming at specific messages and specific behaviors based on the message pressure loading method, and flexible test capability scheduling is realized; and the surrounding test is not performed by simulating peripheral network elements through a commercial instrument, so that the test cost is greatly reduced.
Drawings
Fig. 1 is a schematic diagram of a core network performance testing architecture in the prior art;
fig. 2 is a schematic flow chart of a core network performance testing method according to an embodiment of the present invention;
fig. 3 is a schematic structural diagram of a core network performance testing system according to an embodiment of the present invention;
fig. 4 is a schematic diagram of a specific application architecture of a core network performance testing system according to an embodiment of the present invention;
FIG. 5 is a schematic diagram of a business process flow according to an embodiment of the present invention;
fig. 6 is a schematic diagram illustrating direct interfacing between a message layer and a virtual network element in an NFV framework according to an embodiment of the present invention;
fig. 7 is a schematic diagram of a core network performance test flow according to an embodiment of the present invention;
FIG. 8 is a schematic diagram of a test network according to an embodiment of the present invention;
FIG. 9 is a message set and load pressure diagram of an embodiment of the present invention;
FIG. 10 is a message configuration diagram according to an embodiment of the present invention;
FIG. 11 is a schematic diagram of the start of test and dynamic pressurization of an embodiment of the present invention;
FIG. 12 is a test report diagram according to an embodiment of the present invention;
fig. 13 is a schematic structural diagram of a core network performance testing apparatus according to an embodiment of the present invention.
Detailed Description
In order to make the technical problems, technical solutions and advantages of the present invention more apparent, the following detailed description is given with reference to the accompanying drawings and specific embodiments.
The present invention provides a core network performance testing method, as shown in fig. 2, for solving the problems that the core network performance testing scheme in the prior art cannot realize flexible testing capability scheduling and the testing cost is continuously and greatly increased, and the method comprises the following steps:
step 21: acquiring at least one message set to be tested;
step 22: respectively carrying out test configuration on the at least one message set to be tested to obtain a test configuration result;
step 23: and performing core network performance test on the network element to be tested according to the at least one message set to be tested and the test configuration result to obtain a test result.
The core network performance test method provided by the embodiment of the invention obtains at least one message set to be tested; respectively carrying out test configuration on the at least one message set to be tested to obtain a test configuration result; performing core network performance test on the network element to be tested according to the at least one message set to be tested and the test configuration result to obtain a test result; therefore, the directional test can be carried out aiming at specific messages and specific behaviors based on the message pressure loading method, and flexible test capability scheduling is realized; and the surrounding test is not performed by simulating peripheral network elements through a commercial instrument, so that the test cost is greatly reduced.
Wherein, the acquiring at least one message set to be tested includes: and acquiring at least one message set to be tested according to the tested traffic demand and the networking topological structure.
Specifically, the obtaining at least one message set to be tested according to the tested traffic demand and the networking topology includes: obtaining at least one load pressure number according to the tested traffic demand and the networking topological structure; and acquiring at least one message set to be tested according to the at least one load pressure number.
A corresponding set of messages to be tested may be obtained according to a load pressure number, but not limited to this.
In this embodiment of the present invention, the performing test configuration on the at least one to-be-tested message set respectively to obtain test configuration results includes: and respectively configuring a network protocol IP address, a port number and/or a packet sending rate for the at least one message set to be tested to obtain a test configuration result.
Specifically, the performing, according to the at least one to-be-tested message set and the test configuration result, a core network performance test on the to-be-tested network element to obtain a test result includes: performing core network performance test on the network element to be tested according to the at least one message set to be tested and the test configuration result; and if the update information of at least one message set to be tested is acquired in the test process, continuously performing core network performance test on the network element to be tested according to the update information, the at least one message set to be tested and the test configuration result to obtain a test result.
This enables dynamic pressurization.
In an embodiment of the present invention, the test result may include: the sending success number and/or the sending success ratio of the messages to be tested in each message set to be tested are not limited to this.
An embodiment of the present invention further provides a core network performance testing system, as shown in fig. 3, including:
a message layer 31 and a user layer 32 in communication with the message layer 31;
the message layer 31 is configured to obtain at least one message set to be tested; respectively carrying out test configuration on the at least one message set to be tested to obtain a test configuration result;
and the user layer 32 is configured to perform a core network performance test on the network element to be tested according to the at least one message set to be tested and the test configuration result, so as to obtain a test result.
The core network performance test system provided by the embodiment of the invention obtains at least one message set to be tested; respectively carrying out test configuration on the at least one message set to be tested to obtain a test configuration result; performing core network performance test on the network element to be tested according to the at least one message set to be tested and the test configuration result to obtain a test result; therefore, the directional test can be carried out aiming at specific messages and specific behaviors based on the message pressure loading method, and flexible test capability scheduling is realized; and the surrounding test is not performed by simulating peripheral network elements through a commercial instrument, so that the test cost is greatly reduced.
Wherein the message layer is specifically configured to: and acquiring at least one message set to be tested according to the tested traffic demand and the networking topological structure.
Specifically, the message layer is specifically configured to: obtaining at least one load pressure number according to the tested traffic demand and the networking topological structure; and acquiring at least one message set to be tested according to the at least one load pressure number.
In the embodiment of the present invention, the message layer is specifically configured to: and respectively configuring a network protocol IP address, a port number and/or a packet sending rate for the at least one message set to be tested.
Specifically, the user layer is specifically configured to: performing core network performance test on the network element to be tested according to the at least one message set to be tested and the test configuration result; and if the updating information of at least one message set to be tested is acquired in the testing process, continuing the performance test of the core network on the network element to be tested according to the updating information, the at least one message set to be tested and the test configuration result to obtain a test result.
In an embodiment of the present invention, the test result may include: the sending success number and/or the sending success ratio of the messages to be tested in each message set to be tested are not limited to this.
Further, the core network performance testing system further includes: a virtual layer in communication with the message layer, and a physical layer in communication with the virtual layer; the physical layer is used for providing test physical resources for a core network performance test system; the virtual layer is used for virtualizing the calculated and stored network resources and centralizing the virtualized network resources in a shared resource pool; the message layer acquires at least one message set to be tested by calling the virtual resources in the shared resource pool; and respectively carrying out test configuration on the at least one message set to be tested to obtain a test configuration result.
The message layer can be directly butted with a virtual network element in a Network Function Virtualization (NFV) framework to realize the test of the virtual network element.
The implementation embodiments of the core network performance testing method are all suitable for the embodiment of the core network performance testing system, and the same technical effect can be achieved.
The core network performance testing system provided in the embodiment of the present invention is further illustrated below.
To solve the above technical problem, an embodiment of the present invention provides a core network performance testing system, and specifically, a corresponding core network testing system architecture based on a message may be as shown in fig. 4, where the system is divided into four layers, namely a physical layer, a virtual layer, a message layer, and a user layer.
Wherein, the physical layer: the physical layer mainly provides test physical resources for the whole test system, and the computing power and the storage capacity of the general x86 server are the basis of the virtual layer (the physical layer uses the general x86 server).
Virtual layer: and computing, storing and virtualizing network resources through the hypervisor. All the virtual resources are centralized in a uniform shared resource pool, so that the scheduling is convenient.
And a message layer: the message layer is a main control logic layer of the message-based virtualized core network test scheme provided by the scheme. The message layer is divided into three modules of a test engine, message group control and resource scheduling.
1. A test engine: the test engine mainly provides management and scheduling functions of virtual users for testing and is divided into two parts, namely load control and scheduling control. The load control mainly controls the number of virtual users, the loading speed and the like according to the test requirements. The scheduling control mainly controls the operation state of the message unit, such as running, pausing, stopping, etc. The test engine is loosely coupled with the message group, independent of the type of the processed message, and has universality.
2. Message group control: a message group is a collection of all messages, each of which has independence, used to simulate the complete business process of a test. The message group can simulate the service flow and interface protocol of all network elements around the tested network element to realize the full-enclosure test. The message group control comprises two parts of a message unit and a message configuration.
The message unit can be a pair of sending and receiving messages or a combination of several pairs of sending and receiving messages customized by a user according to the test requirement, and usually one message unit is a subset of a certain business processing flow. Taking a new registration flow of the HSS network element VoLTE as an example, the definition of the message unit is described, the overall service flow is shown in fig. 5, and the normal service flow is composed of four pairs of messages: UAR (User-authorization-Request)/UAA (User-authorization-Answer, user authentication response), MAR (Multimedia-authorization-Request)/MAA (Multimedia-authorization-response, multimedia authentication response), UAR/UAA, SAR (Server-Assignment-Request, server Assignment Request)/SAA (Server-Assignment-Answer, server Assignment response). Existing commercial meters follow this procedure as well. In the scheme, messages in the service flow are divided into a plurality of message groups for management, for example, in the flow of fig. 5, four pairs of messages are respectively used as four message units to respectively control the loads of the four message units. When one pair of messages is abnormal, the receiving and sending of other messages are not influenced, and the exception handling is convenient. When the complete business process contains more message pairs, a user can select more message pairs as a message unit, and the resolution of the message is controllable.
The message configuration comprises a static configuration part and a dynamic library part, wherein the static configuration part does not need to be modified in the test process, such as an IP address, a port number and the like. The dynamic library mainly realizes the docking function of the message unit and the test engine, and comprises the steps of acquiring sending content, packaging a request, sending the request, receiving a response, processing the response and the like. The test engine can realize the loading and scheduling of the message through the dynamic library.
3. Resource regulation and control: the resource regulation and control are mainly used for monitoring the use condition of resources and realizing the scheduling of the resources.
And (3) a user layer: the user layer mainly provides a test operation interface for a user, and the user can make test cases, control the process, monitor the test process, generate test reports and the like.
The core network testing architecture based on the message provided by the scheme has higher consistency with the core network architecture of the NFV, and the message layer of the testing system can be directly butted with the virtual network element in the NFV (as shown in figure 6) to realize the test of the virtual network element; the testing tool (the system) can be directly integrated into a core network with an NFV framework, and the testing tool is directly called by the MANO to realize 'deployment, namely testing' (the Mano is not part of the system, but part of the NFV framework and realizes the arranging and scheduling functions of network elements.
In fig. 6, EMS denotes a network element management system, VNF denotes a virtual network function, OSS denotes an operation support system, and BSS denotes a service support system.
Specifically, the test flow of the system may be as shown in fig. 7, and includes:
step 71: and calculating the load pressure number of each message unit according to the tested traffic demand and the topological structure of the networking. The test networking map may be as shown in fig. 8, and the message group and the load pressure may be as shown in fig. 9.
In fig. 8, MSC Server denotes a mobile switching center Server, HLR denotes a home location register, HSS denotes a home subscriber Server, MME denotes mobility entity management, SGSN denotes a serving GPRS support node, BOSS denotes a service operation support system, TAS denotes a communication application Server, I-CSCF denotes an interrogating call session control function, and S-CSCF denotes a serving call session control function.
CAPS in FIG. 9 represents the number of calls established per second.
Step 72: the message group is configured, including parameters such as IP, port number, and packet sending rate, as shown in fig. 10.
In fig. 10, DNS indicates a domain name system, IP indicates a network protocol, value indicates a Value, and virip indicates a variable name-virtual IP that is customized by a test result.
Step 73: and carrying out load setting on each message unit through the test engine.
Step 74: the test is started and the test index is monitored in real time, as shown in fig. 11 (start of test, and dynamic pressurization are also possible).
Specifically, the user layer schedules the message layer, the virtual layer, and the physical layer to cooperatively execute the test.
In fig. 11, EPC indicates core packet network evolution, and VOBB indicates broadband voice.
Step 75: the test is finished, a report is obtained (as shown in fig. 12), and the problem is analyzed (core network performance analysis).
Specifically, the user layer schedules the message layer, the virtual layer, and the physical layer to perform cooperatively.
Fig. 12 includes a parameter Testing Capability, a Test Start Time, a Test End Time, and a Test Duration Time, in fig. 12; wherein, IP-TRAFFIC-DNS represents network protocol-flow-domain name system.
It can be seen from the above that, the embodiment of the present invention provides a core network test load loading method based on messages, which abandons the traditional test scheme based on a service model and user behavior, disassembles the service model required for testing into an independent message unit based on an interface, and then combines and controls the messages to perform testing. The test system can be deployed on a general X86 platform, so that the limitation of a traditional instrument on software and hardware is eliminated, and the test requirement of a virtualization core network is met.
Wherein, this system: 1) A four-layer structure which is the same as the NFV structure is arranged, so that a message layer of a test system can be directly butted with a virtual network element in the NFV, and the virtual network element is tested; 2) And carrying out load pressure accounting on a message layer, and simulating the service flow and interface protocol of all network elements around the tested network element by using the message group, thereby realizing the full-enclosure test.
In summary, the framework related to the performance test of the network element of the core network and the load compression method based on the message unit provided by the embodiment of the present invention can realize flexible test capability scheduling, and the load compression capability is greatly increased; the deployment mode based on the general X86 server can also meet the requirement of 'deployment, namely testing' of the network elements of the virtualized core network, thereby truly realizing the aim of virtualization of the testing capability.
An embodiment of the present invention further provides a core network, where the core network has a network function virtualization NFV framework, and the core network includes: the core network performance test system is described above.
The implementation embodiments of the core network performance testing system are all applicable to the embodiment of the core network, and the same technical effect can be achieved.
An embodiment of the present invention further provides a core network performance testing apparatus, as shown in fig. 13, including:
a first processing module 131, configured to obtain at least one message set to be tested;
the second processing module 132 is configured to perform test configuration on the at least one to-be-tested message set, respectively, to obtain a test configuration result;
the third processing module 133 is configured to perform a core network performance test on the network element to be tested according to the at least one message set to be tested and the test configuration result, so as to obtain a test result.
The core network performance testing device provided by the embodiment of the invention obtains at least one message set to be tested; respectively carrying out test configuration on the at least one message set to be tested to obtain a test configuration result; performing core network performance test on the network element to be tested according to the at least one message set to be tested and the test configuration result to obtain a test result; therefore, the directional test can be carried out aiming at specific messages and specific behaviors based on the message pressure loading method, and flexible test capability scheduling is realized; and the surrounding test is not performed by simulating peripheral network elements through a commercial instrument, so that the test cost is greatly reduced.
Wherein the first processing module comprises: and the first acquisition submodule is used for acquiring at least one message set to be tested according to the tested traffic demand and the networking topological structure.
Specifically, the first obtaining sub-module includes: the first processing unit is used for obtaining at least one load pressure number according to the tested traffic demand and the networking topological structure; and the first acquisition unit is used for acquiring at least one message set to be tested according to the at least one load pressure number.
In an embodiment of the present invention, the second processing module includes: and the first configuration submodule is used for respectively configuring the network protocol IP address, the port number and/or the packet sending rate for the at least one message set to be tested to obtain a test configuration result.
Specifically, the third processing module includes: the first processing sub-module is used for carrying out core network performance test on the network element to be tested according to the at least one message set to be tested and the test configuration result; and the second processing submodule is used for continuously carrying out the core network performance test on the network element to be tested according to the update information, the at least one message set to be tested and the test configuration result to obtain a test result if the update information of the at least one message set to be tested is obtained in the test process.
In an embodiment of the present invention, the test result may include: the sending success quantity and/or the sending success ratio of the messages to be tested in each message set to be tested.
The implementation embodiments of the core network performance testing method are all suitable for the embodiment of the core network performance testing device, and the same technical effect can be achieved.
The embodiment of the invention also provides a core network performance test system, which comprises a memory, a processor and a computer program which is stored on the memory and can run on the processor; and when the processor executes the program, the core network performance testing method is realized.
The implementation embodiments of the core network performance testing method are all suitable for the embodiment of the core network performance testing system, and can achieve the same technical effect.
An embodiment of the present invention further provides a computer-readable storage medium, on which a computer program is stored, where the computer program, when executed by a processor, implements the steps in the core network performance testing method.
The implementation embodiments of the core network performance testing method are all applicable to the embodiment of the computer-readable storage medium, and the same technical effect can be achieved.
It should be noted that many of the functional components described in this specification are referred to as modules/sub-modules/units in order to more particularly emphasize their implementation independence.
In embodiments of the present invention, the modules/sub-modules/units may be implemented in software for execution by various types of processors. An identified module of executable code may, for instance, comprise one or more physical or logical blocks of computer instructions which may, for instance, be constructed as an object, procedure, or function. Nevertheless, the executables of an identified module need not be physically located together, but may comprise disparate instructions stored in different bits which, when joined logically together, comprise the module and achieve the stated purpose for the module.
Indeed, a module of executable code may be a single instruction, or many instructions, and may even be distributed over several different code segments, among different programs, and across several memory devices. Likewise, operational data may be identified within the modules and may be embodied in any suitable form and organized within any suitable type of data structure. The operational data may be collected as a single data set, or may be distributed over different locations including over different storage devices, and may exist, at least partially, merely as electronic signals on a system or network.
When a module can be implemented by software, considering the level of hardware technology, a module implemented in software may build a corresponding hardware circuit to implement corresponding functions, without considering the cost, and the hardware circuit may include a conventional Very Large Scale Integration (VLSI) circuit or a gate array and an existing semiconductor such as a logic chip, a transistor, or other discrete components. A module may also be implemented in programmable hardware devices such as field programmable gate arrays, programmable array logic, programmable logic devices or the like.
While the preferred embodiments of the present invention have been described, it will be understood by those skilled in the art that various changes and modifications may be made without departing from the spirit and scope of the invention.
Claims (23)
1. A method for testing performance of a core network is characterized by comprising the following steps:
acquiring at least one message set to be tested, wherein each message set to be tested in the at least one message set to be tested is a subset of a business processing flow, and the subset of the business processing flow is obtained by splitting messages in the business processing flow;
respectively carrying out test configuration on the at least one message set to be tested to obtain a test configuration result;
and performing core network performance test on the network element to be tested according to the at least one message set to be tested and the test configuration result to obtain a test result.
2. The method according to claim 1, wherein the obtaining at least one set of messages to be tested comprises:
and acquiring at least one message set to be tested according to the tested traffic demand and the networking topological structure.
3. The method for testing the performance of the core network according to claim 2, wherein the obtaining of at least one message set to be tested according to the tested traffic demand and the networking topology comprises:
obtaining at least one load pressure number according to the tested traffic demand and the networking topological structure;
and acquiring at least one message set to be tested according to the at least one load pressure number.
4. The method according to claim 1, wherein the performing test configuration on the at least one message set to be tested respectively to obtain a test configuration result comprises:
and respectively configuring a network protocol IP address, a port number and/or a packet sending rate for the at least one message set to be tested to obtain a test configuration result.
5. The method according to claim 1, wherein the performing, according to the at least one message set to be tested and the test configuration result, a core network performance test on a network element to be tested to obtain a test result comprises:
performing core network performance test on the network element to be tested according to the at least one message set to be tested and the test configuration result;
and if the update information of at least one message set to be tested is acquired in the test process, continuously performing core network performance test on the network element to be tested according to the update information, the at least one message set to be tested and the test configuration result to obtain a test result.
6. The core network performance testing method of claim 1, wherein the test result comprises:
and the sending success quantity and/or the sending success ratio of the messages to be tested in each message set to be tested.
7. A core network performance testing system, comprising:
a message layer and a user layer in communication with the message layer;
the message layer is used for acquiring at least one message set to be tested; respectively carrying out test configuration on the at least one message set to be tested to obtain a test configuration result, wherein each message set to be tested in the at least one message set to be tested is a subset of a business processing flow, and the subset of the business processing flow is obtained by splitting messages in the business processing flow;
and the user layer is used for performing core network performance test on the network element to be tested according to the at least one message set to be tested and the test configuration result to obtain a test result.
8. The core network performance testing system of claim 7, wherein the message layer is specifically configured to:
and acquiring at least one message set to be tested according to the tested traffic demand and the networking topological structure.
9. The core network performance testing system of claim 8, wherein the message layer is specifically configured to:
obtaining at least one load pressure number according to the tested traffic demand and the networking topological structure;
and acquiring at least one message set to be tested according to the at least one load pressure number.
10. The core network performance testing system of claim 7, wherein the message layer is specifically configured to:
and respectively configuring a network protocol IP address, a port number and/or a packet sending rate for the at least one message set to be tested.
11. The core network performance testing system of claim 7, wherein the user layer is specifically configured to:
performing core network performance test on the network element to be tested according to the at least one message set to be tested and the test configuration result;
and if the updating information of at least one message set to be tested is acquired in the testing process, continuing the performance test of the core network on the network element to be tested according to the updating information, the at least one message set to be tested and the test configuration result to obtain a test result.
12. The core network performance testing system of claim 7, wherein the test results comprise:
the sending success quantity and/or the sending success ratio of the messages to be tested in each message set to be tested.
13. The core network performance testing system of any of claims 7-12, further comprising:
a virtual layer in communication with the message layer, and a physical layer in communication with the virtual layer;
the physical layer is used for providing test physical resources for a core network performance test system;
the virtual layer is used for virtualizing the calculated and stored network resources and centralizing the virtualized network resources in a shared resource pool;
the message layer acquires at least one message set to be tested by calling virtual resources in the shared resource pool; and respectively carrying out test configuration on the at least one message set to be tested to obtain a test configuration result.
14. The core network performance testing system of claim 13, wherein the message layer interfaces directly with virtual network elements in a network functions virtualization, NFV, framework.
15. A core network having a network function virtualization, NFV, framework, comprising: a core network performance test system as claimed in any one of claims 7 to 14.
16. A core network performance testing apparatus, comprising:
the system comprises a first processing module, a second processing module and a third processing module, wherein the first processing module is used for acquiring at least one message set to be tested, each message set to be tested in the at least one message set to be tested is a subset of a business processing flow, and the subset of the business processing flow is obtained by splitting messages in the business processing flow;
the second processing module is used for respectively carrying out test configuration on the at least one message set to be tested to obtain a test configuration result;
and the third processing module is used for performing core network performance test on the network element to be tested according to the at least one message set to be tested and the test configuration result to obtain a test result.
17. The core network performance testing apparatus of claim 16, wherein the first processing module comprises:
and the first acquisition submodule is used for acquiring at least one message set to be tested according to the tested traffic demand and the networking topological structure.
18. The core network performance testing apparatus of claim 17, wherein the first obtaining sub-module comprises:
the first processing unit is used for obtaining at least one load pressure number according to the tested traffic demand and the networking topological structure;
and the first acquisition unit is used for acquiring at least one message set to be tested according to the at least one load pressure number.
19. The core network performance testing apparatus of claim 16, wherein the second processing module comprises:
and the first configuration submodule is used for respectively configuring a network protocol IP address, a port number and/or a packet sending rate for the at least one message set to be tested to obtain a test configuration result.
20. The core network performance testing apparatus of claim 16, wherein the third processing module comprises:
the first processing submodule is used for carrying out core network performance test on the network element to be tested according to the at least one message set to be tested and the test configuration result;
and the second processing submodule is used for continuously carrying out the core network performance test on the network element to be tested according to the update information, the at least one message set to be tested and the test configuration result to obtain a test result if the update information of the at least one message set to be tested is obtained in the test process.
21. The core network performance testing apparatus of claim 16, wherein the test result comprises:
and the sending success quantity and/or the sending success ratio of the messages to be tested in each message set to be tested.
22. A core network performance testing system comprising a memory, a processor and a computer program stored on the memory and executable on the processor; a core network performance testing method according to any one of claims 1 to 6, when the processor executes the program.
23. A computer-readable storage medium, on which a computer program is stored, which, when being executed by a processor, carries out the steps in the core network performance testing method according to any one of claims 1 to 6.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910000937.1A CN111404763B (en) | 2019-01-02 | 2019-01-02 | Core network performance test method, device and system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910000937.1A CN111404763B (en) | 2019-01-02 | 2019-01-02 | Core network performance test method, device and system |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN111404763A CN111404763A (en) | 2020-07-10 |
| CN111404763B true CN111404763B (en) | 2022-11-08 |
Family
ID=71432003
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201910000937.1A Active CN111404763B (en) | 2019-01-02 | 2019-01-02 | Core network performance test method, device and system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN111404763B (en) |
Families Citing this family (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113365300A (en) * | 2021-07-28 | 2021-09-07 | 北京恒安嘉新安全技术有限公司 | Simulation system of mobile network and service test method of mobile network |
| CN116170828A (en) * | 2023-04-18 | 2023-05-26 | 北京博上网络科技有限公司 | 5G core network testing method and system |
Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102740342A (en) * | 2012-06-08 | 2012-10-17 | 大唐移动通信设备有限公司 | Network management equipment performance simulation test method and system |
| CN106789432A (en) * | 2016-12-28 | 2017-05-31 | 中软信息系统工程有限公司 | Test system based on autonomous controllable cloud platform technology |
Family Cites Families (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102821211B (en) * | 2011-06-10 | 2017-04-19 | 中兴通讯股份有限公司 | Automatic testing method and device for communication network elements |
| RU2643451C2 (en) * | 2013-08-27 | 2018-02-01 | Хуавей Текнолоджиз Ко., Лтд. | System and method for virtualisation of mobile network function |
| CN104135735A (en) * | 2014-08-25 | 2014-11-05 | 宁波普天通信技术有限公司 | Automatic testing method, device and system for LTE core network |
| CN104601412B (en) * | 2015-02-12 | 2018-01-26 | 中国工商银行股份有限公司 | A kind of independent test network system and its method for building up |
| CN104852912B (en) * | 2015-04-29 | 2018-07-06 | 中国互联网络信息中心 | Domain name registration service device Performance Test System and method |
| CN107749807B (en) * | 2017-10-31 | 2020-07-28 | 江苏省未来网络创新研究院 | Network function verification method and verification system for NFV |
| CN108011846B (en) * | 2017-11-03 | 2022-07-26 | 华为技术有限公司 | Method and device for managing service in network function virtualization architecture |
-
2019
- 2019-01-02 CN CN201910000937.1A patent/CN111404763B/en active Active
Patent Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102740342A (en) * | 2012-06-08 | 2012-10-17 | 大唐移动通信设备有限公司 | Network management equipment performance simulation test method and system |
| CN106789432A (en) * | 2016-12-28 | 2017-05-31 | 中软信息系统工程有限公司 | Test system based on autonomous controllable cloud platform technology |
Also Published As
| Publication number | Publication date |
|---|---|
| CN111404763A (en) | 2020-07-10 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN104579822B (en) | Mobile application automated performance testing system and method based on Http agreements | |
| US9841988B1 (en) | Updating service virtual machines using a new image that is certified | |
| US11032126B2 (en) | Diagnostic traffic generation for automatic testing and troubleshooting | |
| US8996920B2 (en) | Finite state machine method for test case generation and execution of communication protocols | |
| EP3335374B1 (en) | Automatic symptom data collection in cloud deployment | |
| US10846128B2 (en) | Managing the graceful termination of a virtualized network function instance | |
| CN111404763B (en) | Core network performance test method, device and system | |
| CN102355688A (en) | Equipment testing system and method | |
| EP3520444A1 (en) | Enhancement of traffic detection and routing in virtualized environment | |
| CN104125281A (en) | Method and device for recording examination and approval state of resource application in cloud data centre | |
| CN107992386A (en) | A kind of router memory method for testing pressure and system | |
| CN106936658A (en) | The method of testing and test platform of test case, simulation test equipment | |
| CN105245379A (en) | Method and device for testing network management system through simulating SNMP (simple network management protocol) network element | |
| CN101207525B (en) | System and apparatus for testing wireless network controller signaling processing module | |
| Larrea et al. | Corekube: An efficient, autoscaling and resilient mobile core system | |
| CN112506768B (en) | Test method, test device, electronic equipment and storage medium | |
| CN101969442A (en) | Process running environment perception and migration based network analog framework implementation method | |
| CN114745749A (en) | Virtual network element testing method and device, electronic equipment and readable storage medium | |
| CN112311572B (en) | Network element testing method and device and electronic equipment | |
| CN111221687B (en) | Cloud storage testing system and method | |
| CN113452575A (en) | Service test method, system, device and storage medium | |
| CN112929914A (en) | System and method for network link simulation auxiliary test | |
| US20240147268A1 (en) | "real feel" autonomous network test solution system, method, device, and program | |
| CN110895507B (en) | Simulation test method and device, simulation server and storage medium | |
| CN111078534B (en) | Test scheduling method and related equipment |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |