CN111404763A - Core network performance test method, device and system - Google Patents
Core network performance test method, device and system Download PDFInfo
- Publication number
- CN111404763A CN111404763A CN201910000937.1A CN201910000937A CN111404763A CN 111404763 A CN111404763 A CN 111404763A CN 201910000937 A CN201910000937 A CN 201910000937A CN 111404763 A CN111404763 A CN 111404763A
- Authority
- CN
- China
- Prior art keywords
- tested
- test
- core network
- message set
- message
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L43/00—Arrangements for monitoring or testing data switching networks
- H04L43/08—Monitoring or testing based on specific metrics, e.g. QoS, energy consumption or environmental parameters
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L43/00—Arrangements for monitoring or testing data switching networks
- H04L43/50—Testing arrangements
Landscapes
- Engineering & Computer Science (AREA)
- Computer Networks & Wireless Communication (AREA)
- Signal Processing (AREA)
- Environmental & Geological Engineering (AREA)
- Data Exchanges In Wide-Area Networks (AREA)
Abstract
The invention provides a method, a device and a system for testing the performance of a core network, wherein the method for testing the performance of the core network comprises the following steps: acquiring at least one message set to be tested; respectively carrying out test configuration on at least one message set to be tested to obtain a test configuration result; and performing core network performance test on the network element to be tested according to the at least one message set to be tested and the test configuration result to obtain a test result. The scheme is that at least one message set to be tested is obtained; respectively carrying out test configuration on at least one message set to be tested to obtain a test configuration result; performing core network performance test on the network element to be tested according to the at least one message set to be tested and the test configuration result to obtain a test result; therefore, the directional test can be carried out aiming at specific messages and specific behaviors based on the message pressure loading method, and flexible test capability scheduling is realized; and the surrounding test is not performed by simulating peripheral network elements through a commercial instrument, so that the test cost is greatly reduced.
Description
Technical Field
The present invention relates to the field of communications technologies, and in particular, to a method, an apparatus, and a system for testing performance of a core network.
Background
At present, a core network performance test is based on a full-enclosure test scheme of an existing instrument manufacturer, as shown in fig. 1, based on a certain service model, a test is performed based on user behavior, peripheral devices of a network element to be tested (such as a 4G core network EPC, an IP multimedia subsystem IMS, and the like) are simulated through a commercial instrument to perform enclosure connection on the network element to be tested (such as an EPC, an IMS, a home subscriber server HSS, a routing agent node DRA, and the like), and millions of users are simulated through proprietary hardware and software of the commercial instrument to perform pressure loading on the network element to be tested.
With the increasing network capacity and the advancement of virtualization process, the above test method has the following disadvantages:
1. the load of the traditional test method is all based on a telephone traffic model and the number of users, and the test case (such as ping-pong switching) of specific messages and specific behaviors (especially abnormal behaviors) is difficult to realize, and flexible test capability scheduling cannot be realized.
2. The processing capacity of the core network board card is continuously enhanced, the performance is greatly improved, the number of users involved in the performance test case and the flow are also greatly increased (for example, the number of users simultaneously processed by a single HSS reaches 3000 ten thousand, and the number of users simultaneously processed by an IP short message gateway is more than 6000 ten thousand), and the flow loading cost of the existing test method for performing the enclosure test by simulating peripheral network elements through a commercial instrument is also greatly increased.
3. With the progress of the virtualization process of the core network, more and more core network elements are migrated from a hardware platform proprietary to a device manufacturer to an X86 universal platform in a software and hardware decoupling mode or a three-layer decoupling mode. Different service layers, virtual layers and hardware layers are paired in a flexible mode, and the traditional full-enclosure test cannot meet the requirement of a virtualized core network on performance test of each layer.
4. Research, development, operation, integration and flexible deployment are important characteristics of a virtualized core network, and performance testing is taken as a necessary link after system deployment. The traditional surrounding test method based on hardware cannot meet the requirement of 'deployment and test' of a virtualized core network.
Disclosure of Invention
The invention aims to provide a method, a device and a system for testing the performance of a core network, which solve the problems that the performance testing scheme of the core network in the prior art cannot realize flexible testing capability scheduling and the testing cost is continuously and greatly increased.
In order to solve the above technical problem, an embodiment of the present invention provides a method for testing performance of a core network, including:
acquiring at least one message set to be tested;
respectively carrying out test configuration on the at least one message set to be tested to obtain a test configuration result;
and performing core network performance test on the network element to be tested according to the at least one message set to be tested and the test configuration result to obtain a test result.
Optionally, the obtaining at least one set of messages to be tested includes:
and acquiring at least one message set to be tested according to the tested traffic demand and the networking topological structure.
Optionally, the obtaining at least one set of messages to be tested according to the tested traffic demand and the networking topology includes:
obtaining at least one load pressure number according to the tested traffic demand and the networking topological structure;
and acquiring at least one message set to be tested according to the at least one load pressure number.
Optionally, the performing test configuration on the at least one to-be-tested message set respectively to obtain a test configuration result includes:
and respectively configuring a network protocol IP address, a port number and/or a packet sending rate for the at least one message set to be tested to obtain a test configuration result.
Optionally, the performing, according to the at least one to-be-tested message set and the test configuration result, a core network performance test on the to-be-tested network element to obtain a test result includes:
performing core network performance test on the network element to be tested according to the at least one message set to be tested and the test configuration result;
and if the updating information of at least one message set to be tested is acquired in the testing process, continuing the performance test of the core network on the network element to be tested according to the updating information, the at least one message set to be tested and the test configuration result to obtain a test result.
Optionally, the test result includes:
the sending success quantity and/or the sending success ratio of the messages to be tested in each message set to be tested.
The embodiment of the invention also provides a core network performance test system, which comprises:
a message layer and a user layer in communication with the message layer;
the message layer is used for acquiring at least one message set to be tested; respectively carrying out test configuration on the at least one message set to be tested to obtain a test configuration result;
and the user layer is used for performing core network performance test on the network element to be tested according to the at least one message set to be tested and the test configuration result to obtain a test result.
Optionally, the message layer is specifically configured to:
and acquiring at least one message set to be tested according to the tested traffic demand and the networking topological structure.
Optionally, the message layer is specifically configured to:
obtaining at least one load pressure number according to the tested traffic demand and the networking topological structure;
and acquiring at least one message set to be tested according to the at least one load pressure number.
Optionally, the message layer is specifically configured to:
and respectively configuring a network protocol IP address, a port number and/or a packet sending rate for the at least one message set to be tested.
Optionally, the user layer is specifically configured to:
performing core network performance test on the network element to be tested according to the at least one message set to be tested and the test configuration result;
and if the updating information of at least one message set to be tested is acquired in the testing process, continuing the performance test of the core network on the network element to be tested according to the updating information, the at least one message set to be tested and the test configuration result to obtain a test result.
Optionally, the test result includes:
the sending success quantity and/or the sending success ratio of the messages to be tested in each message set to be tested.
Optionally, the method further includes:
a virtual layer in communication with the message layer, and a physical layer in communication with the virtual layer;
the physical layer is used for providing test physical resources for a core network performance test system;
the virtual layer is used for virtualizing the calculated and stored network resources and centralizing the virtualized network resources in a shared resource pool;
the message layer acquires at least one message set to be tested by calling the virtual resources in the shared resource pool; and respectively carrying out test configuration on the at least one message set to be tested to obtain a test configuration result.
Optionally, the message layer is directly interfaced with a virtual network element in a Network Function Virtualization (NFV) framework.
An embodiment of the present invention further provides a core network, where the core network has a network function virtualization NFV framework, and the core network includes: the core network performance test system is described above.
The embodiment of the invention also provides a core network performance testing device, which comprises:
the first processing module is used for acquiring at least one message set to be tested;
the second processing module is used for respectively carrying out test configuration on the at least one message set to be tested to obtain a test configuration result;
and the third processing module is used for performing core network performance test on the network element to be tested according to the at least one message set to be tested and the test configuration result to obtain a test result.
Optionally, the first processing module includes:
and the first acquisition submodule is used for acquiring at least one message set to be tested according to the tested traffic demand and the networking topological structure.
Optionally, the first obtaining sub-module includes:
the first processing unit is used for obtaining at least one load pressure number according to the tested traffic demand and the networking topological structure;
and the first acquisition unit is used for acquiring at least one message set to be tested according to the at least one load pressure number.
Optionally, the second processing module includes:
and the first configuration submodule is used for respectively configuring the network protocol IP address, the port number and/or the packet sending rate for the at least one message set to be tested to obtain a test configuration result.
Optionally, the third processing module includes:
the first processing submodule is used for carrying out core network performance test on the network element to be tested according to the at least one message set to be tested and the test configuration result;
and the second processing submodule is used for continuously carrying out the core network performance test on the network element to be tested according to the update information, the at least one message set to be tested and the test configuration result to obtain a test result if the update information of the at least one message set to be tested is obtained in the test process.
Optionally, the test result includes:
the sending success quantity and/or the sending success ratio of the messages to be tested in each message set to be tested.
The embodiment of the invention also provides a core network performance test system, which comprises a memory, a processor and a computer program which is stored on the memory and can run on the processor; and when the processor executes the program, the core network performance testing method is realized.
An embodiment of the present invention further provides a computer-readable storage medium, on which a computer program is stored, where the computer program, when executed by a processor, implements the steps in the core network performance testing method.
The technical scheme of the invention has the following beneficial effects:
in the above scheme, the core network performance testing method obtains at least one message set to be tested; respectively carrying out test configuration on the at least one message set to be tested to obtain a test configuration result; performing core network performance test on the network element to be tested according to the at least one message set to be tested and the test configuration result to obtain a test result; therefore, the directional test can be carried out aiming at specific messages and specific behaviors based on the message pressure loading method, and flexible test capability scheduling is realized; and the surrounding test is not performed by simulating peripheral network elements through a commercial instrument, so that the test cost is greatly reduced.
Drawings
Fig. 1 is a schematic diagram of a core network performance testing architecture in the prior art;
fig. 2 is a schematic flow chart of a core network performance testing method according to an embodiment of the present invention;
fig. 3 is a schematic structural diagram of a core network performance testing system according to an embodiment of the present invention;
fig. 4 is a schematic diagram of a specific application architecture of a core network performance testing system according to an embodiment of the present invention;
FIG. 5 is a schematic diagram of a business process flow according to an embodiment of the present invention;
fig. 6 is a schematic diagram illustrating direct interfacing between a message layer and a virtual network element in an NFV framework according to an embodiment of the present invention;
fig. 7 is a schematic diagram of a core network performance test flow according to an embodiment of the present invention;
FIG. 8 is a schematic diagram of a test network according to an embodiment of the present invention;
FIG. 9 is a diagram illustrating message groups and load pressure according to an embodiment of the present invention;
FIG. 10 is a message configuration diagram according to an embodiment of the present invention;
FIG. 11 is a schematic diagram of the start-up test and dynamic pressurization of an embodiment of the present invention;
FIG. 12 is a test report diagram according to an embodiment of the present invention;
fig. 13 is a schematic structural diagram of a core network performance testing apparatus according to an embodiment of the present invention.
Detailed Description
In order to make the technical problems, technical solutions and advantages of the present invention more apparent, the following detailed description is given with reference to the accompanying drawings and specific embodiments.
The present invention provides a core network performance testing method, as shown in fig. 2, for solving the problems that the core network performance testing scheme in the prior art cannot realize flexible testing capability scheduling and the testing cost is continuously and greatly increased, and the method comprises the following steps:
step 21: acquiring at least one message set to be tested;
step 22: respectively carrying out test configuration on the at least one message set to be tested to obtain a test configuration result;
step 23: and performing core network performance test on the network element to be tested according to the at least one message set to be tested and the test configuration result to obtain a test result.
The core network performance test method provided by the embodiment of the invention obtains at least one message set to be tested; respectively carrying out test configuration on the at least one message set to be tested to obtain a test configuration result; performing core network performance test on the network element to be tested according to the at least one message set to be tested and the test configuration result to obtain a test result; therefore, the directional test can be carried out aiming at specific messages and specific behaviors based on the message pressure loading method, and flexible test capability scheduling is realized; and the surrounding test is not performed by simulating peripheral network elements through a commercial instrument, so that the test cost is greatly reduced.
Wherein, the acquiring at least one message set to be tested includes: and acquiring at least one message set to be tested according to the tested traffic demand and the networking topological structure.
Specifically, the obtaining at least one message set to be tested according to the tested traffic demand and the networking topology includes: obtaining at least one load pressure number according to the tested traffic demand and the networking topological structure; and acquiring at least one message set to be tested according to the at least one load pressure number.
It is possible, but not limited to, to obtain a corresponding set of messages to be measured according to a load pressure number.
In this embodiment of the present invention, the performing test configuration on the at least one to-be-tested message set respectively to obtain test configuration results includes: and respectively configuring a network protocol IP address, a port number and/or a packet sending rate for the at least one message set to be tested to obtain a test configuration result.
Specifically, the performing, according to the at least one to-be-tested message set and the test configuration result, a core network performance test on the to-be-tested network element to obtain a test result includes: performing core network performance test on the network element to be tested according to the at least one message set to be tested and the test configuration result; and if the updating information of at least one message set to be tested is acquired in the testing process, continuing the performance test of the core network on the network element to be tested according to the updating information, the at least one message set to be tested and the test configuration result to obtain a test result.
This enables dynamic pressurization.
In an embodiment of the present invention, the test result may include: the sending success number and/or the sending success ratio of the messages to be tested in each message set to be tested are not limited to this.
An embodiment of the present invention further provides a core network performance testing system, as shown in fig. 3, including:
a message layer 31 and a user layer 32 in communication with the message layer 31;
the message layer 31 is configured to obtain at least one message set to be tested; respectively carrying out test configuration on the at least one message set to be tested to obtain a test configuration result;
and the user layer 32 is configured to perform a core network performance test on the network element to be tested according to the at least one message set to be tested and the test configuration result, so as to obtain a test result.
The core network performance test system provided by the embodiment of the invention obtains at least one message set to be tested; respectively carrying out test configuration on the at least one message set to be tested to obtain a test configuration result; performing core network performance test on the network element to be tested according to the at least one message set to be tested and the test configuration result to obtain a test result; therefore, the directional test can be carried out aiming at specific messages and specific behaviors based on the message pressure loading method, and flexible test capability scheduling is realized; and the surrounding test is not performed by simulating peripheral network elements through a commercial instrument, so that the test cost is greatly reduced.
Wherein the message layer is specifically configured to: and acquiring at least one message set to be tested according to the tested traffic demand and the networking topological structure.
Specifically, the message layer is specifically configured to: obtaining at least one load pressure number according to the tested traffic demand and the networking topological structure; and acquiring at least one message set to be tested according to the at least one load pressure number.
In the embodiment of the present invention, the message layer is specifically configured to: and respectively configuring a network protocol IP address, a port number and/or a packet sending rate for the at least one message set to be tested.
Specifically, the user layer is specifically configured to: performing core network performance test on the network element to be tested according to the at least one message set to be tested and the test configuration result; and if the updating information of at least one message set to be tested is acquired in the testing process, continuing the performance test of the core network on the network element to be tested according to the updating information, the at least one message set to be tested and the test configuration result to obtain a test result.
In an embodiment of the present invention, the test result may include: the sending success number and/or the sending success ratio of the messages to be tested in each message set to be tested are not limited to this.
Further, the core network performance testing system further includes: a virtual layer in communication with the message layer, and a physical layer in communication with the virtual layer; the physical layer is used for providing test physical resources for a core network performance test system; the virtual layer is used for virtualizing the calculated and stored network resources and centralizing the virtualized network resources in a shared resource pool; the message layer acquires at least one message set to be tested by calling the virtual resources in the shared resource pool; and respectively carrying out test configuration on the at least one message set to be tested to obtain a test configuration result.
The message layer can be directly butted with a virtual network element in a Network Function Virtualization (NFV) framework to realize the test of the virtual network element.
The implementation embodiments of the core network performance testing method are all suitable for the embodiment of the core network performance testing system, and the same technical effect can be achieved.
The core network performance testing system provided by the embodiment of the present invention is further illustrated below.
To solve the above technical problem, an embodiment of the present invention provides a core network performance testing system, and specifically, a corresponding core network testing system architecture based on a message may be as shown in fig. 4, where the system is divided into four layers, namely a physical layer, a virtual layer, a message layer, and a user layer.
Wherein, the physical layer: the physical layer mainly provides test physical resources for the whole test system, and the computing power and the storage power of the universal x86 server are the basis of the virtual layer (the physical layer uses the universal x86 server).
Virtual layer: and computing, storing and virtualizing network resources through hypervisor. All the virtual resources are centralized in a uniform shared resource pool, so that the scheduling is convenient.
And a message layer: the message layer is a main control logic layer of the message-based virtualized core network test scheme provided by the scheme. The message layer is divided into three modules of a test engine, message group control and resource scheduling.
1. A test engine: the test engine mainly provides management and scheduling functions of virtual users for testing and is divided into two parts, namely load control and scheduling control. The load control mainly controls the number of virtual users, the loading speed and the like according to the test requirements. The scheduling control mainly controls the operation state of the message unit, such as operation, pause, stop, etc. The test engine is loosely coupled with the message group, independent of the type of the processed message, and has universality.
2. Message group control: a message group is a collection of all messages that are used to simulate the complete business process of a test, where each message has independence. The message group can simulate the service flow and interface protocol of all network elements around the tested network element to realize the full-enclosure test. The message group control comprises two parts of a message unit and a message configuration.
Taking an HSS network element Vo L TE new registration flow as an example to illustrate the definition of a message unit, the overall business flow is shown in fig. 5, and a normal business flow consists of four pairs of messages, namely UAR (User-authentication-Request)/UAA (User-authentication-Answer), MAR (Multimedia-authentication-Request)/MAA (Multimedia-authentication-Answer, Multimedia-authentication-response), UAR/UAA, SAR (Server-Assignment-Request, Server Assignment-Request)/SAA (Server-Assignment-Answer, Server Assignment-Answer), existing commercial instruments also follow the Multimedia-authentication-Answer, the scheme manages a pair of messages in the business flow, or a combination of several pairs of messages, and usually one message unit is a subset of a certain business processing flow, and when there is more messages in the four pairs of messages, the scheme manages a pair of messages in the business flow, and manages a plurality of messages as a pair of messages, and when there is an abnormal message processing effect, the four abnormal messages can be selected separately.
The message configuration comprises a static configuration part and a dynamic library part, wherein the static configuration part does not need to be modified in the test process, such as an IP address, a port number and the like. The dynamic library mainly realizes the docking function of the message unit and the test engine, and comprises the steps of acquiring sending content, packaging a request, sending the request, receiving a response, processing the response and the like. The test engine can realize the loading and scheduling of the message through the dynamic library.
3. Resource regulation and control: the resource regulation and control are mainly used for monitoring the use condition of resources and realizing the scheduling of the resources.
And (3) a user layer: the user layer mainly provides an operation interface for testing for a user, and the user can perform operations such as formulation of a test case, flow control, monitoring of a testing process, generation of a test report and the like.
The core network testing architecture based on the message provided by the scheme has higher consistency with the core network architecture of the NFV, and the message layer of the testing system can be directly butted with the virtual network element in the NFV (as shown in figure 6) to realize the test of the virtual network element; the testing tool (the system) can be directly integrated into a core network with an NFV framework, and the testing tool is directly called by the MANO to realize 'deployment, namely testing' (the Mano is not part of the system, but part of the NFV framework and realizes the arranging and scheduling functions of network elements.
In fig. 6, EMS denotes a network element management system, VNF denotes a virtual network function, OSS denotes an operation support system, and BSS denotes a service support system.
Specifically, the test flow of the system may be as shown in fig. 7, and includes:
step 71: and calculating the load pressure number of each message unit according to the tested traffic demand and the topological structure of the networking. The test networking map may be as shown in fig. 8, and the message group and the load pressure may be as shown in fig. 9.
In fig. 8, MSC Server denotes a mobile switching center Server, H L R denotes a home location register, HSS denotes a home subscriber Server, MME denotes mobility entity management, SGSN denotes a serving GPRS support node, BOSS denotes a service operation support system, TAS denotes a communication application Server, I-CSCF denotes an interrogating call session control function, and S-CSCF denotes a serving call session control function.
CAPS in fig. 9 indicates the number of calls established per second.
Step 72: the message group is configured, including parameters such as IP, port number, and packet sending rate, as shown in fig. 10.
In fig. 10, DNS indicates a domain name system, IP indicates a network protocol, Value indicates a Value, and virip indicates a variable name-virtual IP that is customized by a test result.
Step 73: and carrying out load setting on each message unit through the test engine.
Step 74: the test is started and the test index is monitored in real time, as shown in fig. 11 (start of test, dynamic pressurization is also possible).
Specifically, the user layer schedules the message layer, the virtual layer, and the physical layer to cooperatively execute the test.
In fig. 11, EPC indicates core packet network evolution, and VOBB indicates broadband voice.
Step 75: the test is ended, a report is obtained (as shown in fig. 12), and the problem is analyzed (core network performance analysis).
Specifically, the user layer schedules the message layer, the virtual layer, and the physical layer to execute cooperatively.
Fig. 12 includes a parameter Testing Capability, a Test Start Time, a Test End Time, and a Test Duration Time, in fig. 12; wherein, IP-TRAFFIC-DNS represents network protocol-flow-domain name system.
It can be seen from the above that, the embodiment of the present invention provides a core network test load loading method based on messages, which abandons the traditional test scheme based on a service model and user behavior, disassembles the service model required for testing into an independent message unit based on an interface, and then combines and controls the messages to perform testing. The test system can be deployed on a universal X86 platform, so that the limitation of a traditional instrument on software and hardware is eliminated, and the test requirement of a virtualization core network is met.
Wherein, this system: 1) a four-layer structure which is the same as the NFV structure is arranged, so that a message layer of a test system can be directly butted with a virtual network element in the NFV, and the virtual network element is tested; 2) and carrying out load pressure accounting on a message layer, and simulating the service flow and interface protocol of all network elements around the tested network element by using the message group, thereby realizing the full-enclosure test.
In summary, the framework related to the performance test of the network element of the core network and the load pressurization method based on the message unit provided by the embodiment of the present invention can realize flexible test capability scheduling, and the load pressurization capability is greatly increased; the deployment mode based on the universal X86 server can also meet the requirement of 'deployment, namely testing' of the network element of the virtualized core network, thereby truly realizing the aim of virtualization of the testing capability.
An embodiment of the present invention further provides a core network, where the core network has a network function virtualization NFV framework, and the core network includes: the core network performance test system is described above.
The implementation embodiments of the core network performance testing system are all applicable to the embodiment of the core network, and the same technical effect can be achieved.
An embodiment of the present invention further provides a core network performance testing apparatus, as shown in fig. 13, including:
a first processing module 131, configured to obtain at least one message set to be tested;
the second processing module 132 is configured to perform test configuration on the at least one to-be-tested message set, respectively, to obtain a test configuration result;
the third processing module 133 is configured to perform a core network performance test on the network element to be tested according to the at least one message set to be tested and the test configuration result, so as to obtain a test result.
The core network performance testing device provided by the embodiment of the invention obtains at least one message set to be tested; respectively carrying out test configuration on the at least one message set to be tested to obtain a test configuration result; performing core network performance test on the network element to be tested according to the at least one message set to be tested and the test configuration result to obtain a test result; therefore, the directional test can be carried out aiming at specific messages and specific behaviors based on the message pressure loading method, and flexible test capability scheduling is realized; and the surrounding test is not performed by simulating peripheral network elements through a commercial instrument, so that the test cost is greatly reduced.
Wherein the first processing module comprises: and the first acquisition submodule is used for acquiring at least one message set to be tested according to the tested traffic demand and the networking topological structure.
Specifically, the first obtaining sub-module includes: the first processing unit is used for obtaining at least one load pressure number according to the tested traffic demand and the networking topological structure; and the first acquisition unit is used for acquiring at least one message set to be tested according to the at least one load pressure number.
In an embodiment of the present invention, the second processing module includes: and the first configuration submodule is used for respectively configuring the network protocol IP address, the port number and/or the packet sending rate for the at least one message set to be tested to obtain a test configuration result.
Specifically, the third processing module includes: the first processing submodule is used for carrying out core network performance test on the network element to be tested according to the at least one message set to be tested and the test configuration result; and the second processing submodule is used for continuously carrying out the core network performance test on the network element to be tested according to the update information, the at least one message set to be tested and the test configuration result to obtain a test result if the update information of the at least one message set to be tested is obtained in the test process.
In an embodiment of the present invention, the test result may include: the sending success quantity and/or the sending success ratio of the messages to be tested in each message set to be tested.
The implementation embodiments of the core network performance testing method are all suitable for the embodiment of the core network performance testing device, and the same technical effect can be achieved.
The embodiment of the invention also provides a core network performance test system, which comprises a memory, a processor and a computer program which is stored on the memory and can run on the processor; and when the processor executes the program, the core network performance testing method is realized.
The implementation embodiments of the core network performance testing method are all suitable for the embodiment of the core network performance testing system, and the same technical effect can be achieved.
An embodiment of the present invention further provides a computer-readable storage medium, on which a computer program is stored, where the computer program, when executed by a processor, implements the steps in the core network performance testing method.
The implementation embodiments of the core network performance testing method are all applicable to the embodiment of the computer-readable storage medium, and the same technical effect can be achieved.
It should be noted that many of the functional components described in this specification are referred to as modules/sub-modules/units in order to more particularly emphasize their implementation independence.
In embodiments of the present invention, the modules/sub-modules/units may be implemented in software for execution by various types of processors. An identified module of executable code may, for instance, comprise one or more physical or logical blocks of computer instructions which may, for instance, be constructed as an object, procedure, or function. Nevertheless, the executables of an identified module need not be physically located together, but may comprise disparate instructions stored in different bits which, when joined logically together, comprise the module and achieve the stated purpose for the module.
Indeed, a module of executable code may be a single instruction, or many instructions, and may even be distributed over several different code segments, among different programs, and across several memory devices. Likewise, operational data may be identified within the modules and may be embodied in any suitable form and organized within any suitable type of data structure. The operational data may be collected as a single data set, or may be distributed over different locations including over different storage devices, and may exist, at least partially, merely as electronic signals on a system or network.
When a module can be implemented by software, considering the level of existing hardware technology, a module that can be implemented by software can build corresponding hardware circuits including conventional very large scale integration (V L SI) circuits or gate arrays and existing semiconductors such as logic chips, transistors, or other discrete components to implement corresponding functions, without considering the cost.
While the preferred embodiments of the present invention have been described, it will be understood by those skilled in the art that various changes and modifications may be made without departing from the spirit and scope of the invention.
Claims (23)
1. A method for testing performance of a core network is characterized by comprising the following steps:
acquiring at least one message set to be tested;
respectively carrying out test configuration on the at least one message set to be tested to obtain a test configuration result;
and performing core network performance test on the network element to be tested according to the at least one message set to be tested and the test configuration result to obtain a test result.
2. The method according to claim 1, wherein the obtaining at least one set of messages to be tested comprises:
and acquiring at least one message set to be tested according to the tested traffic demand and the networking topological structure.
3. The method for testing the performance of the core network according to claim 2, wherein the obtaining of at least one message set to be tested according to the tested traffic demand and the networking topology comprises:
obtaining at least one load pressure number according to the tested traffic demand and the networking topological structure;
and acquiring at least one message set to be tested according to the at least one load pressure number.
4. The method according to claim 1, wherein the performing test configuration on the at least one message set to be tested respectively to obtain a test configuration result includes:
and respectively configuring a network protocol IP address, a port number and/or a packet sending rate for the at least one message set to be tested to obtain a test configuration result.
5. The method for testing core network performance according to claim 1, wherein the performing a core network performance test on the network element to be tested according to the at least one message set to be tested and the test configuration result to obtain a test result comprises:
performing core network performance test on the network element to be tested according to the at least one message set to be tested and the test configuration result;
and if the updating information of at least one message set to be tested is acquired in the testing process, continuing the performance test of the core network on the network element to be tested according to the updating information, the at least one message set to be tested and the test configuration result to obtain a test result.
6. The core network performance testing method of claim 1, wherein the test result comprises:
the sending success quantity and/or the sending success ratio of the messages to be tested in each message set to be tested.
7. A core network performance testing system, comprising:
a message layer and a user layer in communication with the message layer;
the message layer is used for acquiring at least one message set to be tested; respectively carrying out test configuration on the at least one message set to be tested to obtain a test configuration result;
and the user layer is used for performing core network performance test on the network element to be tested according to the at least one message set to be tested and the test configuration result to obtain a test result.
8. The core network performance testing system of claim 7, wherein the message layer is specifically configured to:
and acquiring at least one message set to be tested according to the tested traffic demand and the networking topological structure.
9. The core network performance testing system of claim 8, wherein the message layer is specifically configured to:
obtaining at least one load pressure number according to the tested traffic demand and the networking topological structure;
and acquiring at least one message set to be tested according to the at least one load pressure number.
10. The core network performance testing system of claim 7, wherein the message layer is specifically configured to:
and respectively configuring a network protocol IP address, a port number and/or a packet sending rate for the at least one message set to be tested.
11. The core network performance testing system of claim 7, wherein the user layer is specifically configured to:
performing core network performance test on the network element to be tested according to the at least one message set to be tested and the test configuration result;
and if the updating information of at least one message set to be tested is acquired in the testing process, continuing the performance test of the core network on the network element to be tested according to the updating information, the at least one message set to be tested and the test configuration result to obtain a test result.
12. The core network performance testing system of claim 7, wherein the test results comprise:
the sending success quantity and/or the sending success ratio of the messages to be tested in each message set to be tested.
13. The core network performance testing system of any of claims 7-12, further comprising:
a virtual layer in communication with the message layer, and a physical layer in communication with the virtual layer;
the physical layer is used for providing test physical resources for a core network performance test system;
the virtual layer is used for virtualizing the calculated and stored network resources and centralizing the virtualized network resources in a shared resource pool;
the message layer acquires at least one message set to be tested by calling the virtual resources in the shared resource pool; and respectively carrying out test configuration on the at least one message set to be tested to obtain a test configuration result.
14. The core network performance testing system of claim 13, wherein the message layer interfaces directly with virtual network elements in a network function virtualization, NFV, framework.
15. A core network having a network function virtualization, NFV, framework, comprising: a core network performance test system as claimed in any one of claims 7 to 14.
16. A core network performance testing apparatus, comprising:
the first processing module is used for acquiring at least one message set to be tested;
the second processing module is used for respectively carrying out test configuration on the at least one message set to be tested to obtain a test configuration result;
and the third processing module is used for performing core network performance test on the network element to be tested according to the at least one message set to be tested and the test configuration result to obtain a test result.
17. The core network performance testing apparatus of claim 16, wherein the first processing module comprises:
and the first acquisition submodule is used for acquiring at least one message set to be tested according to the tested traffic demand and the networking topological structure.
18. The core network performance testing apparatus of claim 17, wherein the first obtaining sub-module comprises:
the first processing unit is used for obtaining at least one load pressure number according to the tested traffic demand and the networking topological structure;
and the first acquisition unit is used for acquiring at least one message set to be tested according to the at least one load pressure number.
19. The core network performance testing apparatus of claim 16, wherein the second processing module comprises:
and the first configuration submodule is used for respectively configuring the network protocol IP address, the port number and/or the packet sending rate for the at least one message set to be tested to obtain a test configuration result.
20. The core network performance testing apparatus of claim 16, wherein the third processing module comprises:
the first processing submodule is used for carrying out core network performance test on the network element to be tested according to the at least one message set to be tested and the test configuration result;
and the second processing submodule is used for continuously carrying out the core network performance test on the network element to be tested according to the update information, the at least one message set to be tested and the test configuration result to obtain a test result if the update information of the at least one message set to be tested is obtained in the test process.
21. The core network performance testing apparatus of claim 16, wherein the test result comprises:
the sending success quantity and/or the sending success ratio of the messages to be tested in each message set to be tested.
22. A core network performance testing system comprising a memory, a processor and a computer program stored on the memory and executable on the processor; characterized in that the processor implements the core network performance testing method according to any of claims 1 to 6 when executing the program.
23. A computer-readable storage medium, on which a computer program is stored, which, when being executed by a processor, carries out the steps in the core network performance testing method according to any one of claims 1 to 6.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910000937.1A CN111404763B (en) | 2019-01-02 | 2019-01-02 | Core network performance test method, device and system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910000937.1A CN111404763B (en) | 2019-01-02 | 2019-01-02 | Core network performance test method, device and system |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN111404763A true CN111404763A (en) | 2020-07-10 |
| CN111404763B CN111404763B (en) | 2022-11-08 |
Family
ID=71432003
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201910000937.1A Active CN111404763B (en) | 2019-01-02 | 2019-01-02 | Core network performance test method, device and system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN111404763B (en) |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113365300A (en) * | 2021-07-28 | 2021-09-07 | 北京恒安嘉新安全技术有限公司 | Simulation system of mobile network and service test method of mobile network |
| CN116170828A (en) * | 2023-04-18 | 2023-05-26 | 北京博上网络科技有限公司 | 5G core network testing method and system |
Citations (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102740342A (en) * | 2012-06-08 | 2012-10-17 | 大唐移动通信设备有限公司 | Network management equipment performance simulation test method and system |
| CN102821211A (en) * | 2011-06-10 | 2012-12-12 | 中兴通讯股份有限公司 | Automatic testing method and device for communication network elements |
| CN104135735A (en) * | 2014-08-25 | 2014-11-05 | 宁波普天通信技术有限公司 | Automatic testing method, device and system for LTE core network |
| US20150063166A1 (en) * | 2013-08-27 | 2015-03-05 | Futurewei Technologies, Inc. | System and Method for Mobile Network Function Virtualization |
| CN104601412A (en) * | 2015-02-12 | 2015-05-06 | 中国工商银行股份有限公司 | Independent test network system and establishing method thereof |
| CN104852912A (en) * | 2015-04-29 | 2015-08-19 | 中国互联网络信息中心 | Domain name registration server performance testing system and domain name registration server performance testing method |
| CN106789432A (en) * | 2016-12-28 | 2017-05-31 | 中软信息系统工程有限公司 | Test system based on autonomous controllable cloud platform technology |
| CN107749807A (en) * | 2017-10-31 | 2018-03-02 | 江苏省未来网络创新研究院 | A kind of network function verification method and checking system towards NFV |
| CN108011846A (en) * | 2017-11-03 | 2018-05-08 | 华为技术有限公司 | The method and device of management business in network function virtualization architecture |
-
2019
- 2019-01-02 CN CN201910000937.1A patent/CN111404763B/en active Active
Patent Citations (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102821211A (en) * | 2011-06-10 | 2012-12-12 | 中兴通讯股份有限公司 | Automatic testing method and device for communication network elements |
| CN102740342A (en) * | 2012-06-08 | 2012-10-17 | 大唐移动通信设备有限公司 | Network management equipment performance simulation test method and system |
| US20150063166A1 (en) * | 2013-08-27 | 2015-03-05 | Futurewei Technologies, Inc. | System and Method for Mobile Network Function Virtualization |
| CN104135735A (en) * | 2014-08-25 | 2014-11-05 | 宁波普天通信技术有限公司 | Automatic testing method, device and system for LTE core network |
| CN104601412A (en) * | 2015-02-12 | 2015-05-06 | 中国工商银行股份有限公司 | Independent test network system and establishing method thereof |
| CN104852912A (en) * | 2015-04-29 | 2015-08-19 | 中国互联网络信息中心 | Domain name registration server performance testing system and domain name registration server performance testing method |
| CN106789432A (en) * | 2016-12-28 | 2017-05-31 | 中软信息系统工程有限公司 | Test system based on autonomous controllable cloud platform technology |
| CN107749807A (en) * | 2017-10-31 | 2018-03-02 | 江苏省未来网络创新研究院 | A kind of network function verification method and checking system towards NFV |
| CN108011846A (en) * | 2017-11-03 | 2018-05-08 | 华为技术有限公司 | The method and device of management business in network function virtualization architecture |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113365300A (en) * | 2021-07-28 | 2021-09-07 | 北京恒安嘉新安全技术有限公司 | Simulation system of mobile network and service test method of mobile network |
| CN116170828A (en) * | 2023-04-18 | 2023-05-26 | 北京博上网络科技有限公司 | 5G core network testing method and system |
Also Published As
| Publication number | Publication date |
|---|---|
| CN111404763B (en) | 2022-11-08 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US8874776B2 (en) | Virtual ad hoc network testbeds for network-aware applications | |
| US11032126B2 (en) | Diagnostic traffic generation for automatic testing and troubleshooting | |
| US7315807B1 (en) | System and methods for storage area network simulation | |
| CN108170612B (en) | Automatic testing method and device and server | |
| US8996920B2 (en) | Finite state machine method for test case generation and execution of communication protocols | |
| CN110765024A (en) | Simulation test method, simulation test device, electronic equipment and computer-readable storage medium | |
| US11811844B2 (en) | Product validation based on simulated enhanced calling or messaging communications services in telecommunications network | |
| CN111404763B (en) | Core network performance test method, device and system | |
| CN114422010B (en) | Protocol testing method of satellite communication simulation platform based on network virtualization | |
| US11490432B1 (en) | Unified query tool for network function virtualization architecture | |
| WO2017113848A1 (en) | Testing method, testing platform and simulated testing device for test case | |
| WO2017025126A1 (en) | Automatic symptom data collection in cloud deployment | |
| US20230081333A1 (en) | Unified interface and tracing tool for network function virtualization architecture | |
| CN111522727A (en) | Simulation object test method, device and system | |
| CN117041111A (en) | Vehicle cloud function test method and device, electronic equipment and storage medium | |
| CN101207525B (en) | System and apparatus for testing wireless network controller signaling processing module | |
| CN116611375A (en) | Software and hardware collaborative simulation platform and software and hardware testing method | |
| CN101969442A (en) | Process running environment perception and migration based network analog framework implementation method | |
| CN114745749A (en) | Virtual network element testing method and device, electronic equipment and readable storage medium | |
| CN111221687B (en) | Cloud storage testing system and method | |
| CN114466000A (en) | CDN gateway source returning method and device | |
| US20240147268A1 (en) | "real feel" autonomous network test solution system, method, device, and program | |
| CN111078534B (en) | Test scheduling method and related equipment | |
| CN112242910B (en) | Network element fault positioning method and device, computing equipment and computer storage medium | |
| CN110895507B (en) | Simulation test method and device, simulation server and storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |