CN113037582A - Network Function Virtualization (NFV) test method, device and system - Google Patents
Network Function Virtualization (NFV) test method, device and system Download PDFInfo
- Publication number
- CN113037582A CN113037582A CN201911354215.2A CN201911354215A CN113037582A CN 113037582 A CN113037582 A CN 113037582A CN 201911354215 A CN201911354215 A CN 201911354215A CN 113037582 A CN113037582 A CN 113037582A
- Authority
- CN
- China
- Prior art keywords
- test
- nfv
- network function
- template
- scene template
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L43/00—Arrangements for monitoring or testing data switching networks
- H04L43/50—Testing arrangements
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/36—Preventing errors by testing or debugging software
- G06F11/3668—Software testing
- G06F11/3672—Test management
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F9/00—Arrangements for program control, e.g. control units
- G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
- G06F9/44—Arrangements for executing specific programs
- G06F9/455—Emulation; Interpretation; Software simulation, e.g. virtualisation or emulation of application or operating system execution engines
- G06F9/45533—Hypervisors; Virtual machine monitors
- G06F9/45558—Hypervisor-specific management and integration aspects
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L41/00—Arrangements for maintenance, administration or management of data switching networks, e.g. of packet switching networks
- H04L41/08—Configuration management of networks or network elements
- H04L41/0893—Assignment of logical groups to network elements
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L41/00—Arrangements for maintenance, administration or management of data switching networks, e.g. of packet switching networks
- H04L41/08—Configuration management of networks or network elements
- H04L41/0896—Bandwidth or capacity management, i.e. automatically increasing or decreasing capacities
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F9/00—Arrangements for program control, e.g. control units
- G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
- G06F9/44—Arrangements for executing specific programs
- G06F9/455—Emulation; Interpretation; Software simulation, e.g. virtualisation or emulation of application or operating system execution engines
- G06F9/45533—Hypervisors; Virtual machine monitors
- G06F9/45558—Hypervisor-specific management and integration aspects
- G06F2009/45591—Monitoring or debugging support
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F9/00—Arrangements for program control, e.g. control units
- G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
- G06F9/44—Arrangements for executing specific programs
- G06F9/455—Emulation; Interpretation; Software simulation, e.g. virtualisation or emulation of application or operating system execution engines
- G06F9/45533—Hypervisors; Virtual machine monitors
- G06F9/45558—Hypervisor-specific management and integration aspects
- G06F2009/45595—Network integration; Enabling network access in virtual machine instances
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L12/00—Data switching networks
- H04L12/28—Data switching networks characterised by path configuration, e.g. LAN [Local Area Networks] or WAN [Wide Area Networks]
- H04L12/46—Interconnection of networks
- H04L12/4641—Virtual LANs, VLANs, e.g. virtual private networks [VPN]
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Computer Networks & Wireless Communication (AREA)
- Signal Processing (AREA)
- Software Systems (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Computer Hardware Design (AREA)
- Quality & Reliability (AREA)
- Data Exchanges In Wide-Area Networks (AREA)
Abstract
The disclosure provides a Network Function Virtualization (NFV) testing method, device and system, and relates to the technical field of cloud computing. According to the NFV test task, a test scene template is determined, the test scene template is filled, the execution sequence of each test case in the test scene template is arranged according to the filled test scene template, and finally each test case is executed according to the execution sequence to test a test object corresponding to the NFV test task until all test cases specified in the scene template are executed, and a test result is output. The test scene is described through the standardized template language, the limitations of test objects, test cases and the like are broken through, a plurality of test tools can be used for executing a plurality of test cases on a plurality of test objects by a single test task, the test scene template can be reused, the test cases are prevented from being re-formulated in each test, and the test efficiency and flexibility are improved.
Description
Technical Field
The disclosure relates to the technical field of cloud computing, and in particular relates to a Network Function Virtualization (NFV) testing method, device and system.
Background
The core technology of cloud networks, such as a cloud computing technology, a Software Defined Network (SDN) technology, a Network Function Virtualization (NFV) technology and the like, has the characteristic of full stack decoupling. The cloud network system is composed of multiple layers and multiple components, and has a plurality of participants, and each layer and each component are mutually dependent and called. Due to the slow standard progress, the private system implementation and other factors, the compatibility and interoperability among the components are poor, and the system integration complexity is high. In order to promote the application landing of the cloud network system, a large amount of repeated testing work needs to be carried out.
In the related art, current tests are mainly performed manually, installation and deployment, test execution, result evaluation and the like are all performed manually, and existing automated test tools are provided only for certain capabilities of products thereof, or are mainly developed around the functional and performance aspects of Network Function Virtualization Infrastructure (NFVI).
Disclosure of Invention
The inventor finds that in the related art, the manual testing method is inefficient, and the automatic testing tool only supports specific test cases and specific test objects, and has limited testing capability and lack of flexibility.
According to the NFV test task, a test scene template is determined, the test scene template is filled, the execution sequence of each test case in the test scene template is arranged according to the filled test scene template, and finally each test case is executed according to the execution sequence to test a test object corresponding to the NFV test task until all test cases specified in the scene template are executed, and a test result is output. The test scene is described through the standardized template language, the limitations of test objects, test cases and the like are broken through, a plurality of test tools are used for executing a plurality of test cases on a plurality of test objects in a single test task, the test scene template can be repeatedly used, the test cases are prevented from being re-formulated in each test, and the test efficiency and flexibility are improved.
According to some embodiments of the present disclosure, there is provided a Network Function Virtualization (NFV) testing method, including:
determining a test scene template according to the NFV test task, and filling the test scene template;
arranging the execution sequence of each test case in the test scene template according to the filled test scene template;
and executing the test cases according to the execution sequence to test the test objects corresponding to the NFV test task until all the test cases specified in the scene template are executed, and outputting test results.
In some embodiments, the determining a test scenario template according to the NFV test task includes: and selecting a test scene template corresponding to the NFV test task from a test scene template library, or generating a corresponding test scene template according to the NFV test task and adding the test scene template to the test scene template library.
In some embodiments, the generating a corresponding test scenario template according to the NFV test task includes: determining a test case and related test parameters according to the NFV test task; and generating a test scene template according to the determined test case and the related test parameters.
In some embodiments, the relevant test parameters include parameters of test cases and parameters of test scenarios.
In some embodiments, the parameters of the test case include one or more of a type of test case, a test tool, and a test category.
In some embodiments, the parameters of the test scenario include one or more of input and output of each test case, execution flow of each test case, test object, and execution times of each test case.
In some embodiments, said populating said test scenario template comprises: filling the parameter values of the test cases corresponding to the test tasks into the parameters of the test cases; and filling the parameter values of the test scenes corresponding to the test tasks into the parameters of the test scenes.
In some embodiments, the generating a corresponding test scenario template according to the NFV test task further includes: and binding the test case and the test tool required by the test case.
In some embodiments, said arranging, according to the filled test scenario template, an execution sequence of each test case in the test scenario template includes: analyzing the test scene template to form a flow file for recording the execution sequence of each test case in the test scene template;
and automatically arranging the execution sequence of each test case in the test scene template according to the flow file.
In some embodiments, the execution of each test case comprises: instantiating a test tool corresponding to the test case; and executing the test case by utilizing the test tool.
In some embodiments, the test objects include one or more of a network function virtualization infrastructure NFVI, a virtualization infrastructure manager VIM, a network function virtualization NFV, a virtual network function manager VNFM, an element management system EMS, a network function virtualization orchestrator NFVO instance.
According to other embodiments of the present disclosure, there is provided a network function virtualization NFV testing apparatus, including: the selection scene template module is configured to determine a test scene template according to the NFV test task and fill the test scene template; the arranging module is configured to arrange the execution sequence of each test case in the test scene template according to the filled test scene template; and the execution module is configured to execute the test cases according to the execution sequence so as to test the test objects corresponding to the NFV test task until all the test cases specified in the scene template are executed, and output a test result.
According to still other embodiments of the present disclosure, there is provided a network function virtualization NFV testing apparatus, including: a memory; and a processor coupled to the memory, the processor configured to execute the network function virtualization, NFV, test method of any embodiment based on instructions stored in the memory.
According to still other embodiments of the present disclosure, there is provided a network function virtualization NFV test system, including: the network function virtualization NFV testing apparatus of any embodiment; the test tool set is configured to respond to the call of the network function virtualization NFV test device to execute a test case; and an interface for connecting the Network Function Virtualization (NFV) testing device with the set of testing tools.
In some embodiments, the system further comprises a user management interface configured to input the test tasks and output the test results.
According to still further embodiments of the present disclosure, there is provided a non-transitory computer readable storage medium having stored thereon a computer program which, when executed by a processor, implements the network function virtualization, NFV, testing method of any of the embodiments.
Drawings
The drawings that will be used in the description of the embodiments or the related art will be briefly described below. The present disclosure can be understood more clearly from the following detailed description, which proceeds with reference to the accompanying drawings.
It is to be understood that the drawings in the following description are merely exemplary of the disclosure, and that other drawings may be derived from those drawings by one of ordinary skill in the art without undue inventive faculty.
Fig. 1 illustrates a flow diagram of a network function virtualization, NFV, testing method, according to some example embodiments of the present disclosure.
Fig. 2 illustrates a flowchart of generating a test scenario template in a network function virtualization, NFV, testing method according to some exemplary embodiments of the present disclosure.
Fig. 3 illustrates a flow diagram of test execution in a network function virtualization, NFV, test method, according to some example embodiments of the present disclosure.
Fig. 4 illustrates a schematic diagram of a network function virtualization, NFV, testing apparatus, according to some example embodiments of the present disclosure.
Fig. 5 illustrates a schematic diagram of a network function virtualization, NFV, testing apparatus, according to some example embodiments of the present disclosure.
Fig. 6 illustrates an architectural schematic of a network function virtualization, NFV, test system, according to some exemplary embodiments of the present disclosure.
Detailed Description
The technical solutions in the embodiments of the present disclosure will be clearly and completely described below with reference to the drawings in the embodiments of the present disclosure.
Fig. 1 illustrates a flow diagram of a network function virtualization, NFV, testing method, according to some example embodiments of the present disclosure. The method may be performed, for example, by a network function virtualization NFV test apparatus.
As shown in fig. 1, the method of this embodiment comprises steps 101-103.
In step 101, a test scenario template is determined according to the NFV test task, and the test scenario template is filled.
Determining a test scenario template according to the NFV test task includes: and selecting a test scene template corresponding to the NFV test task from the test scene template library, or generating a corresponding test scene template according to the NFV test task and adding the test scene template to the test scene template library. Filling the test scenario template includes: and filling the values of the parameters of the test cases corresponding to the test tasks into the parameters of the test cases, and filling the values of the parameters of the test scenes corresponding to the test tasks into the parameters of the test scenes. In some embodiments, if the test case corresponding to the test task has both closed type test cases (i.e., the test case does not contain parameters (also referred to as input parameters)) and parametric type test cases, the values of the parameters in the parametric type test cases are filled into the parameters of the corresponding test cases, and the parameters of the test cases do not need to be filled into the closed type test cases. In addition, in some embodiments, if the test cases corresponding to the test task are all closed type test cases, parameters of the test cases do not need to be filled.
In some exemplary embodiments, generating a corresponding test scenario template according to the NFV test task includes: and determining a test case and related test parameters according to the NFV test task, and then generating a test scene template according to the determined test case and the related test parameters. In some embodiments, generating the corresponding test scenario template according to the NFV test task further includes: and binding the test cases and the test tools required by the test cases.
The relevant test parameters comprise parameters of a test case and parameters of a test scene. The parameters of the test case may include, for example, one or more of a type of test case, a test tool, and a test category. The parameters of the test scenario may include, for example, one or more of input and output of each test case, execution flow of each test case, test object, and execution number of each test case.
The test tasks are defined in a parameterized mode, and different test tasks can be completed if parameters of the filled test cases and/or parameters of the test scenes are different, so that the step of repeatedly configuring the test cases, the test tools and the like for each test task is avoided, and the test scene template can be repeatedly utilized, so that the test efficiency is improved.
In step 102, the execution sequence of each test case in the test scenario template is arranged according to the filled test scenario template.
Some exemplary implementation methods may, for example, parse the test scenario template to form a flow file recording an execution sequence of each test case in the test scenario template, and then automatically arrange the execution sequence of each test case in the test scenario template according to the flow file.
The automatic arrangement of the execution sequence of the test cases is realized, the test efficiency can be improved, and the labor cost brought by manual test is reduced.
In step 103, each test case is executed according to the execution sequence to test the test object corresponding to the NFV test task until all test cases specified in the scene template are executed, and the test result is output.
In some embodiments, the test cases are executed according to the execution sequence automatically arranged in step 102, wherein executing each test case may include, for example: and instantiating a corresponding test tool of the test case, and executing the test case by using the test tool.
Among them, the test object may include one or more of Network Function Virtualization Infrastructure (NFVI), Virtualized Infrastructure Manager (VIM), Network Function Virtualization (NFV), Virtual Network Function Manager (VNFM), Element Management System (EMS), Network Function Virtualization (NFVO) instances, for example.
The test scene is described through a standardized template language, the limitations of test objects, test cases and the like are broken through, a plurality of test tools are used for executing a plurality of test cases on a plurality of test objects in a single test task, the test scene template can be repeatedly used in a plurality of test tasks, the test cases are prevented from being re-formulated in each test, and the test efficiency and flexibility are improved.
Fig. 2 illustrates a flowchart of generating a test scenario template in a network function virtualization, NFV, testing method according to some exemplary embodiments of the present disclosure.
As shown in FIG. 2, some exemplary methods of generating a test scenario template are illustrated.
For example, in performing a task of testing the capability of a VM carrying a VNF network element, in the NFV architecture, NFVI and VIM together provide a resource environment (including, for example, computing resources, storage resources, network resources, and the like) required for deploying, managing, and executing a VNF, and these resources may be physical or virtual (virtual resources may be, for example, a virtual machine VM, a container, a light virtual machine, and the like). NFVI provides operating environments for Virtual Network Functions (VNFs), and VIM provides the ability to provision, manage, and configure these environments. When the VNF runs in the VM, the VNF has special requirements for the configuration of the VM, and therefore, the VM provided by the NFVI and the VIM needs to be tested to determine whether the VNF has the capability of carrying a VNF network element.
As shown in fig. 2, the generating of the test scenario template in the network function virtualization NFV test method includes steps 201 and 205.
At step 201, test cases are added.
For example, a user may add a test case on the unified management interface, and indicate the type of the test case (for example, the test case may be a closed type test case or a parametric type test case), a test tool, a test category (for example, a functional test, a performance test, and the like), an applicable test object, and the like. The test object may be, for example, one or more of a network function virtualization infrastructure NFVI, a virtualization infrastructure manager VIM, a network function virtualization NFV, a virtual network function manager VNFM, an element management system EMS, and a network function virtualization orchestrator NFVO.
For example, in a task of testing the capability of the VM carrying a VNF network element, the test object is, for example, a VIM and NFVI component, the invocation interface for providing physical and virtual resources required for the VNF to run is, for example, an OpenStack API or a middleware AP, the access address is, for example, an OpenStack Keystone URL or an OpenStack Public URL, the VIM may be, for example, a cloud management platform of an operator, and the NFVI may be, for example, formed by a commercial or Open source virtualization software. The physical environment of the test bed comprises a plurality of physical servers, a plurality of network devices and a plurality of storage devices, for example, a CPU of a server can support hardware-assisted virtualization, a network card can support SR-IOV and DPDK, and both VIM and NFVI are deployed and configured, and resources meet test requirements.
For the test task, there are 14 test cases to be added, wherein there are both closed type test cases and parametric type test cases. Specifically, the closure test case includes Central Processing Unit (CPU) expansion, Memory expansion, disk expansion, Virtual Local Area Network (VLAN) Network creation, Data Plane Development Kit (DPDK) for computing node opening, VLAN setting, Memory macro page setting, Memory reservation, file injection, CPU binding, Non-Uniform Memory Access Architecture (NUMA) binding, Virtual machine affinity, Virtual machine inverse affinity, and parametric test cases include Virtual machine creation, Virtual machine deletion, and Virtual machine control verification. Each test case is specifically described below.
(1) The compute node starts a Data Plane Development Kit (DPDK). The concrete examples are:
(2) a VLAN network is created. The concrete examples are:
(3) and creating a virtual machine. The concrete examples are:
(4) virtual machine affinity. The concrete examples are:
(5) virtual machine anti-affinity. The concrete examples are:
(6) Non-Uniform Memory Access Architecture (NUMA) binding. The concrete examples are:
(7) and (5) binding the CPU. The concrete examples are:
(8) and (5) injecting the file. The concrete examples are:
(9) and reserving the memory. The concrete examples are:
(10) and (5) storing the huge pages. The concrete examples are:
(11) a VLAN is set. The concrete examples are:
(12) virtual machine control is verified. The concrete examples are:
(13) CPU capacity expansion, memory capacity expansion and disk capacity expansion. The following are respectively specific examples: a) CPU capacity expansion
b) Memory capacity expansion
c) Disk capacity expansion
(14) And deleting the virtual machine. The concrete examples are:
after the test case corresponding to the test task is determined and added, the test case can be added to the arranging module.
At step 202, test cases are added to the orchestration module.
Namely, the information of the test case is synchronized to the test arranging module.
At step 203, test case scripts are uploaded and test tools are bound.
Specifically, test case scripts and test tools are uploaded and bound to a set of test tools and a framework. The test tool set includes a test tool 1, a test tool 2, a test tool 3, and the like, and is used for testing a test object.
At step 204, test scenarios are added.
Specifically, for example, a user may add a test scenario, select a test case forming the scenario, specify an input/output requirement, an execution flow, an execution number, and the like of the test case, and generate a test scenario template.
For example, in a test task for the capability of the VM for carrying the VNF network element, a test scenario corresponding to the capability is created, where the test scenario includes test cases: the method comprises the steps of starting DPDK by a computing node, establishing a VLAN network, establishing a virtual machine, affinity of the virtual machine, counter affinity of the virtual machine, NUMA binding, CPU binding, file injection, memory reservation, parameter setting of memory huge pages, setting of VLAN, verification of virtual machine control, CPU expansion, memory expansion, disk expansion and virtual machine deletion.
At step 205, test scenarios are added to the orchestration module.
Specifically, in some embodiments, the test scenario template is added to the test orchestration module, and the orchestration module parses the test scenario template to check the correctness of the template.
Fig. 3 illustrates a flow diagram of executing test cases in a network function virtualization, NFV, testing method according to some example embodiments of the present disclosure.
As shown in FIG. 3, some exemplary methods of executing test cases are shown. Including step 301 and 309.
In step 301, a user initiates a test task, selects a scenario test template, and fills scenario test data.
Specifically, for example, a user initiates a test task from the unified management interface, selects a scenario test template, and fills relevant data of the scenario test template, where the relevant data may include, for example, an associated test object, input parameters of a specified test case, and the like.
At step 302, a scenario test template and associated data are submitted.
And submitting the scene test template and related data to a test arrangement module. For example, the test scenario template shown in FIG. 2 and the test task related parameter data are added to the test orchestration module. The relevant parameter data comprises parameter values of the parametric test cases and parameter values of the test scenes.
For example, in a capability test task of a VM carrying a VNF network element, filling an input parameter value of a test case into an input parameter of the test case shown in fig. 2, and filling a relevant parameter of a test scenario, for example, includes: parameter values that will create the output of the virtual machine: the virtual machine identification number VMID is used as a value of an input parameter for verifying the virtual machine control and deleting the virtual machine, so that the three test cases: creating a virtual machine, verifying virtual machine control, and deleting a virtual machine are linked.
In step 303, the test template is parsed to form a flow document.
The test arrangement module reads the scene test template and the input data, analyzes the template to form a flow file readable by the arrangement engine, and the arrangement engine executes the flow file.
The template can be analyzed through an orchestration engine of NFV automatic test, and a built-in analyzer of the orchestration engine analyzes the scene template.
For example, in a test task for the capability of the VM bearing the VNF network element, a test scenario template corresponding to the test task is analyzed, and an execution sequence of the obtained flow file record may be represented as: opening DPDK on a computing node → creating a VLAN network → creating a virtual machine, which comprises virtual machine affinity, inverse affinity, NUMA binding, CPU binding, file injection, memory reservation, memory macro page parameter setting → setting VLAN → verifying virtual machine control → verifying whether each setting is effective → CPU expansion, memory expansion, disk expansion → verifying expansion → deleting the virtual machine → restoring the environment.
At step 304, an execution command for the test case is initiated.
And initiating an execution command of the test case to the test tool framework according to the flow specified by the scene test template.
At step 305, a test tool is instantiated.
The test tool framework receives the execution instruction of the test case, and instantiates a corresponding test tool through the test tool scheduler.
At step 306, the test case is executed.
The test tool executes the test cases, such as the input parameters of the incoming test cases.
In step 307, a test result of a test case is returned.
And returning the test result of one test case after the execution of the test case is finished.
At step 308, the next test is initiated.
And the arrangement engine executes the next test case according to the test result.
At step 309, the final test results are returned.
And integrating and outputting a final test result by the arranging engine until all the test cases appointed in the scene template are executed.
Fig. 4 illustrates a schematic diagram of a network function virtualization, NFV, testing apparatus, according to some example embodiments of the present disclosure.
As shown in fig. 4, the network function virtualization NFV testing apparatus 400 includes a selection scenario template module 401, an orchestration module 402, and an execution module 403.
And the selection scenario template module 401 is configured to determine a test scenario template according to the NFV test task and fill the test scenario template.
And the arranging module 402 is configured to arrange the execution sequence of each test case in the test scenario template according to the filled test scenario template.
The execution module 403 is configured to execute each test case according to the execution sequence to test the test object corresponding to the NFV test task until all test cases specified in the scene template are executed, and output the test result.
Fig. 5 illustrates a schematic diagram of a network function virtualization, NFV, testing apparatus, according to some example embodiments of the present disclosure.
As shown in fig. 5, the network function virtualization NFV test apparatus 500 of this embodiment includes: a memory 501 and a processor 502 coupled to the memory 501, the processor 502 being configured to execute the network function virtualization, NFV, test method in any of the foregoing embodiments based on instructions stored in the memory 501.
The memory 501 may include, for example, a system memory, a fixed nonvolatile storage medium, and the like. The system memory stores, for example, an operating system, an application program, a Boot Loader (Boot Loader), and other programs.
The apparatus 500 may also include an input-output interface 503, a network interface 504, a storage interface 505, and the like. These interfaces 503, 504, 505 and the connection between the memory 501 and the processor 502 may be, for example, via a bus 506. The input/output interface 503 provides a connection interface for input/output devices such as a display, a mouse, a keyboard, and a touch screen. The network interface 504 provides a connection interface for various networking devices. The storage interface 505 provides a connection interface for external storage devices such as an SD card and a usb disk.
Fig. 6 illustrates an architectural schematic of a network function virtualization, NFV, test system, according to some exemplary embodiments of the present disclosure.
As shown in fig. 6, the network function virtualization NFV Test System includes a unified management interface 601, a presentation layer state transition application program interface (REST API)602, a network function virtualization NFV Test device 603, a Test Tool application program interface (Test Tool API)604, a Test Tool set and framework 605, an Open application program interface (Open API)606, a System Under Test (SUT) 607, and Test-supported hardware 608.
The network function virtualization NFV test apparatus 603 may be, for example, the network function virtualization NFV test apparatus described in fig. 4 or fig. 5.
For example, in some specific embodiments, the network function virtualization NFV test system may further include a unified management interface 601 configured to input test tasks and output test results, for example.
For example, in some particular embodiments, the scenario testing orchestration 603 may implement scenario-oriented testing orchestration, including test case management 6031, test scenario template management 6032, template parsing 6033, orchestration engine 6034, and so on. A test case management module 6031 for providing management of closed and parameterized test cases, and a basic unit for test arrangement during test cases; the test scene template management 6032 is responsible for adding, deleting, modifying and checking the test scene templates; a template parsing 6033 responsible for parsing the template when performing the scene test; orchestration engine 6034 is responsible for orchestrating test cases according to scenario templates.
For example, in some embodiments, the set of test tools and framework 605 may be configured to execute test cases in response to a call by the network function virtualization NFV test device. In particular, in some embodiments, the test tool collection and framework enables the integration and scheduling of test tools, including a test tool scheduler 6053 and various test tools, including, for example, open source test tools 6051, commercial test tools 6052, and other test tools. The test tool is mainly responsible for executing test cases and outputting test results; the test tool scheduler 6054 schedules the corresponding test tool to execute the test case according to the upper layer instruction.
For example, in some specific embodiments, the Test object (System Under Test, also referred to as a tested System) 607 may include, for example, an instance of Network Function Virtualization Infrastructure (NFVI) 6071, Virtualization Infrastructure Manager (VIM) 6072, Network Function Virtualization (NFV) 6073, Virtual Network Function Manager (VNFM) 6074, Network Element Management System (EMS) 6075, Network function Virtualization editor (NFVO) 76, and so on.
For example, in some embodiments, the network function virtualization NFV test system further includes standard northbound application program interfaces of the objects under test, exposed application program interfaces of the test tool framework, which are used to shield the variability between heterogeneous products.
As will be appreciated by one skilled in the art, embodiments of the present disclosure may be provided as a method, system, or computer program product. Accordingly, the present disclosure may take the form of an entirely hardware embodiment, an entirely software embodiment or an embodiment combining software and hardware aspects. Furthermore, the present disclosure may take the form of a computer program product embodied on one or more computer-usable non-transitory storage media (including, but not limited to, disk storage, CD-ROM, optical storage, and the like) having computer-usable program code embodied therein.
The present disclosure is described with reference to flowchart illustrations and/or block diagrams of methods, apparatus (systems), and computer program products according to embodiments of the disclosure. It will be understood that each flow and/or block of the flow diagrams and/or block diagrams, and combinations of flows and/or blocks in the flow diagrams and/or block diagrams, can be implemented by computer program instructions. These computer program instructions may be provided to a processor of a general purpose computer, special purpose computer, embedded processor, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, create means for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be stored in a computer-readable memory that can direct a computer or other programmable data processing apparatus to function in a particular manner, such that the instructions stored in the computer-readable memory produce an article of manufacture including instruction means which implement the function specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be loaded onto a computer or other programmable data processing apparatus to cause a series of operational steps to be performed on the computer or other programmable apparatus to produce a computer implemented process such that the instructions which execute on the computer or other programmable apparatus provide steps for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
The above description is only exemplary of the present disclosure and is not intended to limit the present disclosure, so that any modification, equivalent replacement, or improvement made within the spirit and principle of the present disclosure should be included in the scope of the present disclosure.
Claims (16)
1. A Network Function Virtualization (NFV) testing method is characterized by comprising the following steps:
determining a test scene template according to the NFV test task, and filling the test scene template;
arranging the execution sequence of each test case in the test scene template according to the filled test scene template;
and executing the test cases according to the execution sequence to test the test objects corresponding to the NFV test task until all the test cases specified in the scene template are executed, and outputting test results.
2. The method according to claim 1, wherein the determining a test scenario template according to the NFV test task includes:
and selecting a test scene template corresponding to the NFV test task from a test scene template library, or generating a corresponding test scene template according to the NFV test task and adding the test scene template to the test scene template library.
3. The method according to claim 2, wherein the generating a corresponding test scenario template according to the NFV test task includes:
determining a test case and related test parameters according to the NFV test task;
and generating a test scene template according to the determined test case and the related test parameters.
4. The method according to claim 3, wherein the relevant test parameters include parameters of a test case and parameters of a test scenario.
5. The method according to claim 4, wherein the parameters of the test case include one or more of a type of the test case, a test tool, and a test category.
6. The method according to claim 4, wherein the parameters of the test scenario include one or more of input and output of each test case, execution flow of each test case, test object, and execution times of each test case.
7. The method according to claim 4, wherein the populating the test scenario template includes:
filling the parameter values of the test cases corresponding to the test tasks into the parameters of the test cases;
and filling the parameter values of the test scenes corresponding to the test tasks into the parameters of the test scenes.
8. The method according to claim 3, wherein the generating a corresponding test scenario template according to the NFV test task further comprises:
and binding the test case and the test tool required by the test case.
9. The method according to claim 1, wherein the arranging, according to the filled test scenario template, an execution sequence of each test case in the test scenario template comprises:
analyzing the test scene template to form a flow file for recording the execution sequence of each test case in the test scene template;
and automatically arranging the execution sequence of each test case in the test scene template according to the flow file.
10. The method for testing Network Function Virtualization (NFV) of claim 1, wherein the executing of each test case comprises:
instantiating a test tool corresponding to the test case;
and executing the test case by utilizing the test tool.
11. The method according to claim 1, wherein the test object includes one or more of a network function virtualization infrastructure NFVI, a virtualization infrastructure manager VIM, a network function virtualization NFV, a virtual network function manager VNFM, an element management system EMS, and a network function virtualization orchestrator NFVO instance.
12. A Network Function Virtualization (NFV) testing device is characterized by comprising:
the selection scene template module is configured to determine a test scene template according to the NFV test task and fill the test scene template;
the arranging module is configured to arrange the execution sequence of each test case in the test scene template according to the filled test scene template;
and the execution module is configured to execute the test cases according to the execution sequence so as to test the test objects corresponding to the NFV test task until all the test cases specified in the scene template are executed, and output a test result.
13. A Network Function Virtualization (NFV) testing device is characterized by comprising:
a memory; and
a processor coupled to the memory, the processor configured to execute the network function virtualization, NFV, testing method of any of claims 1-11 based on instructions stored in the memory.
14. A network function virtualization, NFV, test system, comprising:
the network function virtualization, NFV, test apparatus of claim 12 or 13;
the test tool set is configured to respond to the call of the network function virtualization NFV test device to execute a test case;
and
an interface for connecting the network function virtualization, NFV, test device with the set of test tools.
15. The Network Function Virtualization (NFV) testing system of claim 14, further comprising a user management interface configured to input test tasks and output test results.
16. A non-transitory computer readable storage medium having stored thereon a computer program which, when executed by a processor, implements the network function virtualization, NFV, testing method of any of claims 1-11.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201911354215.2A CN113037582A (en) | 2019-12-25 | 2019-12-25 | Network Function Virtualization (NFV) test method, device and system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201911354215.2A CN113037582A (en) | 2019-12-25 | 2019-12-25 | Network Function Virtualization (NFV) test method, device and system |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN113037582A true CN113037582A (en) | 2021-06-25 |
Family
ID=76452455
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201911354215.2A Pending CN113037582A (en) | 2019-12-25 | 2019-12-25 | Network Function Virtualization (NFV) test method, device and system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN113037582A (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113259142A (en) * | 2021-07-07 | 2021-08-13 | 飞腾信息技术有限公司 | Multicast performance optimization method, system, device and storage medium in virtual machine |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107220171A (en) * | 2016-03-22 | 2017-09-29 | 阿里巴巴集团控股有限公司 | The method of testing and device of a kind of virtual machine |
| CN107273286A (en) * | 2017-06-02 | 2017-10-20 | 携程计算机技术（上海）有限公司 | For the scene automatic test platform and method of task application |
| CN107729251A (en) * | 2017-10-23 | 2018-02-23 | 中国联合网络通信集团有限公司 | Testing case management and device |
| CN107948006A (en) * | 2018-01-09 | 2018-04-20 | 重庆邮电大学 | A kind of method of combination and device for virtualizing network function |
| US20180121335A1 (en) * | 2016-10-27 | 2018-05-03 | International Business Machines Corporation | Testing a virtual network function by a virtual network tester |
| CN110442513A (en) * | 2019-07-08 | 2019-11-12 | 深圳壹账通智能科技有限公司 | Execution method, apparatus, computer equipment and the storage medium of functional test use-case |
-
2019
- 2019-12-25 CN CN201911354215.2A patent/CN113037582A/en active Pending
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107220171A (en) * | 2016-03-22 | 2017-09-29 | 阿里巴巴集团控股有限公司 | The method of testing and device of a kind of virtual machine |
| US20180121335A1 (en) * | 2016-10-27 | 2018-05-03 | International Business Machines Corporation | Testing a virtual network function by a virtual network tester |
| CN107273286A (en) * | 2017-06-02 | 2017-10-20 | 携程计算机技术（上海）有限公司 | For the scene automatic test platform and method of task application |
| CN107729251A (en) * | 2017-10-23 | 2018-02-23 | 中国联合网络通信集团有限公司 | Testing case management and device |
| CN107948006A (en) * | 2018-01-09 | 2018-04-20 | 重庆邮电大学 | A kind of method of combination and device for virtualizing network function |
| CN110442513A (en) * | 2019-07-08 | 2019-11-12 | 深圳壹账通智能科技有限公司 | Execution method, apparatus, computer equipment and the storage medium of functional test use-case |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113259142A (en) * | 2021-07-07 | 2021-08-13 | 飞腾信息技术有限公司 | Multicast performance optimization method, system, device and storage medium in virtual machine |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN110795219B (en) | Resource scheduling method and system suitable for multiple computing frameworks | |
| CN107533480B (en) | Server selection device, server selection method, and recording medium | |
| CN109302522B (en) | Test method, test device, computer system, and computer medium | |
| CN107733985B (en) | Method and device for deploying functional components of cloud computing system | |
| WO2018036342A1 (en) | Csar-based template design visualization method and device | |
| JP6045134B2 (en) | Parallel workload simulation for application performance testing | |
| US20210397418A1 (en) | Utilizing natural language understanding and machine learning to generate an application | |
| US10387605B2 (en) | System and method for managing and composing verification engines | |
| CN108429787B (en) | Container deployment method and device, computer storage medium and terminal | |
| US20150370583A1 (en) | System and method for simulating virtual machine (vm) placement in virtual datacenters | |
| CN109739762A (en) | A kind of performance test methods and device of application program | |
| CN110362490B (en) | Automatic testing method and system for integrating iOS and Android mobile applications | |
| US10146674B2 (en) | Plugin-based software verification system | |
| KR101751515B1 (en) | Apparatus, method, and computer program for testing | |
| CN114818565A (en) | Simulation environment management platform, method, equipment and medium based on python | |
| CN112639734A (en) | Simulation task scheduling method, execution method, simulation implementation method and device | |
| EP4293498A1 (en) | Application modification method, and system, cluster, medium and program product | |
| CN113448678A (en) | Application information generation method, deployment method, device, system and storage medium | |
| CN113037582A (en) | Network Function Virtualization (NFV) test method, device and system | |
| EP4152715A1 (en) | Method and apparatus for determining resource configuration of cloud service system | |
| CN117370203A (en) | Automatic test method, system, electronic equipment and storage medium | |
| CN112199273A (en) | Virtual machine pressure/performance testing method and system | |
| CN112241373A (en) | Automatic test method, test device, processor and test system | |
| KR20150128711A (en) | Method and system for analyzing a trace timeline of computer system activity | |
| CN115237441A (en) | Upgrade test method, device and medium based on cloud platform |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20210625 |
|
| RJ01 | Rejection of invention patent application after publication |