KR20170127288A - Apparatus and method for suitability test of virtual network function - Google Patents

Abstract

The present invention provides a suitability verification device and an evaluation method thereof, which can define a systematic test procedure for various virtual network functions (VNFs) and satisfy requirements of a network operation. The suitability verification device of a VNF according to the present invention comprises: a network function receiving part receiving at least one VNF and virtual network function description; a test path determination part extracting a test item based on the virtual network function description, and designating a detailed check list with respect to the extracted test item to set a test path; and a network test performing part testing the performance of the at least one VNF based on the determined test path.

Description

[0001] APPARATUS AND METHOD FOR SUITABILITY TEST OF VIRTUAL NETWORK FUNCTION [0002]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to verification of conformity of a network, and more particularly, to a technology for verifying conformance to a Virtual Network Function (VNF).

Network Function Virtualization (NFV) is a technology that provides a new network production environment for providing low-cost, high-efficiency, and fast service based on virtualization technology. Currently, many researches on network functionalization are actively conducted. However, in order to realize Network Function Virtualization (NFV), it is required that the virtual network should have performance comparable to the performance of the physical network equipment in order to flexibly replace the functions of the existing physical network equipment, .

In order to apply virtualization technology to a real network, it is necessary to guarantee a certain degree of predictable performance compared to the existing hardware-based network system. To this end, research is underway to replace real physical network equipment through network functionalization in various fields. Network functions Virtual network devices developed through virtualization include various technologies, and the configuration of the system (hypervisor) that accommodates them varies depending on the virtualization method. Since the virtual network device (VNF) includes various technologies and functions, a systematic test procedure and a test apparatus for the virtual network device are required.

Korean Patent Publication No. 10-2006-0025033

A problem to be solved by the present invention is to define a systematic test procedure for various virtual network devices (VNFs), and to provide a conformance verification apparatus and an evaluation method capable of meeting requirements for network operation.

The apparatus for verifying conformance of a virtual network apparatus according to the present invention includes a network function receiving unit for receiving at least one virtual network function and a virtual network function description, And a network test execution unit for testing the performance of the one or more virtual network devices based on the determined test path and a test path determining unit for setting a test path by designating a detailed check list of the extracted test items.

The network function receiving unit performs validation based on the received virtual network device and the virtual network device specification. The network function receiver may inquire the test history based on the received virtual network device data and the virtual network device specification to determine whether there is a test report for the same virtual network device and omit the test path setting process.

The test path decision unit can set priorities for a number of extracted test items based on the received test specification or add new test items. The network test execution unit determines whether or not parallelization is possible for two or more test items included in the test path, and performs a network test on the test items in a parallel manner or a serial manner according to the determination result. In addition, the network test execution part can determine the test sequence of a plurality of test items considering test efficiency.

The apparatus for verifying conformance of a virtual network apparatus according to the present invention further includes a test result deriving unit for determining whether the test result of the virtual network apparatus has passed or not based on the test specification and generating a test report . The test result derivation unit searches the test history of the virtual network device that is the same as the virtual network device that has been tested, and compares the generated test report with the pre-stored test report to generate a test report. And the test result deriving unit stores the test report generated through the provided storage device.

A method for evaluating conformance of a virtual network device according to the present invention includes: receiving at least one virtual network function and a virtual network function description; extracting a test item based on the virtual network device specification; Setting a test path by specifying a detailed checklist of the extracted test items, and testing the performance of the one or more virtual network devices based on the determined test path, Determining whether to pass the test report, and comparing the test report with the previously stored test report to generate a test report.

Through the conformance verification apparatus and evaluation method of the virtual network apparatus according to the present invention, the developers can perform overall verification of the developed virtual network apparatus (VNF) and reduce the time required for verification of various functions. In addition, through the present invention, it is possible to obtain an objective indicator for the virtual network device, and to evaluate the applicability of the system.

1 is a configuration diagram of a conformance verification apparatus 100 of a virtual network apparatus according to an embodiment of the present invention.
2 is a diagram illustrating an operational configuration of a network function receiving unit 120 of an apparatus for verifying conformance of a virtual network apparatus 100 according to an embodiment of the present invention.
FIG. 3A is a diagram illustrating an operational configuration of a test path determination unit 120 of an apparatus for verifying conformance of a virtual network apparatus 100 according to an embodiment of the present invention.
FIG. 3B is a diagram illustrating an exemplary configuration of a test path of the test path determining unit 120 of the apparatus 100 for verifying conformance of a virtual network apparatus according to an exemplary embodiment of the present invention.
4 is a diagram illustrating an operational configuration of a network test execution unit 130 of an apparatus for verifying conformance of a virtual network apparatus 100 according to an embodiment of the present invention.
5 is a diagram showing an operational configuration of a test result deriving unit 140 of an apparatus for verifying conformance of a virtual network apparatus 100 according to an embodiment of the present invention.
6 is a flowchart illustrating a fitness evaluation method of a virtual network device according to an embodiment of the present invention.
FIG. 7 is a flowchart of a new test path setting method of a fitness evaluation method for a virtual network apparatus according to an embodiment of the present invention.

Hereinafter, embodiments of the present invention will be described in detail with reference to the accompanying drawings. The terms and words used in the present specification are selected in consideration of the functions in the embodiments, and the meaning of the terms may vary depending on the intention or custom of the invention. Therefore, the terms used in the following embodiments are defined according to their definitions when they are specifically defined in this specification, and unless otherwise specified, they should be construed in a sense generally recognized by those skilled in the art.

1 is a configuration diagram of a conformance verification apparatus 100 of a virtual network apparatus according to an embodiment of the present invention.

1, the apparatus for verifying conformance of a virtual network apparatus 100 according to an exemplary embodiment of the present invention includes a network function receiving unit 110, a test path determining unit 120, a network test performing unit 130, And a derivation unit 140.

The network function receiving unit 110 receives a virtual network function (VNF) data and a virtual network function description (VNFd). The network function receiving unit 110 may further receive data on a test description (Test Description, TESTd). The three types of data can be defined as input elements of the test.

The virtual network device (VNF) data is data representing one or more virtual network devices actually developed. The data of the virtual network device may be provided in the form of a virtual network device image including the binary file of the actual virtual network device. However, the data format of the virtual network device may vary depending on the platform. Hereinafter, the virtual network device data is used to include the image form of the virtual network device.

The virtual network device specification VNFd includes information about the corresponding virtual network device VNF, in particular, information useful for network testing of the virtual network device. The virtual network device specification VNFd includes information on an identifier (ID) of the virtual network device specification VNFd, a vendor of the virtual network device, and a program version of the virtual network device VNF. The network function receiving unit 110 performs validation based on the information of the virtual network device specification VNFd.

The test specification (TESTd) is an optional entry that describes the acceptance criteria of the test for the network function or the test to be performed. For example, even if the same network function is tested, the level required for the test may vary depending on the environment in which the test is performed. Therefore, the present invention can variably apply the test request level through the test specification.

The test specification (TESTd) may include basic information such as an identifier for the test specification (TESTd), information of the person who requested the execution of the test (Executor), and information about the version of the test specification (TESTd). The network function receiving unit 110 can manage the test history by managing identifiers and versions through the basic information of the test specification (TESTd).

The network function receiving unit 110 performs validation based on the received input elements VNF, VNFd, and TESTd. The network function receiving unit 110 inquires of the test history on the basis of the received virtual network device data (image), the virtual network device specification VNFd and / or the test specification TESTd, It is determined whether or not a test history exists.

When it is determined that the received virtual network device data (image) is a virtualization type that does not support the conformity assessment in the conformance verification apparatus 100 of the virtual network apparatus or is not normal virtual network device data, the network function receiving unit 110 determines that the invalid And outputs a report to the user and provides the report to the user. The network function receiving unit 110 may not perform unnecessary tests when there is no change compared to the existing test history, that is, when there is no modification to the virtual network device data, the virtual network device specification, and the test specification.

The network function receiving unit 110 compares the received input element with the test report included in the existing test history, and if it is determined that there is no need to newly set up the test route, the network function receiving unit 110 performs a network test (130).

On the other hand, when it is determined that the test path needs to be newly set by comparing the received input element with the existing test history, the network function receiving unit 110 transmits the input elements VNF, VNFd, and TESTd to the test path determining unit 120 . For example, the network function receiving unit 110 receives the input of the virtual network device to set a new test path if the received virtual network device does not have a previous test history or the contents of the virtual network device specification and / or the test specification are different from the previous test history And transmits the element to the test path determination unit 120.

The test path determining unit 120 sets the test path based on the input element received from the network function receiving unit 110. [ In particular, the test path determining unit 120 can set the test path based on the virtual network device specification and / or the test specification. The test path determining unit 120 sets and determines a test path by extracting one or more test items from the virtual network device specification and / or the test specification, and setting a check list for each of the extracted test items.

The network test performing unit 130 performs a performance test on one or more virtual network devices based on the test path calculated by the test path determining unit 120. The network test execution unit 130 distinguishes between a test function for processing parallelism and a test function for serialization by checking whether parallelization is possible for a plurality of test functions.

The network test execution unit 130 merges the test results after the network tests are all performed on the respective test functions 370, and transmits the merged results to the test result deriving unit 140. The test result of the network test performing unit 130 includes the result value (numerical value) for each test function.

The test result deriving unit 140 analyzes the virtual network function test result received from the network test performing unit 130 and derives the analysis result. The test result deriving unit 140 analyzes the test result and the test specification through the parallelization 510 to determine whether the test is a pass or a failure. When the analysis of all the test results is completed, the test result deriving unit 140 confirms whether there is a test history for the same virtual network device as the virtual network device that has performed the present test, The test history and the comparative analysis results are provided in the test report.

The network function receiving unit 110, the test route determining unit 120, the network test performing unit 130, and the test result deriving unit 140 will be described later with reference to FIGS. 2 to 5.

2 is a diagram illustrating an operational configuration of a network function receiving unit 120 of an apparatus for verifying conformance of a virtual network apparatus 100 according to an embodiment of the present invention.

1 and 2, the network function receiving unit 110 receives virtual network device (VNF) data and a virtual network device specification VNFd. The network function receiving unit 110 may further receive data on the test specification TESTd.

The virtual network device specification VNFd includes information on the corresponding virtual network device VNF, in particular, information useful for network testing of the virtual network device. Table 1 shows an example of the configuration of the virtual network device specification VNFd.

An example of the configuration of a virtual network device specification Identifier Description ID ID of VNFd vender The vendor generating this VNFd version Version of VNF, VNFd Feature list Provided functions by VNF Virtualized_resource_requirement Describe the required computation, storage, networking resources characteristics Hypervisor parameter Hypervisor type, version, etc ... ETC

The virtual network device specification VNFd includes information on an identifier (ID) of the virtual network device specification VNFd, a vendor of the virtual network device, and a program version of the virtual network device VNF. The network function receiving unit 110 performs validation based on the information of the virtual network device specification VNFd.

The virtual network device specification VNFd includes a list of functions provided by the virtual network device VNF and a profile of the corresponding virtual network function. As an example, when the virtual network device is a router, the virtual network device specification VNFd includes a list of functions provided by the router and a profile thereof. That is, it includes information on the routing protocol list provided by the router virtual network device, the number of routing tables that can be supported, and the packet throughput per second, and the like.

In addition, the virtual network device specification VNFd may include information about a resource amount required for driving the virtual network device VNF. For example, the virtual network device specification VNFd may include information on the number of virtual CPU cores required by the virtual network device VNF, the memory capacity, the number of virtual network interface cards, and the like.

In addition, the virtual network device specification VNFd includes information about virtualization of the corresponding virtual network device VNF. The virtual network device specification VNFd may include information on the hypervisor type and version and the like as an example of information on virtualization of the corresponding virtual network device VNF. The network test execution unit 130 may organically provide a system environment for performing a test based on information on the hypervisor type and version included in the virtual network device specification VNFd.

The test specification (TESTd) is an optional entry that can contain basic information such as an identifier for the test specification (TESTd), information about the person requesting the performance of the test (Executor) and information about the version of the test specification (TESTd) have. The network function receiving unit 110 can manage the test history by managing identifiers and versions through the basic information of the test specification (TESTd). The user (test implementer) may further describe the test required for the test specification (TESTd).

Then, the user can specify the amount of virtual resources to be allocated through the test specification (TESTd). Since the amount of available resources and the required virtual network function may be different depending on the user, the network function receiving unit 110 supports the user to create a test specification directly. In addition, the test passing standard for each test can be specified through the test specification (TESTd). In addition, the user can directly participate in the network test items through the test specification. Table 2 shows an example of the test specification.

Example of Test Specification Identifier Description ID ID of TESTd executor The person for doing this Test version Version of TESTd Required Test list Required Test for VNF Virtualized_resources_allocation Describe the allocated computation, storage, and networking resources characteristics Pass criterion Requirement for test result to get "pass" ETC

FIG. 3A is a diagram illustrating an operational configuration of a test path determination unit 120 of an apparatus for verifying conformance of a virtual network apparatus 100 according to an embodiment of the present invention.

Referring to FIG. 3A, the test path determining unit 120 of the virtual network device 100 determines a test path based on an input element received from the network function receiving unit 110 according to an exemplary embodiment of the present invention. The test path determining unit 120 classifies received input elements into virtual network device data, virtual network device specifications, and test specifications. The test route determining unit 120 may set the test route based on the virtual network device specification VNFd or based on the virtual network device specification VNFd and the test specification TESTd. The received virtual network device data is not used directly in the test path setting process and is not used directly at the end of the operation configuration of the test path determining unit 120 so that the network test performing unit 130 may use the network test Lt; RTI ID = 0.0 > 305 < / RTI >

The virtual network device specification and the test specification include information necessary for setting the test path in the test path determining section 120. [ The test path determination unit 120 classifies and extracts test items 310, 320, 330, and 340 related to each element based on one or more elements described in the virtual network device specification, and based on the extracted test items, A detailed checklist (311, 312, 313, 314) for the network test is specified to map the test items and test items. Each checklist includes one or more test functions. That is, the test path determination unit 120 sets and determines the test path by extracting one or more test items from the virtual network device specification and / or the test specification, and setting a check list for each of the extracted test items.

The test path determination unit 120 confirms the type of virtualization 310 of the virtual network device through the virtual network device specification. Based on the virtualization scheme 310, which is one of the elements described in the virtual network device specification, the test path determination unit 120 can list up one or more test functions 311 that are directly related. In addition, the test path determination unit 120 may select and extract a check list related to the test functions.

For example, if the virtualization of a virtual network device is a Kernel-based Virtual Machine (KVM), the actual testing should be performed on a KVM-based system. Therefore, the test path determination unit 120 constructs a KVM system to perform a compatibility test on the KVM, extracts a check list such as whether the target platform supports the KVM-based virtualization method, can do. With this principle, the elements specified in one virtual network device specification (VNFd) can be an important factor in selecting a check list of a plurality of network tests, and conversely, one test function can be performed by a plurality of elements of a virtual network specification It can be affected.

The apparatus for verifying conformance of a virtual network apparatus 100 according to the present invention can perform a network test on all check lists of test items extracted by the test path determination unit 120. [ However, the conformance verification apparatus 100 of the virtual network apparatus according to the present invention does not necessarily have to perform the network test on all of the test items or check list of the test items.

The test path determination unit 120 can select one or more test items from among the extracted test items using the test specification as needed. For example, one virtual network device can be given priority among a plurality of test items in consideration of the time required for the test. The network test execution unit 130 performs the network test according to the priority of the test items. For the test items having a relatively low priority, the network test may be omitted or delayed at a later time. Thus, the user can manipulate the test items by directly participating in the test items through the test specification.

In addition, the test path determination unit 120 can add a new test item to the extracted test item using the test specification. In using one virtual network device, the requirements may vary depending on the situation in which the virtual network device is utilized or the target system to which it is applied. For example, if the virtual network device is NAT (National Address Translation), the test items may be classified according to the number of addresses that can support translation. (Checklist) of the test items can be adjusted according to the test results. Thus, the present invention can perform a test on a virtual network device in a customized manner.

That is, the test path determination unit 120 extracts test items from the received virtual network specification to confirm the passing test criteria of the basic test, and upwards / downwards or adds / subtracts test standards according to a user's intention through the received test specification, Can be deleted.

Also, in order to quickly perform the overall test procedure, it is possible to parallelly perform a test path determination process according to the elements of the virtual network device specification, and then merge the test path to output the test path. That is, the test path determination unit 120 sets detailed check lists 311, 321, 331, and 341 for the plurality of test items 310, 320, 330, and 340 shown in FIG. And the adjustment process can be simultaneously performed in parallel.

3B is a diagram illustrating an exemplary configuration of a test path of the test path determining unit 120 of the apparatus 100 for verifying conformance of a virtual network apparatus according to an embodiment of the present invention.

Referring to FIGS. 3A and 3B, FIG. 3B is an example of the configuration of the test path determined by the test path determining unit 120. FIG. The test path determining unit 120 performs a step of mapping the check list of the determined test path with the test function. The test function represents a function for testing performance in a virtual network device. One example of the test path shown in Figure 3B includes various kinds of test functions 370. [ As an example, the test function 370 may include a resource allocation test, an installation test, a compatibility test, a functional test, a destructive test, a performance test, Testing, Usability Testing and Security Testing.

The test path determination unit 120 extracts a check list to be verified in the test execution process according to the elements of the virtual network device specification as described above. For example, when extracting performance-related checklists, you need to make a difference for each virtual network device because the factors that measure performance depend on the network function. In addition, the test path determination unit 120 may add performance measurement elements that are not included in the virtual network device specification in consideration of the experimental specification.

The checklist extracted for all network tests can be categorized according to the type of testing. The network test has a number of test functions, and checklists can be classified according to the test function they have. In an example of FIG. 3B, checklists # 1, # 3, # 4, # 8 and # 9 are mapped to a resource allocation test, Test # 1 (Test Function) 1, # 2, # 3, and # 4 of the list for Test # 1.

In this way, the network test execution unit 130 can perform the test on the network function independently of each other in the process of performing the optimization for the entire test through the classification process according to the test. Having a separate checklist for each test on the network function allows each test to be performed in parallel, which in turn can reduce the time required for testing. As a result, a checklist for each network test can be selected.

In addition, the test path determination unit 120 may add a check list that is not provided basically through the test specification. A newly added set of one or more checklists can be defined as a new test function. In this way, the user can directly define the desired test items through the test specification.

4 is a diagram illustrating an operational configuration of a network test execution unit 130 of an apparatus for verifying conformance of a virtual network apparatus 100 according to an embodiment of the present invention.

Referring to FIG. 4, the network test execution unit 130 performs a performance test on one or more virtual network devices based on the test path set by the test path determining unit 120. The test path set in the test path determination unit 120 may include a check list for two or more test functions 370. [ The network test execution unit 130 performs a process of checking whether or not parallelization is possible for two or more test functions 370. [ The network test execution unit 130 can simplify the network test procedure by parallelizing the test function.

For example, if the test function # 1 (Test # 1) and the test function # 3 (Test # 3) can be parallelized, the network test execution unit 130 outputs the test function # 1 (Test # 3 (Test # 3) are classified into a parallel form, and a network test is performed in a parallel manner (410). On the other hand, if parallelization is not possible, the network test execution unit 130 classifies the data into a serialized form and performs a network test using the serial method 420.

When the network test is performed in the serialized form, the network test execution unit 130 can determine the test sequence considering the test efficiency for the test function 421 classified in the serialized form, and schedule the test sequence. The network test execution unit 130 displays status information on each test execution based on the scheduling result of the test repair while the actual network test is performed, and the status information may include the network test execution completion time.

The network test execution unit 130 merges the test results after the network tests are all performed on the respective test functions 370, and transmits the merged results to the test result deriving unit 140. The test result of the network test performing unit 130 includes the result value (numerical value) for each test function. For example, when the network performance test is performed in the network test execution unit 130 and the packet per second is measured to be 10,000,000 pps, the network test execution unit 130 calculates the packet throughput And outputs the corresponding value to the item as the result value. Table 3 shows an example of the test results.

An example of the test results of the network test execution department Identifier Checklist Result Performance
Test # 1 Packet per second 10 Mpps Check list # 2 Value Check list # 3 Value Check list # 4 Value Test # 2 Check list # 1 Value Check list # 2 Value Check list # 3 Value ETC

5 is a diagram showing an operational configuration of a test result deriving unit 140 of an apparatus for verifying conformance of a virtual network apparatus 100 according to an embodiment of the present invention.

Referring to FIG. 5, the test result derivation unit 140 of the conformance verification apparatus 100 of the virtual network apparatus according to an embodiment of the present invention analyzes the virtual network function test result received from the network test execution unit 130 do. The test result deriving unit 140 analyzes the result of each test in the received test results (result for Test # 1 to n) to derive the analysis result.

The test result deriving unit 140 performs parallelization (510) on the received test results to analyze multiple test results at the same time. Then, the test result deriving unit 140 analyzes the test result and the test specification through the parallelization (510), and judges whether or not each test item is a pass or fail. The test result deriving unit 140 can determine whether the test items are passed or failed according to the criteria included in the test specification. In addition, the test result derivation unit 140 can use the previously stored default test specification (TESTd) as a judgment criterion without using the test specification.

When analysis of all the test results is completed, the test result derivation unit 140 searches for a test history for the same virtual network device as the virtual network device that has performed the current test. The test result deriving unit 140 may provide the test report 520 with a test history for the similar or the same virtual network device in order to provide comparison and reference data in order to perform verification for a specific virtual network device . The test result deriving unit 140 may compare the test result of the similar or the same virtual network device with the test result of the corresponding virtual network device and include it in the test report 520. The user can easily grasp whether the performance of the virtual network device under test has been improved or the like through comparative analysis with similar or identical virtual network devices. Through the test report 520 provided in the test result derivation unit 140, the virtual network device developer, the platform administrator, and the virtual network device user can obtain detailed results of the network test performed on the virtual network device.

The test result deriving unit 140 stores (530) the test report 520 through a storage device provided therein. The test report 520 may include test results, analysis results, and comparison results of the virtual network device. The test results and test reports accumulated and accumulated in the test result deriving unit 140 can be used again in the network function receiving unit 110 and the test path determining unit 120 when performing a network test for a virtual network device in the future have.

Table 4 shows an example of the test report generated in the test result deriving unit 140. [ The test report generated by the test result deriving unit 140 may include not only the test results, but also analysis and judgment results based on the test results. In addition, test reports can include additional forms of analysis to increase visibility.

Example of Test Report Identifier Checklist Result criterion Pass / Fail Performance
Test # 1 Packet per second 10 Mpps 5Mpps Pass Check list # 2 Value Pass Check list # 3 Value Fail Check list # 4 Value Pass Test # 2 Check list # 1 Value Pass Check list # 2 Value Pass Check list # 3 Value Pass ETC

6 is a flowchart illustrating a fitness evaluation method of a virtual network device according to an embodiment of the present invention.

1 and 6, a method of evaluating conformance of a virtual network apparatus according to the present invention includes: first, a conformance verification apparatus 100 (hereinafter referred to as a conformance verification apparatus) of a virtual network apparatus receives virtual network apparatus (VNF) data, (VNFd) and the test specification (TESTd) (S601). Here, the test specification is not necessarily received information, but may be selectively received. The virtual network device data, the virtual network device specification and the test specification are the same as those of FIGS. 1 to 5.

The conformance verification apparatus 100 performs validation based on the received input elements VNF, VNFd, and TESTd (S602). When the conformance verification apparatus 100 determines that the received virtual network device data (image) is a virtualization type that is not supported or is not normal virtual network device data, it determines that the validity is not valid and outputs a report to the user .

The conformance verification apparatus 100 inquires the test history on the basis of the received virtual network device data, the virtual network device specification VNFd and / or the test specification TESTd (S603). The conformance verification apparatus 100 inquires a plurality of pre-stored test reports to determine whether there is a network test history for a virtual network apparatus that is the same as or similar to the test target virtual network apparatus (S604). If there is no test history for the virtual network device which is the same as or similar to the target virtual network, the conformance verification apparatus 100 sets a new test path (S605). The procedure for setting a new test path will be described in detail in FIG. 7 which will be described later. If there is an identical or similar test history, the conformance testing apparatus 100 does not set a new test path, but recycles the test path included in the conventional test report.

Next, the conformance verification apparatus 100 performs a network test according to the set test path (new test path or stored test path) (S606). The conformance verification apparatus 100 distinguishes between a test function for processing parallelism and a test function for serialization by checking whether parallelization is possible for a plurality of test functions. And the conformance testing apparatus 100 merges the test results after all the network tests have been performed for each test function. The concrete network test procedure refers to the above-described FIG. 4 and the description thereunder.

Then, the conformance testing apparatus 100 analyzes the virtual network function test result and derives the analysis result (S607). The conformance verification apparatus 100 analyzes the test result and the test specification through parallelization, and judges whether each test item is passed or failed. The conformance verification apparatus 100 determines whether or not the test results are passed, checks whether there is a test history for the same virtual network apparatus as the virtual network apparatus that has performed the present test, The test history and the comparative analysis results are provided in the test report.

FIG. 7 is a flowchart of a new test path setting method of a fitness evaluation method for a virtual network apparatus according to an embodiment of the present invention.

6 and 7, a new test path setting method of a method for evaluating conformance of a virtual network apparatus according to an embodiment of the present invention classifies test elements into virtual network device data, a virtual network device data specification, and a test specification (S701). The virtual network device specification and test specification contain the information necessary to set up the test path. Then, the conformance verification apparatus 100 classifies and extracts test items related to each element based on one or more elements described in the virtual network device specification (S702), and based on the extracted test items, A check list is designated (S703). Each checklist includes one or more test functions.

The conformance verification apparatus 100 sets priorities for a plurality of test items extracted based on the test specification (S704). The conformance verification apparatus 100 may perform a network test on all of the test items including the check list. However, the present invention does not necessarily require a network test to be performed on all test items or check lists of test items. The conformance verification apparatus 100 can set one or more test items to be prioritized for the test among the extracted test items as needed. For example, one virtual network device can be given priority among a plurality of test items considering the time or resources required for the test. The conformance testing apparatus 100 performs the network test according to the priority of the test item. The network test may be omitted or delayed for a test item having a relatively low priority. The priority of such test items can be set based on the test specification.

Then, the conformance verification apparatus 100 adds a new test item from the test specification (S705). In using one virtual network device, the requirements may vary depending on the situation in which the virtual network device is utilized or the target system to which it is applied. Therefore, the test criteria can be up / down or added / deleted according to the user's intention through the received test specification. Steps 704 and 705 are not mandatory processing steps and may be selectively used or omitted. The conformance testing apparatus 100 sets a test path for testing the test items set in the check list through the above process (S706).

The present invention including the above-described contents can be written in a computer program. And the code and code segment constituting the program can be easily deduced by a computer programmer of the field. In addition, the created program can be stored in a computer-readable recording medium or an information storage medium, and can be read and executed by a computer to implement the method of the present invention. And the recording medium includes all types of recording media readable by a computer.

While the present invention has been particularly shown and described with reference to exemplary embodiments thereof, it is to be understood that the invention is not limited to the disclosed exemplary embodiments, but, on the contrary, It is possible.

100: Apparatus for evaluating suitability of a virtual network device
110: Network function receiver
120: Test path determining unit
130: network test execution unit
140: Test result deriving part

Claims (16)

A network function receiving unit for receiving at least one virtual network function and a virtual network function description;
A test path determination unit for extracting test items based on the virtual network device specification and setting a test path by designating a detailed check list of the extracted test items; And
A network test performing unit configured to test a performance of one or more virtual network devices based on the determined test path;
And a verification unit for verifying the conformity of the virtual network device. The method according to claim 1,
And the network function receiving unit performs validation on the basis of the received virtual network device and the virtual network device specification. The method according to claim 1,
Wherein the virtual network device specification includes at least one of an identifier for the virtual network device, developer information, and program information. The method according to claim 1,
The network function receiving unit inquires the previously stored test history based on the received virtual network device data and the virtual network device specification to determine whether or not there is a test report for the same virtual network device and to omit the test path setting process And a device for verifying the conformity of the virtual network device. The method according to claim 1,
The network function receiving unit receives a test description,
Wherein the test path determining unit sets a priority for a plurality of the extracted test items based on the received test specification. The method according to claim 1,
The network function receiving unit receives a test description,
And the test path determination unit adds a new test item based on the received test specification. The method according to claim 1,
Wherein the network test execution unit determines whether or not parallelization is possible for two or more test items included in the test path and performs a network test on the test items in a parallel manner or a serial manner according to a determination result Conformity verification device. The method according to claim 1,
Wherein the network test execution unit determines a test sequence of a plurality of test items in consideration of test efficiency. The method according to claim 1,
A test result deriving unit for determining whether the test result of the virtual network device is accepted based on the test specification and generating a test report by comparing the test result with a previously stored test report;
Further comprising: means for determining a validity of the virtual network device. 10. The method of claim 9,
The test result deriving unit searches the test history of the virtual network device that is the same as the virtual network device that has performed the test, and compares the generated test report with the previously stored test report to generate a test report. . 10. The method of claim 9,
Wherein the test result deriving unit stores the generated test report through the storage device. Receiving at least one virtual network function and a virtual network function description;
Extracting a test item based on the virtual network device specification;
Setting a test path by specifying a detailed check list of the extracted test items; And
Testing performance of the one or more virtual network devices based on the determined test path;
Wherein the method comprises the steps of: 13. The method of claim 12,
Determining whether the test result of the virtual network device is acceptable or not and generating a test report by comparing the test report with a previously stored test report;
Further comprising the steps of: 14. The method of claim 13,
Searching a test history of a virtual network device that is the same as the virtual network device on which the test is performed, and comparing the pre-stored test report with the generated test result to generate a test report;
Further comprising the steps of: 13. The method of claim 12,
Checking a test history based on the received virtual network device data and the virtual network device specification to determine whether a test report for the same virtual network device exists and omitting the test path setting process;
Further comprising the steps of: determining whether the virtual network device is suitable for the virtual network device. 13. The method of claim 12,
Receiving a test description; And
Setting a priority for a plurality of the extracted test items based on the received test specification;
Further comprising the steps of: determining whether the virtual network device is suitable for the virtual network device.

Images