CN109257241A - Virtual NE functional module performance appraisal procedure, device and system - Google Patents
Virtual NE functional module performance appraisal procedure, device and system Download PDFInfo
- Publication number
- CN109257241A CN109257241A CN201710567875.3A CN201710567875A CN109257241A CN 109257241 A CN109257241 A CN 109257241A CN 201710567875 A CN201710567875 A CN 201710567875A CN 109257241 A CN109257241 A CN 109257241A
- Authority
- CN
- China
- Prior art keywords
- test
- virtual
- functional module
- unit
- flow
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L43/00—Arrangements for monitoring or testing data switching networks
- H04L43/50—Testing arrangements
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L43/00—Arrangements for monitoring or testing data switching networks
- H04L43/08—Monitoring or testing based on specific metrics, e.g. QoS, energy consumption or environmental parameters
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L41/00—Arrangements for maintenance, administration or management of data switching networks, e.g. of packet switching networks
Abstract
The present invention discloses a kind of Virtual NE functional module performance appraisal procedure, device and system.This method comprises: the test flow that test instrumentation issues is copied into multiple groups test flow；Corresponding multiple business unit that multiple groups test flow is sent into Virtual NE functional module to be measured are handled；Whether verifying each test flow is all correctly processed；If not each test flow is all correctly processed, then the performance boundary value that current traffic is Virtual NE functional module to be measured is recorded.The present invention is by replicating test flow by the relatively low equipment of price, and all test results of poll can be effectively tested out the property extremes of VNF network element while controlling testing cost.
Description
Technical field
The present invention relates to network functions to virtualize field, in particular to a kind of Virtual NE functional module performance assessment side
Method, device and system.
Background technique
NFV (Network Function Virtualization, network function virtualization), mainly by using x86 etc.
General purpose hardware and virtualization technology, allow software and hardware decouple and function modeling, by it is original must pass through specialized hardware realize
Network function changes into generic server realization, has in this way using the flexible shared of resource, meets automatic deployment, the elasticity of business
Flexible, Fault Isolation and self-healing and the quick exploitation and deployment of new business.
For NFV by after software and hardware decoupling, VNF (Virtual NE functional module) is used as a kind of pure software system, performance
Index is no longer restricted by hardware, and theoretically processing capacity will extend manyfold.So how to assess the performance of the VNF of different manufacturers
Index just faces very big challenge.
The general bottleneck of traditional physical NE is on hardware device, overall performance and hardware quantity (such as port number or plate
Card quantity) it is linear, it is only necessary to test the performance of a port or one piece of board, so that it may extrapolate overall performance.And
VNF is as a kind of software systems, traffic handing capacity and the not absolute linear relationship of consumed hardware server resource,
For example the resource that a set of vBRAS (virtualization Broadband Remote Access Server) occupies a standard server can handle 1 general-purpose
Family, but occupy two-server resource, then it is capable of handling 2.6 general-purpose families (because having shared part control ability).So can not
Continue to calculate overall performance in the way of that original test single port or veneer card.
On the other hand, if tested with test instrumentation by traffic peak, will there are problems that two, first is that this
Sample needs to expend a large amount of test instrumentation resource.Current test instrumentation is expensive, the usually normal network equipment it is hundreds of
Times.Second is that equipment component producer did not tested where the limit of VNF yet, it is bad to calculate and plan that in advance testing scheme and test provide
Source.
Therefore continue to continue to use the testing scheme of existing physical NE, i.e., by VNF and corresponding first floor system (NFVI, network
Virtualization of function infrastructure solution) it is placed into the test environment of existing physical NE equipment, substitute existing Physical Network
Element device is tested according to the test case of existing physical NE equipment.It has been difficult accurately to test out the performance pole of VNF
Value, to also allow for the superiority and inferiority that tester can not accurately assess the VNF of different manufacturers.
Summary of the invention
In view of the above technical problem, the present invention provides a kind of Virtual NE functional module performance appraisal procedure, device and
System can effectively assess the similar VNF of different manufacturers offer.
According to an aspect of the present invention, a kind of Virtual NE functional module performance appraisal procedure is provided, comprising:
The test flow that test instrumentation issues is copied into multiple groups test flow；
Corresponding multiple business unit that multiple groups test flow is sent into Virtual NE functional module to be measured are handled；
Whether verifying each test flow is all correctly processed；
If not each test flow is all correctly processed, then recording current traffic is Virtual NE function mould to be measured
The performance boundary value of block.
In one embodiment of the invention, the method also includes:
If each test flow is all correctly processed, increases duplication coefficient and/or server resource, finally measure
The performance boundary value of Virtual NE functional module to be measured, wherein the duplication coefficient is the duplication quantity for testing flow.
In one embodiment of the invention, the increase duplication coefficient and/or server resource, are finally measured to be measured
The performance boundary value of Virtual NE functional module includes:
Judge whether server resource occupancy reaches extreme value；
If server resource, which occupies, is not up to extreme value, duplication coefficient is added 1, executes the survey for issuing test instrumentation later
The step of examination flow is copied into multiple groups flow.
In one embodiment of the invention, the increase duplication coefficient and/or server resource, are finally measured to be measured
The performance boundary value of Virtual NE functional module further include:
If server resource occupancy reaches extreme value, judge whether business unit quantity reaches extreme value；
If business unit quantity reaches extreme value, executing the record current traffic is Virtual NE functional module to be measured
Performance boundary value the step of.
In one embodiment of the invention, the increase duplication coefficient and/or server resource, are finally measured to be measured
The performance boundary value of Virtual NE functional module further include:
If business unit quantity is not up to extreme value, increase the server resource for distributing to Virtual NE functional module, increases
The processing capacity of strong business unit；Execute later it is described by the multiple groups test flow be sent into Virtual NE functional module to be measured
The step of corresponding multiple business unit are handled.
In one embodiment of the invention, the method also includes:
The test environment of initialization of virtual Network Element Function module, setting duplication coefficient is 0；
Receive the test flow that test instrumentation is sent according to Standard User model or discharge model；
Duplication coefficient is added 1, the test flow for issuing test instrumentation is executed later and is copied into multiple groups test flow
The step of.
According to another aspect of the present invention, a kind of Virtual NE functional module performance assessment device is provided, comprising:
Copied cells, the test flow for issuing test instrumentation are copied into multiple groups test flow；
Flow scheduling unit, for multiple groups test flow to be sent into the corresponding multiple of Virtual NE functional module to be measured
Business unit is handled；
Selecting unit, for verifying whether each test flow is all correctly processed；
Performance Evaluation unit, for not being the case where each test flow is all correctly processed in selecting unit verifying
Under, record current traffic is the performance boundary value of Virtual NE functional module to be measured.
In one embodiment of the invention, Performance Evaluation unit is also used to test flow in each and all be correctly processed
In the case where, increase duplication coefficient and/or server resource, finally measures the performance boundary of Virtual NE functional module to be measured
Value, wherein the duplication coefficient is the duplication quantity for testing flow.
In one embodiment of the invention, described device further include:
Monitoring resource unit, for judging server resource in the case where each test flow is all correctly processed
It occupies and whether reaches extreme value；
Performance Evaluation unit is also used in the case where monitoring resource unit determining server resource occupation is not up to extreme value,
Duplication coefficient is added 1, indicates that copied cells execute the behaviour that the test flow that test instrumentation issues is copied into multiple groups flow later
Make.
In one embodiment of the invention, described device further include:
Intelligence evaluation and test unit, for sentencing in the case where monitoring resource unit determining server resource occupation reaches extreme value
Whether disconnected business unit quantity reaches extreme value；
Performance Evaluation unit is also used to execute in the case where intelligently evaluation and test unit determines that business unit quantity reaches extreme value
Record the operation for the performance boundary value that current traffic is Virtual NE functional module to be measured.
In one embodiment of the invention, described device further include:
Virtual base facilities management unit, for determining that business unit quantity is not up to the feelings of extreme value in intelligently evaluation and test unit
Under condition, increases the server resource for distributing to Virtual NE functional module, enhance the processing capacity of business unit；Instruction stream later
Amount scheduling unit execute by multiple groups test flow be sent into corresponding multiple business unit of Virtual NE functional module to be measured into
The operation of row processing.
In one embodiment of the invention, described device further include:
Intelligence evaluation and test unit, initializes for the test environment to Virtual NE functional module, setting duplication coefficient
It is 0；
Copied cells are also used to receive the test flow that test instrumentation is sent according to Standard User model or discharge model；
Duplication coefficient is added 1, executes the operation that the test flow that test instrumentation issues is copied into multiple groups test flow later.
According to another aspect of the present invention, a kind of Virtual NE functional module performance assessment system, including tester are provided
Table and the Virtual NE functional module performance as described in above-mentioned any embodiment assess device.
The present invention is by replicating test flow by the relatively low equipment of price, and all test results of poll,
While controlling testing cost, the property extremes of VNF network element can be effectively tested out.
Detailed description of the invention
In order to more clearly explain the embodiment of the invention or the technical proposal in the existing technology, to embodiment or will show below
There is attached drawing needed in technical description to be briefly described, it should be apparent that, the accompanying drawings in the following description is only this
Some embodiments of invention for those of ordinary skill in the art without creative efforts, can be with
It obtains other drawings based on these drawings.
Fig. 1 is the schematic diagram of Virtual NE functional module performance assessment system first embodiment of the present invention.
Fig. 2 is the schematic diagram of Virtual NE functional module performance assessment system second embodiment of the present invention.
Fig. 3 is the schematic diagram of Virtual NE functional module performance appraisal procedure first embodiment of the present invention.
Fig. 4 is the schematic diagram of Virtual NE functional module performance appraisal procedure second embodiment of the present invention.
Specific embodiment
Following will be combined with the drawings in the embodiments of the present invention, and technical solution in the embodiment of the present invention carries out clear, complete
Site preparation description, it is clear that described embodiments are only a part of the embodiments of the present invention, instead of all the embodiments.Below
Description only actually at least one exemplary embodiment be it is illustrative, never as to the present invention and its application or make
Any restrictions.Based on the embodiments of the present invention, those of ordinary skill in the art are not making creative work premise
Under every other embodiment obtained, shall fall within the protection scope of the present invention.
Unless specifically stated otherwise, positioned opposite, the digital table of the component and step that otherwise illustrate in these embodiments
It is not limited the scope of the invention up to formula and numerical value.
Simultaneously, it should be appreciated that for ease of description, the size of various pieces shown in attached drawing is not according to reality
Proportionate relationship draw.
Technology, method and apparatus known to person of ordinary skill in the relevant may be not discussed in detail, but suitable
In the case of, the technology, method and apparatus should be considered as authorizing part of specification.
It is shown here and discuss all examples in, any occurrence should be construed as merely illustratively, without
It is as limitation.Therefore, the other examples of exemplary embodiment can have different values.
It should also be noted that similar label and letter indicate similar terms in following attached drawing, therefore, once a certain Xiang Yi
It is defined in a attached drawing, then in subsequent attached drawing does not need that it is further discussed.
Fig. 1 is the schematic diagram of Virtual NE functional module performance assessment system first embodiment of the present invention.As shown in Figure 1,
The Virtual NE functional module performance assessment system includes that test instrumentation 1 and Virtual NE functional module performance assess device 2,
Wherein
Test instrumentation 1, for sending test flow according to Standard User model or discharge model.
Virtual NE functional module performance assesses device 2, and the test flow for issuing test instrumentation 1 is copied into multiple groups
Test flow；Multiple groups test flow is sent at corresponding multiple business unit of Virtual NE functional module 3 to be measured
Reason；Whether poll verifying each test flow is all correctly processed；If not each test flow is all correctly processed, then
Record the performance boundary value that current traffic is Virtual NE functional module to be measured.
In one embodiment of the invention, Virtual NE functional module performance assessment device 2 is also used to survey in each
In the case that examination flow is all correctly processed, increases duplication coefficient and/or server resource, finally measure Virtual NE to be measured
The performance boundary value of functional module, wherein the duplication coefficient is the duplication quantity for testing flow.
Based on the Virtual NE functional module performance assessment system that the above embodiment of the present invention provides, compared with prior art
Afterwards, main advantage is:
Present technology there is no the testing scheme specific to VNF, be done at present or with continuing to use existing scheme, i.e., using existing
There is the test envelope of physical NE equipment, NFV network element is put into the position of corresponding physics network element device, is set according to existing physical NE
Standby mode is tested.But since there are linear between port or board and performance indicator unlike physical NE by VNF
Corresponding relationship can only stack a large amount of test instrumentation to realize the test of VNF property extremes, cause instrument resource to consume in this way
More, testing cost is high.
The above embodiment of the present invention can be replicated by will test flow by the relatively low equipment of price, and poll
All test results can be effectively tested out the property extremes of VNF network element while controlling testing cost.
Below by specific embodiment to Virtual NE functional module performance assessment device 2 in the above embodiment of the present invention
Structure and function is further described.
Fig. 2 is the schematic diagram of Virtual NE functional module performance assessment system second embodiment of the present invention.With Fig. 1 embodiment
It compares, in Fig. 2 embodiment, the Virtual NE functional module performance assessment device can specifically include copied cells 21, stream
Measure scheduling unit 22, selecting unit 23 and Performance Evaluation unit 24, in which:
Copied cells 21, the test flow for issuing test instrumentation 1 be copied into multiple groups test flow (such as: N group,
Wherein N is the integer more than or equal to 0).
In one embodiment of the invention, copied cells 21 specifically can be used in SDN (Software Defined
Network, software defined network) controller control under, by test instrumentation issue test flow be copied into multiple groups flow, send
Enter into the same VNF to be measured, is similar to multicast replication function.
In one embodiment of the invention, copied cells 21 can be implemented as interchanger.
Flow scheduling unit 22, for N group test flow to be sent into the corresponding N number of of Virtual NE functional module to be measured
Business unit is handled.
Selecting unit 23, for verifying whether each test flow is all correctly processed.
In one embodiment of the invention, selecting unit 23 specifically can be used under the control of SDN controller, with wheel
The mode of inquiry will by business unit treated test flow be sent into test instrumentation 1 one by one, it is each after the processing to verify VNF
Whether whether item test flow is all correctly processed or handles timely.
Performance Evaluation unit 24, for not being the feelings that each test flow is all correctly processed in the verifying of selecting unit 23
Under condition, record current traffic is the performance boundary value of Virtual NE functional module 3 to be measured.
In one embodiment of the invention, Performance Evaluation unit 24 can be also used for testing flow all by just in each
Really in the case where processing, increases duplication coefficient and/or server resource, finally measure Virtual NE functional module 3 to be measured
Performance boundary value, wherein the duplication coefficient is the duplication quantity for testing flow.
Device and system are assessed based on the Virtual NE functional module performance that the above embodiment of the present invention provides, utilize SDN
Flexible dispatching ability and network element the characteristics of virtualizing, pass through the relatively low equipment (such as interchanger) of price by that will test flow
It is replicated, and all test results of poll, while controlling testing cost, the property of VNF network element can be effectively tested out
It can extreme value.
In one embodiment of the invention, Performance Evaluation unit 24, it is not each for being also used to verify in selecting unit 23
In the case that item test flow is all correctly processed, record current traffic is the performance pole of Virtual NE functional module 3 to be measured
Limit value；And record occupied server resource situation at this time.
The above embodiment of the present invention proposes a kind of capability evaluating device for VNF, by being sent into after test flow duplication
It is handled in VNF, and each is verified by selecting unit polling type and is tested in the case that flow has all been correctly processed,
Increase duplication coefficient and server resource simultaneously, finally measures the performance boundary value of VNF.The above embodiment of the present invention can have
The similar VNF that assessment different manufacturers in effect ground provide, and it is required in different business amount to calculate all kinds of VNF according to assessment result
Stock number.
In one embodiment of the invention, as shown in Fig. 2, described device can also include monitoring resource unit 25,
In:
Monitoring resource unit 25, for judging that server is provided in the case where each test flow is all correctly processed
Whether source occupancy situation reaches extreme value.
In one embodiment of the invention, the server resource occupancy situation may include that CPU usage, memory make
With rate, network usage etc..
Monitoring resource unit 25 can independently of or be integrated in NFVI, dedicated for monitor the occupied service of VNF
Device resource.
Performance Evaluation unit 24 can be also used for being not up in 25 determining server occupation condition of monitoring resource unit
In the case where extreme value, duplication coefficient is added 1, indicates that the test flow that test instrumentation 1 issues is answered in the execution of copied cells 21 later
The operation of multiple groups flow is made.
In one embodiment of the invention, as shown in Fig. 2, described device can also include intelligence evaluation and test unit 26,
In:
Intelligence evaluation and test unit 26, for reaching the feelings of extreme value in 25 determining server occupation condition of monitoring resource unit
Under condition, judge whether business unit quantity reaches extreme value.
Performance Evaluation unit 24 is also used in the case where intelligently evaluation and test unit 26 determines that business unit quantity reaches extreme value,
Execute the operation for the performance boundary value that record current traffic is Virtual NE functional module 3 to be measured.
In one embodiment of the invention, described device can also include Virtual base facilities management unit, in which:
Virtual base facilities management unit, for determining that business unit quantity is not up to extreme value in intelligently evaluation and test unit 26
In the case of, increase the server resource for distributing to Virtual NE functional module, enhances the processing capacity of business unit；It indicates later
Flow scheduling unit 22 executes corresponding multiple business sheets that multiple groups test flow is sent into Virtual NE functional module 3 to be measured
The operation that member is handled.
In one embodiment of the invention, intelligence evaluation and test unit 26 can be also used for the survey to Virtual NE functional module
Test ring border is initialized, and setting duplication coefficient is 0.Copied cells 21 can be also used for reception test instrumentation 1 and use according to standard
The test flow that family model or discharge model are sent；Duplication coefficient is added 1, executes the test for issuing test instrumentation 1 later
Flow is copied into the operation of multiple groups test flow.
Fig. 3 is the schematic diagram of Virtual NE functional module performance appraisal procedure first embodiment of the present invention.Preferably, this reality
Device execution can be assessed by Virtual NE functional module performance of the present invention by applying example.Method includes the following steps:
Step 301, the test flow that test instrumentation 1 issues is copied into multiple groups test flow.
Step 302, multiple groups test flow is sent into corresponding multiple business unit of Virtual NE functional module 3 to be measured
It is handled.
Step 303, whether verifying each test flow is all correctly processed.
Step 304, if not each test flow is all correctly processed, then recording current traffic is virtual net to be measured
The performance boundary value of meta function module 3；And record occupied server resource situation at this time.
In one embodiment of the invention, after step 303, if the method can also include: each test
Flow is all correctly processed, then increases duplication coefficient and/or server resource, finally measure Virtual NE functional module to be measured
3 performance boundary value, wherein the duplication coefficient is the duplication quantity for testing flow.
It is multiple by test flow based on the Virtual NE functional module performance appraisal procedure that the above embodiment of the present invention provides
It is sent into VNF and is handled after system, and each test flow is verified by selecting unit polling type and has all been correctly processed
In the case where, while increasing duplication coefficient and server resource, finally measure the performance boundary value of VNF.The above-mentioned reality of the present invention
The similar VNF of different manufacturers offer can effectively be assessed by applying example, and all kinds of VNF can be calculated according to assessment result not of the same trade or business
Required stock number when business amount.
Fig. 4 is the schematic diagram of Virtual NE functional module performance appraisal procedure second embodiment of the present invention.Preferably, this reality
Device execution can be assessed by Virtual NE functional module performance of the present invention by applying example.Method includes the following steps:
Step 401, initialization VNF tests environment, if the control unit of VNF to be measured is separated with business unit, according to superfluous
Remaining policy deployment control unit, quantity are the maximum value that the VNF can be configured, and duplication coefficient X=0 is arranged.
Step 402, test instrumentation sends test flow according to Standard User model or discharge model.
Step 403, coefficient X=X+1 will be replicated, test flow is copied into X by way of multicast replication by copied cells
Part.
Step 404, the business unit that the test flow after duplication is sent into VNF is tested.
It step 405, will treated by business unit in a manner of poll by SDN controller control selections unit
Flow be sent into test instrumentation, with verify VNF processing whether correctly processing or whether in time.
Step 406, if all test flows can be correctly processed, step 407 is entered, further checks that resource accounts for
With situation, step 310 is otherwise entered, test terminates.
Step 407, server resource occupancy situation at this time is detected by monitoring resource module, judges whether to occur resource
Otherwise the case where reaching the limit of value enters step 403 if yes then enter step 408 is arrived.
Step 408, further check whether the control unit of NFV has reached limiting condition, if can support to be added
More server resources, if yes then enter step 408 is arrived, test terminates, and otherwise enters step 409.
Step 409, the resource of VNF is distributed to by VIM (Virtual base facilities management) unit increase, is increased at business unit
Reason ability re-starts test then into step 404.
Step 410, test terminates, and traffic peak when using zero defect records shared at this time as final testing result
Server resource situation.
The Virtual NE functional module performance appraisal procedure that the above embodiment of the present invention provides, can use the flexible of SDN
The characteristics of dispatching and network element virtualize is answered by will test flow by the relatively low equipment (such as interchanger) of price
System, and all test results of poll can be effectively tested out the property extremes of VNF network element while controlling testing cost.
The present invention will be described below by way of specific embodiments.
By taking certain type vBRAS test as an example, this vBRAS is to turn control divergence type, i.e. control unit is in different from business unit
VM on, reference can be made to Figure of description 2.
The first step configures three control units, forms the configuration mode of 2+1, i.e., according to the high availability requirement to VNF
Two control units are in hot standby state, and a control unit is in cold standby state.
Second step sends test flow according to standard test models by test instrumentation, typical metropolitan area is pressed in the present embodiment
The access bandwidth user of net and online user's average flow rate configure, and every portion is basic unit by 10,000, such as according to network
It is as follows to choose each phase user situation for real traffic situation:
1,4M (containing) is below: accounting 22%, average flow rate 256k.
2,4M-12M (containing): accounting 24%, average flow rate 1024k.
3,12M-20M (containing): accounting 13%, average flow rate 1248k.
4,20M-100M: accounting 8%, average flow rate 1548k.
5,100M: accounting 33%, average flow rate 2048k.
Setting duplication coefficient X is 0.
Step 3: starting to test, 1 first is added to X, i.e., only forwards and does not replicate test flow, being equivalent at this time has 1 general-purpose family to exist
Line.It is sent in Service Processing Unit, is handled by flow is tested by copied cells；After Service Processing Unit is handled,
Recycle that selecting unit will treated that flow is forwarded to test instrumentation verifies.
After test instrumentation verification, after confirming zero defect, then the server resource by monitoring resource module record at this time
Occupancy situation, including CPU usage, memory usage, network usage etc., for example in this example, record case is as follows:
1, vCPU:534%/8vCPU；(note: being that the occupancy of 8 core CPU is superimposed to calculate and obtain herein).
2, memory: 64%/8G.
3, network: 1.5G (average flow rate).
At this point, server resource is also available free, input quantity can be increased, i.e. duplication coefficient X=X+1.
Step 4: X=2 is equivalent to that is, by 2 times of duplication of test flow while having 2 general-purpose families online after duplication coefficient adds 1.
The flow after duplication is sent into Service Processing Unit by copied cells and is handled, after Service Processing Unit is handled, then
The 1st group and the 2nd group of flow are respectively fed to test instrumentation and verified in turn by selecting unit.
At this point, discovery partial discharge cannot be handled normally, test instrumentation shows service request and is rejected.It examines at this time
The server resource occupancy situation of monitoring resource module record at this time was looked into, discovery:
1, vCPU:800%/8vCPU.
2, memory: 96%/8G.
3, network: 2G (average flow rate).
Obvious cpu resource is insufficient, therefore redistributes server resource by VIM, at this time 16 vCPU of distribution, again into
Row test, server resource occupancy situation are as follows:
1, vCPU:926%/16vCPU.
2, memory: 70%/8G.
3, network: 3G (average flow rate).
The 4th step is repeated, has more than needed until there is server resource, but still has user application the case where being rejected.
5th step it is more than needed to find that server resource has always, but have service request to be rejected always at this time as X=21.
At this point, test terminates, the business processing limit capacity for recording the vBRAS is 20 general-purpose families.
The above embodiment of the present invention can use the characteristics of flexible dispatching ability and network element virtualization of SDN, by that will survey
Examination flow duplication after be sent into VNF in handled, and by selecting unit polling type verify each test flow all by
In the case where correct processing, while increasing duplication coefficient and server resource, finally measures the performance boundary value of VNF.
The above embodiment of the present invention can effectively assess the similar VNF of different manufacturers offer, and can be tied according to assessment
Fruit calculates all kinds of VNF required stock numbers in different business amount.
The above embodiment of the present invention can be carried out by that will test flow by the relatively low equipment (such as interchanger) of price
Duplication, and all test results of poll can be effectively tested out the performance pole of VNF network element while controlling testing cost
Value.
Virtual NE functional module performance assessment device described above can be implemented as executing the application institute
General processor, programmable logic controller (PLC) (PLC), the digital signal processor (DSP), specific integrated circuit of representation function
(ASIC), field programmable gate array (FPGA) either other programmable logic device, discrete gate or transistor logic,
Discrete hardware components or it is any appropriately combined.
So far, the present invention is described in detail.In order to avoid covering design of the invention, it is public that this field institute is not described
The some details known.Those skilled in the art as described above, completely it can be appreciated how implementing technology disclosed herein
Scheme.
Those of ordinary skill in the art will appreciate that realizing that all or part of the steps of above-described embodiment can pass through hardware
It completes, relevant hardware can also be instructed to complete by program, the program can store in a kind of computer-readable
In storage medium, storage medium mentioned above can be read-only memory, disk or CD etc..
Description of the invention is given for the purpose of illustration and description, and is not exhaustively or will be of the invention
It is limited to disclosed form.Many modifications and variations are obvious for the ordinary skill in the art.It selects and retouches
It states embodiment and is to more preferably illustrate the principle of the present invention and practical application, and those skilled in the art is enable to manage
The solution present invention is to design various embodiments suitable for specific applications with various modifications.
Claims (13)
1. a kind of Virtual NE functional module performance appraisal procedure characterized by comprising
The test flow that test instrumentation issues is copied into multiple groups test flow；
Corresponding multiple business unit that multiple groups test flow is sent into Virtual NE functional module to be measured are handled；
Whether verifying each test flow is all correctly processed；
If not each test flow is all correctly processed, then recording current traffic is Virtual NE functional module to be measured
Performance boundary value.
2. the method according to claim 1, wherein further include:
If each test flow is all correctly processed, increases duplication coefficient and/or server resource, finally measure to be measured
The performance boundary value of Virtual NE functional module, wherein the duplication coefficient is the duplication quantity for testing flow.
3. according to the method described in claim 2, it is characterized in that, the increase replicates coefficient and/or server resource, finally
The performance boundary value for measuring Virtual NE functional module to be measured includes:
Judge whether server resource occupancy reaches extreme value；
If server resource, which occupies, is not up to extreme value, duplication coefficient is added 1, executes the test stream for issuing test instrumentation later
The step of amount is copied into multiple groups flow.
4. according to the method described in claim 3, it is characterized in that, the increase replicates coefficient and/or server resource, finally
Measure the performance boundary value of Virtual NE functional module to be measured further include:
If server resource occupancy reaches extreme value, judge whether business unit quantity reaches extreme value；
If business unit quantity reaches extreme value, the property that the record current traffic is Virtual NE functional module to be measured is executed
The step of energy limit value.
5. according to the method described in claim 4, it is characterized in that, the increase replicates coefficient and/or server resource, finally
Measure the performance boundary value of Virtual NE functional module to be measured further include:
If business unit quantity is not up to extreme value, increase the server resource for distributing to Virtual NE functional module, enhances industry
The processing capacity of business unit；Execute later it is described by the multiple groups test flow be sent into the corresponding of Virtual NE functional module to be measured
The step of multiple business unit are handled.
6. method according to any one of claims 1-5, which is characterized in that further include:
The test environment of initialization of virtual Network Element Function module, setting duplication coefficient is 0；
Receive the test flow that test instrumentation is sent according to Standard User model or discharge model；
Duplication coefficient is added 1, executes the step that the test flow for issuing test instrumentation is copied into multiple groups test flow later
Suddenly.
7. a kind of Virtual NE functional module performance assesses device characterized by comprising
Copied cells, the test flow for issuing test instrumentation are copied into multiple groups test flow；
Flow scheduling unit, for multiple groups test flow to be sent into corresponding multiple business of Virtual NE functional module to be measured
Unit is handled；
Selecting unit, for verifying whether each test flow is all correctly processed；
Performance Evaluation unit, for remembering in the case where selecting unit verifying is not that each test flow is all correctly processed
Record the performance boundary value that current traffic is Virtual NE functional module to be measured.
8. device according to claim 7, which is characterized in that
Performance Evaluation unit be also used to each test flow be all correctly processed in the case where, increase duplication coefficient and/or
Server resource finally measures the performance boundary value of Virtual NE functional module to be measured, wherein the duplication coefficient is test
The duplication quantity of flow.
9. device according to claim 8, which is characterized in that further include:
Monitoring resource unit, for judging that server resource is occupied in the case where each test flow is all correctly processed
Whether extreme value is reached；
Performance Evaluation unit is also used to answer in the case where monitoring resource unit determining server resource occupation is not up to extreme value
Coefficient processed adds 1, indicates that copied cells execute the operation that the test flow that test instrumentation issues is copied into multiple groups flow later.
10. device according to claim 9, which is characterized in that further include:
Intelligence evaluation and test unit, for judging industry in the case where monitoring resource unit determining server resource occupation reaches extreme value
Whether business element number reaches extreme value；
Performance Evaluation unit is also used to execute record in the case where intelligently evaluation and test unit determines that business unit quantity reaches extreme value
Current traffic is the operation of the performance boundary value of Virtual NE functional module to be measured.
11. device according to claim 10, which is characterized in that further include:
Virtual base facilities management unit, for determining the case where business unit quantity is not up to extreme value in intelligently evaluation and test unit
Under, increase the server resource for distributing to Virtual NE functional module, enhances the processing capacity of business unit；Flow is indicated later
Scheduling unit, which executes, carries out corresponding multiple business unit that multiple groups test flow is sent into Virtual NE functional module to be measured
The operation of processing.
12. device according to any one of claims 7-11, which is characterized in that further include:
Intelligence evaluation and test unit, initializes for the test environment to Virtual NE functional module, and setting duplication coefficient is 0；
Copied cells are also used to receive the test flow that test instrumentation is sent according to Standard User model or discharge model；It will answer
Coefficient processed adds 1, executes the operation that the test flow that test instrumentation issues is copied into multiple groups test flow later.
13. a kind of Virtual NE functional module performance assessment system, which is characterized in that including test instrumentation and such as claim
Virtual NE functional module performance described in any one of 7-12 assesses device.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710567875.3A CN109257241B (en) | 2017-07-13 | 2017-07-13 | Method, device and system for evaluating performance of virtual network element functional module |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710567875.3A CN109257241B (en) | 2017-07-13 | 2017-07-13 | Method, device and system for evaluating performance of virtual network element functional module |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN109257241A true CN109257241A (en) | 2019-01-22 |
| CN109257241B CN109257241B (en) | 2021-02-05 |
Family
ID=65051642
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201710567875.3A Active CN109257241B (en) | 2017-07-13 | 2017-07-13 | Method, device and system for evaluating performance of virtual network element functional module |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN109257241B (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113098730A (en) * | 2020-01-08 | 2021-07-09 | 中国移动通信有限公司研究院 | Server testing method and equipment |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105281979A (en) * | 2015-10-29 | 2016-01-27 | 贵州电网有限责任公司电力调度控制中心 | Load test method for virtualization application platform |
| CN105323085A (en) * | 2014-07-10 | 2016-02-10 | 中兴通讯股份有限公司 | Processing method and device for establishing performance measurement task and performance measurement result |
| WO2016204804A1 (en) * | 2015-06-16 | 2016-12-22 | Hewlett-Packard Development Company, L.P. | Virtualized network function monitoring |
| CN106533723A (en) * | 2015-09-11 | 2017-03-22 | 中兴通讯股份有限公司 | Virtual resource scheduling method, device and system |
| WO2017058274A1 (en) * | 2015-09-30 | 2017-04-06 | Intel IP Corporation | Devices and methods of using network function virtualization and virtualized resources performance data to improve performance |
-
2017
- 2017-07-13 CN CN201710567875.3A patent/CN109257241B/en active Active
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105323085A (en) * | 2014-07-10 | 2016-02-10 | 中兴通讯股份有限公司 | Processing method and device for establishing performance measurement task and performance measurement result |
| WO2016204804A1 (en) * | 2015-06-16 | 2016-12-22 | Hewlett-Packard Development Company, L.P. | Virtualized network function monitoring |
| CN106533723A (en) * | 2015-09-11 | 2017-03-22 | 中兴通讯股份有限公司 | Virtual resource scheduling method, device and system |
| WO2017058274A1 (en) * | 2015-09-30 | 2017-04-06 | Intel IP Corporation | Devices and methods of using network function virtualization and virtualized resources performance data to improve performance |
| CN105281979A (en) * | 2015-10-29 | 2016-01-27 | 贵州电网有限责任公司电力调度控制中心 | Load test method for virtualization application platform |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113098730A (en) * | 2020-01-08 | 2021-07-09 | 中国移动通信有限公司研究院 | Server testing method and equipment |
| CN113098730B (en) * | 2020-01-08 | 2022-08-05 | 中国移动通信有限公司研究院 | Server testing method and equipment |
Also Published As
| Publication number | Publication date |
|---|---|
| CN109257241B (en) | 2021-02-05 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN109416639B (en) | Method, system, and computer readable medium for simulating network traffic patterns on a virtual machine | |
| CN106021045B (en) | The test method of server hard disc IO performance under a kind of Linux system | |
| CN106302574B (en) | A kind of service availability management method, device and its network function virtualization architecture | |
| CN105738854A (en) | Simulation memory test board system for intelligent ammeter embedded application and test method | |
| CN106557389B (en) | A kind of slow disk detection method and device | |
| US8639466B2 (en) | Computerised storage system comprising one or more replaceable units for managing testing of one or more replacement units | |
| CN105765898B (en) | The detection of 4 pairs of POEs, classify and be mutually distinguishable | |
| CN106776280A (en) | Configurable performance test device | |
| CN105893211A (en) | Method and system for monitoring | |
| CN109257241A (en) | Virtual NE functional module performance appraisal procedure, device and system | |
| CN105391601A (en) | Network management equipment performance testing method and system | |
| US5768520A (en) | Method for determining load capacity by grouping physical components into logical components whose loads represent fixed proportional loads of physical components | |
| CN111123009A (en) | Intelligent substation avalanche testing method and system based on SCD file and terminal equipment | |
| CN111159029B (en) | Automated testing method, apparatus, electronic device and computer readable storage medium | |
| JP6321880B2 (en) | Operation status display system | |
| US20180203628A1 (en) | Method, apparatus and computer program product for evaluating data storage systems for energy efficiency | |
| CN103885441B (en) | A kind of adaptive failure diagnostic method of controller local area network | |
| Davis et al. | Linear analysis of multiple outage interaction | |
| Liu et al. | Manufacturing system design with optimal diagnosability | |
| CN111614162A (en) | Transformer substation monitoring system performance evaluation method based on avalanche test | |
| CN109374038A (en) | A kind of changed test method of the nuclear safe level instrument control product based on application model machine | |
| Bai et al. | On the trend of remaining software defect estimation | |
| CN109271303A (en) | A kind of software configuration recommended method | |
| CN104486150B (en) | A kind of method of testing of onboard networks data content integrality | |
| CN102201945A (en) | Testing system for simulating storage area network |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |