CN107147439B - A kind of software definition optical-fiber network Performance Test System and method - Google Patents

Abstract

The embodiments of the present application provide a software-defined optical network performance testing system and method, which solves the problem that the existing technical testing solutions cannot verify long-term operation indicators. The software-defined optical network performance testing system includes: a test controller, an instrument control agent, data meter. The embodiments of the present invention also include a software-defined optical network performance testing method, which is used in the software-defined optical network performance testing system described in any one of the embodiments of the present application, which can initiate connection establishment and deletion of a single service, or initiate multiple service connections. Connection establishment and deletion of services. The invention can be used to verify the indicators of stability and reliability during long-term operation of the controller.

Description

A software-defined optical network performance testing system and method

technical field

The present application relates to the technical field of optical communication, and in particular, to a system and a performance testing method for software-defined optical network performance testing.

Background technique

Software Defined Optical Network (SDON) applies the concept of SDN to optical networks to build a new generation of service-oriented optical network architecture. Through the SDON technology, the differences of the underlying physical forwarding devices can be shielded through the standard southbound interface, the unified scheduling and abstract virtualization of resources can be realized through the centralized controller, and the upper-layer service can be provided on-demand through the flexible and open northbound interface of the controller. Configure and schedule network resources. It can be seen from this that the centralized controller becomes its key control component, and its network reliability and performance need to be fully verified in the network application process. By defining the performance indicators related to the controller and testing and evaluating the software-defined optical network, the application and deployment of SDON technology in the existing network can be promoted more quickly.

The disadvantage of the prior art is that the message exchange process between the multi-domain cooperative controller and the test controller cannot accurately reflect whether the service of the underlying network has been successfully created. Whether the service is successfully created, you need to manually operate the instrument to send traffic to verify. In addition, the current test methods cannot verify the indicators of stability and reliability during long-term operation of the controller, as well as the success rate and failure rate of connection creation during long-term operation.

SUMMARY OF THE INVENTION

The embodiments of the present application provide a software-defined optical network performance testing system and method, which solves the problem that the existing technical testing solutions cannot verify long-term operation indicators, and improves the efficiency and reliability of performance testing.

The present invention provides a software-defined optical network performance testing system. The software-defined optical network includes a multi-domain cooperative controller and a plurality of domain controllers. The multi-domain cooperative controller communicates with each domain controller through an interface between controller layers. Each domain controller is connected to an optical transport network domain or a packet optical transport network domain respectively through a southbound interface. The software-defined optical network performance test system includes: a test controller, an instrument control agent, and a data instrument.

The test controller is used to initiate a connection establishment request to the multi-domain cooperative controller and receive a connection establishment success message; initiate a connection deletion request to the multi-domain cooperative controller and receive a connection deletion success message; send a connection deletion success message to the meter The control agent sends service flow initiation and service flow termination requests; and receives a notification of service stop sending from the instrument control agent.

The instrument control agent is used to receive the service flow initiation and service flow termination requests of the test controller, and to remotely control the data instrument to send out and terminate service flow.

The data meter is connected to at least one of the optical transport network domain or the packet optical transport network domain, and is used for receiving the instruction of the instrument control agent, and sending out service flow or termination to the optical transport network domain or the packet optical transport network domain business flow.

Preferably, in the software-defined optical network performance test system, the test controller and the instrument control agent are connected through a REST API interface.

Preferably, in the software-defined optical network formation test system, the instruction sent by the meter control agent to the data meter includes at least one of TELNET, CLI, and HTTP.

The embodiment of the present invention further includes a software-defined optical network performance testing method, which is used in the software-defined optical network performance testing system described in any one of the embodiments of the present application, including the following steps:

The test controller initiates a connection creation request to the multi _- domain collaborative controller at time T1;

The test controller receives a connection establishment success message fed back from the multi _- domain cooperative controller at time T2;

After the test controller waits for the time T, it sends a service flow initiation and service flow termination request to the instrument control agent, and the control instrument initiates and terminates the service flow, and the service flow lasts for T';

_At time T3, the test controller receives the notification of service stop sending returned from the instrument control agent, and initiates a connection deletion request to the multi-domain controller;

The test controller receives a connection deletion success message from the multi _- domain controller at time T4.

Further, the software-defined optical network performance testing method also includes the following steps:

After the controller waits for the time T", the above steps are performed again.

As a further optimized embodiment of the software-defined optical network performance test method of the present application, the test controller initiates a connection creation request to the multi-domain cooperative controller several times in a row, and receives a connection creation success message; the test controller sends a connection creation success message to all The instrument control agent continuously sends out a plurality of service flow initiation requests and service flow deletion requests; the test controller continuously initiates connection deletion requests to the multi-domain collaborative controller for many times, and receives a connection deletion success message.

Preferably, in the software-defined optical network performance testing method described in the embodiment of the present application, T=T"=1.5×Z; Z=Y-(T ₂ '-T ₁ ')-(SX); wherein,

T ₁ ': At this moment, the test controller sends a connection creation request message to the collaborative controller;

T ₂ ': At this moment, the test controller receives the connection creation success message of the collaborative controller;

_T4 ': before time T1', the test controller receives the successful message of connection deletion of the cooperative controller;

S: from T ₄ ' to T ₁ ', the waiting time for the test controller;

X: delay time between T ₄ ' and service interruption;

Y: The service interruption duration obtained by the instrument monitoring under the condition that the data instrument continuously sends out the business flow;

Z _: Delay time between time T2' and service recovery.

Further preferably, in the software-defined optical network performance testing method, T'=3T.

In the embodiment of the software-defined optical network performance testing method described in the present application, in order to simplify the calculation of Z, the following steps are further included: gradually reduce the value of S, and obtain S=X when the service creation is unsuccessful.

The above-mentioned at least one technical solution adopted in the embodiment of the present application can achieve the following beneficial effects: the present invention realizes the process of automatically creating a business, sending a flow of the instrument to verify whether the business is successful, and deleting the business by linking the test controller and the instrument. Repeating this process can verify the stability and reliability of the controller during long-term operation, which is conducive to comparative analysis of the success rate and failure rate of business creation during long-term operation, and the operational stability and reliability of different controller systems. Comprehensive evaluation of reliability.

Description of drawings

The drawings described herein are used to provide further understanding of the present application and constitute a part of the present application. The schematic embodiments and descriptions of the present application are used to explain the present application and do not constitute an improper limitation of the present application. In the attached image:

1 is a schematic diagram of a software-defined optical network test solution in the prior art;

2 is a schematic diagram of an embodiment of a software-defined optical network performance testing system according to the present invention;

3 is a schematic diagram of a single service embodiment of a software-defined optical network performance testing method according to the present invention;

4 is a schematic diagram of a multi-service embodiment of a software-defined optical network performance testing method according to the present invention;

FIG. 5 is a schematic diagram of a method for taking a value of a performance test waiting time.

Detailed ways

In order to make the objectives, technical solutions and advantages of the present application clearer, the technical solutions of the present application will be clearly and completely described below with reference to the specific embodiments of the present application and the corresponding drawings. Obviously, the described embodiments are only a part of the embodiments of the present application, but not all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by those of ordinary skill in the art without creative efforts shall fall within the protection scope of the present application.

The technical solutions provided by the embodiments of the present application will be described in detail below with reference to the accompanying drawings.

FIG. 1 is a schematic diagram of a software-defined optical network test solution in the prior art; the current solution for verifying SDON service creation is shown in FIG. 1 . The test controller sends a service creation request to the multi-domain controller through the northbound interface of the restful API, and the multi-domain collaborative controller returns a restful 200ok message to the test controller to complete the business interaction process with the test controller.

The tester verifies whether the service of the underlying network is successfully created by initiating instrument service traffic.

At present, ONF, IETF and other standardization organizations are conducting research on the test indicators and test methods of the controller's southbound interface, and the corresponding test indicators have formed a working group draft.

However, in the prior art, after the multi-domain collaborative controller returns a restful 200ok message to the test controller, the message interaction process with the test controller is completed, but it cannot be guaranteed that the service of the underlying network has been successfully created. Whether the business is successfully created requires traffic verification by the instrument. The current technical solution requires testers to manually initiate business traffic. Since human participation interrupts the test process, only a single test can verify the process of instrument business creation or deletion.

In addition, the current test methods cannot verify the indicators of stability and reliability during long-term operation of the controller, as well as the success rate and failure rate of connection creation during long-term operation.

2 is a schematic diagram of an embodiment of a software-defined optical network performance testing system according to the present invention;

The present invention provides a software-defined optical network performance testing system. The software-defined optical network includes a multi-domain cooperative controller and a plurality of domain controllers. The multi-domain cooperative controller communicates with each domain controller through an interface between controller layers. Each domain controller is connected to an optical transport network domain or a packet optical transport network domain respectively through a southbound interface. The software-defined optical network performance test system includes: a test controller, an instrument control agent, and a data instrument.

The test controller is used to initiate a connection establishment request to the multi-domain cooperative controller and receive a connection establishment success message; initiate a connection deletion request to the multi-domain cooperative controller and receive a connection deletion success message; send a connection deletion success message to the meter The control agent sends service flow initiation and service flow termination requests; and receives a notification of service stop sending from the instrument control agent. It should be noted that the test controller sends service creation and deletion requests to the multi-domain collaborative controller through the northbound interface.

The instrument control agent is used to receive the service flow initiation and service flow termination requests of the test controller, and to remotely control the data instrument to send out and terminate service flow.

The data meter is connected to at least one of the optical transport network domain or the packet optical transport network domain, and is used for receiving the instruction of the instrument control agent, and sending out service flow or termination to the optical transport network domain or the packet optical transport network domain business flow.

Preferably, in the software-defined optical network performance test system, the test controller and the instrument control agent are connected through a REST API interface. The test controller sends traffic initiation and termination requests to the instrument control bandwidth through the rest API interface.

Preferably, in the software-defined optical network formation test system, the instruction sent by the meter control agent to the data meter includes at least one of TELNET, CLI, and HTTP. The instrument control agent remotely controls the instrument to initiate or terminate traffic through telnet, CLI, HTTP and other commands.

FIG. 3 is a schematic diagram of a single service embodiment of a software-defined optical network performance testing method according to the present invention. The embodiment of the present invention further includes a software-defined optical network performance testing method, which is used in the software-defined optical network performance testing system described in any one of the embodiments of the present application, including the following steps:

Step 11, the test controller initiates a connection creation request to the multi _- domain collaborative controller at time T1;

Step 12, the test controller receives the connection creation success message fed back from the multi _- domain collaborative controller at time T2;

After step 13, test controller wait time T, send service flow initiation, service flow termination request to instrument control agent, control instrument initiates service flow and terminates service flow, the time that this service flow lasts is T';

Step 14, the test controller receives the notification _of service stop sending from the instrument control agent at time T3, and initiates a connection deletion request to the multi-domain controller;

Step 15: The test controller receives a connection deletion success message from the multi _- domain controller at time T4.

Further, the software-defined optical network performance testing method also includes the following steps

Step 16: After the controller waits for the time T", steps 11 to 15 are performed again.

It should be noted that, during the long-term operation, connection establishment and deletion of a single service may be initiated, and connection establishment and deletion of multiple services may also be initiated.

FIG. 4 is a schematic diagram of a multi-service embodiment of a software-defined optical network performance testing method according to the present invention. As a further optimized embodiment of the software-defined optical network performance test method of the present application, the test controller initiates a connection creation request to the multi-domain cooperative controller several times in a row, and receives a connection creation success message; the test controller sends a connection creation success message to all The instrument control agent continuously sends out a plurality of service flow initiation requests and service flow deletion requests; the test controller continuously initiates connection deletion requests to the multi-domain collaborative controller for many times, and receives a connection deletion success message. Specifically, the process of initiating multiple service flows in the same cycle to verify the long-term operation stability and reliability of the controller includes the following steps:

Step 21, the test controller initiates a connection creation request of the first service to the multi-domain system controller at time _T11 ;

Step 22, the test controller receives the message that the first service is created successfully returned by the multi-domain collaborative controller at time _T12 , and simultaneously initiates a connection creation request for the second service;

Step 23, sequentially send n business connections to create, the test controller receives the creation success message of the nth business from the multi-domain collaborative controller at time T _n2 , and completes the creation process of the n business;

Step 24, after the test controller waits for the time T, initiates the request of n business flows to the instrument control agent, and stops the sending of n concurrent flows after the concurrent time T' of the n instrument business flows;

Step 25: At time T ₁₃ , the test controller sends a request for deleting the first service to the multi-domain collaborative controller after receiving the notification that n concurrent traffic stops being sent from the instrument control agent;

Step 26, the deletion process of the N services is executed serially, and at time T _n3 , the test controller receives the message that the nth service is deleted successfully returned by the collaborative controller;

Step 27: After testing the controller waiting time T", steps 21 to 26 are performed again, and the next process of creating n services, verifying the flow sent by the meter, and deleting n services is continued.

The above test process can be repeated by setting the number of times in the test controller, or it can run until it is manually stopped.

It should be noted that, in the flow of the embodiment shown in FIGS. 3 to 4 , after the message flow interaction between the test controller and the cooperative controller is completed, it is necessary to wait for a time T or T" before continuing to the next operation, which is After the simple message exchange process is completed, it cannot guarantee that the service has been successfully created on the underlying network. Therefore, it is necessary to set the acceptance wait to ensure that the underlying network service has been successfully created.

FIG. 5 is a schematic diagram of a method for taking a value of a performance test waiting time. In order to ensure that sufficient test pressure can be provided during the reliability test process and the upper limit of the controller performance can be tested as much as possible, it is necessary to set T, T' and T" reasonably. For the settings of the above three moments, please refer to Figure 5. In Figure 5 In step 5, the test instrument keeps sending traffic, the test controller initiates the connection deletion process, waits for time T, initiates the connection creation process, and monitors the time of service interruption through the instrument.

Preferably, in the software-defined optical network performance testing method described in the embodiment of the present application, T=T"=1.5×Z; Z=Y-(T ₂ '-T ₁ ')-(SX); wherein,

T ₁ ': At this moment, the test controller sends a connection creation request message to the collaborative controller;

T ₂ ': At this moment, the test controller receives the connection creation success message of the collaborative controller;

_T3 ': before time T1', the test controller at this time sends a connection deletion request message to the cooperative controller;

_T4 ': before time T1', the test controller receives the successful message of connection deletion of the cooperative controller;

S: from T ₄ ' to T ₁ ', the waiting time for the test controller;

X: delay time between T ₄ ' and service interruption;

Y: The service interruption duration obtained by the instrument monitoring under the condition that the data instrument continuously sends out the business flow;

Z _: Delay time between time T2' and service recovery.

Further preferably, in the software-defined optical network performance testing method, T'=3T.

It should be pointed out that, after the message creation process is completed, the underlying network device needs to wait for time Z to complete the connection before completing the creation of the service connection.

Here Y is the service interruption duration measured by the meter. If the traffic is interrupted, it is measured by the value of the flow rate sent by the meter = the number of packets lost by the meter/the rate of sending packets.

The Z value we obtained is mainly to ensure that after the end of the signaling process at time Z, the underlying network can complete the process of creating or deleting services, because by capturing packets, we can obtain the signaling time for creating services between the controller and the device. However, after the signaling is completed, it cannot be guaranteed that the underlying network can also complete the actual service creation. The specific device configuration is crossed and the service delivery takes time. Z is to ensure that the underlying network can complete business creation.

In the embodiment of the software-defined optical network performance testing method described in the present application, in order to simplify the calculation of Z, the following steps are further included: gradually reduce the value of S, and obtain S=X when the service creation is unsuccessful.

The Z value estimated by us through measurement can be multiplied by a coefficient to further ensure the success of business creation or deletion. This is T (creation guarantee waiting time) = T" (deletion guarantee waiting time) = 1.5 times Z.

T' is the time when the meter sends traffic to verify whether the service is successful. This value can be 3 times the Z value. If the Z value is too small, it can also be set to a fixed interval, such as 5s.

It should be noted that the technical key point of the present invention is: linking the test controller and the instrument to realize the process of automatically creating a business, sending the flow of the instrument to verify whether the business is successful, and deleting the business. By repeating this process, the control The stability and reliability of the device during long-term operation are verified. In addition, the method of reasonably setting the waiting time T and T' of the test controller ensures that the services of the underlying physical network can be successfully created and deleted, and at the same time can provide enough test pressure to test the upper limit of the controller performance as much as possible.

It should also be noted that the terms "comprising", "comprising" or any other variation thereof are intended to encompass a non-exclusive inclusion such that a process, method, article or device comprising a series of elements includes not only those elements, but also Other elements not expressly listed, or which are inherent to such a process, method, article of manufacture, or apparatus are also included. Without further limitation, an element qualified by the phrase "comprising a..." does not preclude the presence of additional identical elements in the process, method, article of manufacture, or device that includes the element.

The above descriptions are merely examples of the present application, and are not intended to limit the present application. Various modifications and variations of this application are possible for those skilled in the art. Any modification, equivalent replacement, improvement, etc. made within the spirit and principle of this application shall be included within the scope of the claims of this application.

Claims (10)

1. A performance test system of a software defined optical network, wherein the software defined optical network comprises a multi-domain cooperative controller and a plurality of domain controllers, the multi-domain cooperative controller is connected with each domain controller through an interface between controller layers, and each domain controller is respectively connected with an optical transport network domain or a grouped optical transport network domain through a southbound interface, the test system is characterized by comprising: a test controller, a meter control agent, and a data meter;

the test controller is used for

Initiating a connection establishment request to the multi-domain cooperative controller and receiving a connection establishment success message;

initiating a connection deletion request to the multi-domain cooperative controller and receiving a connection deletion success message;

sending a service flow initiation and service flow termination request to the instrument control agent;

receiving a notification from the meter control agent that traffic stops sending;

the instrument control agent is used for receiving the service flow initiating and service flow terminating requests of the test controller and remotely controlling the data instrument to send out and terminate service flow;

the data instrument is connected with at least one optical transport network domain or packet optical transport network domain and is used for receiving the instruction of the instrument control agent and sending service flow or terminating the service flow to the optical transport network domain or the packet optical transport network domain.

2. The software defined optical network performance testing system of claim 1, wherein the test controller and the meter control agent are coupled via a REST API interface.

3. The software defined optical network performance testing system of claim 1 wherein the instructions issued by the meter control agent to the data meter comprise at least one of TELNET, CLI, HTTP.

4. A method for testing performance of a software defined optical network, which is used in the system for testing performance of a software defined optical network according to any one of claims 1 to 3, and comprises the following steps:

test controller at T₁A connection establishment request is sent to a multi-domain cooperative controller at any moment;

test controller at T₂Receiving a connection establishment success message fed back by the multi-domain cooperative controller at any moment;

after waiting for time T, the test controller sends service flow initiation and service flow termination requests to an instrument control agent, and the control instrument initiates a service flow and terminates the service flow, wherein the service flow lasts for time T';

test controller at T₃Constantly receiving a notice that the service returned by the instrument control agent stops sending, and initiating a connection deletion request to the multi-domain controller;

test controller at T₄And receiving a connection deletion success message from the multi-domain controller at the moment.

5. The method of claim 4, wherein the test controller tests the performance of the optical network at T₄After the step of receiving the connection deletion success message from the multi-domain controller, the method also comprises the following steps:

after waiting the time T ", the controller performs the steps of claim 4 again.

6. The method according to claim 4, wherein the method for testing performance of the software defined optical network,

the test controller continuously initiates a connection establishment request to the multi-domain cooperative controller for multiple times and receives a connection establishment success message;

the test controller continuously sends a plurality of service flow initiating requests and service flow deleting requests to the instrument control agent;

and the test controller continuously initiates a connection deletion request to the multi-domain cooperative controller for multiple times and receives a connection deletion success message.

7. The method according to claim 4, wherein the method for testing performance of the software defined optical network,

T＝1.5×Z

Z＝Y-(T₂’-T₁’)-(S-X)

wherein,

T₁': the moment test controller sends a connection establishment request message to the cooperative controller;

T₂': the time test controller receives the connection of the cooperative controllerCreating a success message;

T₄': at T₁Before the moment, the test controller receives a connection deletion success message of the cooperative controller;

s: from T₄To T₁', the waiting time of the test controller;

X：T₄' delay time from traffic interruption;

y: under the condition that the data instrument continuously sends out the service flow, the instrument monitors the obtained service interruption duration;

z: at T₂' delay time between time and traffic recovery.

8. The method according to claim 5, wherein the method for testing performance of the software defined optical network,

T”＝1.5×Z

Z＝Y-(T₂’-T₁’)-(S-X)

wherein,

T₁': the moment test controller sends a connection establishment request message to the cooperative controller;

T₂': the test controller receives a successful connection establishment message of the cooperative controller at the moment;

T₄': at T₁Before the moment, the test controller receives a connection deletion success message of the cooperative controller;

s: from T₄To T₁', the waiting time of the test controller;

X：T₄' delay time from traffic interruption;

y: under the condition that the data instrument continuously sends out the service flow, the instrument monitors the obtained service interruption duration;

z: at T₂' delay time between time and traffic recovery.

9. The method according to claim 7, wherein the software defined optical network performance testing method,

T’＝3T。

10. the method according to any of claims 7 to 9, further comprising the steps of:

and gradually reducing the value of S to obtain that S is X when the service creation is unsuccessful.