JP2017103625A - Control system, control device, control method, and control program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To enable processing synchronized between management systems to be performed in parallel.SOLUTION: A control system includes: a plurality of management systems 92 that manages the connection state of nodes and constructs a network using the nodes; and an integrated management system 91 that controls the plurality of management systems. The integrated management system 91 includes a setting order adjustment unit 11 that refers to a setting order flow in which the order of processing executed by each of the management systems is defined and causes each of the management systems to execute processing related to network settings in the order described in the setting order flow.SELECTED DRAWING: Figure 2

Description

  The present invention relates to a technique for realizing flexible and parallel processing network management by adjusting a setting order between management systems in a service node or network design system or management system.

  Currently, studies such as SDN (Software Defined Networking) and NFV (Network Function Virtualization) are being conducted as a virtualization technology for communication networks and a network appliance virtualization technology.

  SDN is a technology that is being standardized by ONF (Open Networking Foundation) (see, for example, Non-Patent Document 1). When SDN is used, when an SDN device is arranged at each site, the SDN controller that manages the SDN device can make settings such as opening, changing, and deleting a path end-to-end. For this reason, the arrangement of the SDN device in the communication network has advantages such as automation of SO (Service Order) and shortening of construction time.

  Further, the network virtualization technology has an advantage that an operation of sharing one physical network among a plurality of users can be performed regardless of the physical configuration of the network. NFV is a technology that is being standardized by ETSI NFV (see, for example, Non-Patent Document 2). As described above, standardization of a management system for automatic provisioning of a virtualized network appliance is being studied by using a virtualization technology for network devices such as servers.

  FIG. 1 shows an example of a communication network. The node 94 is a node that provides a service, and the node 93 is a network node that connects nodes that provide a service. Each node may be a physical node or a virtual node. Each node 93 is connected to a control network of a management system 92 that manages each domain. There is also an integrated management system 91 that controls a plurality of domains. A user can receive an end-to-end service by controlling a service across domains from the integrated management system 91. The plurality of nodes 94 function as NFV devices, 93 functions as an SDN device, and the management system 92 functions as a virtual infrastructure management device if it is NFV, and as an SDN controller if it is controlled by the SDN device. The integrated management system 91 functions as an NFV orchestrator.

  In the conventional NFV system, the integrated management system 91 and the management system 92 are systems having independent functions, and various commands between the systems are set by specifying them with an abstract interface. The NFV setting is normally controlled from the NFV manager and set independently of the management system. However, when considering scalability and parallel execution of processes, it is better to be able to work from a separate management system. However, in this case, when the management system 92 tries to perform processing sequentially according to the command of the integrated management system 91, a waiting time for a response from another management system 92 occurs at an arbitrary timing.

  In addition, in the case where the processing in the management system 92 is a work that can be performed independently of the other management systems 92, there is little dependency on the setting order, but depending on the contents set by each management system 92, the other management systems 92 There may be use cases that require sequential processing so that the next work can only be performed after the work of other management system 92 is completed. I can't.

“Software-Defined Networking: The New Norm for Networks”, ONF white paper, 2012. “Network Functions Virtualization-Introduction White Paper”, ETSI, Oct. 2012.

  Therefore, an object of the present invention is to enable synchronized processing between management systems to be performed in parallel.

  The present invention is provided with a function (setting order adjustment unit) for adjusting the setting order and a setting order table in the integrated management system, and the setting order table describes the timing created by the user or application and executed for each management system. It is. The management system notifies the integrated management system when a certain setting operation is completed according to the setting, and the setting order adjustment unit adjusts the timing by adjusting the setting order of each management system as a broker.

Specifically, the control system according to the present invention is:
Multiple management systems to control the nodes;
An integrated management system for causing the management system to construct a network using the nodes;
A control system comprising:
The integrated management system includes:
A process to be executed by the management system for constructing the network and a setting order flow that defines the order of the processes are acquired, and the process defined by the setting order flow is performed in the order determined by the setting order flow. A setting order adjustment unit that generates an execution request to request execution,
An execution request from the setting order adjustment unit is transmitted to the management system corresponding to the process defined by the setting order flow, and an end notification indicating that the execution of the process defined by the execution request is completed is sent to the management system. An integrated management system communication unit that receives from,
The plurality of management systems include:
A process execution unit for constructing the network by executing a process defined by the execution request;
A management system that outputs the execution request transmitted from the integrated management system to the process execution unit, and transmits the completion notification to the integrated management system when the execution of the process defined by the execution request is completed in the process execution unit And a communication unit.

The integrated management system includes:
A storage unit that holds an order rule that defines an execution order of processing when constructing a network using the node;
When the information on the network to be constructed using the node is input, the execution order of the processes used when configuring the network is determined so as to conform to the order rule held in the storage unit, A setting order flow generation unit that generates the setting order flow.

Specifically, the control device according to the present invention is:
Multiple management systems to control the nodes;
An integrated management system for causing the management system to construct a network using the nodes;
A control device functioning as the integrated management system provided in a control system comprising:
A process to be executed by the management system for constructing the network and a setting order flow that defines the order of the processes are acquired, and the process defined by the setting order flow is performed in the order determined by the setting order flow. A setting order adjustment unit that generates an execution request to request execution,
An execution request from the setting order adjustment unit is transmitted to the management system corresponding to the process defined by the setting order flow, and an end notification indicating that the execution of the process defined by the execution request is completed is sent to the management system. An integrated management system communication unit to receive from,
Is provided.

Specifically, the control device according to the present invention is:
Multiple management systems to control the nodes;
An integrated management system for causing the management system to construct a network using the nodes;
A control device functioning as the management system provided in a control system comprising:
A request to execute the process defined in the setting order flow in the order determined by the setting order flow that defines the process to be executed by the management system and the order of the process in order to construct the network A process execution unit for constructing the network by executing a process determined by the execution request;
The execution request transmitted from the integrated management system is output to the process execution unit, and when execution of the process defined by the execution request is completed in the process execution unit, execution of the process defined by the execution request is completed A management system communication unit that transmits a notification of completion to the integrated management system;
Is provided.

Specifically, the control method of the integrated management system according to the present invention is:
Multiple management systems to control the nodes;
An integrated management system for causing the management system to construct a network using the nodes;
A control method executed by the integrated management system provided in the control system comprising:
The integrated management system is
A process to be executed by the management system for constructing the network and a setting order flow that defines the order of the processes are acquired, and the process defined by the setting order flow is performed in the order determined by the setting order flow. A step of transmitting an execution request for requesting execution to the management system corresponding to the processing defined in the setting order flow is executed.

Specifically, the control method of the management system according to the present invention is:
Multiple management systems to control the nodes;
An integrated management system for causing the management system to construct a network using the nodes;
A control method executed by the management system provided in the control system comprising:
The management system is
A request to execute the process defined in the setting order flow in the order determined by the setting order flow that defines the process to be executed by the management system and the order of the process in order to construct the network Receiving an execution request from the integrated management system;
Setting the network by executing a process defined by the execution request;
When the execution of the process defined by the execution request is completed, sending an end notification to the integrated management system that the execution of the process defined by the execution request is completed;
Are executed in order.

  Specifically, the control program according to the present invention is a program for causing a computer to function as the integrated management system according to the present invention. For example, the control program according to the present invention is a program for causing a computer to execute the steps provided in the control method of the integrated management system according to the present invention. The control program according to the present invention may be recorded on a computer-readable storage medium.

  Specifically, the control program according to the present invention is a program for causing a computer to function as the management system according to the present invention. For example, the control program according to the present invention is a program for causing a computer to execute each step included in the management system control method according to the present invention. The control program according to the present invention may be recorded on a computer-readable storage medium.

  According to the present invention, synchronized processing between management systems can be performed in parallel, and processing time can be shortened.

An example of a communication network is shown. An example of the control system which concerns on Embodiment 1 is shown. 3 shows a configuration example of an integrated management system according to the first and second embodiments. 2 shows a configuration example of a management system according to the first embodiment. An example of a setting profile is shown. An example of a setting order flow is shown. An example of the procedure in the previous stage for constructing the network in the first embodiment will be described. An example of the sequence of the control system at the time of constructing the network in Embodiment 1 is shown. 4 shows a network setting example according to a setting order flow Df according to the first embodiment. 2 shows an example of a sequence of a control system when an error occurs in processing in the first embodiment. An example of rollback according to a setting order flow Df according to the first embodiment will be described. The example of the abolition of the network according to the setting order flow Df which concerns on Embodiment 1 is shown. An example of the control system which concerns on Embodiment 2 is shown. 3 shows a configuration example of a management system according to a second embodiment. An example of a procedure in a previous stage for constructing a network in the second embodiment will be described. An example of the sequence of the control system at the time of constructing the network in Embodiment 2 is shown. An example of a setting order flow transmitted to the management system 92 # 1 is shown. An example of a setting order flow transmitted to the management system 92 # 2 is shown. The example of construction of the network according to setting order flow Df concerning Embodiment 2 is shown. 10 shows an example of a sequence of a control system when an error occurs in processing in the second embodiment. The example of rollback according to the setting order flow Df which concerns on Embodiment 2 is shown. A network abolition example according to the setting order flow Df according to the second embodiment will be described. 10 illustrates a configuration example of an integrated management system according to a third embodiment. The 1st and 2nd setting order flow production | generation methods are shown. The 3rd setting order flow production | generation method is shown. The 4th setting order flow production | generation method is shown. The 1st example of the prior input of the 4th setting order flow production | generation method is shown. The 2nd example of the prior input of the 4th setting order flow production | generation method is shown.

  Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings. In addition, this invention is not limited to embodiment shown below. These embodiments are merely examples, and the present invention can be implemented in various modifications and improvements based on the knowledge of those skilled in the art. In the present specification and drawings, the same reference numerals denote the same components.

(Embodiment 1)
FIG. 2 shows an example of a network management system according to the present embodiment. The network management system according to the present embodiment includes a plurality of management systems 92 and an integrated management system 91. The network management system according to the present embodiment uses the integrated management system 91 and the management system 92 to construct a network composed of nodes 93 and service nodes 94. Each of the integrated management system 91 and the management system 92 may be configured as a single device, or may be function-distributed in a plurality of devices. The network according to the present embodiment may be configured with a virtual network or a physical network.

  The node 93 is an arbitrary node that can construct a network. For example, a virtual router or a virtual switch. The service node 94 is a node that provides a user terminal and a service to which the user terminal is connected. The service providing node is, for example, a virtual node that provides a network appliance, an application, and a database. The management system 92 manages and controls the connection state between the node 93 and the service node 94. The integrated management system 91 controls a service across one or more management systems 92 constructed by the node 93 and the service node 94.

  The management system 92 is provided for each base having different management of the communication network composed of the node 93 and the service node 94. For example, the management system 92 # 1 is provided in the management base # 1 of the communication network, the management system 92 # 2 is provided in the management base # 2 of the communication network, and the management system 92 # 3 is provided in the management base # 3 of the communication network. 2 shows an example in which one management system 92 is provided at each base, but a plurality of management systems 92 may be provided at each base.

  FIG. 3 shows a configuration example of the integrated management system 91. The integrated management system 91 includes a setting order adjustment unit 11, a management system communication unit 12 that functions as an integrated management system communication unit, a processing execution unit 13, a management system management unit 16, and a setting order flow input unit 14A. FIG. 4 shows a configuration example of the management system 92 according to the present embodiment. The management system 92 includes a management system communication unit 22 and a process execution unit 23.

  The management system management unit 16 manages information on each node 93 and service node 94 controlled by each management system 92. Information managed in the management system management unit 16 is arbitrary, but for example, parameters of each process can be exemplified. Identification information, IP address information, authentication information, connection information between the management systems 92, and the like of the management system 92 are managed.

  The setting order flow input unit 14A is a functional unit for giving the setting order flow Df to the integrated management system 91. In the setting order flow input unit 14A, the user inputs the setting order flow Df. Alternatively, the setting order flow Df may be acquired from an arbitrary node, for example, the node 93 and the node 94, or the management system 92. Specifically, API (Application Programming Interface) such as GUI (Graphical User Interface) or REST (Representation State Transfer) is used, FTP (File Transfer Protocol) such as FTP (Transfer Protocol using FTP), FTP Input the settings.

  The setting order adjustment unit 11 divides the processing into the contents to be processed in each management system 92 according to the setting order flow Df, and determines the setting order in each management system 92. As shown in FIG. 6, the setting order flow Df determines the process to be executed by the management system 92 and the order of the process in order to construct a network. The setting order adjustment unit 11 makes a setting request for the setting order flow Df executed in each management system 92, performs processing status management, and executes the next processing after the processing ends. By adjusting the setting order, the timing at which each management system 92 executes processing is adjusted.

  The setting order adjustment unit 11 in this embodiment adjusts the setting order of processes in each management system 92 by transmitting a “setting start request” to each management system 92 for each process to be executed by the management system 92. In the present embodiment, “setting start request” corresponds to “execution request”, and “setting end notification” corresponds to “end notification”. The “execution request” is a control signal for requesting execution of processing defined in the setting order flow Df in the order determined in the setting order flow Df. The “end notification” is a response signal indicating that the execution of the process determined by the execution request has ended. Specifically, it may wait for the management system process to end, and then move to the next process after the end, or periodically poll the management system process and monitor the status. May be confirmed.

  The management system communication unit 12 has a function of communicating with each management system 92. For example, the management system communication unit 12 transmits a “setting execution request” to the management system 92 and receives a “setting preparation completion notification” from the management system 92. For example, the management system communication unit 12 transmits a “setting start request” to the management system 92 and then receives a “setting end notification” from the management system 92. For example, when receiving the “error notification” from the management system 92, the management system communication unit 12 transmits a “rollback start request” to the management system 92, and then receives a “rollback end notification” from the management system 92. Specifically, communication is performed using a communication tool such as SSH (Secure Shell), Telnet (TELecommunication Network), or the like.

  When the integrated management system 91 has a function for setting a VNF (Virtual Network Function) or an application, the process execution unit 13 communicates directly with the node 93 or the service node 94 to perform the setting. When the management system 92 includes the function, the integrated management system 91 may not include the process execution unit 13.

  The process execution unit 23 executes the process requested by the setting start request. For example, by controlling the service node 94, the connection relationship between the nodes 93 is changed. Specifically, the setting information is input to the node by using an automatic setting tool such as Ansible or Chef.

  The management system communication unit 22 has a function of communicating with the integrated management system 91. For example, the management system communication unit 22 receives the setting start request transmitted from the integrated management system 91 and outputs it to the process execution unit 23. When the execution of the process determined by the setting start request is completed, the management system communication unit 22 transmits a setting end notification to the integrated management system 91. Specifically, the integrated management system 91 and the management system 92 communicate using a communication tool such as SSH or Telnet. The node 94 may be set directly from the integrated management system 91. In that case, the integrated management system 91 preferably includes a setting order adjustment unit 11, a setting order flow input unit 14 </ b> A, and a process execution unit 13.

  FIG. 5 shows an example of the setting profile. In the setting profile, identification information and processing contents of the management system 92 to be executed are determined for each of the processes DP1 to DP8. The setting profile may further include an order rule for each of the processes DP1 to DP8. Here, the order rule is a rule that defines the order for each processing content, and includes an execution order rule, an abolition order rule, and a rollback order rule. The execution order rule is a rule that defines the order in which the management system 92 executes processing when setting a service. The abolition order rule is a rule that defines the order in which the management system 92 executes processing when the service setting contents are abolished. The rollback order rule is a rule indicating the order in which the management system 92 executes processing when an error occurs when setting or canceling a service setting.

  FIG. 6 shows an example of the setting order flow. When the process DP1 is executed, according to the execution order rule of the process DP1, the process DP1 and the process DP2 are executed simultaneously. Therefore, the process DP1 and the process DP2 are executed in parallel.

  According to the execution order rule of the process DP3, if the execution of the process DP1 is successful, the process DP3 is executed. Further, according to the execution order rule of the process DP5, if the process DP2 is successfully executed, the process DP5 is executed. Further, according to the execution order rule of the process DP3, the processes DP3 and DP5 can be executed simultaneously, and the parameters of the process DP3 are set to the process DP5. Therefore, the process DP3 and the process DP5 are executed in parallel after the process DP1 and the process DP2.

  According to the execution order rule of the process DP4, the process DP4 is executed if the process DP3 is successfully executed. Further, according to the execution order rule of the process DP6, the process DP6 is to be executed after the process DP5 is completed. Therefore, the process DP4 is executed after the process DP3 is finished, and the process DP6 is executed after the process DP4 and the process DP5. Further, according to the execution order rules of the processes DP7 and DP8, the processes DP7 and DP8 are to be executed after the processes DP4 and DP6 are finished. Therefore, the process DP7 and the process DP8 are executed in parallel after the process DP4 and the process DP6.

  FIG. 7 shows an example of a procedure in the previous stage of processing using the setting order flow. When the integrated management system 91 acquires or generates a setting order flow (S171), the integrated management system 91 refers to the management system management unit 16 to acquire information of the management system 92 (S172), communicates with the management system 92, and sets the setting order flow. It is confirmed whether there is an authority or a resource for executing Df. For example, it is confirmed whether the authority 93 and the resources (CPU, memory, capability, etc.) sufficient to implement the setting order flow Df are in the nodes 93 and 94 under the management system 92 (S173).

FIG. 8 shows an example of a sequence of a control system when constructing a network.
The integrated management system 91 communicates with the management systems 92 # 1 and 92 # 2, and confirms the resources of the setting order flow Df (S173-1 to S173-3). For example, the integrated management system 91 notifies the setting execution request to the management systems 92 # 1 and 92 # 2 (S173-1), and receives setting preparation completion notifications from all the related management systems 92 # 1 and 92 # 2. (S173-3). In response to this, the control system starts processing according to the setting order flow Df. When the processes S11, S12, S13, and S14 of the management systems 92 # 1 and 92 # 2 are completed, the process using the setting order flow is completed.

  FIG. 9 shows a network setting example according to the setting order flow Df. In FIG. 9, the case of S11S, S12S, S13S, and S14S in which all the processes S11 to S14 are completed normally will be described.

  When the integrated management system 91 receives a network service setting request (S111), the setting order flow input unit 14A acquires the setting order flow, or the setting order flow generation unit 14B generates the setting order flow (S171). . Then, the processing of the control system according to the setting order flow Df starts.

  The setting order flow Df describes that the processes DP1 and DP2 are executed simultaneously (S11). According to the setting profile, the management system that executes the process DP1 is # 1, and the management system that executes the process DP2 is # 2. Therefore, the setting order adjustment unit 11 notifies the setting start request for the process DP1 to the management system 92 # 1, and notifies the setting start request for the process DP2 to the management system 92 # 2 (S112-1).

  The management system 92 # 1 executes the process DP1 (firewall and router setting) (S121-1), and when the execution is successful, the integrated management system 91 notifies the integrated management system 91 that the process DP1 has ended (S122). -1). The management system 92 # 2 executes the process DP2 (firewall and router setting) (S131-1), and when the execution is successful, notifies the integrated management system 91 that the process DP2 has ended (S132). -1).

  The integrated management system 91 receives the setting end notification of the process DP1 from the management system 92 # 1, and receives the setting end notification of the process DP2 from the management system 92 # 2. Thereby, the setting order adjustment unit 11 determines that S11 has been completed normally.

  The setting order flow Df describes that the processes DP3 and DP5 can be executed simultaneously after the processes DP1 and DP2 (S12S). According to the setting profile, the management system that executes the process DP3 is # 1, and the management system that executes the process DP5 is # 2. Therefore, the setting order adjusting unit 11 notifies the management system 92 # 1 of a setting start request for the process DP3 (load balancer setting), and notifies the management system 92 # 2 of a setting start request for the process DP5 (database setting). (S112-2).

  When the management system 92 # 1 receives the setting start request for the process DP3, the management system 92 # 1 executes the process DP3 (S121-2). In the process DP3, the parameters obtained by the process are notified after the process is executed. Therefore, the management system 92 # 1 transmits a setting end notification and parameters to the integrated management system 91 (S122-2). The integrated management system 91 transfers the received parameters of the process DP3 to the management system 92 # 2 that executes the process DP5 (S115).

  When the management system 92 # 2 receives the setting start request for the process DP5, the management system 92 # 2 executes the process DP5 (S131-2). At this time, the management system 92 # 2 uses the parameters received from the integrated management system 91. When the execution of the process DP5 is successful, the management system 92 # 2 notifies the integrated management system 91 that the process DP5 has ended (S132-2).

  Since the parameter obtained by DP3 of the management system 92 # 1 is necessary in the process DP5, for example, when the parameter is the IP address of the virtual node, the database setting which is the DP5 setting is performed until the process immediately before the IP address is necessary. Alternatively, if it can be processed as an arbitrary parameter in the DP5 process, the process proceeds as an arbitrary parameter N, and after receiving the DP3 parameter, the IP address is input to the parameter N and the change is made. You may set only the setting of the necessary part.

  Here, according to the setting profile, the processing DP4 (setting of the web application) is performed after the processing DP3 (setting of the load balancer). The main body that executes the process DP3 and the process DP4 is the management system 92 # 1. Therefore, in step S112-2, the setting order adjustment unit 11 may further notify the management system 92 # 1 of a setting start request for performing the process DP4 after the process DP3. In this case, when the execution of the process DP3 is successful, the management system 92 # 1 executes the process DP4 (S123-2). When the execution of the process DP4 is successful, a setting completion notification indicating that the process DP4 has ended is sent to the integrated management system 91 (S124-2).

  The integrated management system 91 receives the setting end notification of the process DP5 from the management system 92 # 2. Thereby, the setting order adjustment unit 11 determines that S12 is completed in the management system 92 # 2 (S12S). At this time, if the notification of the completion of the setting of the process DP4 in the management system 92 # 1 has been received, it may be determined that the management system 92 # 1 has also completed S12. If not, the management system 92 # 1 continues. The processes of S12 and S13 may be performed in parallel.

  The setting order flow Df describes that the process DP6 (setting of the user accommodation terminal) is executed after the process DP5. According to the setting profile, the management system that executes the process DP6 is # 1. Therefore, the setting order adjustment unit 11 notifies the management system 92 # 1 of a setting start request for the process DP6 (S112-3).

  The management system 92 # 1 executes the process DP6 (S121-3). When the execution of the process DP6 is successful, the management system 92 # 1 notifies the integrated management system 91 that the process DP6 has ended (S122-3).

  The integrated management system 91 receives a setting completion notification for the process DP6 from the management system 92 # 1. Thereby, the setting order adjustment unit 11 determines that S13 is completed (S13S).

  The setting order flow Df describes that processing DP7 and processing DP8 (transmission of test packets) are executed simultaneously after processing DP4 and processing DP6. Therefore, S14 is implemented after S12 and S13 are completed. According to the setting profile, the management system that executes the process DP7 is # 1, and the management system that executes the process DP8 is # 2. Therefore, the setting order adjustment unit 11 notifies the management system 92 # 1 of setting start requests for the processing DP7 and the processing DP8 (S112-4).

  The management system 92 # 1 executes the process DP7 (S121-4). If the execution of the process DP7 is successful, the management system 92 # 1 notifies the integrated management system 91 that the process DP7 has ended (S122-4). The management system 92 # 2 executes the process DP8 (S131-4). When the execution of the process DP8 is successful, the management system 92 # 2 notifies the integrated management system 91 that the process DP8 has ended (S132-4).

  In the setting order flow Df, no processing is described after the processing DP7 and DP8. In this case, the setting order adjustment unit 11 determines that the processing according to the setting order flow Df has been completed. Thereby, the setting of the network service is completed (S119).

  As described above, upon receiving a network service setting request (S111), the control system according to the present embodiment sets the network service according to the setting order flow Df in accordance with the execution order rule described in the setting profile. I do. Although the test items are entered in the setting profile as in processing DP7 and processing DP8, a general-purpose test such as communication confirmation may be performed without writing in the setting profile.

  FIG. 10 shows an example of a sequence of the control system when an error occurs in the process. FIG. 11 shows an example of rollback according to the setting order flow Df. 10 and 11, the case where the process S11 succeeds (S11S), the process S12 fails (S12E), and the process 13 is a rollback process (S13R) will be described.

  For example, if the management system 92 # 1 fails to execute the process DP4, the management system 92 # 1 notifies the integrated management system 91 of an error indicating that the process execution has failed (S129). In this case, the integrated management system 91 transmits a rollback start request to the management systems 92 # 1 and 92 # 2 according to the setting profile.

  According to the setting profile, when rollback occurs in the processes DP3 to DP6, the process DP4 is stopped after the DP5 is stopped. Therefore, the setting order adjustment unit 11 of the integrated management system 91 notifies the management system 92 # 2 of a rollback start request for the process DP5 (S141).

  When the management system 92 # 2 receives the rollback start request for the process DP5, the management system 92 # 2 stops the process DP5 (S161). Since the processing content of the processing DP5 is database startup, the management system 92 # 2 stops the database started in S133. When the stop of the process DP5 is completed, the management system 92 # 2 notifies the integrated management system 91 that the rollback of the process DP5 has ended (S162).

  When the setting order adjustment unit 11 of the integrated management system 91 receives the rollback end notification of the process DP5, it notifies the management system 92 # 1 of a rollback start request for the process DP4 (S142). Here, according to the setting profile, when rollback occurs in the processes DP3 to DP6, the process DP3 is stopped after the DP4 is stopped. Therefore, in step S142, the setting order adjustment unit 11 may further notify the management system 92 # 1 of a rollback start request for stopping the process DP3 after the process DP4 is stopped.

  When receiving the rollback start request for the process DP4, the management system 92 # 1 stops the process DP4 (S151). Since the processing content of the processing DP4 is activation of the web application, the management system 92 # 1 stops the web application that is to be activated.

  When the stop of the process DP4 is completed, the management system 92 # 1 stops the process DP3 (S152). Since the processing content of the processing DP3 is activation of the load balancer, the management system 92 # 1 stops the activated load balancer. When the stop of the process DP3 is completed, the management system 92 # 1 notifies the integrated management system 91 that the rollback of the process DP4 and the process DP3 has ended (S153).

  The integrated management system 91 receives the rollback end notification of process DP3. Thereby, the setting order adjustment unit 11 determines that the rollback process has been completed (S13R).

  As described above, since the integrated management system 91 includes the setting order adjustment unit 11 in the control system according to the present embodiment, each management system 92 performs processing according to the order described in the setting order flow Df. Can do. Therefore, it is possible to control the setting order of the service nodes 94 between the management systems 92.

  Here, since the integrated management system 91 manages the setting order of the management systems 92, synchronized processing between the management systems 92 can be performed in parallel. For this reason, the management system 92 that should make a response can respond quickly, and the time required for setting can be shortened.

  In particular, since the setting profile also includes the rollback order, efficient recovery can be enabled.

  In the present embodiment, a case has been described in which a network service setting request is received in step S111. However, the present embodiment is not limited to this. For example, as shown in FIG. 12, when a request for abolition of the network service is received in step S111, the control system according to the present embodiment conforms to the abolition order rule described in the setting profile, similarly to the setting of the network service. The network service is abolished according to the setting order flow Df.

(Embodiment 2)
FIG. 13 shows an example of a control system according to this embodiment. The configuration of the integrated management system 91 is the same as that shown in FIGS. FIG. 14 shows an example of the configuration of the management system 92 according to this embodiment. The management system 92 includes a setting order adjustment unit 21, a management system communication unit 22, and a process execution unit 23.

  The setting order adjustment unit 11 adjusts the setting order of processing according to the setting order flow Df. In this embodiment, the setting order adjustment unit 11 in this embodiment adjusts the setting order of processing in each management system 92 by transmitting a “setting execution request” and a setting order flow Df to each management system 92. In the present embodiment, “setting execution request” corresponds to “execution request”, and “all setting end notification” corresponds to “end notification”. The “execution request” is a control signal for requesting execution of processing defined in the setting order flow Df in the order determined in the setting order flow Df. The “end notification” is a response signal indicating that the execution of the process determined by the execution request has ended. The setting order adjustment unit 11 is not necessary when the setting order flow input unit 14A inputs the setting order flow Df separately for each management system.

  The management system communication unit 12 has a function of communicating with each management system 92. In the present embodiment, the management system communication unit 12 provided in the integrated management system 91 transmits the setting order flow Df to the management system 92 together with the “setting execution request”, and then receives the “all setting end notification” from the management system 92. . For example, when receiving the “error notification” from the management system 92, the management system communication unit 12 transmits a “rollback start request” to the management system 92, and then receives “all rollback end notification” from the management system 92. . Specifically, the management systems 92 communicate with each other using a communication tool such as SSH or Telnet.

  The setting order adjustment unit 21 adjusts the setting implementation status between the management systems 92 for each setting order flow Df of the management system 92 input from the setting order adjustment unit 11 of the integrated management system 91. Specifically, it may wait for the process of the other management system 92 to end, and may move to the next process after the end, or periodically poll the process of the other management system 92 to The situation may be confirmed by monitoring.

  The process execution unit 23 executes the process defined by the setting order flow Df. The setting order adjustment unit 21 adjusts the setting order of processes executed by the process execution unit 23 according to the setting order flow Df. Specifically, the setting information is input to the node by using an automatic setting tool such as Ansible or Chef.

  The management system communication unit 22 has a function of communicating with the integrated management system 91. For example, the management system communication unit 22 receives the setting execution request and the setting order flow Df and outputs them to the setting order adjustment unit 21. Then, when the execution of the process determined by the setting order flow Df ends, the management system communication unit 22 transmits an all setting end notification to the integrated management system 91. Specifically, the integrated management system 91 and the management system 92 communicate using a communication tool such as SSH or Telnet.

  In the present embodiment, the management system communication unit 22 included in the management system 92 further has a function of communicating with other management systems 92. For example, when the processing defined in the setting order flow Df ends, the management system communication unit 22 included in the management system 92 # 1 transmits a setting end notification to the other management system 92 # 2 defined in the setting order flow Df. To do. In addition, the management system communication unit 22 included in the management system 92 # 1 receives a setting end notification from the other management system 92 # 2.

  FIG. 15 shows an example of a procedure in a previous stage for constructing a network. When the integrated management system 91 acquires or generates a setting order flow (S171), the integrated management system 91 refers to the management system management unit 16 to acquire information on the management system 92 (S172), and sets the setting order flow Df for each corresponding management system 92. Is transmitted to the management system 92 together with the setting execution request (S174). Communication is performed between the integrated management system 91 and each management system 92, and it is confirmed whether there is an authority or resource sufficient to execute the setting order flow Df (S175). The order of S174 and S175 may be reversed.

  FIG. 16 shows an example of a sequence of a control system when building a network. The management system communication unit 12 of the integrated management system 91 transmits the setting order flow Df to the management systems 92 # 1 and 92 # 2 together with the setting execution request (S174). First, the management systems 92 # 1 and 92 # 2 confirm the status of the setting order flow Df (S175-1), and if they can be confirmed, send a setting preparation completion notification to each other (S175-2). In response to this, the management systems 92 # 1 and 92 # 2 start processing according to the setting order flow Df.

  Each management system 92 # 1 and 92 # 2 confirms the start of the setting order flow when performing the processes S21, S22, S23, and S24 described in the setting order flow Df. For example, the management systems 92 # 1 and 92 # 2 perform setting order flow start confirmation for confirming that the process S21 is executed before executing the process S21.

  When all the processes S21, S22, S23, and S24 described in the setting order flow Df are completed, each management system 92 # 1 and 92 # 2 transmits an all setting end notification to the integrated management system 91 (S176). When the integrated management system 91 receives the notification of completion of all settings from the management systems 92 # 1 and 92 # 2, the processing according to the setting order flow Df is completed.

  Here, in step S174, the integrated management system 91 preferably encrypts the setting order flow Df to be transmitted to each management system 92. Thereby, it is possible to prevent leakage of the details of the setting information of each management system 92.

  The setting order flow Df to be transmitted to each management system 92 may be the entire setting order flow created by the integrated management system 91, but the individual setting order flow obtained by separating the setting order flow Df for each management system 92. It is preferable that Thereby, the data amount of the setting order flow Df transmitted to each management system 92 can be reduced.

  FIGS. 17 and 18 show examples of individual setting order flows transmitted to the management systems 92 # 1 and 92 # 2, respectively. The setting profiles shown in FIG. 5 may be held in advance by the management systems 92 # 1 and 92 # 2, or may be attached when the setting order flow Df is transmitted. Further, the contents of the setting profile may be embedded in the setting order flow Df.

FIG. 19 shows a network setting example according to the setting order flow Df. In FIG. 19, the case of S21S, S22S, S23S, and S24S in which all the processes S21 to S24 have been normally completed will be described.
When the integrated management system 91 receives a network service setting request (S111), the setting order flow input unit 14A acquires the setting order flow, or the setting order flow generation unit 14B generates the setting order flow (S171). . Thereby, the setting order adjustment unit 11 acquires the setting order flow shown in FIG. The setting order adjustment unit 11 transmits the setting order flow Df to the management systems 92 # 1 and 92 # 2 (S174). Then, the processing of the control system according to the setting order flow Df starts.

  The setting order adjustment unit 21 of the management system 92 # 1 performs a setting order flow start confirmation to start execution of the process DP1 with the management system 92 # 2. The setting order adjustment unit 21 of the management system 92 # 2 performs a setting order flow start confirmation to start execution of the process DP2 with the management system 92 # 1. After this confirmation, the process execution unit 23 of the management system 92 # 1 executes the process DP1 (S121-1), and the process execution unit 23 of the management system 92 # 2 executes the process DP2 (S131-1).

  If the execution of the process DP1 is successful, the setting order adjustment unit 21 of the management system 92 # 1 sends a setting completion notification to the management system 92 # 2 that the process DP1 has ended (S122-1). When the execution of the process DP2 is successful, the setting order adjustment unit 21 of the management system 92 # 2 sends a setting completion notification to the management system 92 # 1 indicating that the process DP2 has ended (S132-1). In this way, the management systems 92 # 1 and 92 # 2 transmit and receive a setting end notification to each other when the execution of the processing is completed.

  When the execution of the process DP1 ends, the setting order adjustment unit 21 of the management system 92 # 1 confirms the setting order flow start confirmation that the execution of the process DP3 starts according to the setting order flow shown in FIG. And do. After this confirmation, the process execution unit 23 of the management system 92 # 1 executes process DP3 (S121-2). When the execution of the process DP3 ends normally, the setting order adjustment unit 21 of the management system 92 # 1 transmits a setting end notification to the management system 92 # 2 (S122-2). In the process DP3, parameters are notified after the process is executed. Therefore, the setting order adjustment unit 21 of the management system 92 # 1 transmits the parameters to the management system 92 # 2 (S122-2).

  When the execution of the process DP3 ends, the setting order adjustment unit 21 of the management system 92 # 1 confirms the setting order flow start confirmation to start the execution of the process DP4 according to the setting order flow shown in FIG. And do. After this confirmation, the process execution unit 23 of the management system 92 # 1 executes process DP4 (S123-2). When the execution of the process DP4 ends normally, the setting order adjustment unit 21 of the management system 92 # 1 transmits a setting end notification to the management system 92 # 2 (S124-2).

  On the other hand, when the execution of the process DP2 ends, the setting order adjustment unit 21 of the management system 92 # 2 confirms the setting order flow start confirmation that the execution of the process DP5 is started according to the setting order flow shown in FIG. Perform with # 1. After this confirmation, the process execution unit 23 of the management system 92 # 2 executes process DP5 (S131-2). When the execution of the process DP5 ends normally, the setting order adjustment unit 21 of the management system 92 # 2 transmits a setting end notification to the management system 92 # 1 (S132-2).

  When the execution of the process DP4 ends, the setting order adjustment unit 21 of the management system 92 # 1 confirms the setting order flow start confirmation that the execution of the process DP6 starts according to the setting order flow shown in FIG. And do. Here, the process DP6 needs to be after the process DP5 executed by the management system 92 # 2. For this reason, the management system 92 # 1 waits for the setting completion notification of the process DP5 from the management system 92 # 2 and executes the process DP6 (S121-3). When the execution of the process DP6 ends normally, the setting order adjustment unit 21 of the management system 92 # 1 transmits a setting end notification to the management system 92 # 2 (S122-3).

  When the execution of the processing DP4 and the processing DP6 is completed, the setting order adjustment unit 21 of the management system 92 # 1 manages the setting order flow start confirmation that the execution of the processing DP7 is started according to the setting order flow shown in FIG. Perform with system 92 # 2. On the other hand, when the setting order adjustment unit 21 of the management system 92 # 2 receives the setting completion notification of the process DP6 from the management system 92 # 1, the setting order adjustment unit 21 starts execution of the process DP8 according to the setting order flow illustrated in FIG. The forward flow start confirmation is performed with the management system 92 # 1.

  After confirming the start of the setting order flow, the process execution unit 23 of the management system 92 # 1 executes the process DP7 (S111-4), and the process execution unit 23 of the management system 92 # 2 executes the process DP8 (S131- 2). When the execution of the process DP7 ends normally, the setting order adjustment unit 21 of the management system 92 # 1 transmits a setting end notification to the management system 92 # 2 (S122-4). When the execution of the process DP8 ends normally, the setting order adjustment unit 21 of the management system 92 # 2 transmits a setting end notification to the management system 92 # 1 (S132-4).

  When all the processes described in the setting order flow Df are completed, each management system 92 # 1 and 92 # 2 transmits an all setting completion notification to the integrated management system 91 (S176). The integrated management system 91 determines that the setting of the network service is completed when receiving the all setting end notifications from the management systems 92 # 1 and 92 # 2 (S119).

  FIG. 20 shows an example of the sequence of the control system when an error occurs in the process. FIG. 21 shows an example of rollback according to the setting order flow Df. 20 and FIG. 21, the case where the process S21 is successful (S21S), the process S22 is unsuccessful (S22E), and the process 23 is a rollback process (S23R) will be described.

  For example, if the management system 92 # 1 fails to execute the process DP4, the management system 92 # 1 notifies the integrated management system 91 of an error indicating that the process execution has failed (S129). In this case, the setting order adjustment unit 11 of the integrated management system 91 transmits a rollback start request to the management systems 92 # 1 and 92 # 2 according to the setting profile (S177).

  According to the setting profile, when rollback occurs in the processes DP3 to DP6, the process is stopped in the order of DP6, DP5, DP4, and DP3. Further, according to the setting order flow Df of the management system 92 # 1 shown in FIG. 17, if the process DP4 has not ended, the process DP6 is not executed. Since the error notification received by the integrated management system 91 is the error notification of the process DP4, the process DP6 is not executed. Therefore, the setting order adjustment unit 11 of the integrated management system 91 notifies the management systems 92 # 1 and 92 # 2 of a rollback start request for the processes DP3 to DP5 (S177).

  When the setting order adjustment unit 21 of the management system 92 # 2 receives the rollback start request for the processes DP3 to DP5, it stops the process DP5 (S161). On the other hand, the setting order adjustment unit 21 of the management system 92 # 1 waits for a rollback end notification of the process DP5 in accordance with the rollback order rule of the process DP4 described in the setting profile.

  When the process DP5 is stopped (S161), the setting order adjustment unit 21 of the management system 92 # 2 notifies the management system 92 # 1 that the rollback of the process DP5 has ended (S162). The setting order adjustment unit 21 of the management system 92 # 2 sends an all rollback end notification to the integrated management system 91 (S178).

  When the setting order adjustment unit 21 of the management system 92 # 1 receives the rollback end notification of the process DP5, the process DP4 is stopped (S151). When the stop of the process DP4 ends (S151), the setting order adjustment unit 21 of the management system 92 # 1 stops the process DP3 (S152). When the stop of the process DP3 is completed, the management system 92 # 1 notifies the management system 92 # 2 that the rollback of the process DP3 has ended (S153). The setting order adjustment unit 21 of the management system 92 # 1 sends an all rollback end notification to the integrated management system 91 (S178).

  The integrated management system 91 receives all rollback end notifications from the management systems 92 # 1 and 92 # 2. Thereby, the setting order adjustment unit 11 determines that the rollback process has been completed (S23R).

  As described above, the control system according to this embodiment is described in the setting order flow Df because the integrated management system 91 includes the setting order adjustment unit 11 and the management system 92 includes the setting order adjustment unit 21. According to the order, each management system 92 can perform processing. Therefore, it is possible to control the setting order of the service nodes 94 between the management systems 92.

  Here, in the control system according to the present embodiment, the integrated management system 91 provides the setting order flow Df to each management system, communicates between the management systems 92, and exchanges information between the management systems 92 for confirmation. To adjust the order of settings. Thereby, communication to the integrated management system can be reduced.

  In the present embodiment, a case has been described in which a network service setting request is received in step S111. However, the present embodiment is not limited to this. For example, when a request to abolish the network service is received in step S111 as shown in FIG. 22, the control system according to the present embodiment conforms to the abolition order rule described in the setting profile, similarly to the setting of the network service. The network service is abolished according to the setting order flow Df.

(Embodiment 3)
FIG. 23 shows a second example of the configuration of the integrated management system 91. The second example of the integrated management system 91 includes a setting order flow generation unit 14B and a knowledge DB 15 instead of the setting order flow input unit 14A of the first example of the integrated management system 91.

  The setting order flow generation unit 14B generates a setting order flow Df. The setting order flow generation unit 14B outputs the generated setting order flow Df to the setting order adjustment unit 11. Although the method of generating the setting order flow Df is arbitrary, for example, the following can be exemplified.

  When the setting order flow generation unit 14B acquires the setting order flow information, the setting order flow generation unit 14B generates the acquired setting order flow Df as illustrated in FIG. 24 (first setting order flow generation method). Here, the setting order flow information is information on the setting order flow Df described in a format readable by the setting order flow generation unit 14B.

  When the setting order flow generation unit 14B acquires the setting profile information, the setting order flow generation unit 14B generates the setting order flow Df using the setting profile information as illustrated in FIG. 24 (second setting order flow generation method). Here, the setting profile information is information describing the processing contents for each management system 92, and includes an order rule for executing the processing.

  When the setting order flow generation unit 14B acquires information such as nodes and connection relationships, the setting order flow generation unit 14B generates a setting order flow Df using an order rule as illustrated in FIG. 25 (third setting order flow generation method). Specifically, an order flow related to information such as nodes and connection relationships is searched, and a setting flow is generated in view of the correlation or priority order between the order flows.

  When the setting order flow generation unit 14B acquires information such as nodes and connection relations, the setting order flow generation unit 14B generates a setting order flow Df using data stored in the knowledge DB 15 as illustrated in FIG. 26 (fourth setting order flow). Generation method). Specifically, the network information is acquired, and the nearest setting flow Df is searched in order to construct a network requested from past data in the knowledge DB 15 using machine learning or deep learning. , A setting flow Df is generated. In the case of this method, it is desirable that there is an operation for the user to check whether the setting flow Df is correct.

  Regarding the third and fourth setting order flow generation methods, it is necessary to store order rules or data in the knowledge DB 15 in advance. The procedure including the prior input (S101) of the fourth setting order flow generation method is shown in FIGS.

  For example, as shown in FIG. 27, order rules such as time and setting order are input to the integrated management system 91 (S101) and recorded in the knowledge DB 15. At this time, it is preferable to input an order rule such as the time of each process and the order of setting using a user operation log.

  For example, as shown in FIG. 28, in the prior input S101, the integrated management system 91 may verify whether or not an order rule is established, or may refer to an actual past setting log. In this case, the integrated management system 91 records only the order rules that are established in the knowledge DB 15.

  As described above, in the prior input S101, the setting order flow Df can be easily generated by recording the setting order and the time required for setting in the integrated management system 91 in the setting profile.

  When the network is constructed, the setting order flow generation unit 14B acquires the connection relationship with the node (S103), acquires the order rule from the knowledge DB 15, calculates the processing time and the setting order (S104), and the setting order flow. Df is generated (S105).

  Note that the setting order flow generation unit 14B may output the generated setting order flow Df to the setting order adjustment unit 11 after inputting from the integrated management system 91 that the generated setting order flow Df is accepted. . Alternatively, the setting order flow may be generated by combining the first to fourth setting order flow generation methods. In that case, it may be possible to set the priority of which setting order has priority.

  In the above-described embodiment, the example in which the processing of the management systems 92 # 1 and 92 # 2 is the setting of the network service has been described. It can be applied to any process.

  The integrated management system 91 is realized by causing the computer to function as the setting order adjustment unit 11, the management system communication unit 12, the management system management unit 16, the setting order flow input unit 14A, and the setting order flow generation unit 14B. Also good. In this case, each configuration is realized by a CPU (Central Processing Unit) in the integrated management system 91 executing a computer program stored in a storage unit (not shown).

  The management system 92 may be realized by causing a computer to function as the setting order adjustment unit 21, the management system communication unit 22, and the process execution unit 23. In this case, each configuration is realized by the CPU in the management system 92 executing a computer program stored in a storage unit (not shown).

  The present invention can be applied to the information communication industry.

11, 21: Setting order adjustment unit 12, 22: Management system communication unit 13: Processing execution unit 14A: Setting order flow input unit 14B: Setting order flow generation unit 16: Management system management unit 23: Processing execution unit 91: Integrated management System 92: Management system 93: Node 94: Service node

Claims (8)

Multiple management systems to control the nodes;
An integrated management system for causing the management system to construct a network using the nodes;
A control system comprising:
The integrated management system includes:
A process to be executed by the management system for constructing the network and a setting order flow that defines the order of the processes are acquired, and the process defined by the setting order flow is performed in the order determined by the setting order flow. A setting order adjustment unit that generates an execution request to request execution,
An execution request from the setting order adjustment unit is transmitted to the management system corresponding to the process defined by the setting order flow, and an end notification indicating that the execution of the process defined by the execution request is completed is sent to the management system. An integrated management system communication unit that receives from,
The plurality of management systems include:
A process execution unit for constructing the network by executing a process defined by the execution request;
A management system that outputs the execution request transmitted from the integrated management system to the process execution unit, and transmits the completion notification to the integrated management system when the execution of the process defined by the execution request is completed in the process execution unit A communication unit,
Control system. The integrated management system includes:
A storage unit that holds an order rule that defines an execution order of processing when constructing a network using the node;
When the information on the network to be constructed using the node is input, the execution order of the processes used when configuring the network is determined so as to conform to the order rule held in the storage unit, A setting order flow generation unit that generates the setting order flow; and
The control system according to claim 1. Multiple management systems to control the nodes;
An integrated management system for causing the management system to construct a network using the nodes;
A control device functioning as the integrated management system provided in a control system comprising:
A process to be executed by the management system for constructing the network and a setting order flow that defines the order of the processes are acquired, and the process defined by the setting order flow is performed in the order determined by the setting order flow. A setting order adjustment unit that generates an execution request to request execution,
An execution request from the setting order adjustment unit is transmitted to the management system corresponding to the process defined by the setting order flow, and an end notification indicating that the execution of the process defined by the execution request is completed is sent to the management system. An integrated management system communication unit to receive from,
A control device comprising: Multiple management systems to control the nodes;
An integrated management system for causing the management system to construct a network using the nodes;
A control device functioning as the management system provided in a control system comprising:
A request to execute the process defined in the setting order flow in the order determined by the setting order flow that defines the process to be executed by the management system and the order of the process in order to construct the network A process execution unit for constructing the network by executing a process defined by the execution request;
The execution request transmitted from the integrated management system is output to the process execution unit, and when execution of the process defined by the execution request is completed in the process execution unit, execution of the process defined by the execution request is completed A management system communication unit that transmits a notification of completion to the integrated management system;
A control device comprising: Multiple management systems to control the nodes;
An integrated management system for causing the management system to construct a network using the nodes;
A control method executed by the integrated management system provided in the control system comprising:
The integrated management system is
A process to be executed by the management system for constructing the network and a setting order flow that defines the order of the processes are acquired, and the process defined by the setting order flow is performed in the order determined by the setting order flow. Executing the step of transmitting an execution request for requesting execution to the management system corresponding to the processing defined in the setting order flow;
Control method of integrated management system. Multiple management systems to control the nodes;
An integrated management system for causing the management system to construct a network using the nodes;
A control method executed by the management system provided in the control system comprising:
The management system is
A request to execute the process defined in the setting order flow in the order determined by the setting order flow that defines the process to be executed by the management system and the order of the process in order to construct the network Receiving an execution request from the integrated management system;
Setting the network by executing a process defined by the execution request;
When the execution of the process defined by the execution request is completed, sending an end notification to the integrated management system that the execution of the process defined by the execution request is completed;
Management system control method that executes in order.   A control program for causing a computer to execute the steps according to claim 5.   A control program for causing a computer to execute each step according to claim 6.

Images