JP7395961B2 - Network management device, network management method, and network management program - Google Patents

Description

TECHNICAL FIELD The present invention relates to network management technology, and particularly to technology for evaluating the impact of network system updates.

To ensure stable operation of a network system, it is necessary to perform update work to avoid problems when adding or replacing devices to update the network, or updating programs running on each device. When making some kind of update to a network system that is currently in operation, if there is a discrepancy between the known state of the network system and the state of the network system that is actually in operation, the update process may fail. Therefore, before performing the update work, it is desirable to have information on whether or not there is a discrepancy between the known state of the network system and the state of the network system that is actually in operation. As a technique for evaluating the influence of updating a network system, for example, a technique such as Patent Document 1 has been disclosed.

Patent Document 1 relates to a configuration change evaluation device that evaluates the influence of a change when changing the configuration of a network system. The configuration change evaluation device disclosed in Patent Document 1 acquires information on the network configuration before the change and information on changes in device settings, and determines processing operations that are affected by the change in settings. Furthermore, the configuration change evaluation device disclosed in Patent Document 1 identifies devices that are affected by a change in settings based on a determination result of a processing operation that is affected. By having such a configuration, Patent Document 1 states that it becomes possible to evaluate the influence of a change in the configuration of a network system in advance.

Japanese Patent Application Publication No. 2007-243855

However, the technique of Patent Document 1 is not sufficient in the following points. In Patent Document 1, devices affected by a change in the configuration of a network system are determined. However, Patent Document 1 does not have a function to determine an evaluation method for affected devices. Therefore, when multiple devices are affected by multiple changes, such as when multiple devices are changed at the same time, the administrator may be required to make complex decisions. Therefore, the technique of Patent Document 1 is not sufficient as a technique for evaluating information on the status of the network system that is actually in operation and evaluating the impact of the update when updating the configuration of the network system.

In order to solve the above problems, the present invention aims to provide a network management device that can appropriately evaluate terminals that may be affected when changing the configuration of a network.

In order to solve the above problems, the network management device of the present invention includes update content acquisition means, determination means, monitoring control means, and evaluation execution means. The update content acquisition means obtains information on update content of the network system. The determination means determines the terminals and affected items on the network system that are affected by the update, based on the information on the update content. The monitoring control means determines an evaluation method corresponding to the impact item. The evaluation execution means evaluates the terminal affected by the update based on the evaluation method determined by the monitoring control means.

The network management method of the present invention acquires information on update content of a network system, and determines terminals and evaluation items on the network system that are affected by the update based on the information on the update content. The network management method of the present invention determines an evaluation method corresponding to an evaluation item, and evaluates a terminal affected by an update based on the determined evaluation method.

According to the present invention, when changing the configuration of a network, it is possible to appropriately evaluate terminals that may be affected.

FIG. 1 is a diagram showing an outline of the configuration of a first embodiment of the present invention. FIG. 2 is a diagram showing the configuration of a network management system according to a second embodiment of the present invention. FIG. 3 is a diagram showing an operation flow of a network management system according to a second embodiment of the present invention. FIG. 7 is a diagram illustrating an example of the configuration of a network to be managed in a second embodiment of the present invention. It is a figure which shows the example of the data of the influence item database of the 2nd Embodiment of this invention. It is a figure which shows the example of the correspondence table which shows the correspondence of the evaluation item and evaluation method of the 2nd Embodiment of this invention. FIG. 7 is a diagram illustrating an example of a case where a terminal is added to a network to be managed according to the second embodiment of the present invention. FIG. 3 is a diagram showing the configuration of a network management system according to a third embodiment of the present invention. FIG. 7 is a diagram showing an operation flow of a network management system according to a third embodiment of the present invention. FIG. 3 is a diagram showing the configuration of a network management system according to a fourth embodiment of the present invention. FIG. 7 is a diagram showing an operation flow of a network management system according to a fourth embodiment of the present invention. It is a figure which shows the example of another structure of the network management system of this invention.

(First embodiment)
A first embodiment of the present invention will be described in detail with reference to the drawings. FIG. 1 is a diagram showing an overview of the configuration of a network management device according to this embodiment. The network management device of this embodiment includes an update content acquisition section 1, a determination section 2, a monitoring control section 3, and an evaluation execution section 4. The update content acquisition unit 1 acquires information on update content of the network system. The determination unit 2 determines the terminals and evaluation items on the network system that are affected by the update, based on information on the update content. The monitoring control unit 3 determines the evaluation method corresponding to the evaluation item. The evaluation execution unit 4 evaluates the terminals affected by the update based on the evaluation method determined by the monitoring control unit 3.

In the network management device of this embodiment, an update content acquisition unit 1 acquires information on update content of the network system, and a determination unit 2 determines terminals and evaluation items affected by the update from the acquired update content. There is. Update content information refers to information regarding updates to the network system being managed, such as changes to the version of programs running on the terminal, addition of a terminal, changes to various terminal settings, etc. Say something. Further, in the network management device of this embodiment, the monitoring control unit 3 determines the evaluation method corresponding to the evaluation item. The monitoring control unit 3 determines the evaluation method corresponding to the evaluation item based on, for example, a correspondence table between evaluation items and evaluation items set in advance. Furthermore, in the network management device of this embodiment, the evaluation execution unit 4 executes the evaluation of the terminal using the determined evaluation method.

With such a configuration, the network management device of this embodiment can automatically determine evaluation items necessary to check the impact of an update in advance, based on information on the update content of the network system. Therefore, even if the network system is complex, there is no need for judgment by the administrator or the like. Further, by performing the evaluation based on the evaluation items determined based on the update content information and the terminal information, it is possible to appropriately perform a preliminary evaluation for suppressing the occurrence of failures after the update. Therefore, the network management device of this embodiment can appropriately evaluate terminals that may be affected when changing the configuration of the network system.

(Second embodiment)
A second embodiment of the present invention will be described in detail with reference to the drawings. FIG. 2 is a diagram showing an overview of the configuration of the network management system 10 of this embodiment. The network management system 10 of this embodiment is a system that automatically determines the range affected by the update and evaluates the impact of the update when updating the network system, such as adding a terminal device.

The network management system 10 of this embodiment includes an update content acquisition unit 11, a determination unit 12, a monitoring control unit 13, an evaluation execution unit 14, a system configuration storage unit 15, and an impact item storage unit 16. .

The update content acquisition unit 11 acquires information corresponding to the update content of the network system, that is, information on the update content. Further, the update content acquisition unit 11 analyzes the update content of the network system and converts it into a processable format based on the acquired information of the update content, and determines the information of the updated content that has been analyzed and converted. Send to Department 12.

The information about the update content of the network system is information about updates to the network system that is the management target. For example, updates include upgrading the OS (Operating System) or application program version of a terminal on a network system, or adding a new server or network device when changing routing or filtering rules. Refers to one or both. The information corresponding to the update content of the network system, that is, the update content information is, for example, a notation in CSV or text format in which one or both of the configuration diagram before and after the update and the difference between the hardware configuration before and after the update are recorded. This is shown in a workflow diagram of the update work. The update content acquisition unit 11 analyzes the update content from the update content information in the above format, converts it into information in a format that can be processed by the determination unit 12, and sends the information to the determination unit 12. The information in a format that can be processed by the determining unit 12 refers to, for example, information in the format of the impact item database of the impact item storage unit 16. An example of the impact item database will be explained later.

The determination unit 12 refers to the system configuration database and determines the items (evaluation items) affected by the update of the network system and the terminals to be evaluated when evaluating the evaluation items. That is, the determination unit 12 determines the terminal to be evaluated and the evaluation items based on data in the system configuration database in the system configuration storage unit 15, data in the impact item database in the impact item storage unit 16, and information on update contents of the network system. Determine. The determination unit 12 sends information on the terminals determined to be evaluated and the evaluation items to the monitoring control unit 13.

For example, when an update to "add a server to an existing network system" is performed, the determination unit 12 receives a message from the update content acquisition unit 11 that "a new server will be connected to an existing network device, and the network device will be added accordingly." Receive information corresponding to the update "Change the settings of the routing table". Next, the determination unit 12 refers to the impact item database and acquires information on impact items related to the update content. For example, when updating the settings of a network device, the determination unit 12 acquires information indicating that “communication status between terminals connected to the network device is affected” as information on the influence item. The determination unit 12 determines evaluation items that need to be executed when evaluating the impact from the acquired information on the impact items. For example, when the influence item is information that "communication status between terminals connected to the network device is affected", the determination unit 12 determines "communication status between terminals" as the evaluation item.

The monitoring control unit 13 determines an evaluation method corresponding to each evaluation item based on the evaluation item information sent from the determination unit 12. Evaluation methods corresponding to each evaluation item are set in advance. The monitoring control unit 13 sends information on the terminal to be evaluated and the evaluation method to the evaluation execution unit 14, and instructs the evaluation execution unit 14 to perform the evaluation.

Data associating evaluation items with evaluation methods is stored in a database. For example, if the evaluation item is communication confirmation between terminals, the database includes the evaluation item communication confirmation between terminals, and the evaluation method ICMP (Internet Control Message) echo request and reply executed for communication confirmation. (ping) is associated. Another example of data that associates an evaluation item with an evaluation method is data that associates confirmation of the routing status, which is an evaluation item, with execution of a program to output routing table information, which is an evaluation method. It will be done.

The evaluation execution unit 14 executes each evaluation for the terminal to be evaluated based on the evaluation method information input from the monitoring control unit 13. Further, the evaluation execution unit 14 outputs the evaluation result to the monitoring control unit 13.

The evaluation execution unit 14 executes commands such as ping and ipconfig/ifconfig to evaluate evaluation items and collect evaluation result data. The evaluation execution unit 14 may perform the evaluation by executing a script that compiles each command. The evaluation execution unit 14 also performs evaluation using a network management tool such as a configuration management tool such as Ansible (registered trademark), a monitoring tool such as Zabbix (registered trademark), or a configuration collection tool such as SCRUB. Good too.

The update content acquisition unit 11, determination unit 12, monitoring control unit 13, and evaluation execution unit 14 of this embodiment correspond to the network management device of the first embodiment. Further, the update content acquisition unit 11, the determination unit 12, the monitoring control unit 13, and the evaluation execution unit 14 are configured using, for example, a semiconductor device such as a plurality of or a single FPGA (Field Programmable Gate Array). Each process in the update content acquisition unit 11, determination unit 12, monitoring control unit 13, and evaluation execution unit 14 may be performed by executing a computer program on a CPU (Central Processing Unit).

The system configuration storage unit 15 stores configuration information of the network system as a system configuration database. The configuration information of the network system includes, for example, information on specifications of each terminal on the network system, information on setting values of each terminal, and information on connection relationships between the terminals. The information on the connection relationship between terminals refers to the information on the physical connection relationship and the logical connection relationship between the terminals, or information on either one of the connection relationships. Further, the configuration information of the network system includes information on functional requirements and non-functional requirements of the network system.

The impact item storage unit 16 is an impact item database that stores data that associates update contents of the network system with items affected by the update, that is, impact items.

An example of associating update content with impact items is when a change in the router's routing policy (update content) and a change in settings, etc., affect operation, such as the communication status between terminals connected to the router (influence item). This is the association with the item to be given. Other examples of associating update content with impact items include the addition of a new server (update content), the settings of the switch to which the new server is connected, and the communication status between terminals connected to the switch (impact item). It is an association with

Furthermore, a database that stores data that associates update contents with impact items may have registered relationships specific to a particular network system based on past cases. For example, if there is a problem between a certain OS (Operating System) and a specific version of a specific application program running on the OS, the version of the OS (updated content) and the version of the specific application program ( (influence items) may be registered in association with each other.

A database that stores data that associates update contents with impact items can be constructed as a knowledge database based on technical information regarding the network system, knowledge of past defects, and the like.

The system configuration storage unit 15 and the influence item storage unit 16 are each configured by a storage device such as a nonvolatile semiconductor storage device, a hard disk drive, or a combination of these storage devices. The system configuration storage unit 15 and the influence item storage unit 16 may be provided on the same storage device. Further, the network management system 10 may include the system configuration storage section 15 and the influence item storage section 16 outside the system.

The operation of the network management system 10 of this embodiment when evaluating the impact of updating the network system will be described. FIG. 3 is a diagram showing an operational flow when the network management system 10 of this embodiment evaluates the impact of an update. Furthermore, in the following description, an example will be described in which the network management system 10 evaluates a network system having a configuration as shown in FIG. 4.

The network system in FIG. 4 includes one router R1, two servers P1 and P2, two switches S1 and S2, and four clients C1, C2, C3, and C4. ing. In the example of FIG. 4, a server P1 and a server P2 are each connected to the router R1. Server P1 is connected to client C1 and client C2 via switch S1. Further, the server P2 is connected to the client C3 and the client C4 via the switch S2.

In the following, an example of processing will be described in which the routing table is changed and the application program running on the server P1 is updated by connecting the server P3 to the router R1 in the network system configured as described above.

First, the update content acquisition unit 11 acquires information on update content of the network system (step S101). Information on update content of the network system is input by, for example, an administrator of the network system. The update content obtaining unit 11 may obtain information on update content of the network system from an external server device via the network.

Upon acquiring the update content information, the update content acquisition unit 11 analyzes the update content from the acquired update content information. The update content acquisition unit 11 analyzes update content such as "addition of server P3", "change of routing table of R1", and "change of version of server application on server P3", for example. A server application is an application program that runs on a server. The update content acquisition unit 11 sends the analyzed update content information to the determination unit 12 .

Upon receiving the update content information, the determining unit 12 refers to the impact item database of the impact item storage unit 16 and obtains information on the impact item corresponding to the update content. FIG. 5 is a diagram showing an example of the configuration of the impact item database. The impact item database shown in FIG. 5 stores data in which item numbers for identifying each record, update details, and information on impact items are associated with each other.

After acquiring the impact item information, the determination unit 12 determines evaluation items that need to be executed to evaluate the impact of the update from the impact items corresponding to the update content included in the update content information (step S102). . For example, when the update content information includes "addition of server P3", the determination unit 12 determines that the update content of item number #3 in the impact item database is applicable. When determining that the updated content of item #3 in the impact item database is applicable, the determining unit 12 refers to the impact item of item #3, The communication status between connected terminals is determined as an evaluation item that needs to be executed to evaluate the impact of the update.

Similarly, when the update content information includes the update content "change of the routing table of router R1", the determination unit 12 determines that the update content of item number #2 in the impact item database is applicable. When determining that the updated content of item #2 in the impact item database is applicable, the determination unit 12 refers to the impact item of item #2, and refers to the “configuration of router routing table” and “configuration of router routing table” The communication status is determined as an evaluation item.

Further, when the update content information includes the update content "change the version of the application program on server P1", the determination unit 12 determines that the update content of item number #5 in the impact item database is applicable. . When determining that the updated content of item #5 in the impact item database is applicable, the determination unit 12 refers to the impact item of item #5 and determines "the version of the agent on the client that communicates with the application program on the server". is determined as an evaluation item. An agent is an application program that runs on a client's terminal.

After determining the evaluation items, the determination unit 12 refers to the system configuration database of the system configuration storage unit 15 and acquires detailed information of the terminal to be evaluated for each determined evaluation item (step S103). The determination unit 12 includes detailed information about the terminal, such as router R1 which is a router to which server P3 is connected, server P1 which is a terminal connected to router R1, data transmission/reception with an application program on server P1, etc. Get detailed information about a client. The determination unit 12 acquires information necessary for identifying and evaluating each terminal, such as the ID and IP address of each terminal, as detailed information of each terminal.

Upon acquiring the detailed information of the terminal, the determination unit 12 deletes duplicate evaluation items. For example, item number #2 and item number #3 both include the status of the router's routing table, so if the target routers are the same, the determination unit 12 evaluates one of them. Delete from item.

In the above example, the evaluation items and the detailed information of the terminals related to the evaluation items are as follows.
Evaluation item 1: Routing table of router R1 Evaluation item 2: Communication status between server P1 and server P2 Evaluation item 3: Version of the OS on server P1 Evaluation item 4: Detailed information on versions of agents on client C1 and client C2: Router Detailed information on R1, server P1, server P2, client C1, and client C2 The detailed information includes, for example, information such as the ID and IP address of each terminal.

After generating the evaluation item and detailed information of the terminal related to the evaluation item, the determination unit 12 sends the generated information to the monitoring control unit 13.

Upon receiving the evaluation items and the detailed information of the terminals related to the evaluation items, the monitoring control unit 13 refers to the correspondence table of evaluation items and evaluation methods and determines the evaluation method corresponding to each evaluation item (step S104). The monitoring control unit 13 previously holds a correspondence table between evaluation items and evaluation methods. FIG. 6 is a diagram showing an example of a correspondence table between evaluation items and evaluation methods. The correspondence table of evaluation items and evaluation methods shown in FIG. 6 is constructed by correlating item numbers for identifying the correspondence between evaluation items and evaluation methods, and information on evaluation items and evaluation methods.

After determining the evaluation method corresponding to each evaluation item, the monitoring control unit 13 sends information on the determined evaluation method to the evaluation execution unit 14 as an evaluation command.

For example, when the evaluation item is the router's routing table status, the monitoring control unit 13 issues an instruction to execute a program that outputs a routing table configuration file, which is the evaluation method of item #5, and details of the target router. The information is sent to the evaluation execution unit 14 as an evaluation command. When the evaluation item is the communication status of the server, the monitoring control unit 13 sends the evaluation execution unit 14 an instruction to execute the program that sends the ping of item number #4 and detailed information about the server for which communication is to be confirmed as an evaluation instruction. send. Further, when the evaluation item is the version of the OS on the server, the monitoring control unit 13 sends the evaluation execution unit an instruction to execute the OS information collection tool of item number #7 and detailed information of the target server as an evaluation instruction. Send to 14th. Furthermore, when the evaluation item is the version of the agent on the client, the monitoring control unit 13 sends a request to obtain the version of the agent on the client via the REST API (Representational State Transfer Application Programming Interface) in item number #8. The command to do so and detailed information on the target client are sent to the evaluation execution unit 14 as an evaluation command.

Upon receiving the evaluation command, the evaluation execution unit 14 executes the evaluation based on the contents of the evaluation command (step S105). The evaluation execution unit 14 executes the evaluation requested as the evaluation command, for example, by executing a program necessary for the evaluation. When the execution of the program based on the content of the evaluation command is completed, the evaluation execution unit 14 sends the execution result to the monitoring control unit 13 as an evaluation result.

Upon acquiring the evaluation results, the monitoring control unit 13 outputs the evaluation result data to a maintenance terminal device, etc. (step S106). The monitoring control unit 13 may output the evaluation result data to a display device or the like as image data. In addition, when outputting evaluation result data, the monitoring control unit 13 compares the evaluation result with a standard, generates data that allows the administrator, etc. to recognize abnormal items or items that are likely to be abnormal, and performs evaluation. It may be output as a result.

Figure 7 shows a configuration in which a server 3 with an IP address of (192.168.10.100) is connected to a network with the same configuration as in Figure 4, and the version of the application program on server 1 is updated to v3.1. It shows. Furthermore, a maintenance terminal M1 with an IP address of (192.168.10.100) is further connected to the network in FIG. Further, in the network of FIG. 7, it is assumed that the versions of the agents of clients 1, 3, and 4 are 1.08, and the versions of the agents of client 2 are 1.10.

At this time, if you connect a new server P3 with the same IP address without knowing that the maintenance terminal M1 with the IP address (192.168.10.100) is already connected, the maintenance terminal M1 and server P3 will Communication cannot be performed normally.

Furthermore, even if it is recognized that a problem occurs with the combination of the server's application program version 3.1 and the agent version 1.1, it is difficult to understand that the client 2's agent version is 1.10. If not, there is a risk that the server application program will be updated to version 3.1. In such a case, there is a possibility that a communication problem or the like may occur between the server P1 and the client C2 after the update. By using the network management system of this embodiment, it is possible to determine that the status of the routing table of router R1 and the version information of the agent on client C2 are important based on the contents of the update, and to present those items. Update failures can be prevented.

In network systems, basic items such as network configuration and requirements to be met, such as communication confirmation between terminals and physical connection relationships, are often subject to constant monitoring. In addition, for network systems that require high levels of delay suppression, throughput and TAT (Turn Around Time), and for network systems that require high levels of security, special considerations must be made in consideration of the requirements of each network system, such as detailed firewall settings. Some items that have become public are also often monitored. However, there are an almost infinite number of items that can be monitored, such as specifications of individual terminals, various parameters, settings and versions of application programs, communication status among all terminals, and routing status. Furthermore, since it is extremely difficult to determine which item to monitor from among a plurality of items, necessary and sufficient items may not be regularly monitored. If there are items that need to be monitored but are not being monitored, there may be a discrepancy between the network system configuration information and the state of the network system that is actually running. However, there is a risk that the administrator may not be able to recognize the discrepancy. If you try to update the network system when there is a discrepancy without recognizing the discrepancy, the settings may be overwritten with inappropriate data based on incorrect information, or the settings may become inconsistent. , there is a risk that the system will go down if the update process fails.

In addition to the items that are regularly monitored, the network management system 10 of this embodiment determines items that will be changed by the update or items that may be affected based on the update content of the network system. Items that may be affected include not only physically existing data such as configuration parameters of each terminal, but also functional and non-functional requirements such as communication status between terminals, security policy, and latency performance. . By obtaining information in advance about items that will be changed by the update and items that may be affected, network system administrators can perform tasks and change settings in consideration of the impact of the update. By obtaining information about items that may be affected in advance and performing update operations, it is possible to prevent system failures caused by update process failures such as setting inconsistencies.

In the network management system 10 of this embodiment, an update content acquisition unit 11 acquires information on update content of the network system, and a determination unit 12 refers to data in an impact item database and determines which items are affected by the update based on the update content. Determining devices and affected items. In addition, in the network management system 10 of the present embodiment, the monitoring control unit 13 determines an evaluation method corresponding to the impact item, and the evaluation execution unit 14 executes the evaluation of the terminal using the determined evaluation method and outputs the result. are doing. The evaluation execution unit 14 evaluates the terminals affected by the update based on the evaluation method determined by the monitoring control unit 13. With such a configuration, the network management system 10 of the present embodiment automatically determines necessary evaluation items based on information on update contents of the network system, executes evaluation, and outputs the results. , information on devices that will be affected by the update can be presented in advance. Therefore, the network management system 10 of this embodiment can provide information on terminals that may be affected by an update before the update even in a network system with a complicated configuration. As a result, the network management system 10 of this embodiment can appropriately evaluate terminals that may be affected when changing the configuration of the network system.

(Third embodiment)
A third embodiment of the present invention will be described in detail with reference to the drawings. FIG. 8 is a diagram showing an overview of the configuration of the network management system 30 of this embodiment. In the network management system 30 of the second embodiment, the impact item database is created by an administrator or the like based on knowledge of past cases and the like. In response to such a configuration, the network management system 30 of the present embodiment stores the influence item database based on the network system and a learning model generated by machine learning by learning the relationship between influence items. It is characterized by estimating influence items that are possible items.

The network management system 30 of this embodiment includes an update content acquisition section 11, a monitoring control section 13, an evaluation execution section 14, a system configuration storage section 15, an estimation section 31, a learning section 32, and a learning model storage section. It is equipped with 33.

The configurations and functions of the update content acquisition unit 11, the monitoring control unit 13, the evaluation execution unit 14, and the system configuration storage unit 15 of this embodiment are the same as the parts with the same names in the second embodiment. In this embodiment, the update content acquisition unit 11 outputs update information to the estimation unit 31. Additionally, the monitoring control unit 13 acquires information on evaluation items from the estimation unit 31.

The estimation unit 31 inputs the update content information sent from the update content acquisition unit 11 and uses the learned model stored in the learning model storage unit 33 to calculate evaluation items corresponding to the update content information. It has a function to estimate and output the estimated evaluation items. The estimation unit 31 sends information on the estimated evaluation items to the monitoring control unit 13. The trained model stored in the learning model storage unit 33 uses teacher data that takes as input information about the terminal to be updated, the update items of the terminal, and the topology configuration of the network to which the terminal belongs, and outputs the evaluation items. This is a model generated using machine learning.

The learning unit 32 receives information on the terminal to be updated, the update items of the terminal, and the topology configuration of the network to which the terminal belongs as input, and performs machine learning using training data with evaluation items as output, and generates a learned model. do. The learning unit 32 stores the generated trained model in the learning model storage unit 33. Information on the terminal to be updated, the update items of the terminal, the configuration of the network to which the terminal belongs, and data on the evaluation items are input to the learning unit 32 by, for example, an administrator. The learning unit 32 may obtain information on the terminal to be updated, the update items of the terminal, the configuration of the network to which the terminal belongs, and data on the impact items from another server or the like via the network.

The learning unit 32 uses the input data used by the estimation unit 31 for estimation, which is information on the update items of the terminal and the topology configuration of the network to which the terminal belongs, and the data on the evaluation items, which are the output results, and data indicating whether the evaluation result is correct or not. It may also have a function to perform relearning based on . When relearning is performed, the learning unit 32 updates the trained model stored in the learning model storage unit 33 with the relearning data.

Each process in the estimation unit 31 and the learning unit 32 may be performed by executing a computer program on the CPU, for example. The processing of the estimation unit 31 may be performed by a plurality of semiconductor devices such as a single FPGA or the like.

The learning model storage unit 33 stores data of the learning model generated by the learning unit 32. Further, a trained model generated by another server or the like may be stored in the learning model storage unit 33. The learning model storage unit 33 is configured by a storage device such as a nonvolatile semiconductor storage device, a hard disk drive, or a combination of these storage devices. The learning model storage unit 33 may be provided on the same storage device as the system configuration storage unit 15 and the influence item storage unit 16.

The operation of the network management system 30 of this embodiment when evaluating the impact of updating the network system will be described. FIG. 9 is a diagram showing an operational flow when the network management system 30 of this embodiment evaluates the impact of an update.

First, the update content acquisition unit 11 acquires information on network update content (step S111). Upon acquiring the update content information, the update content acquisition unit 11 analyzes the update content from the acquired update content information. The update content acquisition unit 11 sends the analyzed update content information to the estimation unit 31.

Upon receiving the update content information, the estimation unit 31 uses the trained model stored in the learning model storage unit 33 to estimate the evaluation item corresponding to the update content included in the update content information (step S112 ). After estimating the evaluation items, the estimation unit 31 refers to the system configuration database of the system configuration storage unit 15 and acquires detailed information of the terminal to be evaluated (step S113). The detailed information includes, for example, information such as the ID and IP address of each terminal.

After generating the evaluation items and the detailed information of the terminals related to the evaluation items, the estimation unit 31 sends the generated information to the monitoring control unit 13.

Upon receiving the evaluation items and the detailed information of the terminals related to the evaluation items, the monitoring control unit 13 refers to the correspondence table of evaluation items and evaluation methods and determines the evaluation method corresponding to each evaluation item (step S114).

After determining the evaluation method corresponding to each evaluation item, the monitoring control unit 13 sends a request to perform the evaluation using the determined evaluation method and information on the terminal to be evaluated as an evaluation command to the evaluation execution unit 14.

Upon receiving the evaluation instruction, the evaluation execution unit 14 executes evaluation based on the content of the evaluation instruction (step S115). The evaluation execution unit 14 executes the evaluation requested as the evaluation command, for example, by executing a program necessary for the evaluation. When the execution of the program based on the content of the evaluation command is completed, the evaluation execution unit 14 sends the execution result to the monitoring control unit 13 as an evaluation result.

Upon acquiring the evaluation results, the monitoring control unit 13 outputs the evaluation result data to a maintenance terminal device, etc. (step S116). The monitoring control unit 13 may output the evaluation result data to a display device or the like as image data. In addition, when outputting evaluation result data, the monitoring control unit 13 compares the evaluation result with a standard, generates data that allows the administrator, etc. to recognize abnormal items or items that are likely to be abnormal, and performs evaluation. It may be output as a result.

The network management system 30 of this embodiment has the same effects as the network management system 10 of the second embodiment. Furthermore, the network management system 30 of the present embodiment estimates evaluation items for evaluating impact items that may be affected by the update, based on the learned model generated by machine learning. Therefore, the network management system 30 of this embodiment can accurately present information on terminals and the like that may be affected by updates even when a more complex network system is to be managed.

(Fourth embodiment)
A fourth embodiment of the present invention will be described in detail with reference to the drawings. FIG. 10 is a diagram showing an overview of the configuration of the network management system 40 of this embodiment. The network management system 10 of the second embodiment outputs the evaluation results without making specific judgments about the results, but the network management system 40 of the present embodiment has a configuration based on the settings. , is characterized in that the difference from the actual operating state is determined as a deviation determination and the result is output as the evaluation result.

The network management system 40 of the present embodiment includes an update content acquisition section 11, a determination section 12, a monitoring control section 13, an evaluation execution section 14, a system configuration storage section 15, an impact item storage section 16, and a deviation determination section. 41.

The configurations and functions of the update content acquisition unit 11, determination unit 12, monitoring control unit 13, evaluation execution unit 14, and influence item storage unit 16 of this embodiment are the same as those of the parts with the same names in the second embodiment. . When determining the evaluation result, the monitoring control section 13 requests the deviation determination section 41 to determine whether there is a discrepancy between the set configuration and the evaluation result. Further, the monitoring control unit 13 outputs an evaluation result based on the deviation determination result received from the deviation determination unit 41.

The deviation determination unit 41 refers to the system configuration database of the system configuration storage unit 15 and determines whether the evaluation result matches the information on the system configuration database. The deviation determination unit 41 compares the evaluation results with the values stored in the system configuration storage unit 15 and checks whether the values match. The deviation determination unit 41 may perform deviation determination in advance for each evaluation item based on a determination method. The discrepancy determination unit 41 outputs the result of checking whether or not the values match as a discrepancy determination result. The processing in the deviation determination unit 41 is performed by, for example, a plurality of semiconductor devices such as a single FPGA or the like. The processing in the deviation determination unit 41 may be performed by executing a computer program on the CPU.

The operation of the network management system 40 of this embodiment when evaluating the impact of updating the network system will be described. FIG. 11 is a diagram showing an operational flow when the network management system 40 of this embodiment evaluates the impact of an update.

First, the update content acquisition unit 11 obtains information on network update content (step S121). Upon acquiring the update content information, the update content acquisition unit 11 analyzes the update content from the acquired update content information. The update content acquisition unit 11 sends the analyzed update content information to the determination unit 12 .

Upon receiving the update content information, the determination unit 12 refers to the impact item database of the impact item storage unit 16 and determines the evaluation item corresponding to the update content (step S122). The evaluation item corresponding to the update content is determined in the same manner as in the second embodiment.

After determining the evaluation items, the determination unit 12 refers to the system configuration database of the system configuration storage unit 15 and acquires detailed information of the terminal to be evaluated (step S123). The detailed information includes, for example, information such as the ID and IP address of each terminal.

After generating the evaluation item and detailed information of the terminal related to the evaluation item, the determination unit 12 sends the generated information to the monitoring control unit 13.

Upon receiving the evaluation items and the detailed information of the terminals related to the evaluation items, the monitoring control unit 13 refers to the correspondence table of evaluation items and evaluation methods and determines the evaluation method corresponding to each evaluation item (step S124).

After determining the evaluation method corresponding to each evaluation item, the monitoring control unit 13 sends the determined evaluation method and information on the terminal to be evaluated to the evaluation execution unit 14 as an evaluation command.

Upon receiving the evaluation command, the evaluation execution unit 14 executes the evaluation based on the contents of the evaluation command (step S125). The evaluation execution unit 14 executes the evaluation requested as the evaluation command, for example, by executing a program necessary for the evaluation. When the execution of the program based on the content of the evaluation command is completed, the evaluation execution unit 14 sends the execution result to the monitoring control unit 13 as an evaluation result.

Upon acquiring the evaluation results, the monitoring control section 13 sends the data of the evaluation results to the deviation determination section 41 . Upon receiving the evaluation result data, the discrepancy determining unit 41 refers to the system configuration database and determines whether there is a discrepancy between the evaluation result and the information on the system configuration database (step S126). When determining the presence or absence of a deviation, the deviation determination unit 41 compares the evaluation result with the value stored in the system configuration storage unit 15, and monitors information indicating whether or not the values match and the difference as the deviation determination result. It is sent to the control section 13.

Upon receiving the deviation determination result, the monitoring control unit 13 outputs the data of the management determination result to a management terminal device or the like (step S127). The monitoring control unit 13 may output the data of the deviation determination result to a display device or the like as image data.

The network management system 40 of this embodiment has the same effects as the network management system 10 of the second embodiment. Further, in the network management system 40 of the present embodiment, the deviation determination unit 41 compares the information regarding the configuration of the network system registered in the system configuration database with the evaluated result as a deviation determination, and outputs the deviation determination result. ing. Therefore, the network management system 40 of the present embodiment more accurately provides information on terminals that require action such as reexamination of setting values to the administrator of the network system before performing the update work. be able to.

Each process in the network management device of the first embodiment, the network management system of the second embodiment, and the network management system of the third embodiment may be performed by executing a computer program on a computer. FIG. 12 shows an example of the configuration of a computer 50 that executes computer programs that perform various processes in the network management system. The computer 50 includes a CPU 51, a memory 52, a storage device 53, and an I/F (Interface) section 54. Furthermore, the data compression device of the first embodiment also has a similar configuration.

The CPU 51 reads computer programs for performing each process from the storage device 53 and executes them. The memory 52 is configured with a DRAM (Dynamic Random Access Memory) or the like, and temporarily stores computer programs executed by the CPU 51 and data being processed. The storage device 53 stores computer programs executed by the CPU 51. The memory device 53 is configured by, for example, a nonvolatile semiconductor memory device. Other storage devices such as a hard disk drive may be used as the storage device 53. The I/F unit 54 is an interface that inputs and outputs data with other units of the network management system, terminals of the network to be managed, and the like. The computer 50 may further include a communication module that communicates with other information processing devices via a communication network.

Further, the computer program for each process can be stored in a recording medium and distributed. As the recording medium, for example, a magnetic tape for data recording or a magnetic disk such as a hard disk can be used. Further, as the recording medium, an optical disc such as a CD-ROM (Compact Disc Read Only Memory) can also be used. A nonvolatile semiconductor memory device may be used as the recording medium.

1 Update content acquisition unit 2 Judgment unit 3 Monitoring control unit 4 Evaluation execution unit 10 Network management system 11 Update content acquisition unit 12 Judgment unit 13 Monitoring control unit 14 Evaluation execution unit 15 System configuration storage unit 16 Impact item storage unit 30 Network management system 31 Estimation unit 32 Learning unit 33 Learning model storage unit 40 Network management system 41 Deviation determination unit 50 Computer 51 CPU
52 Memory 53 Storage device 54 I/F section

Claims (9)

a system configuration storage means for acquiring and storing information regarding the configuration of the network system;
update content acquisition means for acquiring information on update content of the network system;
determination means for determining terminals and evaluation items on the network system affected by the update based on information on the update content;
monitoring control means for determining an evaluation method corresponding to the evaluation item;
Evaluation execution means for evaluating the terminal affected by the update based on the evaluation method determined by the monitoring control means ;
discrepancy determining means for comparing the configuration of the network system based on the result of the evaluation of the terminal with the configuration of the network system stored by the system configuration storage means and outputting a comparison result;
A network management device comprising: Impact item storage means that stores data associating the updated content with impact items corresponding to the updated content as an impact item database.
Furthermore ,
The determination means refers to the configuration of the network system stored by the system configuration storage means to determine which terminals on the network system are affected by the update, and refers to the impact items in the impact item database. The network management device according to claim 1, wherein the evaluation item is determined by determining the evaluation item. 3. The network management device according to claim 1 , wherein the monitoring control means stores in advance information on the evaluation items and the evaluation method corresponding to the evaluation items. update content acquisition means for acquiring information on update content of the network system;
learning model storage means for storing a learning model learned using teacher data that inputs information about a terminal to be updated, update items of the terminal, and configuration of a network system to which the terminal belongs, and outputs evaluation items;
estimating means for estimating terminals and evaluation items affected by the update based on the learning model, from information about the terminal to be updated, the update items of the terminal, and the configuration of a network system to which the terminal belongs;
monitoring control means for determining an evaluation method corresponding to the evaluation item estimated by the estimation means;
and evaluation execution means for evaluating the terminal affected by the update based on the evaluation method determined by the monitoring control means. obtain and store information about the configuration of network systems;
Obtaining information on update content of the network system,
determining terminals and evaluation items on the network system that are affected by the update based on information on the update content;
Determine an evaluation method corresponding to the evaluation item,
performing an evaluation of the terminal affected by the update based on the determined evaluation method ;
A network management method that compares a configuration of the network system based on a result of evaluation of the terminal with a configuration of the network system indicated by stored information regarding the configuration of the network system, and outputs a comparison result. Stores information about the configuration of the network system as a system configuration database,
storing data associating update content of the network system with impact items corresponding to the update content as an impact item database;
Obtaining information on update content of the network system,
The system configuration database is referenced to determine terminals on the network system that are affected by the update, and the update content is determined by referring to the impact items in the impact item database to determine evaluation items for the terminals that are affected by the update. Judgment based on the information of
Determine an evaluation method corresponding to the evaluation item,
A network management method for evaluating the terminal affected by an update based on the determined evaluation method . 7. The network management method according to claim 6 , wherein the actual configuration of the network system based on the result of the executed evaluation of the terminal is compared with the configuration of the network system in the system configuration database, and a comparison result is output. Get information about network system updates,
storing a learning model learned using teacher data that takes as input information about a terminal to be updated, update items of the terminal, and configuration of a network system to which the terminal belongs, and outputs evaluation items;
Based on the learning model, estimate the terminal affected by the update and the evaluation item from information on the terminal to be updated, the update item of the terminal, and the configuration of the network to which the terminal belongs,
determining an evaluation method corresponding to the estimated evaluation item,
A network management method for evaluating the terminal affected by an update based on the determined evaluation method. A process of obtaining and storing information regarding the configuration of a network system;
a process of acquiring information on update content of the network system;
a process of determining terminals and evaluation items on the network system affected by the update based on information on the update content;
a process of determining an evaluation method corresponding to the evaluation item;
A process of evaluating the terminal affected by the update based on the determined evaluation method ;
Comparing the configuration of the network system based on the result of the evaluation of the terminal with the configuration of the network system indicated by the stored information regarding the configuration of the network system, and outputting a comparison result;
A network management program that causes a computer to run

Images