JP2017049639A - Evaluation program, procedure manual evaluation method, and evaluation device - Google Patents

Abstract

PROBLEM TO BE SOLVED: To appropriately evaluate a procedure manual in terms of whether the procedure manual is easy to automatically perform work.SOLUTION: An evaluation device 10 extracts a plurality of words expressing operation from a plurality of procedure manuals 11a, 11b, .... Next, the evaluation device 10 counts the number of appearances of a word at a work name in the plurality of procedure manuals 11a, 11b, ..., and the number of appearances of the word at an operation procedure in the plurality of procedure manuals 11a, 11b, ... for each of the plurality of words. Next, the evaluation device 10 compares a value corresponding to the number of appearances of the word at the work name in the plurality of procedure manuals 11a, 11b, ..., and a value corresponding to the number of appearances of the word at the operation procedure in the plurality of procedure manuals 11a, 11b for each of the plurality of words, ... and determines weight values. Then, the evaluation device 10 evaluates the concreteness of description of the operation procedure for each of the plurality of procedures on the basis of the total of the weight values of the words included in the operation procedure.SELECTED DRAWING: Figure 1

Description

  The present invention relates to an evaluation program, a procedure manual evaluation method, and an evaluation apparatus.

  When operating a computer system, various operations are performed on computers included in the system. The work is a series of operations for instructing the computer to back up data, collect logs, update software, and the like. A single operation often involves a plurality of operations. A series of operations for performing one work is defined as an operation procedure. The operation procedure is converted into text in a natural language, and is stored as a procedure document in, for example, the operation management server.

  The system operator refers to the procedure manual and performs operations according to the procedure manual on the computer to be worked in the system. If the number of computers to be worked becomes large, the work load on the worker becomes excessive. Recently, automation of work has been promoted.

  In the automation of work, for example, a program for automatic work execution (hereinafter referred to as an automation program) such as a script in which individual operations described in a procedure manual are replaced with commands is used. If the operation expression of the procedure manual is specific, it is easy to uniquely identify the command to be replaced, and an automated program can be automatically generated based on the procedure manual. On the other hand, if the operation expression is not specific, it is difficult to automatically generate an automation program because it is not known what command should be replaced.

  In a large-scale system, operations are diverse and the amount of procedure manuals is enormous. In addition, a plurality of procedure manuals for the same work may be created with different expressions. Therefore, when creating an automation program for automating operation based on a procedure manual, an operation of extracting a specific procedure manual from the enormous procedure manual so that the automation program can be generated occurs.

  As a method for determining the concreteness of a document, for example, there is a method in which the number of themes of a document is determined by the number of clusters of the document, and the concreteness of the document is determined by the number of themes. In addition, a document analysis system that can point out a highly ambiguous part from a document including an ambiguous word written in a natural language is also considered.

JP 2009-093654 A JP 2014-225174 A

  When the work automation program is generated based on the work procedure manual, it is important that the description of the operation procedure in the procedure manual is specific. However, the conventional technology for determining the concreteness of a document does not evaluate the concreteness with an emphasis on the operation procedure of the work procedure manual. Therefore, the conventional technique cannot appropriately evaluate the concreteness of the procedure manual.

  If the concreteness of the procedure manual cannot be evaluated appropriately, for example, it is not known which procedure manual should be used to generate the automation program from among a plurality of procedure manuals related to the same work. If an automated program is generated based on a procedure manual with an ambiguous description by mistake, an incomplete program is generated and it takes time to correct the program.

  In one aspect, an object of the present invention is to enable appropriate evaluation of the concreteness of a procedure manual.

  In one proposal, an evaluation program is provided that causes a computer to execute the following processing. Based on this evaluation program, the computer is a plurality of procedure manuals related to the work to be performed on the managed system, and a plurality of procedure manuals describing the work name indicating the name of the work and the operation procedure for the managed system. From this, a plurality of phrases expressing the operation are extracted. Next, for each of the plurality of words, the computer counts the number of occurrences of words in the work names of the plurality of procedure manuals and the number of occurrences of words in the operation procedures of the plurality of procedure books. Further, for each of the plurality of words, the computer compares the value according to the number of occurrences of the word in the work names of the plurality of procedure manuals with the value according to the number of occurrences of the word in the operation procedure of the plurality of procedure books. Then, a weight value indicating the degree of concreteness of the operation expressed by the phrase is determined. Then, for each of the plurality of procedure manuals, the computer evaluates the concreteness of the description of the operation procedure based on the word weight value included in the operation procedure of the procedure manual.

  According to the first aspect, it is possible to appropriately evaluate whether or not the procedure manual facilitates the automatic operation.

It is a figure which shows the function structural example of the evaluation apparatus which concerns on 1st Embodiment. It is a figure which shows the structural example of the system which concerns on 2nd Embodiment. It is a figure which shows the example of 1 structure of the hardware of the operation management server used for this Embodiment. It is a block diagram which shows the concreteness evaluation of a procedure manual, and a script production | generation function. It is a figure which shows an example of procedure manual DB. It is a figure which shows an example of a specific information storage part. It is a figure which shows an example of the function of a procedure manual evaluation part. It is a figure which shows an example of a procedure book evaluation process sequence. It is a figure which shows an example of an operation procedure extraction process. It is a figure which shows an example of an operation procedure extraction process. It is a figure which shows an example of operation distribution acquisition process. It is the first half of the flowchart which shows an example of the procedure of operation distribution acquisition processing. It is the latter half of the flowchart which shows an example of the procedure of operation distribution acquisition processing. It is a figure which shows an example of an operation weight calculation process. It is a flowchart which shows an example of the procedure of an operation weight calculation process. It is a figure which shows the example of calculation of procedure manual operation weight amount. It is a flowchart which shows an example of the calculation procedure of procedure manual operation weight amount. It is a figure which shows the example of calculation of standard operation weight amount. It is a flowchart which shows an example of the procedure of a standard operation weight amount calculation process. It is a figure which shows the example of evaluation of a procedure manual. It is a flowchart which shows an example of the procedure of a procedure manual concreteness evaluation process. It is a figure which shows an example of the search result of a procedure manual. It is a figure which shows the example of a script production | generation based on a procedure manual with high procedure manual concrete degree. It is a figure which shows the example of a script production | generation based on a procedure manual with low procedure manual concreteness. It is a figure which shows the function of the procedure manual evaluation part of 3rd Embodiment. It is a figure which shows an example of the specific high-order procedure information. It is a flowchart which shows an example of the procedure document evaluation process sequence of 3rd Embodiment. It is a flowchart which shows an example of the operation procedure extraction process in 3rd Embodiment. It is a flowchart which shows an example of the procedure of a procedure book selection process.

Hereinafter, the present embodiment will be described with reference to the drawings. Each embodiment can be implemented by combining a plurality of embodiments within a consistent range.
[First Embodiment]
First, a first embodiment will be described. The first embodiment relates to an evaluation apparatus that evaluates the concreteness of a procedure manual for operation operations of a computer system.

FIG. 1 is a diagram illustrating a functional configuration example of the evaluation apparatus according to the first embodiment. The evaluation device 10 includes a storage unit 11 and a calculation unit 12.
The storage unit 11 stores a plurality of procedure manuals 11a, 11b,... Related to work performed on the management target system. In the plurality of procedure manuals 11a, 11b,..., A work name indicating a work name and an operation procedure for the management target system are described. The work name expresses a process executed in the entire work in a superordinate concept, and ambiguous words (a phrase in which one word or a plurality of words are connected) are often used. On the other hand, in the operation procedure, for example, work to be performed is described in time series, and specific words are often used. However, some of the plurality of procedure manuals 11a, 11b,... Therefore, the arithmetic unit 12 executes an evaluation process for appropriately evaluating the concreteness of the plurality of procedure manuals 11a, 11b,. The procedure of the evaluation process is as follows.

  First, the calculation unit 12 extracts a plurality of words and phrases expressing the operation from the plurality of procedure manuals 11a, 11b,... (Step S1). For example, the calculation unit 12 analyzes a plurality of procedure manuals 11a, 11b,... And extracts verbs expressing operations such as “creation” and “copy”. Further, the arithmetic unit 12 may extract a phrase having a relationship of “noun + case particle representing means + verb” such as “send by e-mail”. At this time, the calculation unit 12 distinguishes a word extracted from the work name of the procedure manual and a word extracted from the operation procedure of the procedure manual.

  Next, for each of the plurality of extracted words, the calculation unit 12 calculates the number of appearances of words in the work names of the plurality of procedure manuals 11a, 11b,... And the number of appearances of words in the operation procedures of the plurality of procedure books. Count (step S2). At this time, the calculation unit 12 may calculate the appearance frequency of each word / phrase in the work name and the operation procedure. For example, the arithmetic unit 12 determines the phrases to be determined in the work names of the plurality of procedure manuals 11a, 11b,... With respect to the total number of appearances of all the phrases in the work names of the plurality of procedure manuals 11a, 11b,. The first appearance frequency indicating the ratio of the number of appearances is calculated. Further, the calculation unit 12 determines the phrase to be determined in the operation procedure of the plurality of procedure manuals 11a, 11b,... With respect to the total number of appearances of all the phrases in the operation procedure of the plurality of procedure manuals 11a, 11b,. 2nd appearance frequency which shows the ratio of the appearance number of is calculated.

  Next, the computing unit 12 determines a weight value indicating the degree of the concreteness of the operation expressed by the phrase for each of the plurality of phrases (step S3). For example, the calculation unit 12 determines a value corresponding to the number of appearances of words / phrases in the work names of the plurality of procedure manuals 11a, 11b,. Compare the value according to the number. Then, the calculation unit 12 increases the weight value for a phrase having a smaller number of appearances in the work names of the plurality of procedure manuals 11a, 11b,..., And appears in the operation procedure of the plurality of procedure manuals 11a, 11b,. The higher the number, the higher the weight value.

  The computing unit 12 can also use the first appearance frequency and the second appearance frequency for determining the weight value. For example, the calculation unit 12 calculates a value obtained by dividing the second appearance frequency of the word to be determined by the first appearance frequency of the word as the weight value of the word. As a result, the higher the frequency of appearance in the operation procedure, the higher the weight value, and the lower the frequency of appearance in the work item name, the higher the weight value.

  Thereafter, the arithmetic unit 12 evaluates the concreteness of the description of the operation procedure for each of the plurality of procedure manuals 11a, 11b,... Based on the weight value of the phrase included in the operation procedure of the procedure manual (step S4). To S6). The evaluation of the concreteness is executed by the following procedure, for example.

  The calculation unit 12 calculates the sum of the weight values of all the words included in the operation procedure of the procedure manual for the plurality of procedure books 11a, 11b,... (Step S4). This sum is used as the procedure manual operation weight amount. In the example of the procedure manual 11a, the sum of the weight values of the phrases “create”, “copy”, and “send by e-mail” is the procedure manual operation weight amount of the procedure manual 11a.

  Next, the calculation unit 12 sets each of the plurality of words as a word for which the standard operation weight amount is to be calculated, extracts a procedure manual in which the calculation target word appears in the operation procedure, and extracts the procedure manual operation weight of the extracted procedure manual. The average of the amounts is calculated as the standard operation weight amount of the calculation target word (step S5). For example, the procedure manual in which the phrase “copy” appears in the operation procedure is only the procedure manual 11a and the procedure manual 11b. In this case, the average value “4.5” of the procedure manual operation weight amount “5.5” of the procedure manual 11a and the procedure manual operation weight amount “3.5” of the procedure manual 11b is the standard of the phrase “copy”. This is the operation weight. The standard operation weight amount of a word represents a standard procedure manual operation weight amount of a procedure manual in which the word appears in the operation procedure. A phrase with a high standard operation weight amount is a phrase that is often used in a procedure manual that includes a lot of highly specific phrases in the operation procedure.

  Next, for each of the plurality of procedure manuals 11a, 11b,..., The arithmetic unit 12 adds the sum of the weight values of all the words included in the operation procedure in the procedure manual to the words that appear in the operation procedure of the procedure manual. Divide by the maximum value of each standard operation weight. Then, the calculation unit 12 sets the division result as a concrete level indicating the level of concreteness of the description of the operation procedure in the procedure manual (step S6). The concreteness of the procedure manual indicates that the greater the value is, the more specific the operation procedure is.

  The concreteness of the procedure manual is “1” or more when the procedure manual operation weight amount of the procedure manual is higher than the maximum standard operation weight amount of the words in the operation procedure. A procedure manual having a high degree of concreteness (for example, 1 or more) has a concreteness higher than the average in a group of procedure manuals including a specific word / phrase in the operation procedure. In addition, the specific word that appears in the operation procedure of the procedure manual group is the word that has the highest standard operation weight amount in the operation procedure of the procedure manual for which the concreteness is to be calculated, and the procedure manual group that includes the word is also specific. It can be said that it is a collection of relatively high procedures. If the procedure manual has a larger procedure manual operation weight amount in such a group of procedure manuals, it can be said that the concreteness of the operation procedure is quite high.

  The arithmetic unit 12 evaluates the concreteness of each procedure manual by comparing the concreteness of each of the plurality of procedure manuals 11a, 11b,. For example, when the procedure manual 11a and the procedure manual 11b are compared, the procedure manual 11a is evaluated to be more specific, and the procedure manual 11b is evaluated to be less specific. For example, when the procedure manual is searched, the calculation unit 12 can sort and output the search results in descending order by the degree of concreteness. Thereby, it is possible to easily select a procedure manual with a high specificity of the operation procedure.

  In this way, the evaluation device 10 can evaluate the specificities of the plurality of procedure manuals 11a, 11b,. For example, when automating the log acquisition work, it is understood that the procedure manual 11a is more specific by comparing the specificities of the procedure manuals 11a and 11b. Therefore, the operator can easily understand that it is appropriate to generate an automated program such as a script based on the procedure manual 11a. As described above, it is possible to easily find a procedure manual suitable for generating an automated program from among the plurality of procedure manuals 11a, 11b,...

  Moreover, in the first embodiment, the concreteness is evaluated with emphasis on the description of the operation procedure in the procedure manual, and a highly reliable evaluation result can be obtained. In other words, by increasing the weight value of a word that appears more frequently in the operation procedure than the work name, if an ambiguous word that represents the work name appears frequently in the operation procedure in the procedure document, The procedure manual operation weight is kept low. As a result, it is prevented that the procedure manual in which the operation procedure is described with an ambiguous word is highly evaluated.

  In the example of FIG. 1, the concreteness is evaluated according to the concreteness of each procedure manual, but may be evaluated by other methods. For example, the concreteness of the procedure manual can be evaluated by the procedure manual operation weight amount. In this case, the greater the procedure manual operation weight amount, the higher the concreteness is evaluated. Further, for example, when there is at least one word whose weight value is equal to or less than a predetermined value among words included in the operation procedure of the procedure manual, the concreteness of the procedure manual may be evaluated low. As a result, it is possible to reduce the evaluation of the procedure manual having an operation expression that is difficult to replace with a command, and to prevent the automation program from being erroneously generated based on the procedure manual.

  Further, the evaluation of the concreteness of the procedure manual may be repeatedly performed every time a new procedure manual is stored in the storage unit 11. In this case, the procedure manual that is known to have low specificity may be excluded from the processing target at the time of concreteness evaluation. That is, when the computing unit 12 extracts words from the plurality of procedure manuals 11a, 11b,..., A predetermined number of the procedure manuals that have already been evaluated for concreteness. The phrase can be extracted from the procedural manual and the procedural manual that has not yet been evaluated. Thereby, the accuracy of evaluation of concreteness can be improved.

  In addition, the calculating part 12 is realizable with the processor which the evaluation apparatus 10 has, for example. Moreover, the memory | storage part 11 is realizable with the memory or storage apparatus which the evaluation apparatus 10 has, for example.

[Second Embodiment]
Next, a second embodiment will be described. In the second embodiment, a highly specific procedure manual is extracted, and a script is generated based on the procedure manual.

  FIG. 2 is a diagram illustrating a configuration example of a system according to the second embodiment. For example, the operation management server 100 is connected to the management target system 200 via the network 20. The management target system 200 includes, for example, a plurality of computers 210, 220, and 230.

  The operation management server 100 accesses the management target system 200 via the network 20 and performs operations related to operation management. The work is performed manually by the worker based on a procedure manual written in a natural language, for example. If a script for automatically executing the contents of work is prepared in the operation management server 100, the worker only has to input an execution command for the script.

  The operation management server 100 has a function of automatically generating a script for automating a work procedure document written in a natural language. However, if the description of the procedure manual is not concrete, automatic script generation fails. Therefore, in the second embodiment, the operation management server 100 is provided with a function for evaluating whether or not the procedure manual is specific enough to automatically generate a script.

  FIG. 3 is a diagram illustrating a configuration example of hardware of the operation management server used in the present embodiment. The entire operation management server 100 is controlled by the processor 101. A memory 102 and a plurality of peripheral devices are connected to the processor 101 via a bus 109. The processor 101 may be a multiprocessor. The processor 101 is, for example, a CPU (Central Processing Unit), an MPU (Micro Processing Unit), or a DSP (Digital Signal Processor). At least a part of the functions realized by the processor 101 executing the program may be realized by an electronic circuit such as an ASIC (Application Specific Integrated Circuit) or a PLD (Programmable Logic Device).

  The memory 102 is used as a main storage device of the operation management server 100. The memory 102 temporarily stores at least part of an OS (Operating System) program and application programs to be executed by the processor 101. The memory 102 stores various data necessary for processing by the processor 101. As the memory 102, for example, a volatile semiconductor storage device such as a RAM (Random Access Memory) is used.

  Peripheral devices connected to the bus 109 include a storage device 103, a graphic processing device 104, an input interface 105, an optical drive device 106, a device connection interface 107, and a network interface 108.

  The storage device 103 writes and reads data electrically or magnetically with respect to a built-in storage medium. The storage device 103 is used as an auxiliary storage device of a computer. The storage device 103 stores an OS program, application programs, and various data. For example, an HDD (Hard Disk Drive) or an SSD (Solid State Drive) can be used as the storage device 103.

  A monitor 21 is connected to the graphic processing device 104. The graphic processing device 104 displays an image on the screen of the monitor 21 in accordance with an instruction from the processor 101. Examples of the monitor 21 include a display device using a CRT (Cathode Ray Tube) and a liquid crystal display device.

  A keyboard 22 and a mouse 23 are connected to the input interface 105. The input interface 105 transmits signals sent from the keyboard 22 and the mouse 23 to the processor 101. The mouse 23 is an example of a pointing device, and other pointing devices can also be used. Examples of other pointing devices include a touch panel, a tablet, a touch pad, and a trackball.

  The optical drive device 106 reads data recorded on the optical disc 24 using laser light or the like. The optical disc 24 is a portable recording medium on which data is recorded so that it can be read by reflection of light. The optical disc 24 includes a DVD (Digital Versatile Disc), a DVD-RAM, a CD-ROM (Compact Disc Read Only Memory), a CD-R (Recordable) / RW (ReWritable), and the like.

  The device connection interface 107 is a communication interface for connecting peripheral devices to the operation management server 100. For example, the memory device 25 and the memory reader / writer 26 can be connected to the device connection interface 107. The memory device 25 is a recording medium equipped with a communication function with the device connection interface 107. The memory reader / writer 26 is a device that writes data to the memory card 27 or reads data from the memory card 27. The memory card 27 is a card type recording medium.

  The network interface 108 is connected to the network 20. The network interface 108 transmits and receives data to and from other computers or communication devices via the network 20.

  With the hardware configuration described above, the processing functions of the second embodiment can be realized. Note that the evaluation apparatus 10 shown in the first embodiment can also be realized by the same hardware as the operation management server 100 shown in FIG.

  The operation management server 100 implements the processing functions of the second embodiment by executing a program recorded on a computer-readable recording medium, for example. A program describing the processing contents to be executed by the operation management server 100 can be recorded in various recording media. For example, a program to be executed by the operation management server 100 can be stored in the storage device 103. The processor 101 loads at least a part of the program in the storage apparatus 103 into the memory 102 and executes the program. A program to be executed by the operation management server 100 can also be recorded on a portable recording medium such as the optical disc 24, the memory device 25, and the memory card 27. The program stored in the portable recording medium becomes executable after being installed in the storage apparatus 103 under the control of the processor 101, for example. The processor 101 can also read and execute a program directly from a portable recording medium.

The operation management server 100 realizes a procedure evaluation function and a script generation function based on a program stored in the storage device 103, for example.
FIG. 4 is a block diagram showing the concreteness evaluation and script generation function of the procedure manual. The operation management server 100 includes a procedure manual database (DB) 110, a procedure manual evaluation unit 120, a concreteness information storage unit 130, and a script generation unit 140.

The procedure manual DB 110 stores information regarding a plurality of procedure manuals 111. For example, a part of the storage area of the storage apparatus 103 is used as the procedure manual DB 110.
The procedure manual evaluation unit 120 evaluates the concreteness of the description in the procedure manual. For example, when a procedure manual evaluation instruction is input via an input device such as the keyboard 22, the procedure manual evaluation unit 120 reads a plurality of procedure manuals 111 stored in the procedure manual DB 110 and analyzes the contents. And the procedure manual evaluation part 120 calculates the numerical value which shows the specific degree of each procedure manual. The procedure manual evaluation unit 120 stores the procedure manual concreteness information 131 indicating the concreteness of each procedure manual in the concreteness information storage unit 130.

  The concreteness information storage unit 130 stores procedure manual concreteness information 131. As the degree-of-specificity information storage unit 130, a part of the storage area of the memory 102 or the storage apparatus 103 is used.

  The script generation unit 140 generates a script for automatically executing an operation operation corresponding to the procedure manual by replacing each operation indicated in the specific procedure manual with a command. For example, the script generation unit 140 generates a script based on a procedure manual determined by the procedure manual evaluation unit 120 as having the highest degree of concreteness among a plurality of procedure manuals related to a predetermined work.

Next, the contents of the procedure manual DB 110 will be described in detail.
FIG. 5 is a diagram illustrating an example of the procedure manual DB. The procedure manual DB 110 stores a plurality of procedure manuals 111a, 111b, 111c,. Each procedure manual 111a, 111b, 111c,... Describes a procedure manual ID, a work item name, and an operation procedure. The procedure manual ID is identification information for identifying the procedure manual. The work item name is the name of the operation work performed in the procedure manual. The operation procedure is the content of the operation performed in the operation work.

Next, the contents of the concreteness information storage unit 130 will be described in detail.
FIG. 6 is a diagram illustrating an example of the concreteness information storage unit. In the example of FIG. 6, procedure manual concreteness information 131 in a table format is stored in the concreteness information storage unit 130. The procedure manual specificity information 131 includes columns for procedure manual ID, work item name, and procedure manual concreteness. The procedure manual ID is set in the column of the procedure manual ID. In the work item name column, the work item name of the procedure manual is set. In the column of procedure manual concreteness, a numerical value (procedure manual concreteness) representing the concreteness of the operation procedure described in the procedure manual is set.

Next, the function of the procedure manual evaluation unit 120 will be described in detail.
FIG. 7 is a diagram illustrating an example of the function of the procedure manual evaluation unit. The procedure manual evaluation unit 120 includes a storage unit 121, an operation extraction unit 122, an operation distribution acquisition unit 123, an operation weight calculation unit 124, a procedure manual operation weight amount calculation unit 125, a standard operation weight amount calculation unit 126, and a procedure manual specificity. An evaluation unit 127 is included.

  The storage unit 121 stores information used in the procedure manual evaluation process. For example, the procedure part operation information 121a, the operation distribution information 121b, the operation weight information 121c, the procedure manual operation weight amount information 121d, and the standard operation weight amount information 121e are stored in the storage unit 121. The procedure manual operation information 121a is information for managing the contents of the procedure manual read from the procedure manual DB 110. The operation distribution information 121b is information indicating how much the operation expression (word) appearing in the operation procedure of the procedure manual appears in each of the work item and the operation procedure. The operation weight information 121c is information indicating a value (operation weight value) representing the specificity of each operation expression that appears in the operation procedure of the procedure manual. The procedure manual operation weight amount information 121d is information indicating a value (procedure manual operation weight amount) obtained by totaling operation weight values of operation expressions included in the operation procedure for each of the plurality of procedure manuals. The standard operation weight amount information 121e is information indicating an average value (standard operation weight amount) of the procedure manual operation weight amount of the procedure manual including the operation expression for each operation expression.

  The operation extraction unit 122 extracts the procedure manual from the procedure manual DB 110 and generates the procedure manual operation information 121a. The operation extraction unit 122 stores the generated procedure manual operation information 121 a in the storage unit 121.

  The operation distribution acquisition unit 123 acquires the ratio (distribution status) of the procedure manuals in which each operation expression appears based on the procedure manual operation information 121a, and generates the operation distribution information 121b. The operation distribution acquisition unit 123 stores the generated operation distribution information 121b in the storage unit 121.

  The operation weight calculation unit 124 calculates an operation weight value for each operation expression based on the operation distribution information 121b, and generates operation weight information 121c. The operation weight calculation unit 124 stores the generated operation weight information 121 c in the storage unit 121.

  The procedure manual operation weight amount calculation unit 125 calculates a procedure manual operation weight amount for each procedure document based on the operation weight information 121c, and generates procedure manual operation weight amount information 121d. The procedure manual operation weight amount calculation unit 125 stores the generated procedure manual operation weight amount information 121 d in the storage unit 121.

  The standard operation weight amount calculation unit 126 calculates a standard operation weight amount for each operation expression based on the procedure manual operation weight amount information 121d, and generates standard operation weight amount information 121e. The standard operation weight amount calculation unit 126 stores the generated standard operation weight amount information 121e in the storage unit 121.

  The procedure manual concreteness evaluation unit 127 calculates the concreteness for each procedure manual based on the procedure manual operation weight information 121d and the standard operation weight information 121e, and generates the procedure manual concreteness information 131. The procedure manual concreteness evaluation unit 127 stores the generated procedure manual concreteness information 131 in the concreteness information storage unit 130.

Next, the procedure manual evaluation process in the procedure manual evaluation unit 120 will be described in detail.
FIG. 8 is a diagram illustrating an example of a procedure manual evaluation process procedure. As shown in FIG. 8, first, an operation procedure extraction process is executed by the operation extraction unit 122 (step S101). Next, an operation distribution acquisition process is executed by the operation distribution acquisition unit 123 (step S102). Next, an operation weight calculation process is executed by the operation weight calculation unit 124 (step S103). Next, the procedure manual operation weight amount calculation unit 125 executes a procedure manual operation weight amount calculation process (step S104). Next, the standard operation weight amount calculation unit 126 executes standard operation weight amount calculation processing (step S105). Next, the procedure manual concreteness evaluation unit 127 executes a procedure manual concreteness evaluation process (step S106).

Next, the process of each step shown in FIG. 8 will be described in detail. First, the operation procedure extraction process will be described with reference to FIGS.
FIG. 9 is a diagram illustrating an example of the operation procedure extraction process. The operation extraction unit 122 reads a plurality of procedure manuals 111a, 111b, 111c,... From the procedure manual DB 110. Then, the operation extracting unit 122 analyzes the contents of the plurality of procedure manuals 111a, 111b, 111c,..., And extracts work item names and operation procedures. And the operation extraction part 122 produces | generates the procedure manual operation information 121a based on an extraction result.

  The procedure manual operation information 121a includes columns for a procedure manual ID, a work item name, and an operation procedure. The procedure manual ID assigned to the procedure manual is set in the column of the procedure manual ID. In the work item name column, the work item name of the procedure manual is set. An operation procedure described in the procedure manual is set in the operation procedure column.

FIG. 10 is a diagram illustrating an example of the operation procedure extraction process. In the following, the process illustrated in FIG. 10 will be described in order of step number.
[Step S111] The operation extraction unit 122 selects one procedure manual ID of the procedure manual to be input. The procedure manual ID of the procedure manual to be input is specified, for example, when an evaluation instruction is input. For example, when all the procedure manuals in the procedure manual DB 110 are designated as input procedure manuals, the operation extraction unit 122 selects one procedure manual ID for each of the procedure manuals in the procedure manual DB 110 one by one.

[Step S112] The operation extraction unit 122 reads the procedure manual with the selected procedure manual ID from the procedure manual DB 110.
[Step S113] The operation extraction unit 122 analyzes the read procedure manual and obtains a work item name and an operation procedure. For example, the operation extraction unit 122 searches for a character string “work item name:” from the procedure manual. Then, the operation extraction unit 122 acquires a character string (until there is a line break) following the detected character string as a work item name of the procedure manual. In addition, the operation extraction unit 122 acquires a character string “operation procedure:” from the procedure manual. Then, the operation extraction unit 122 acquires character strings in all lines after the detected character string as an operation procedure.

[Step S114] The operation extraction unit 122 associates the selected procedure manual ID with the extracted work item name and operation procedure, and records them in the procedure manual operation information 121a.
[Step S115] The operation extraction unit 122 determines whether or not processing has been completed for all procedure manual IDs. When the process is completed for all the procedure manual IDs, the operation procedure extraction process is terminated. If there is an unprocessed procedure manual ID, the process proceeds to step S111.

In this way, the operation procedure extraction process is executed, and the procedure manual operation information 121a is generated.
Next, the operation distribution acquisition process will be described with reference to FIGS.

FIG. 11 is a diagram illustrating an example of the operation distribution acquisition process. The operation distribution acquisition unit 123 acquires the work item distribution frequency from the work item name of each procedure manual based on the procedure manual operation information 121a. For example, the operation distribution acquisition unit 123 performs a morphological analysis of a character string included in the work item name, and extracts an expression applicable to the following part of speech pattern as an operation expression.
・ Verbs (Omit “do” and “do”)
Noun + “de (case particle representing means)” + verb For example, “acquire” is extracted from “log acquisition”, and “change” is extracted from “job setting change”. The operation distribution acquisition unit 123 counts the number of times of extraction for each extracted operation expression and sets it as the work item distribution frequency. Then, the operation distribution acquisition unit 123 sets the ratio of the work item distribution frequency of the operation expression to the total number of extracted operation expressions as the work item distribution ratio of the operation expression.

  The operation distribution acquisition unit 123 acquires the operation procedure distribution frequency from the operation procedure of each procedure manual based on the procedure manual operation information 121a. For example, the operation distribution acquisition unit 123 performs morphological analysis of a character string included in the operation procedure, and extracts a verb indicating an operation expression. For example, “Copy” is extracted from “Copy log file from server”, and “Confirm” is extracted from “Confirm change result”. The operation distribution acquisition unit 123 can also extract an operation expression including a word indicating an operation means, such as “send by e-mail”. The operation distribution acquisition unit 123 counts the number of times of extraction for each extracted operation expression and sets it as the operation procedure distribution frequency. Then, the operation distribution acquisition unit 123 sets the ratio of the operation procedure distribution frequency of the operation expression to the total number of extracted operation expressions as the operation procedure distribution ratio of the operation expression.

  The operation distribution acquisition unit 123 generates operation distribution information 121b using the obtained information. In the operation distribution information 121b, for example, columns of operation expression, work item distribution frequency, work item distribution ratio, operation procedure distribution frequency, and operation procedure distribution ratio are provided. In the operation expression column, a character string indicating the extracted operation expression is set. The work item distribution frequency of the corresponding operation expression is set in the work item distribution frequency column. The work item distribution ratio of the corresponding operation item is set in the work item distribution ratio column. The operation procedure distribution frequency of the corresponding operation item is set in the operation procedure distribution frequency column. The operation procedure distribution ratio of the corresponding operation item is set in the operation procedure distribution ratio column.

FIG. 12 is the first half of a flowchart illustrating an example of the procedure of the operation distribution acquisition process. In the following, the process illustrated in FIG. 12 will be described in order of step number.
[Step S121] The operation distribution acquisition unit 123 selects one procedure manual ID from the procedure manual operation information 121a.

  [Step S122] The operation distribution acquisition unit 123 reads the work item name of the selected procedure manual ID from the procedure manual operation information 121a and analyzes it. For example, the operation distribution acquisition unit 123 performs morphological analysis of the read operation item. The operation distribution acquisition unit 123 acquires an operation expression based on the analysis result. At this time, one or a plurality of operation expressions are acquired.

[Step S123] The operation distribution acquisition unit 123 selects one operation expression acquired in step S122.
[Step S124] The operation distribution acquisition unit 123 determines whether or not the selected operation expression has been registered in the operation distribution information 121b. For example, the operation distribution acquisition unit 123 searches the operation expression selected in step S123 from the operation expression column of the operation distribution information 121b. The operation distribution acquisition unit 123 determines that it is registered when there is a corresponding operation expression. If registered, the process proceeds to step S126. If not registered, the process proceeds to step S125.

  [Step S125] The operation distribution acquisition unit 123 adds a new record to the operation distribution information 121b, and sets the operation expression selected in step S123 in the operation expression column of the record. Further, the operation distribution acquisition unit 123 sets “1” to the work item distribution frequency of the newly added record. Thereafter, the process proceeds to step S127.

[Step S126] The operation distribution acquisition unit 123 adds “1” to the work item distribution frequency of the record corresponding to the selected operation expression.
[Step S127] The operation distribution acquisition unit 123 determines whether or not processing has been completed for all the operation expressions acquired in step S122. When the processes for all the operation expressions are completed, the process proceeds to step S131 (see FIG. 13). If there is an unprocessed operation expression, the process proceeds to step S123.

FIG. 13 is the second half of the flowchart showing an example of the procedure of the operation distribution acquisition process. In the following, the process illustrated in FIG. 13 will be described in order of step number.
[Step S131] The operation distribution acquisition unit 123 reads the operation procedure of the procedure manual ID selected in step S121 from the procedure manual operation information 121a and analyzes it. For example, the operation distribution acquisition unit 123 performs morphological analysis of the read operation procedure. The operation distribution acquisition unit 123 acquires an operation expression based on the analysis result. At this time, one or a plurality of operation expressions are acquired.

[Step S132] The operation distribution acquisition unit 123 selects one operation expression acquired in step S131.
[Step S133] The operation distribution acquisition unit 123 determines whether or not the selected operation expression has been registered in the operation distribution information 121b. If registered, the process proceeds to step S135. If not registered, the process proceeds to step S134.

  [Step S134] The operation distribution acquisition unit 123 adds a new record to the operation distribution information 121b, and sets the operation expression selected in step S132 in the operation expression column of the record. Further, the operation distribution acquisition unit 123 sets “1” to the operation procedure distribution frequency of the newly added record. Thereafter, the process proceeds to step S136.

[Step S135] The operation distribution acquisition unit 123 adds “1” to the operation procedure distribution frequency of the record corresponding to the selected operation expression.
[Step S136] The operation distribution acquisition unit 123 determines whether or not the processing has been completed for all the operation expressions acquired in step S131. When the processes for all the operation expressions are completed, the process proceeds to step S137. If there is an unprocessed operation expression, the process proceeds to step S132.

  [Step S137] The operation distribution acquisition unit 123 determines whether or not the processing has been completed for all the procedure manual IDs set in the procedure manual operation information 121a. If the processing for all procedure manual IDs has been completed, the processing proceeds to step S138. If there is an unprocessed procedure manual ID, the process proceeds to step S121 (see FIG. 12).

[Step S138] The operation distribution acquisition unit 123 sums up the work item distribution frequencies of the operation expressions. Further, the operation distribution acquisition unit 123 sums up the operation procedure distribution frequencies of the respective operation expressions.
[Step S139] The operation distribution acquisition unit 123 calculates a work item distribution ratio and an operation procedure distribution ratio for each operation item, and sets them in the operation distribution information 121b.

  For example, the operation distribution acquisition unit 123 sequentially selects the operation expressions set in the operation distribution information 121b. The operation distribution acquisition unit 123 divides the work item distribution frequency of the selected operation expression by the sum of the work item distribution frequencies of all operation expressions. The operation distribution acquisition unit 123 sets the division result in the operation distribution information 121b as a work item distribution ratio of the selected operation expression. Further, the operation distribution acquisition unit 123 divides the operation procedure distribution frequency of the selected operation expression by the sum of the operation procedure distribution frequencies of all operation expressions. The operation distribution acquisition unit 123 sets the division result in the operation distribution information 121b as the operation procedure distribution ratio of the selected operation expression. Thereafter, the operation distribution acquisition process ends.

Next, the operation weight calculation process will be described in detail with reference to FIGS. 14 and 15.
FIG. 14 is a diagram illustrating an example of the operation weight calculation process. The operation weight calculation unit 124 calculates an operation weight value for each operation expression based on the operation distribution information 121b. For example, the operation weight calculation unit 124 calculates an operation weight value using the following equation.
(Operation weight value) = (Operation procedure distribution ratio) / (Work item distribution ratio)
The operation weight value increases as the operation expression appears more frequently in the operation procedure. In addition, the operation weight value is lower as the operation expression appears more frequently in the work item name. An operation expression with a higher operation weight value can be evaluated as more specific. That is, when the work item name is compared with the operation procedure, the work item name represents the entire operation operation, and abstract terms are often used. On the other hand, the operation procedure is intended to be performed by an operator based on the operation procedure, and specific terms are often used. Therefore, in the second embodiment, the operation weight value is set higher for the operation expression that is used more in the operation expression than the work item name.

  The operation weight calculation unit 124 generates operation weight information 121c based on the calculated operation weight value. The operation weight information 121c has columns for operation expression and operation weight value. The operation expression extracted from the procedure manual is set in the operation expression column. In the operation weight value column, the weight value of the corresponding operation expression is set.

FIG. 15 is a flowchart illustrating an example of the procedure of the operation weight calculation process. In the following, the process illustrated in FIG. 15 will be described in order of step number.
[Step S141] The operation weight calculation unit 124 selects one operation expression from the operation distribution information 121b.

[Step S142] The operation weight calculation unit 124 reads the work item distribution ratio and the operation procedure distribution ratio of the selected operation expression from the operation distribution information 121b.
[Step S143] The operation weight calculation unit 124 adds a new record to the operation weight information 121c, and sets the selected operation expression in the operation expression column of the added record.

  [Step S144] The operation weight calculation unit 124 determines whether or not the work item distribution ratio read in step S142 is greater than “0”. If the work item distribution ratio is greater than “0”, the process proceeds to step S145. If the work item distribution ratio is “0”, the process proceeds to step S146.

  [Step S145] The operation weight calculation unit 124 calculates (operation procedure distribution ratio) / (work item distribution ratio) based on the work item distribution ratio and the operation procedure distribution ratio read in step S142. Then, the operation weight calculation unit 124 records the calculation result as the operation weight value in the operation weight information 121c in association with the selected operation expression.

  [Step S146] The operation weight calculation unit 124 determines whether or not the processing in steps S141 to S145 has been completed for all operation expressions in the operation distribution information 121b. If the processing has been completed for all operation expressions, the processing proceeds to step S147. If there is an unprocessed operation expression, the process proceeds to step S141.

  [Step S147] The operation weight calculation unit 124 determines whether there is an operation expression whose operation weight value is not recorded. For the operation expression for which the work item distribution ratio is determined to be “0” in the determination in step S144, the operation weight value is not recorded. If there is a corresponding operation expression, the process proceeds to step S148. If there is no corresponding operation expression, the operation weight value calculation process ends.

  [Step S148] The operation weight calculation unit 124 acquires the maximum value of the operation weight value set in the operation weight information 121c. Then, the operation weight calculation unit 124 sets the acquired maximum value in the operation weight information 121c as a provisional value of the operation weight value for the operation expression for which the operation weight value is not recorded.

In this way, an operation weight value is set for each operation expression.
Next, the procedure manual operation weight amount calculation processing will be described in detail with reference to FIGS.

  FIG. 16 is a diagram illustrating a calculation example of the procedure manual operation weight amount. The procedure manual operation weight amount calculation unit 125 extracts an operation expression in the operation procedure for each procedure manual ID indicated in the procedure manual operation information 121a. Then, the procedure manual operation weight amount calculation unit 125 sums up the operation weight values of the operation expressions extracted from the operation procedures for each procedure document ID, and uses the total value as the procedure manual operation weight amount corresponding to the procedure document ID. The procedure manual operation weight information 121d is set.

  A value obtained by dividing the total operation weight value of each operation expression by the number of operation steps in the operation procedure may be used as the procedure manual operation weight amount. The number of operation steps is, for example, the maximum value of step numbers (first numbers in each row) indicated in the operation procedure. The number of lines describing the operation procedure may be the number of operation steps. In the example of the procedure manual ID “1” in FIG. 16, the number of operation steps is “3”. Then, the value obtained by dividing the total operation weight value of each operation expression by the number of operation steps is “5.5 / 3 = 1.83”. By dividing the total operation weight value by the number of operation steps, an operation weight amount per step is obtained. By setting the operation weight amount per step as the procedure manual operation weight amount, it is possible to prevent the procedure manual operation weight amount from being affected by the length of the operation procedure.

  The procedure manual operation weight information 121d has columns of procedure manual ID, operation expression, and procedure manual operation weight. The procedure manual ID included in the procedure manual operation information 121a is set in the procedure manual ID column. In the operation expression column, an operation expression included in the operation procedure corresponding to the procedure manual ID is set. In the column for the procedure manual operation weight amount, the total of the operation weight values of each corresponding operation expression (procedure manual operation weight amount) is set.

FIG. 17 is a flowchart illustrating an example of a procedure for calculating the procedure manual operation weight amount. In the following, the process illustrated in FIG. 17 will be described in order of step number.
[Step S151] The procedure manual operation weight amount calculation unit 125 selects one procedure manual ID from the procedure manual operation information 121a.

  [Step S152] The procedure manual operation weight amount calculation unit 125 reads the operation procedure of the selected procedure manual ID from the procedure manual operation information 121a and analyzes it. Then, the procedure manual operation weight amount calculation unit 125 acquires an operation expression in the read operation procedure.

[Step S153] The procedure manual operation weight amount calculation unit 125 records the acquired operation expression in the procedure manual operation weight amount information 121d.
[Step S154] The procedure manual operation weight amount calculation unit 125 reads the operation weight value of each acquired operation expression from the operation weight information 121c. Then, the procedure manual operation weight calculation unit 125 integrates the operation weight values of the acquired operation expressions.

[Step S155] The procedure manual operation weight amount calculation unit 125 records the integrated value in step S154 as the procedure manual operation weight amount in the procedure manual operation weight amount information 121d.
[Step S156] The procedure manual operation weight amount calculation unit 125 determines whether or not processing has been completed for all procedure manual IDs. When the processing is completed for all the procedure manual IDs, the procedure manual operation weight amount calculation processing ends. If there is an unprocessed procedure manual ID, the process proceeds to step S151.

  In this way, the procedure manual operation weight amount for each procedure manual ID is calculated. The procedure manual operation weight amount increases as the operation procedure includes more operation expressions having high specificities (operation weight values).

Next, the standard operation weight amount calculation process will be described with reference to FIGS.
FIG. 18 is a diagram illustrating a calculation example of the standard operation weight amount. For each operation expression, the standard operation weight amount calculation unit 126 calculates an average of the procedure manual operation weight amounts of the procedure manual ID including the operation expression in the operation procedure. The calculated average is the standard operation weight amount of the operation expression. For example, the procedure manual IDs of the procedure manuals including the operation expression “copy” in the operation procedures are “1” and “3”. The procedure manual operation weight amount of the procedure manual ID “1” is “5.5”, and the procedure manual operation weight amount of the procedure manual ID “3” is “3.5”. Then, the standard operation weight amount of the operation expression “copy” is “4.5”.

FIG. 19 is a flowchart illustrating an example of the procedure of the standard operation weight amount calculation process. In the following, the process illustrated in FIG. 19 will be described in order of step number.
[Step S161] The standard operation weight amount calculation unit 126 selects one operation expression from the operation distribution information 121b.

  [Step S162] The standard operation weight amount calculation unit 126 searches the procedure manual operation weight amount information 121d for the procedure manual ID of the procedure manual including the selected operation expression in the operation procedure. Then, the standard operation weight amount calculation unit 126 records the corresponding procedure manual ID as a new record in the standard operation weight amount information 121e in association with the selected operation expression.

[Step S163] The standard operation weight amount calculation unit 126 integrates the procedure manual operation weight amounts of the recorded procedure manual IDs.
[Step S164] The standard operation weight amount calculation unit 126 divides the integrated value of the procedure manual operation weight amount by the number of procedure manual IDs to calculate an average value of the procedure manual operation weight amount.

[Step S165] The standard operation weight amount calculation unit 126 records the calculated average value in the standard operation weight amount information 121e as a standard operation weight amount in association with the selected operation expression.
[Step S166] The standard operation weight calculation unit 126 determines whether or not processing has been completed for all operation expressions. When the process is completed for all the operation expressions, the standard operation weight amount calculation process ends. If there is an unprocessed operation expression, the process proceeds to step S161.

  In this way, the standard operation weight amount of each operation expression is calculated. The standard operation weight amount indicates how specific the operation expression is used in the procedure manual. That is, the standard operation weight amount becomes larger as the operation expression is used more frequently in the procedure manual having a higher specific operation procedure.

Hereinafter, the procedure manual concreteness evaluation process will be described in detail with reference to FIGS. 20 and 21.
FIG. 20 is a diagram illustrating an evaluation example of a procedure manual. The procedure manual concreteness evaluation unit 127 calculates the concreteness of the procedure manual as a ratio of the procedure manual operation weight amount to the maximum value of the standard operation weight amount. This is expressed by the following formula.
(Procedure details) = (Procedure operation weight) / (Maximum standard operation weight)
The maximum value of the standard operation weight amount is the standard operation weight amount for the operation expression having the maximum standard operation weight amount among the operation expressions included in the operation procedure of the procedure manual to be calculated.

  For example, the procedure manual concreteness evaluation unit 127 refers to the procedure manual operation weight amount information 121d and the standard operation weight amount information 121e, among the operation expressions included in the operation procedure of the procedure manual 111a with the procedure manual ID “1”. Then, it is determined that the operation expression “copy” has the largest standard operation weight amount. The standard operation weight amount of the operation expression “copy” is “4.5”. On the other hand, the procedure manual operation weight amount of the procedure manual with the procedure manual ID “1” is “5.5”. Then, “5.5 / 4.5 = 1.22” becomes the procedure manual concrete degree of the procedure manual 111a with the procedure manual ID “1”.

  Also, for example, it is determined that the operation expression “copy” has the largest standard operation weight amount among the operation expressions included in the operation procedure of the procedure manual 111c with the procedure manual ID “3”. The standard operation weight amount of the operation expression “copy” is “4.5”. On the other hand, the procedure manual operation weight amount of the procedure manual 111c with the procedure manual ID “3” is “3.5”. Then, “3.5 / 4.5 = 0.78” becomes the procedure manual specificity of the procedure manual 111c with the procedure manual ID “3”.

  Among the operation expressions in the operation procedure of the procedure manual, the operation expression having the highest standard operation weight amount is an operation representation that is frequently used in the procedure manual having a high procedure manual operation weight amount. It is considered that the procedure manual is more specific as the procedure manual operation weight amount of the procedure manual using the operation expression is larger than the standard operation weight amount of the operation expression having the highest standard operation weight amount.

FIG. 21 is a flowchart illustrating an example of the procedure of the procedure manual concreteness evaluation process. In the following, the process illustrated in FIG. 21 will be described in order of step number.
[Step S171] The procedure manual concreteness evaluation unit 127 selects one procedure manual ID from the procedure manual operation weight information 121d.

[Step S172] The procedure manual concreteness evaluation unit 127 reads the operation expression included in the operation procedure of the selected procedure manual ID from the procedure manual operation weight information 121d.
[Step S173] The procedure manual concreteness evaluation unit 127 acquires the standard operation weight amount of each operation expression included in the operation procedure from the standard operation weight amount information 121e. The procedure manual concreteness evaluation unit 127 compares the acquired standard operation weights, and specifies an operation expression having the maximum standard operation weight. Then, the procedure manual concreteness evaluation unit 127 stores the standard operation weight amount of the specified operation expression in the storage unit 121.

  [Step S174] The procedure manual concreteness evaluation unit 127 acquires the procedure manual operation weight amount of the procedure manual corresponding to the selected procedure manual ID from the procedure manual operation weight information 121d and stores it in the storage unit 121.

  [Step S175] The procedure manual concreteness evaluation unit 127 divides the procedure manual operation weight amount stored in step S174 by the standard operation weight amount stored in step S173 to calculate the procedure manual concreteness.

  [Step S176] The procedure manual concreteness evaluation unit 127 determines whether or not processing has been completed for all procedure manual IDs. When the process is completed for all the procedure manual IDs, the procedure manual concreteness evaluation process ends. If there is an unprocessed procedure manual ID, the process proceeds to step S171.

  In this way, the procedure manual concreteness is calculated for all input procedure manuals. When automating a procedure manual, if a script is created based on a procedure manual with a high degree of procedure manual specificity, the procedure manual has less ambiguity and a correct script can be easily created. For example, by searching for a procedure manual by work item name and comparing the procedure manual specificities of the corresponding procedure manuals, it is possible to quickly find a procedure manual with a high work specificity among the procedure manuals related to similar work.

  FIG. 22 is a diagram illustrating an example of a procedure book search result. FIG. 22 shows a search result 31 of a search for the work item name of the procedure manual with “log” as a search keyword. In the example of FIG. 22, the procedure manual specificities of procedure manuals having work item names such as “log acquisition” and “log collection” are shown in the search result 31. Referring to the search result 31, it can be understood that the operation procedure of the procedure manual with the procedure manual ID “1” is the most specific as the procedure manual for the work related to log acquisition.

Since the operation procedure of the procedure manual with the procedure manual ID “1” is specific, there is a high possibility that a script can be automatically generated.
FIG. 23 is a diagram illustrating a script generation example based on a procedure manual having a high procedure manual specificity. The first step of the procedure manual 111 a is replaced with a directory creation command in the script 41. The second step of the procedure manual 111a is replaced in the script 41 with a command for copying the log file from the server to the directory. The third step of the procedure manual 111a is replaced in the script 41 with a command for sending a message indicating that the work is completed by mail.

  Thus, all the operation steps included in the operation procedure in the procedure manual 111a can be replaced with commands, and the script 41 can be completed. On the other hand, even if an attempt is made to automatically generate a script for a procedure manual with a low degree of procedure manual specificity, there is a possibility that the command to be replaced cannot be determined because the ambiguity is too high.

  FIG. 24 is a diagram illustrating a script generation example based on a procedure manual having a low procedure manual specificity. In the first step “preparation of directory” of the procedure manual 111c, whether to create a new directory unconditionally or to check whether a predetermined directory exists and to create a directory only when there is no corresponding directory I can't. Therefore, in the first step of the procedure manual 111c, conversion to a command has failed when the script 42 is created. Further, in the third step of the procedure manual 111c, the contact means in the “work completion notification” cannot be specified. Therefore, in the third step of the procedure manual 111c, conversion to a command has failed when the script 42 is created.

  As shown in FIG. 24, when the automatic generation of the script 42 fails, the operator himself / herself sets a command in the script 42 to complete the script 42 or manually executes an operation step that could not be converted into a command. It becomes.

  As described above, according to the second embodiment, it is possible to specify a procedure manual effective for automatic script generation, and it is easy to generate a script corresponding to the procedure manual. If the procedure manual can be replaced with a script, the operation can be automated and the system operation can be made more efficient.

[Third Embodiment]
Next, a third embodiment will be described. In the third embodiment, when repeatedly evaluating the concreteness of a procedure manual, the procedure manual with a low degree of concreteness of the procedure manual is excluded from the input at the time of the next procedure manual evaluation. Is to improve.

  That is, the procedure manual specificity is a relative value between the input procedure manuals. For this reason, if the target operation procedure manual is low in concreteness, the concreteness determination accuracy is low. Therefore, in the third embodiment, in order to improve the accuracy of determination of the degree of concreteness, when performing the concreteness evaluation of a new procedural manual, a procedure manual that is known to have high specificity in the previous concreteness evaluation, The concreteness of the procedure manual is evaluated by the new procedure manual.

Hereinafter, differences of the third embodiment from the second embodiment will be described.
FIG. 25 is a diagram illustrating the function of the procedure manual evaluation unit according to the third embodiment. The procedure manual evaluation unit 120a of the third embodiment includes a procedure manual selection unit 128 in addition to the same functions as those of the second embodiment. The storage unit 121 stores high-specificity procedure manual information 121f.

  The procedure manual sorting unit 128 sorts a predetermined number of procedure manuals with high procedure manual concreteness as higher-level procedure manuals from the evaluated procedure manuals based on the procedure manual concreteness calculated by the procedure manual concreteness evaluation unit 127. To do. For example, the procedure manual sorting unit 128 sorts the procedure manual having the highest half of the procedure manual concreteness as the upper procedure manual. The procedure manual selection unit 128 generates concreteness higher procedure manual information 121 f including the procedure manual ID of the selected higher-level procedure manual and stores it in the storage unit 121.

  Further, in the third embodiment, when a new procedure manual to be evaluated for concreteness is stored in the procedure manual DB 110, the operation extracting unit 122 stores the new procedure manual and the concreteness higher procedure manual information 121f. The indicated procedure manual is acquired from the procedure manual DB 110. And the operation extraction part 122 produces | generates the procedure manual operation information 121a based on the acquired procedure manual.

  FIG. 26 is a diagram illustrating an example of the high-level concrete procedure information. The concreteness level procedure manual information 121f includes information on the concreteness calculated procedure manual and information on the concreteness high procedure manual. For example, the range of procedure manual IDs for which the procedure manual specificities have been calculated is indicated in the information on the specificities calculated procedure manuals. For example, the procedure manual ID of the procedure manual selected as the higher-level procedure manual by the procedure manual sorting unit 128 is set in the information on the higher-order procedure manual.

Next, a procedure manual evaluation process procedure according to the third embodiment will be described.
FIG. 27 is a flowchart illustrating an example of a procedure manual evaluation process procedure according to the third embodiment. Of the processing shown in FIG. 27, the processing procedure extraction processing (step S101a) and the procedure manual selection processing (step S107) are different from the processing of the second embodiment shown in FIG.

  In the operation procedure extraction process (step S101a), the operation extraction unit 122 reads from the procedure manual DB 110 the procedure manuals 111d and 111e set as the higher procedure manual in the concreteness higher procedure manual information 121f, the new procedure manual 111g, 111f is read. The operation extracting unit 122 generates procedure manual operation information 121a based on the read procedure manual.

  In the procedure manual selection process (step S107), the procedure manual selection unit 128 generates the specificity higher level procedure manual information 121f based on the procedure manual specificities of a plurality of procedure manuals calculated by the procedure manual concreteness evaluation unit 127. To do.

  FIG. 28 is a flowchart illustrating an example of an operation procedure extraction process according to the third embodiment. Of the processes shown in FIG. 28, the processes of steps S202 to S205 are the same as the steps S112 to S115 of the operation procedure extraction process of the second embodiment shown in FIG.

  In step S <b> 201, the operation extraction unit 122 selects one procedure manual ID of a newly created procedure manual or a high-specificity procedure manual from the procedure manual DB 110. For example, the operation extraction unit 122 acquires the procedure manual ID of the procedure manual for which the concreteness has been calculated included in the concreteness higher procedure manual information 121f, and has a procedure manual ID that is not included in the acquired procedure manual ID. The procedure manual is determined as a newly created procedure manual. Further, the operation extraction unit 122 determines that the procedure manual in the procedure manual DB 110 to which the procedure manual ID of the procedure manual with higher specificity included in the concrete procedure higher procedure manual information 121f is assigned is the procedure manual with the higher specificity. .

  In this way, the operation procedure extraction process is performed based on the high-level procedure manual and the new procedure manual. In other words, among the procedure manuals stored in the procedure manual DB 110, the procedure manuals that are determined to be low in the concreteness evaluation in the past are excluded from the input targets in the concreteness evaluation after the next time.

Next, the procedure manual selection process will be described in detail.
FIG. 29 is a flowchart illustrating an example of the procedure of the procedure manual selection process. In the following, the process illustrated in FIG. 29 will be described in order of step number.

  [Step S211] The procedure manual selection unit 128 reads the procedure manual specificity information 131 for all the procedure manuals indicated in the procedure manual specificity information 131. At this time, the procedure manual selection unit 128 sets the procedure manual ID indicated in the read procedure manual concreteness information 131 in the concreteness higher procedure manual information 121f as information on the concreteness calculated procedure manual.

  [Step S212] The procedure manual selection unit 128 outputs the procedure manual ID of the procedure manual with the higher degree of concreteness to the higher concrete procedure manual information 121f. For example, the procedure manual selection unit 128 sorts the read procedure manual IDs in descending order according to the procedure manual specificities. The procedure manual selection unit 128 sets a predetermined number of procedure manual IDs from the upper level in the concreteness higher procedure manual information 121f. Then, the procedure manual selection unit 128 stores the concreteness higher procedure manual information 121 f in the storage unit 121.

  As described above, in the third embodiment, when the concrete evaluation of the procedure manual is repeatedly performed, the procedure manual determined to be low in the previous concrete concrete evaluation is excluded from the evaluation target. . Thereby, the concreteness of the whole procedure manual used as the object of concreteness evaluation can be raised. As a result, it is possible to prevent erroneous evaluation of concreteness for a procedure document with low concreteness.

  In the second and third embodiments, the concreteness of the description of the operation procedure of the procedure manual is evaluated based on the procedure manual concreteness. For example, the operation procedure of the procedure manual is evaluated based on the procedure manual operation weight amount. You may evaluate the concreteness of the description. In this case, the procedure manual with a larger procedure manual operation weight amount is evaluated higher.

  As mentioned above, although embodiment was illustrated, the structure of each part shown by embodiment can be substituted by the other thing which has the same function. Moreover, other arbitrary structures and processes may be added. Further, any two or more configurations (features) of the above-described embodiments may be combined.

DESCRIPTION OF SYMBOLS 10 Evaluation apparatus 11 Memory | storage part 11a, 11b, ... Procedure manual 12 Calculation part

Claims (7)

On the computer,
A plurality of procedure manuals relating to work to be performed on the management target system, and a plurality of procedures expressing the operation from the plurality of procedure manuals describing the work name indicating the name of the work and the operation procedure for the management target system Extract words from
For each of the plurality of words, count the number of occurrences of words in the work names of the plurality of procedure manuals and the number of occurrences of words in the operation procedures of the plurality of procedure books,
For each of the plurality of phrases, a value according to the number of occurrences of the phrase in the work name of the plurality of procedure manuals is compared with a value according to the number of occurrences of the phrase in the operation procedure of the plurality of procedure manuals, Determine a weight value indicating the degree of concreteness of the operation expressed by the phrase;
For each of the plurality of procedure manuals, based on the word weight value included in the operation procedure of the procedure manual, the concreteness of the description of the operation procedure is evaluated.
An evaluation program that executes processing. In the determination of the weight value, the word value having a smaller number of appearances in the work names of the plurality of procedure manuals has a higher weight value, and the word / phrase having a larger number of appearances in the operation procedure of the plurality of procedure manuals has a higher weight value.
The evaluation program according to claim 1. In determining the weight value,
Each of the plurality of words is a word to be determined,
A first appearance frequency indicating a ratio of the number of appearances of the words to be determined in the work names of the plurality of procedure manuals to the total number of appearances of all the words in the work names of the plurality of procedure manuals; Calculating a second appearance frequency indicating a ratio of the number of appearances of the words to be determined in the operation procedures of the plurality of procedure manuals to a total number of appearances of all the words in the operation procedures of the procedure manuals;
A value obtained by dividing the second appearance frequency by the first appearance frequency is calculated as a weight value of the word to be determined.
The evaluation program according to claim 2. In the evaluation of the concreteness,
Each of the plurality of phrases is a phrase for which a standard operation weight is to be calculated,
A procedure manual in which the calculation target word / phrase appears in the operation procedure is extracted, and an average of the weight values of all the words / phrases included in the operation procedure of the extracted extraction procedure document is calculated between the extraction procedure manuals. Calculate as the standard operation weight for the target word,
For each of the plurality of procedure manuals, the sum of the weight values of all the words included in the operation procedure in the procedure manual is divided by the maximum value among the standard operation weight amounts of the respective words appearing in the operation procedure of the procedure manual. The calculated value is calculated as a degree of concreteness indicating the degree of concreteness of the description of the operation procedure in the procedure manual.
The evaluation program according to claim 1. In extracting words from the plurality of procedures,
Extract phrases from a predetermined number of procedure manuals that have already been evaluated for concreteness and those that have not been evaluated yet.
The evaluation program according to any one of claims 1 to 4. Computer
A plurality of procedure manuals relating to work to be performed on the management target system, and a plurality of procedures expressing the operation from the plurality of procedure manuals describing the work name indicating the name of the work and the operation procedure for the management target system Extract words from
For each of the plurality of words, count the number of occurrences of words in the work names of the plurality of procedure manuals and the number of occurrences of words in the operation procedures of the plurality of procedure books,
For each of the plurality of phrases, a value according to the number of occurrences of the phrase in the work name of the plurality of procedure manuals is compared with a value according to the number of occurrences of the phrase in the operation procedure of the plurality of procedure manuals, Determine a weight value indicating the degree of concreteness of the operation expressed by the phrase;
For each of the plurality of procedure manuals, based on the word weight value included in the operation procedure of the procedure manual, the concreteness of the description of the operation procedure is evaluated.
Procedure manual evaluation method. A plurality of procedure manuals related to work to be performed on the management target system, a storage unit for storing the plurality of procedure manuals in which a work name indicating the name of the work and an operation procedure for the management target system are described;
Extracting a plurality of phrases expressing an operation from the plurality of procedure manuals, and for each of the plurality of phrases, the number of occurrences of the phrase in the work name of the plurality of procedure manuals and the phrase in the operation procedure of the plurality of procedure manuals The number of occurrences is counted, and for each of the plurality of words, the value according to the number of appearances of the words in the work names of the plurality of procedure manuals and the number of occurrences of the words in the operation procedures of the plurality of procedure books And a weight value indicating the degree of concreteness of the operation expressed by the phrase is determined, and for each of the plurality of procedure manuals, the weight value of the phrase included in the operation procedure of the procedure manual is determined. An operation unit for evaluating the concreteness of the description of the operation procedure;
An evaluation apparatus.

Images