JPH07129384A - Conversion system of operation procedure into natural language format file - Google Patents

Abstract

PURPOSE:To attain a conversion system of an operation procedure into a natural language format file by converting plural operation procedures for an application program into one natural language format expression, writing the expression in a procedure file and automatically executing the same procedure. CONSTITUTION:This conversion system is provided with a monitoring condition file 11 describing identification conditions for command input and output based upon a prescribed operation procedure, an input/output monitoring part 12 for extracting the operation procedure and a secular change, a conversion reference file 21 for converting plural operation procedures described by program language into one operation procedure expressed by a natural language format expression, a procedure conversion part 22 for converting plural operation procedures into one natural language format operation procedure, and a procedure file 30 for storing the operation procedure converted into the natural language operation procedure.

Description

Detailed Description of the Invention

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention monitors an input of an operating procedure performed on an application program and a change over time, converts a plurality of operating procedures into natural language operating procedures, and stores them in a procedure file. The present invention relates to a system for converting an operation procedure from a procedure file into a natural language format file that automatically executes the same operation.

The functions controlled by application programs of various electronic devices and communication devices have become more sophisticated and complicated, and along with that, the operating procedures for operating the application programs have also become hierarchical, becoming more complicated and diversified. There is.

When a similar or similar operation is repeatedly executed for such an application program, it is necessary to input a command or the like from a keyboard or the like each time and perform a similar operation, which causes a mistake. become. In addition, in order to prevent such mistakes, it is possible to prevent the occurrence of simple mistakes to some extent by operating according to the procedure manual described in detail.
Such an operation also causes a decrease in efficiency.

Therefore, in the case of routine work in which the same operation is repeated using an input device such as a keyboard, there is a demand for a system capable of automatically executing an operation of an application program without human intervention.

[0005]

2. Description of the Related Art FIG. 8 is a block diagram for explaining a conventional example. In the figure, 200 is an application program, 30a is a procedure file, 40a is a procedure execution unit, 50
Is an input / output control unit.

In the conventional example shown in the figure, the history of the operating procedure performed by the user is stored in the procedure file 30a in the programming language as it is.
If the same operation is required, the operation procedure written in the procedure file 30a by the procedure execution unit 40a is read to perform the operation.

[0007]

In the above-mentioned conventional example, it is possible to read out the operation procedure written in the procedure file 30a and repeat the same operation procedure.
It cannot be used if the operation method or input contents are partially different. Further, since the contents of the procedure file 30a are described in the programming language, it is difficult to understand the flow of operations and it is difficult to reuse them by partially modifying the operation procedures.

Further, since the operation timing cannot be saved in the history of the operation procedure in the conventional example, the timing is separately added later. Therefore, it is difficult to use the previous operating procedure even when performing a procedure similar to the operating procedure that has been performed before, which is a cause of hindering automation of various operations.

According to the present invention, inputs to an application program and changes over time are monitored, a plurality of operating procedures are converted into one natural language expression, and then written into a procedure file, and the same procedure file is used according to the contents of the procedure file. A system for converting operating procedures into a natural language format file that facilitates the understanding of the procedures by automatically executing the procedures and expressing them in a natural language format, making it easy to correct the procedures when performing similar operations. Try to realize.

[0010]

FIG. 1 is a block diagram for explaining the first principle of the present invention. Reference numeral 200 in the figure denotes an application program to be operated, and 210
Is an input / output unit, and 220 is a processing unit.

Reference numeral 100 is a system for converting an operation procedure into a natural language format file, and reference numeral 11 is a monitor in which conditions for identifying whether a command is input and a response is output based on a predetermined operation procedure are described. A condition file 12 is an input / output monitoring unit that extracts the command inputs and responses to the application program 200 and their timing relationships by referring to the monitoring condition file 11.

Reference numeral 21 is a conversion reference file for converting a plurality of operating procedures described in a programming language into operating procedures expressed in one natural language format,
Reference numeral 22 denotes a plurality of operation procedures extracted by the input / output monitoring unit 12,
Reference numeral 21 denotes a conversion reference file, which is a procedure conversion unit for converting into one natural language operation procedure, and 30 is a procedure for accumulating the operation procedure converted into one natural language operation procedure by the procedure conversion unit 22. It is a file.

FIG. 2 is a block diagram for explaining the second principle of the present invention. The conversion reference file 21 and the procedure file 30 are the same components as described in the principle diagram of FIG. Reference numeral 40 is a procedure execution unit that restores the operation procedure in the natural language format written in the procedure file 30 into the operation procedure in the programming language by referring to the conversion reference file 21, and executes the operation procedure.
It is an input / output control unit that controls the input / output of the operating procedure at the time of automatic execution of 0, and solves the problem by such means.

[0014]

In the first principle diagram of FIG. 1, the input / output unit 210 and the processing unit 220 of the application program 200.
The command executed during the period, the response to the command, the change over time, and the like are monitored, and the operation procedure that matches the conditions described in the monitoring condition file 11 is extracted. Then, the extracted operation procedure is converted into a program in a natural language format by referring to the conversion reference file 21, and a plurality of operation procedures are collectively expressed as one operation procedure and written in the procedure file 30.

In the second principle diagram of FIG. 2, the operation procedure in the natural language format written in the procedure file 30 is returned to the operation procedure in the programming language by referring to the conversion reference file 21, and the application is restored. Program 20
Perform operation 0.

Since a plurality of operation procedures are written in the procedure file 30 as one natural language operation procedure in this way, when executing similar operation procedures, the operation procedure of the procedure file 30 is performed from an editor (not shown) or the like. By modifying, it is possible to easily create and use a new operation procedure. Also, a new operation procedure can be automatically executed as it is by creating a file in the natural language format in the procedure file 30 from the editor.

[0017]

FIG. 3 is a block diagram for explaining an embodiment of the present invention. The figure shows an embodiment in which the first principle diagram of FIG. 1 and the second principle diagram of FIG. 2 of the present invention are combined to form one system. The figure shows an operation procedure conversion for saving the operation procedure on UNIX in a file in a natural language format and a system for automatically executing the operation procedure from the procedure file.

Reference numeral 200 in the figure denotes an input / output unit 210 and a processing unit 2.
20A is an application program to be operated including 20 and connected to the input / output unit 210 is an operation button,
210B is for receiving a signal, and 210C is for recognizing a character input and operating the application program 200.

Further, the input / output monitoring unit 1 described in principle with reference to FIG.
2 is composed of an input monitoring unit 12A, an output monitoring unit 12B, and a time monitoring unit 12C, a conversion reference file 21 is composed of a natural language dictionary file 21A, a structural analysis correspondence file 21B, and a procedure conversion unit 22 is a natural language conversion unit. 22A and the structure analysis unit 22B, and the procedure file 30 is composed of a generation procedure file 30A, a modification procedure file 30B, and a new procedure file 30C.

An editor 60 creates and modifies the procedure file 30. Application program 200
Operation button 210A of the upper input / output unit 210, signal reception 210
B, the character input 210C is monitored by the input monitoring unit 12A, the output monitoring unit 12B, and the time monitoring unit 12C of the input / output monitoring unit 12 before the processing unit 220 executes the processing.
The conditions are classified with reference to the operation and the contents of the monitoring condition file 11.

By such processing, the conditions specified in the monitoring condition file 11 are extracted, and the natural language conversion section 22A is extracted.
Refers to the natural language dictionary file 21A and converts the operating procedure described in UNIX into a natural language format. Further, the structure analysis unit 22B refers to the structure analysis correspondence file 21B, collects a plurality of typical operations (here, operations of about 2 to 3) as one operation procedure, and generates the generation procedure file 30A. .

When the operation procedure in the natural language format generated in the generation procedure file 30A is modified, the modification procedure file 3 is modified by modifying it from the editor 60.
0B is generated, and a new operation procedure is similarly created using the editor 60, and becomes a new procedure file 30C. In the case of such procedure correction and new creation, since the procedure is described in the natural language format, the work can be easily performed.

Further, when the operation is executed based on the contents of the generation procedure file 30A, the correction procedure file 30B, and the new procedure file 30C, the natural language dictionary file 21A used for converting the operation procedure in the procedure execution unit 40, the structure By referring to the analysis correspondence file 21B, the UN
It is converted into an IX operation procedure, and automatic execution control is performed via the input / output control unit 50.

FIG. 4 shows an embodiment of the monitoring condition file of the present invention. For example, as an example of the monitoring condition, the input command is the "set cursor" command. As a response to a command, it is necessary to "see END of command response". Further, as the timing, a specified condition for monitoring such as "a command interval is A seconds or more" is written.

FIG. 5 shows an embodiment of the natural language dictionary file of the present invention. For example, the operation on UNIX is "jump
When "<byte>" is specified, this is expressed as "<byte number>jump" in the natural language format. Also,
"Exchange <data><type>" is "<
Data> is converted to <conversion type> ”.

Here, the format that can be changed by the user is fixed only in parentheses. FIG. 6 shows an embodiment of the structural analysis correspondence file of the present invention. For example, referring to the natural language dictionary file 21A, the operation procedure expressed in the natural language format is “set the mouse cursor to <x, y>”, “<
It is assumed that the two operation procedures are “press button>”. By referring to the structural analysis correspondence file 21B, "setting the mouse cursor" and "pressing the button" are continuous operations. Therefore, this is one operation procedure, "mouse cursor <x, y> Set to <button>
Press "to convert.

FIG. 7 shows an embodiment of the generation procedure file of the present invention. For example, the operation procedure of the application program when testing the electronic exchange is described in a natural language format, and the generation procedure file 30A generated by referring to the various files shown in FIGS.
Is an example of. In this way, by expressing the procedure on UNIX in a natural language format and expressing a plurality of operations as one operation procedure, even a person other than the creator of such a procedure can easily understand. It becomes easy to modify the operation procedure and create a new one.

[0028]

According to the present invention, since the history of input, changes over time, etc. is created as a procedure file from the contents of actual operation, there is no error in the description of the procedure file when the application program is automatically executed. In addition, since the operating procedure is converted into the natural language format, the automatically created file can be easily understood as a procedure manual, the operating procedure can be modified on the file, and a new operating procedure can be created directly on the procedure file. It is also possible to do. Further, since the history of the operation timing can be described, it is possible to execute the procedure described in the procedure file as it is.

Therefore, it is possible to contribute to the efficiency of the work of repeating the operation such as the test operation of the application program.

[Brief description of drawings]

FIG. 1 is a block diagram illustrating a first principle of the present invention.

FIG. 2 is a block diagram illustrating a second principle of the present invention.

FIG. 3 is a block diagram illustrating an embodiment of the present invention.

FIG. 4 Example of monitoring condition file of the present invention

FIG. 5: Example of natural language dictionary file of the present invention

FIG. 6 is an example of a structural analysis compatible file of the present invention.

FIG. 7: Example of generation procedure file of the present invention

FIG. 8 is a block diagram illustrating a conventional example.

[Explanation of symbols]

100 System for converting operation procedure into natural language format file 11 Monitoring condition file 12 Input / output monitoring unit 12A Input monitoring unit 12B Output monitoring unit 12C Time monitoring unit 21 Reference file for conversion 21A Natural language dictionary file 21B Structural analysis compatible file 22 Procedure Conversion unit 22A Natural language conversion unit 22B Structural analysis unit 30, 30a Procedure file 30A Generation procedure file 30B Correction procedure file 30C New procedure file 40, 40a Procedure execution unit 50 Input / output control unit 60 Editor 200 Application program 210 Input / output unit 210A Operation Button 210B Signal reception 210C Character input 220 Processing unit

 ─────────────────────────────────────────────────── ─── Continued Front Page (72) Inventor Hiroaki Ishiguri 1015 Kamiodanaka, Nakahara-ku, Kawasaki City, Kanagawa Prefecture, Fujitsu Limited (72) Inventor, Ikuko Kubota 1015, Kamedotachu, Nakahara-ku, Kawasaki City, Kanagawa Prefecture, Fujitsu Limited

Claims (2)

[Claims] 1. An application program (200)
A system (100) for converting an operation procedure into a natural language format file when executing, and a condition for identifying that a command is input and a response is output based on a predetermined operation procedure. And a monitoring condition file (11) that describes the input and response of commands made to the application program (200) and their timing relationship with reference to the monitoring condition file (11). A section (12), a conversion reference file (21) for converting a plurality of operation procedures described in a programming language into an operation procedure expressed in one natural language format, and the input / output monitoring section (12) ), A procedure conversion unit for converting the plurality of operation procedures extracted in step 1) into one natural language format operation procedure by referring to the conversion reference file (21). (22)
And a procedure file (30) for accumulating the operation procedure converted into one natural language operation procedure by the procedure conversion unit (22), the conversion system of the operation procedure into a natural language format file. . 2. The conversion reference file (21) according to the preceding paragraph.
And the procedure file (30) described in the preceding paragraph, and the operation procedure of the natural language format written in the procedure file (30) is returned to the operation procedure of the programming language by referring to the conversion reference file (21) and operated. A procedure execution unit (40) for executing a procedure, and an input / output control unit (5) for controlling input / output of an operation procedure when the application program (200) is automatically executed.
0) A system for converting an operating procedure into a natural language format file.