JP6845439B2 - Information processing device, display control method and program - Google Patents

Description

The present invention relates to an information processing device, a display control method, and a program that execute so-called RPA (Robotic Process Automation).

Software called RPA software that causes an information processing device to execute commands that can be executed by an information processing device such as a computer in a defined execution order is known (see, for example, Non-Patent Document 1).

"RPA Solution Windows Operation Robot" WinActor "| NTT DATA", [online], [Search on October 10, 2018], Internet <URL: http://www.nttdata.com/jp/ja/lineup/winactor /index.html ＞

Conventional RPA software has a function of displaying an operation screen in which commands are arranged in the order of execution on a display device connected to an information processing device. However, in the execution of a command, there is no one that displays the execution procedure in a hierarchical manner or visually displays whether or not a condition has been set.

Therefore, an object of the present invention is to provide an information processing device, a display control method, and a program capable of easily displaying a hierarchical display of commands and / or a display of condition settings on an operation screen.

In order to achieve the above object, the information processing apparatus of the present invention receives a robot operation indicating the type of command executed by the information processing apparatus and a command input which is a specific execution content of the robot operation. A first area of the device, a scenario creation unit that creates scenario data in which a unit, a robot operation and a command set whose input is accepted by the command input unit are arranged in the execution order of the information processing device, and a list of robot operations are displayed. It also has a display control unit that displays the robot movements and command sets whose inputs have been accepted by the command input unit in the second area of the display device in the order of execution of the information processing device. , The display control unit receives input of the hierarchy designation and / or condition designation of the robot operation and command set displayed in the second area via the input device, and the robot displayed in the second area. It is characterized in that the display mode of an operation and a set of commands is changed.

In the information processing apparatus of the present invention configured in this way, the display control unit can input the hierarchy designation and / or condition designation of the robot operation and command set displayed in the second area via the input device. If there is, the display mode of the robot operation and the set of commands displayed in the second area is changed.

By doing so, it is possible to easily display the hierarchical display of commands and / or the display of condition settings on the operation screen.

It is a functional block diagram which shows the schematic structure of the information processing apparatus which is an embodiment of this invention. It is a figure which shows the content of the scenario data of the information processing apparatus which is an embodiment. It is a figure which shows the content of the robot operation list data of the information processing apparatus which is an embodiment. It is a flowchart for demonstrating an example of the operation of the information processing apparatus which is an embodiment. It is a figure which shows an example of the operation screen displayed by the information processing apparatus which is an embodiment. It is a figure which shows another example of the operation screen displayed by the information processing apparatus which is an embodiment. It is a figure which shows another example of the operation screen displayed by the information processing apparatus which is an embodiment. It is a figure which shows another example of the operation screen displayed by the information processing apparatus which is an embodiment. It is a figure which shows another example of the operation screen displayed by the information processing apparatus which is an embodiment. It is a figure which shows another example of the operation screen displayed by the information processing apparatus which is an embodiment.

Hereinafter, embodiments of the present invention will be described with reference to the drawings. FIG. 1 is a functional block diagram showing a schematic configuration of an information processing apparatus according to an embodiment of the present invention.

The information processing device 1 according to the present embodiment is a device capable of processing information such as a personal computer, a server, a smartphone, and a tablet terminal. The information processing device 1 has a control unit 100, a storage unit 110, a communication unit 120, an input I / F (interface) 130, and an output I / F 140.

The control unit 100 controls the entire information processing device 1. The control unit 100 includes a CPU, a programmable logic device such as an FPGA, and an arithmetic element represented by an integrated circuit such as an ASIC.

The storage unit 110 of the information processing device 1 stores the operating system 111 and the scenario software 113, and the operating system 111 is executed by the control unit 100 when the information processing device 1 is started, and the operating system 111 is executed. Then, when the scenario software 113 is executed by the operator of the information processing device 1 instructing the execution of the scenario software 113, the information processing device 1 has the functional configuration as shown in FIG. .. Of course, the scenario software 113 may be set to run automatically after booting the operating system 111.

The control unit 100 includes a command input unit 101, a scenario creation unit 102, a scenario execution unit 103, and a display control unit 104.

The command input unit 101 receives a robot operation indicating the type of command executed by the operating system 111 of the information processing device 1 and the application software 112, and input of a command which is a specific execution content of the robot operation. More specifically, the command input unit 101 receives the robot operation and the command input input by the operator of the information processing device 1 via the input device 2 via the input I / F 130.

The scenario creation unit 102 creates scenario data 114 in which the robot operation and command sets whose inputs are accepted by the command input unit 101 are arranged in the execution order of the information processing device 1. The scenario data 114 created by the scenario creation unit 102 is stored in the storage unit 110. The details of the scenario data 114 will be described later.

The scenario execution unit 103 causes the information processing device 1 to execute commands arranged in the order of execution based on the scenario data 114 created by the scenario creation unit 102. Here, if the command is a command that can be executed by the operating system 111, the scenario execution unit 103 executes this command in the operating system 111, and if the command is a command that can be executed by the application software 112, the scenario execution unit 103 executes the scenario. Part 103 executes this command in the application software 112.

The display control unit 104 sends a display control signal for displaying a predetermined display screen on the display device 3. Specifically, the display control unit 104 displays a list of robot operations in the first area of the display device 3 connected to the information processing device 1 via the output I / F 140, and the command input unit 101 displays the list. The robot operation and command set for which the input is accepted are arranged and displayed in the second area of the display device 3 in the execution order of the information processing device 1.

Further, the display control unit 104 is displayed in the second area when there is an input of the hierarchical designation and / or the condition designation of the robot operation and command set displayed in the second area via the input device 2. The display mode of the robot movement and the set of commands is changed.

Preferably, the display control unit 104 receives the input of the hierarchical designation of the robot operation and the command set displayed in the second area via the input device 2, and the robot operation displayed in the second area. And change the hierarchical display of the command set.

Alternatively, when the display control unit 104 receives the input of the condition specification of the robot operation and the command set displayed in the second area via the input device 2, the robot operation and the robot operation displayed in the second area The condition display of the set of commands is changed.

The storage unit 110 includes a large-capacity storage medium such as a hard disk drive and a storage medium such as a semiconductor storage medium such as ROM and RAM. The storage unit 110 temporarily or non-temporarily stores various data used in various operations of the control unit 100.

Further, the storage unit 110 stores the operating system 111, the application software 112, the scenario software 113, the scenario data 114, and the robot operation list data 115.

The operating system 111 is software that controls the operation of the entire information processing device 1 and also controls the input / output of the information processing device 1. Further, the application software 112 is software that gives the information processing device 1 a specific function and causes a specific operation. Examples of the application software 112 include word processing software, spreadsheet software, and the like.

The operating system 111 and the application software 112 operate based on the operation input by the operator of the information processing device 1 via the input device 2. However, in the information processing device 1 of the present embodiment, the operating system 111 and the application software 112 are operated. Each of 112 also operates based on a command input by the operator of the information processing device 1 via the input device 2 and a command instructed to be executed by the scenario execution unit 103.

As described above, the scenario software 113 is software that is executed by the information processing device 1 to cause the information processing device 1 to have a functional configuration as shown in FIG. Further, the scenario data 114 is a set of robot actions and commands arranged in the execution order of the information processing device 1, and is created by the scenario creation unit 102. The robot operation list data 115 is data in which robot operations indicating the types of commands executed by the operating system 111 of the information processing device 1 and the application software 112 are stored as a list (for example, in a table format). The details of the robot operation list data 115 will also be described later.

The communication unit 120 includes a communication control function of a CPU and a chipset, a LAN chip, and the like, and communicates with the LAN 4 and other devices on the WAN (not shown) such as the Internet connected to the LAN 4. To control.

The input device 2 is, for example, a keyboard, a mouse, or the like, and sends an operation input signal to the information processing device 1 based on the operation input from the operator of the information processing device 1. The input I / F 130 includes an interface function of a CPU and a chipset, an interface chip, and the like, and sends an operation input signal from the input device 2 to the control unit 100.

The display device 3 is, for example, a liquid crystal display or the like, and displays a predetermined display screen based on a display control signal from the display control unit 104. The output I / F 140 includes an interface function of the CPU and the chipset, an interface chip, and the like, and outputs a display control signal from the display control unit 104 to the display device.

The specific operation of each part constituting the information processing apparatus 1 shown in FIG. 1 will be described in detail later.

Next, the contents of the scenario data 114 stored in the storage unit 110 will be described with reference to FIG.

As shown in FIG. 2, the scenario data 114 has a plurality of scenario data # 1 to # n 114a (n (n: natural number) in the illustrated example). The scenario data # 1 to # n 114a are a plurality of scenario name data 114b for identifying each scenario data # 1 to # n 114a and a plurality of commands included in the scenario data # 1 to # n 114a (illustration example). Then, it has n (n: natural number)) command data # 1 to # n 114c. In the illustrated example, each scenario data # 1 to # n 114a has n command data # 1 to # n 114c for simplification, but each scenario data # 1 to # n 114a has n command data # 1 to # n 114a. It may have different numbers of command data 114c.

The command data # 1 to # n 114c are command name data 114d indicating which robot operation each command data 114c corresponds to, and command memo data capable of describing an outline of the command executed by the command execution data 114f described later. It has 114e and command execution data 114f in which a command that is a specific execution content of the robot operation specified by the command name data 114d is described. The command described in the command execution data 114f is a command that can be interpreted and executed by the operating system 111 and / or the application software 112.

In each of the scenario data # 1 to # n 114a, the command data # 1 to # n 114c are arranged in the execution order of the information processing device 1. Therefore, when the scenario execution unit 103 selects and executes specific scenario data # 1 to # n 114a, the command data # 1 to # n 114c in the selected scenario data # 1 to # n 114a are arranged in the order in which they are arranged. Execute (that is, in ascending order from # 1).

Next, the contents of the robot operation list data 115 stored in the storage unit 110 will be described with reference to FIG.

The robot operation list data 115 includes a robot operation column 115a indicating the content of the robot operation, a branch column 115b indicating whether or not a branch can be specified for this robot operation, and a layer column 115c indicating whether or not the hierarchy can be specified for this robot operation. Has.

As an example, the robot operation that starts the application cannot specify the branch or the hierarchy, but the robot operation that confirms the continuation of the scenario can only specify the branch, the robot operation that receives the mail can only specify the hierarchy, and The robot operation that confirms the existence of a file in a specific directory (file path) can be specified as a branch or as a hierarchy.

The control unit 100 of the information processing device 1 according to the present embodiment has a mail client function, and can receive a mail arriving at the mail address described by the scenario data 114 (command data 114c).

Further, the robot operation list data 115 shown in FIG. 3 is merely an example, and the number and contents of the data are not limited to those shown in the figure.

Next, an example of the operation of the information processing apparatus 1 according to the present embodiment will be described with reference to the flowchart of FIG. 4 and FIGS. 5 to 10.

FIG. 4 is a flowchart for explaining the operation of the information processing device 1. The operation shown in the flowchart of FIG. 4 is started when the operator of the information processing apparatus 1 instructs the start of the scenario software 113 and the scenario software 113 is started.

FIG. 5 shows a screen displayed on the display screen of the display device 3 when the scenario software 113 is started. Such a screen is generated by the display control unit 104 of the control unit 100 of the information processing device 1 and sent to the display device 3.

On the screen shown in FIG. 5, the area 200 in which the scenario name data 114b of the scenario data # 1 to # n 114a of the scenario data 114 stored in the storage unit 110 is displayed, and a new area 200 for instructing the creation of a new scenario. The scenario creation button 201 is displayed. In the flowchart of FIG. 4, the procedure for creating the new scenario creation button 201, that is, the new scenario data # 1 to # n 114a, will be described.

In step S1, an operation input from the operator for the new scenario creation button 201 displayed on the display device 3 via the input device 2 is awaited. Then, if there is an operation input of the new scenario creation button 201 (YES in step S1), the program proceeds to step S2, and the display control unit 104 causes the display device 3 to display the scenario name input screen (not shown). If there is an operation input of the scenario name via the input device 2, the command input unit 101 of the control unit 100 accepts this operation input. The accepted scenario name is stored in the storage unit 110 as the scenario name data 114b by the scenario creation unit 102 as a part of the scenario data 114.

FIG. 6 is a diagram showing an example of a scenario edit mode screen displayed on the display screen of the display device 3 after the scenario name input operation in step S2. The screen shown in FIG. 6 is generated by the display control unit 104 and sent to the display device 3.

In the screen shown in FIG. 6, the first area 210 in which the list of robot operations is displayed, and the robot operation and the command set input by the command input unit 101 described later are arranged from top to bottom in the execution order of the information processing device 1. It has a second region 211 arranged in. The display of the robot operation list displayed in the first area 210 is generated by the display control unit 104 with reference to the robot operation list data 115. Further, the display control unit 104 also generates the display of the set of the robot operation and the command displayed in the second area 211.

The screen shown in FIG. 6 shows a state in which a plurality of robot operation and command sets have already been input by the command input unit 101. Therefore, in the state where step S2 is completed and step S3 is executed, nothing is displayed in the second area 211.

In step S3, the operator of the information processing device 1 waits for the selection input of any robot action from the list of robot actions displayed in the first area 210 to be input via the input device 2. Then, when the selection input is made (YES in step S3), the program proceeds to step S4, and the display control unit 104 causes the display device 3 to display the command detailed setting screen.

7 to 10 show an example of the detailed command setting screen displayed on the display device 3.

The detailed command setting screen 220 shown in FIG. 7 is a screen for inputting the details of the command corresponding to the robot operation “application> start”. The detailed command setting screen 220 shown in FIG. 7 provides an application software specification screen 221 for designating the application software 112 to be started, and a memo input screen 222 for inputting command memo data 114e indicating the specific execution content of this command. Have.

The operator of the information processing device 1 inputs a character string or the like on the command detailed setting screen 220 via the input device 2. In the example shown in FIG. 7, the operator inputs "excel (registered trademark)" on the application software designation screen 221 and "starts Excel" on the memo input screen 222.

Next, the command detailed setting screen 230 shown in FIG. 8 is a screen for inputting the details of the command corresponding to the robot operation “File> Open> Fixed file name”. The detailed command setting screen 230 shown in FIG. 8 is a file location specification screen 231 that specifies the location of the file to be opened (by the application software 112 associated with the file), in other words, a directory (file path), and a specific command of this command. It has a memo input screen 232 for inputting command memo data 114e indicating an execution content.

Next, the command detailed setting screen 240 shown in FIG. 9 is a screen for inputting the details of the command corresponding to the robot operation “flow> branch (numerical value)”. The detailed command setting screen 240 shown in FIG. 9 includes a data ID setting screen 241 for setting an ID for specifying data as a branch condition, a size setting screen 242 for setting a magnitude relationship with a numerical value as a branch condition, and the like. It has a numerical value input screen 243 for inputting a numerical value to be compared, and a memo input screen 244 for inputting command memo data 114e indicating a specific execution content of this command.

The detailed command setting screen 250 shown in FIG. 10 is a screen for inputting the details of the command corresponding to the robot operation “window> front window storage”. The detailed command setting screen 250 shown in FIG. 10 is a window reference ID setting screen 251 for setting an ID for storing the screen displayed in the foreground on the display screen of the display device 3, and a command indicating a specific execution content of this command. It has a memo input screen 252 for inputting memo data 114e.

In step S5, the command and the like are input using the detailed command setting screen displayed in step S4. Then, when a command or the like is input (YES in step S5), the program proceeds to step S6, and the command input unit 101 is the specific execution content of the robot operation and the robot operation input in steps S4 and S5. It accepts command input and command memo data 114e, respectively. Next, the scenario creation unit 102 updates the scenario data 114 using the robot operation and command set received by the command input unit 101, as well as the command memo data 114e.

Further, the display control unit 104 has a second area 211 of the display screen of the display device 3 based on the robot operation received by the command input unit 101, the command input which is the specific execution content of the robot operation, and the command memo data 114e. The display contents of are updated (see FIG. 6).

At this time, the display control unit 104 refers to the robot operation list data 115 for the robot operation accepted by the command input unit 101, and determines whether or not branch designation is possible for the accepted robot operation. Then, when it is determined that the branch designation is possible, the condition display is added to the display content of the second area 211.

As an example, in FIG. 6, the robot operation R1 in which the command memo data 114e is “when the number of orders is 10 or more” is designated as a branch. Therefore, the display control unit 104 does not satisfy the conditions of the robot operation R2 and the robot operation R1 that branch when the condition of the robot operation R1 is satisfied (displayed as "True" in the figure) ("False" in the figure). Is displayed), the robot operation R3 that branches in the case is separated and displayed in a visible state.

Next, in step S7, the operator of the information processing device 1 waits for an operation input to the second area 211 of the display screen of the display device 3 via the input device 2. An example of the operation input referred to here is an operation input for instructing a change in the hierarchy for the robot operation displayed in the second area 211, and more specifically, the robot operation is shown in the left-right direction in FIG. This is an operation input that gives an instruction to change the hierarchy by dragging to.

In step S8, the display control unit 104 refers to the robot operation list data 115 for the robot operation for which the operation input has been input, and determines whether or not the accepted robot operation can be hierarchically specified. Then, when it is determined that the hierarchy can be specified, the display content of the second area 211 is updated and the hierarchy is displayed (or changed).

As an example, in FIG. 6, the robot operation R4 in which the command memo data 114e is “moving” is shifted to the right in the figure from the robot operation R5 in which the command memo data 114e is “repeated for each order”. It is displayed. Hierarchical display is performed by shifting the display of robot operation to the left and right by a predetermined distance.

After that, the program returns to step S3 and repeats the operations of steps S3 to S8.

In the information processing device 1 of the present embodiment configured as described above, the display control unit 104 specifies the hierarchy of the robot operation and command set displayed in the second area 211 via the input device 2. And / or when there is an input of the condition designation, the display mode of the robot operation and the command set displayed in the second area 211 is changed.

By doing so, it is possible to easily display the hierarchical display of commands and / or the display of condition settings on the operation screen.

Although the embodiments of the present invention have been described in detail with reference to the drawings, the specific configuration is not limited to the embodiments and examples, and design changes are made to the extent that the gist of the present invention is not deviated. Is included in the present invention.

As an example, the display mode of the display device 3 on the display screen by the display control unit 104 is not limited to the illustrated example, and various modifications can be made.

Then, in the above-described embodiment, the program for operating the information processing device 1 is stored and provided in the storage unit 110, but the program is stored by using an optical disk drive (not shown), a USB interface, or the like. An optical disk, a USB flash memory device, a memory card, or the like may be connected, and the program may be read into the information processing device 1 from the DVD or the like and operated. Further, the program may be stored in the external server on the WAN, and the program may be read into the information processing device 1 via the communication unit 120 and operated. Further, in each of the above-described embodiments, the information processing device 1 is composed of a plurality of hardware elements, but it is also possible for the CPU or the like to realize the operation of a part of these hardware elements by the operation of the program. ..

1 Information processing device 2 Input device 3 Display device 100 Control unit 101 Command input unit 102 Scenario creation unit 103 Scenario execution unit 104 Display control unit 110 Storage unit 114 Scenario data 115 Robot operation list data 210 First area 211 Second area

Claims (7)

An information processing device that executes RPA
A command input unit for receiving the robot operation indicating the type of command, and an input of said command said is a specific execution content of robot operation, respectively executed by the information processing apparatus,
A scenario creation unit that creates scenario data in which the robot operation and the set of commands whose inputs are accepted by the command input unit are arranged in the execution order of the information processing device.
It has robot operation information indicating the content of the robot operation, branch information indicating whether or not branching conditions can be specified for the robot operation, and hierarchical information indicating whether or not the hierarchy can be specified for the robot operation. A storage unit that stores the robot operation list data that defines the robot operation and the scenario data,
The first area in which the list of the robot movements based on the robot movement list data is displayed, and the robot movements and the set of the commands whose inputs are accepted by the command input unit are arranged in the execution order of the information processing apparatus. It has a display control unit for displaying a scenario edit mode screen having a second area to be displayed on the display device.
The display control unit
When there is a selection input of the robot operation accepted by the command input unit from the list of the robot operations displayed in the first area, the details of the command corresponding to the robot operation can be input. Display the command detailed setting screen on the display device, and display it.
When the command input unit receives the input of the details of the command on the command detailed setting screen, the display contents of the second area are updated.
When there is input of the hierarchy designation and / or condition designation of the robot operation and the set of commands displayed in the second area via the input device, the hierarchy designation and / or the hierarchy designation and / or based on the robot motion list data. It is characterized in that it is determined whether or not the condition can be specified, and when it is determined that it is possible, the display mode of the robot operation and the set of commands displayed in the second area is changed. Information processing device. When the display control unit receives the input of the hierarchical designation of the robot operation and the set of commands displayed in the second area via the input device, the display control unit is displayed in the second area. The information processing apparatus according to claim 1, wherein the robot operation and the hierarchical display of the set of commands are changed. When the display control unit receives an input of a condition designation of the robot operation and the set of commands displayed in the second area via the input device, the display control unit is displayed in the second area. The information processing apparatus according to claim 1, wherein the robot operation and the condition display of the set of commands are changed. The display control unit displays a scenario list screen on which the list of the scenario data and the instruction buttons for editing, executing, and newly creating the scenario data are displayed on the display device, and inputs the input on the scenario list screen. The information processing device according to any one of claims 1 to 3, wherein the scenario edit mode screen is displayed on the display device when an instruction input for editing or newly creating the scenario data is received via the device. .. The information processing apparatus according to any one of claims 1 to 4, wherein the information processing apparatus has a scenario execution unit that executes the commands arranged in the execution order in the information processing apparatus based on the scenario data. It is a display control method by an information processing device that executes RPA.
The robot operation indicating the type of the command executed by the information processing device and the input of the command which is the specific execution content of the robot operation are accepted and received.
A scenario data is created in which the robot operation and the command set for which the input is accepted are arranged in the execution order of the information processing device.
It has robot operation information indicating the content of the robot operation, branch information indicating whether or not branching conditions can be specified for the robot operation, and hierarchical information indicating whether or not the hierarchy can be specified for the robot operation. The robot operation list data that defines the robot operation and the scenario data are stored in the storage unit.
First a first region list of the robot operation based on the robot operation list data is displayed, the set of the robot operation and the command input is accepted is displayed by arranging the execution order of the information processing apparatus A scenario edit mode screen having two areas is displayed on the display device, and the display device is displayed.
When there is a selection input of the robot operation from the list of the robot operations displayed in the first area, the display device displays a command detail setting screen for inputting the details of the command corresponding to the robot operation. Display on
When the input of the details of the command is received on the command details setting screen, the display contents of the second area are updated.
Further, when there is input of the hierarchy designation and / or condition designation of the robot operation and the set of commands displayed in the second area via the input device, the hierarchy designation and the hierarchy designation and / or the condition designation are performed based on the robot motion list data. / Or it is determined whether or not the condition can be specified, and when it is determined that it is possible, the display mode of the robot operation and the set of commands displayed in the second area is changed. A characteristic display control method using an information processing device. A program that is run by a computer and runs RPA .
When this program is executed by the computer, it will run on this computer.
A robot operation indicating the type of command executed by the computer, a command input unit that accepts input of the command, which is a specific execution content of the robot operation, and a command input unit.
A scenario creation unit that creates scenario data in which the robot operation and the set of commands whose inputs are accepted by the command input unit are arranged in the execution order of the computer.
It has robot operation information indicating the content of the robot operation, branch information indicating whether or not branching conditions can be specified for the robot operation, and hierarchical information indicating whether or not the hierarchy can be specified for the robot operation. A storage unit that stores the robot operation list data that defines the robot operation and the scenario data,
Display the first region where a list of the robot operation based on the robot operation list data is displayed, the set of the robot operation and the command input is accepted by the command input unit is arranged in order of execution of the computer A scenario edit mode screen having a second area is displayed on the display device, and the robot action accepted by the command input unit is selected from the list of the robot actions displayed in the first area. When there is an input, a command detailed setting screen for inputting the details of the command according to the robot operation is displayed on the display device, and on the command detailed setting screen, the command input unit inputs the details of the command. Is received, the display content of the second area is updated, and further, the hierarchy designation and / or condition designation of the robot operation and the command set displayed in the second area via the input device is performed. When there is an input, it is determined whether or not the hierarchy designation and / or the condition designation is possible based on the robot operation list data, and when it is determined that it is possible, it is displayed in the second area. A program characterized by functioning as a display control unit that changes the display mode of the robot operation and the set of commands.