JP2023054409A - Automation program generation apparatus, automation program generation method, automation program generation program, computer-readable recording medium, and recorded device - Google Patents

Abstract

To reduce an amount of codes to be written by a user, thereby facilitating generation of an automation program.SOLUTION: An automation program generation method for automating operation of transcribing data to a second application serving as a transcription destination, on the basis of the data acquired from a first applications serving as a transcription source includes the steps of: prompting a user to select a first application and a second application, and generating a summary procedure in a summary procedure generation unit; selecting, by an acquisition range designation unit, a range of data to be acquired inthe data in the first application selected in the summary procedure generation unit; holding, in a memory unit, the data in the range set in the acquisition range designation unit, as tabular data in a tabular format; designating a transcription destination to which the data based on the tabular format is to be transcribed, in the second application selected in the summary procedure generation unit; and generating an automation program on the basis of the summary procedure generated in the summary procedure generation unit, the range set in the acquisition range designation unit, and the transcription destination.SELECTED DRAWING: Figure 1

Description

TECHNICAL FIELD The present disclosure relates to an automated program creation device, an automated program creation method, an automated program creation program, a computer-readable recording medium, and a recording device.

Robotic process automation (RPA) automates the work that humans used to do in the desktop environment of a computer by having a program perform the work that humans used to do in the desktop environment. A user must write code to create an RPA program, which is a program that performs work in RPA.

As a solution similar to RPA, there is known a solution that executes a scenario for managing a storage device in place of an operator's management work for the storage device. In such a solution, a method is known that uses a template to facilitate scenario creation. Patent Document 1 discloses that a scenario is created by embedding variables in a template.

However, if a method of embedding variables in a template to generate a desired scenario is applied to the creation of an RPA program, the creation of the RPA program may rather become difficult. Since the work performed by the user in the desktop environment of the computer usually targets multiple applications, the work performed by the RPA program also targets multiple applications. Therefore, a template that can generate an RPA program by embedding variables needs to reflect the order in which applications are used in tasks to be automated. A creator who creates an RPA program must correctly understand the sequence of applications used and the types of variables used in the application for the task to be automated, and then select an appropriate template from among a wide variety of templates. It was difficult for those unfamiliar with programming because they had to choose.

JP-A-2005-339213

One object of the present disclosure is to reduce the number of templates, reduce the amount of code written by the user, and facilitate the creation of an automation program. An object of the present invention is to provide a computer-readable recording medium and a recording device.

According to the automation program creation method according to the embodiment of the present invention, it is a method of generating an automation program that automates the operation of posting to the second application of the transcription destination based on the data acquired from the first application of the transcription source, a step of selecting the first application and the second application, creating a schematic procedure in a schematic procedure creating unit; and acquiring data of the first application selected in the schematic procedure creating unit. a step of selecting a range by an acquisition range specifying unit; a step of storing the data of the range set by the acquisition range specifying unit in a memory unit as table data in tabular format; a step of designating a transcription destination to which data based on the table data of the second application is to be transcribed; the outline procedure created by the outline procedure creating unit; the range set by the acquisition range specifying unit; and generating an automated program based on the above. With the above configuration, by setting the data of the first application to be transferred to the second application in tabular form, it becomes easier for the user to specify the desired range to be input, and to visualize the data to be transferred. Automation programs, which were conventionally complicated, can now be created easily.

According to the automation program creation program according to the embodiment of the present invention, an automation program is created for generating an automation program for automating the operation of posting to the second application of the transcription destination based on the data acquired from the first application of the transcription source. A program having a function of allowing the first application and the second application to be selected, creating a general procedure in a general procedure creating unit, and generating data of the first application selected in the general procedure creating unit. Among them, a function of selecting the range to be acquired by the acquisition range specifying part, a function of storing the data of the range set by the acquisition range specifying part in the memory part as tabular table data, and the outline procedure creating part The selected second application has a function of specifying a posting destination to which data based on the table data is to be posted, the outline procedure created by the outline procedure creating unit, and the range set by the acquisition range specifying unit. and a function of generating an automated program based on the transcription destination. With the above configuration, by setting the data of the first application to be transferred to the second application in tabular form, it becomes easier for the user to specify the desired range to be input, and to visualize the data to be transferred. Automation programs, which were conventionally complicated, can now be created easily.

Furthermore, a computer-readable recording medium or a device that stores the program according to the embodiment of the present invention is a medium that stores the program or a device that stores the program. Recording media include CD-ROM, CD-R, CD-RW, flexible disc, magnetic tape, MO, DVD-ROM, DVD-RAM, DVD-R, DVD+R, DVD-RW, DVD+RW, Blu-ray (product name), UHD BD (trade name), HD DVD (AOD: trade name), magnetic disks, optical disks, magneto-optical disks, semiconductor memories, and other media capable of storing programs. In addition to the programs that are stored in the recording medium and distributed, the programs also include those that are distributed by downloading through a network line such as the Internet. Further, the stored device includes general-purpose or dedicated device in which the above program is implemented in the form of software, firmware, or the like in an executable state. Furthermore, each process and function included in the program may be executed by computer-executable program software. and a partial hardware module that implements a part of hardware elements may be mixed. Computer-readable recording media, as used herein, also includes non-transitory tangible media or transient propagated signals.

According to the automated program creation device according to the embodiment of the present invention, the automated program creation device automates the operation of transcribing to the second application of the transcription destination based on the data acquired from the first application of the transcription source, an outline procedure creating unit for selecting the first application and the second application and creating an outline procedure; an acquisition range designation unit for selection; a memory unit that holds the data in the range set by the acquisition range designation unit as table data in table format; , a posting destination specifying unit for specifying a posting destination to which data based on the table data is posted; the outline procedure created by the outline procedure creating unit; the range set by the acquisition range specifying unit; and an automation program generation unit that generates an automation program based on the transcription destination designated by the designation unit. With the above configuration, by setting the data of the first application to be transferred to the second application in tabular form, it becomes easier for the user to specify the desired range to be input, and to visualize the data to be transferred. Automation programs, which were conventionally complicated, can now be created easily.

According to the automated program creation device according to the embodiment of the present invention, the automated program creation device automates the operation of transcribing to the second application of the transcription destination based on the data acquired from the first application of the transcription source, selecting an operation of acquiring the data from the first application and an operation of posting the data to the second application, and acquiring data included in an arbitrary data file of the selected first application; the data in the selected range to be transferred to the second application as source data in a tabular format; and setting the data posting unit for posting to the second application, and based on the set data posting unit, the selection is performed. display the transcription data to be transcribed to the selected second application, and display the acquisition source data of the selected first application in tabular form within the set range based on the set data transcription unit , a processor section for generating an automated program to be transferred to the selected second application; and a memory section for holding the set acquisition source data in tabular form as tabular data. With the above configuration, by setting the data of the first application to be transferred to the second application in tabular form, it becomes easier for the user to specify the desired range to be input, and to visualize the data to be transferred. Automation programs, which were conventionally complicated, can now be created easily.

According to one aspect of the present disclosure, it is possible to reduce the amount of code written by a user while suppressing the number of templates, thereby facilitating creation of an automation program.

FIG. 2 is a schematic diagram showing a series of tasks to be automated; 1 is a block diagram showing the hardware configuration of an automation program creation device according to one embodiment of the present invention; FIG. 3 is a functional block diagram of a processor unit in FIG. 2; FIG. It is a block diagram showing the software configuration of the automation program creation program according to one embodiment of the present invention. It is a schematic diagram which shows the exchange with an automation program creation program and spreadsheet software. FIG. 4 is a schematic diagram showing interaction between an automation program creation program and a web browser; FIG. 4 is a schematic diagram showing an example of interaction between an automation program creation program and automation target software; It is a flowchart which shows the procedure which creates an automation program using RPA software. FIG. 11 is a schematic diagram showing a schematic procedure creation screen; 10 is a flow chart showing a procedure for making detailed settings for importing spreadsheet software. FIG. 4 is a schematic diagram showing a spreadsheet software acquisition range specification screen; 10 is a flow chart showing a procedure of posting setting; It is a schematic diagram which shows a general posting detail setting screen. It is a schematic diagram which shows an example of an operation record screen. FIG. 4 is a schematic diagram showing an activity list screen; It is a schematic diagram which shows the screen which sets an operation record screen. It is a schematic diagram which shows an example of a tabular data transcription output detail setting screen. FIG. 18 is a schematic diagram showing a state in which the upper left cell of the table is selected in FIG. 17; FIG. 10 is a schematic diagram showing a state in which column name options are displayed; It is a schematic diagram which shows a table|surface navigation screen. FIG. 4 is a schematic diagram showing a table operation screen; FIG. 22A is an expense list, and FIG. 22B is a schematic diagram showing an example of a newly generated table. FIG. 10 is a schematic diagram showing a table to be combined; It is a table obtained by connecting the table of FIG. 23 by "customer code". It is a schematic diagram which shows the table|surface of vertical stacking|stacking object. FIG. 26 is a table obtained by summarizing the table of FIG. 25 by the vertical stacking function. FIG. 24 is a table obtained by summarizing the table of FIG. 23 by the vertical stacking function. FIG. 4 is a schematic diagram showing a table from which a difference is taken; FIG. 29 is a schematic diagram showing a table obtained by taking differences in FIG. 28; FIG. 29 is a schematic diagram showing a table extracted from common parts of FIG. 28; FIG. 10 is a schematic diagram showing a state in which the title of one article is manually selected on the target web page; FIG. 32 is a schematic diagram showing a state in which multiple article titles are automatically selected on the Web page of FIG. 31; FIG. 5 is a schematic diagram showing an example of an output detail setting screen; FIG. 34 is a schematic diagram showing an example of a web scraping extraction preview display displayed in a web scraping extraction preview display field on the output details setting screen of FIG. 33; FIG. 11 is a schematic diagram showing another example of Web scraping extraction preview display; It is the first part of the flowchart showing the procedure for performing Web capture detailed settings.

BEST MODE FOR CARRYING OUT THE INVENTION Hereinafter, embodiments of the present invention will be described with reference to the drawings. However, the embodiments shown below exemplify an automation program creation device, an automation program creation method, an automation program creation program, a computer-readable recording medium, and a recording device for embodying the technical idea of the present invention. Therefore, the present invention does not specify the automation program creation device, the automation program creation method, the automation program creation program, the computer-readable recording medium, and the recording device as follows. In addition, this specification does not specify the members shown in the claims as the members of the embodiment. Unless otherwise specified, the dimensions, materials, shapes, relative arrangements, etc. of components described in the embodiments are not intended to limit the scope of the present invention, but are merely explanations. Just an example. Note that the sizes and positional relationships of members shown in each drawing may be exaggerated for clarity of explanation. Furthermore, in the following description, the same names and symbols indicate the same or homogeneous members, and detailed description thereof will be omitted as appropriate. Furthermore, each of the elements constituting the present invention may be configured with the same member so that a single member may serve as a plurality of elements, or conversely, the function of one member may be performed by a plurality of members. It can also be realized by sharing.
[Embodiment 1]

An automated program creation device is generally called RPA (Robotic Process Automation), and is a device that assists the user in creating an automated program that replaces and automates the work that the user was doing in the desktop environment of a personal computer with a program. . FIG. 1 shows an RPA program for executing transcription work for outputting data in an arbitrary file or application to an arbitrary file form or application form using the automated program creation device of the present invention. It is a conceptual diagram which shows the method to create. Spreadsheet software SS, Web browser WB, and automation target software GS located on the left in FIG. 1 are transcription source applications that display data to be transcribed in transcription work. The spreadsheet software SS, the web browser WB, the automation target software GS, and the mail software MS located on the right in FIG. In this embodiment, the automation target software GS indicates all applications that can be operated by the user in the desktop environment. For example, the automation target software GS as the transcription source application in this embodiment indicates an application that can be operated by the user other than the spreadsheet software SS and the web browser WB. Further, for example, the automation target software GS as the transcription destination application in this embodiment indicates an application that can be operated by the user other than the spreadsheet software SS, the web browser WB, and the mail software MS.

In this embodiment, a transcription work is defined as a work of acquiring data from a transcription source application and outputting it to a transcription destination application. For example, in the transcription work of transcribing data in a data file of spreadsheet software SS to another data file of the same spreadsheet software SS, in FIG. Data is obtained from the data file of the calculation software SS, and the data or data based on the data is output to the data file of the spreadsheet software SS as the transcription destination application shown on the right in FIG. be In FIG. 1, the work of transcribing the data in the page being browsed by the web browser into the form of the predetermined software acquires the data from the web browser WB as the transcribing source application shown on the left in FIG. 1, the data or data based on the data is output to the automation target software GS as the transcription destination application shown on the right side of FIG.

When a user creates an RPA program that executes such transcription work, it is necessary to consider which data are treated as variables and how the variables are treated. For example, what data is to be acquired from the posting source application and as what variables, how to edit the acquired data and process it into data for output to the posting destination, and which variables are to be used for the posting destination application. It is necessary to consider how to output. It is difficult for users unfamiliar with programming to create programs while considering how to handle variables. In this embodiment, as shown in FIG. 1, the data obtained from the transcription source application is stored as a table, thereby facilitating designation of how to handle variables. Details will be described later.

FIG. 2 shows the configuration of a general-purpose computer PC that functions as the automation program creation device of this embodiment. The computer PC includes a display unit 11 such as a display, an input unit 12 , a bus 13 , a communication unit 14 , a processor unit 20 , a memory unit 15 and a storage unit 16 . By installing the automation program creation program in the computer PC, the computer PC functions as an automation program creation device. In this embodiment, a general-purpose computer PC functions as an automation program creation device, but a dedicated automation program creation device may be configured with hardware.

The display unit 11 displays each application shown in FIG. 1 and screen information provided by the automation program creation program. The display unit 11 is composed of, for example, a liquid crystal display (LCD), organic EL, or the like. The display unit 11 may be composed of a touch panel, and in this case, the touch panel serves both as the display unit 11 and the input unit 12 . The input unit 12 is an input device such as a keyboard 12a, a mouse 12b, and a touch pad 12c. A bus 13 constitutes a data transmission path for exchanging data between the members. The communication unit 14 is a member for performing data communication with an external device, and uses Ethernet (trade name) or IEEE802. Standardized communication interfaces and modules such as X can be used. In this way, the connection with the external device can be made by wire or wirelessly. The processor unit 20 is a member that performs various calculations and processes, and can be suitably realized by a CPU, MPU, SoC, ASIC, or the like. The memory unit 15 expands the load module when the computer program is executed, and holds temporary data generated when the computer program is executed. Such a memory unit 15 can use a RAM composed of volatile memory such as SRAM or SDRAM, or a ROM composed of nonvolatile memory such as EEPROM. The storage unit 16 is a member for holding various types of information such as automation program execution files, data, and setting information. The storage unit 16 is composed of a hard disk, a semiconductor memory, a portable medium, and the like.
(Processor unit 20)

FIG. 3 is a functional block diagram showing the functions of the processor section 20 of the computer PC that functions as the automation program generation device of this embodiment. The processor unit 20 has an automation program generation unit 25 and an automation program execution unit 26 . The automation program generation unit 25 is a functional block for generating an automation program, and has a general procedure generation unit 21, an acquisition range designation unit 22, a transcription designation unit 23, and an operation record setting unit 48. The automation program execution section 26 is a functional block for executing the automation program generated by the automation program generation section 25 .

The schematic procedure creating unit 21 is a functional block for setting a schematic procedure showing transfer of data between applications in the transcription work to be automated. The general procedure creation unit 21 has a repetition setting unit 31 . The repetition setting unit 31 is a functional block for setting a procedure to be repeated among the general procedures set by the general procedure creating unit 21 .

The acquisition range specifying unit 22 is a functional block for specifying a range in which data to be acquired exists among the data of the transcription source application. It accepts user's specification. In this embodiment, the data of the transcription source application includes data included in files handled by the transcription source application and data included in screen information displayed by functions of the transcription source application. For example, when the transcription source application is spreadsheet software SS and data is acquired from a file displayed in a tabular format by the spreadsheet software SS, the data contained in the file handled by the transcription source application is acquired. . In this case, the specification of the range in which the data to be obtained exists in the file is accepted. In particular, when acquiring data from a file displayed in tabular form by spreadsheet software SS, the range in which the data to be acquired exists is specified by specifying the rows and columns of the table. Also, for example, when the transcription source application is the automation target software GS and the character string displayed by the function of the software is acquired as data, the data contained in the screen information displayed by the function of the transcription source application is acquired. is the case. Also in this case, the specification of the range in which the character string to be acquired in the screen information exists is accepted. Although the details will be described later, if it is difficult to specify data by a method unique to the target application, such as specifying data by row and column in spreadsheet software SS, the operation record setting unit 48 described later can be used. The function specifies the range of data acquisition.

The acquisition range specifying unit 22 also has an automatic table recognition executing unit 35 . The automatic table recognition execution unit 35 extracts data from a file that is handled by the spreadsheet software SS but has a shape that makes it difficult for the user to specify the range of data to be acquired because the data arrangement is not constant, and the user specifies the range. It is a functional block that shapes into an easy-to-use shape. For example, in the case of a file that includes a portion intended as a table and a portion that is not, the table is extracted by recognizing the portion surrounded by ruled lines as the portion intended as a table. Also, for example, a table is extracted by recognizing a cell joined across multiple columns as a cell in a single column. Furthermore, for example, when extracting data from a plurality of files, a table is extracted by adding a file name indicating the extraction source of each row as a new column. In this way, a known algorithm is appropriately applied to generate a table shaped into a shape that allows the user to easily designate a range. The user specifies the range in which the data to be acquired exists by specifying rows and columns for the formatted table.

In this way, the data of the transcription source application for which the range in which the data to be acquired exists is specified by the acquisition range specifying unit 22 is held in the memory unit 15 as table data.

When the transcription source application is spreadsheet software SS, table data is generated by arranging data included in the transcription source application for each column displayed on the spreadsheet software SS. Also when the table is recognized by the automatic table recognition execution unit, the table data is generated by arranging the data based on the shaped table. That is, the spreadsheet software SS is an application in which data is arranged according to rows and columns as rules that are easy to use for generating table data. Further, when the transcription source application is the web browser WB, the data visually recognized by the user through the web browser WB is arranged according to the html tags. Therefore, table data is generated by arranging data included in the transcription source application for each tag. That is, the Web browser WB is an application in which data is arranged according to tag information as a rule that is easy to use for generating tabular data. In this way, when an application in which data is arranged according to rules that are easy to use for generating tabular data is the transcription source application, tabular data is generated according to the rules. In the present embodiment, applications in which data is arranged according to rules that are easy to use for generating table data include spreadsheet software SS and Web browser WB, but are not limited to these. When the data of the transcription source application is arranged according to a certain rule and the rule is well known, a method of generating tabular data from the data of the transcription source application can be set in the acquisition range specifying unit 22 in advance. Therefore, it can be said that data is arranged according to rules that are easy to use for generating tabular data. In this case, similar to the spreadsheet software SS and the Web browser WB, by setting the type of the transcription source application by the outline procedure creation unit 21, the corresponding table data generation method is applied, and the data of the transcription source application is applied. tabular data is generated from In the table data, the data is arranged according to the rules for arranging data in the transcription source application. Note that the column names of the table data to be generated may be appropriately set by the user.

Also, when the acquisition range specifying unit 22 does not correspond to the data arrangement rule of the automation target software GS as the transcription source application, for example, when the automation target software GS is an application that is used only within a certain company. 2, it is difficult to generate tabular data according to the data arrangement rules in the automation target software GS. In such a case, the data acquisition range is designated by the function of the operation record setting unit 48 as described above. In specifying the data acquisition range by the function of the operation record setting unit 48, the data acquisition range and the column names of the table data are specified according to the user's operation. More specifically, position information and coordinate information in the object hierarchy related to data specified by the user are associated with the specified column name. By being associated in this way, the data included in the first screen information displayed by the automation target software GS and the data included in the second screen information displayed by the automation target software GS are placed at the same position as the data. Tabular data is generated in which the located data and the are placed in the same column.

In this way, the data of the transcription source application for which the range in which the data to be acquired exists is designated by the acquisition range designation unit 22 is acquired as table data by an appropriate method according to the type of the transcription source application. Data is held in the memory unit 15 . Note that the table data held in the memory unit 15 is similarly given a name so that it can be distinguished from the table data held in the memory unit 15, but the name may be given by the user. In this case, the acquisition range specifying unit 22 accepts the name given to the table data.

The transcription designation unit 23 is a functional block for designating data to be transcribed to a transcription destination application. The transcription designation section 23 has a transcription destination designation section 23a, a transcription unit designation section 23b, a table manipulation section 23c, and a transcription data preview section 23d.

The transcription destination designation unit 23a is a functional block for designating a form in which data is written in the transcription destination application, and displays screen information for designating the form and accepts the user's designation of the screen information. . In this embodiment, the form of the posting destination application is an object for which the user has made some designation based on the data to be transcribed in the conventional transcription work. It includes a combo box from which any option is selected, and a radio button indicating that one of a plurality of options has been selected.

The transcription unit designation unit 23b is a functional block for designating a unit for transcription of data acquired from the range designated by the acquisition range designation unit 22. FIG. That is, the range of data to be transcribed in one transcription is designated by the transcription unit designation section 23b. As described above, the data to be transcribed to the destination application is stored in the memory section 15 as table data, so the transcribed unit designation section 23b accepts designation of the number of rows as the unit for transcribed data. Note that when transcription to a transcription destination application whose unit is designated by the transcription unit designation section 23b is to be repeated in the general procedure, the unit designated by the transcription designation section 23b is treated as the unit of transcription. .

The table manipulation unit 23c is a functional block for manipulating data held in the memory unit 15 as table data and editing data to be written to the transcription destination application. Manipulation of table data by the table operation unit 23c includes filter operation for determining rows to be displayed according to whether or not data contained in a certain column satisfies a predetermined condition, and multiple table data for common column items. Includes table join operations that join according to conditions.

The transcription data preview section 23d is a functional block that displays a table operated by the table operation section 23c and a unit for transcribing the data designated by the transcription unit designation section 23b in the table. The user sees the information displayed by the transcription data preview section 23d, and confirms the transcription unit set by himself and the result of the table operation.

The operation record setting unit 48 is a functional block for recording a user's operation on an arbitrary application of the transcription source application or the transcription destination application.

4 to 7 are diagrams showing the relationship between software and data possessed by the computer PC functioning as the automation program creation device of this embodiment. The RPA soft RS shown in FIGS. 4 to 7 is an automated program generation program. By installing the RPA software RS, the processor unit 20 functions as an automation program generation unit 25 and an automation program execution unit 26. Therefore, functional blocks included in the RPA software RS are shown in FIGS. 4 to 7 .

As shown in FIG. 4, the RPA software RS acquires data from existing applications such as spreadsheet software SS, web browser WB, and other automation target software GS, and writes data to these existing applications. . Data acquisition and data writing for existing applications are performed by the function of each functional block of the automation program generation unit 25 when the automation program is generated, and are automated when the generated automation program is executed. It is performed by the program execution unit 26 . Further, the automation program generation unit 25 generates table data based on the data acquired from the transcription source application, retains it in the memory unit 15, refers to the table data retained in the memory unit 15, and transfers the table data to the transcription destination application. Create an automated program by setting the data write. The automation program execution unit 26 executes transcription work based on the generated automation program.

When supporting the creation of an automation program with the RPA software RS, as shown in FIG. , RPA software RS exchanges data and the like via API. The Web browser WB (data format is html file) and RPA software RS communicate between processes using selenium or the like to acquire, write, and operate data.

Further, the automation program generation unit 25 supports creation of the automation program in tabular data format. The automation program created by the automation program generation unit 25 is saved in the storage unit 16 or the like as an RPA program file. Further, the automation program execution unit 26 reads the saved RPA program file and executes the automation program. Thereby, a predetermined series of operations are automatically executed.

FIG. 5 shows the relationship between the RPA software RS and the spreadsheet software SS. The RPA software RS performs COM communication with the spreadsheet software SS to operate the spreadsheet software SS. By operating the spreadsheet software SS, the RPA software RS acquires the values of the cells of the table displayed by the spreadsheet software SS as acquisition of data contained in the file, and writes data using the spreadsheet software SS. Write data to the cells of the table displayed by . In this embodiment, the spreadsheet software SS is Excel, and files displayed by the spreadsheet software SS have the extension . xlsx file. In this case, the RPA software RS may be used within the process of the Excel file manipulation library to write data to the file.

FIG. 6 shows the relationship between the RPA software RS and the web browser WB. The RPA software RS allows the user to operate the web browser when acquiring data from the web browser. At this time, the path of the element clicked by the user with a pointing device such as a mouse is obtained via an extended function added in advance to the web browser WB. The RPA software RS uses Xpath as a search expression based on the acquired path, and extracts path elements corresponding to Xpath. When executing the automated program created by the RPA software RS, the path of the form displayed on the web browser WB is specified via the extension function of the web browser WB, and data is sent to the elements of the specified path. copy.

When generating XPath from a path acquired by an extension function of Web browser WB, RPA software RS generates XPath that can extract elements in the same hierarchy as the element corresponding to the path. By operating the browser WB, it is possible to extract a plurality of elements in the same hierarchy as the designated element. At this time, when the user specifies multiple elements that are determined to be in the same hierarchy, the Xpath can be generated from the common part of the paths of the multiple elements. The accuracy of generating suitable XPaths is improved.

FIG. 7 shows the relationship between the RPA software RS and the automation target software GS for automating the operation by the function of the operation record setting unit 48 . The RPA software RS and the automation target software GS communicate via UIAutomation. UIAutomation is a library provided by Microsoft Corporation. When the automation program is created, the automation program generation unit 25 receives an operation performed by the user on the operation of the automation target software GS. More specifically, the automation program displays a translucent window TW in front of the automation target software GS so that the display information of the automation target software GS can be visually recognized. In the computer PC according to the present embodiment, the application corresponding to the screen information displayed in the foreground accepts operations. It is accepted as an operation for TW. The automation program generation unit 25 that receives user operations using the function of the translucent window TW passes the mouse position specified by the received user operations to UIAutomation. As a result of passing the mouse position, UIAutomation receives information about the UI element of the user interface at that mouse position. The information related to the UI element here includes the position of the UI in the hierarchy and attributes of the UI (for example, whether data can be input or whether it is a combo box). Based on the information related to this UI element, the automation program generation unit 25 displays options for operation content indicating the content of the operation to be performed on the UI element. The automation program generation unit 25 receives the operation content selected by the user for the UI element, records the operation content and the UI element in association with each other, and transfers the operation content and information specifying the UI element to UIAutomation. to execute the operation for the automation target software GS.

When the created automation program is executed, information designating a UI element and operation contents associated with the UI element are sent to UIAutomation to execute a predetermined operation on the UI.

It should be noted that the RPA software RS is not limited to the above-described method using UIAutomation or the like when supporting the creation and execution of an automation program for the automation target software GS. For example, an API provided by the OS, which is the environment in which the automation target software GS and the RPA software RS are executed, may be used. As an example, the Win32 API (product or service name) of the Windows (product or service name) OS may be used to monitor operation events sent from the OS to each application and generate an automation program. Further, the automation program may be executed by executing the operation contents indicated in the automation program via the Win32 API to the automation target software GS.

The RPA software RS of this embodiment has a plurality of modes for creating an automatic program. The navigation mode, one of multiple modes, guides the user through the steps necessary to create an automation program in accordance with the automation program that the user intends to create. mode. FIG. 8 shows a flowchart when creating an automation program for executing transcription work with the RPA software RS in navigation mode.

First, in step S901 in FIG. 8, the general procedure creation unit 21 displays a general procedure creation screen as screen information for the user to create a general procedure.
(Outline procedure creation screen 110)

FIG. 9 shows an example of the outline procedure creation screen 110 . The user operates the general procedure creation screen 110 to generate the general procedure. Here, the outline procedure generated by the user is a procedure corresponding to the transcription work, and the user designates the transcription source application and the transcription destination application. Therefore, even when the option "extract data from spreadsheet software SS" is displayed and the user selects this option, it can be considered that the spreadsheet software SS has been selected as the transcription source application. As described above, the automated program creation apparatus of the present embodiment prompts the user to create a general procedure by displaying the application to be used in the transcription work, which is a relatively easy-to-specify item, as options. Screen information for specifying the information required to acquire data from the source application and the information required to write data to the destination according to the outline procedure created by the user selecting the application. display. This reduces the difficulty for the user to create the automation program.

Details of the outline procedure creation screen 110 will be described with reference to FIG. By constructing a general scenario first and then constructing a detailed scenario, it becomes easier to create a scenario for the user's business flow. The items in the center of the screen are rough operations (activities) that can be selected. By clicking an item to be selected from among the rough operations listed in the operation candidate list 112 in the center of the screen and then pressing the "Add" button 113, it can be added to the operation selection list 114 on the right side of the screen. It is possible. Furthermore, when the "Next" button 117 is pressed again, if activities have been added to the operation selection list 114 on the right side, a transition is made to a screen for making detailed settings for each rough operation in the order of the added items. On the other hand, if there is nothing in the operation selection list 114, no transition is made. Also, when the "discard and return" button 118 is pressed, the creation navigation setting is canceled and the process ends.

On the outline procedure creation screen 110, the transcription source application and the transcription destination application are selected by adding the outline procedure icon 111 in the operation candidate list 112 to the operation selection list 114. FIG. In the example of FIG. 9, when the outline procedure icon 111 "spreadsheet software" of the form "from what data will you extract data?" be done. The icon "Web" corresponds to the web browser WB, and the icon "arbitrary application" corresponds to the automation target software GS. Further, in the example of FIG. 9, when the outline procedure icon 111 "spreadsheet software" of the form "to what?" is selected.

The general procedure creation screen 110 also includes a repeat setting icon 119 . By creating a general procedure in combination with the repeat setting icon 119, the user creates a general procedure including a procedure to be repeatedly executed. The repetition setting unit 31 displays screen information related to repetition based on the outline procedure including the repetition setting icon 119 . In FIG. 9, when the user selects the "Repeat specified range" button 115 while selecting the outline procedure icon 111 arranged as the outline procedure, the repetition setting icon 119 is displayed on the selected outline procedure. is inserted. The selected general procedure icon 111 is displayed one step lower than the repetition setting icon 119, indicating that the general procedure is a repetition setting.

In the example of the first embodiment, the spreadsheet software SS is selected as the transcription source application, and the spreadsheet software SS and the web browser WB are selected as the transcription destination application. Further, a part of the operation of writing data to the automation target software GS, the spreadsheet software SS, and the web browser WB as the transcription destination applications is set to be performed repeatedly.

As shown in FIG. 8, after the outline procedure creation screen 110 is displayed in step S901, it is determined in step S902 whether or not the outline procedure has been created. If not, step S902 is repeated. goes to step S903.

In step S903, the automation program creation unit determines whether or not the transcription source application was selected in step S901. If the automation program creation unit determines that the transcription source application has been selected, it starts setting the acquisition range according to the application selected as the transcription source application in step S904. After the automation program creation unit completes the setting of the acquisition range in step S904, the process proceeds to step S905. If the automation program creation unit determines in step S903 that the transcription source application has not been selected, the process proceeds to step S905. (Capture range setting for spreadsheet software SS)

FIG. 10 is a flowchart showing the details of the acquisition range designation executed by the acquisition range designation unit 22 when the spreadsheet software SS is selected as the transcription source application. In step S1101, the acquisition range specifying unit 22 determines whether or not the automatic table acquisition mode for automatic table recognition is set. When the acquisition range specifying unit 22 determines that the automatic table acquisition mode is set, in step S1102 the acquisition range specifying unit 22 performs automatic table recognition using the function of the automatic table recognition execution unit. Automatic table recognition is performed to generate a formatted table, and the process proceeds to step S1103. If it is determined in step S1101 that the acquisition range specifying unit 22 is not in the table automatic acquisition mode, the process advances to step S1103. In step S1103, the acquisition range designation unit 22 designates a range in which data to be acquired exists in a table formatted by the automatic table recognition execution unit or a table displayed in tabular form by the spreadsheet software SS. After the acquisition range is designated in step S1103, the acquisition range designation unit 22 designates the name of table data generated from the data to be acquired in step S1104. The acquisition range specifying unit 22 in step S1104 may receive the name of the table data from the user, or may specify a name that can be distinguished from other table data already held in the memory unit 15 . In step S1105, the acquisition range specifying unit 22 generates table data whose column items are the top rows of the acquisition range specified in step S1103, and assigns the name specified in step S1104 to the table data. is stored in the memory unit 15.

FIG. 11 shows a spreadsheet software acquisition range designation screen 130 displayed by the acquisition range designation unit 22 when the automatic table acquisition mode is not set. This figure shows a screen for accepting user operations in steps S1103 and S1104 in FIG. 10 described above. In FIG. 11, a form labeled with "file name", "sheet name", and "cell" is displayed in order to accept specification of the range of the table executed in step S1103. Also, in FIG. 11, a form with a label of "extracted table name" is displayed in order to accept designation of a name to be executed in step S1104. In the example of FIG. 11, the name "expense list" is specified. Further in FIG. 11, a trigger button 138 is provided for executing step s1105. The name of the table data specified in step S1104 is a variable name for calling the table data from the memory unit 15 in the RPA software RS.

As shown in FIG. 8, after the designation of the acquisition range is completed, the automation program creation unit determines in step S905 whether or not the transcription destination application was selected in step S901. When the automation program creation unit determines that the transcription destination application has been selected, transcription setting is executed in step S906. After the transcription setting is completed in step S906, the automation program creation unit proceeds to step S907. If the automation program creation unit determines in step S905 that the destination application has not been selected, the automation program proceeds to step S907.

FIG. 12 is a flow chart showing details of settings related to transcription executed by the transcription designation unit 23 when an arbitrary application is selected as a transcription destination application. At step S1301, table data to be called from the memory unit 15 is selected. In step S1302, as a function of the table operation unit 23c, an operation for the table data selected in step S1301 is accepted, and the table data is edited according to the operation. In step S1303, as a function of the transcription unit designation unit 23b, the unit of transcription to the transcription destination application is designated for the table data called in step S1301 or the table data edited in step S1302. After accepting designation of the unit of transcription in step S1303, in step S1304, as a function of the destination designation unit 23a, the form to which the data is to be transcribed is designated in the destination application.

In step S1304, the transcription destination designation unit 23a displays screen information for accepting designation of a transcription destination form from the user according to the transcription destination application. If the destination application is the spreadsheet software SS, the specification of the destination file, sheet, cell, etc. is accepted. When the posting destination application is the web browser WB, the web browser WB is started, the user operation for the web browser WB is acquired via the extension function of the web browser WB, and the form selected by the user on the web browser WB is displayed. Identify. When the transcription destination application is the automation target software GS, the form is specified by the function of the operation record section.

FIG. 13 shows a general posting detail setting screen 150 displayed as one mode of posting setting in step S906. A general posting detail setting screen 150 shown in this figure shows one aspect of the posting designation section 23 . On the general posting details setting screen 150, the details of data posting are set. In the example of FIG. 13, the general posting details setting screen 150 displays an activity display field 121 on the left side of the screen and a posting details designation field 152 on the right side of the center of the screen. In this example, a detail setting screen for the activity selected in the activity display column 121, here, "record operation and perform input/output", is displayed on the general posting detail setting screen 150. FIG.

Details of data transcription for transcribing the data in the range set by the acquisition range designation unit 22 in FIG.

A posting data specification column 153 and an execution operation determination column 156 are provided in the posting details specification column 152 of FIG.
(Posting data specification field 153)

The transcription data specification column 153 includes columns corresponding to table data selection executed in step S1301, table manipulation executed in step S1302, and transcription unit designation executed in step S1303 shown in the flowchart of FIG. The user can set the details of the data to be transcribed to the destination application by operating the transcribed data specification field 153 .

The posting data specification field 153 has a table data reference presence/absence specification field 155 and a table data specification field 153b. The user can specify whether or not to refer to the table data held in the memory unit 15 by operating the table data reference presence/absence designation field 155 . In the example of FIG. 13, referring to tabular data is selected. Further, the user specifies table data including data to be transcribed or data for generating data to be transcribed by operating the table data designation column 153b. That is, the transfer data specification column corresponds to step S1301 in the flowchart of FIG. 12 described above. The example of FIG. 13 indicates that table data named "expense list" is selected.

The transcription data designation field 153 also has a transcription unit preview field 154 as one form of the transcription unit preview section 24 . The transcription unit preview field 154 displays the form of the data to be transcribed based on the setting of the details of the transcription data set by the user operating the transcription data designation field 153 . The transcription unit preview column 154 is also a member for allowing the user to edit the table data in step S1302 of the flowchart of FIG. 12 described above. When the user operates the transcription unit preview field 154, the table navigation screen 380 of FIG. 20 is displayed and the table operation by the user is accepted.

The posting data designation field 153 has a posting unit designation field 153c as one form of the transcription unit designation section 23b. The user specifies a target to be transcribed in one transcription of data to the transcription destination application by operating the transcription unit designation column 153c. That is, the transcription unit designation field 153c corresponds to step S1303 in the flowchart of FIG. As a transcription unit from the table data designated by the table data designation column 153b, "one line at a time", "whole table", and "grouping" can be selected. When "line by line" is selected, the table data of the variable name selected in the table data selection column 153b is transcribed line by line in one transcription. Also, when "whole table" is selected, the entire table data is transcribed in one transcription. Furthermore, when "grouping" is selected, the data of the row with the same column value of the table data is input. For this reason, in the "grouping", it is possible to select the column items of the table data of the variable name selected in the table data selection column 153b. In the example of FIG. 13, the column item "Date" is shown together with the option "Grouping". In this case, data having the same value in the column named "Date" among the table data of the variable name selected in the table data selection column 153b is transcribed once.
(Execution operation determination column 156)

Further, in the transcription details designation field 152 of FIG. 13, an execution operation determination field 156 is provided below the transcription unit designation field 153 . The execution operation determination column 156 is a member for allowing the user to designate a form as a data posting destination in step S1304 of the flowchart of FIG. 12 described above.

The execution operation determination column 156 is displayed when the automation target software GS is designated as the transcription destination application. The user starts the operation record from the performed operation determination field 156 by the function of the operation record setting unit 48 in order to specify the form in the automation target software GS. The performed operation determination column 156 shown in FIG. 13 is a member for determining operations that are not repeated in the execution of the automation program, but a separate performed operation determination column for determining repeated operations may be provided. In this case, it is preferable that the performed operation determination column for determining the operation not to be repeated and the performed operation determination column for determining the repeated operation are displayed on the same screen. Here, "displayed on the same screen" includes an arrangement in which the above-described two execution operation determination fields can be displayed by scrolling. According to this, since the user can set both the repeated operation and the non-repeated operation from the same screen, it is possible to easily generate an automation program related to the work in which the repeated operation and the non-repeated operation are mixed. can.
(Operation record screen 160)

FIG. 14 shows an aspect of a display screen including screen information displayed by the function of the operation record setting section 48. FIG. The operation record screen 160 shown in FIG. 14 displays an "expense settlement" form GS1 displayed by the expense settlement application as the automation target software GS. The operation record setting unit 48 displays a translucent window TW in front of the screen information generated by the automation target software GS. The semi-transparent window TW may be a transparent window as long as it is transparent enough to allow the screen information that overlaps the semi-transparent window TW and is positioned behind the semi-transparent window TW to be visible. By displaying a translucent window, the user can recognize that some screen information is superimposed on the screen information generated by the automation target software GS. is preferred. In FIG. 14, the frame of the semi-transparent window TW is located inside the frame of FIG. 14 in order to clarify the semi-transparent window TW, but it is actually displayed on the entire screen.

The user performs an operation on the operation record screen 160 to specify the form to which the posting is to be made. The operation record setting unit 48 accepts an operation of specifying a predetermined form included in the form GS1 through the translucent window TW by the user through the translucent window TW, and specifies the form in the form GS1 designated by the user. Thereby, the transcription destination setting unit specifies the form in which the data is written in the transcription destination application. In the example of FIG. 14, the form with the description "applicant" is selected from the "expense reimbursement" form GS1 of the software to be automated. To make the operation easier to understand, the position of the mouse cursor is indicated by a circle.

After the form into which the data is written is specified, the operation record setting unit 48, based on the table data called from the memory unit 15 by the transcription designation unit 23, provides screen information for allowing the user to select the data to be written into the form. indicate. When the table data is edited by the table operation section 23c, screen information may be displayed based on the edited table data. Also, the screen information may be displayed based on the unit specified by the transcription unit specifying section 23b.

The user selects data to be written in the form from choices of data to be written displayed by the operation record setting unit 48 . The operation record setting unit 48 accepts the user's selection and associates the specified form with data to be written in the form. As a result, the transfer destination designating unit 23a designates a form in which data is written in the transfer destination application and data to be written in the form.

Note that the operation record setting unit 48 writes the data selected by the user into the specified form. As a result, the user can check whether the selected data can be written to the specified form without error by having the automation target software execute the operation immediately after selecting the operation via the operation record screen. , debugging becomes easier

As shown in FIG. 8, the automation program creation unit advances to step S907 and determines whether or not there is an operation record procedure for which details have not been set. Here, the operation record procedure for judging presence or absence is not the operation record procedure included in the acquisition range setting of the transcription source application in step S904 or the transcription setting to the transcription destination application in step S906. are set as procedures corresponding to user operations performed before and after the procedure of transcribing. If it is determined in step S907 that there is an unset operation record procedure, the process advances to step S908 to execute operation record setting. In step S908, a translucent window TW is displayed by the function of the operation record setting unit 48, and user operations performed on the translucent window TW are recorded. When the recording of the user operation in step S908 is completed, the process advances to step S909 to generate screen information showing the contents of the automation program based on the contents set in at least one of steps S901, S904, S906, and S908. If it is determined in step S907 that there is no unset operation record procedure, the process proceeds to step S908. to generate
(Activity list screen 220)

FIG. 15 shows an activity list screen 220 displayed in step S909 showing the contents of the automated program to be created. On the activity list screen 220, the created procedures are grouped and displayed in units of outline procedures set in step S901. The activity list screen 220 has a summary activity display column 221 on the left side of the screen. In the summary activity display column 221, the created activities are grouped and displayed on a summary activity basis. In the activity list screen 220 of FIG. 15, variables are displayed in orange. In this embodiment, since the automated program that generated the table data itself also treats it as a variable, the name given to the table data itself is treated as a variable name. Each column item included in the table data is also treated as a variable name because it is referenced during transcription.

The activity list screen 220 of FIG. 15 shows a state in which the detailed settings for importing various data and the settings for the transcription operation have been completed. A general activity headline section 222 is a portion of this figure that says "record operations and input/output", and displays a general activity corresponding to a flow. A general activity detail display area 225 is provided below the general activity headline section 222 . In the general activity detail display area 225, "start application", "repeat table", and "end application" are displayed. operations or activities are enumerated. The unit of general activity when various settings are completed corresponds to the general procedure created in FIG. Here, in the general activity headline section 222, the display of "record operations and input/output" is manually input by the user as a summary name 223, while the user enters "enter expense list" on the right. A summary label 224 of "do" is automatically generated.

After displaying the activity list screen 220 in step S909 as shown in FIG. 8, the automation program creation unit creates an automation program in step S910. The automation program is generated based on the contents set in at least one of steps S901, S904, S906, and S908.
[Embodiment 3]
(Operation record screen 280)

FIG. 16 shows the operation record screen 280 when the form of the transcription destination application designated by the user by the function of the transcription destination designation unit 23a is displayed in a tabular format. Note that the translucent window is not displayed in this figure for the sake of explanation.

When it is detected that the user has selected the table UI with the mouse on the operation record screen 280 of FIG. A data transfer detail setting window 301 is displayed. The table data transfer detail setting window 301 has a table input position specification field 302 and a table selection field 303 . First, in order to specify the table UI of the output destination, the user is made to select the upper left cell of the table in the table input position specification field 302 . After detecting the user's selection and specifying the upper left cell of the table UI, the operation of selecting the upper left of the table UI is reflected in the table UI. In FIG. 18, the daily report management application, which is the automation target software GS, displays the selected cell in the table UI with a blue frame. "Selected" is displayed in the table input position specification column 302, indicating that the upper left cell of the table has been selected.

Next, select a table. In the table data transfer detail setting window 301 shown in FIG. 18, a table selection column 303 is provided with a table movement direction specification column 304, a row insertion specification column 305, a row deletion specification column 306, and a "try to move table" button 307. It is By pressing the "try to move table" button 307, it is possible to check whether the table UI has been correctly selected. In this confirmation, the RPA software accepts the user's operation with the corresponding keyboard such as "right: →", and it is possible to confirm whether the selection moves on the table UI in that way when the keyboard is operated. .

The table displayed on the RPA software corresponds to the table UI of the automation target software, that is, the table UI of the daily report management application as the transcription destination application. As an example, an operation record screen 320 in FIG. 19 shows a state in which data to be transcribed in the second column from the left of the table UI is selected. In this operation record screen 320, how each column of the table UI of the automation target software GS is associated with each column of the table data imported for creating the RPA program in the RPA software, and the setting screen at that time can be confirmed. In the drawing, the portion L1 indicated by a horizontally long bar reflects the table UI of the automation target software GS on the setting screen of the RPA software RS. In column name options 321 below it, column item names of the imported table data are displayed as options. A column name option 321 selects a column name corresponding to table data to be transferred to the automation target software GS when the RPA software RS is executed. For example, if you select and set "item" from among the column name options 321 displayed in the pulldown of the second column from the left of L1, when you run the RPA software RS, "item ” will be transcribed in the second column from the left of the automation target software GS. By setting in this way, the data in the table data to be written in the specific column of the table UI displayed by the automation target software GS is designated.
(table operation)

Next, the details of table data editing that can be executed by the table operation unit 23c will be described. The function of editing the table data held in the memory unit 15 is called "table navigation". For example, on the general posting details setting screen 150 in FIG. 13, the table operation can be called to edit the table data.

Also, from the table navigation screen 380 in FIG. 20, the type corresponding to the desired table operation can be selected and executed. The table data after execution of the operation is held in the memory unit 15 . At this time, the table data held in the memory section may be held in the memory section 15 with a name designated by the user, or may be given a name that can be distinguished from the table data already held in the memory section 15. and may be held in the memory unit 15 .

Also, when a plurality of table data are held in the memory unit 15 and a plurality of table data are selected in step S1301 in the flow shown in FIG. 12, the plurality of table data are combined. Alternatively, it is possible to extract the difference between the plurality of table data. FIG. 21 is another example of FIG. For example, in the table operation screen 390 of FIG. 21, when an expense list such as that shown in FIG. 22A is generated as Table 1, selecting "Filter table by conditions" selects "Filter table 1 by conditions" as an activity. is generated.

Here, for example, when creating a scenario in which an application is made only when expenses are 1,000 yen or more, if the setting "Filter expense list by amount>1000" is made, the expense list in FIG. 22A is narrowed down. Then, a table such as that shown in FIG. 22B is generated. A table newly generated in this way can also be treated as a variable. For example, if the table in FIG. 22B is given the name of “Applied Expense List”, the table “Applied Expense List” can be used in other activities.

Also, by using this function, it is possible to substitute branch processing specification. For example, in normal branch processing, the branch processing like an if statement (in this case, "amount >1000") is executed by specifying the place where the user should branch from the code and executing the branch processing at an appropriate position. It was necessary to perform an operation such as inserting, which was troublesome. On the other hand, if you use this function, you can handle it as a single table, so by using it together with the repeat processing of the creation navigation, you can perform operations equivalent to branching without inserting the branch processing yourself. .
(table operation function)

Various operations such as joining, stacking, extracting differences, extracting common parts, narrowing down tables, adding columns, and deleting columns can be performed on multiple tables. Such a table operating function is executed by the table operating section 23c in FIG. Here, as an example of the table manipulation function, a table join function for joining a plurality of tables will be described with reference to FIGS. 23 and 24. FIG.
(table join function)

The table join function allows you to join tables with specific column names for multiple tables. For example, as shown in FIG. 23, if there are two tables, they can be merged by the name of a particular column, here "customer code" to produce the table of FIG.

By combining table data in this way, it is possible to generate an automated program for transcription work that treats data in table data held as separate table data as associated data. In the example of FIG. 23, table data having "customer name" and table data having "mail address" are held as separate table data. Using the table combination function, an automated program is generated for the transcription work that transcribes the "customer name" and the "e-mail address" related to the "customer name" for multiple forms that exist on the same screen. .
(Table stacking function)

In addition, with the vertical stacking function, multiple tables that define the same items can be linked in the column direction. For example, as shown in FIG. 25, two tables having common items (in this case, "customer name", "customer code", and "status") are displayed by executing the table stacking function. 26 can be summarized in one table. As shown in FIG. 23 described above, when the table vertical stacking function is executed for a table in which items that are not common are present, the non-existing items become empty cells as shown in FIG.

By vertically stacking tabular data in this way, it is possible to generate an automated program for transcription work that treats the same type of data held as separate tabular data as data held in the same tabular data. In the example of FIG. 25, the two tables have common column items, so the data in each row is the same type of data. By the table vertical stacking function, it is treated as a single table data as shown in FIG. is generated.
(difference extraction function)

Furthermore, a difference extraction function for obtaining differences between a plurality of tables will be described. In the differential extraction function, for a plurality of tables, among the specific columns of one table, rows that do not exist in the specific columns of other tables are left. For example, there are two tables as shown in FIG. 28. Table 1 on the left records customer name, customer code and status as item names, and Table 2 on the right records customer code and email address. think. A difference extraction function is used to extract only customers who do not have e-mail addresses from these tables. Here, among the customer codes in the specific column of Table 1, rows in which the customer code of Table 2 does not exist are extracted from Table 1. As a result, as shown in FIG. 29, a table listing pseudonymized banks whose customer code does not exist in Table 2 and whose mail address does not exist is created.

In this way, by extracting differences from a plurality of table data, it is possible to generate an automated program related to the transcription work of transcribing the data resulting from narrowing down the data of one table data based on the conditions of another table data. . In the example of FIG. 28, the table on the left is narrowed down based on the table on the right. As a result, it is possible to generate an automated program that transcribes data that does not have a "customer code" corresponding to the table data on the right side among the table data on the left side.
(common part extraction function)

Next, a common portion extracting function for extracting common portions of tables will be described. The common part extraction function leaves only rows existing in specific columns of one table and in specific columns of other tables for a plurality of tables. For example, consider an example of extracting only customers who have mail addresses from the table of FIG. 28 described above. Here, among the customer codes, which are the specific columns of Table 1, the rows in which the customer codes of Table 2 exist are extracted from Table 1. As a result, as shown in FIG. 30, a table is created in which pseudonymous manufacturing companies whose customer codes exist in Table 2 and whose mail addresses exist are listed.

In this way, by extracting common parts from a plurality of table data, as with the difference extraction function, automation related to the posting work of posting the data resulting from narrowing down the data of one table data based on the conditions of another table data Programs can be generated. In the example of FIG. 28, the table on the left is narrowed down based on the table on the right. As a result, it is possible to generate an automated program that transcribes data having a "customer code" corresponding to the table data on the right side among the table data on the left side.

In the examples of FIGS. 23, 25, and 28, two tables are arranged in the horizontal direction, that is, in the row direction. It goes without saying that each table manipulation function such as a table joining function, a table stacking function, a difference extraction function, etc. can be executed for a plurality of tables arranged in a table.
(table filtering function)

The table narrowing function for narrowing down the table filters on a specific column. You can also include multiple column conditions.
(Column addition function)

With the column addition function for adding columns, it is possible to add columns of spreadsheet software including formulas.
(Column deletion function)

The column deletion function is a function for deleting unnecessary columns.

Various operations on columns in the table data described above can also be operations on rows, and conversely, operations on rows can be replaced with operations on columns.
[Embodiment 4: Web scraping]
(Detailed web import settings)

After the element data to be acquired from the web browser WB is specified, the acquisition range specifying unit 22 displays the web data acquisition setting screen 540 . The Web data acquisition setting screen allows the user to select whether or not to acquire element data in the same hierarchy as the element data specified by the user. In addition, when acquiring element data of the same layer, it accepts a setting as to whether to arrange the element data of the same layer in the same column or in the same row. With these settings, the data obtained from the web browser WB is held in the memory unit 15 as tabular data.

FIG. 32 shows a screen when acquisition of element data in the same hierarchy as the element data specified by the user is selected in FIG. When acquisition of element data of the same layer is selected, the acquisition range specifying unit 22 creates a search expression capable of extracting element data of the same layer based on the element data path specified by the user. In FIG. 32, the element data corresponding to the path extracted by the search formula are highlighted.

FIG. 36 is a flowchart executed by the acquisition range setting unit when the acquisition range setting unit sets the acquisition range in step S904 of FIG. 8 when the web browser WB is specified as the transcription source application. Note that this flowchart shows a flowchart executed by the acquisition range setting unit from a state in which a page from which data is to be acquired is displayed on the web browser WB. Activation of the web browser WB and display of a page from which data is to be obtained may be set separately by the operation record setting unit 48 .

In step S5701, the acquisition range setting unit receives designation of element data to be displayed on the web browser WB. In step S5702, the acquisition range setting unit acquires the path of the element data specified by the user on the web browser WB via the extended function of the web browser WB. In step S5703, the acquisition range setting unit highlights the element data corresponding to the acquired path based on the acquired path. FIG. 31 shows a state in which element data specified by the user is highlighted in step S5703. The user can identify the element data specified by him/herself.

In step S5704, the acquisition range setting unit determines whether or not to acquire element data on the same layer as the element data specified by the user in step S5701. When acquiring element data in the same layer as the element data specified by the user, in step S5705, based on the path acquired in step S5702, element data in the same layer as the element data specified by the user in step S5701 is acquired. Generate a search expression using the Xpath of . In this embodiment, the search formula is generated in step S5705 based on the path acquired in step S5702, but the search formula may be generated based on multiple paths. For example, a search formula may be generated based on paths of a plurality of element data by accepting specification of element data recognized as being in the same hierarchy as the element data specified by the user in step S5701. In this case, the probability of generating a search formula that can extract element data on the same level as intended by the user is improved. FIG. 32 shows a state in which element data extracted by the search formula generated in step S5705 is highlighted. If it is determined in step S5704 that the element data on the same layer as the element data designated by the user is not to be obtained, the process advances to step S5708 to finish setting the data acquisition range from the Web browser WB.

When step S5705 is completed, the acquisition range setting unit receives selection of the arrangement direction of element data on the same layer in step S5706. The arrangement direction of the element data selected in step S5706 is whether the element data of the same hierarchy are arranged in the same column when the data acquired from the Web browser WB is held as table data in the memory unit 15. , to be placed on the same line, or reflected in the FIG. 34 shows an aspect of table data held in the memory unit 15 when element data of the same layer are arranged in the same column in step S5706. When the selection in step S5706 is completed, the acquisition range setting unit accepts addition of data to be acquired in step S5707. The data specified in step S5707 are arranged according to the arrangement selected in step S5706 when held in the memory unit 15 as table data. For example, when it is selected in step S5706 that element data of the same layer are arranged in the same column, the data specified in step S5707 is acquired as data arranged in a new column. FIG. 35 shows table data held in the memory unit 15 when element data of the same hierarchy are set to be arranged in the same column in step S5706 and two types of data are added in step S5707. shows an aspect of Depending on the settings in each step, the form of table data shown in FIGS. 34 and 35 may be displayed as a preview of the data to be acquired.

After completing the addition of data in step S5707, the process advances to step S5708 to end the setting of the data acquisition range from the web browser WB.

As described above, according to the present invention according to each embodiment, it is possible to easily create an automation program by guiding the user to acquire data groups that can be acquired as tabular data as tabular data. is. In particular, if the automation target software is spreadsheet software such as Excel, automatic recognition and table range setting can be performed. Also, if the software to be automated is a web browser, it is easy to set the direction of repetition during web scraping. Furthermore, if the software to be automated is another general-purpose program, by displaying a screen where variable names can be set when "Data Acquisition" is selected as the operation content, a name is given to the table data for reference. This has the advantage of making it possible to create automated programs easily.

The automation program creation device, the automation program creation method, the automation program creation program, the computer-readable recording medium, and the recording device of the present invention automate the operation of spreadsheet software such as Excel, web browsers, and other automation target software. It can be suitably used for RPA software that supports the creation of automated programs that

11 Display unit 12 Input unit; 12a Keyboard; 12b Mouse; 12c Touch pad 13 Bus 14 Communication unit 15 Memory unit 16 Storage unit 20 Processor unit 21 General procedure creation unit 22 Acquisition range Designation unit 23: transcription designation unit; 23a: transcription destination designation unit; 23b: transcription unit designation unit; 23c: table operation unit; Execution unit 31 Repeat setting unit 35 Automatic table recognition execution unit 48 Operation record setting unit 110 General procedure creation screen 111 General procedure icon 112 Operation candidate list 113 Add button 114 Operation selection list 115 ``Repeat specified range'' button 117 ... ``Next'' button 118 ... ``Discard and return'' button 119 ... Repeat setting icon 121 ... Activity display column 123 ... ``Extract with automatic table recognition function'' button 124 ... ``Table Specify the range of the calculation software sheet"
125..."Extract by record function" button 130...Spreadsheet software acquisition range specification screen 132...Spreadsheet software import details specification field 138..."Next" button 150...General posting details setting screen 152...Posting details specification field 153... Transcription data specification column; 153b Table data selection column; 153c Transcription unit selection column;
154 Transcription unit preview column 155 Table data reference presence/absence specification column 156 Implementation operation determination column 171 Operation content options 186 Application ID column 191 Operation content options 202 Individually specify cells to be written out column 208 … “Next” button 220 … Activity list screen 221 … Summary activity display field 222 … Summary activity headline part 223 … Summary name 224 … Summary label 225 … Summary activity detail display area 231 … “Select file” button 232 … “Folder Select" button 234 --- "Automatic extraction" button 235 --- "Preview" button 236 --- "Manual extraction" button 237 --- "Setting" button 280 --- Operation record screen 300 --- Operation record screen 301 --- Table Data transfer detail setting window 302 --- Table Input position specification column 303 Table selection column 304 Table movement direction specification column 305 Row insertion specification column 306 Row deletion specification column 307 "Try table movement" button 310 Operation record screen 320 Operation record screen 321 Column name options 358 --- "OK" button 380 --- Table navigation screen 390 --- Table operation screen 513 --- "Open web page" setting column; 515b..."Setting" button 516..."Output setting"column;516b..."Setting" button 540...Output detail setting screen SS...Spreadsheet software WB...Web browser GS...Automation target Software; GS1... Expense adjustment form of expense adjustment application RS... RPA software PC... Computer TW... Translucent window L1... Area corresponding to table UI

Claims (21)

A method for generating an automated program for automating the operation of posting to a second application as a posting destination based on data acquired from a first application as a posting source, comprising:
a step of selecting the first application and the second application and creating a schematic procedure in a schematic procedure creation unit;
a step of selecting a range to be acquired from the data of the first application selected by the outline procedure creation section by an acquisition range specifying section;
a step of holding the data in the range set by the acquisition range specifying unit in a memory unit as tabular data;
a step of designating a posting destination to which the data based on the table data of the second application selected by the outline procedure creating unit is to be posted;
generating an automation program based on the outline procedure created by the outline procedure creating unit, the range set by the acquisition range specifying unit, and the transcription destination;
How to create an automated program, including The method for creating an automated program according to claim 1,
The process of creating an outline procedure is
an operation of obtaining the data from the first application;
A method of creating an automated program including an operation of posting said data to said second application. The method for creating an automated program according to claim 2, further comprising:
A method of creating an automated program, comprising the step of setting a data transcription unit to be transcribed to the second application by a transcription unit designation unit. The method for creating an automated program according to claim 3, further comprising:
A method for creating an automated program, comprising the step of displaying, in a posted data preview section, the posting data to be posted in the second application selected in the outline procedure creating section based on the data posting unit set in the posting unit specifying section. . The automated program creation method according to any one of claims 1 to 4,
The method of creating an automated program, wherein the step of selecting the range to be acquired by the acquisition range specifying unit includes the step of selecting a plurality of data files of the first application. The automated program creation method according to any one of claims 1 to 5,
After holding and fetching the table data in the memory unit, receiving an operation on the table data in the memory unit,
A method for creating an automated program for generating an automated program for transcribing data obtained by performing a process corresponding to an operation on the table data to data to be acquired. The automation program creation method according to claim 6,
the operation on the table data in the memory unit is the setting of a filter;
An automated program creation method, comprising creating an automated program that performs posting by referring to values that match the set filter conditions. The method for creating an automated program according to claim 6 or 7,
the operation on the table data in the memory unit is a horizontal join that joins the first table data and the second table data based on column items common to the table data;
An automated program creation method for creating an automated program that associates and transcribes data included in the first table data and data included in the second table data based on the common column item. The method for creating an automated program according to claim 6 or 7,
The method of creating an automated program, wherein the operation on the table data in the memory unit is a vertical connection for connecting a plurality of table data to table data having all column items of the plurality of table data. The automated program creation method according to any one of claims 6 to 9,
A method for creating an automated program, wherein the operation on table data in the memory section is extraction of differences between a plurality of table data. The automated program creation method according to any one of claims 6 to 9,
A method for creating an automated program, wherein the operation on table data in the memory section is extraction of common items of a plurality of table data. The automated program creation method according to any one of claims 1 to 11,
The automated program creation method, wherein the step of displaying the transcription data formats the acquisition source data into tabular data, and displays the formatted tabular data on the transcription unit preview section. The automated program creation method according to any one of claims 1 to 12, further comprising:
A method for creating an automated program, comprising the step of giving a name to the data of the first application selected by the outline procedure creation section and storing the data in the memory section as the table data. The automated program creation method according to any one of claims 1 to 13,
An automated program creation method in which at least one of line by line, whole, and grouping can be selected as a data transcription unit to be set by the transcription unit specifying unit. The method for creating an automated program according to claim 14,
A method for creating an automated program, wherein the transcription data displayed in the transcription unit preview section is displayed in a tabular form, and a frame shape corresponding to the set data transcription unit is displayed superimposed on the tabular form. The automated program creation method according to any one of claims 1 to 15,
the first application is a web browser;
A method of creating an automated program in which the range of data selected by the acquisition range specifying unit is data in the same hierarchy as the data of the specific range specified in the html file. The automated program creation method according to any one of claims 1 to 16,
the first application is a web browser;
A method of creating an automated program in which, when the range of data selected by the acquisition range specifying unit is divided and displayed on a plurality of pages, the data of the specific range specified in the html file and the corresponding data of the next page. An automation program creation program for generating an automation program for automating the operation of posting to a second application of a posting destination based on data acquired from a first application of a posting source,
a function of selecting the first application and the second application and creating a schematic procedure in a schematic procedure creation unit;
a function of selecting a range to be acquired from the data of the first application selected by the outline procedure creating section by an acquisition range specifying section;
a function of holding the data in the range set by the acquisition range specifying unit in a memory unit as tabular data;
a function of specifying a posting destination to which the data based on the table data of the second application selected by the outline procedure creating unit is to be posted;
a function of generating an automation program based on the outline procedure created by the outline procedure creating unit, the range set by the acquisition range specifying unit, and the transcription destination;
Automation program creation program for realizing on a computer. A computer-readable recording medium or a device storing the program according to claim 18. An automated program creation device that automates the operation of posting to a second application as a posting destination based on data acquired from a first application as a posting source,
a schematic procedure creation unit for selecting the first application and the second application and creating a schematic procedure;
an acquisition range specifying unit for selecting a range to be acquired from the data of the first application selected by the outline procedure creation unit;
a memory unit that holds the data in the range set by the acquisition range specifying unit as tabular data;
a posting destination specifying unit for specifying a posting destination to which data based on the table data of the second application selected by the outline procedure creating unit is to be posted;
Automation program generation for generating an automation program based on the outline procedure created by the outline procedure creating unit, the range set by the acquisition range specifying unit, and the posting destination specified by the posting destination specifying unit. Department and
an automated programming device comprising: An automated program creation device that automates the operation of posting to a second application as a posting destination based on data acquired from a first application as a posting source,
an operation of obtaining the data from the first application;
a posting operation of said data to said second application;
let me choose
causing a user to select a range of data to be obtained from data included in an arbitrary data file of the selected first application;
setting a data posting unit for posting the data in the selected range to the second application as source data in tabular format;
displaying the posting data to be posted to the selected second application based on the set data posting unit;
generating an automated program for transcribing the set range of source data in tabular format of the selected first application to the selected second application based on the set data transcription unit a processor unit that
a memory unit that holds the set acquisition source data in the tabular form as tabular data;
an automated programming device comprising:

Images