CN113885855A - RPA instruction intelligent recording method based on input following - Google Patents

Abstract

The invention discloses an RPA instruction intelligent recording method based on input following, which comprises an RPA robot, and comprises the following steps: s1, recording is started: synchronously monitoring and following the operation process of two input ends of a mouse and a keyboard on an operation page through an RPA robot; s2, recording operation: sequentially acquiring elements of mouse operation according to the operation of each input end, and recording events triggered to the elements and contents input by a keyboard; s3, command generation: combining the mouse operation and the record input by the keyboard, generating a corresponding instruction for each record, and arranging the instructions into an instruction set according to the operation sequence. The invention can enable a user to actively finish the automatic generation of the instruction through the RPA robot, can enable the instruction set to reliably operate, and effectively reduces the RPA instruction building difficulty and the use threshold.

Description

RPA instruction intelligent recording method based on input following

Technical Field

The invention relates to the technical field of RPA (resilient packet access), in particular to an RPA instruction intelligent recording method based on input following.

Background

In order to liberate manpower on regular and repetitive mechanical work, a series of flow operations of a human on a computer are completed by replacing manual simulation with a computer, and a robot flow automation technology is derived gradually. The Robot Process Automation (RPA) technology is to use Automation application software as a virtual labor force to assist office staff to Process a large amount of repeated flow work based on rules according to a preset program and an existing system.

Currently, the RPA technology has been widely used by virtue of the advantages of high automation degree, high precision and the like. Although the RPA does have a strong ability to assist office workers in replacing manpower in some regular-based and repeated flow work, the flow of the RPA operation needs to be preset and established by operators in advance, and the operators are required to have necessary logical thinking and programming thinking abilities, so that the RPA can be used well.

Therefore, how to let office personnel without programming ability use RPA; how to make RPA easier to get to the hands and have lower use threshold; and how to make the RPA serve a wider range of practitioners, become a problem that needs to be solved urgently at present.

Disclosure of Invention

The invention aims to provide an RPA instruction intelligent recording method based on input following. The invention can help the RPA robot to automatically generate the RPA instruction set, reduce the difficulty of constructing the RPA instruction set and the use threshold, and simplify the RPA operation process.

In order to solve the technical problems, the technical scheme provided by the invention is as follows: an RPA instruction intelligent recording method based on input following comprises an RPA robot and comprises the following steps:

s1, recording is started: synchronously monitoring and following the operation process of two input ends of a mouse and a keyboard on an operation page through an RPA robot;

s2, recording operation: sequentially acquiring elements of mouse operation according to the operation of each input end, and recording events triggered to the elements and contents input by a keyboard;

s3, command generation: combining the mouse operation and the keyboard input record, generating a corresponding instruction for each record, and arranging the instructions into an instruction set according to the operation sequence.

In the above RPA instruction intelligent recording method based on input following, the operation page includes a web page, a desktop, and an application software window page.

In the method for intelligently recording the RPA instruction based on the input following, the element is any one instance which can be picked up in the operation page.

Examples of the aforementioned RPA instruction smart recording method based on input following include buttons, input boxes, dialog boxes, and Tab pages.

In the foregoing RPA instruction intelligent recording method based on input following, in step S2, the recording operation process is specifically as follows:

s2.1, firstly, pausing mouse movement according to the click coordinates, and acquiring a window of a process under the current coordinates and elements to which the coordinates on the window belong;

s2.2, monitoring mouse operation and recording an event triggered to the element after the mouse operation; s2.3, monitoring keyboard operation and recording the content input by the keyboard;

s2.4, the step S2.2 and the step S2.3 are used as a record together, and the record is stored in a visual list bar;

s2.5, resuming the mouse to move to the state to be operated after completing one record;

and S2.6, repeating the steps S2.1-S2.5 until all the operations are finished.

Compared with the prior art, the invention synchronously monitors and follows the operation process of two input ends of a mouse and a keyboard on an operation page through the recording capability of the RPA robot; then, sequentially acquiring elements of mouse operation according to the operation of each input end, and recording events triggered to the elements and contents input by a keyboard; combining the mouse operation and the keyboard input record, generating a corresponding instruction for each record, and then arranging the records according to the operation sequence to form an instruction set. Therefore, the invention can reliably and actively finish the automatic generation of the instruction, and effectively reduce the RPA instruction building difficulty and the use threshold. The invention can help the user to automatically generate the RPA instruction set by using the RPA robot convenient ring only by clicking a mouse, double clicking and inputting a keyboard, and the instruction set can stably and reliably run, thereby really reducing the construction difficulty and the use threshold of the RPA instruction set, simplifying the RPA operation process and simultaneously improving the usability of the RPA. The invention can enable the user to quickly start RPA process construction, and thus understand the concept of RPA, and bring more convenient and intuitive user experience while reducing the operation and learning threshold of RPA.

Drawings

FIG. 1 is a schematic view of an RPA robot of the present invention;

FIG. 2 is a schematic diagram of the present invention when using the RPA robot smart recording function;

FIG. 3 is a diagram illustrating the generation of an instruction set at an RPA robot according to the present invention.

Detailed Description

The present invention will be further described with reference to the following examples and drawings, but the present invention is not limited thereto.

Example (b): an RPA instruction intelligent recording method based on input following is shown in fig. 1 and comprises an RPA robot, wherein the RPA robot comprises an instruction set, a process designer, a result debugger, a process manager, a global variable manager and a toolbar.

Instruction set 1 in fig. 1: the RPA command storage management system is used for storing and managing RPA commands, and a user can select a required command to be added to a flow designer in a double-click or drag mode to carry out free design.

Flow designer 2 in fig. 1: and providing a visual RPA flow editing platform for a user.

Debugger 3 of result in fig. 1: the program debugging system is used for displaying program error information, log information and other debugging data.

The flow manager 4 in fig. 1: and managing flow files such as RPA flows, Python scripts and the like.

Global variable manager 5 in fig. 1: managing global variables.

Toolbar 6 in fig. 1: the method comprises the functions of flow arrangement, debugging, intelligent recording and the like.

The RPA robot is used for carrying out the intelligent recording of the RPA instruction based on the input following, and the steps of the RPA robot are as follows in combination with the step shown in figure 2:

s1, recording is started: synchronously monitoring and following the operation process of two input ends of a mouse and a keyboard on an operation page through an RPA robot; the operation page comprises but is not limited to a webpage, a desktop and an application software window page; in the embodiment, as the mouse moves, a process window under the current coordinate and a minimum unit element (such as a button, an input box, a hyperlink or a character) to which the coordinate on the window belongs are identified in advance according to the coordinate at which the mouse stops; meanwhile, the operation of the mouse and the keyboard is monitored in real time; as shown in fig. 2, it should be noted that after recording is started, the operation of the "smart recording" window is shielded, and the operation of the RPA itself is prevented from being recorded;

s2, recording operation: sequentially acquiring elements of mouse operation according to the operation of each input end, and recording events triggered to the elements and contents input by a keyboard; the element is any one instance which can be grabbed in the operation page, including but not limited to a button, an input box, a dialog box and a Tab page, and the specific process is as follows:

s2.1, firstly, pausing mouse movement according to the click coordinates, and acquiring a window of a process under the current coordinates and elements to which the coordinates on the window belong; the embodiment can also be used for carrying out more operations on the clicked and captured elements through the element operation menu, wherein the operations comprise back-driving element information, obtaining similar element information, inputting, moving a mouse to the position, clicking, checking, selecting a drop-down box, clicking and processing a popup box, waiting for the elements, capturing a screenshot and the like, so that the use scene is diversified and the records are enriched;

s2.2, monitoring mouse operation, distinguishing click or double click, and recording an event which is triggered to the element after the mouse operation; invalid mouse operation needs to be avoided, and invalid mouse operation does not need to be recorded

S2.3, monitoring keyboard operation and recording the content input by the keyboard; invalid keyboard operation is avoided, and invalid keyboard operation is not recorded

S2.4, the step S2.2 and the step S2.3 are used as a record together, and the record is stored in a list column in a visualized manner;

s2.5, resuming the mouse to move to the state to be operated after completing one record;

and S2.6, repeating the steps S2.1-S2.5 until all the operations are finished.

S3, command generation: as shown in fig. 3, combining the mouse operation and the keyboard input record, generating a corresponding instruction for each record, and arranging the instructions into an instruction set according to the operation sequence.

The RPA instruction intelligent recording method based on input following provided by the embodiment enables RPA to be very simple to use, only mouse clicking and keyboard inputting are needed to finish the construction of the RPA instruction set, the problem that a user is difficult to operate under the condition of not understanding the RPA instruction construction is solved, the RPA usability is improved, the user is indirectly helped to understand RPA services, and the intelligent and automatic characteristics of the RPA are highlighted to a certain degree.

Claims (5)

1. An RPA instruction intelligent recording method based on input following comprises an RPA robot and is characterized in that: the method comprises the following steps:

s1, recording is started: synchronously monitoring and following the operation process of two input ends of a mouse and a keyboard on an operation page through an RPA robot;

s2, recording operation: sequentially acquiring elements of mouse operation according to the operation of each input end, and recording events triggered to the elements and contents input by a keyboard;

s3, command generation: combining the mouse operation and the keyboard input record, generating a corresponding instruction for each record, and arranging the instructions into an instruction set according to the operation sequence.

2. The RPA instruction intelligent recording method based on input following according to claim 1, characterized in that: the operation page comprises a webpage, a desktop and an application software window page.

3. The RPA instruction intelligent recording method based on input following according to claim 1, characterized in that: the element is any instance which can be picked up in the operation page.

4. The RPA instruction intelligent recording method based on input following according to claim 3, wherein: examples include buttons, input boxes, dialog boxes, and Tab pages.

5. The RPA instruction intelligent recording method based on input following according to claim 1, characterized in that: in step S2, the recording operation is specifically performed as follows:

s2.1, firstly, pausing mouse movement according to the click coordinates, and acquiring a window of a process under the current coordinates and elements to which the coordinates on the window belong;

s2.2, monitoring mouse operation and recording an event triggered to the element after the mouse operation;

s2.3, monitoring keyboard operation and recording the content input by the keyboard;

s2.4, the step S2.2 and the step S2.3 are used as a record together, and the record is stored in a visual list bar;

s2.5, resuming the mouse to move to the state to be operated after completing one record;

and S2.6, repeating the steps S2.1-S2.5 until all the operations are finished.

Images