CN115270038A - Method and system for acquiring webpage similar elements of RPA system - Google Patents

Abstract

The invention discloses a method and a system for acquiring webpage similar elements of an RPA system, and belongs to the technical field of robot process automation. In the automatic process configuration stage, two similar webpage elements are selected and stored in a first webpage element selector and a second webpage element selector respectively; extracting a common mode of elements contained in the two webpage element selectors according to the obtained first webpage element selector and the second webpage element selector, and outputting a common mode list in a Json object form; and acquiring a DOM structure tree of a webpage interface by using an RPA system, traversing the DOM tree from bottom to top by adopting an breadth-first search algorithm according to the acquired common mode list of the webpage elements, carrying out mode matching on each node element in the DOM tree and the common mode list of the webpage elements, and storing the node elements in a similar element list if the matching is the same. The method and the device can realize the acquisition of the similar elements of the webpage, and further can perform batch operation on the similar elements subsequently.

Description

Method and system for acquiring webpage similar elements of RPA system

Technical Field

The invention relates to the technical field of robot Process Automation (RPA for short), in particular to a method for acquiring similar elements of a webpage.

Background

RPA can automate some rule-based, largely repetitive flow tasks in human work. People can configure task flows through the RPA system, and the RPA robot can automatically process according to the configured flows. In these flow tasks, a considerable proportion of tasks are to perform operations on the web page, such as clicking a hyperlink in the web page or acquiring a text and a picture of a block in the web page.

Therefore, the acquisition and accurate positioning of web page elements is an important technique for RPA. Especially, when people configure the process, some similar elements in the web page need to be processed. But may differ at the level of similar elements or in tag names. It is not possible to locate other similar elements simply by means of hierarchical equality or tag name equality, etc.

Disclosure of Invention

In view of the above problems, the present invention is directed to a method for acquiring similar elements of a RPA system web page.

In order to achieve the above object, the present invention provides the following technical solutions, which specifically include the following steps:

in a first aspect, the invention provides a method for acquiring similar elements of a webpage of an RPA system, which comprises the following steps:

s1: in the automatic process configuration stage, two similar webpage elements are selected and stored in a first webpage element selector and a second webpage element selector respectively;

s2: extracting a common mode of elements contained in the two webpage element selectors according to the first webpage element selector and the second webpage element selector obtained in the step S1, and outputting a common mode list in a Json object mode;

s3: and (3) acquiring a DOM structure tree of the webpage interface by using an RPA system, traversing the DOM tree from bottom to top by adopting an breadth-first search algorithm according to the webpage element common mode list obtained in the step (S2), carrying out mode matching on each node element in the DOM tree and the webpage element common mode list, and storing the node elements into a similar element list if the matching is the same.

In a second aspect, the present invention provides a system for acquiring similar elements in a web page of an RPA system, including:

a first web page element selection module for storing a first web page element;

a second web page element selection module for storing a second web page element that is similar to the first web page element;

a common pattern extraction module for extracting common patterns of elements stored in the first web page element selection module and the second web page element selection module, and outputting a common pattern list in the form of a Json object;

and the mode matching module is used for acquiring a DOM structure tree of the webpage interface, traversing the DOM tree from bottom to top by adopting an breadth-first search algorithm according to the webpage element common mode list acquired by the common mode extraction module, performing mode matching on each node element in the DOM tree and the webpage element common mode list, and storing the node elements into a similar element list if the matching is the same.

In the application of the RPA system, a series of operations are often required to be performed on web page elements, and the operations performed on similar elements of a web page are often consistent. The method and the device can realize the acquisition of the similar elements of the webpage, and further can perform batch operation on the similar elements subsequently, rather than manually selecting different similar elements and configuring corresponding operation flows.

Drawings

The accompanying drawings, which are included to provide a further understanding of the invention and are incorporated in and constitute a part of this specification, illustrate embodiments of the invention and together with the description serve to explain the invention and not to limit the invention.

Fig. 1 is a flowchart illustrating a method for acquiring similar elements of a web page in an RPA system according to an embodiment of the present invention;

FIG. 2 is a diagram illustrating properties of target elements in a DOM tree in accordance with an embodiment of the present invention;

fig. 3 is a schematic diagram illustrating a system for acquiring similar elements of a web page in an RPA system according to an embodiment of the present invention;

fig. 4 is a schematic structural diagram of an electronic device terminal of a method for acquiring similar elements in a web page of an RPA system according to an embodiment of the present invention.

Detailed Description

In order to make the objects, technical solutions and advantages of the present application more apparent, the technical solutions of the present application will be described in detail and completely with reference to the following specific embodiments of the present application and the accompanying drawings. It should be apparent that the described embodiments are only some of the embodiments of the present application, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present application.

The invention provides a method for acquiring similar elements of a webpage of an RPA system, which comprises the following steps:

s1: in the automatic process configuration stage: two similar webpage elements are selected autonomously and stored in a first webpage element selector htmlSector 1 and a second webpage element selector htmlSector 2 respectively, and meanwhile, an RPA system can automatically acquire a DOM tree of a webpage, and FIG. 2 is a schematic diagram of the attribute of a target element in the DOM tree shown in the embodiment.

In this embodiment, in the process configuration stage of the RPA system, two web page elements need to be manually selected as similar elements according to task requirements. For example, the similar elements of the web page selected in this embodiment are titles of two articles in the web page.

S2: and extracting a common mode of elements contained in the two web page element selectors according to the first web page element selector and the second web page element selector obtained in the step S1, and outputting a common mode list in a Json object mode.

In this embodiment, the following functions will be performed by the self-developed RPA system itself.

S2-1: judging the number of elements in the first webpage element selector and the second webpage element selector, if any one of the first webpage element selector and the second webpage element selector is empty, returning error information and reporting an error, if the number of the elements in the two selectors is not equal, indicating that the webpage elements contained in the two selectors are not similar elements, returning error information and reporting an error; if the number of the elements in the two selectors is equal, the step S2-2 is carried out;

s2-2: and taking the elements in the element selector as nodes, synchronously traversing the selector nodes in the two selectors according to the positive sequence of the element indexes, extracting the common mode of the two selector nodes, and adding the common mode into a common mode list. The method specifically comprises the following steps:

s2-2-1: traversing the property _ k of the node1_ i in the first webpage element selector, and selecting the node2_ j with the node _ i.property _ k.name from the nodes of the second webpage element selector; the node1_ i represents the ith node in the first webpage element selector, the property _ k represents the kth attribute, the node1_ i, the property _ k.name represents the name of the kth attribute of the ith node in the first webpage element selector, and the node2_ j represents the jth node in the second webpage element selector;

in this step, the node set in the first web page element selector is represented as [ node1_1, node1 \2, …, node1_ n ], where n is the number of nodes in the web page element selector; each node1_ i (i =1,2, …, n) contains several attributes, denoted as [ property _1, property _2, …, property _ K ], where K is the number of attributes; the structure of each property _ K (K =1,2, …, K) is represented as { Name _ 1.

Similarly, the node set in the second web page element selector is represented as [ node2_1, node2 \2, …, node2_ n ], n is the number of nodes in the web page element selector; the attributes of each node2_ i and the structure thereof are expressed in the same manner as above.

By selecting a property _ k in a certain node1_ i in the first webpage element selector, whether a node2_ j with the same property exists in the second webpage element selector is checked, namely whether a node _ i. And if the attribute exists, entering S2-2-2, otherwise, selecting the next attribute property _ k +1 in the node1_ i in the first webpage element selector, and repeating the operation.

S2-2-2: and combining the attribute values of the two nodes node1_ i and node2_ j according to the attribute matching mode to obtain an attribute combination value. The method specifically comprises the following steps:

s2-2-2-1: if the attribute matching rules of the node1_ i and the node2_ j are the same and the attribute values are also the same, directly returning the attribute values as attribute combination values; if the matching rules of the two nodes are the same and the attribute values are different, returning NULL as an attribute merging value; if the matching rules of the two nodes are different, converting the two nodes into regular matching, converting the attribute values of the two nodes into regular values, and entering the step S2-2-2-2;

s2-2-2-2: judging whether the regular values of the two nodes are equal, if so, directly returning the regular matching mode and the regular value as an attribute merging value; and if the two node attribute values are not equal, respectively adding a regular symbol to the original attribute values of the two nodes to obtain two processed character strings, and returning a result obtained by adding the two character strings as an attribute merging value.

S2-2-3: synthesizing the attribute matching mode and the attribute merging value into a Jtoken object, and adding the attribute names property _ k.name and JToken serving as a Json object into the public mode list.

S3: and traversing the DOM tree from bottom to top by adopting an breadth-first search algorithm according to the webpage element common mode list obtained in the step S2, carrying out mode matching on each node element in the DOM tree and the webpage element common mode list, and storing the node elements into a similar element list if the matching is the same. The method specifically comprises the following steps:

s3-1: judging whether the current node element in the DOM tree is a < body > or < html > element, if so, entering S3-3, otherwise, entering S3-2;

s3-2: setting the use attribute value of the current node element in the DOM tree to true, performing pattern matching with the public pattern list obtained in the step S2, and if matching is successful, adding the current node element in the DOM tree to the similar element list; returning to the step S3-1;

s3-3: a list of similar elements is returned.

Corresponding to the foregoing embodiment of a method for acquiring similar elements in a web page of an RPA system, the present application further provides an embodiment of a system for acquiring similar elements in a web page of an RPA system, as shown in fig. 3, including:

a first web page element selection module for storing a first web page element;

a second web page element selection module for storing a second web page element that is similar to the first web page element;

a common pattern extraction module for extracting common patterns of elements stored in the first web page element selection module and the second web page element selection module, and outputting a common pattern list in the form of a Json object;

and the mode matching module is used for acquiring a DOM structure tree of the webpage interface, traversing the DOM tree from bottom to top by adopting an breadth-first search algorithm according to the webpage element common mode list acquired by the common mode extraction module, performing mode matching on each node element in the DOM tree and the webpage element common mode list, and storing the node elements into a similar element list if the matching is the same.

In this embodiment, the common mode extraction module includes:

the first judging module is used for judging the number of elements in the first webpage element selecting module and the second webpage element selecting module, if any one of the elements is empty, returning error information and reporting an error, and if the number of the elements in the two selecting modules is not equal, indicating that the webpage elements contained in the two selecting modules are not similar elements, returning error information and reporting an error; if the number of the elements in the two selection modules is equal, entering a second judgment module;

and the second judging module is used for regarding the elements in the element selecting module as nodes, synchronously traversing the nodes in the two selecting modules according to the positive sequence of the element indexes, extracting the common mode of the nodes of the two selecting modules and adding the common mode into the common mode list.

In this embodiment, the second determining module includes:

the node selection module is used for traversing the property _ k of the node1_ i in the first webpage element selection module and selecting the node2_ j with the node _ i.property _ k.name from the nodes in the second webpage element selection module; wherein, node1_ i represents the ith node in the first webpage element selection module, property _ k represents the kth attribute, node1_ i.property _ k.name represents the name of the kth attribute of the ith node in the first webpage element selection module, and node2_ j represents the jth node in the second webpage element selection module;

the attribute value merging module is used for merging the attribute values of the two nodes 1_ i and 2_ j selected in the node selection module according to the attribute matching mode to obtain an attribute merged value;

and the public mode list adding module is used for synthesizing the attribute matching mode and the attribute merging value into a Jtoken object and adding the attribute names property _ k.name and JToken into the public mode list as a Json object.

In this embodiment, the attribute value merging module includes:

an attribute matching rule judging module, configured to judge the attribute matching rules and attribute values of the two nodes node1_ i and node2_ j selected in the node selecting module, and if the attribute matching rules of the nodes node1_ i and node2_ j are the same and the attribute values are also the same, directly return the attribute values as attribute merged values; if the matching rules of the two nodes are the same, but the attribute values are different, returning NULL as an attribute merging value; if the matching rules of the two nodes are different, converting the matching rules into regular matching, converting the attribute values of the two nodes into regular values, and entering a regular value matching module;

the regular value matching module is used for judging whether the regular values of the two nodes output by the attribute matching rule judging module are equal, and if so, directly returning the regular matching mode and the regular values as attribute merging values; and if the two node attribute values are not equal, respectively adding a regular symbol to the original attribute values of the two nodes to obtain two processed character strings, and returning a result obtained by adding the two character strings as an attribute merging value.

In this embodiment, the pattern matching module includes:

the DOM structure tree acquisition module is used for acquiring a DOM structure tree of the webpage interface;

the DOM tree node traversing module is used for traversing the DOM tree from bottom to top by adopting a breadth-first search algorithm, judging whether a current node element in the DOM tree is a < body > or < html > element, if so, entering the similar element list output module, and otherwise, entering the DOM tree node matching module;

the DOM tree node matching module is used for setting the use attribute value of the current node element in the DOM tree to be true, performing mode matching with the public mode list obtained by the public mode extraction module, and if matching is successful, adding the current node element in the DOM tree to the similar element list;

and the similar element list output module is used for returning the final similar element list.

With regard to the system in the above embodiment, the specific manner in which each module performs the operation has been described in detail in the embodiment related to the method, and will not be elaborated here.

Embodiments of the system of the present invention may be applied to any data processing capable device, which may be a device or apparatus such as a computer. The system embodiments may be implemented by software, or by hardware, or by a combination of hardware and software. The software implementation is taken as an example, and as a logical device, the device is formed by reading corresponding computer program instructions in the nonvolatile memory into the memory for running through the processor of any device with data processing capability. In terms of hardware, as shown in fig. 4, for a hardware structure diagram provided in this embodiment, in addition to the processor, the memory, the network interface, and the nonvolatile memory shown in fig. 4, any device with data processing capability where a system is located in the embodiment may also include other hardware according to the actual function of the any device with data processing capability, which is not described again.

The embodiment of the invention also provides a computer readable storage medium, on which a program is stored, and when the program is executed by a processor, the method for acquiring the similar elements of the webpage of the RPA system is realized.

The computer readable storage medium may be an internal storage unit, such as a hard disk or a memory, of any data processing capability device described in any of the foregoing embodiments. The computer readable storage medium may also be any external storage device of a device with data processing capabilities, such as a plug-in hard disk, a Smart Media Card (SMC), an SD Card, a Flash memory Card (Flash Card), etc. provided on the device. Further, the computer readable storage medium may include both an internal storage unit and an external storage device of any data processing capable device. The computer-readable storage medium is used for storing the computer program and other programs and data required by the arbitrary data processing capable device, and may also be used for temporarily storing data that has been output or is to be output.

The above-mentioned embodiments only express several embodiments of the present application, and the description thereof is more specific and detailed, but not construed as limiting the scope of the patent protection. It should be noted that, for a person skilled in the art, several variations and modifications can be made without departing from the concept of the present application, which falls within the scope of protection of the present application. Therefore, the protection scope of the present application shall be subject to the appended claims.

Claims (10)

1. A method for acquiring similar elements of a webpage of an RPA system is characterized by comprising the following steps:

s1: in the automatic process configuration stage, two similar webpage elements are selected and stored in a first webpage element selector and a second webpage element selector respectively;

s2: extracting a common mode of elements contained in the two webpage element selectors according to the first webpage element selector and the second webpage element selector obtained in the step S1, and outputting a common mode list in a Json object mode;

s3: and (3) acquiring a DOM structure tree of the webpage interface by using an RPA system, traversing the DOM tree from bottom to top by adopting an breadth-first search algorithm according to the webpage element common mode list obtained in the step (S2), carrying out mode matching on each node element in the DOM tree and the webpage element common mode list, and storing the node elements into a similar element list if the matching is the same.

2. The RPA system web page similar element acquiring method according to claim 1, wherein the step S2 comprises the steps of:

s2-1: judging the number of elements in the first webpage element selector and the second webpage element selector, if any one of the first webpage element selector and the second webpage element selector is empty, returning error information and reporting an error, and if the number of the elements in the two selectors is not equal, indicating that the webpage elements contained in the two selectors are not similar elements, returning error information and reporting an error; if the number of the elements in the two selectors is equal, the step S2-2 is carried out;

s2-2: and taking the elements in the element selector as nodes, synchronously traversing the selector nodes in the two selectors according to the positive sequence of the element indexes, extracting the common mode of the two selector nodes, and adding the common mode into a common mode list.

3. The RPA system web page similar element acquiring method according to claim 2, wherein the extracting of the common mode of the two selector nodes in step S2-2 is specifically:

s2-2-1: traversing the property _ k of the node1_ i in the first webpage element selector, and selecting the node2_ j with the node _ i, property _ k.name from the node of the second webpage element selector; wherein, node1_ i represents the ith node in the first web page element selector, property _ k represents the kth attribute, node1_ i.property _ k.name represents the name of the kth attribute of the ith node in the first web page element selector, and node2_ j represents the jth node in the second web page element selector;

s2-2-2: according to the attribute matching mode, combining the attribute values of the two nodes node1_ i and node2_ j to obtain an attribute combination value;

s2-2-3: synthesizing the attribute matching mode and the attribute merging value into a Jtoken object, and adding the attribute names property _ k.name and JToken serving as a Json object into the public mode list.

4. The method for acquiring similar elements in a web page of an RPA system according to claim 3, wherein the method for obtaining the attribute combination value in step S2-2-2 comprises:

s2-2-2-1: if the attribute matching rules of the node1_ i and the node2_ j are the same and the attribute values are also the same, directly returning the attribute values as attribute combination values; if the matching rules of the two nodes are the same, but the attribute values are different, returning NULL as an attribute merging value; if the matching rules of the two nodes are different, converting the two nodes into regular matching, converting the attribute values of the two nodes into regular values, and entering the step S2-2-2-2;

s2-2-2-2: judging whether the regular values of the two nodes are equal, if so, directly returning the regular matching mode and the regular value as an attribute combination value; and if the two node attribute values are not equal, respectively adding a regular symbol to the original attribute values of the two nodes to obtain two processed character strings, and returning a result obtained by adding the two character strings as an attribute merging value.

5. The RPA system web page similar element acquisition method according to claim 1, wherein the step S3 of performing pattern matching between each node in the DOM tree and the common pattern of the web page elements comprises:

s3-1: judging whether the current node element in the DOM tree is a < body > or < html > element, if so, entering S3-3, otherwise, entering S3-2;

s3-2: setting the use attribute value of the current node element in the DOM tree to true, performing pattern matching with the public pattern list obtained in the step S2, and if matching is successful, adding the current node element in the DOM tree to the similar element list; returning to the step S3-1;

s3-3: a list of similar elements is returned.

6. A system for acquiring similar elements of a webpage of an RPA system is characterized by comprising:

a first web page element selection module for storing a first web page element;

a second web page element selection module for storing a second web page element that is similar to the first web page element;

a common pattern extraction module for extracting common patterns of elements stored in the first web page element selection module and the second web page element selection module, and outputting a common pattern list in the form of a Json object;

and the mode matching module is used for acquiring a DOM structure tree of the webpage interface, traversing the DOM tree from bottom to top by adopting an breadth-first search algorithm according to the webpage element common mode list acquired by the common mode extraction module, performing mode matching on each node element in the DOM tree and the webpage element common mode list, and storing the node elements into a similar element list if the matching is the same.

7. The RPA system web page similarity element acquisition system according to claim 6, wherein said common schema extraction module comprises:

the first judging module is used for judging the number of elements in the first webpage element selecting module and the second webpage element selecting module, if any one of the elements is empty, returning error information and reporting an error, and if the number of the elements in the two selecting modules is not equal, indicating that the webpage elements contained in the two selecting modules are not similar elements, returning error information and reporting an error; if the number of the elements in the two selection modules is equal, entering a second judgment module;

and the second judging module is used for regarding the elements in the element selecting module as nodes, synchronously traversing the nodes in the two selecting modules according to the positive sequence of the element indexes, extracting the common mode of the nodes of the two selecting modules and adding the common mode into the common mode list.

8. The RPA system web page similar element acquiring system according to claim 7, wherein said second determining module comprises:

the node selection module is used for traversing the property _ k of the node1_ i in the first webpage element selection module and selecting the node2_ j with the node _ i.property _ k.name from the nodes in the second webpage element selection module; wherein, node1_ i represents the ith node in the first webpage element selection module, property _ k represents the kth attribute, node1_ i.property _ k.name represents the name of the kth attribute of the ith node in the first webpage element selection module, and node2_ j represents the jth node in the second webpage element selection module;

the attribute value merging module is used for merging the attribute values of the two nodes 1_ i and 2_ j selected in the node selection module according to the attribute matching mode to obtain an attribute merged value;

and the public pattern list adding module is used for synthesizing the attribute matching patterns and the attribute merging values into a Jtoken object and adding the attribute names property _ k.name and JToken into the public pattern list as a Json object.

9. The RPA system web page similar element acquiring system according to claim 8, wherein said attribute value merging module comprises:

the attribute matching rule judging module is used for judging the attribute matching rules and the attribute values of the two nodes 1_ i and 2_ j selected in the node selecting module, and if the attribute matching rules of the nodes 1_ i and 2_ j are the same and the attribute values are also the same, directly returning the attribute values as the attribute merging values; if the matching rules of the two nodes are the same, but the attribute values are different, returning NULL as an attribute merging value; if the matching rules of the two nodes are different, converting the matching rules into regular matching, converting the attribute values of the two nodes into regular values, and entering a regular value matching module;

the regular value matching module is used for judging whether the regular values of the two nodes output by the attribute matching rule judging module are equal, and if so, directly returning the regular matching mode and the regular values as attribute merging values; and if the two node attribute values are not equal, respectively adding a regular symbol to the original attribute values of the two nodes to obtain two processed character strings, and returning a result obtained by adding the two character strings as an attribute merging value.

10. The RPA system web page similarity element acquisition system according to claim 9, wherein said pattern matching module comprises:

the DOM structure tree acquisition module is used for acquiring a DOM structure tree of the webpage interface;

the DOM tree node traversing module is used for traversing the DOM tree from bottom to top by adopting a breadth-first search algorithm, judging whether a current node element in the DOM tree is a < body > or < html > element, if so, entering the similar element list output module, and otherwise, entering the DOM tree node matching module;

the DOM tree node matching module is used for setting the use attribute value of the current node element in the DOM tree to be true, performing mode matching with the common mode list obtained by the common mode extraction module, and if the matching is successful, adding the current node element in the DOM tree to the similar element list;

and the similar element list output module is used for returning the final similar element list.

Images