CN117112668A - ETL-based RPA flow management method and system - Google Patents
ETL-based RPA flow management method and system Download PDFInfo
- Publication number
- CN117112668A CN117112668A CN202311073017.5A CN202311073017A CN117112668A CN 117112668 A CN117112668 A CN 117112668A CN 202311073017 A CN202311073017 A CN 202311073017A CN 117112668 A CN117112668 A CN 117112668A
- Authority
- CN
- China
- Prior art keywords
- rpa
- flow
- data
- access right
- newly
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000007726 management method Methods 0.000 title claims abstract description 95
- 238000000034 method Methods 0.000 claims abstract description 118
- 230000008569 process Effects 0.000 claims abstract description 99
- 230000008859 change Effects 0.000 claims abstract description 69
- 238000012795 verification Methods 0.000 claims abstract description 56
- 238000005457 optimization Methods 0.000 claims abstract description 43
- 230000002093 peripheral effect Effects 0.000 claims abstract description 32
- 238000012545 processing Methods 0.000 claims abstract description 29
- 230000006870 function Effects 0.000 claims description 38
- 238000006243 chemical reaction Methods 0.000 claims description 37
- 238000012360 testing method Methods 0.000 claims description 33
- 238000004364 calculation method Methods 0.000 claims description 21
- 230000011218 segmentation Effects 0.000 claims description 20
- 238000012986 modification Methods 0.000 claims description 13
- 230000004048 modification Effects 0.000 claims description 13
- 238000013515 script Methods 0.000 claims description 12
- 238000005516 engineering process Methods 0.000 claims description 10
- 238000010276 construction Methods 0.000 claims description 4
- 230000000694 effects Effects 0.000 abstract description 5
- 230000008439 repair process Effects 0.000 abstract description 4
- 238000013075 data extraction Methods 0.000 description 4
- 238000013461 design Methods 0.000 description 4
- 238000010586 diagram Methods 0.000 description 4
- 238000013475 authorization Methods 0.000 description 3
- 238000011161 development Methods 0.000 description 2
- 230000018109 developmental process Effects 0.000 description 2
- 238000007689 inspection Methods 0.000 description 2
- 238000012544 monitoring process Methods 0.000 description 2
- 230000000007 visual effect Effects 0.000 description 2
- BUGBHKTXTAQXES-UHFFFAOYSA-N Selenium Chemical compound [Se] BUGBHKTXTAQXES-UHFFFAOYSA-N 0.000 description 1
- 241000700605 Viruses Species 0.000 description 1
- 230000002159 abnormal effect Effects 0.000 description 1
- 239000008186 active pharmaceutical agent Substances 0.000 description 1
- 230000004075 alteration Effects 0.000 description 1
- 238000000605 extraction Methods 0.000 description 1
- 238000011049 filling Methods 0.000 description 1
- 230000006872 improvement Effects 0.000 description 1
- 238000012423 maintenance Methods 0.000 description 1
- 238000010606 normalization Methods 0.000 description 1
- 238000007781 pre-processing Methods 0.000 description 1
- 238000004801 process automation Methods 0.000 description 1
- 229910052711 selenium Inorganic materials 0.000 description 1
- 239000011669 selenium Substances 0.000 description 1
- 238000004088 simulation Methods 0.000 description 1
- 239000013589 supplement Substances 0.000 description 1
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/25—Integrating or interfacing systems involving database management systems
- G06F16/254—Extract, transform and load [ETL] procedures, e.g. ETL data flows in data warehouses
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F21/00—Security arrangements for protecting computers, components thereof, programs or data against unauthorised activity
- G06F21/60—Protecting data
- G06F21/62—Protecting access to data via a platform, e.g. using keys or access control rules
- G06F21/6218—Protecting access to data via a platform, e.g. using keys or access control rules to a system of files or objects, e.g. local or distributed file system or database
- G06F21/6227—Protecting access to data via a platform, e.g. using keys or access control rules to a system of files or objects, e.g. local or distributed file system or database where protection concerns the structure of data, e.g. records, types, queries
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F2221/00—Indexing scheme relating to security arrangements for protecting computers, components thereof, programs or data against unauthorised activity
- G06F2221/21—Indexing scheme relating to G06F21/00 and subgroups addressing additional information or applications relating to security arrangements for protecting computers, components thereof, programs or data against unauthorised activity
- G06F2221/2141—Access rights, e.g. capability lists, access control lists, access tables, access matrices
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Databases & Information Systems (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Data Mining & Analysis (AREA)
- Health & Medical Sciences (AREA)
- Bioethics (AREA)
- General Health & Medical Sciences (AREA)
- Computer Hardware Design (AREA)
- Computer Security & Cryptography (AREA)
- Software Systems (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
The application relates to the technical field of data processing, and provides an RPA flow management method and system based on ETL, wherein the method comprises the following steps: constructing an RPA flow database; obtaining an RPA flow set; removing invalid data to obtain an RPA verification flow set; judging whether traceability is provided; the system comprises a connected peripheral interface circuit, and if the connected peripheral interface circuit is newly added equipment, access right information is acquired; the method has the advantages that the RPA process optimization record is added to the RPA process change record, the RPA process management is realized, the problem that the conventional ETL tool is low in data processing efficiency and cannot find and repair process problems and loopholes in time is solved, the efficient processing and management of data can be realized through an automatic ETL process, the RPA process problems can be found and performed in time, the efficiency and accuracy of the RPA process are improved, meanwhile, enterprises can be helped to strengthen data security, and the technical effects of data integrity and confidentiality are ensured.
Description
Technical Field
The application relates to the technical field of data processing, in particular to an RPA flow management method and system based on ETL.
Background
ETL represents three steps of Extract (data extraction), transform (data conversion) and Load (data loading), and can be automatically completed to implement automatic processing and management of data, RPA (robot process automation), and in particular, to a technology for interacting and completing an expected task according to a prerecorded script.
Patent number: 202210038065X discloses application of the ETL tool in automatic inspection based on the ETL tool in the system automatic inspection method, gathers branch office data and processes, analyzes and processes the data, monitors the utilization rate of database table space, and is still unsatisfactory from the aspects of safety and data processing efficiency.
In summary, the conventional ETL tool in the prior art has low data processing efficiency, and cannot discover and repair the technical problems of the flow and the vulnerability in time.
Disclosure of Invention
The application provides an RPA flow management method and system based on ETL, which aim to solve the technical problems that the conventional ETL tool in the prior art has low data processing efficiency and cannot discover and repair flow problems and loopholes in time.
In view of the above problems, the present application provides an RPA flow management method and system based on ETL.
The application discloses a first aspect, which provides an RPA flow management method based on ETL, wherein the method comprises the following steps: constructing an RPA flow database by using an ETL data warehouse technology, wherein the RPA flow database comprises an RPA script, metadata and a device work log; performing data conversion processing through the RPA flow database to obtain an RPA flow set, wherein the RPA flow set comprises a data format conversion flow subset, a data calculation flow subset, a data merging flow subset and a data segmentation flow subset; based on the data format conversion flow subset, the data calculation flow subset, the data merging flow subset and the data segmentation flow subset in the RPA flow set, respectively eliminating invalid data to obtain an RPA verification flow set; after the authorized access verification is passed, managing the RPA flow version and the RPA flow change record, and judging whether the RPA flow has traceability; under the condition that the RPA flow has traceability, a peripheral interface circuit is communicated, and if the peripheral interface circuit is connected with newly-added equipment, access right information of the newly-added equipment is obtained; performing RPA flow optimization through the access right information and the RPA verification flow set, and adding an RPA flow optimized record to the RPA flow change record; and after the RPA process optimization is finished, loading the data meeting the access right information in the RPA verification process set into the newly-added equipment to realize RPA process management.
In another aspect of the present disclosure, an RPA process management system based on ETL is provided, where the system includes: the database construction module is used for constructing an RPA flow database by utilizing an ETL data warehouse technology, wherein the RPA flow database comprises an RPA script, metadata and a device work log; the data conversion processing module is used for carrying out data conversion processing through the RPA flow database to obtain an RPA flow set, wherein the RPA flow set comprises a data format conversion flow subset, a data calculation flow subset, a data merging flow subset and a data segmentation flow subset; the invalid data eliminating module is used for eliminating invalid data respectively based on a data format conversion flow subset, a data calculation flow subset, a data merging flow subset and a data segmentation flow subset in the RPA flow set to obtain an RPA verification flow set; the traceability judging module is used for managing the RPA flow version and the RPA flow change record after the authorized access verification is passed, and judging whether the RPA flow has traceability or not; the access right acquisition module is used for communicating the peripheral interface circuit under the condition that the RPA flow has traceability, and acquiring access right information of the newly-added equipment if the peripheral interface circuit is connected with the newly-added equipment; the flow optimization module is used for performing RPA flow optimization through the access right information and the RPA verification flow set, and adding the record of the RPA flow optimization to the RPA flow change record; and the flow management module is used for loading the data meeting the access right information in the RPA verification flow set into the newly-added equipment after the RPA flow optimization is finished, so as to realize RPA flow management.
One or more technical schemes provided by the application have at least the following technical effects or advantages:
because the ETL data warehouse technology is adopted, an RPA flow database is constructed, wherein the RPA flow database comprises an RPA script, metadata and equipment work logs; performing data conversion processing through the RPA flow database to obtain an RPA flow set, wherein the RPA flow set comprises a data format conversion flow subset, a data calculation flow subset, a data merging flow subset and a data segmentation flow subset; based on the data format conversion flow subset, the data calculation flow subset, the data merging flow subset and the data segmentation flow subset in the RPA flow set, respectively eliminating invalid data to obtain an RPA verification flow set; after the authorized access verification is passed, managing the RPA flow version and the RPA flow change record, and judging whether the RPA flow has traceability; under the condition that the RPA flow has traceability, a peripheral interface circuit is communicated, and if the peripheral interface circuit is connected with newly-added equipment, access right information of the newly-added equipment is obtained; performing RPA flow optimization through the access right information and the RPA verification flow set, and adding an RPA flow optimized record to the RPA flow change record; after the RPA process optimization is finished, the data meeting the access right information in the RPA verification process set is loaded into the newly-added equipment, RPA process management is realized, the efficient processing and management of the data can be realized through an automatic ETL process, and the problem of the RPA process can be found and carried out in time, so that the efficiency and accuracy of the RPA process are improved, and meanwhile, the enterprise can be helped to strengthen the data security, and the technical effects of the data integrity and confidentiality are ensured.
The foregoing description is only an overview of the present application, and is intended to be implemented in accordance with the teachings of the present application in order that the same may be more clearly understood and to make the same and other objects, features and advantages of the present application more readily apparent.
Drawings
Fig. 1 is a schematic flow diagram of a possible flow management method of RPA based on ETL according to an embodiment of the present application;
fig. 2 is a schematic flow diagram of determining whether an RPA flow has traceability in an RPA flow management method based on ETL according to an embodiment of the present application;
fig. 3 is a schematic flow diagram of a possible modification of access rights information in an RPA flow management method based on ETL according to an embodiment of the present application;
fig. 4 is a schematic diagram of a possible structure of an RPA flow management system based on ETL according to an embodiment of the present application.
Reference numerals illustrate: the system comprises a database construction module 100, a data conversion processing module 200, an invalid data rejection module 300, a traceability judgment module 400, an access right acquisition module 500, a flow optimization module 600 and a flow management module 700.
Detailed Description
The embodiment of the application provides an RPA flow management method and system based on ETL, which solve the technical problems that the conventional ETL tool has low data processing efficiency and cannot find and repair flow problems and vulnerabilities in time, realize the efficient processing and management of data through an automatic ETL flow, and find and process the RPA flow problems in time, thereby improving the efficiency and accuracy of the RPA flow, and simultaneously helping enterprises to strengthen the data security and ensuring the technical effects of data integrity and confidentiality.
Having described the basic principles of the present application, various non-limiting embodiments of the present application will now be described in detail with reference to the accompanying drawings.
Example 1
As shown in fig. 1, an embodiment of the present application provides an RPA flow management method based on ETL, where the method includes:
s10: constructing an RPA flow database by using an ETL data warehouse technology, wherein the RPA flow database comprises an RPA script, metadata and a device work log;
s20: performing data conversion processing through the RPA flow database to obtain an RPA flow set, wherein the RPA flow set comprises a data format conversion flow subset, a data calculation flow subset, a data merging flow subset and a data segmentation flow subset;
s30: based on the data format conversion flow subset, the data calculation flow subset, the data merging flow subset and the data segmentation flow subset in the RPA flow set, respectively eliminating invalid data to obtain an RPA verification flow set;
specifically, ETL represents three steps of Extract (data extraction), transform (data conversion) and Load (data loading), and the data extraction, that is, the extraction of data from a source system, can be realized by means of API, web scanning, database query, and the like; the data to be extracted is subjected to operations such as normalization, processing and the like to meet the follow-up flow Cheng Xuqiu, such as data merging, data conversion formats and the like; the data loading is to load the converted data into the target system, which can be a database, a file, an application program and the like, and generally, the loading can be realized by directly writing the data into the database, transmitting the file and the like;
the automated process of RPA robots, including steps, conditions, decisions, loops, etc., typically requires the use of a visual development interface provided by the RPA tool, such as UiPath, automation Anywhere, etc.; according to the RPA flow design, an automatic task is executed, a robot performs operations such as data extraction, processing, filling, clicking and the like according to specified logics and conditions, and simulation manual operation is performed to complete the task on the basis of the operations;
the RPA process database includes RPA scripts, metadata, and device work logs, it should be noted that, the RPA generally uses a visual development interface provided by an RPA tool to create a process, and the process created by using the RPA tool is called an RPA process, and the RPA process is created without writing codes, so that an automation task can be completed through operations such as dragging, clicking, and the like. The RPA script is a programming language, an automatic script is required to be written by using codes, an automatic task is completed by writing a program, in the process of executing the automatic task, the ETL data warehouse technology is utilized for data access, complete and consistent data are extracted, necessary data preprocessing is carried out, and an RPA flow database meeting the data requirement of the RPA flow is constructed;
performing necessary conversion and processing on the extracted data in the RPA process database to meet the requirements of the RPA process, wherein the necessary conversion and processing includes, but is not limited to, data format conversion, data calculation (general calculation, for example, known first quarter workload of employee a and first month workload, and second month workload, and corresponding, the first quarter workload is equal to the first quarter workload minus the first month workload minus the second month workload), data merging, and data segmentation, thereby obtaining the RPA process set, and the RPA process set includes a data format conversion process subset, a data calculation process subset, a data merging process subset, and a data segmentation process subset;
invalid data refers to data which cannot be used or does not meet specific requirements in the data processing process, and comprises abnormal data in the virus attack process; based on the data format conversion flow subset, the data calculation flow subset, the data merging flow subset and the data segmentation flow subset in the RPA flow set, invalid data is respectively removed to obtain an RPA verification flow set, the RPA verification flow set comprises the data format conversion flow subset, the data calculation flow subset, the data merging flow subset and the data segmentation flow subset after the invalid data is removed,
the invalid data is removed to ensure that only valid data participates, so that the possibility of error of the RPA flow can be reduced, the stability of the RPA flow is improved, meanwhile, the data is converted and processed through the RPA flow set, the control and management capacity of the RPA flow management based on the ETL to the access authority can be further enhanced, and the safety and reliability of the RPA flow management based on the ETL are improved.
S40: after the authorized access verification is passed, managing the RPA flow version and the RPA flow change record, and judging whether the RPA flow has traceability;
as shown in fig. 2, step S40 includes the steps of:
s41: recording the RPA flow change record of each version of the RPA flow;
s42: based on the change of the RPA flow in the RPA flow change record, performing operation test by using an automatic test tool to obtain an operation test result;
s43: performing documented management through the RPA flow change record to obtain documented management information, wherein the documented management information comprises a technical document, a user manual and an operation guide;
s44: and obtaining a readability test result through the documented management information, and judging whether the RPA process has traceability or not by combining the operation test result.
Specifically, confirming that the authorized access verification has passed, and that the RPA procedure version and RPA procedure change record can be accessed; checking the RPA flow version and the RPA flow change record to confirm whether traceability information such as version number, change date, change reason and the like is contained; if the RPA flow version and RPA flow change record do not contain sufficient traceability information, modifications and supplements are needed.
For the RPA process version, each version needs to be ensured to have a unique version number, and related documents such as corresponding process design documents, test reports and the like can be traced back according to the version number; for the RPA flow change record, information such as date of each change, flow design before and after the change, change reason, change personnel and the like needs to be recorded;
further, determining whether the RPA procedure has traceability includes: recording an RPA procedure change record for each version of the RPA procedure: in the process of developing the RPA flow, the content of the change, including the reason of the change, the specific content of the change and the like, needs to be recorded every time the change is carried out, so that the problem can be rapidly positioned when the problem is found later; and based on the change of the RPA flow in the RPA flow change record, performing operation test by using an automatic test tool to obtain an operation test result: for each change of the RPA flow, sufficient test and verification are required to ensure that the changed RPA flow can normally run without affecting the accuracy of the business flow and data, and the running test can be realized by adopting an automatic test tool such as Selenium;
the method comprises the steps of carrying out documented management through the version and the change of each RPA flow in an RPA flow change record to obtain documented management information, wherein the documented management information comprises a technical document, a user manual and an operation guide so as to facilitate subsequent maintenance and management work, meanwhile, ensuring the integrity and the readability of the documented management information obtained by carrying out documented management on the version and the change of each RPA flow in the RPA flow change record, selecting a proper readability test tool, such as a Flesch-Kincaid readability test tool and a Gunning Fog readability test tool, inputting the documented management information into the readability test tool to carry out test, obtaining a readability test result, wherein the readability test result is that the documented management information can/cannot be read out by an RPA flow management system based on an ETL, combining the documented management information and an operation test result, and judging whether the RPA has the readability or not under the dual-traceability verification of the readability test result and the operation test result;
through documenting management and readability test, the stability of the RPA flow can be ensured, and the failure of the RPA flow caused by personnel variation and other reasons is avoided; through documented management, the RPA flow can be maintained and modified more easily by an developer, and the continuity and maintainability of the RPA flow are ensured.
S50: under the condition that the RPA flow has traceability, a peripheral interface circuit is communicated, and if the peripheral interface circuit is connected with newly-added equipment, access right information of the newly-added equipment is obtained;
s60: performing RPA flow optimization through the access right information and the RPA verification flow set, and adding an RPA flow optimized record to the RPA flow change record;
s70: and after the RPA process optimization is finished, loading the data meeting the access right information in the RPA verification process set into the newly-added equipment to realize RPA process management.
Specifically, the newly added equipment refers to equipment which is not connected with an RPA flow management system based on ETL; the peripheral interface circuit is used for connecting the RPA flow management system based on the ETL with an interface circuit for exchanging data with external equipment or a system; under the condition that the RPA flow has traceability, a peripheral interface circuit is communicated, and if the peripheral interface circuit is connected with newly-added equipment, access right information of the newly-added equipment is obtained;
performing RPA process optimization through the access right information and the RPA verification process set, specifically, analyzing and evaluating according to the access right information and the RPA verification process set, determining which steps in the RPA process can be optimized or simplified, for example, opening chat software and acquiring a contact friend list can be directly bound, directly loading the contact friend list into a contact interface after opening the chat software, recording related information for each RPA process optimization, including information of optimization date, process design before and after optimization, optimization reason, optimization personnel and the like, and adding the record of RPA process optimization into the RPA process change record; and after the RPA process optimization is finished, loading the data meeting the access right information in the RPA verification process set into the newly-added equipment to realize RPA process management. The RPA process is optimized through the access authority information and the RPA verification process set, so that the process efficiency and quality are improved, meanwhile, the management and monitoring of the RPA process are realized, the problem of the RPA process is found and carried out in time, and the efficiency of the RPA process is improved.
Step S50 includes the steps of:
s51: if the peripheral interface circuit is connected with the non-newly-added equipment, acquiring real-time access right information of the non-newly-added equipment;
S52-A: when the real-time access right information is inconsistent with the access right information at the last moment, performing RPA flow optimization through the real-time access right information and the RPA verification flow set, and adding an RPA flow optimized record to the RPA flow change record;
S52-B: and after the RPA process optimization is finished, loading the data meeting the real-time access right information in the RPA verification process set into the non-newly-added equipment to realize RPA process management.
The embodiment of the application also comprises the following steps:
S53-A: and under the condition that the real-time access right information is consistent with the access right information at the last moment, directly loading the data meeting the real-time access right information in the RPA verification process set into the non-newly-added equipment to realize RPA process management.
Specifically, the non-newly added equipment refers to equipment which is connected with an RPA flow management system based on ETL; the real-time access right information refers to access right information of equipment or a system connected with the peripheral interface circuit and is used for controlling access right of the peripheral equipment or the system; if the peripheral interface circuit is connected with the non-newly-added equipment, acquiring real-time access right information of the non-newly-added equipment;
in the first case, when the real-time access right information is inconsistent with the access right information at the last moment, performing RPA flow optimization through the real-time access right information and the RPA verification flow set: analyzing and evaluating the RPA verification process set according to the real-time access right information, re-determining which steps in the RPA process can be optimized or simplified, and adding the RPA process optimized record to the RPA process change record; the RPA process optimization is used for characterizing the improvement and optimization of the RPA process so as to improve the efficiency and stability of the RPA process, and after the RPA process optimization is finished, the data meeting the real-time access right information in the RPA verification process set is loaded into the non-newly added equipment to realize the RPA process management;
in the second case, if the real-time access right information is consistent with the access right information at the last moment, the access right information of the peripheral interface circuit is compared at two time points, if the access right information at the two time points is unchanged, the access right information at the two time points is considered to be consistent, and the data meeting the real-time access right information in the RPA verification process set is directly loaded into the non-newly-added equipment, so that RPA process management is realized;
by monitoring the access right information of the peripheral interface circuit in real time and combining the RPA verification flow set, the real-time optimization and management of the RPA flow can be realized, the efficiency and stability of the flow are improved, the sustainability and maintainability of the flow are ensured, the method can be widely applied to various RPA flow management scenes, and the automation degree and the efficiency of RPA flow management are improved.
As shown in fig. 3, the embodiment of the present application further includes:
s53: acquiring equipment function information of the newly-added equipment/non-newly-added equipment;
s54: marking an authentication function to be authorized in the equipment function information through the equipment function information and the real-time access authority information;
s55: if the authentication function to be authorized is started by the newly-added equipment/non-newly-added equipment, an access right change prompt is sent;
s56: and carrying out modification of the access right information through the access right modification prompt.
Specifically, acquiring device function information of the added device/non-added device, such as device function information of a mouse, including but not limited to enlarging or reducing interface scale and automatic scrolling; the authentication function to be authorized refers to a function which can be accessed or used by equipment only through authorization authentication; marking an authentication function to be authorized in the equipment function information through the equipment function information and the real-time access authority information, for example, adding a contact friend of which the user is chat software in a mobile phone address book; the access right change reminding is that an RPA flow management system based on ETL sends reminding to a user through a message popup window;
in one case: if the authentication function to be authorized is started by the newly-added equipment/non-newly-added equipment, an access right change prompt is sent; sending an access right change prompt through the access right change prompt, if the user accepts the access right change prompt, changing access right information, and after the user changes the access right information, realizing the authentication function to be authorized, wherein the function of adding the contact friends of the user as chat software in the mobile phone address book can be realized only by the fact that the user agrees to access the mobile phone address book according to the above example;
in another case: if the authentication function to be authorized is started by the newly-added equipment/non-newly-added equipment, an access right change prompt is sent; if the user does not accept the access right change reminding, the access right change reminding is sent out, and the data generally relate to the internal non-public data of the enterprise, and the RPA flow corresponding to the authentication function to be authorized can be used as a functional plug-in unit and installed into an internal computer of the enterprise for internal use, and meanwhile, the connection of an administrator is also required to be disconnected;
by automating and optimizing the RPA flow, the efficiency and accuracy of flow management are improved. When the access authority information of the peripheral interface circuit changes, the RPA flow management system based on the ETL can automatically verify the correctness of the RPA flow, thereby ensuring the stability of the flow. Meanwhile, when the functions of the newly-added equipment or the non-newly-added equipment need authorization authentication, related users are automatically reminded of changing access authority information, and the connection of an administrator is disconnected under the necessary condition, so that the privacy of the users is fully respected.
Step S56 includes the steps of:
s561: after the access right information is changed, acquiring the equipment model of the newly-added equipment and adding the equipment model of the newly-added equipment into the non-newly-added equipment;
s562: acquiring real-time access right information of the non-newly added equipment;
s563: adding an authority effective constraint through the real-time access authority information, wherein the authority effective constraint is a single effective constraint or a memory effective constraint;
S564-A: and if the authority effective constraint is a memory effective constraint, reserving access authority information corresponding to the memory effective constraint in the process of updating the access authority information.
The embodiment of the application also comprises the following steps:
S565-A: if the authority effective constraint is a single effective constraint, returning access authority information corresponding to the single effective constraint to the original state after the authentication function to be authorized is executed;
S565-B: and ignoring the access right information corresponding to the single effective constraint in the process of updating the access right information.
Specifically, the access right information is changed through the access right change prompt, and the method further comprises the steps of obtaining the equipment model of the newly-added equipment and adding the equipment model of the newly-added equipment into the non-newly-added equipment after the access right information is changed; re-acquiring real-time access right information of the non-newly-added equipment after each occurrence of an event that the equipment model is added to the non-newly-added equipment; adding authority effective constraint through the real-time access authority information, wherein the authority effective constraint is single effective constraint or memory effective constraint, and the single effective constraint refers to authority constraint which is effective for only one access; the memory valid constraint refers to a permission constraint which can be kept valid in multiple accesses;
in one case: if the authority effective constraint is a memory effective constraint, reserving access authority information corresponding to the memory effective constraint in the process of updating the access authority information;
in another case: if the authority effective constraint is a single effective constraint, after the authentication function to be authorized is executed, returning the access authority information corresponding to the single effective constraint to the original state, in other words, enabling the authority constraint corresponding to the single effective constraint to be effective only in the access, and invalidating after the access is finished; if the access right information needs to be updated, the RPA flow management system based on ETL ignores the access right information corresponding to the single effective constraint, because the single effective constraint is only effective for the current access and should not affect the update of the whole access right.
The control and management capability of the RPA flow management system based on the ETL on the access authority can be further enhanced by adding the effective constraint of the authority, so that the efficient processing and management of the data are realized.
In summary, the RPA flow management method and system based on ETL provided by the embodiment of the application have the following technical effects:
1. because the ETL data warehouse technology is adopted, an RPA flow database is constructed, wherein the RPA flow database comprises an RPA script, metadata and equipment work logs; performing data conversion processing through the RPA flow database to obtain an RPA flow set, wherein the RPA flow set comprises a data format conversion flow subset, a data calculation flow subset, a data merging flow subset and a data segmentation flow subset; based on the data format conversion flow subset, the data calculation flow subset, the data merging flow subset and the data segmentation flow subset in the RPA flow set, respectively eliminating invalid data to obtain an RPA verification flow set; after the authorized access verification is passed, managing the RPA flow version and the RPA flow change record, and judging whether the RPA flow has traceability; under the condition that the RPA flow has traceability, a peripheral interface circuit is communicated, and if the peripheral interface circuit is connected with newly-added equipment, access right information of the newly-added equipment is obtained; performing RPA flow optimization through the access right information and the RPA verification flow set, and adding an RPA flow optimized record to the RPA flow change record; after the RPA process optimization is finished, the data meeting the access right information in the RPA verification process set is loaded into the newly-added equipment to realize RPA process management.
2. Because the equipment function information of the newly-added equipment/non-newly-added equipment is acquired; marking an authentication function to be authorized in the equipment function information through the equipment function information and the real-time access authority information; if the newly-added equipment/non-newly-added equipment starts the authentication function to be authorized, sending out an access right change prompt; and carrying out modification of the access right information through the access right modification reminding. By automating and optimizing the RPA flow, the efficiency and accuracy of flow management are improved. When the access authority information of the peripheral interface circuit changes, the RPA flow management system based on the ETL can automatically verify the correctness of the RPA flow, thereby ensuring the stability of the flow. Meanwhile, when the functions of the newly-added equipment or the non-newly-added equipment need authorization authentication, related users are automatically reminded of changing access authority information, and the connection of an administrator is disconnected under the necessary condition, so that the privacy of the users is fully respected.
Example two
Based on the same inventive concept as the RPA process management method based on ETL in the foregoing embodiment, as shown in fig. 4, an embodiment of the present application provides an RPA process management system based on ETL, where the system includes:
the database construction module 100 is configured to construct an RPA flow database by using an ETL data warehouse technology, where the RPA flow database includes an RPA script, metadata, and a device work log;
the data conversion processing module 200 is configured to perform data conversion processing through the RPA flow database to obtain an RPA flow set, where the RPA flow set includes a data format conversion flow subset, a data calculation flow subset, a data merging flow subset, and a data segmentation flow subset;
an invalid data removing module 300, configured to remove invalid data based on a data format conversion flow subset, a data calculation flow subset, a data merging flow subset, and a data segmentation flow subset in the RPA flow set, respectively, to obtain an RPA verification flow set;
the traceability judging module 400 is configured to manage the RPA flow version and the RPA flow change record after the authorized access verification is passed, and judge whether the RPA flow has traceability;
the access right obtaining module 500 is configured to communicate with a peripheral interface circuit if the RPA flow has traceability, and obtain access right information of the newly-added device if the peripheral interface circuit is connected to the newly-added device;
the flow optimization module 600 is configured to perform RPA flow optimization through the access right information and the RPA verification flow set, and add a record of RPA flow optimization to the RPA flow change record;
and the flow management module 700 is configured to load the data meeting the access right information in the RPA verification flow set into the added device after the RPA flow optimization is completed, so as to implement RPA flow management.
Further, the traceability determination module 400 is configured to perform the following steps:
recording the RPA flow change record of each version of the RPA flow;
based on the change of the RPA flow in the RPA flow change record, performing operation test by using an automatic test tool to obtain an operation test result;
performing documented management through the RPA flow change record to obtain documented management information, wherein the documented management information comprises a technical document, a user manual and an operation guide;
and obtaining a readability test result through the documented management information, and judging whether the RPA process has traceability or not by combining the operation test result.
Further, the access right obtaining module 500 is configured to perform the following steps:
if the peripheral interface circuit is connected with the non-newly-added equipment, acquiring real-time access right information of the non-newly-added equipment;
when the real-time access right information is inconsistent with the access right information at the last moment, performing RPA flow optimization through the real-time access right information and the RPA verification flow set, and adding an RPA flow optimized record to the RPA flow change record;
and after the RPA process optimization is finished, loading the data meeting the real-time access right information in the RPA verification process set into the non-newly-added equipment to realize RPA process management.
Further, the access right obtaining module 500 is further configured to perform the following steps:
and under the condition that the real-time access right information is consistent with the access right information at the last moment, directly loading the data meeting the real-time access right information in the RPA verification process set into the non-newly-added equipment to realize RPA process management.
Further, the access right obtaining module 500 is further configured to perform the following steps:
acquiring equipment function information of the newly-added equipment/non-newly-added equipment;
marking an authentication function to be authorized in the equipment function information through the equipment function information and the real-time access authority information;
if the authentication function to be authorized is started by the newly-added equipment/non-newly-added equipment, an access right change prompt is sent;
and carrying out modification of the access right information through the access right modification prompt.
Further, the access right obtaining module 500 is further configured to perform the following steps:
after the access right information is changed, acquiring the equipment model of the newly-added equipment and adding the equipment model of the newly-added equipment into the non-newly-added equipment;
acquiring real-time access right information of the non-newly added equipment;
adding an authority effective constraint through the real-time access authority information, wherein the authority effective constraint is a single effective constraint or a memory effective constraint;
and if the authority effective constraint is a memory effective constraint, reserving access authority information corresponding to the memory effective constraint in the process of updating the access authority information.
Further, the access right obtaining module 500 is further configured to perform the following steps:
if the authority effective constraint is a single effective constraint, returning access authority information corresponding to the single effective constraint to the original state after the authentication function to be authorized is executed;
and ignoring the access right information corresponding to the single effective constraint in the process of updating the access right information.
Any of the steps of the methods described above may be stored as computer instructions or programs in a non-limiting computer memory and may be called by a non-limiting computer processor to identify any method for implementing an embodiment of the present application, without unnecessary limitations.
Further, the first or second element may not only represent a sequential relationship, but may also represent a particular concept, and/or may be selected individually or in whole among a plurality of elements. It will be apparent to those skilled in the art that various modifications and variations can be made to the present application without departing from the scope of the application. Thus, the present application is intended to include such modifications and alterations insofar as they come within the scope of the application or the equivalents thereof.
Claims (8)
1. An RPA process management method based on ETL, the method comprising:
constructing an RPA flow database by using an ETL data warehouse technology, wherein the RPA flow database comprises an RPA script, metadata and a device work log;
performing data conversion processing through the RPA flow database to obtain an RPA flow set, wherein the RPA flow set comprises a data format conversion flow subset, a data calculation flow subset, a data merging flow subset and a data segmentation flow subset;
based on the data format conversion flow subset, the data calculation flow subset, the data merging flow subset and the data segmentation flow subset in the RPA flow set, respectively eliminating invalid data to obtain an RPA verification flow set;
after the authorized access verification is passed, managing the RPA flow version and the RPA flow change record, and judging whether the RPA flow has traceability;
under the condition that the RPA flow has traceability, a peripheral interface circuit is communicated, and if the peripheral interface circuit is connected with newly-added equipment, access right information of the newly-added equipment is obtained;
performing RPA flow optimization through the access right information and the RPA verification flow set, and adding an RPA flow optimized record to the RPA flow change record;
and after the RPA process optimization is finished, loading the data meeting the access right information in the RPA verification process set into the newly-added equipment to realize RPA process management.
2. The RPA process management method based on ETL as set forth in claim 1, wherein the determining whether the RPA process has traceability includes:
recording the RPA flow change record of each version of the RPA flow;
based on the change of the RPA flow in the RPA flow change record, performing operation test by using an automatic test tool to obtain an operation test result;
performing documented management through the RPA flow change record to obtain documented management information, wherein the documented management information comprises a technical document, a user manual and an operation guide;
and obtaining a readability test result through the documented management information, and judging whether the RPA process has traceability or not by combining the operation test result.
3. The RPA process management method based on ETL of claim 1, wherein the peripheral interface circuit is connected as a newly added device, the method further comprising:
if the peripheral interface circuit is connected with the non-newly-added equipment, acquiring real-time access right information of the non-newly-added equipment;
when the real-time access right information is inconsistent with the access right information at the last moment, performing RPA flow optimization through the real-time access right information and the RPA verification flow set, and adding an RPA flow optimized record to the RPA flow change record;
and after the RPA process optimization is finished, loading the data meeting the real-time access right information in the RPA verification process set into the non-newly-added equipment to realize RPA process management.
4. The RPA process management method based on ETL of claim 3, further comprising:
and under the condition that the real-time access right information is consistent with the access right information at the last moment, directly loading the data meeting the real-time access right information in the RPA verification process set into the non-newly-added equipment to realize RPA process management.
5. The ETL-based RPA process management method of claim 4, further comprising:
acquiring equipment function information of the newly-added equipment/non-newly-added equipment;
marking an authentication function to be authorized in the equipment function information through the equipment function information and the real-time access authority information;
if the authentication function to be authorized is started by the newly-added equipment/non-newly-added equipment, an access right change prompt is sent;
and carrying out modification of the access right information through the access right modification prompt.
6. The RPA process management method based on ETL according to claim 5, wherein said modifying access rights information is performed by said access rights modification reminder, said method further comprising:
after the access right information is changed, acquiring the equipment model of the newly-added equipment and adding the equipment model of the newly-added equipment into the non-newly-added equipment;
acquiring real-time access right information of the non-newly added equipment;
adding an authority effective constraint through the real-time access authority information, wherein the authority effective constraint is a single effective constraint or a memory effective constraint;
and if the authority effective constraint is a memory effective constraint, reserving access authority information corresponding to the memory effective constraint in the process of updating the access authority information.
7. The ETL-based RPA process management method of claim 6, wherein the rights effective constraint is a single effective constraint or a memory effective constraint, the method further comprising:
if the authority effective constraint is a single effective constraint, returning access authority information corresponding to the single effective constraint to the original state after the authentication function to be authorized is executed;
and ignoring the access right information corresponding to the single effective constraint in the process of updating the access right information.
8. An ETL-based RPA process management system for implementing an ETL-based RPA process management method as claimed in any one of claims 1-7, comprising:
the database construction module is used for constructing an RPA flow database by utilizing an ETL data warehouse technology, wherein the RPA flow database comprises an RPA script, metadata and a device work log;
the data conversion processing module is used for carrying out data conversion processing through the RPA flow database to obtain an RPA flow set, wherein the RPA flow set comprises a data format conversion flow subset, a data calculation flow subset, a data merging flow subset and a data segmentation flow subset;
the invalid data eliminating module is used for eliminating invalid data respectively based on a data format conversion flow subset, a data calculation flow subset, a data merging flow subset and a data segmentation flow subset in the RPA flow set to obtain an RPA verification flow set;
the traceability judging module is used for managing the RPA flow version and the RPA flow change record after the authorized access verification is passed, and judging whether the RPA flow has traceability or not;
the access right acquisition module is used for communicating the peripheral interface circuit under the condition that the RPA flow has traceability, and acquiring access right information of the newly-added equipment if the peripheral interface circuit is connected with the newly-added equipment;
the flow optimization module is used for performing RPA flow optimization through the access right information and the RPA verification flow set, and adding the record of the RPA flow optimization to the RPA flow change record;
and the flow management module is used for loading the data meeting the access right information in the RPA verification flow set into the newly-added equipment after the RPA flow optimization is finished, so as to realize RPA flow management.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202311073017.5A CN117112668B (en) | 2023-08-23 | 2023-08-23 | ETL-based RPA flow management method and system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202311073017.5A CN117112668B (en) | 2023-08-23 | 2023-08-23 | ETL-based RPA flow management method and system |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN117112668A true CN117112668A (en) | 2023-11-24 |
| CN117112668B CN117112668B (en) | 2024-02-20 |
Family
ID=88812234
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202311073017.5A Active CN117112668B (en) | 2023-08-23 | 2023-08-23 | ETL-based RPA flow management method and system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN117112668B (en) |
Citations (13)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101567013A (en) * | 2009-06-02 | 2009-10-28 | 阿里巴巴集团控股有限公司 | Method and apparatus for implementing ETL scheduling |
| CN102185836A (en) * | 2011-04-15 | 2011-09-14 | 哈尔滨工业大学 | Standalone electronic document protection system based on information stream model |
| EP3617884A1 (en) * | 2018-08-29 | 2020-03-04 | Accenture Global Solutions Limited | Adapter extension for inbound messages from robotic automation platforms to unified automation platform |
| CN112732686A (en) * | 2020-12-29 | 2021-04-30 | 广东省电信规划设计院有限公司 | Operation method and device for improving data market based on GP (GP) cluster |
| CN113570093A (en) * | 2021-06-25 | 2021-10-29 | 北京来也网络科技有限公司 | Information reporting method, device, equipment and medium based on AI and RPA |
| WO2021238045A1 (en) * | 2020-05-27 | 2021-12-02 | 重庆邮电大学 | Rpa-based customer requirement obtaining and querying method under large-scale customization |
| CN113806114A (en) * | 2021-09-30 | 2021-12-17 | 杭州分叉智能科技有限公司 | RPA robot-based method for checking contraband words on commodity display page |
| CN114372105A (en) * | 2022-01-13 | 2022-04-19 | 中电福富信息科技有限公司 | ETL tool based method for realizing system automatic inspection |
| CN115269548A (en) * | 2022-07-26 | 2022-11-01 | 中国银行股份有限公司 | Method and system for generating data warehouse development model and related equipment |
| CN115640613A (en) * | 2022-10-12 | 2023-01-24 | 杨炜祖 | Privacy data distributed control method and system based on RPA and electronic terminal |
| CN115660620A (en) * | 2022-10-25 | 2023-01-31 | 珠海金智维信息科技有限公司 | Personnel DB library management method and device based on RPA and storage medium |
| CN115668178A (en) * | 2019-04-05 | 2023-01-31 | 转化成像创新公司 | Methods, systems, and computer program products for retrospective data mining |
| CN116366651A (en) * | 2023-03-31 | 2023-06-30 | 杭州电力设备制造有限公司 | APP-based configuration management optimization method |
-
2023
- 2023-08-23 CN CN202311073017.5A patent/CN117112668B/en active Active
Patent Citations (13)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101567013A (en) * | 2009-06-02 | 2009-10-28 | 阿里巴巴集团控股有限公司 | Method and apparatus for implementing ETL scheduling |
| CN102185836A (en) * | 2011-04-15 | 2011-09-14 | 哈尔滨工业大学 | Standalone electronic document protection system based on information stream model |
| EP3617884A1 (en) * | 2018-08-29 | 2020-03-04 | Accenture Global Solutions Limited | Adapter extension for inbound messages from robotic automation platforms to unified automation platform |
| CN115668178A (en) * | 2019-04-05 | 2023-01-31 | 转化成像创新公司 | Methods, systems, and computer program products for retrospective data mining |
| WO2021238045A1 (en) * | 2020-05-27 | 2021-12-02 | 重庆邮电大学 | Rpa-based customer requirement obtaining and querying method under large-scale customization |
| CN112732686A (en) * | 2020-12-29 | 2021-04-30 | 广东省电信规划设计院有限公司 | Operation method and device for improving data market based on GP (GP) cluster |
| CN113570093A (en) * | 2021-06-25 | 2021-10-29 | 北京来也网络科技有限公司 | Information reporting method, device, equipment and medium based on AI and RPA |
| CN113806114A (en) * | 2021-09-30 | 2021-12-17 | 杭州分叉智能科技有限公司 | RPA robot-based method for checking contraband words on commodity display page |
| CN114372105A (en) * | 2022-01-13 | 2022-04-19 | 中电福富信息科技有限公司 | ETL tool based method for realizing system automatic inspection |
| CN115269548A (en) * | 2022-07-26 | 2022-11-01 | 中国银行股份有限公司 | Method and system for generating data warehouse development model and related equipment |
| CN115640613A (en) * | 2022-10-12 | 2023-01-24 | 杨炜祖 | Privacy data distributed control method and system based on RPA and electronic terminal |
| CN115660620A (en) * | 2022-10-25 | 2023-01-31 | 珠海金智维信息科技有限公司 | Personnel DB library management method and device based on RPA and storage medium |
| CN116366651A (en) * | 2023-03-31 | 2023-06-30 | 杭州电力设备制造有限公司 | APP-based configuration management optimization method |
Non-Patent Citations (3)
| Title |
|---|
| LILIA MUNOZ; JOSE-NORBERTO MAZON; JUAN TRUJILLO: "ETL Process Modeling Conceptual for Data Warehouses: A Systematic Mapping Study", IEEE LATIN AMERICA TRANSACTIONS, pages 358 * |
| 唐建荣;: "企业财务共享中心机器人流程自动化应用研究", 财会通讯, no. 12, pages 166 - 170 * |
| 杨强;刘泽栋: "新一代信息技术在核电企业财务智能化中的应用", 财会月刊, pages 68 - 77 * |
Also Published As
| Publication number | Publication date |
|---|---|
| CN117112668B (en) | 2024-02-20 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN109446068B (en) | Interface test method, device, computer equipment and storage medium | |
| US10061578B2 (en) | System and method of configuring a data store for tracking and auditing real-time events across different software development tools in agile development environments | |
| Nguyen et al. | An automatic method for assessing the versions affected by a vulnerability | |
| CN110209650B (en) | Data normalization and migration method and device, computer equipment and storage medium | |
| CN103313289B (en) | WAP system automation test macro and method | |
| US20120116984A1 (en) | Automated evaluation of compliance data from heterogeneous it systems | |
| CN112561370B (en) | Method and device for managing software release, computer equipment and storage medium | |
| CN111859047A (en) | Fault solving method and device | |
| US20190318271A1 (en) | Performance manager to autonomously evaluate replacement algorithms | |
| CN110063042A (en) | A kind of response method and its terminal of database failure | |
| CN114546975A (en) | Business risk processing method and server combining artificial intelligence | |
| CN113918954A (en) | Automated vulnerability scanning integration method, device, equipment and storage medium | |
| CN117112668B (en) | ETL-based RPA flow management method and system | |
| WO2016138611A1 (en) | Monitoring and reporting transmission and completeness of data upload from a source location to a destination location | |
| Alshareef et al. | Transforming Data Flow Diagrams for Privacy Compliance. | |
| CN116680699A (en) | Vulnerability priority ordering system, vulnerability priority ordering method, computer equipment and storage medium | |
| CN116599881A (en) | Cloud platform tenant modeling test method, device, equipment and storage medium | |
| CN113886262A (en) | Software automation test method and device, computer equipment and storage medium | |
| KR20140054913A (en) | Apparatus and method for processing data error for distributed system | |
| CN112632546A (en) | Automatic code analysis method for broadcasting and television industry | |
| CN112819554B (en) | Service processing method and device based on page operation and computer equipment | |
| US20230418582A1 (en) | Information Technology Management System | |
| Arzaman et al. | The Development of Smart Document Management System With Mobile Application Technology In Agricul-Tural Sector (Malaysia Sustainability Palm Oil) | |
| CN102203756A (en) | Client devices, server devices and framework programs to be used in information processing systems | |
| Lee | CONTINUOUS AUDITS in Times of Crisis. |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |