CN115643181A - Universal data acquisition system based on RPA robot - Google Patents
Universal data acquisition system based on RPA robot Download PDFInfo
- Publication number
- CN115643181A CN115643181A CN202211149328.0A CN202211149328A CN115643181A CN 115643181 A CN115643181 A CN 115643181A CN 202211149328 A CN202211149328 A CN 202211149328A CN 115643181 A CN115643181 A CN 115643181A
- Authority
- CN
- China
- Prior art keywords
- data
- rpa
- terminal equipment
- running
- state
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Abstract
The invention discloses a universal data acquisition system based on an RPA robot, which comprises a data acquisition module, a data acquisition module and a data acquisition module, wherein the data acquisition module is used for acquiring data; the terminal equipment is connected with the background control end through the server, the server end collects the running state parameters of a data capturing system of the terminal equipment in a RPA data collecting state, when the running space upper limit is reached in the RPA data capturing running process, the RPA is closed to close an application program in a pause state, whether the expected running residual space of the terminal equipment meets the normal running of the RPA data capturing is calculated, if not, the task amount of the RPA data capturing is adjusted, and the problem that the terminal computer equipment system is crashed due to the fact that the RPA data capturing occupies too large running memory of the terminal equipment is avoided. The problem of current because RPA robot data snatch set up the task volume great, the computer terminal breaks down under the RPA robot overload state, and the RPA robot can't normally operate and snatch data is solved.
Description
Technical Field
The invention relates to the technical field of networks, in particular to a universal data acquisition system based on an RPA robot.
Background
An RPA (resilient Process Automation) Process Automation robot, also called digital labor force, can simulate manual work to perform operations such as copying, pasting, clicking, inputting and the like, and helps the human labor force to be liberated from work contents of 'relatively fixed rules, relatively high repeatability and relatively low added value'. Currently, this technology is continuously being used in financial, banking, e-commerce, manufacturing, retail, and other scenarios. In the actual working process, data needs to be captured, and the conventional data capturing technical means is that business personnel capture data manually, capture the data by means of general data capturing software and write a traditional data capturing program by an IT department, and format the data into a system. The data capturing process developed by the RPA is similar to the capturing of general data capturing software, but because of the visual process carried by the RPA, the built-in components and the abundant components in the component market, the data capturing of the RPA is relative to the general data capturing software, and the data capturing process can be seamlessly connected with other processes.
The traditional technical scheme is that a program is written in a code mode, and the capturing process is simulation at a network level and can be completed by professional developers. Due to the fact that the scheme is too aggressive, a plurality of websites and APPs can intercept the method. The main principle of interception is based on this solution, and it is not operated in a real browser environment. The crossing of interception is desired, requiring great technical power and development costs. The RPA capture scheme is really operated on the browser and simulates the operation of a human, so that the RPA capture scheme cannot be intercepted. As can be seen from this, the existing automatic capture solution is divided into two general data capture software or the traditional technical solution.
However, in the prior art, in the actual operation process, because the RPA robot occupies a large amount of system operation memory space in the data capturing process, and the RPA robot is only responsible for operating related steps of capturing data in the data capturing process, the operation condition of a computer terminal cannot be monitored in real time, and the RPA robot can capture data in the data capturing process, because the RPA robot captures a large amount of tasks, the computer terminal has a fault in the RPA robot overload state, and the RPA robot cannot capture data in normal operation, a universal data acquisition system based on the RPA robot is developed for solving the problem.
Disclosure of Invention
The invention aims to provide a universal data acquisition system based on an RPA robot, which aims to solve the problems that the RPA robot cannot normally operate to capture data due to the fact that the data capture setting task amount of the RPA robot is large, a computer terminal breaks down in an overload state of the RPA robot, and the RPA robot cannot capture data.
The invention provides a universal data acquisition system based on an RPA robot, which comprises a data acquisition module, a data acquisition module and a data acquisition module, wherein the data acquisition module is used for acquiring data; the terminal equipment is connected with the background control end through the server;
the server side acquires the running state parameters of the data capture system of the terminal equipment in the RPA data acquisition state;
the evaluation detection unit is used for bringing the system running state parameters of the terminal equipment in the RPA data acquisition state into a terminal system running state evaluation model by the server side to obtain a terminal equipment system running state result;
the server constructs an application management service flow processing logic database through the RPA according to the operation state result of the terminal equipment system and executes the application management service flow processing logic;
the server side detects the system running condition and analyzes data of the terminal equipment system which executes the application management business process processing logic;
and the server side performs data analysis processing according to the detection result of the terminal equipment system under the normal operation of the terminal equipment system to obtain the maximum collection amount of RPA general data.
Further, the evaluation detection unit comprises;
the server side enables the acquisition parameters of the terminal equipment in the RPA data acquisition state to include the running quantity of the application software of the terminal equipment and the percentage of the running memory space occupied by the running of the application software;
constructing a time-interval collection service process of the RPA robot, and collecting collection parameters in a time-interval collection state of the RPA data;
and if the parameters of the collection parameters in the RPA data collection state are abnormal, suspending the RPA robot data collection task and feeding back an error report to the background control end.
Further, the logic constructing unit includes:
after an RPA data capturing task is started, establishing a static constant safe operation memory upper limit value according to the size of an operation space memory of the existing terminal equipment;
after the RPA data capturing task runs, storing an application software running memory in a running state except the RPA data capturing task to a cloud server, and suspending application software running in a running state except the RPA data capturing task;
and when the RPA runs to a critical point, transmitting the time node record data to a corresponding storage cloud space of the application software, establishing a closing time node, and closing the application software.
Further, the operation state analysis unit includes:
the server side detects the system operation condition of the terminal equipment system which executes the application management service flow processing logic to obtain a detection result of the terminal equipment system;
and if the running state of the terminal equipment system accords with a preset value, the terminal equipment system runs normally.
Further, the operating space analyzing unit includes:
the data analysis processing comprises the operation memory space data of the terminal equipment, the hardware equipment temperature data of the terminal equipment and the load capacity data of the terminal equipment in an expected time period;
evaluating the operation content occupied by the terminal equipment in the RPA data acquisition expected time period to obtain the RPA data acquisition operation space requirement data in the expected time period;
and comparing the expected RPA data acquisition operating space demand data with the load capacity data in the expected time period of the terminal equipment, and if the data comparison result is abnormal, feeding back information to the background control end.
The invention has the following beneficial effects: the invention provides a universal data acquisition system based on an RPA robot, which comprises a data acquisition module, a data acquisition module and a data acquisition module, wherein the data acquisition module is used for acquiring data; the terminal equipment is connected with the background control end through the server, the server end acquires system operation state parameters of the terminal equipment in an RPA data acquisition state, the server end brings the system operation state parameters of the terminal equipment in the RPA data acquisition state into a terminal system operation state evaluation model to obtain a terminal equipment system operation state result, the server constructs an application management service flow processing logic database through the RPA according to the terminal equipment system operation state result and executes the application management service flow processing logic, and the server end performs system operation condition detection and data analysis on the terminal equipment system executing the application management service flow processing logic, the server side carries out data analysis processing according to the detection result of the terminal equipment system under the normal operation of the terminal equipment system to obtain the maximum collection amount of RPA general data, judges the maximum load capacity of the maximum terminal equipment operation by carrying out operation data collection on terminal equipment under the normal operation of the RPA operation, suspends the operation of other application software on the terminal equipment in the operation process of RPA data capture, stores data generated in the operation process of the application software to a cloud server and marks time, closes an application program in a suspended state when the upper limit of an operation space is reached in the operation process of RPA data capture, calculates whether the expected operation residual space of the terminal equipment meets the normal operation of the RPA data capture, adjusts the task amount of the RPA data capture if the expected operation residual space does not meet the normal operation of the RPA data capture, and avoids the overlarge operation memory of the terminal equipment due to the RPA data capture, resulting in system crash of the terminal computer equipment. The problem of current because RPA robot data snatch set up the task volume great, the computer terminal breaks down under the RPA robot overload state, and the RPA robot can't normally operate and snatch data is solved.
Drawings
In order to more clearly illustrate the technical solution of the present invention, the drawings needed to be used in the embodiments will be briefly described below, and it is obvious to those skilled in the art that other drawings can be obtained according to the drawings without any inventive exercise.
Fig. 1 is a schematic price diagram of a universal data acquisition system based on an RPA robot according to an embodiment of the present invention;
fig. 2 is a schematic diagram illustrating a step of an evaluation detection unit of a universal data acquisition system based on an RPA robot according to an embodiment of the present invention;
fig. 3 is a schematic diagram of a logic construction unit of a universal data acquisition system based on an RPA robot according to an embodiment of the present invention;
fig. 4 is a schematic diagram of a step of an operation state analysis unit of a RPA robot-based general data acquisition system according to an embodiment of the present invention;
fig. 5 is a schematic diagram of a step of an operation space analysis unit of a RPA robot-based general data collection system according to an embodiment of the present invention.
Detailed Description
In order to make the objects, technical solutions and advantages of the present invention more apparent, the technical solutions of the present invention will be clearly and completely described below with reference to the specific embodiments of the present invention and the accompanying drawings. It is to be understood that the described embodiments are merely exemplary of the invention, and not restrictive of the full scope of the invention. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention. The technical solutions provided by the embodiments of the present invention are described in detail below with reference to the accompanying drawings.
Referring to fig. 1, the present invention provides a RPA robot-based universal data acquisition system, including; the terminal equipment is connected with the background control end through the server;
the acquisition unit 101 is used for acquiring the running state parameters of the data capture system of the terminal equipment in the RPA data acquisition state by the server;
the server side collects parameters of terminal equipment such as computers, mobile phones, tablet computers and the like in the running state.
The evaluation detection unit 102 is configured to bring the system running state parameters of the terminal device in the RPA data acquisition state into a terminal system running state evaluation model by the server side to obtain a terminal device system running state result;
and the system running state parameters in the RPA data acquisition state are brought into the terminal system running state evaluation model, and the obtained data is analyzed and judged to obtain the result of whether the RPA data acquisition capture is normal or not.
A logic construction unit 103, wherein the server constructs an application management service flow processing logic database through an RPA according to the operation state result of the terminal device system, and executes the application management service flow processing logic;
when the RPA robot captures and collects data frequently, the RPA robot occupies a large running memory space of the terminal equipment, so that system breakdown of the terminal equipment is avoided, application software is managed by establishing RPA robot service processing logic, and multiple sets of service processing logic are established, so that the RPA robot can be conveniently selected for use according to use conditions.
The operation state analysis unit 104 is used for detecting the system operation condition and analyzing data of the terminal equipment system executing the application management business process processing logic by the server side;
and analyzing the data in the running state, detecting the system running condition of the terminal equipment system which executes the application management business process processing logic by the server side to obtain a detection result of the terminal equipment system, and if the running state of the terminal equipment system accords with a preset value, the terminal equipment system runs normally.
And the operation space analysis unit 105 is used for analyzing and processing data by the server according to the detection result of the terminal equipment system under the normal operation of the terminal equipment system to obtain the maximum collection amount of RPA general data.
The server side carries out data analysis processing according to the terminal equipment system detection result under the normal operation of the terminal equipment system to obtain the maximum collection amount of RPA general data, operation data collection is carried out on terminal equipment under the normal operation of the RPA operation to judge the maximum terminal equipment operation load capacity, in the RPA data capturing operation process, the operation of other application software is suspended on the terminal equipment, data generated in the application software operation process is stored in a cloud server and time is marked, when the RPA data capturing operation process reaches the upper limit of the operation space, the RPA is closed to close an application program in the suspended state, whether the expected operation residual space of the terminal equipment meets the normal operation of the RPA data capturing is calculated, if not, the task amount of the RPA data capturing is adjusted, and the phenomenon that the terminal computer system is crashed due to the fact that the RPA data capturing occupies too large operation memory of the terminal equipment is avoided.
Further, referring to fig. 2, the evaluation detection unit includes;
s201, the server side enables acquisition parameters of the terminal equipment in an RPA data acquisition state to include the running number of application software of the terminal equipment and the percentage of running memory space occupied by the running of the application software;
s202, constructing a time-interval collection service process of the RPA robot, and collecting collection parameters in a time-interval collection state of the RPA data;
for the collection time of the RPA robot for collecting the service, a method for collecting the residual situation of the operation space of the terminal equipment by time segmentation is adopted, the residual situation of the operation space of the terminal equipment can be mastered in real time, and an adaptive decision is made.
And S203, if the parameters of the acquisition parameters in the RPA data acquisition state are abnormal, suspending the RPA robot data acquisition task and feeding back an error report to the background control end.
The RPA data capturing process is summarized to generate system errors, the RPA robot data collecting task is suspended, error reporting data contents are sent to the background control end, and managers can process data fed back by the background control end and repair the system.
Further, referring to fig. 3, the logic constructing unit includes:
s301, after an RPA data capturing task is started, establishing a static constant safe operation memory upper limit value according to the size of an existing terminal equipment operation space memory;
the static constant safe operation memory upper limit value is used for ensuring the maximum operation memory residual space of the application software in the terminal equipment under the normal operation state.
S302, after the RPA data capturing task runs, storing an application software running memory in a running state except the RPA data capturing task to a cloud server, and suspending the application software running in the running state except the RPA data capturing task;
and S303, when the RPA runs to a critical point, transmitting the time node record data to a storage cloud space corresponding to the application software, establishing a closing time node, and closing the application software.
When the RPA captures data and reaches the upper limit of the operation space in the operation process, the RPA is closed to close the application program in the pause state, whether the expected operation residual space of the terminal equipment meets the normal operation of the RPA for capturing data is calculated, if not, the task amount of the RPA for capturing data is adjusted, and the problem that the terminal computer equipment system is crashed because the RPA captures the data and occupies too large operation memory of the terminal equipment is avoided.
Further, referring to fig. 4, the operation state analysis unit includes:
s401, the server side detects the system running condition of the terminal equipment system which executes the application management business process processing logic to obtain a detection result of the terminal equipment system;
whether the data processing business process normally operates or not needs to be mastered in real time, errors in the data business process are avoided, and the detection results of the terminal equipment system need to be sorted, summarized and stored.
S402, if the running state of the terminal equipment system accords with a preset value, the terminal equipment system runs normally.
Further, referring to fig. 5, the runtime analysis unit includes:
s501, analyzing and processing the data, wherein the analyzing and processing comprise operation memory space data of the terminal equipment, hardware equipment temperature data of the terminal equipment and load capacity data of the terminal equipment in an expected time period;
s502, evaluating the operation content occupied by the terminal equipment in the RPA data acquisition predicted time period to obtain RPA data acquisition operation space demand data in the predicted time period;
and S503, comparing the expected time period RPA data acquisition operation space requirement data with the load capacity data in the expected time period of the terminal equipment, and if the data comparison result is abnormal, feeding back information to the background control end.
From the above embodiments, the present invention provides a universal data collecting system based on an RPA robot, including; the terminal equipment is connected with the background control end through the server, the server end acquires data capture system running state parameters of the terminal equipment in an RPA data acquisition state, the server end brings the system running state parameters of the terminal equipment in the RPA data acquisition state into a terminal system running state evaluation model to obtain a terminal equipment system running state result, the server constructs an application management service flow processing logic database through the RPA according to the terminal equipment system running state result and executes the application management service flow processing logic, and the server end performs system running condition detection and data analysis on the terminal equipment system executing the application management service flow processing logic, the server side carries out data analysis processing according to the detection result of the terminal equipment system under the normal operation of the terminal equipment system to obtain the maximum collection amount of RPA general data, the maximum load capacity of the maximum terminal equipment operation is judged by carrying out operation data collection on the terminal equipment under the normal operation of the terminal equipment system, the terminal equipment suspends the operation of other application software in the operation process of RPA data capturing, the data generated in the operation process of the application software is stored in a cloud server and time is marked, when the upper limit of the operation space is reached in the operation process of RPA data capturing, the RPA is closed to close an application program in the suspended state, whether the expected operation residual space of the terminal equipment meets the normal operation of the RPA data capturing is calculated, if not, the task amount of the RPA data capturing is adjusted, and the phenomenon that the terminal equipment operation memory is excessively large due to the RPA data capturing is avoided, resulting in system crash of the terminal computer equipment. The problem of current because RPA robot data snatch set up the task volume great, the computer terminal breaks down under the RPA robot overload state, and the RPA robot can't normally operate and snatch data is solved.
Those skilled in the art will readily appreciate that the techniques of the embodiments of the present invention may be implemented using software plus any required general purpose hardware platform. Based on such understanding, the technical solutions in the embodiments of the present invention may be substantially or partially embodied in the form of a software product, which may be stored in a storage medium, such as a ROM/RAM, a magnetic disk, an optical disk, or the like, and includes several instructions for enabling a computer device (which may be a personal computer, a server, or a network device) to execute the method according to the embodiments or some parts of the embodiments.
The above-described embodiments of the present invention should not be construed as limiting the scope of the present invention.
Claims (5)
1. A universal data acquisition system based on an RPA robot is characterized by comprising; the terminal equipment is connected with the background control end through the server;
the server side acquires the operating state parameters of the data capture system of the terminal equipment in the RPA data acquisition state;
the system running state parameters of the terminal equipment in the RPA data acquisition state are brought into a terminal system running state evaluation model by the server side to obtain a terminal equipment system running state result;
the server constructs an application management service flow processing logic database through the RPA according to the operation state result of the terminal equipment system and executes the application management service flow processing logic;
the server side detects the system running condition and analyzes data of the terminal equipment system which executes the application management business process processing logic;
and the server side performs data analysis processing according to the detection result of the terminal equipment system under the normal operation of the terminal equipment system to obtain the maximum collection amount of the RPA general data.
2. The system of claim 1, wherein the evaluation detection unit comprises;
the server side enables the acquisition parameters of the terminal equipment in the RPA data acquisition state to include the running quantity of the application software of the terminal equipment and the percentage of the running memory space occupied by the running of the application software;
constructing a time-interval collection service process of the RPA robot, and collecting collection parameters in a time-interval collection state of the RPA data;
and if the parameters of the collection parameters in the RPA data collection state are abnormal, suspending the RPA robot data collection task and feeding back an error report to the background control end.
3. The system of claim 1, wherein the logic building unit comprises:
after an RPA data capturing task is started, establishing a static constant safe operation memory upper limit value according to the size of an existing terminal equipment operation space memory;
after the RPA data capturing task runs, storing an application software running memory in a running state except the RPA data capturing task to a cloud server, and suspending the application software running in the running state except the RPA data capturing task;
and when the RPA runs to a critical point, transmitting the time node record data to a corresponding storage cloud space of the application software, establishing a closing time node, and closing the application software.
4. The system of claim 1, wherein the operating condition analysis unit comprises:
the server side detects the system operation condition of the terminal equipment system which executes the application management business process processing logic to obtain a detection result of the terminal equipment system;
and if the running state of the terminal equipment system accords with a preset value, the terminal equipment system runs normally.
5. The system of claim 1, wherein the runtime analysis unit comprises:
the data analysis processing comprises the operation memory space data of the terminal equipment, the hardware equipment temperature data of the terminal equipment and the load capacity data of the terminal equipment in an expected time period;
evaluating the operation content occupied by the terminal equipment in the RPA data acquisition expected time period to obtain the RPA data acquisition operation space requirement data in the expected time period;
and comparing the expected RPA data acquisition operating space demand data with the load capacity data in the expected time period of the terminal equipment, and if the data comparison result is abnormal, feeding back information to the background control end.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202211149328.0A CN115643181A (en) | 2022-09-21 | 2022-09-21 | Universal data acquisition system based on RPA robot |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202211149328.0A CN115643181A (en) | 2022-09-21 | 2022-09-21 | Universal data acquisition system based on RPA robot |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN115643181A true CN115643181A (en) | 2023-01-24 |
Family
ID=84942221
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202211149328.0A Pending CN115643181A (en) | 2022-09-21 | 2022-09-21 | Universal data acquisition system based on RPA robot |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN115643181A (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN116151999A (en) * | 2023-03-17 | 2023-05-23 | 杭州工猫科技有限公司 | RPA-based enterprise automatic tax return method and system |
-
2022
- 2022-09-21 CN CN202211149328.0A patent/CN115643181A/en active Pending
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN116151999A (en) * | 2023-03-17 | 2023-05-23 | 杭州工猫科技有限公司 | RPA-based enterprise automatic tax return method and system |
| CN116151999B (en) * | 2023-03-17 | 2023-09-26 | 杭州工猫科技有限公司 | RPA-based enterprise automatic tax return method and system |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN107294808B (en) | Interface test method, device and system | |
| CN108092836A (en) | The monitoring method and device of a kind of server | |
| CN109753998A (en) | The fault detection method and system, computer program of network are generated based on confrontation type | |
| EP2869144A1 (en) | Simulation testing platform for wind power plant and testing method thereof | |
| CN110826071A (en) | Software vulnerability risk prediction method, device, equipment and storage medium | |
| CN104899130A (en) | Application program management method and system | |
| CN104572031A (en) | Method and device for generating test case | |
| US11704186B2 (en) | Analysis of deep-level cause of fault of storage management | |
| WO2023104121A1 (en) | Testing method and apparatus for test case, and electronic device and storage medium | |
| CN109117526A (en) | One kind being suitable for mechanical system maintenance of equipment and guides data record and analysis system | |
| CN115643181A (en) | Universal data acquisition system based on RPA robot | |
| CN111309609B (en) | software processing system | |
| CN115952081A (en) | Software testing method, device, storage medium and equipment | |
| CN111538608A (en) | Method for preventing terminal equipment from being down, terminal equipment and storage medium | |
| CN109376981B (en) | Data processing mode determining method and device, server and data processing method | |
| CN117421217A (en) | Automatic software function test method, system, terminal and medium | |
| CN113760689A (en) | Interface fault alarm method, device, equipment and storage medium | |
| CN115952020A (en) | Page abnormity detection method, medium, device and computing equipment | |
| CN114385398A (en) | Request response state determination method, device, equipment and storage medium | |
| CN112291302B (en) | Internet of things equipment behavior data analysis method and processing system | |
| CN111694752A (en) | Application testing method, electronic device and storage medium | |
| CN111861021A (en) | Business risk prediction method, device, equipment and computer readable storage medium | |
| CN113220379B (en) | Task processing method and device, electronic equipment and readable storage medium | |
| CN104035866A (en) | Software behavior evaluation method and device based on system calling and analysis | |
| CN114253867B (en) | Automatic testing method, device and system based on neural network model |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |