CN116560819A - RPA-based batch automatic operation method, system, equipment and storage medium - Google Patents

RPA-based batch automatic operation method, system, equipment and storage medium Download PDF

Info

Publication number
CN116560819A
CN116560819A CN202310840106.1A CN202310840106A CN116560819A CN 116560819 A CN116560819 A CN 116560819A CN 202310840106 A CN202310840106 A CN 202310840106A CN 116560819 A CN116560819 A CN 116560819A
Authority
CN
China
Prior art keywords
rpa
script
automation
end request
execution
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN202310840106.1A
Other languages
Chinese (zh)
Other versions
CN116560819B (en
Inventor
张静波
姜全尧
邢翠霞
郭亮
姜晓东
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Beijing Ideal Information Technology Co ltd
Original Assignee
Beijing Ideal Information Technology Co ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Beijing Ideal Information Technology Co ltd filed Critical Beijing Ideal Information Technology Co ltd
Priority to CN202310840106.1A priority Critical patent/CN116560819B/en
Publication of CN116560819A publication Critical patent/CN116560819A/en
Application granted granted Critical
Publication of CN116560819B publication Critical patent/CN116560819B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F9/00—Arrangements for program control, e.g. control units
    • G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
    • G06F9/46—Multiprogramming arrangements
    • G06F9/48—Program initiating; Program switching, e.g. by interrupt
    • G06F9/4806—Task transfer initiation or dispatching
    • G06F9/4843—Task transfer initiation or dispatching by program, e.g. task dispatcher, supervisor, operating system
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/90—Details of database functions independent of the retrieved data types
    • G06F16/95—Retrieval from the web
    • G06F16/951—Indexing; Web crawling techniques
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F9/00—Arrangements for program control, e.g. control units
    • G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
    • G06F9/44—Arrangements for executing specific programs
    • G06F9/451—Execution arrangements for user interfaces
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00—Computing arrangements based on biological models
    • G06N3/02—Neural networks
    • G06N3/04—Architecture, e.g. interconnection topology
    • G06N3/045—Combinations of networks
    • G06N3/0455—Auto-encoder networks; Encoder-decoder networks
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00—Computing arrangements based on biological models
    • G06N3/02—Neural networks
    • G06N3/04—Architecture, e.g. interconnection topology
    • G06N3/048—Activation functions
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00—Computing arrangements based on biological models
    • G06N3/02—Neural networks
    • G06N3/08—Learning methods
    • G06N3/088—Non-supervised learning, e.g. competitive learning
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q10/00—Administration; Management
    • G06Q10/10—Office automation; Time management
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00—Arrangements for image or video recognition or understanding
    • G06V10/70—Arrangements for image or video recognition or understanding using pattern recognition or machine learning
    • G06V10/82—Arrangements for image or video recognition or understanding using pattern recognition or machine learning using neural networks
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V30/00—Character recognition; Recognising digital ink; Document-oriented image-based pattern recognition
    • G06V30/10—Character recognition
    • G06V30/14—Image acquisition
    • G06V30/1444—Selective acquisition, locating or processing of specific regions, e.g. highlighted text, fiducial marks or predetermined fields
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00—Network arrangements or protocols for supporting network services or applications
    • H04L67/01—Protocols
    • H04L67/02—Protocols based on web technology, e.g. hypertext transfer protocol [HTTP]
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00—Network arrangements or protocols for supporting network services or applications
    • H04L67/50—Network services
    • H04L67/51—Discovery or management thereof, e.g. service location protocol [SLP] or web services
    • Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
    • Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
    • Y02P—CLIMATE CHANGE MITIGATION TECHNOLOGIES IN THE PRODUCTION OR PROCESSING OF GOODS
    • Y02P90/00—Enabling technologies with a potential contribution to greenhouse gas [GHG] emissions mitigation
    • Y02P90/02—Total factory control, e.g. smart factories, flexible manufacturing systems [FMS] or integrated manufacturing systems [IMS]

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Software Systems (AREA)
  • General Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • Data Mining & Analysis (AREA)
  • Evolutionary Computation (AREA)
  • Artificial Intelligence (AREA)
  • Health & Medical Sciences (AREA)
  • Computing Systems (AREA)
  • General Health & Medical Sciences (AREA)
  • Business, Economics & Management (AREA)
  • Mathematical Physics (AREA)
  • Molecular Biology (AREA)
  • Computational Linguistics (AREA)
  • Databases & Information Systems (AREA)
  • Biomedical Technology (AREA)
  • Biophysics (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Human Resources & Organizations (AREA)
  • Strategic Management (AREA)
  • Signal Processing (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Multimedia (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Entrepreneurship & Innovation (AREA)
  • Economics (AREA)
  • Human Computer Interaction (AREA)
  • Medical Informatics (AREA)
  • Marketing (AREA)
  • Operations Research (AREA)
  • Quality & Reliability (AREA)
  • Tourism & Hospitality (AREA)
  • General Business, Economics & Management (AREA)
  • User Interface Of Digital Computer (AREA)
  • Stored Programmes (AREA)

Abstract

The invention discloses a batch automation operation method, a system, equipment and a storage medium based on RPA, wherein the method comprises the following steps: recording operation steps in batches based on a PRA system, respectively generating scripts, and managing the scripts through a dubbo architecture; receiving a front-end request; analyzing the operation time, the operation frequency and the associated script of the front-end request; and sending the operation time and the operation frequency of the front-end request to an Agent at the opposite end through a dubbo protocol, and executing the association script by the Agent according to the front-end request. Through the processing scheme disclosed by the invention, operation automation is realized, and the effects of reducing operation risk, improving operation efficiency and improving operation value are achieved.

Description

RPA-based batch automatic operation method, system, equipment and storage medium
Technical Field
The invention relates to the technical field of automatic operation, in particular to an RPA-based batch automatic operation method, an RPA-based batch automatic operation system, RPA-based batch automatic operation equipment and a storage medium.
Background
With the advancement of digitization, the number of service systems is increased, the cross-system service process is more complex, and a data island is formed, so that a large number of repeated system operation processes needing to be manually executed, such as month report statistics, year report statistics, report summary and the like, are generated. The traditional solution is to develop a system interface or a reconfiguration system by a technical department, so that the cost is high and the quick response to the change of the service requirement is difficult; in addition, part of service requirements cannot be landed because an internal and external system interface cannot be opened, and the service requirements can be only manually executed.
It is apparent that the above-mentioned conventional automatic operation method still has inconvenience and defects in use, and further improvement is needed. How to create a new automatic operation method becomes the aim of improvement in the current industry.
Disclosure of Invention
In view of this, embodiments of the present disclosure provide a batch automation operation method based on RPA, which at least partially solves the problems existing in the prior art.
In a first aspect, an embodiment of the present disclosure provides an RPA-based batch automation operation method, the method including the steps of:
recording operation steps in batches based on a PRA system, respectively generating scripts, and managing the scripts through a dubbo architecture;
receiving a front-end request;
analyzing the operation time, the operation frequency and the associated script of the front-end request;
and sending the operation time and the operation frequency of the front-end request to an Agent at the opposite end through a dubbo protocol, and executing the association script by the Agent according to the front-end request.
According to a specific implementation of an embodiment of the disclosure, the method further includes:
judging whether the script is successfully executed according to the expected return value of the script; wherein, when the execution is successful, the operation is ended; when the execution fails, the alarm is given and the manual processing is waited.
According to a specific implementation manner of an embodiment of the disclosure, the receiving a front-end request includes:
executing a script according to preset running time and running frequency; the method comprises the steps of,
and respectively executing a plurality of scripts according to a preset rule by using a preset running time and a preset running frequency.
According to a specific implementation manner of the embodiment of the disclosure, the PRA-based system batch recording operation steps and script generation include the following steps:
acquiring operation information in a recording mode;
converting the operation information into a language recognizable by the RPA robot;
the RPA robot is trained and a script is generated based on the operation information converted into the recognizable language of the RPA robot.
According to a specific implementation manner of the embodiment of the present disclosure, the operation information includes: screen data, mouse operation data, and keyboard operation data; wherein,,
the mouse operation data includes: single click, double click, right click and drag;
the keyboard operation data includes: keyboard input, shortcut key use and combination key use;
the screen data includes windows, buttons, and drop down lists.
According to one specific implementation of an embodiment of the present disclosure, the method is used for bare metal installation, software automation installation, script development and flow programming.
In a second aspect, embodiments of the present disclosure provide an RPA-based batch automation operating system, the system comprising:
the acquisition module is configured to record operation steps in batches based on the PRA system, respectively generate scripts and manage the scripts through a dubbo framework;
the analysis module is configured to receive the front-end request; analyzing the operation time, the operation frequency and the associated script of the front-end request;
and the execution module is configured to send the operation time and the operation frequency of the front-end request to the opposite-end Agent through the dubbo protocol, and the Agent executes the association script according to the front-end request.
According to a specific implementation of an embodiment of the disclosure, the system further includes:
the judging module is configured to judge whether script execution is successful or not according to expected return values of the script; wherein, when the execution is successful, the operation is ended; when the execution fails, the alarm is given and the manual processing is waited.
In a third aspect, embodiments of the present disclosure further provide an electronic device, including:
at least one processor; the method comprises the steps of,
a memory communicatively coupled to the at least one processor; wherein,,
The memory stores instructions executable by the at least one processor, which when executed by the at least one processor, cause the at least one processor to perform the RPA-based batch automation method of any one of the foregoing first aspect or any implementation of the first aspect.
In a fourth aspect, the presently disclosed embodiments also provide a non-transitory computer-readable storage medium storing computer instructions that, when executed by at least one processor, cause the at least one processor to perform the RPA-based batch automation method of the first aspect or any implementation of the first aspect.
In a fifth aspect, embodiments of the present disclosure also provide a computer program product comprising a computer program stored on a non-transitory computer readable storage medium, the computer program comprising program instructions which, when executed by a computer, cause the computer to perform the RPA-based batch automation method of the first aspect or any implementation of the first aspect.
According to the RPA-based batch automation operation method in the embodiment of the disclosure, the object handle element is grabbed, the webpage label is grabbed, the image is grabbed, OCR (optical character recognition) is utilized, and the object handle element is grabbed according to the coordinate position and other special grabbing modes. The method can be compatible with IE, chrome, firefox different browser types and windows multiple software versions, automatically converts the operation atoms after grabbing into machine recognizable languages through an intelligent conversion method, intelligently converts the machine recognizable languages through python agility languages, expands based on python grammar, provides manual intervention repair for task points with problems, and reduces the operation design difficulty of robots. By converting the graphical operation into the machine language which can be identified by the machine, the labor cost is greatly reduced, and the automatic coverage rate is improved.
Drawings
The foregoing is merely an overview of the present invention, and the present invention is further described in detail below with reference to the accompanying drawings and detailed description.
Fig. 1 is a schematic diagram of a batch automation operation method based on RPA according to an embodiment of the disclosure;
fig. 2 is a schematic flow chart of a batch automation operation method based on RPA according to an embodiment of the disclosure;
FIG. 3 is a flow chart of an RPA-based batch automation operation method according to an embodiment of the disclosure;
FIG. 4 is a schematic diagram of an automatic encoder incorporating noise reduction provided in an embodiment of the present disclosure;
FIG. 5 is a schematic diagram of tilt angle correction provided by an embodiment of the present disclosure;
FIG. 6 is a schematic diagram of intelligent driving of a multi-robot joint job workflow provided by an embodiment of the present disclosure;
FIG. 7 is a schematic diagram of an embodiment of an RPA-based batch automation operating system according to an embodiment of the disclosure;
fig. 8 is a schematic structural diagram of an RPA-based batch automation operating system according to an embodiment of the present disclosure;
fig. 9 is a schematic diagram of an RPA-based system according to an embodiment of the disclosure; and
fig. 10 is a schematic diagram of an electronic device according to an embodiment of the disclosure.
Detailed Description
Embodiments of the present disclosure are described in detail below with reference to the accompanying drawings.
Other advantages and effects of the present disclosure will become readily apparent to those skilled in the art from the following disclosure, which describes embodiments of the present disclosure by way of specific examples. It will be apparent that the described embodiments are merely some, but not all embodiments of the present disclosure. The disclosure may be embodied or practiced in other different specific embodiments, and details within the subject specification may be modified or changed from various points of view and applications without departing from the spirit of the disclosure. It should be noted that the following embodiments and features in the embodiments may be combined with each other without conflict. All other embodiments, which can be made by one of ordinary skill in the art without inventive effort, based on the embodiments in this disclosure are intended to be within the scope of this disclosure.
It is noted that various aspects of the embodiments are described below within the scope of the following claims. It should be apparent that the aspects described herein may be embodied in a wide variety of forms and that any specific structure and/or function described herein is merely illustrative. Based on the present disclosure, one skilled in the art will appreciate that one aspect described herein may be implemented independently of any other aspect, and that two or more of these aspects may be combined in various ways. For example, an apparatus may be implemented and/or a method practiced using any number of the aspects set forth herein. In addition, such apparatus may be implemented and/or such methods practiced using other structure and/or functionality in addition to one or more of the aspects set forth herein.
In addition, in the following description, specific details are provided in order to provide a thorough understanding of the examples. However, it will be understood by those skilled in the art that the aspects may be practiced without these specific details.
The embodiment of the invention provides a batch automation operation method based on RPA, which mainly develops batch automation operation flow technology oriented to document, mail and work order processing and cross-system docking, and simultaneously realizes automation of business statistics, data check and data filling, bare metal installation, script development and flow arrangement based on an RPA system, and mainly comprises the following contents:
(1) Hardware input device simulation technique
An important technology in RPA robots is to simulate some operations of a mouse and a keyboard, such as mouse operations of clicking, double clicking, right clicking, dragging, etc., or keyboard operations of keyboard input, shortcut key use, combination key use, etc., which are important bases for the RPA to convert manual operations into machine language.
Unlike the existing RPA technology, when simulating mouse and keyboard operations, we need to perform manual "training" on the RPA robot based on the collected data, so that the RPA robot learns one or a series of operations to be performed. In the training process, the RPA robot recognizes the mouse dragging track, information input by a keyboard and the like through a complex man-machine operation automatic grabbing technology method, the accuracy is higher when the mouse operation is simulated through the automatic grabbing technology than that of the prior art, the phenomenon that the mouse dragging track is offset due to different hardware equipment is greatly reduced, one or a series of grabbed operations are automatically converted into a language which can be recognized by a machine through an intelligent conversion method, and the operations such as the mouse and the keyboard are simulated through the expansion of Python grammar. In the future, the RPA automation system will enlarge the wonderful color in the unattended aspect of operation and maintenance automation.
(2) Page element grabbing technology
To simulate manual operations on an application, the RPA robot must interact with various elements on the page, such as windows, buttons, drop-down lists, and the like. The screen capturing technology is to capture the data in the interface directly through the terminal or the display without accessing the underlying database or the interface, and is suitable for the legacy system which cannot be operated by a command and cannot be opened or accessed.
The traditional RPA screen capturing technology always faces great challenges of great difficulty in image recognition when encountering problems of complex background, artistic fonts, low resolution, non-uniform illumination, image degradation, character deformation, multi-language mixing, complex text line format, incomplete characters of a detection frame and the like, and the PRA automatic technology uses OCR-based image denoising and angle correction to improve the accuracy of image recognition through an intelligent AI algorithm, so that the accurate recognition of complex images is realized. The screen capturing technology improves the display level of the process automation processing, so that the technical processing process can be intuitively displayed in front of a user, and the usability and influence of the RPA are rapidly improved.
In the future, the accurate page element grabbing technology can be used in the market of IT, medicine, optics and other fields.
(3) Automatic substitution and filling of verification code
Verification codes are a problem frequently encountered in RPA process automation. Such as when a web page or client logs in, or submitting a data ping, may encounter a verification code. In order to simulate the complete operation of a manual login system, the RPA needs to complete the security verification when logging in a specific website, the security verification mode comprises a verification picture consisting of 4-bit random numbers or letters, or a complete image is formed by combining the parts with the missing drag, and the like.
(4) Batch scheduling automation
Batch is a repetitive work that runs long in IT operation and maintenance operations, and the time period for batch job execution spans very large, varying from a few minutes to tens of hours. Batch operation is mostly completed manually by operators, login to different servers through Telnet and the like, execution of respective batch programs, and manual monitoring and management during execution are required. The batch operation is manually executed, and various checks are performed: the detection of the conditions before scheduling and the monitoring of the results after scheduling are completely carried out by operators following relevant regulations and historical experience, the execution efficiency is low, the workload of the operators is greatly increased, and the batch operation automation system based on RPA can greatly reduce the error risk of manual operation.
Firstly, the operation steps are recorded and executed in batches through an RPA system, a python script is generated, and then the python script is transmitted to a batch scheduling automation system for task scheduling. The batch dispatching automation can realize cyclic call, concurrent call, branch call and the like by configuring the workflow at the Server, the task is automatically distributed at fixed time after the workflow is analyzed by the Server, and the Python script can be automatically executed after the task is received by the agent, so that the dispatching automation of batch tasks is realized. Thus, batch jobs of an open system, a virtual architecture, a distributed and micro-service architecture can be uniformly scheduled and managed through one platform, so that uniform management and uniform scheduling of various scheduling jobs are realized. The manual operation is replaced by batch dispatching automation, so that the risks of manual misoperation and forgetting operation are fundamentally solved, the fault rate possibly caused by the manual error is eliminated, and the error account risk is avoided; meanwhile, batch operation management is carried out through a centralized management platform, so that users and passwords are effectively isolated, and the system safety is improved; the potential safety hazard brought by excessive manual participation steps to the application system is solved.
(5) Application change automation
Along with the rapid development of the IT operation and maintenance age, the application scale has increased, and the problems of shortened delivery period, increased frequency and the like of application change lead to the increase of the personnel flow frequency and the increase of the change operation risk. By implementing automation of application deployment, a set of standardized operation flows are obtained, operation and maintenance personnel are released from complex traditional operation and maintenance work, knowledge and skills of the operation and maintenance personnel are applied to more valuable work and tasks, expensive human errors are eliminated, and the reliability of the whole application deployment process is improved, as shown in fig. 1.
The application change automation system changes the machine language by 'training' the manual operation of the robot by means of the information grabbing of the passing elements of the RPA system, so that the automation operation of the application change is realized, the change can be obviously and greatly promoted by the automation implementation of application deployment, and compared with the efficiency of the traditional application change, the time consumption of the automation deployment can be reduced by more than 75%, so that more change tasks can be arranged in one change window.
The basic design method comprises the following steps: the method comprises the steps that the dubbo architecture is used for realizing the management of RPA generation machine language, management and consumption of a release script are provided for a release module, a Server side (Server) mainly completes access support capability of an application front end, after receiving a front end request, a Provider (EntegorProvider) sends the request to an Agent (Agent side program) at an opposite end through a dubbo protocol, the Agent executes a downlink instruction, and an execution result is fed back to the Provider, and if a proxy (EntegorProgramming is involved, the proxy is responsible for forwarding information between the Provider and the Agent, and finally the Provider updates a task result to a database. Through a series of automatic operations, the steps of stopping and updating the application, updating the database, starting the application and the like are realized, the operation risk is greatly reduced, and a large amount of labor force is saved.
(6) Daily operation automation
Under the current trend of two-state operation and maintenance, cloud computing and big data are gradually dominant, whether steady state operation and maintenance based on the traditional industry of banks or sensitive state operation and maintenance based on emerging enterprises of the Internet are faced with the problems of business volume expansion, application system increase, mass server installation, frequent software upgrading installation and the like, and in the whole operation and maintenance field, the operation and maintenance scenes are various. While daily operation automation is applicable to the following scenarios: bare engine installation, script development, process arrangement and the like, unified script development, control and operation and maintenance operation automation are realized, and the purposes of reducing operation and maintenance risks, improving operation and maintenance efficiency and improving operation and maintenance value are achieved.
The daily operation automation uses equipment such as a server and the like as basic resources, and an RPA automation system is adopted to generate an automation script and upgrade an installation flow, so that the operation system installation and the software automatic installation are realized, and finally the automatic installation from bare metal installation to various software is realized. The automation of daily operation adopts SOA (service oriented architecture) technology from design to development, the whole architecture conforms to JAVA EE specification, a plurality of advanced technologies are adopted in actual development, and technologies such as cross-platform and ultra-large-scale message communication and integration technologies are adopted, so that the full-channel equipment access and the like are realized. A series of processes such as initiation, approval, execution, verification and the like of daily operation and maintenance tasks are realized. The operation and maintenance process is not perceived, the operation and maintenance operation is zero to participate, and the operation and maintenance result is visualized, so that the final service operation target of the data center which is unattended is finally achieved.
Fig. 2 is a schematic diagram of a flow of an RPA-based batch automation operation method according to an embodiment of the disclosure.
Fig. 3 is a flow diagram of an RPA-based batch automation method corresponding to fig. 2.
As shown in fig. 2, at step S110, the operation steps are recorded in batches based on the PRA system, and scripts are generated and managed through the dubbo architecture, respectively.
In an embodiment of the present invention, the operation steps include: screen data, mouse operation data, and keyboard operation data; wherein, the mouse operation data includes: single click, double click, right click and drag; the keyboard operation data includes: keyboard input, shortcut key use and combination key use; the screen data includes windows, buttons, and drop down lists.
In the embodiment of the invention, the recorded operation information is acquired through at least one of object handle element grabbing, webpage label grabbing, image grabbing, OCR (optical character recognition) and coordinate position grabbing.
In an embodiment of the present invention, the OCR recognition includes the steps of: preprocessing an image; wherein the preprocessing comprises: binarizing the image based on a fixed threshold algorithm and an Otsu algorithm; the self-adaption enhancement of the low-noisiness image is realized by introducing a sequential similarity detection algorithm into LLNet; and correcting the inclination angle of the image through Randon transformation.
More specifically, the complex image accurate recognition and automatic verification method is realized based on OCR, and is as follows:
optical character recognition technology (Optical Character Recognition, OCR) is a technology that analyzes and recognizes literal characters in an image and converts them into character sequences in an editable text format. In the text format conversion process, the problems of complex background, artistic fonts, low resolution, non-uniform illumination, image degradation, character deformation, multi-language mixing, complex layout of text lines, incomplete characters of a detection frame and the like are inevitably encountered. In view of the above problems, the present application sets the gray value of the pixel point to 0 or 255 by binarization, so that the image exhibits a remarkable black-and-white effect. Binarization reduces data dimension on one hand, and highlights outline structure of effective area by eliminating interference caused by noise in original image on the other hand; adopting a neural network-based LLNet method, and realizing self-adaptive enhancement of the low-noisiness picture by introducing the idea of a sequential similarity detection algorithm; the condition of picture character rotation and displacement is solved by adopting a Randon conversion method.
The method for automatically identifying the complex image verification code based on the neural network training model is used for combing the advantages and disadvantages and principles of different methods, further enhancing the compatibility of the model to different types of verification modes under the condition of ensuring the accuracy and speed of picture identification, and automatically replacing and filling based on the identification result so as to improve the success rate of intelligent identification verification of the image and assist the RPA to complete correct login of the system.
1. Automatic grabbing and machine language intelligent conversion method for complex man-machine operation
According to the technical implementation mode division of information grabbing, the grabbing technology to be adopted in the application comprises the following steps: grabbing according to object handle elements, grabbing according to webpage labels, grabbing according to images, grabbing according to coordinate positions by utilizing OCR (optical character recognition) and other special type grabbing modes.
(1) The grabbing is realized according to the object handle element: the handle refers to a pointer pointing to a certain structure in the operating system memory, and is set up in Windows because of the need of memory management, and Windows uses the handle to record the change of the data address. Handles identify different types of object instances in an application, such as windows, buttons, icons, scroll bars, output devices, controls, or files. At the same time, windows also provide related APIs to get these window handles, such as FindWindow, enummwindows, and enummchild Windows (get all top-level Windows and their child Windows) functions.
(2) Capturing is achieved according to the webpage label: most Web page source code is written in HTML, and the data in the page is identified by various HTML tags, such as < head >, < title >, < div >, < tr >, < td >, etc., which grab the data in the Web page and most importantly locate the data accurately in the page. The method is used for querying a certain element in the Web page through the key value or the characteristic value, such as ID, name, tag, link, DOM, XPath, cssSelector. The values of elements in the page, such as ID, name, tag, link, are often changed, but the structure of the page is usually unchanged, and in order to ensure the grabbing accuracy, the page elements used in the application are XPath and CssSelecter. XPath is a language that locates elements in an XML document. Because HTML can be seen as an implementation of XML, the position of an element in a page can be converted to XPath to represent, such as XPath =// div = 'lMenus' ]/div [1]/div [2]/span [1]; CSS (Cascading Style Sheets) is a specialized language used to describe HTML and XML document presentations. CssSelector may be an element binding property in a web page, such as css=input [ name= "username" ].
(3) Grabbing is realized by using an image comparison technology: the image capturing technology is utilized to pre-store the image of a certain object to be queried, such as the image of a button or a drop-down control, and when the robot queries the object in the desktop window, the query and comparison are carried out on the image of the whole window according to the pre-stored image of the object. And if the matching is successful, the robot can acquire the coordinate position of the image and perform the next operation. In the application, in order to improve the stability of image query, parameters such as a comparison range, a comparison mode, retry times, and accuracy requirements of an object image are preset in the RPA software.
(4) Grabbing is realized according to the interface coordinate position: in this application, in order to ensure the capability of capturing information under various conditions, RPA software provides a function of acquiring interface elements according to the coordinate positions of the interfaces, and such a function is often used in early automation software, but due to the problems of uncertainty of the opening position of the interface and low resolution of the interface each time, such a method is rarely adopted in the implementation of RPA technology at present. This capability is provided in the present application in order to accommodate the inability of the various techniques previously discussed to be implemented, the inability of the client program's interface location to be adjusted at will, and the inability of the size to be scaled.
2. Method for realizing accurate recognition and automatic verification of complex image based on OCR
Text recognition can be categorized essentially as a serialization annotation problem, the main goal being to find a mapping of text string images to text string content, much like some tasks in natural language processing. Of course, word recognition is not a small difference compared to natural language processing because it has some uniqueness. Firstly, local characteristics, wherein the local part in the text string can be directly reflected in the whole recognition target; secondly, the combination characteristic is that the combination of the text strings is changed in a lot, the number of English words in common use is tens of thousands, and the combination of Chinese characters is more, so that the combination is changed in a lot. Based on practical considerations, the method and the device adopt the steps of firstly dividing the image into single words, then identifying the category of the single words, and then stringing the results, wherein the most critical is image preprocessing. In the application, the image preprocessing is mainly realized through binarization, denoising and inclination angle detection correction.
(1) Binarization
The image binarization sets the gray value of the pixel point to 0 or 255, so that the image presents obvious black-white effect. Binarization reduces data dimension on one hand, and highlights outline structure of effective area by eliminating interference caused by noise in original image on the other hand.
In the application, in order to ensure the recognition accuracy, a fixed threshold algorithm and an Otsu algorithm are combined to realize binarization. The fixed threshold method is to uniformly use the same fixed threshold for all pixels in the input image. The basic idea is as follows:
… … equation 1
Wherein,,a fixed threshold value with the coordinate point (x, y); t is a global threshold, and x is the image abscissa; y is the ordinate of the image; the main drawback of the fixed threshold method is that it is difficult to determine the optimal threshold for different input images. To address this problem, the present application combines the Otsu algorithm together.
The Otsu algorithm is also called as a maximum inter-class variance method, and is an adaptive threshold determination method, and the basic idea is described as follows:
the input image is considered as L gray levels,the total number of pixels is known by indicating the number of pixels having a gray level i. By means of the normalized gray level histogram, it is regarded as probability distribution of the input image +.>：
… … equation 2
Now assume that in the firstSetting a threshold value for each gray level, dividing the image into +.>And->(background and target object),>the expression gray level is [1, …, ]>]Pixel points of->Representing gray level [ ]>+1，…，L]The probability of occurrence of two classes and the average value of gray levels in the classes are respectively as follows:
… … equation 3
… … equation 4
… … equation 5
… … equation 6
Wherein,,is->Probability of occurrence; />Is a histogram; />From 1 to +.>Is a cumulative occurrence probability of (a);is->Probability of occurrence; />Is->Is a gray scale of (2); />Is->Is a gray scale of (2); />Is the average gray level of the whole image;from 1 to +.>Is used for the average gray level of (a). Can be easily verified for any +.>The values are as follows:
… … equation 7
The intra-class variances of these two classes are given by equations 8, 9:
… … equation 8
… … equation 9
Wherein,,is->Is a variance of (2); />Is->Is a variance of (c).
To evaluate the threshold valueIntroducing discriminant, and measuring according to the standard of the discriminant:
… … equation 10
… … equation 11
… … equation 12
… … equation 13
Wherein,,、/>、/>a judgment variable for evaluating the definition of the picture is preset; />Respectively the intra-class variance, the inter-class variance and the total variance of the gray level. The problem is converted into an optimization problem, i.e. a +.>Making it possible to maximize the objective function in equation 10. The following relationship always exists:
… … equation 14
And->Are all->Function of (2), but->But do not meet->Is irrelevant; and->Based on second order statistics (class variance), but +.>Then it is based on first order statistics (class mean). Thus, η is the discrimination +. >The simplest measurement of the value is as follows:
… … equation 15
To this end, the best resultsValue selection->The method comprises the following steps:
… … equation 16
(2) Denoising method
In the application, the image noise processing is to adopt a neural network-based LLNet method, and the LLNet realizes the self-adaptive enhancement (brightness enhancement and denoising) of the low-noisiness picture by introducing the idea of a sequential similarity detection algorithm.
First, an Auto-Encoder (AE) will be described. AE belongs to non-supervised learning and consists of a three-layer network, wherein the number of neurons of an input layer is equal to that of neurons of an output layer, and the number of neurons of a middle layer is less than that of neurons of the input layer and the output layer. For each training sample, the purpose of AE learning is to make the output signal as identical as possible to the input signal. The flow may be represented by the following formula:
… … equation 17
… … equation 18
Where s is a nonlinear function (e.g., sigmoid), W is the link weights of the input layer to the middle layer and the middle layer to the output layer, b andthe bias of the intermediate layer and the output layer, respectively. y can be regarded as a lossy compressed form of x, and signal y is decoded by the decoding layer and passed to the output layer as signal z. A typical square error is used in calculating the error of x and z, and if x is a bit vector, Then cross entropy may be used.
The AE is used to pretrain the neural network, and the initial weight W of the encoder is determined, however, the initial model obtained by the AE is often at risk of overfitting due to the influence of problems such as model complexity, training set data amount, data noise and the like. To prevent the overfitting, a noise reducing Auto-Encoder (DAE) is introduced, and noise is added to the input data on the basis of AE, thereby improving the stability of the model. A schematic of the DAE is shown in fig. 4.
Wherein x is an input signal, DAE sets the value of part of input layer nodes to 0 with a specific probability, and thus obtains an input signal containing noiseBy->And calculating y and z, and performing error iteration on the z and the original input signal x, so that the influence on the model caused by different distributions of the test sample and the training sample is reduced. Furthermore, the DAE can be stacked in multiple layers to form a stacked self-encoder (Stacked Denoising Auto-encoders, SDA), that is, the output of the middle layer of the previous layer is the input of the next layer, the self-encoding of each layer is subjected to unsupervised training through greedy training layer by layer, and the output of the trained K layer is used as the input of the self-encoding training of the k+1 layer.
The number of intermediate layer nodes is generally smaller than the input-output layers, so the intermediate layer tends to learn the internal regularity of the signal. However, if the number of intermediate layer nodes is greater than that of input/output layers, and the self-encoder is expected to learn an internal rule, the sparse self-encoder needs to be utilized, that is, the sparsity limit is added to the activation function of the intermediate layer, so that only part of nodes are active at the same time. Assuming that the activation function of the middle layer is sigmoid, the node output 1 indicates active, the output 0 indicates inactive, and the KL divergence can be used to measure the similarity between the actual activity degree of the node and the artificially set sparsity ρ:
… … equation 19
Wherein,,signal looseness for the node; m is the number of training samples, < > and >>For the response output of the jth node of the middle layer to the ith training sample,/th node of the middle layer>The average active output for the j-th node of the middle layer. Generally, setting ρ to 0.5 or 0.01, a smaller KL divergence means +.>The higher the similarity to ρ, the more the KL divergence is added as a regularization term to the loss function to constrain the sparsity of the network.
Finally, the noise reduction capability of the sparse self-encoder and the complex modeling of the depth network are utilized to mechanically learn the characteristics of the low-noisiness picture and generate the picture with the least noise and higher contrast.
(3) Tilt angle correction
Aiming at inclination angle correction, the method of Randon transformation is adopted to solve the problems of rotation and displacement of the picture characters.
As shown in fig. 5, the Radon transform projects the image space in the form of line integrationThe space, radon transform, is a continuous form of linear parameter transform, and the algorithm flow is as follows:
… … equation 20
Wherein,,is a linear integral; m is a horizontal coordinate point; n is a vertical coordinate point; />Is a dirac function; />Is an oblique angle.
Binarizing the input image, finding out document boundary by Sobel boundary detection algorithm, carrying out Radon transformation, integrating the original function along all possible straight lines in the image planeTake a value of 0 to 179 deg.), the resulting integrated value is projected to +.>Space, find +.>If a straight line is included in the image, the integral value along the straight line is the largest, and finally, the slope of the radian system is converted into the slope of the angle system, so that the inclination correction is completed.
And training the RPA robot based on the operation information converted into the recognizable language of the RPA robot, and generating a script. Before the automatic operation is completed through the trained RPA robot, testing the trained RPA robot, and recording the running process of the flow through a log.
More specifically, an important technology of RPA is to simulate some operations of a mouse and a keyboard, such as mouse operations of clicking, double clicking, right clicking, dragging, etc., or keyboard operations of keyboard input, shortcut key use, combination key use, etc., which are important bases for the RPA to convert manual operations into machine language.
As shown in fig. 6, the method further includes: the intelligent driving method for the multi-robot combined operation workflow specifically comprises the following steps:
workflow technology is a set of technical solutions which are created based on business process management theory and practice, and the design in the application comprises three parts, namely workflow design, workflow operation and workflow monitoring. Workflow technology is used to control and manage the automatic transfer of documents between individual computers.
The RPA accesses the application program by operating the user interface, realizing continuous processing on the service logic. In this process, the RPA needs to operate one or more interfaces, and at each interface, some data items need to be processed, which is regarded as a kind of workflow process at the microscopic level. The RPA in this application has relevant features of workflow technology including flow triggering, flow nesting, branching (IF ELSE), looping, suspending, cancelling, delaying, error handling, etc., while supporting definitions of constants, variables in the flow.
To better define and design workflows, RPA provides specialized workflow design tools to help users define workflows graphically, support rapid assembly of business processes in drag controls, and automatically generate initial process records in a recorded manner. The RPA also has built-in debugger and simulator for testing the flow and logging the running process of the flow as shown in fig. 6.
Except for sequential workflows, some steps need to be performed after waiting for some events to occur (as shown in fig. 7, two actions such as exception checking and timeout in a simulated user login event need to be performed continuously after waiting for a manual processing action to trigger). Another workflow type is a state machine workflow that provides a series of states, starting from an initial state to an ending state, with a defined behavioral transition between the two states.
The last part of realization is flow monitoring, which is to configure the flow by providing a graphical mode and monitor the execution condition of the flow. The configuration function comprises flow starting time, trigger event conditions, execution object equipment, association relation among flows and the like. The monitoring function includes the running state of the flow, the time spent by each link, the running traffic, the successful or failed execution, etc.
More specifically, step S120 is next followed.
At step S120, a front-end request is received.
In an embodiment of the present invention, the receiving a front-end request includes: executing a script according to preset running time and running frequency; and executing the scripts respectively according to a preset rule with a preset running time and running frequency.
More specifically, step S130 is next followed.
At step S130, the runtime and frequency of operation of the front-end request and associated scripts are parsed.
More specifically, step S140 is next followed.
At step S140, the running time and the running frequency of the front-end request are sent to the Agent at the opposite end through the dubbo protocol, and the Agent executes the association script according to the front-end request.
In an embodiment of the present invention, the method further includes: judging whether the script is successfully executed according to the expected return value of the script; wherein, when the execution is successful, the operation is ended; when the execution fails, the alarm is given and the manual processing is waited.
In the embodiment of the invention, the method is used for bare metal installation, software automation installation, script development and flow arrangement.
Fig. 8 illustrates an RPA-based batch automation operating system 800 provided by the present invention, including an acquisition module 810, a parsing module 820, and an execution module 830.
The acquisition module 810 is used for recording operation steps in batches based on the PRA system, respectively generating scripts, and managing the scripts through a dubbo architecture;
the parsing module 820 is configured to receive a front-end request; analyzing the operation time, the operation frequency and the associated script of the front-end request;
the execution module 830 is configured to send the operation time and the operation frequency of the front-end request to an Agent at the opposite end through a dubbo protocol, and the Agent executes the association script according to the front-end request.
In an embodiment of the present invention, the system further includes:
the judging module is configured to judge whether script execution is successful or not according to expected return values of the script; wherein, when the execution is successful, the operation is ended; when the execution fails, the alarm is given and the manual processing is waited.
Fig. 9 is a schematic diagram of an RPA-based system according to an embodiment of the disclosure; the RPA system designed by the embodiment of the invention mainly comprises three parts, namely an editor, a controller and an operator, wherein the editor and the operator are deployed on a desktop machine of a worker to realize the design and robot configuration of a localized task, the editor provides visual control dragging and editing, automatic script recording, workflow editing, and functions of a prefabricated library and a pre-constructed template, the operator provides mouse and keyboard event simulation, screen grabbing and workflow driving functions, the controller is deployed locally to provide a centralized control center to monitor the running state of a plurality of robots, and remote maintenance and technical support capability of the robots are provided.
Referring to fig. 10, the embodiment of the present disclosure further provides an electronic device 100, including:
at least one processor; the method comprises the steps of,
a memory communicatively coupled to the at least one processor; wherein,,
the memory stores instructions executable by the at least one processor to enable the at least one processor to perform the RPA-based batch automation method of the foregoing method embodiments.
The disclosed embodiments also provide a non-transitory computer readable storage medium storing computer instructions for causing the computer to perform the RPA-based batch automation method of the foregoing method embodiments.
The disclosed embodiments also provide a computer program product comprising a computer program stored on a non-transitory computer readable storage medium, the computer program comprising program instructions which, when executed by a computer, cause the computer to perform the RPA-based batch automation method of the foregoing method embodiments.
Referring now to fig. 10, a schematic diagram of an electronic device 100 suitable for use in implementing embodiments of the present disclosure is shown. The electronic devices in the embodiments of the present disclosure may include, but are not limited to, mobile terminals such as mobile phones, notebook computers, digital broadcast receivers, PDAs (personal digital assistants), PADs (tablet computers), PMPs (portable multimedia players), in-vehicle terminals (e.g., in-vehicle navigation terminals), and the like, and stationary terminals such as digital TVs, desktop computers, and the like. The electronic device shown in fig. 10 is merely an example and should not be construed to limit the functionality and scope of use of the disclosed embodiments.
As shown in fig. 10, the electronic device 100 may include a processing means (e.g., a central processing unit, a graphics processor, etc.) 1001 that may perform various appropriate actions and processes according to a program stored in a Read Only Memory (ROM) 1002 or a program loaded from a storage means 1008 into a Random Access Memory (RAM) 1003. In the RAM 1003, various programs and data necessary for the operation of the electronic apparatus 100 are also stored. The processing device 1001, the ROM 1002, and the RAM 1003 are connected to each other by a bus 1004. An input/output (I/O) interface 1005 is also connected to bus 1004.
In general, the following devices may be connected to the I/O interface 1005: input devices 1006 including, for example, a touch screen, touchpad, keyboard, mouse, image sensor, microphone, accelerometer, gyroscope, and the like; an output device 1007 including, for example, a Liquid Crystal Display (LCD), speaker, vibrator, etc.; storage 1008 including, for example, magnetic tape, hard disk, etc.; and communication means 1009. The communication means 1009 may allow the electronic device 100 to communicate with other devices wirelessly or by wire to exchange data. While an electronic device 100 having various means is shown in the figures, it is to be understood that not all of the illustrated means are required to be implemented or provided. More or fewer devices may be implemented or provided instead.
In particular, according to embodiments of the present disclosure, the processes described above with reference to flowcharts may be implemented as computer software programs. For example, embodiments of the present disclosure include a computer program product comprising a computer program embodied on a computer readable medium, the computer program comprising program code for performing the method shown in the flowcharts. In such an embodiment, the computer program may be downloaded and installed from a network via the communication device 1009, or installed from the storage device 1008, or installed from the ROM 1002. The above-described functions defined in the method of the embodiment of the present disclosure are performed when the computer program is executed by the processing device 1001.
It should be noted that the computer readable medium described in the present disclosure may be a computer readable signal medium or a computer readable storage medium, or any combination of the two. The computer readable storage medium can be, for example, but not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or a combination of any of the foregoing. More specific examples of the computer-readable storage medium may include, but are not limited to: an electrical connection having one or more wires, a portable computer diskette, a hard disk, a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing. In the context of this disclosure, a computer-readable storage medium may be any tangible medium that can contain, or store a program for use by or in connection with an instruction execution system, apparatus, or device. In the present disclosure, however, the computer-readable signal medium may include a data signal propagated in baseband or as part of a carrier wave, with the computer-readable program code embodied therein. Such a propagated data signal may take any of a variety of forms, including, but not limited to, electro-magnetic, optical, or any suitable combination of the foregoing. A computer readable signal medium may also be any computer readable medium that is not a computer readable storage medium and that can communicate, propagate, or transport a program for use by or in connection with an instruction execution system, apparatus, or device. Program code embodied on a computer readable medium may be transmitted using any appropriate medium, including but not limited to: electrical wires, fiber optic cables, RF (radio frequency), and the like, or any suitable combination of the foregoing.
The computer readable medium may be contained in the electronic device; or may exist alone without being incorporated into the electronic device.
The computer readable medium carries one or more programs which, when executed by the electronic device, cause the electronic device to: acquiring at least two internet protocol addresses; sending a node evaluation request comprising the at least two internet protocol addresses to node evaluation equipment, wherein the node evaluation equipment selects an internet protocol address from the at least two internet protocol addresses and returns the internet protocol address; receiving an Internet protocol address returned by the node evaluation equipment; wherein the acquired internet protocol address indicates an edge node in the content distribution network.
Alternatively, the computer-readable medium carries one or more programs that, when executed by the electronic device, cause the electronic device to: receiving a node evaluation request comprising at least two internet protocol addresses; selecting an internet protocol address from the at least two internet protocol addresses; returning the selected internet protocol address; wherein the received internet protocol address indicates an edge node in the content distribution network.
Computer program code for carrying out operations of the present disclosure may be written in one or more programming languages, including an object oriented programming language such as Java, smalltalk, C ++ and conventional procedural programming languages, such as the "C" programming language or similar programming languages. The program code may execute entirely on the user's computer, partly on the user's computer, as a stand-alone software package, partly on the user's computer and partly on a remote computer or entirely on the remote computer or server. In the case of a remote computer, the remote computer may be connected to the user's computer through any kind of network, including a Local Area Network (LAN) or a Wide Area Network (WAN), or may be connected to an external computer (for example, through the Internet using an Internet service provider).
The flowcharts and block diagrams in the figures illustrate the architecture, functionality, and operation of possible implementations of systems, methods and computer program products according to various embodiments of the present disclosure. In this regard, each block in the flowchart or block diagrams may represent a module, segment, or portion of code, which comprises one or more executable instructions for implementing the specified logical function(s). It should also be noted that, in some alternative implementations, the functions noted in the block may occur out of the order noted in the figures. For example, two blocks shown in succession may, in fact, be executed substantially concurrently, or the blocks may sometimes be executed in the reverse order, depending upon the functionality involved. It will also be noted that each block of the block diagrams and/or flowchart illustration, and combinations of blocks in the block diagrams and/or flowchart illustration, can be implemented by special purpose hardware-based systems which perform the specified functions or acts, or combinations of special purpose hardware and computer instructions.
The units involved in the embodiments of the present disclosure may be implemented by means of software, or may be implemented by means of hardware. The name of the unit does not in any way constitute a limitation of the unit itself, for example the first acquisition unit may also be described as "unit acquiring at least two internet protocol addresses".
It should be understood that portions of the present disclosure may be implemented in hardware, software, firmware, or a combination thereof.
The foregoing is merely specific embodiments of the disclosure, but the protection scope of the disclosure is not limited thereto, and any changes or substitutions that can be easily conceived by those skilled in the art within the technical scope of the disclosure are intended to be covered by the protection scope of the disclosure. Therefore, the protection scope of the present disclosure shall be subject to the protection scope of the claims.

Claims (10)

1. An RPA-based batch automation method, comprising the steps of:
recording operation steps in batches based on a PRA system, respectively generating scripts, and managing the scripts through a dubbo architecture;
receiving a front-end request;
analyzing the operation time, the operation frequency and the associated script of the front-end request;
And sending the operation time and the operation frequency of the front-end request to an Agent at the opposite end through a dubbo protocol, and executing the association script by the Agent according to the front-end request.
2. The RPA-based batch automation operation method of claim 1, further comprising:
judging whether the script is successfully executed according to the expected return value of the script; wherein, when the execution is successful, the operation is ended; when the execution fails, the alarm is given and the manual processing is waited.
3. The RPA-based batch automation operation method of claim 1, wherein the receiving the front-end request comprises:
executing a script according to preset running time and running frequency; the method comprises the steps of,
and respectively executing a plurality of scripts according to a preset rule by using a preset running time and a preset running frequency.
4. The RPA-based batch automation operation method of claim 1, wherein the PRA-based system batch recording operation step and script generation step comprises the steps of:
acquiring operation information in a recording mode;
converting the operation information into a language recognizable by the RPA robot;
the RPA robot is trained and a script is generated based on the operation information converted into the recognizable language of the RPA robot.
5. The RPA-based batch automation operation method of claim 4, wherein the operation information comprises: screen data, mouse operation data, and keyboard operation data; wherein,,
the mouse operation data includes: single click, double click, right click and drag;
the keyboard operation data includes: keyboard input, shortcut key use and combination key use;
the screen data includes windows, buttons, and drop down lists.
6. The RPA-based batch automation operation method of any one of claims 1-5, wherein the method is used for bare metal installation, software automation installation, script development and flow programming.
7. An RPA-based batch automation operating system, the system comprising:
the acquisition module is configured to record operation steps in batches based on the PRA system, respectively generate scripts and manage the scripts through a dubbo framework;
the analysis module is configured to receive the front-end request; analyzing the operation time, the operation frequency and the associated script of the front-end request;
and the execution module is configured to send the operation time and the operation frequency of the front-end request to the opposite-end Agent through the dubbo protocol, and the Agent executes the association script according to the front-end request.
8. The RPA-based batch automation operating system of claim 7, further comprising:
the judging module is configured to judge whether script execution is successful or not according to expected return values of the script; wherein, when the execution is successful, the operation is ended; when the execution fails, the alarm is given and the manual processing is waited.
9. An electronic device, comprising:
at least one processor; the method comprises the steps of,
a memory communicatively coupled to the at least one processor; wherein,,
the memory stores instructions executable by the at least one processor, which when executed by the at least one processor, cause the at least one processor to perform the RPA-based batch automation method of any one of claims 1 to 6.
10. A non-transitory computer-readable storage medium storing computer instructions that, when executed by at least one processor, cause the at least one processor to perform the RPA-based batch automation method of any one of claims 1 to 6.
CN202310840106.1A 2023-07-10 2023-07-10 RPA-based batch automatic operation method, system, equipment and storage medium Active CN116560819B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202310840106.1A CN116560819B (en) 2023-07-10 2023-07-10 RPA-based batch automatic operation method, system, equipment and storage medium

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202310840106.1A CN116560819B (en) 2023-07-10 2023-07-10 RPA-based batch automatic operation method, system, equipment and storage medium

Publications (2)

Publication Number Publication Date
CN116560819A true CN116560819A (en) 2023-08-08
CN116560819B CN116560819B (en) 2024-02-13

Family

ID=87498596

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202310840106.1A Active CN116560819B (en) 2023-07-10 2023-07-10 RPA-based batch automatic operation method, system, equipment and storage medium

Country Status (1)

Country Link
CN (1) CN116560819B (en)

Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2010186332A (en) * 2009-02-12 2010-08-26 Hitachi Software Eng Co Ltd Test execution system
CN111126781A (en) * 2019-11-29 2020-05-08 苏宁云计算有限公司 RPA service flow establishing method and system
CN113420201A (en) * 2021-06-09 2021-09-21 湖南大学 Cross-domain element positioning and tree generating method for browser RPA system
CN113590358A (en) * 2021-08-02 2021-11-02 中国工商银行股份有限公司 Service concurrency control method and device based on RPA
CN115496459A (en) * 2022-07-11 2022-12-20 珠海金智维信息科技有限公司 RPA-based anti-fraud case automation processing system and method, and storage medium
CN116011753A (en) * 2022-12-27 2023-04-25 广西电网有限责任公司玉林供电局 Method and device for realizing direct dispatch monitoring reminding of fault worksheet based on RPA robot
CN116319242A (en) * 2023-03-22 2023-06-23 中国工商银行股份有限公司 Cloud management platform micro-service scheduling method and device based on RPA technology

Patent Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2010186332A (en) * 2009-02-12 2010-08-26 Hitachi Software Eng Co Ltd Test execution system
CN111126781A (en) * 2019-11-29 2020-05-08 苏宁云计算有限公司 RPA service flow establishing method and system
CN113420201A (en) * 2021-06-09 2021-09-21 湖南大学 Cross-domain element positioning and tree generating method for browser RPA system
CN113590358A (en) * 2021-08-02 2021-11-02 中国工商银行股份有限公司 Service concurrency control method and device based on RPA
CN115496459A (en) * 2022-07-11 2022-12-20 珠海金智维信息科技有限公司 RPA-based anti-fraud case automation processing system and method, and storage medium
CN116011753A (en) * 2022-12-27 2023-04-25 广西电网有限责任公司玉林供电局 Method and device for realizing direct dispatch monitoring reminding of fault worksheet based on RPA robot
CN116319242A (en) * 2023-03-22 2023-06-23 中国工商银行股份有限公司 Cloud management platform micro-service scheduling method and device based on RPA technology

Non-Patent Citations (2)

* Cited by examiner, † Cited by third party
Title
JANKE, R: "A truncated DNA-damage-signaling response is activated after DSB formation in the G1 phase of Saccharomyces cerevisiae", NUCLEIC ACIDS RESEARCH, vol. 38, no. 7, 1 April 2010 (2010-04-01), pages 2302 - 2313 *
邵志骅;许卉莹;崔林山;: "公安交通管理大数据迁移融合处理应用场景及解决方法", 中国公共安全(学术版), no. 03, 15 September 2016 (2016-09-15), pages 79 - 82 *

Also Published As

Publication number Publication date
CN116560819B (en) 2024-02-13

Similar Documents

Publication Publication Date Title
US8549483B1 (en) Engine for scalable software testing
JP2022514155A (en) Software test
US8881109B1 (en) Runtime documentation of software testing
US8805094B2 (en) Using machine learning to improve detection of visual pairwise differences between browsers
US11074162B2 (en) System and a method for automated script generation for application testing
US11422783B2 (en) Auto-deployment of applications
US11301245B2 (en) Detecting bias in artificial intelligence software by analysis of source code contributions
CN112506778A (en) WEB user interface automatic test method, device, equipment and storage medium
CN112835579A (en) Method and device for determining interface code, electronic equipment and storage medium
WO2022271345A1 (en) Triggering dynamic robotic process automation
US20200241900A1 (en) Automation tool
US11615016B2 (en) System and method for executing a test case
CN117235527A (en) End-to-end containerized big data model construction method, device, equipment and medium
CN116560819B (en) RPA-based batch automatic operation method, system, equipment and storage medium
WO2023155274A1 (en) Recruitment information publishing method and apparatus based on rpa and ai
CN115952020A (en) Page abnormity detection method, medium, device and computing equipment
US11544179B2 (en) Source traceability-based impact analysis
CN115631374A (en) Control operation method, control detection model training method, device and equipment
CN115687075A (en) Error correction method and device for page test script
US20220100964A1 (en) Deep learning based document splitter
Bailey et al. FRAM memory technology-advantages for low power, fast write, high endurance applications
CN112328473A (en) Code automation integration test method and device and electronic equipment
CN106897387B (en) Service detection method based on action simulation
US20230078782A1 (en) Methods and systems of automatically associating text and control objects
CN116880899B (en) Task information association method, device, electronic equipment and computer readable medium

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant