WO2022252637A1

WO2022252637A1 - Browser-based rpa implementation method and apparatus, device, and medium

Info

Publication number: WO2022252637A1
Application number: PCT/CN2022/072188
Authority: WO
Inventors: 李淮兵; 杨延威; 杨开济; 赵莫; 李攀
Original assignee: 平安科技（深圳）有限公司
Priority date: 2021-06-01
Filing date: 2022-01-14
Publication date: 2022-12-08
Also published as: CN113238850A; CN113238850A8; CN113238850B

Abstract

A browser-based RPA implementation method and apparatus, a device, and a medium, which relate to the technical field of information. The method comprises: obtaining a client file of a design robot, and packaging the client file, wherein the packaged client file comprises a program library, an interface library, and a control library; obtaining certificate signatures of the program library, the interface library and the control library, and sending the packaged program library, interface library, and control library, as well as the corresponding certificate signatures to a Web server; in response to a page access request of a user in a browser, generating a page on the basis of the page access request, downloading the program library, the interface library and the control library from the Web server, loading the program library, the interface library, and the control library on the page, and generating a process design page; obtaining a process script generated by the process design page, and controlling script execution software to execute the process script, so that an RPA design robot is automatically updated, permission troubles are avoided, and the security is improved.

Description

Browser-based RPA implementation method, device, equipment and medium

This application claims the priority of the Chinese patent application with the application number 202110609423.3 and the title of the invention "Browser-based RPA Implementation Method, Device, Equipment and Medium" submitted to the China Patent Office on June 1, 2021, the entire content of which is passed References are incorporated in this application.

technical field

The present application relates to the field of information technology, and in particular to a browser-based RPA implementation method, a browser-based RPA implementation device, computer equipment and storage media.

Background technique

RPA is Robotic Process Automation (RPA), which realizes process automation by imitating the manual operation of the user on the computer. Traditional RPA design robots are all desktop applications, but they have disadvantages such as cumbersome installation, inability to automatically update, poor system compatibility, and poor security.

Although the idea of designing robots based on browser-based RPA has been proposed, the inventor realized that the development of designing robots based on browser-based RPA is not yet mature. Automatic installation is realized, and there are still problems such as cumbersome permissions and poor work performance.

Contents of the invention

This application provides a browser-based RPA implementation method, a browser-based RPA implementation device, computer equipment, and storage media, aiming to solve the problems of cumbersome installation and update of existing RPA design robots, poor system compatibility, and poor security question.

In order to achieve the above object, the application provides a browser-based RPA implementation method, the method comprising:

Obtain the client file of the RPA design robot, and package the client file, and the client file after the package process includes an XBAP program library, an interface library and a control library;

Obtain the certificate signature of the XBAP program library, the interface library and the control library, and send the packaged XBAP program library, the interface library and the control library and the corresponding certificate signature to the Web server;

In response to the user's page access request in the browser, an XBAP page is generated based on the page access request, the XBAP program library is downloaded from the Web server, and the XBAP program library is loaded on the XBAP page;

Download the interface library and the control library from the Web server, and load the interface library and the control library in the XBAP page to generate a process design page;

According to the process script generated by the process design page, the script execution software is controlled to execute the process script.

In order to achieve the above object, the application also provides a browser-based RPA implementation device, the browser-based RPA implementation device includes:

The file packaging module obtains the client file of the RPA design robot, and the client file is packaged, and the client file after the package process includes an XBAP program library, an interface library and a control library;

Signature acquisition module, used to obtain the certificate signature of the XBAP library, the interface library and the control library, and the packaged XBAP library, the interface library and the control library and the corresponding certificates The signature is sent to the web server;

The program loading module is used to respond to the user's page access request in the browser, generate an XBAP page based on the page access request, download the XBAP program library from the Web server, and load the XBAP page on the XBAP page. Describe the XBAP library;

A page generation module, configured to download the interface library and the control library from the Web server, and load the interface library and the control library in the XBAP page to generate a process design page;

The process design module is used to control the script execution software to execute the process script according to the process script generated on the process design page.

In addition, in order to achieve the above object, the present application also provides a computer device, the computer device includes a memory and a processor; the memory is used to store a computer program; the processor is used to execute the computer program and Realize following steps when executing described computer program:

In addition, in order to achieve the above purpose, the present application also provides a computer-readable storage medium, the computer-readable storage medium stores a computer program, and when the computer program is executed by a processor, the processor implements the following steps:

The browser-based RPA implementation method, browser-based RPA implementation device, equipment, and storage medium disclosed in the embodiments of the present application realize online RPA process design through browsers and Web servers, which can enable RPA design robots to avoid authority troubles and realize Automatic updates and online debugging improve security and enhance user experience.

Description of drawings

In order to illustrate the technical solutions of the embodiments of the present application more clearly, the drawings that need to be used in the description of the embodiments will be briefly introduced below. Obviously, the drawings in the following description are some embodiments of the present application. Ordinary technicians can also obtain other drawings based on these drawings on the premise of not paying creative work.

Fig. 1 is a schematic flow chart of a browser-based RPA implementation method provided in the embodiment of the present application;

Fig. 2 is a schematic interface diagram of a process design page provided by the embodiment of the present application;

Fig. 3 is a schematic block diagram of a browser-based RPA implementation device provided in an embodiment of the present application;

Fig. 4 is a schematic block diagram of a computer device provided by an embodiment of the present application.

Detailed ways

The following will clearly and completely describe the technical solutions in the embodiments of the present application with reference to the drawings in the embodiments of the present application. Obviously, the described embodiments are part of the embodiments of the present application, not all of them. Based on the embodiments in this application, all other embodiments obtained by persons of ordinary skill in the art without making creative efforts belong to the scope of protection of this application.

The flow charts shown in the drawings are just illustrations, and do not necessarily include all contents and operations/steps, nor must they be performed in the order described. For example, some operations/steps can be decomposed, combined or partially combined, so the actual order of execution may be changed according to the actual situation. In addition, although the functional modules are divided in the schematic diagram of the device, in some cases, they may be divided into modules different from those in the schematic diagram of the device.

The term "and/or" used in the description of the present application and the appended claims refers to any combination and all possible combinations of one or more of the associated listed items, and includes these combinations.

RPA is Robotic Process Automation, which realizes process automation by imitating the manual operation of users on computers, thereby replacing or assisting humans to complete repetitive work and tasks in digital devices such as computers and RPA mobile phones. The traditional RPA design robot is a desktop application, which exists in the form of a client, and the client often has problems such as security permissions, cumbersome installation, failure to automatically update, and software security. At the same time, the existing browser-based The RPA design robot cannot solve the above problems well, and there are still problems such as inability to debug online and limited authority.

Although the idea of browser-based RPA design robots has been proposed, the development of browser-based RPA design robots is not yet mature. The existing ones are based on ActiveX, SilverLight and other similar technologies, so automatic installation, And there are still problems such as cumbersome permissions and poor work performance.

Based on the above problems, this application proposes a browser-based RPA implementation method, which aims to solve the problems of cumbersome installation and update of existing RPA design robots, poor system compatibility, and poor security, and can make RPA design robots exempt from authority troubles , Realize automatic update, online debugging, and improve security.

Wherein, the above-mentioned browser-based RPA implementation method can be applied to a server or to a terminal device, wherein the terminal device can include a mobile phone, a tablet computer, a personal digital assistant (Personal Digital Assistant, PDA), etc., which have a telephone function fixed terminal. A server can be, for example, a single server or a cluster of servers. However, for ease of understanding, the following embodiments will introduce in detail a browser-based RPA implementation method applied to a server.

Some implementations of the present application will be described in detail below in conjunction with the accompanying drawings. In the case of no conflict, the following embodiments and features in the embodiments can be combined with each other.

Please refer to FIG. 1 . FIG. 1 is a schematic flowchart of a browser-based RPA implementation method provided by an embodiment of the present application. The browser-based RPA implementation method can be applied to the server, and specifically applied to the browser, which can enable the RPA design robot to avoid authority troubles, realize automatic updates, and online debugging, thereby improving security.

As shown in FIG. 1 , the browser-based RPA implementation method includes steps S101 to S105.

S101. Obtain the client file of the RPA design robot, and package the client file. The packaged client file includes an XBAP program library, an interface library, and a control library.

Wherein, performing packaging processing on the RPA design robot may be performing packaging processing on files of the RPA design robot at the client.

Specifically, the XBAP library adopts XAML (Extensible Application Markup Language) architecture design, and XAML is a standard technology of Microsoft, wherein, some browsers (such as IE browser) can automatically recognize this architecture and load it automatically, so When the user opens the RPA design robot with the IE browser, the browser can automatically load the XBAP program library without unnecessary operations. The control library can be a process control library, or any building block control, mainly including controls related to user business processes, which can be loaded by the XBAP program library. The interface library is the main interface library, and the main interface library includes interface program libraries other than non-process controls. Specifically, it may also include the design interface of the RPA design robot, which can be loaded by the XBAP program library.

In some embodiments, the client files of the RPA design robot are obtained, and the client files are classified into files to generate XBAP program library, interface library and control library, and the XBAP program library, the described The interface library and the control library are packaged. This can enhance fault tolerance. When IE browser loads or automatically updates related modules, if it fails due to network reasons or human factors, other modules will not be affected, and the browser can be reloaded or updated after refreshing the browser.

Specifically, the XBAP program library, the interface library and the control library are packaged separately. For example, when an error occurs in the interface library or cannot be loaded, the loading of the control library is not affected, and the browser can be continuously refreshed at the same time. Reload or update the interface library.

In some embodiments, when the client file is packaged, the MD5 value calculation is performed on the XBAP program library, the interface library and the control library respectively to obtain the corresponding MD5 value of each library; the XBAP program library, the The interface library and the control library are packaged with corresponding MD5 values respectively. Therefore, in subsequent updates, incremental updates can be performed according to whether the MD5 values of the library files are consistent, and it can be determined whether the downloaded program files have been tampered with to preserve program security.

Specifically, the MD5 value can be considered as the "digital fingerprint" of the file. The MD5 value of each file is different. If anyone makes any changes to the file, its MD5 value, which is the corresponding "digital fingerprint", will change. For example, the download server provides an MD5 value for a file in advance. After the user downloads the file, recalculate the MD5 value of the downloaded file. whether it has been tampered with.

In some embodiments, the types of files in the RPA design robot are uniformly modified, and the modified files are packaged. Therefore, when the browser downloads the corresponding file, it is not necessary to add the corresponding Multipurpose Internet Mail Extensions (MIME) on the Web server for various file types.

Specifically, the suffixes of all files in the RPA design robot are uniformly modified so that the suffixes of all files are the same.

For example, if there are files of the file type "*.exe", "*.dll", "*.abcd" etc. in the RPA design robot, change the suffix of the above file to "*.deploy" suffix, because the suffix of each file is the same, that is, the file type is the same, so there is no need to add the corresponding Multipurpose Internet Mail Extensions (MIME) on the Web server.

S102. Obtain the certificate signatures of the XBAP program library, the interface library, and the control library, and send the packaged XBAP program library, the interface library, and the control library and the corresponding certificate signatures to the Web server.

In order to make the Internet a reliable software source and assure users that they know the source of the code, it is necessary to obtain the certificate signatures of the XBAP program library, the interface library and the control library.

Wherein, the certificate is a digital encryption certificate provided by Microsoft, and the certificate signature is created using a public key signature algorithm such as RSA public key cryptography. The public key algorithm actually uses two different keys, specifically a public key and a private key. A private key is known only to its owner, while a public key can be used by anyone. With public key algorithms, if one key is used for encryption, the other is used for decryption. Furthermore, the decryption key cannot reasonably be computed from the encryption key. In digital signatures, the private key generates the signature, and the corresponding public key verifies it.

Exemplarily, after the packaging is completed, the source of the RPA design robot can be confirmed to the recipient by using the digital signature. The digital signature only generates a digital signature string, and the user can bundle it with the RPA design robot.

Wherein, said certificate is a set of data that fully identifies an entity and is issued by a certificate authority only after the entity's identity has been verified by the certificate authority. The data set includes an entity's public encryption key. When the sender of a message signs the message with his private key, the recipient of the message can use the sender's public key to verify the sender's identity.

Specifically, the digital encryption certificate is sent to the user, and the user can use the SignTool signature tool to sign the digital encryption certificate, sign the certificate and upload it to the IE browser. Based on the certificate signatures of the XBAP program library, the interface library and the control library, the packaged XBAP program library, the interface library and the control library are sent to the Web server. The web service can be any server, such as IIS, Tomcat, Apache and other servers, and can be expanded horizontally, it can be a cheap server, and the operating system of the application can also be any system, such as Window, Linux and so on.

S103. In response to the user's page access request in the browser, generate an XBAP page based on the page access request, download the XBAP program library from the Web server, and load the XBAP program library on the XBAP page .

Wherein, the page access request can be the user's access request to the XBAP page using HTTPS, and the XBAP page is a page generated by the browser using XBAP technology, and XBAP combines Web applications and client (WPF) applications Function. Similar to web applications, XBAPs can be deployed to a web server and launched from Internet Explorer or Firefox. Like client (WPF) applications, XBAPs can take advantage of WPF features, including Workflow.

In some embodiments, the page identifier of the page access request is acquired, and it is determined whether the page identifier is a preset page identifier, and if the page identifier is a preset page identifier, an XBAP page is generated according to the page identifier. Wherein said preset page mark is XBAP mark, and described XBAP page is the page that browser utilizes XBAP technology to generate, is WPF browser application program in essence, utilizes the webpage of this technology development to be similar to html page. Traditional pages developed using html, css and javascript can only run in the browser sandbox, while pages developed using XBAP technology can take advantage of the natural compatibility and automatic identification of Microsoft software such as IE browser for .net framework Optimization, so that when the IE browser accesses the XBAP page file, it can automatically load the application program into a desktop application program.

Specifically, obtain the domain name suffix of the page access request, determine whether the domain name suffix is a preset domain name suffix, and if the page identifier is a preset domain name suffix, generate an XBAP page according to the page identifier.

Exemplarily, the domain name suffix of the page access request is acquired, and it is determined whether the domain name suffix is .xbap, and if the page identifier is .xbap, an XBAP page is generated according to the page identifier.

In some embodiments, an XBAP page is generated based on the page access request and the ClickOnce deployment technology, and the XBAP page is deployed, wherein the XBAP page includes a WPF browser application. In this way, the automatic update function can be provided for the RPA design robot, and the security is improved, and the user can let the IE browser automatically trust and load it without additional operations.

A WPF browser application (Xbap) is a client application that can be deployed to a web server and launched in a browser. The WPF host (PresentationHost.exe) is registered as a shell and MIME handler for XBAP and XAML files. Therefore, when starting the domain name corresponding to the XBAP, the IE browser knows to start the WPF host. In other browsers or stand-alone applications, you can use the native browser host API provided by WPF to host the XBAP.

Among them, PresentationHost, as a host process, can load many other applications, such as some tools with relatively low coupling degree in RPA design robots, such as script recorder, configuration manager, etc. Associated with IE browser. Therefore, the RPA design robot can access the web server through the IE browser to load automatically, without worrying about the leakage of program files, and save the execution performance and security by hosting the PresentationHost host process, without worrying about the program being tampered with and executed.

Exemplarily, when the user visits the WPF browser application program, the IE browser only embeds the lightweight display interface generated by this process, and actually calls the system resources of the computer itself, and the use of system resources such as its CPU and memory is related to Scheduling has nothing to do with IE browsers, and the operation of the entire PRA design robot is not affected by browser performance at all.

Specifically, the XBAP page can be deployed on the Web server. Specifically, generate a WPF browser application based on the ClickOnce deployment technology, and obtain the executable file, application list and deployment list output by the WPF browser application; and copy the executable file and the application list to the Web server for Generate XBAP pages. The executable file contains compiled code and has an exe extension, the application manifest contains metadata associated with the application and has manifest extension information, and the deployment manifest contains ClickOnce for deploying the application And has the information of the xbap extension.

Exemplarily, if XBAP is to be deployed on a web server, the executable file and the application manifest are copied to the web server, and an HTML page containing a hyperlink is generated to open the deployment manifest, that is, a file with an extension of .xbap. When a user clicks a link to an xbap file, ClickOnce automatically handles the mechanics of downloading and launching the application, resulting in an XBAP page. The following code sample displays an HTML page containing a hyperlink to an XBAP:

<html>

<body>

<a href="XbapEx.xbap">Click this link to launch the application</a>

</body>

</html>.

Specifically, the XBAP page can be deployed into a webpage frame. Specifically, generate a WPF browser application based on the ClickOnce deployment technology, and obtain the executable file, application list, and deployment list output by the WPF browser application; generate at least one framed web page, and set the source attribute of the frame to Set to deploy the manifest file to generate XBAP pages.

The following sample code demonstrates an HTML page with two frames, the source of the second frame is set to XBAP:

<html>

<head>

<title>A page with frames</title>

</head>

</frameset>

</html>.

In some embodiments, due to the existence of many different security environments, in some security environments such as deployment that does not follow the ClickOnce specification, the user needs to customize the trust method, the user will receive a warning when trying to install it, and the user can choose to continue or cancel the installation. Therefore, before downloading and loading the XBAP program library from the Web server, load the certificate signature and determine the current loading environment, if the loading environment is a local computer, it is set to full trust without any operation; If the loading environment is an Intranet and a trusted site, a prompt message of full trust is displayed on the browser; if the loading environment is an Intranet and a trusted site, a prompt message of not granting trust is displayed on the browser . In this way, it can be used in different security environments by setting a custom trust method.

Specifically, the loading environment may be determined by means of an IP address or the like, wherein the intranet is an intranet of an enterprise.

Exemplarily, if the loading environment is a local computer, no prompt information will be sent to the client.

Exemplarily, if the loading environment is an intranet and a trusted site, the browser displays a prompt message of full trust, and the user can choose to continue or cancel the installation at this time. If the user chooses to continue the installation at this time, the user is required to Sign the XBAP page with said certificate.

Exemplarily, if the loading environment is Intranet, the browser displays a prompt message of not granting trust, and the user can choose to continue or cancel the installation at this time. If the user chooses to continue the installation at this time, the user is required to use the certificate Sign the XBAP page.

In some embodiments, after the XBAP page is generated, the XBAP program library is downloaded from the Web server, and the XBAP program library is loaded on the XBAP page.

Specifically, obtain the MD5 value of the XBAP program library, determine whether the MD5 value of the XBAP program library is the same as the corresponding historical MD5 value; if the MD5 value of the XBAP program library is different from the corresponding historical MD5 value, Download the XBAP library from the Web server. In this way, the incremental download of the RPA design robot can be achieved, and the minimum download amount and download speed can be guaranteed. At the same time, the high availability and fault tolerance of the design robot in the browser can be ensured, and the failure caused by network reasons, human factors, and misoperations can be avoided. If the update fails, you can restart the update process after refreshing the webpage without reinstalling. Wherein, the historical MD5 value is the latest MD5 value of the XBAP program library.

Wherein, during the first visit, the XBAP program library is automatically downloaded in full, and in subsequent updates, the XBAP program library will automatically compare the MD5 values, and only download when the MD5 values are inconsistent. If the XBAP program library of the RPA design robot is updated, it only needs to be published to the web server, and the user only needs to refresh the page to automatically obtain and run the latest program control.

Specifically, the MD5 value corresponding to the first packaged XBAP program library is used as the initial MD5 value, and before the XBAP program library is loaded, the MD5 value of the XBAP program library is obtained, and the encrypted information of the MD5 value is determined to be corresponding to the corresponding Whether the encrypted information of the initial MD5 value is the same, if the encrypted information of the MD5 value is different from the encrypted information of the initial MD5 value, output a warning message. In this way, the downloaded program file can be prevented from being tampered with, and it will be downloaded again when loading, so as to preserve the security of the program.

Wherein, the encrypted information may be through a secret key, a password, etc. Thereafter, each updated file has the same encrypted information. If it is tampered with in the middle, the secret key or password will be changed. Whether the encrypted information of the MD5 value is the same as the corresponding encrypted information of the initial MD5 value determines whether the downloaded program file has been tampered with.

S104. Download the interface library and the control library from the Web server, and load the interface library and the control library on the XBAP page to generate a process design page.

On the XBAP page, download and load the interface library and the control library from the Web server through the XBAP program library to form a process design page.

In some embodiments, the MD5 value calculation is performed on the XBAP program library, the interface library and the control library respectively to obtain the corresponding MD5 value of each library; the XBAP program library, the interface library and the control library are respectively compared with the corresponding The MD5 value is packaged, and the MD5 value is used as the initial MD5 value; before loading the interface library and the control library, obtain the MD5 values of the interface library and the control library, and determine the Whether the encrypted information of the MD5 value is the same as the corresponding encrypted information of the initial MD5 value, if the encrypted information of the MD5 value is not the same as the corresponding encrypted information of the initial MD5 value, output a warning message. In this way, the downloaded program file can be prevented from being tampered with, and it will be downloaded again when loading, so as to preserve the security of the program.

Specifically, the encrypted information may be through secret keys, passwords, etc., and each updated file thereafter has the same encrypted information. Whether the encrypted information of the MD5 value in the middle is the same as the encrypted information of the corresponding initial MD5 value determines whether the downloaded program file has been tampered with.

Exemplarily, if the password of the MD5 value of the control library is different from the password of the corresponding initial MD5 value, output a warning message that the program file has been tampered with and stop loading the control library, or re-download another version of the control library.

Exemplarily, if the password of the MD5 value of the control library is the same as the password of the corresponding initial MD5 value, the output starts to load the downloaded control library.

In some embodiments, the MD5 value of the interface library and the control library is obtained, and it is determined whether the MD5 value of the interface library and the control library is the same as the corresponding historical MD5 value; if the MD5 value of the interface library If it is different from the corresponding historical MD5 value, download the interface library from the Web server; if the MD5 value of the control library is different from the corresponding historical MD5 value, download the control library from the Web server. In this way, the incremental download of the RPA design robot can be achieved, the minimum amount of download and the download speed can be guaranteed, and at the same time, the high availability and fault tolerance of the design robot in the browser can be guaranteed, and the failure caused by network reasons, human factors, misoperation, etc. can be avoided. If the update fails, you can restart the update process after refreshing the web page without reinstalling. Wherein, the historical MD5 value is the most recent MD5 value of the interface library and the MD5 value of the control library.

Specifically, when accessing for the first time, the XBAP program library, the interface library and the control library are fully automatically downloaded, and in subsequent updates, the XBAP program library will download the interface library and the control library. The above-mentioned control library automatically performs MD5 value comparison, and downloads only when the MD5 values are inconsistent. If the RPA design robot interface or controls are updated, it only needs to be published to the web server, and users only need to refresh the page to automatically obtain and run the latest program controls.

In some embodiments, after the XBAP page loads the interface library and the control library, a process design page is generated. Wherein, the process design page includes a control area, a script management area and a script design area, specifically as shown in FIG. 2 , the left side is the control area, the right side is the script management area, and the middle is the script design area and the process script area.

Among them, the control area is loaded through the control library, including multiple different types of controls such as controls for jumping URLs, the script management area and script design area are loaded through the interface library, and the script management area includes many different types of processes such as single Circular process or multi-circular process, the script design area provides a design area for the user, the user can select different controls and processes according to the control area and the script management area, and then design the process in the script design area, the process script The area is used to display the process script generated on the process design page, and the user can modify the generated process script in the process script area.

Specifically, the control area, script management area, and script design area are all displayed graphically in the IE browser, providing 15 categories with a total of more than 180 types of controls to automate various processes, no need for users to install and download software, and everything is already online The form is realized.

S105. According to the process script generated on the process design page, control the script execution software to execute the process script.

Specifically, obtain the process design result of the user on the process design page; generate a process script according to the process design result, and debug the process script; after the process script debugging is completed, the control script execution software executes the The process script after the above debugging is completed.

Wherein, the process design result is a user's design operation in the script design area according to the control area and the script management area, and the process design result is used to generate a corresponding process script. Specifically, the process design result is the result of the user selecting the corresponding controls and corresponding scripts in the control area and script management area of the process design page on the browser to perform design operations in the script design area.

Exemplarily, for example, if the user wants to open a browser to visit Baidu, he can drag a browser-opening control in the control area to the script design area, then input Baidu URL in the control, and record the corresponding operation result.

In some embodiments, the recording function of the design robot can be enabled in the IE browser, which can record user operations in real time and automatically generate corresponding processes to obtain process design results.

Specifically, the recording function needs to capture keyboard and mouse input, and has extremely high requirements for code execution authority. For this, we use the characteristics of XBAP to embed a separate recording client in the browser. Start the recording function in the application, record user operations in real time and automatically generate corresponding processes to obtain process design results.

In some embodiments, a process script is generated according to the process design result, and the process script is debugged. Wherein, the process script is generated according to the user's operation in the script design area, the process script can be displayed in the form of a graph, and can be debugged after the script is saved, and a debug button is displayed on the process design page.

Specifically, you can debug the process sequence or configuration parameters in the process script, and view the corresponding debugging results.

In some embodiments, the authority to execute the Windows underlying API can be obtained in the form of user authorization, thereby ensuring that the RPA can call the local Windows API in an online mode, which solves the problem of finding elements, mouse input, keyboard input, etc. in the debugging state. Call problems, so as to achieve the same debugging effect on the browser as on the client. The debugging content can include breakpoints, log records, log output, etc.

Specifically, when the IE browser loads the WPF browser application program, it detects that the program wants to access local resources, so an authorization window will pop up, and the IE browser will run the program only after the user agrees to the authorization.

In some embodiments, after the debugging of the process script is completed, the corresponding script execution software is controlled to execute the debugged process script. The script execution software is corresponding software for executing process scripts, for example, browser, excel, word, etc. can be used.

Exemplarily, for example, if the user wants to open a browser to visit Baidu, he can drag a browser-opening control in the control area to the script design area, and then input Baidu URL in the control, and generate the corresponding design result, and generate process script and debug the process script, when the debugging is completed and the process script runs, the browser will be automatically opened and then jump to the Baidu page.

Please refer to FIG. 3. FIG. 3 is a schematic block diagram of a browser-based RPA implementation device provided by an embodiment of the present application. The browser-based RPA implementation device can be configured in a server to execute the aforementioned browser-based The RPA implementation method of the server.

As shown in FIG. 3 , the browser-based RPA implementation device 200 includes: a file packaging module 201 , a signature acquisition module 202 , a program loading module 203 , a page generation module 204 and a process design module 205 .

File packing module 201, obtains the client file of RPA design robot, described client file is carried out packing process, the client file after described packing process comprises XBAP program storehouse, interface storehouse and control storehouse;

The signature acquisition module 202 is used to obtain the certificate signature of the XBAP program library, the interface library and the control library, and package the packaged XBAP program library, the interface library and the control library and the corresponding The certificate signature is sent to the web server;

The program loading module 203 is configured to respond to the user's page access request in the browser, generate an XBAP page based on the page access request, download the XBAP program library from the Web server, and load the XBAP program library on the XBAP page The XBAP library;

A page generating module 204, configured to download the interface library and the control library from the Web server, and load the interface library and the control library in the XBAP page to generate a process design page;

The process design module 205 is configured to control the script execution software to execute the process script according to the process script generated on the process design page.

It should be noted that those skilled in the art can clearly understand that for the convenience and brevity of the description, the specific working process of the above-described devices, modules, and units can refer to the corresponding processes in the foregoing method embodiments. No longer.

The methods and devices of the present application can be used in many general-purpose or special-purpose computing system environments or configurations. Examples: personal computers, server computers, handheld or portable devices, tablet-type devices, multiprocessor systems, microprocessor-based systems, set-top boxes, programmable consumer terminal equipment, network PCs, minicomputers, mainframe computers, including the above A distributed computing environment for any system or device, and more.

Exemplarily, the above method and apparatus can be implemented in the form of a computer program, and the computer program can be run on the computer device as shown in FIG. 4 .

Please refer to FIG. 4 . FIG. 4 is a schematic diagram of a computer device provided by an embodiment of the present application. The computer device may be a server.

As shown in FIG. 4, the computer device includes a processor, a memory, and a network interface connected through a system bus, where the memory may include a non-volatile storage medium and an internal memory.

Non-volatile storage media can store operating systems and computer programs. The computer program includes program instructions. When the program instructions are executed, the processor can execute any browser-based RPA implementation method.

The processor is used to provide computing and control capabilities and support the operation of the entire computer equipment.

The internal memory provides an environment for running the computer program in the non-volatile storage medium. When the computer program is executed by the processor, the processor can execute any browser-based RPA implementation method.

This network interface is used for network communication, such as sending assigned tasks, etc. Those skilled in the art can understand that the structure of the computer equipment is only a block diagram of the partial structure related to the solution of the present application, and does not constitute a limitation to the computer equipment on which the solution of the application is applied. The specific computer equipment may include More or fewer components are shown in the figures, or certain components are combined, or have different component arrangements.

It should be understood that the processor may be a central processing unit (Central Processing Unit, CPU), and the processor may also be other general processors, digital signal processors (Digital Signal Processor, DSP), application specific integrated circuits (Application Specific Integrated Circuit, ASIC), Field-Programmable Gate Array (Field-Programmable Gate Array, FPGA) or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, etc. Wherein, the general-purpose processor may be a microprocessor or the processor may be any conventional processor or the like.

Wherein, in some embodiments, the processor is used to run the computer program stored in the memory, to achieve the following steps: obtain the client file of the RPA design robot, and package the client file, and the package process After the client file comprises XBAP program storehouse, interface storehouse and control storehouse; Obtain the certificate signature of described XBAP program storehouse, described interface storehouse and described control storehouse, and described XBAP program storehouse after packing, described interface Storehouse and described control storehouse and corresponding certificate signature are sent to Web server; In response to user's page visit request in described browser, generate XBAP page based on described page visit request, download described XBAP program from described Web server library, and load the XBAP program library on the XBAP page; download the interface library and the control library from the Web server, and load the interface library and the control library on the XBAP page, Generate a process design page; according to the process script generated on the process design page, control the script execution software to execute the process script.

In some embodiments, the processor is further configured to: obtain the client file of the RPA design robot, and perform file classification processing on the client file to obtain a file classification result; generate a file classification result based on the file classification result. XBAP program library, interface library and control library; respectively package the XBAP program library, the interface library and the control library.

In some embodiments, the processor is further configured to: respectively perform MD5 value calculation on the XBAP program library, the interface library and the control library to obtain the corresponding MD5 value of each library; and the control library are packaged with corresponding MD5 values respectively.

In some embodiments, the processor is further configured to: obtain the MD5 value corresponding to the interface library and the control library, and determine the MD5 value corresponding to the interface library and the control library and the corresponding historical MD5 value Whether it is the same; if the MD5 value of the interface library is different from the corresponding historical MD5 value, download the interface library from the Web server; if the MD5 value of the control library is different from the corresponding historical MD5 value, Download the control library from the Web server.

In some embodiments, the processor is further configured to: uniformly modify the type of the client file, obtain a modified client file, and package the modified file.

In some embodiments, the processor is further configured to: generate an XBAP page based on the page access request and the ClickOnce deployment technology and deploy the XBAP page, wherein the XBAP page includes a WPF browser application.

In some embodiments, the processor is further configured to: obtain the process design result of the user on the process design page; generate a process script according to the process design result, and debug the process script; when the process After the script debugging is completed, the script execution software is controlled to execute the debugged process script.

The embodiment of the present application also provides a computer-readable storage medium, and the computer-readable storage medium may be non-volatile or volatile. A computer program is stored on the computer-readable storage medium, and the computer program includes program instructions. When the program instructions are executed, any browser-based RPA implementation method provided in the embodiments of the present application is implemented.

Wherein, the computer-readable storage medium may be an internal storage unit of the computer device described in the foregoing embodiments, such as a hard disk or a memory of the computer device. The computer-readable storage medium can also be an external storage device of the computer device, such as a plug-in hard disk equipped on the computer device, a smart memory card (Smart Media Card, SMC), a secure digital (Secure Digital, SD ) card, flash memory card (Flash Card), etc.

Further, the computer-readable storage medium may mainly include a program storage area and a data storage area, wherein the program storage area may store an operating system, an application program required by at least one function, etc.; The data created using the node, etc.

This application refers to the new application mode of computer technology such as the storage of the blockchain language model, point-to-point transmission, consensus mechanism, and encryption algorithm. Blockchain (Blockchain), essentially a decentralized database, is a series of data blocks associated with each other using cryptographic methods. Each data block contains a batch of network transaction information, which is used to verify its Validity of information (anti-counterfeiting) and generation of the next block. The blockchain can include the underlying platform of the blockchain, the platform product service layer, and the application service layer.

The above is only a specific embodiment of the application, but the scope of protection of the application is not limited thereto. Any person familiar with the technical field can easily think of various equivalents within the scope of the technology disclosed in the application. Modifications or replacements, these modifications or replacements shall be covered within the scope of protection of this application. Therefore, the protection scope of the present application should be based on the protection scope of the claims.

Claims

A browser-based RPA implementation method, wherein the method includes:

Obtain the client file of the RPA design robot, and package the client file, and the client file after the package process includes an XBAP program library, an interface library and a control library;

Obtain the certificate signature of the XBAP program library, the interface library and the control library, and send the packaged XBAP program library, the interface library and the control library and the corresponding certificate signature to the Web server;

In response to the user's page access request in the browser, an XBAP page is generated based on the page access request, the XBAP program library is downloaded from the Web server, and the XBAP program library is loaded on the XBAP page;

Download the interface library and the control library from the Web server, and load the interface library and the control library in the XBAP page to generate a process design page;

According to the process script generated by the process design page, the script execution software is controlled to execute the process script.
The method according to claim 1, wherein said obtaining the client file of the RPA design robot, said client file is packaged, comprising:

Obtain the client file of the RPA design robot, and process the file classification of the client file to obtain the file classification result;

Generate XBAP program library, interface library and control library based on the file classification result;

The XBAP program library, the interface library and the control library are packaged respectively.
The method according to claim 2, wherein said packaging said XBAP program library, said interface library and said control library respectively includes:

Calculate the MD5 value of the XBAP program library, interface library and control library respectively, and obtain the MD5 value corresponding to each library;

The XBAP program library, the interface library and the control library are respectively packaged with corresponding MD5 values.
The method according to claim 3, wherein, before downloading the interface library or the control library from the Web server, the method further comprises:

Obtaining the MD5 values corresponding to the interface library and the control library, and determining whether the MD5 values corresponding to the interface library and the control library are the same as the corresponding historical MD5 values;

If the MD5 value of the interface library is different from the corresponding historical MD5 value, download the interface library from the Web server;

If the MD5 value of the control library is different from the corresponding historical MD5 value, download the control library from the Web server.
The method according to claim 1, wherein said obtaining the client file of the RPA design robot, said client file is packaged, comprising:

The type of the client file is uniformly modified to obtain a modified client file, and the modified file is packaged.
The method according to claim 1, wherein said generating an XBAP page based on said page access request, said method further comprising:

An XBAP page is generated based on the page access request and the ClickOnce deployment technology, and the XBAP page is deployed, wherein the XBAP page includes a WPF browser application program.
The method according to claim 1, wherein the process script generated on the process design page is used to control script execution software to execute the process script, the method further comprising:

Obtain the process design result of the user on the process design page;

Generate a process script according to the process design result, and debug the process script;

After the debugging of the process script is completed, the control script execution software executes the debugged process script.
A browser-based RPA implementation device, including:

The file packing module obtains the client file of the RPA design robot, and packs the client file, and the client file after the packing process includes an XBAP program library, an interface library and a control library;

Signature acquisition module, used to obtain the certificate signature of the XBAP library, the interface library and the control library, and the packaged XBAP library, the interface library and the control library and the corresponding certificates The signature is sent to the web server;

The program loading module is used to respond to the user's page access request in the browser, generate an XBAP page based on the page access request, download the XBAP program library from the Web server, and load the XBAP page on the XBAP page. Describe the XBAP library;

A page generation module, configured to download the interface library and the control library from the Web server, and load the interface library and the control library in the XBAP page to generate a process design page;

The process design module is used to control the script execution software to execute the process script according to the process script generated on the process design page.
A computer device, wherein the computer device includes a memory and a processor;

The memory is used to store computer programs;

The processor is configured to execute the computer program and implement the following steps when executing the computer program:

Obtain the client file of the RPA design robot, and package the client file, and the client file after the package process includes an XBAP program library, an interface library and a control library;

Obtain the certificate signature of the XBAP program library, the interface library and the control library, and send the packaged XBAP program library, the interface library and the control library and the corresponding certificate signature to the Web server;

In response to the user's page access request in the browser, an XBAP page is generated based on the page access request, the XBAP program library is downloaded from the Web server, and the XBAP program library is loaded on the XBAP page;

Download the interface library and the control library from the Web server, and load the interface library and the control library in the XBAP page to generate a process design page;

According to the process script generated by the process design page, the script execution software is controlled to execute the process script.
The computer device according to claim 9, wherein, when the processor implements the acquisition of the client file of the RPA design robot, when the client file is packaged, it is used to realize:

Obtain the client file of the RPA design robot, and process the file classification of the client file to obtain the file classification result;

Generate XBAP program library, interface library and control library based on the file classification result;

The XBAP program library, the interface library and the control library are packaged respectively.
The computer device according to claim 10, wherein, when said processor implements packaging processing of said XBAP program library, said interface library and said control library respectively, it is used to implement:

Calculate the MD5 value of the XBAP program library, interface library and control library respectively, and obtain the MD5 value corresponding to each library;

The XBAP program library, the interface library and the control library are respectively packaged with corresponding MD5 values.
The computer device according to claim 11, wherein, before realizing the downloading of the interface library or the control library from the Web server, the processor is further configured to:

Obtaining the MD5 values corresponding to the interface library and the control library, and determining whether the MD5 values corresponding to the interface library and the control library are the same as the corresponding historical MD5 values;

If the MD5 value of the interface library is different from the corresponding historical MD5 value, download the interface library from the Web server;

If the MD5 value of the control library is different from the corresponding historical MD5 value, download the control library from the Web server.
The computer device according to claim 9, wherein, when the processor realizes obtaining the client file of the RPA design robot, and when the client file is packaged, it is used to realize:

The type of the client file is uniformly modified to obtain a modified client file, and the modified file is packaged.
The computer device according to claim 9, wherein, when the processor implements the process script generated according to the process design page, and controls the script execution software to execute the process script, it is used to realize:

Obtain the process design result of the user on the process design page;

Generate a process script according to the process design result, and debug the process script;

After the debugging of the process script is completed, the control script execution software executes the debugged process script.
A computer-readable storage medium, wherein the computer-readable storage medium stores a computer program, and when the computer program is executed by a processor, the processor implements the following steps:

Obtain the client file of the RPA design robot, and package the client file, and the client file after the package process includes an XBAP program library, an interface library and a control library;

Obtain the certificate signature of the XBAP program library, the interface library and the control library, and send the packaged XBAP program library, the interface library and the control library and the corresponding certificate signature to the Web server;

In response to the user's page access request in the browser, an XBAP page is generated based on the page access request, the XBAP program library is downloaded from the Web server, and the XBAP program library is loaded on the XBAP page;

Download the interface library and the control library from the Web server, and load the interface library and the control library in the XBAP page to generate a process design page;

According to the process script generated by the process design page, the script execution software is controlled to execute the process script.
The computer-readable storage medium according to claim 15, wherein, when the processor implements the acquisition of the client file of the RPA design robot, and when the client file is packaged, it is used to realize:

Obtain the client file of the RPA design robot, and process the file classification of the client file to obtain the file classification result;

Generate XBAP program library, interface library and control library based on the file classification result;

The XBAP program library, the interface library and the control library are packaged respectively.
The computer-readable storage medium according to claim 16, wherein the processor is configured to realize:

Calculate the MD5 value of the XBAP program library, interface library and control library respectively, and obtain the MD5 value corresponding to each library;

The XBAP program library, the interface library and the control library are respectively packaged with corresponding MD5 values.
The computer-readable storage medium according to claim 17, wherein, before realizing the downloading of the interface library or the control library from the Web server, the processor is further configured to:

Obtaining the MD5 values corresponding to the interface library and the control library, and determining whether the MD5 values corresponding to the interface library and the control library are the same as the corresponding historical MD5 values;

If the MD5 value of the interface library is different from the corresponding historical MD5 value, download the interface library from the Web server;

If the MD5 value of the control library is different from the corresponding historical MD5 value, download the control library from the Web server.
The computer-readable storage medium according to claim 15, wherein the processor realizes obtaining the client file of the RPA design robot, and when the client file is packaged, it is used to realize:

The type of the client file is uniformly modified to obtain a modified client file, and the modified file is packaged.
The computer-readable storage medium according to claim 15, wherein, when the processor implements the process script generated according to the process design page and controls the script execution software to execute the process script, it is configured to:

Obtain the process design result of the user on the process design page;

Generate a process script according to the process design result, and debug the process script;

After the debugging of the process script is completed, the control script execution software executes the debugged process script.