CN113971065B - Method for realizing picture-in-picture in RPA enterprise process automation - Google Patents
Method for realizing picture-in-picture in RPA enterprise process automation Download PDFInfo
- Publication number
- CN113971065B CN113971065B CN202111271047.8A CN202111271047A CN113971065B CN 113971065 B CN113971065 B CN 113971065B CN 202111271047 A CN202111271047 A CN 202111271047A CN 113971065 B CN113971065 B CN 113971065B
- Authority
- CN
- China
- Prior art keywords
- picture
- rpa
- user
- pip
- rpa robot
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000000034 method Methods 0.000 title claims abstract description 52
- 238000004801 process automation Methods 0.000 title claims abstract description 13
- 238000013507 mapping Methods 0.000 claims description 5
- 238000012545 processing Methods 0.000 claims description 5
- 238000012544 monitoring process Methods 0.000 claims description 3
- 238000004806 packaging method and process Methods 0.000 claims description 3
- 238000012795 verification Methods 0.000 claims description 2
- 230000008569 process Effects 0.000 abstract description 22
- 238000005516 engineering process Methods 0.000 description 32
- 230000006870 function Effects 0.000 description 13
- 230000004044 response Effects 0.000 description 9
- 241000282414 Homo sapiens Species 0.000 description 8
- 238000010586 diagram Methods 0.000 description 5
- 230000006872 improvement Effects 0.000 description 4
- 238000003860 storage Methods 0.000 description 4
- 230000009467 reduction Effects 0.000 description 3
- 238000011161 development Methods 0.000 description 2
- 230000003287 optical effect Effects 0.000 description 2
- 230000009466 transformation Effects 0.000 description 2
- 206010063385 Intellectualisation Diseases 0.000 description 1
- 206010040007 Sense of oppression Diseases 0.000 description 1
- 230000002159 abnormal effect Effects 0.000 description 1
- 238000004590 computer program Methods 0.000 description 1
- 230000007547 defect Effects 0.000 description 1
- 238000013461 design Methods 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 238000004519 manufacturing process Methods 0.000 description 1
- 239000013307 optical fiber Substances 0.000 description 1
- 239000000047 product Substances 0.000 description 1
- 230000003252 repetitive effect Effects 0.000 description 1
- 238000012552 review Methods 0.000 description 1
- 239000004065 semiconductor Substances 0.000 description 1
- 239000013589 supplement Substances 0.000 description 1
- 239000011800 void material Substances 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F9/00—Arrangements for program control, e.g. control units
- G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
- G06F9/44—Arrangements for executing specific programs
- G06F9/451—Execution arrangements for user interfaces
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06Q10/00—Administration; Management
- G06Q10/10—Office automation; Time management
- G06Q10/103—Workflow collaboration or project management
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
- Y02P—CLIMATE CHANGE MITIGATION TECHNOLOGIES IN THE PRODUCTION OR PROCESSING OF GOODS
- Y02P90/00—Enabling technologies with a potential contribution to greenhouse gas [GHG] emissions mitigation
- Y02P90/02—Total factory control, e.g. smart factories, flexible manufacturing systems [FMS] or integrated manufacturing systems [IMS]
Landscapes
- Engineering & Computer Science (AREA)
- Business, Economics & Management (AREA)
- Human Resources & Organizations (AREA)
- Strategic Management (AREA)
- Software Systems (AREA)
- Theoretical Computer Science (AREA)
- Physics & Mathematics (AREA)
- Entrepreneurship & Innovation (AREA)
- General Physics & Mathematics (AREA)
- Operations Research (AREA)
- Tourism & Hospitality (AREA)
- Quality & Reliability (AREA)
- General Business, Economics & Management (AREA)
- Marketing (AREA)
- Economics (AREA)
- Human Computer Interaction (AREA)
- Data Mining & Analysis (AREA)
- General Engineering & Computer Science (AREA)
- Information Transfer Between Computers (AREA)
Abstract
The invention provides a picture-in-picture implementation method in RPA enterprise process automation. The technical scheme of the invention can make the working process of the RPA robot independent and show in a small picture-in-picture window. The operator can perform other related operations outside this window. Therefore, man-machine cooperation is realized, namely, an operator can simultaneously use the current computer terminal to do other work while the RPA robot executes tasks. A plurality of picture-in-picture interfaces coexist, namely a plurality of RPA robots simultaneously execute respective tasks, so that high-density deployment of one computer terminal is realized, and resources are greatly saved.
Description
Technical Field
The application relates to the technical field of Robot Process Automation (RPA), in particular to a picture-in-picture implementation method in RPA enterprise process automation.
Background
The picture-in-picture technology can ensure that the robot process automation RPA robot and human work at the same time in the same computer without mutual interference, and the upgrading and the supplement of the RPA technology application solve the use pain point in the RPA technology application process.
RPA (robot Process Automation), i.e., robotic Process Automation. The robot software can simulate the operation of human beings in digital equipment such as a computer, utilizes and fuses various existing technologies through automation and intellectualization based on established processes and rules, reduces repeated, complicated and large-batch work tasks and realizes automation of business processes. The RPA technology and the application thereof are rapidly developed at home at present, and more enterprises in various industries add the application of the RPA technology into development strategies of the enterprises, including governments, manufacturing industries, energy fields, large-scale national enterprises, financial industries, logistics industries, medical industries, real estate, logistics, consumption retail industries and the like.
With the rapid development of internet informatization and digitization, a large number of enterprises are faced with the goal of cost reduction and efficiency improvement through internet digital transformation. Since the beginning of 2020, epidemic situations are that a pause key is pressed down in most industries, marketing is stagnated, and defects in the operation of the past enterprises are amplified one by one. Enterprises are forced to review input and output and improve vibration operation efficiency again. Under the background, the characteristics of the RPA such as stability, efficiency improvement and easy use are deeply favored by enterprises and are applied to large-scale enterprises first. Meanwhile, with the help of the strong pressure resistance of large enterprises, the growing RPA can avoid the oppression of epidemic situation smoothly, thus realizing the growth against the market.
RPA liberates mankind by performing "massive, tedious, well-defined regular, highly repetitive" work instead of mankind, putting mankind into more creative and decision-making work. Because the core of the RPA is to imitate the working mode and working mode of human to replace the work of human, the working environment of the RPA robot is required to be completed in a computer terminal as well as human. When the RPA robot works, all software and hardware resources of the current computer, including memory, hard disk, mouse, keyboard, various software, etc., need to be used. If the relevant manual operation is performed at this time, conflicts (such as a keyboard, a mouse and the like) in relevant hardware can be caused, and the RPA robot works abnormally. That is, when the RPA robot performs a task, a human cannot use the current computer to do other work at the same time.
Therefore, how to save resources to the maximum extent and improve the efficiency of the joint work of the RPA robot and the human in the application process of the RPA technology is a technical problem which needs to be solved urgently.
Disclosure of Invention
In order to solve the technical problem, the invention provides a picture-in-picture implementation method in RPA enterprise process automation. The technical scheme of the invention is just necessary technical upgrade on the existing advantages of the RPA technology. It can separate the working process of the RPA robot and show the working process in a small picture-in-picture window. The operator can perform other related operations outside this window. Therefore, man-machine cooperation is realized, namely, an operator can simultaneously use the current computer terminal to do other work while the RPA robot executes tasks. A plurality of picture-in-picture interfaces coexist, namely a plurality of RPA robots simultaneously execute respective tasks, so that high-density deployment of one computer terminal is realized, and resources are greatly saved.
The technical scheme adopted by the invention is as follows:
a method for realizing picture-in-picture in RPA enterprise process automation comprises the following steps:
step 1, starting a remote service function in a computer terminal, and modifying the default maximum remote number of a system in a local group strategy of the computer terminal to be more than 1;
step 2, logging in and checking by using a plurality of user accounts and passwords;
step 3, monitoring the access of the RDP protocol by using the environment patch package, realizing the encryption and decryption processing of the data information of a plurality of users through an encryption and decryption layer of the RDP protocol forwarding service, and creating a user session by calling termsrv.dll; when the picture-in-picture function is started through the RPA robot actuator, an RDP protocol is intercepted and forwarded to a corresponding user session, so that login of a plurality of users is realized;
and 4, enabling the plurality of user accounts which are logged in simultaneously to respectively correspond to a picture-in-picture interface, and simultaneously displaying the plurality of user accounts on a screen in the form of the plurality of picture-in-picture interfaces.
Further, the step 2 comprises:
mapping the provided user account number and password pair to a Windows account, and if the mapping fails, failing to verify the identity; otherwise, the identity authentication is successful.
Further, the step 3 includes:
and creating an operation flow for an encryption and decryption layer, a termsrv.dll call and a user session of the RDP protocol forwarding service, and compiling and packaging codes to form the environment patch package.
Further, the step 4 comprises the following steps:
step 401, configuring information of a plurality of user accounts for the RPA robot actuator, so that a corresponding relationship is established between the RPA robot actuator and each user account;
step 402, constructing a plurality of picture-in-picture clients supporting the RDP protocol;
step 403, dynamically setting the IP address, user account, password and display attribute of each pip client;
step 404, when the pip function is started, establishing a one-to-one correspondence between each pip client and each pip interface, and the RPA robot executor transmits user parameters and window parameters to each pip client to perform pip display.
Further, the step 5 comprises the following steps:
step 501, starting an RPA robot SDK service in each picture-in-picture client based on an http protocol;
step 502, based on configured user account information, the RPA robot executor invokes RPA execution services corresponding to each user account in an independent session space of each pip client, so that a plurality of RPA robots execute respective tasks at the same time.
Further, the step 1 is realized by executing a registry script file of the Windows operating system.
Further, the multiple picture-in-picture interfaces are independent, and can be switched among different picture-in-picture interfaces according to the instruction of a user, and the operation of the RPA robot is started or terminated.
Further, the pip Client is constructed using axmstsclib. Axmsrdpclient8 notsafeforscaling by referencing Microsoft Terminal Services Active Client dynamic link library.
Further, the plurality of picture-in-picture interfaces include one or more interfaces operated by manual control of a user.
Further, step 5, after step 4, is to run RPA robot executors in each picture-in-picture interface respectively to perform the respective tasks.
Through the embodiment of the application, the following technical effects can be obtained:
1) The resources are saved: the application of the picture-in-picture technology can greatly save the investment of resources when an enterprise applies the RPA technology;
2) The efficiency is improved: the RPA robot executes tasks and business personnel work, and the picture-in-picture technology coexists in the same computer terminal, so that the business personnel can visually know and control the task execution condition and the process running condition of the RPA robot, the function of the RPA robot is optimized, and the exception handling work is simple and efficient.
Drawings
In order to more clearly illustrate the technical solutions in the embodiments of the present application, the drawings needed to be used in the embodiments or the prior art descriptions will be briefly described below, and it is obvious that the drawings in the following description are some embodiments of the present application, and those skilled in the art can also obtain other drawings according to the drawings without inventive labor.
FIG. 1 is a schematic representation of the operating environment of the process of the present invention;
FIG. 2 is a schematic flow chart of the method of the present invention for simultaneously logging in and using multiple accounts;
FIG. 3 is a schematic flow chart of the display and control in PIP form;
fig. 4 is a schematic diagram of a structure for running RPA software and simultaneously executing tasks.
Detailed Description
In order to make the objects, technical solutions and advantages of the embodiments of the present application clearer, the technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application, and it is obvious that the described embodiments are some embodiments of the present application, but not all embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present application.
Before describing the technical solution of the present invention in detail, the term convention used in the present invention is first introduced as follows:
an actuator Worker: the RPA robot is completed by mutually matching a plurality of modules of RPA software from design to use, and can be roughly divided into:
1) RPA designer-platform for designing, developing robots;
2) The RPA actuator, namely the Worker, runs the application of the developed robot;
3) RPA management platform-platform for unified management of RPA robots.
The picture-in-picture technology of the invention is mainly used for improving the RPA actuator, namely the Worker capability. The traditional RPA software executor Worker needs to independently occupy a computer to operate the RPA robot, and during the operation of the RPA robot, a user cannot normally use various hardware of the computer, such as a keyboard and a mouse, otherwise, the operation process of the RPA robot is abnormal. The application of the picture-in-picture technology can realize that a plurality of RPA robots are deployed on one computer to run simultaneously in a mode of a plurality of picture-in-picture windows, and a user can simultaneously use the computer to process other work.
FIG. 1 is a schematic diagram of the operating environment of the process of the present invention. The system comprises a computer terminal, wherein an RPA robot executor Worker is loaded on the computer terminal, a plurality of picture-in-picture interfaces, such as picture-in-picture 1, picture-in-picture 2 and picture-in-picture 3, 8230, 8230and picture-in-picture n, can be simultaneously displayed on a display screen main interface of the computer terminal by operating the RPA executor, each picture-in-picture interface corresponds to one operating RPA robot, and a user can simultaneously process other works by using a computer.
FIG. 3 is a flow chart showing and controlling in a picture-in-picture manner; fig. 4 is a schematic diagram of a structure for running RPA software and simultaneously executing tasks.
The method of the invention realizes the simultaneous login and use of multiple accounts by utilizing the multi-account function of the operating system. FIG. 2 is a schematic flow chart of the method of the present invention for simultaneously logging in and using multiple accounts.
The picture-in-picture technique advances in that: the resource of one computer can be simultaneously applied to a plurality of independent working scenes, namely the picture-in-picture technology enables one computer to have the capability of dividing the system into two parts, for example, an RPA robot needs to execute a working task of opening a browser and inputting search contents, meanwhile, a worker needs to complete the work of document editing, and under the traditional mode, the work cannot be completed in one computer system, because both works have the flow of character editing, and one computer system can only support the character editing (keyboard input) of one work at the same time. The picture-in-picture technology places two jobs in two completely independent systems on one computer, thereby realizing that the two jobs can be carried out simultaneously without mutual interference. If a further job is needed, a separate system is added by the pip technique. Each independent system is presented in the form of an independent 'window', the core of the realization is that the independent systems and the accounts of the computer system are in one-to-one correspondence, and the independent systems depend on the simultaneous login of multiple accounts of the computer.
The method for realizing simultaneous login and use of multiple accounts specifically comprises the following steps:
step 1, starting a remote service function in a computer terminal, and modifying the default maximum remote number of a system in a local group strategy of the computer terminal to be more than 1 by executing a self-defined reg file;
the step 1 is the basis for realizing the simultaneous login of multiple accounts. Taking a custom url protocol as an example, the content format of the reg file is as follows:
WindowsRegistryEditorVersion5.00
[HKEY_CLASSES_ROOT\SelfURIProto]
"URLProtocol"=""
"Desp" = "custom uri protocol"
@="URL:SelfdefineProtocolHandler"
[HKEY_CLASSES_ROOT\SelfURIProto\shell]
[HKEY_CLASSES_ROOT\SelfURIProto\shell\open]
[HKEY_CLASSES_ROOT\SelfURIProto\shell\open\command]
@="C:\\Users\\user\\AppData\\Local\\Programs\\MicrosoftVSCode\\Code.exe"
Step 2, checking by using the user account and the password;
the verification is performed by using the user account and the password, and the method specifically comprises the following steps:
the standard UserPassword authentication program maps the provided user name and password pair to a Windows account, and if the mapping fails, the authentication fails; otherwise, the identity authentication is successful;
and 3, monitoring the access of the RDP by using the environment patch package, realizing encryption and decryption processing on data information of a plurality of users through an encryption and decryption layer of the RDP forwarding service, and establishing a user session by calling termsrv. When the picture-in-picture function is started through the RPA robot actuator, an RDP protocol is intercepted and forwarded to a corresponding user session, so that login of a plurality of users is realized;
in the step 3, after the RDP protocol is accessed, the encryption and decryption layers of the RDP protocol are used to encrypt and decrypt the data information of a plurality of users, the termsrv.dll call and the user session creation operation flow are performed, and the environment patch package is formed by code compiling and packaging;
therefore, when the computer applies the picture-in-picture technology for the first time, the whole process does not need to be manually configured, and the service environment patch package can be directly read.
Through the technical implementation process, a mode that one computer simultaneously logs in through multiple accounts is formed, and multiple independent system operation interfaces corresponding to the multiple accounts and a picture-in-picture interface are achieved.
Step 4, displaying and controlling a plurality of accounts logged in simultaneously in a picture-in-picture mode;
fig. 3 is a flow chart showing and controlling in a picture-in-picture form. The essence of pip technology is to better refine RPA process automation applications through "man-machine collaboration" and "high-density deployment". The picture-in-picture technique is ultimately embodied in an RPA technique application scenario. The method is called picture-in-picture because the method is the most intuitive expression for the application of two advanced capabilities of 'high-density deployment' and 'man-machine cooperation' in RPA enterprise process automation application: and the plurality of RPA robots working simultaneously are respectively displayed in independent windows. On the screen of a computer, a large window frame is formed, which contains a plurality of small window frames. The capability of one machine with multiple systems is realized. Next, how to use multiple systems simultaneously will be presented to the user in a picture-in-picture intuitive manner. This will be explained in this section.
The Windows system reserves a 3389 port as a remote connection network port, and can support remote login of the computer by using a user account through equipment such as a mobile phone, a computer and the like. The user can set the computer to be provided with a plurality of login users, and different desktops are displayed and related operations are executed by switching the users. Different desktops can be displayed in a remote mode under the conditions of opening the program service and allowing a user to remotely log in. The pip is actually a client supporting the RDP protocol, supporting login to the remote desktop.
The process of the RPA robot running the task in the picture-in-picture interface can be controlled by the user. Because each picture-in-picture interface is an independent 'system', a user can switch to any picture-in-picture interface at any time and actively start or stop the operation of the robot or perform other operations.
In step 4, the displaying and controlling in the form of picture-in-picture specifically includes the following steps:
step 401, after completing the creation of multiple accounts, configuring user information for the RPA robot actuator in the RPA software system, so that a corresponding relationship is established between the RPA robot actuator and each account;
step 402, an RPA robot actuator is developed by using an AxMSTSClib.AxMsRdpClient8NotSafeForScript by referring to a Microsoft Terminal Services Active Client dynamic link library, so that the RPA robot actuator supports an RDP protocol; the RPA robot executor is a client developed by a C/S architecture and C # bottom language;
an example of the working principle of the remote connection machine is encoded as follows:
private void Form1_Load(object sender, Event Argse)
{ var rdpClient = new AxMsRdpClient9NotSafeForScripting
{
Dock = DockStyle.None,
Width = 2000,
Height = 1000
};
this.panel1.Controls.Add(rdpClient);
rdpClient.Server = "182.160.120.20";
if (port != 3389)
rdpClient.AdvancedSettings2.RDPPort = port;
rdpClient.UserName = "admin";
rdpClient.AdvancedSettings2.ClearTextPassword = "aabbcc";
var clientNonScriptable = (IMsRdpClientNonScriptable5)rdpClient.GetOcx();
rdpClient.AdvancedSettings9.EnableCredSspSupport = true;
rdpci. Connecting text = $ "connecting [ {"182.160.120.20"} ], please wait. -;
rdpClient.Connect();
}
step 403, the computer terminal dynamically sets IP addresses, user names, passwords, and desktop resolution attributes of the multiple pip interfaces, then runs the RPA robot executor in the multiple pip interfaces, and establishes a corresponding relationship with each pip interface when starting the pip function;
step 404, by invoking the pip client, the RPA robot executor transmits the user parameter and the window parameter to the pip client to perform pip display;
through the technical implementation process, the system can display and control a plurality of 'system components' under one computer in a picture-in-picture intuitive mode.
And 5, respectively operating the RPA robot executors on a plurality of picture-in-picture windows under the computer terminal in the figure 1, and realizing that a plurality of RPA robots execute tasks simultaneously.
Fig. 4 is a schematic structural diagram of the RPA software running and task execution in the method of the present invention. And (3) the operation of the RPA robot needs the RPA robot executor as a carrier, the RPA robot is added into the RPA robot executor, and the SDK service of the RPA robot is started. In a plurality of picture-in-picture interface windows, the RPA robot executors are respectively operated to respectively enable the RPA robot to execute tasks, so that the simultaneous execution is realized, and the mutual interference is avoided. If conventional virtual machine technology is used, RPA software needs to be deployed on all virtual machines. Not only occupies a large amount of resources, but also reduces the operating efficiency of the computer. The application of the picture-in-picture technique is to launch the RPA software application through accounts with different IP addresses. Each account is provided with an exclusive IP address and a port, and the accounts operate respectively by controlling the respective login IP address and the set port, so that conflicts and resource occupation which may be generated during operation are avoided. Since the pip technology must be used in combination with a robot actuator (Worker) of RPA software, the successful combination and stability of the pip technology and the Worker application in a plurality of system components is also a crucial part of the technical scheme of the present invention, and the technical implementation manner of this part is as follows:
step 501, respectively operating RPA robot actuators in a plurality of picture-in-picture interfaces, and supporting http protocol to call;
the technical implementation principle is exemplified as follows:
var PORT = 3000;
var http = require('http');
var url=require('url');
var fs=require('fs');
var mine=require('./mine').types;
var path=require('path');
var server = http.createServer(function (request, response) {
var pathname = url.parse(request.url).pathname;
var realPath = path.join("assets", pathname);
//console.log(realPath);
var ext = path.extname(realPath);
fs.exists(realPath, function (exists) {
if (!exists) {
response.writeHead(404, {
'Content-Type': 'text/plain'
});
response.write("This request URL " + pathname + " was not found on this server.");
response.end();
} else {
fs.readFile(realPath, "binary", function (err, file) {
if (err) {
response.writeHead(500, {
'Content-Type': 'text/plain'
});
response.end(err);
} else {
var contentType = mine[ext] || "text/plain";
response.writeHead(200, {
'Content-Type': contentType
});
response.write(file, "binary");
response.end();
}
});
}
});
});
server.listen(PORT);
console.log("Server runing at port: " + PORT + ".");
step 502, in the RPA robot actuator, selecting any picture-in-picture interface to execute the RPA robot task, and calling RPA execution services corresponding to different user accounts in an independent session space according to the configured information to enable the RPA robot to execute the task.
According to the technical scheme of the invention, the RPA enterprise process automation software with the picture-in-picture technology can perform daily financial reconciliation in enterprise financial work. In the daily financial reconciliation work of an enterprise, the work flow and the content of the RPA robot generally comprise: 1) Logging in a bank system; 2) Downloading bank details; 3) Automatically formatting the download detail, and putting the download detail into a statement sample table; 4) Automatically logging in an enterprise SAP system and importing a statement bill; 5) Carrying out automatic account checking; 6) And making the account checking result into a table.
If more banks are involved in the reconciliation work, the RPA robot can only process one bank by one bank. If an enterprise wishes to simultaneously process the account checking work of multiple banks through multiple RPA robots, multiple computers need to be equipped, and each computer needs to be deployed with a corresponding RPA software system. And the reconciliation result table after the reconciliation work is finished needs to be unified and summarized from each computer.
By applying RPA enterprise process automation software, regular, large, repeated and fussy account checking work in daily finance of an enterprise is solved. In one computer, RPA enterprise process automation software only needs to be deployed once. Through the picture-in-picture technology, a plurality of RPA robots are operated simultaneously, account checking work of different banks is executed respectively, and account checking result tables after account checking are finished do not need secondary collection.
In the process of executing account checking work by the RPA robot, the enterprise staff receives occasional work, such as mail receiving and replying, document signing and the like. At this time, it is necessary to wait for the RPA robot to finish the current reconciliation process, and the enterprise staff can use the computer. Unless the workflow of the current RPA robot is terminated. Through the picture-in-picture technology, the RPA robot can carry out account checking work through the picture-in-picture mode. When enterprise employees need to use a computer to process other works, the work flow of the enterprise employees and the work flow of the RPA robot are not interfered with each other and are synchronously carried out.
Through the technical scheme of the invention, resources can be saved. The application of the picture-in-picture technology can greatly save the investment of resources when an enterprise applies the RPA technology. Although the RPA robot replaces human beings to complete a large amount of repeated regular and fussy work, the efficiency is improved, and the manpower is liberated. However, the problem is that when the RPA robot is performing tasks, the current computer terminal does not support other tasks, such as daily tasks of enterprise employees. If enterprise employees need to synchronously complete other work, the investment of an additional computer is needed. After the picture-in-picture technology is applied, only one computer terminal is needed, and the RPA robot and the enterprise staff can work simultaneously without mutual interference. With the increasing application of RPA technology by enterprises, the resource saving brought by the picture-in-picture technology is more obvious.
In the present day when the digitization of the internet is rapidly developed, "cost reduction and efficiency improvement" is a core target of the digitization upgrading transformation of each enterprise. More and more enterprises choose to apply the RPA technology because the RPA technology can help the enterprises to quickly realize the aim of 'cost reduction and efficiency improvement', while the invention of the picture-in-picture technology is the second qualitative leap of the RPA technology in this respect.
In some embodiments, part or all of the computer program may be loaded and/or installed onto the device via ROM. When loaded and executed, may perform one or more of the steps of the method described above.
The functions described above in this application may be performed at least in part by one or more hardware logic components. For example, without limitation, exemplary types of hardware logic components that may be used include: a Field Programmable Gate Array (FPGA), an Application Specific Integrated Circuit (ASIC), an Application Specific Standard Product (ASSP), a system on a chip (SOC), a load programmable logic device (CPLD), and the like.
Program code for implementing the methods of the present disclosure may be written in any combination of one or more programming languages. These program code may be provided to a processor or controller of a general purpose computer, special purpose computer, or other programmable data processing apparatus, such that the program code, when executed by the processor or controller, causes the functions/acts specified in the flowchart and/or block diagram to be performed. The program code may execute entirely on the machine, partly on the machine, as a stand-alone software package partly on the machine and partly on a remote machine or entirely on the remote machine or server.
In the context of this disclosure, a machine-readable medium may be a tangible medium that can contain, or store a program for use by or in connection with an instruction execution system, apparatus, or device. The machine-readable medium may be a machine-readable signal medium or a machine-readable storage medium. A machine-readable medium may include, but is not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any suitable combination of the foregoing. More specific examples of a machine-readable storage medium would include an electrical connection based on one or more wires, a portable computer diskette, a hard disk, a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.
Further, while operations are depicted in a particular order, this should be understood as requiring that such operations be performed in the particular order shown or in sequential order, or that all illustrated operations be performed, to achieve desirable results. Under certain circumstances, multitasking and parallel processing may be advantageous. Likewise, while several specific implementation details are included in the above discussion, these should not be construed as limitations on the scope of the disclosure. Certain features that are described in the context of separate embodiments can also be implemented in combination in a single implementation. Conversely, various features that are described in the context of a single implementation can also be implemented in multiple implementations separately or in any suitable subcombination.
Although the subject matter has been described in language specific to structural features and/or methodological acts, it is to be understood that the subject matter defined in the appended claims is not necessarily limited to the specific features or acts described above. Rather, the specific features and acts described above are disclosed as example forms of implementing the claims.
Claims (9)
1. A picture-in-picture implementation method for RPA process automation, which is characterized by comprising the following steps:
step 1, starting a remote service function in a computer terminal, and modifying the default maximum remote number of a system in a local group strategy of the computer terminal to be more than 1;
step 2, using a plurality of user account numbers and passwords to carry out login verification;
step 3, after the RDP protocol is accessed, the data information of a plurality of users is encrypted and decrypted through an encryption and decryption layer of the RDP protocol, the operation flows of term rv.dll calling and user session creating are carried out, and an environment patch package is formed through code compiling and packaging; monitoring the access of the RDP by using an environment patch package, realizing encryption and decryption processing on data information of a plurality of users through an encryption and decryption layer of RDP forwarding service, and creating a user session by calling termsrv.dll; when the picture-in-picture function is started through the RPA robot actuator, an RDP protocol is intercepted and forwarded to a corresponding user session, so that login of a plurality of users is realized;
and 4, enabling the plurality of user accounts which are logged in simultaneously to respectively correspond to a picture-in-picture interface, and simultaneously displaying the plurality of user accounts on a screen in the form of the plurality of picture-in-picture interfaces.
2. The method of claim 1, wherein step 2 comprises:
mapping the provided user account number and password pair to a Windows account, and if the mapping fails, the identity authentication fails; otherwise, the identity authentication is successful.
3. The method according to claim 1, wherein the step 4 comprises the steps of: step 401, configuring information of a plurality of user accounts for the RPA robot actuator, so that a corresponding relationship is established between the RPA robot actuator and each user account;
step 402, constructing a plurality of picture-in-picture clients supporting RDP;
step 403, dynamically setting the IP address, user account, password and display attribute of each pip client;
step 404, when the pip function is started, establishing a one-to-one correspondence between each pip client and each pip interface, and the RPA robot executor transmits user parameters and window parameters to each pip client to perform pip display.
4. The method of claim 1, further comprising, after step 4, step 5 of running RPA robot actuators in respective picture-in-picture interfaces to perform respective tasks.
5. The method of claim 4, wherein the step 5 comprises the steps of: step 501, starting an RPA robot SDK service in each picture-in-picture client based on an http protocol; step 502, based on configured user account information, the RPA robot executor invokes RPA execution services corresponding to each user account in an independent session space of each pip client, so that a plurality of RPA robots execute respective tasks at the same time.
6. The method of claim 1, wherein step 1 is performed by executing a registry script file of a Windows operating system.
7. The method of claim 1, wherein the plurality of picture-in-picture interfaces are independent of each other, and can be switched between different picture-in-picture interfaces according to the instruction of a user, and start or terminate the operation of the RPA robot.
8. The method of claim 3, wherein the PIP Client is built using AxMSTSClib.AxMsRdpClient8NotSafeForScripting by referencing Microsoft Terminal Services Active Client dynamic link library.
9. The method of claim 1, wherein the plurality of picture-in-picture interfaces includes one or more interfaces operated by manual user control.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111271047.8A CN113971065B (en) | 2021-10-29 | 2021-10-29 | Method for realizing picture-in-picture in RPA enterprise process automation |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111271047.8A CN113971065B (en) | 2021-10-29 | 2021-10-29 | Method for realizing picture-in-picture in RPA enterprise process automation |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN113971065A CN113971065A (en) | 2022-01-25 |
| CN113971065B true CN113971065B (en) | 2023-04-07 |
Family
ID=79588915
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202111271047.8A Active CN113971065B (en) | 2021-10-29 | 2021-10-29 | Method for realizing picture-in-picture in RPA enterprise process automation |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN113971065B (en) |
Citations (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111835732A (en) * | 2020-06-24 | 2020-10-27 | 广州海颐信息安全技术有限公司 | Remote access security management system |
Family Cites Families (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20090144237A1 (en) * | 2007-11-30 | 2009-06-04 | Michael Branam | Methods, systems, and computer program products for providing personalized media services |
| US11055067B2 (en) * | 2019-10-18 | 2021-07-06 | Asg Technologies Group, Inc. | Unified digital automation platform |
| CN113254174A (en) * | 2021-05-26 | 2021-08-13 | 广州衡昊数据科技有限公司 | RPA robot process automation implementation system and method |
-
2021
- 2021-10-29 CN CN202111271047.8A patent/CN113971065B/en active Active
Patent Citations (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111835732A (en) * | 2020-06-24 | 2020-10-27 | 广州海颐信息安全技术有限公司 | Remote access security management system |
Also Published As
| Publication number | Publication date |
|---|---|
| CN113971065A (en) | 2022-01-25 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US20200241914A1 (en) | Pattern-based orchestration of cloud provisioning tasks at runtime | |
| EP1393169B1 (en) | Method and system for automatically configuring a client-server network | |
| US7451403B1 (en) | System and method for developing user interfaces purely by modeling as meta data in software application | |
| US8762187B2 (en) | Easy process modeling platform | |
| US6385652B1 (en) | Customer access solutions architecture | |
| US11522851B2 (en) | Secured rest execution inside headless web application | |
| CN107924411A (en) | The recovery of UI states in transaction system | |
| US20180081702A1 (en) | Pre/post deployment customization | |
| US20230409837A1 (en) | Systems and methods for a virtual agent in a cloud computing environment | |
| US9141442B1 (en) | Automated connector creation for provisioning systems | |
| US10929279B2 (en) | Systems and method for automated testing framework for service portal catalog | |
| CN110231975A (en) | A kind of applied program processing method, device and electronic equipment | |
| CA3178644A1 (en) | Techniques to facilitate a migration process to cloud storage | |
| CN113256095A (en) | Draggable configured agile flow service construction method, system, device and medium | |
| US20120096408A1 (en) | System and method for establishing a collaborative workspace | |
| CN113971065B (en) | Method for realizing picture-in-picture in RPA enterprise process automation | |
| US20100131853A1 (en) | Dynamic adaptive cross-site custom interface | |
| US20040237069A1 (en) | Creation of a script for executing commands | |
| US10819818B2 (en) | Smart factory application integration | |
| WO2020139840A1 (en) | System and method for configuring simple object access protocol (soap) components | |
| CN114840287B (en) | Task interaction method of cross-cloud desktop | |
| Balasubramanian | Retrieval And Decoding of Dynamic Data From Secured Cloud Using SNC Protocol Implementation | |
| CN116455773A (en) | Automatic service opening system and method based on network topology arrangement | |
| CN113298538A (en) | Method and device for processing customer service data | |
| CN115048079A (en) | Multi-programming language multi-system platform algorithm fusion service management assembly and use method |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant | ||
| PE01 | Entry into force of the registration of the contract for pledge of patent right |
Denomination of invention: A Method for Implementing Picture in Picture in RPA Enterprise Process Automation Granted publication date: 20230407 Pledgee: Ji'nan rural commercial bank Limited by Share Ltd. high tech branch Pledgor: Tuorui Technology Co.,Ltd. Registration number: Y2024980014392 |
|
| PE01 | Entry into force of the registration of the contract for pledge of patent right |