CN113971065A

CN113971065A - Method for realizing picture-in-picture in RPA enterprise process automation

Info

Publication number: CN113971065A
Application number: CN202111271047.8A
Authority: CN
Inventors: 杨开格; 周言; 马成龙; 马成
Original assignee: Tuorui Technology Co ltd
Current assignee: Tuorui Technology Co ltd
Priority date: 2021-10-29
Filing date: 2021-10-29
Publication date: 2022-01-25
Anticipated expiration: 2041-10-29
Also published as: CN113971065B

Abstract

The invention provides a picture-in-picture implementation method in RPA enterprise process automation. The technical scheme of the invention can make the working process of the RPA robot independent and show in a small picture-in-picture window. The operator can perform other related operations outside this window. Therefore, man-machine cooperation is realized, namely, an operator can simultaneously use the current computer terminal to do other work while the RPA robot executes tasks. A plurality of picture-in-picture interfaces coexist, namely a plurality of RPA robots simultaneously execute respective tasks, so that high-density deployment of one computer terminal is realized, and resources are greatly saved.

Description

Method for realizing picture-in-picture in RPA enterprise process automation

Technical Field

The application relates to the technical field of Robot Process Automation (RPA), in particular to a picture-in-picture implementation method in RPA enterprise process automation.

Background

The picture-in-picture technology can lead the robot process automation RPA robot and human to work at the same time in the same computer without mutual interference, and the upgrading and the supplement of the RPA technology application solve the use pain point in the RPA technology application process.

RPA (robotic Process Automation), namely, robotic Process Automation. The robot software can simulate the operation of human beings in digital equipment such as a computer, utilizes and fuses various existing technologies through automation and intellectualization based on established processes and rules, reduces repeated, complicated and large-batch work tasks and realizes automation of business processes. The RPA technology and the application thereof are rapidly developed at home at present, and more enterprises in various industries add the application of the RPA technology into development strategies of the enterprises, including governments, manufacturing industries, energy fields, large-scale national enterprises, financial industries, logistics industries, medical industries, real estate, logistics, consumption retail industries and the like.

With the rapid development of internet informatization and digitization, a large number of enterprises are faced with the goal of cost reduction and efficiency improvement through internet digital transformation. Since the year 2020, epidemic situations are that the pause key is pressed down by most industries, marketing is trapped in stagnation, and defects in enterprise operation are amplified one by one in the past. Enterprises are forced to review input and output and improve vibration operation efficiency again. Under the background, the characteristics of the RPA such as stability, efficiency improvement and easy use are deeply favored by enterprises and are applied to large-scale enterprises first. Meanwhile, with the help of the strong pressure resistance of large enterprises, the growing RPA can avoid the oppression of epidemic situation smoothly, thus realizing the growth against the market.

RPA liberates mankind by performing "massive, tedious, well-defined regular, highly repetitive" work instead of mankind, putting mankind into more creative and decision-making work. Because the core of the RPA is to imitate the working mode and working mode of human to replace the work of human, the working environment of the RPA robot is required to be completed in a computer terminal as well as human. When the RPA robot works, all software and hardware resources of the current computer, including memory, hard disk, mouse, keyboard, various software, etc., need to be used. If the relevant manual operation is performed at this time, conflicts (such as a keyboard, a mouse and the like) in relevant hardware can be caused, and the RPA robot works abnormally. That is, when the RPA robot performs a task, a human cannot use the current computer to do other work at the same time.

Therefore, how to save resources to the maximum extent and improve the efficiency of the joint work of the RPA robot and the human in the application process of the RPA technology is a technical problem which needs to be solved urgently.

Disclosure of Invention

In order to solve the technical problem, the invention provides a picture-in-picture implementation method in RPA enterprise process automation. The technical scheme of the invention is just necessary technical upgrade on the existing advantages of the RPA technology. It can isolate the working process of the RPA robot and display the working process in a small picture-in-picture window. The operator can perform other related operations outside this window. Therefore, man-machine cooperation is realized, namely, an operator can simultaneously use the current computer terminal to do other work while the RPA robot executes tasks. A plurality of picture-in-picture interfaces coexist, namely a plurality of RPA robots simultaneously execute respective tasks, so that high-density deployment of one computer terminal is realized, and resources are greatly saved.

The technical scheme adopted by the invention is as follows:

a method for realizing picture-in-picture in RPA enterprise process automation comprises the following steps:

step 1, starting a remote service function in a computer terminal, and modifying the default maximum remote number of a system in a local group strategy of the computer terminal to be more than 1;

step 2, logging in and checking by using a plurality of user accounts and passwords;

step 3, monitoring the access of the RDP protocol by using the environment patch package, realizing the encryption and decryption processing of the data information of a plurality of users through an encryption and decryption layer of the RDP protocol forwarding service, and creating a user session by calling termsrv.dll; when the picture-in-picture function is started through the RPA robot actuator, an RDP protocol is intercepted and forwarded to a corresponding user session, so that login of a plurality of users is realized;

and 4, enabling the plurality of user accounts which are logged in simultaneously to respectively correspond to a picture-in-picture interface, and simultaneously displaying the plurality of user accounts on a screen in the form of the plurality of picture-in-picture interfaces.

Further, the step 2 comprises:

mapping the provided user account number and password pair to a Windows account, and if the mapping fails, the identity authentication fails; otherwise, the identity authentication is successful.

Further, the step 3 includes:

and creating an operation flow by an encryption and decryption layer, a termsrv.

Further, the step 4 comprises the following steps:

step 401, configuring information of a plurality of user accounts for the RPA robot actuator, so that a corresponding relationship is established between the RPA robot actuator and each user account;

step 402, constructing a plurality of picture-in-picture clients supporting RDP;

step 403, dynamically setting the IP address, user account, password and display attribute of each pip client;

step 404, when the pip function is started, a one-to-one correspondence relationship is established between each pip client and each pip interface, and the RPA robot executor transmits user parameters and window parameters to each pip client to perform pip display.

Further, the step 5 comprises the following steps:

step 501, starting an RPA robot SDK service in each picture-in-picture client based on an http protocol;

step 502, based on configured user account information, the RPA robot executor invokes RPA execution services corresponding to each user account in an independent session space of each pip client, so that a plurality of RPA robots execute respective tasks at the same time.

Further, the step 1 is realized by executing a registry script file of the Windows operating system.

Further, the multiple picture-in-picture interfaces are independent, and can be switched among different picture-in-picture interfaces according to the instruction of a user, and the operation of the RPA robot is started or terminated.

Further, the pip Client is constructed using axmstsclib. axmsrdpclient8 notsafeforscaling by referencing Microsoft Terminal Services Active Client dynamic link library.

Further, the plurality of picture-in-picture interfaces include one or more interfaces operated by manual control of a user.

Further, step 5, after step 4, is to run RPA robot executors in each picture-in-picture interface respectively to perform the respective tasks.

Through the embodiment of the application, the following technical effects can be obtained:

1) the resources are saved: the application of the picture-in-picture technology can greatly save the investment of resources when an enterprise applies the RPA technology;

2) the efficiency is improved: the RPA robot executes tasks and business personnel work, and the picture-in-picture technology coexists in the same computer terminal, so that the business personnel can visually know and control the task execution condition and the process running condition of the RPA robot, the function of the RPA robot is optimized, and the exception handling work is simple and efficient.

Drawings

In order to more clearly illustrate the technical solutions in the embodiments of the present application, the drawings needed to be used in the embodiments or the prior art descriptions will be briefly described below, and it is obvious that the drawings in the following description are some embodiments of the present application, and those skilled in the art can also obtain other drawings according to the drawings without inventive labor.

FIG. 1 is a schematic diagram of the operating environment of the process of the present invention;

FIG. 2 is a schematic flow chart of the method of the present invention for simultaneously logging in and using multiple accounts;

FIG. 3 is a flow chart showing and controlling in a picture-in-picture manner;

fig. 4 is a schematic diagram of a structure for running RPA software and simultaneously executing tasks.

Detailed Description

In order to make the objects, technical solutions and advantages of the embodiments of the present application clearer, the technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application, and it is obvious that the described embodiments are some embodiments of the present application, but not all embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present application.

Before describing the technical solution of the present invention in detail, the term convention used in the present invention is first introduced as follows:

an actuator Worker: the RPA robot is completed by mutually matching a plurality of modules of RPA software from design to use, and can be roughly divided into:

1) RPA designer-platform for designing, developing robots;

2) the RPA actuator, namely the Worker, runs the application of the developed robot;

3) RPA management platform-platform for unified management of RPA robots.

The picture-in-picture technology of the invention is mainly used for improving the RPA actuator, namely the Worker capability. The traditional RPA software executor Worker needs to independently occupy a computer to operate the RPA robot, and during the operation of the RPA robot, a user cannot normally use various hardware of the computer, such as a keyboard and a mouse, otherwise, the operation process of the RPA robot is abnormal. The application of the picture-in-picture technology can realize that a plurality of RPA robots are deployed on one computer to run simultaneously in a mode of a plurality of picture-in-picture windows, and a user can process other works simultaneously by using the computer.

FIG. 1 is a schematic diagram of the operating environment of the process of the present invention. The system comprises a computer terminal, an RPA robot executor Worker is loaded on the computer terminal, a plurality of picture-in-picture interfaces, such as picture-in-picture 1, picture-in-picture 2, picture-in-picture 3 … … picture-in-picture n, can be displayed simultaneously on a display screen main interface of the computer terminal by operating the RPA executor, each picture-in-picture interface corresponds to one operating RPA robot, and a user can simultaneously use the computer to process other works.

FIG. 3 is a flow chart showing and controlling in a picture-in-picture manner; fig. 4 is a schematic diagram of a structure for running RPA software and simultaneously executing tasks.

The method of the invention realizes the simultaneous login and use of multiple accounts by utilizing the multi-account function of the operating system. Fig. 2 is a schematic flow chart of the method for simultaneously logging in and using multiple accounts.

The picture-in-picture technology has the following improvements: the resource of one computer can be simultaneously applied to a plurality of independent working scenes, namely the picture-in-picture technology enables one computer to have the capability of dividing the system into two parts, for example, an RPA robot needs to execute a working task of opening a browser and inputting search contents, meanwhile, a worker needs to complete the work of document editing, and under the traditional mode, the work cannot be completed in one computer system, because both works have the flow of character editing, and one computer system can only support the character editing (keyboard input) of one work at the same time. The picture-in-picture technology places two jobs in two completely independent systems on one computer, thereby realizing that the two jobs can be carried out simultaneously without mutual interference. If a further job is needed, a separate system is added by the pip technique. Each independent system is presented in the form of an independent 'window', the core of the realization is that the independent systems and the accounts of the computer system are in one-to-one correspondence, and the independent systems depend on the simultaneous login of multiple accounts of the computer.

The method for realizing simultaneous login and use of multiple accounts specifically comprises the following steps:

step 1, starting a remote service function in a computer terminal, and modifying the default maximum remote number of a system in a local group strategy of the computer terminal to be more than 1 by executing a self-defined reg file;

the step 1 is the basis for realizing the simultaneous login of multiple accounts. Taking a custom url protocol as an example, the content format of the reg file is as follows:

WindowsRegistryEditorVersion5.00

[HKEY_CLASSES_ROOT\SelfURIProto]

"URLProtocol"=""

"Desp" = "custom uri protocol"

@="URL:SelfdefineProtocolHandler"

[HKEY_CLASSES_ROOT\SelfURIProto\shell]

[HKEY_CLASSES_ROOT\SelfURIProto\shell\open]

[HKEY_CLASSES_ROOT\SelfURIProto\shell\open\command]

@="C:\\Users\\user\\AppData\\Local\\Programs\\MicrosoftVSCode\\Code.exe"

Step 2, checking by using the user account and the password;

the verification is performed by using the user account and the password, and the method specifically comprises the following steps:

the standard UserPassword authentication program maps the provided user name and password pair to a Windows account, and if the mapping fails, the authentication fails; otherwise, the identity authentication is successful;

and 3, monitoring the access of the RDP by using the environment patch package, realizing encryption and decryption processing on data information of a plurality of users through an encryption and decryption layer of RDP forwarding service, and establishing user session by calling termsrv. When the picture-in-picture function is started through the RPA robot actuator, an RDP protocol is intercepted and forwarded to a corresponding user session, so that login of a plurality of users is realized;

in the step 3, after the RDP protocol is accessed, the encryption and decryption layers of the RDP protocol are used to encrypt and decrypt the data information of a plurality of users, the termsrv.dll call and the user session creation operation flow are performed, and the environment patch package is formed by code compiling and packaging;

therefore, when the computer applies the picture-in-picture technology for the first time, the whole process does not need to be manually configured, and the service environment patch package can be directly read.

Through the technical implementation process, a mode that one computer simultaneously logs in through multiple accounts is formed, and multiple independent system operation interfaces corresponding to the multiple accounts and a picture-in-picture interface are achieved.

Step 4, displaying and controlling a plurality of accounts logged in simultaneously in a picture-in-picture mode;

fig. 3 is a flow chart showing and controlling in a picture-in-picture form. The essence of pip technology is to better refine RPA process automation applications through "man-machine collaboration" and "high-density deployment". The pip technique is ultimately embodied in the RPA technique application scenario. The method is called picture-in-picture because the method is the most intuitive expression for the application of two advanced capabilities of 'high-density deployment' and 'man-machine cooperation' in RPA enterprise process automation application: and the plurality of RPA robots working simultaneously are respectively displayed in independent windows. On the screen of a computer, a large window frame is formed, which contains a plurality of small window frames. The capability of one machine with multiple systems is realized. Next, how to use multiple systems simultaneously will be presented to the user in a picture-in-picture intuitive manner. This will be explained in this section.

The Windows system reserves a 3389 port as a remote connection network port, and can support remote login of the computer by using a user account through equipment such as a mobile phone, a computer and the like. The user can set the computer to be provided with a plurality of login users, and different desktops are displayed and related operations are executed by switching the users. Different desktops can be displayed in a remote mode under the conditions of opening the program service and allowing a user to remotely log in. The pip is actually a client supporting the RDP protocol, supporting login to the remote desktop.

The process of the RPA robot running the task in the picture-in-picture interface can be controlled by the user. Because each picture-in-picture interface is an independent 'system', a user can switch to any picture-in-picture interface at any time and actively start or stop the operation of the robot or perform other operations.

In step 4, the displaying and controlling in the form of picture-in-picture specifically includes the following steps:

step 401, after completing the creation of multiple accounts, configuring user information for the RPA robot actuator in the RPA software system, so that a corresponding relationship is established between the RPA robot actuator and each account;

step 402, an RPA robot actuator is developed by using an AxMSTSClib.AxMsRdpClient8NotSafeForScript by referring to a Microsoft Terminal Services Active Client dynamic link library, so that the RPA robot actuator supports an RDP protocol; the RPA robot executor is a client developed by a C/S architecture and C # bottom language;

an example of the working principle of the remote connection machine is encoded as follows:

private void Form1_Load(object sender, Event Argse)

{ var rdpClient = new AxMsRdpClient9NotSafeForScripting

{

Dock = DockStyle.None,

Width = 2000,

Height = 1000

};

this.panel1.Controls.Add(rdpClient);

rdpClient.Server = "182.160.120.20";

if (port != 3389)

rdpClient.AdvancedSettings2.RDPPort = port;

rdpClient.UserName = "admin";

rdpClient.AdvancedSettings2.ClearTextPassword = "aabbcc";

var clientNonScriptable = (IMsRdpClientNonScriptable5)rdpClient.GetOcx();

rdpClient.AdvancedSettings9.EnableCredSspSupport = true;

rdpci. connecting text = $ "connecting [ {"182.160.120.20"} ], please wait. -;

rdpClient.Connect();

}

step 403, the computer terminal dynamically sets the IP addresses, user names, passwords and desktop resolution attributes of the multiple picture-in-picture interfaces, then runs the RPA robot actuator in the multiple picture-in-picture interfaces, and establishes a corresponding relationship with each picture-in-picture interface when starting the picture-in-picture function;

step 404, by calling the pip client, the RPA robot executor transmits the user parameter and the window parameter to the pip client to perform pip display;

through the technical implementation process, the system can be displayed and controlled in a picture-in-picture mode in a plurality of systems under one computer.

And 5, respectively operating the RPA robot executors on a plurality of picture-in-picture windows under the computer terminal in the figure 1, so that a plurality of RPA robots can execute tasks simultaneously.

Fig. 4 is a schematic structural diagram of the method of the present invention for operating RPA software and executing tasks simultaneously. And (3) the operation of the RPA robot needs the RPA robot executor as a carrier, the RPA robot is added into the RPA robot executor, and the SDK service of the RPA robot is started. In a plurality of picture-in-picture interface windows, the RPA robot executors are respectively operated to respectively enable the RPA robot to execute tasks, so that the simultaneous execution is realized, and the mutual interference is avoided. If conventional virtual machine technology is used, RPA software needs to be deployed on all virtual machines. Not only occupies a large amount of resources, but also reduces the operating efficiency of the computer. The application of the picture-in-picture technique is to launch the RPA software application through accounts with different IP addresses. Each account is provided with an exclusive IP address and a port, and the accounts operate respectively by controlling the respective login IP address and the set port, so that conflicts and resource occupation which may be generated during operation are avoided. Since the pip technology must be used in combination with a robot actuator (Worker) of RPA software, the successful combination and stability of the pip technology and the Worker application in a plurality of system components is also a crucial part of the technical scheme of the present invention, and the technical implementation manner of this part is as follows:

step 501, operating RPA robot actuators in a plurality of picture-in-picture interfaces respectively, and supporting http protocol to call;

the technical implementation principle is exemplified as follows:

var PORT = 3000;

var http = require('http');

var url=require('url');

var fs=require('fs');

var mine=require('./mine').types;

var path=require('path');

var server = http.createServer(function (request, response) {

var pathname = url.parse(request.url).pathname;

var realPath = path.join("assets", pathname);

//console.log(realPath);

var ext = path.extname(realPath);

fs.exists(realPath, function (exists) {

if (!exists) {

response.writeHead(404, {

'Content-Type': 'text/plain'

});

response.write("This request URL " + pathname + " was not found on this server.");

response.end();

} else {

fs.readFile(realPath, "binary", function (err, file) {

if (err) {

response.writeHead(500, {

'Content-Type': 'text/plain'

});

response.end(err);

} else {

var contentType = mine[ext] || "text/plain";

response.writeHead(200, {

'Content-Type': contentType

});

response.write(file, "binary");

response.end();

}

});

}

});

server.listen(PORT);

console.log("Server runing at port: " + PORT + ".");

step 502, in the RPA robot actuator, selecting any picture-in-picture interface to execute the RPA robot task, and calling RPA execution services corresponding to different user accounts in an independent session space according to the configured information to enable the RPA robot to execute the task.

According to the technical scheme of the invention, the RPA enterprise process automation software with the picture-in-picture technology can perform daily financial reconciliation in enterprise financial work. In the daily financial reconciliation work of an enterprise, the work flow and the content of the RPA robot generally comprise: 1) logging in a bank system; 2) downloading bank details; 3) automatically formatting the download details, and putting the download details into a statement sample table; 4) automatically logging in an enterprise SAP system and importing a statement bill; 5) carrying out automatic account checking; 6) and making the account checking result into a table.

If more banks are involved in the reconciliation work, the RPA robot can only process one bank by one bank. If an enterprise wishes to simultaneously process the account checking work of multiple banks through multiple RPA robots, multiple computers need to be equipped, and each computer needs to be deployed with a corresponding RPA software system. And the reconciliation result table after the reconciliation work is finished needs to be unified and summarized from each computer.

By applying RPA enterprise process automation software, regular, large, repeated and fussy account checking work in daily finance of an enterprise is solved. In one computer, RPA enterprise process automation software only needs to be deployed once. Through the picture-in-picture technology, a plurality of RPA robots are operated simultaneously, account checking work of different banks is executed respectively, and account checking result tables after account checking are finished do not need secondary collection.

In the process of executing account checking work by the RPA robot, the enterprise staff receives occasional work, such as mail receiving and replying, document signing and the like. At this time, it is necessary to wait for the RPA robot to finish the current reconciliation process, and the enterprise staff can use the computer. Unless the workflow of the current RPA robot is terminated. Through the picture-in-picture technology, the RPA robot can carry out account checking work through the picture-in-picture mode. When enterprise employees need to use a computer to process other works, the work flow of the enterprise employees and the work flow of the RPA robot are not interfered with each other and are synchronously carried out.

Through the technical scheme of the invention, resources can be saved. The application of the picture-in-picture technology can greatly save the investment of resources when an enterprise applies the RPA technology. Although the RPA robot replaces human beings to complete a large amount of repeated regular and fussy work, the efficiency is improved, and the manpower is liberated. However, the problem is that when the RPA robot is performing tasks, the current computer terminal does not support other tasks, such as daily tasks of enterprise employees. If enterprise employees need to synchronously complete other work, the investment of an additional computer is needed. After the picture-in-picture technology is applied, the RPA robot and enterprise staff can work simultaneously without mutual interference only by one computer terminal. With the increasing application of RPA technology by enterprises, the resource saving brought by the picture-in-picture technology is more obvious.

In the present day when the digitization of the internet is rapidly developed, "cost reduction and efficiency improvement" is a core target of the digitization upgrading and transformation of each enterprise. More and more enterprises choose to apply the RPA technology, because the RPA technology can help the enterprises to quickly realize the aim of cost reduction and efficiency improvement, and the invention of the PIP technology is a qualitative leap of the RPA technology on the aspect.

In some embodiments, part or all of the computer program may be loaded and/or installed onto the device via ROM. When being loaded and executed, may carry out one or more of the steps of the method described above.

The functions described above in this application may be performed at least in part by one or more hardware logic components. For example, without limitation, exemplary types of hardware logic components that may be used include: a Field Programmable Gate Array (FPGA), an Application Specific Integrated Circuit (ASIC), an Application Specific Standard Product (ASSP), a system on a chip (SOC), a load programmable logic device (CPLD), and the like.

Program code for implementing the methods of the present disclosure may be written in any combination of one or more programming languages. These program codes may be provided to a processor or controller of a general purpose computer, special purpose computer, or other programmable data processing apparatus, such that the program codes, when executed by the processor or controller, cause the functions/operations specified in the flowchart and/or block diagram to be performed. The program code may execute entirely on the machine, partly on the machine, as a stand-alone software package partly on the machine and partly on a remote machine or entirely on the remote machine or server.

In the context of this disclosure, a machine-readable medium may be a tangible medium that can contain, or store a program for use by or in connection with an instruction execution system, apparatus, or device. The machine-readable medium may be a machine-readable signal medium or a machine-readable storage medium. A machine-readable medium may include, but is not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any suitable combination of the foregoing. More specific examples of a machine-readable storage medium would include an electrical connection based on one or more wires, a portable computer diskette, a hard disk, a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.

Further, while operations are depicted in a particular order, this should be understood as requiring that such operations be performed in the particular order shown or in sequential order, or that all illustrated operations be performed, to achieve desirable results. Under certain circumstances, multitasking and parallel processing may be advantageous. Likewise, while several specific implementation details are included in the above discussion, these should not be construed as limitations on the scope of the disclosure. Certain features that are described in the context of separate embodiments can also be implemented in combination in a single implementation. Conversely, various features that are described in the context of a single implementation can also be implemented in multiple implementations separately or in any suitable subcombination.

Although the subject matter has been described in language specific to structural features and/or methodological acts, it is to be understood that the subject matter defined in the appended claims is not necessarily limited to the specific features or acts described above. Rather, the specific features and acts described above are disclosed as example forms of implementing the claims.

Claims

1. A method for realizing picture-in-picture in RPA enterprise process automation is characterized by comprising the following steps:

2. The method for implementing picture-in-picture in RPA enterprise process automation as claimed in claim 1, wherein said step 2 includes:

3. The method for implementing picture-in-picture in RPA enterprise process automation as claimed in claim 1, wherein said step 3 includes:

4. The method for implementing picture-in-picture in RPA enterprise process automation as claimed in claim 1, wherein said step 4 includes the steps of:

5. The method for implementing picture-in-picture in RPA enterprise process automation as recited in claim 4, wherein said step 5 comprises the steps of:

6. The method for implementing picture-in-picture in RPA enterprise process automation as claimed in claim 1, wherein said step 1 is implemented by executing a registry script file of Windows operating system.

7. The method for implementing picture-in-picture in RPA enterprise process automation as claimed in claim 1, wherein the multiple picture-in-picture interfaces are independent from each other, and can switch between different picture-in-picture interfaces and start or stop the operation of the RPA robot according to the user's instruction.

8. The method for realizing pip in RPA enterprise process automation as recited in claim 4, wherein the pip Client is built by using AxMSTSCLlib.AxMsRdpClient8NotSafeForscript by referencing Microsoft Terminal Services Active Client dynamic link library.

9. The method for implementing picture-in-picture in RPA enterprise process automation as recited in claim 1, wherein the plurality of picture-in-picture interfaces includes one or more interfaces operated by manual control of a user.

10. The method for implementing picture-in-picture in RPA enterprise process automation as claimed in claim 1, further comprising step 5, after step 4, of operating RPA robot executors in respective picture-in-picture interfaces to perform respective tasks.