CN113885982A - Remote control method and device combining AI and RPA, electronic equipment and medium - Google Patents

Remote control method and device combining AI and RPA, electronic equipment and medium Download PDF

Info

Publication number
CN113885982A
CN113885982A CN202111138297.4A CN202111138297A CN113885982A CN 113885982 A CN113885982 A CN 113885982A CN 202111138297 A CN202111138297 A CN 202111138297A CN 113885982 A CN113885982 A CN 113885982A
Authority
CN
China
Prior art keywords
program
rpa
process service
terminal
controlled terminal
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN202111138297.4A
Other languages
Chinese (zh)
Other versions
CN113885982B (en
Inventor
黄令辉
蔡炫
汪冠春
胡一川
褚瑞
李玮
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Beijing Laiye Network Technology Co Ltd
Laiye Technology Beijing Co Ltd
Original Assignee
Beijing Laiye Network Technology Co Ltd
Laiye Technology Beijing Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Beijing Laiye Network Technology Co Ltd, Laiye Technology Beijing Co Ltd filed Critical Beijing Laiye Network Technology Co Ltd
Priority to CN202111138297.4A priority Critical patent/CN113885982B/en
Publication of CN113885982A publication Critical patent/CN113885982A/en
Application granted granted Critical
Publication of CN113885982B publication Critical patent/CN113885982B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F9/00Arrangements for program control, e.g. control units
    • G06F9/06Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
    • G06F9/44Arrangements for executing specific programs
    • G06F9/451Execution arrangements for user interfaces
    • G06F9/452Remote windowing, e.g. X-Window System, desktop virtualisation
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06NCOMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N20/00Machine learning
    • YGENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
    • Y02TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
    • Y02PCLIMATE CHANGE MITIGATION TECHNOLOGIES IN THE PRODUCTION OR PROCESSING OF GOODS
    • Y02P90/00Enabling technologies with a potential contribution to greenhouse gas [GHG] emissions mitigation
    • Y02P90/02Total factory control, e.g. smart factories, flexible manufacturing systems [FMS] or integrated manufacturing systems [IMS]

Landscapes

  • Engineering & Computer Science (AREA)
  • Software Systems (AREA)
  • Theoretical Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Evolutionary Computation (AREA)
  • Medical Informatics (AREA)
  • Data Mining & Analysis (AREA)
  • Computing Systems (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Mathematical Physics (AREA)
  • Artificial Intelligence (AREA)
  • Human Computer Interaction (AREA)
  • Stored Programmes (AREA)

Abstract

The disclosure provides a remote control method, a remote control device, electronic equipment and a remote control medium which are combined with an AI and an RPA, and relates to the field of the AI and the RPA, wherein the method comprises the following steps: the RPA robot is controlled to send a process service extension management program corresponding to an automatic process service program installed on the main control terminal to the controlled terminal, so that the controlled terminal installs the process service extension management program; the RPA robot is controlled to remotely control the controlled terminal so as to obtain interface operable elements according to the process service extension management program; and controlling the RPA robot to create and execute the operation flow of the interface operable elements according to the automatic flow service program. Therefore, the RPA robot is controlled to remotely control the controlled terminal, the operation flow on the controlled terminal is created and executed according to the automatic flow service program of the main control terminal, the controlled terminal does not need to install the automatic flow service program, the interface confusion with the main control terminal is avoided, and the working efficiency is improved.

Description

Remote control method and device combining AI and RPA, electronic equipment and medium
Technical Field
The present application relates to the technical field of Artificial Intelligence (AI) and Robot Process Automation (RPA), and in particular, to a remote control method, apparatus, electronic device, and medium combining AI (Artificial Intelligence) and RPA (robot Process Automation).
Background
Robot Process Automation (RPA) is a Process task that simulates human operations on a computer by specific "robot software" and executes automatically according to rules.
Artificial Intelligence (AI) is a technical science that studies and develops theories, methods, techniques and application systems for simulating, extending and expanding human Intelligence.
Currently, a user installs an automated process service program (e.g., UiBot program) on a remote terminal, and then controls an interface operable element of the remote terminal through a remote tool to create and execute an operation process on the remote terminal.
However, since the user can only open the automated process service program on the remote terminal in the form of remote control to perform the creation and execution of the operation process, especially when the user selects an operable element to perform the creation of the operation process, the user is easily confused with the local interface, and uncontrollable factors exist in the operation, which results in the reduction of the work efficiency of the user.
Disclosure of Invention
The object of the present application is to solve at least to some extent one of the technical problems in the above-mentioned technology.
To this end, the present application proposes in a first aspect a remote control method combining artificial intelligence AI and robot process automation RPA.
The second aspect of the present application proposes another remote control method combining artificial intelligence AI and robot process automation RPA.
The third aspect of the application provides a remote control device combining artificial intelligence AI and robot process automation RPA.
A fourth aspect of the present disclosure proposes another remote control device that combines artificial intelligence AI and robot process automation RPA.
A fifth aspect of the present application provides an electronic device.
A sixth aspect of the present application provides a non-transitory computer readable storage medium having computer instructions stored thereon.
A seventh aspect of the present application proposes a computer program product.
The embodiment of the first aspect of the present application provides a remote control method combining artificial intelligence AI and robot process automation RPA, which is applied to a master control terminal, and includes: controlling the RPA robot to install an automatic flow service program on the main control terminal; wherein the automatic process service program is used for creating and executing an operation process; controlling the RPA robot to send a process service extension management program corresponding to the automatic process service program to a controlled terminal so that the controlled terminal installs the process service extension management program; controlling an RPA robot to remotely control the controlled terminal so as to obtain interface operable elements according to the process service extension management program; and controlling the RPA robot to create and execute the operation flow of the interface operable element according to the automatic flow service program.
The technical scheme provided by the embodiment of the application is applied to a main control terminal, an RPA robot is controlled to install an automatic process service program on the main control terminal, and a process service extension management program corresponding to the automatic process service program is sent to a controlled terminal, so that the controlled terminal installs the process service extension management program, and further, the RPA robot is controlled to carry out remote control on the controlled terminal, interface operable elements are obtained according to the process service extension management program, and operation processes are created and executed on the interface operable elements according to the automatic process service program. Therefore, the RPA robot is controlled to remotely control the controlled terminal, the operation flow on the controlled terminal is created and executed according to the automatic flow service program of the main control terminal, the controlled terminal does not need to install the automatic flow service program, the interface confusion with the main control terminal is avoided, and the working efficiency is improved.
In an embodiment of the application, the extending the management program according to the process service to obtain the interface operable element includes: the controlled terminal is controlled to manage an extension program through a process service extension management program, and the controlled terminal is controlled to acquire the interface operable element through the extension program in combination with a natural language processing technology NLP and/or an optical character recognition technology OCR; and controlling the controlled terminal to send the interface operable element to the master control terminal.
In an embodiment of the application, the controlling the RPA robot to send the flow service extension management program corresponding to the automated flow service program to the controlled terminal includes: controlling an RPA robot to establish a virtual channel between the main control terminal and the controlled terminal; and controlling the RPA robot to send the automatic process service program to a controlled terminal through the virtual channel and sending a process service expansion management program corresponding to the automatic process service program to the controlled terminal.
In one embodiment of the application, the extension program comprises at least one of the following extension programs: chrome extensions, FireFox extensions, Java extensions, Windows remote desktop extensions, and Citrix extensions.
The embodiment of the second aspect of the application provides a remote control method combining Artificial Intelligence (AI) and Robot Process Automation (RPA), which is applied to a controlled terminal and comprises the following steps: receiving a process service extension management program sent by the master control terminal through the RPA robot and installing the process service extension management program; acquiring an interface operable element according to the process service extension management program; and sending the interface operable element to the main control terminal so as to control the RPA robot to create and execute the operation flow of the interface operable element according to the automatic flow service program.
An embodiment of a third aspect of the present application provides a remote control device that combines artificial intelligence AI and robot process automation RPA, applied to a main control terminal, including: the installation module is used for controlling the RPA robot to install an automatic flow service program on the main control terminal; wherein the automatic process service program is used for creating and executing an operation process; the transmitting module is used for controlling the RPA robot to transmit the process service extension management program corresponding to the automatic process service program to a controlled terminal so that the controlled terminal can install the process service extension management program; the control module is used for controlling the RPA robot to remotely control the controlled terminal so as to obtain interface operable elements according to the process service extension management program; and the processing module is used for controlling the RPA robot to create and execute the operation flow of the interface operable element according to the automatic flow service program.
In one embodiment of the present application, the control module is configured to: the controlled terminal is controlled to manage an extension program through a process service extension management program, and the controlled terminal is controlled to acquire the interface operable element through the extension program in combination with a natural language output technology (NLP); and controlling the controlled terminal to send the interface operable element to the master control terminal.
In an embodiment of the present application, the sending module is configured to: establishing a virtual channel between the master control terminal and the controlled terminal; and controlling the RPA robot to send the automatic process service program to a controlled terminal through the virtual channel and sending a process service expansion management program corresponding to the automatic process service program to the controlled terminal.
In one embodiment of the application, the extension program comprises at least one of the following extension programs: chrome extensions, FireFox extensions, Java extensions, Windows remote desktop extensions, and Citrix extensions.
In one embodiment of the present application, the apparatus further comprises: and the releasing module is used for closing the virtual channel and releasing the resources distributed by the virtual channel when the creation and the execution of the operation flow are completed.
The embodiment of the fourth aspect of the present application provides a remote control device that combines artificial intelligence AI and robot process automation RPA, is applied to controlled terminal, includes: the receiving module is used for receiving the process service extension management program sent by the master control terminal through the RPA robot and installing the process service extension management program; the acquisition module is used for acquiring interface operable elements according to the process service extension management program; and the sending module is used for sending the interface operable element to the main control terminal so as to control the RPA robot to create and execute the operation flow of the interface operable element according to the automatic flow service program.
An embodiment of a fifth aspect of the present application provides an electronic device, including at least one processor; and a memory communicatively coupled to the at least one processor; wherein the memory stores instructions executable by the at least one processor to enable the at least one processor to perform the method of the first aspect, or to perform the method of the second aspect.
A sixth aspect of the present application proposes a non-transitory computer readable storage medium storing computer instructions for causing a computer to perform the method of the first aspect or the second aspect.
A seventh aspect of the present application proposes a computer program product comprising a computer program which, when executed by a processor, implements the method of an embodiment of the first aspect described above, or which, when executed by a processor, implements the method of the second aspect described above.
It should be understood that the description herein is not intended to identify key or critical features of the embodiments of the disclosure, nor is it intended to be used to limit the scope of the disclosure. Other features of the present application will become apparent from the following description.
Drawings
The foregoing and/or additional aspects and advantages of the present application will become apparent and readily appreciated from the following description of the embodiments, taken in conjunction with the accompanying drawings of which:
FIG. 1 is a schematic diagram of a remote control method incorporating AI and RPA according to one embodiment of the present application;
FIG. 2 is a schematic diagram of an automated flow creation program according to an embodiment of the present application;
FIG. 3 is a schematic diagram illustrating a process of managing an extension by a process service extension manager according to an embodiment of the application;
FIG. 4 is a schematic diagram of a remote control method incorporating AI and RPA according to another embodiment of the present application;
FIG. 5 is a schematic diagram of a UiBot extension management tool according to an embodiment of the present application;
fig. 6 is a schematic diagram of virtual channel connection between a master control terminal and a controlled terminal according to an embodiment of the present application;
FIG. 7 is a schematic diagram of a remote control method incorporating AI and RPA according to another embodiment of the present application;
FIG. 8 is a schematic diagram of an interface operable element acquired by a controlled terminal through a process service extension management program according to an embodiment of the present application;
FIG. 9 is a schematic diagram of a remote control method incorporating AI and RPA according to another embodiment of the present application;
FIG. 10 is a schematic diagram of another remote control method that combines AI and RPA according to one embodiment of the present application;
FIG. 11 is a schematic diagram of a remote control device incorporating AI and RPA according to one embodiment of the present application;
FIG. 12 is a schematic diagram of a remote control device incorporating AI and RPA according to one embodiment of the present application;
fig. 13 is a block diagram of an electronic device incorporating a remote control method of artificial intelligence AI and robotic process automation RPA in accordance with an embodiment of the application.
Detailed Description
Reference will now be made in detail to embodiments of the present application, examples of which are illustrated in the accompanying drawings, wherein like or similar reference numerals refer to the same or similar elements or elements having the same or similar function throughout. The embodiments described below with reference to the drawings are exemplary and intended to be used for explaining the present application and should not be construed as limiting the present application.
A remote control method, an apparatus, an electronic device, and a medium that combine Artificial Intelligence (AI) and Robot Process Automation (RPA) according to an embodiment of the present application are described below with reference to the accompanying drawings.
Before describing the embodiments of the present application in detail, for the sake of understanding, the following commonly used technical terms are introduced:
automated procedure service program: an automated process service may be used for the creation and execution of operational processes, and may include: the system comprises an automatic flow establishing program and an automatic flow executing program, wherein the automatic flow establishing program can be used for establishing an operation flow, and the automatic flow executing program can be used for executing the operation flow;
flow service extension management program: the process service extension program of the controlled terminal may be managed, for example, the process service extension program is upgraded, uninstalled, installed, and the like, and the process service extension program may include at least one of the following extension programs: chrome extension, FireFox extension, Java extension, Windows remote desktop extension, and Citrix extension; the interface operable element is as follows: elements operable on the interface, such as clickable links, titles, pictures, forms, buttons and the like on the interface;
virtual channel: the virtual channel is a channel for data interaction between the main control terminal and the controlled terminal, and is established through a virtual driver of the main control terminal which communicates with an application program of the controlled terminal;
resource: the virtual channel may be a resource such as a Central Processing Unit (CPU), a memory, and a disk, which are required for establishing the virtual channel.
Fig. 1 is a schematic diagram of a remote control method combining AI and RPA according to one embodiment of the present application. The remote control method combining the AI and the RPA provided by the embodiment of the application can be applied to a main control terminal. The main control terminal may be an electronic device that executes a remote control method combining AI and RPA, the main control terminal may be a Personal Computer (PC), a mobile terminal, a server, and the like, and the mobile terminal may be a hardware device having various operating systems, touch screens, and/or display screens, such as a vehicle-mounted device, a mobile phone, a tablet Computer, a Personal digital assistant, a wearable device, and the like. The controlled terminal is an electronic device different from the main control terminal.
As shown in fig. 1, the remote control method combining AI and RPA may include:
step 101, controlling an RPA robot to install an automatic flow service program on a main control terminal; the automatic process service program is used for creating and executing the operation process.
In this embodiment of the present application, the RPA robot may be controlled to install an automated process service program (e.g., UiBot program) on the master control terminal, where the automated process service program may be used to create and execute an operation process, and the automated process service program may include: an automatic flow creation program and an automatic flow execution program, wherein the automatic flow creation program can be used for creating an operation flow, and the automatic flow execution program can be used for executing the operation flow, and as shown in fig. 2, the automatic flow creation program is, for example, UiBot Creator which can be used for creating, opening, and starting the operation flow, the UiBot Creator can also be used for downloading a UiBot extension management tool, a UI analyzer, and the like, wherein the UiBot is an RPA robot flow automation tool which can replace software and a platform for manually performing tedious, complicated, repeated, and batched operations on a computer, the UiBot extension management tool can manage (e.g., upgrade, uninstall, or install) Chrome extension, FireFox extension, Java extension, Windows remote desktop extension, and Citrix extension, the automatic flow execution program is, for example, UiBot word, and UiBot word can be used for executing the automatic flow, the UiBot Worker can check specific service robots and has complete robot adding and running management functions.
And 102, controlling the RPA robot to send the process service extension management program corresponding to the automatic process service program to the controlled terminal so that the controlled terminal installs the process service extension management program.
In the embodiment of the application, the controllable RPA robot sends the process service extension management program corresponding to the automation process service program to the controlled terminal through the virtual channel, and the controlled terminal installs the process service extension management program when receiving the process service extension management program. The virtual channel can be composed of a virtual driver of the main control terminal which communicates with an application program of the controlled terminal, the process service extension management program can be an UiBot extension management tool, the process service extension management program can manage the process service extension program of the controlled terminal, for example, the process service extension management program can comprise Chrome extension, Firefox extension, Java extension, Citrix extension and Windows remote desktop extension, and the process service extension management program can download, uninstall or upgrade the Chrome extension, the Firefox extension, the Java extension, the Citrix extension and the Windows remote desktop extension. Fig. 3 is a schematic diagram of a process of managing an extension program by a process service extension manager according to an embodiment of the present application, and in fig. 3, a process service extension manager (e.g., UI Adapter) is generated by combining a script program (BotScript) of a relevant process program default. The script program can be scripted according to programming languages such as C/C + +, Ptyhon, and.Net.
And 103, controlling the RPA robot to remotely control the controlled terminal so as to acquire interface operable elements according to the process service extension management program.
In the embodiment of the application, the RPA robot can be controlled to install a remote control tool through an automatic process service program so as to remotely control the controlled terminal. For example, Citrix extension and Windows remote desktop extension are installed through an automation flow service program to automate Citrix application programs and remote application programs, so as to realize remote control of a controlled terminal.
As an example, the controlled terminal may be controlled to download the process service extension program through the process service extension management program to obtain the interface operable element. And then, the controlled terminal is controlled to send the acquired interface operable elements to the master control terminal. The flow service extension program can comprise at least one of Chrome extension, Firefox extension, java extension and the like; the interface operable elements may include at least one of links, titles, pictures, forms, buttons, and the like.
And step 104, controlling the RPA robot to create and execute the operation flow of the interface operable element according to the automatic flow service program.
And then, the control RPA robot can create the operation flow of the interface operable element according to an automatic flow creation program in the automatic flow service program, and further execute the operation flow according to an automatic flow execution program in the automatic flow service program.
In summary, the RPA robot is controlled to install the automatic flow service program on the main control terminal, and the flow service extension management program corresponding to the automatic flow service program is sent to the controlled terminal, so that the controlled terminal installs the flow service extension management program, and further, the RPA robot is controlled to perform remote control on the controlled terminal, so as to obtain the interface operable element according to the flow service extension management program, and perform creation and execution of the operation flow on the interface operable element according to the automatic flow service program. Therefore, the RPA robot is controlled to remotely control the controlled terminal, the operation flow on the controlled terminal is created and executed according to the automatic flow service program of the main control terminal, the controlled terminal does not need to install the automatic flow service program, the interface confusion with the main control terminal is avoided, and the working efficiency is improved.
In order to enable the main control terminal to accurately obtain the interface operable elements, as shown in fig. 4, fig. 4 is a schematic diagram of a remote control method combining AI and RPA according to another embodiment of the present application. In this embodiment of the present application, the extension program may be managed by controlling a process service extension management program on the controlled terminal, and the controlled terminal is controlled to obtain the interface operable element by combining the extension program with a natural language processing technology NLP and/or an optical character recognition technology OCR, and then control the controlled terminal to send the interface operable element to the main control terminal, where the embodiment shown in fig. 4 may include the following steps:
step 401, controlling the RPA robot to install an automatic process service program on a main control terminal; the automatic process service program is used for creating and executing the operation process.
And 402, controlling the RPA robot to send the process service extension management program corresponding to the automatic process service program to the controlled terminal so that the controlled terminal installs the process service extension management program.
And 403, controlling the RPA robot to remotely control the controlled terminal to manage the extended program through the process service extended management program, and controlling the controlled terminal to acquire the interface operable elements through the extended program in combination with a natural language processing technology NLP and/or an optical character recognition technology OCR.
As an example, the controlled terminal may be controlled to remotely control the RPA robot to download and install an extension program through the flow service extension management program, and the controlled terminal may be controlled to obtain the interface operable element through the extension program in combination with a Natural Language Processing (NLP).
As another example, the controlled terminal may be controlled to remotely control the RPA robot to download and install an extension program through the process service extension management program, and control the controlled terminal to obtain the interface operable element through the extension program in combination with an Optical Character Recognition technology (OCR).
As another example, the controlled terminal may be controlled to remotely control the RPA robot to download and install the extension program through the process service extension management program, and control the controlled terminal to acquire the interface operable element through the extension program in combination with the natural language processing technology and the optical character recognition technology.
For example, as shown in fig. 5, at least one of Chrome extension, Firefox extension, Java extension, Windows remote desktop extension, Citrix extension, and the like may be downloaded and installed through the UiBot extension management tool, and then interface operable elements may be obtained through Chrome extension, Firefox extension, Java extension, Windows remote desktop extension, and/or Citrix extension in combination with natural language processing technology and/or optical character recognition technology.
And step 404, controlling the RPA robot to remotely control the controlled terminal and send the interface operable element to the master control terminal.
Optionally, the RPA robot may be controlled to remotely control the controlled terminal to send the interface operable element to the master control terminal through the virtual channel.
For example, as shown in fig. 6, fig. 6 is a schematic view illustrating a connection of a virtual channel between a master control terminal and a controlled terminal according to an embodiment of the present disclosure, where the virtual channel is composed of a virtual driver of the master control terminal that communicates with an application of the controlled terminal, and provides a secure way to complete various tasks. And at the controlled terminal, the virtual channels of the main control terminal are routed through Wdica. And polling the virtual channel of the main control terminal by a corresponding WinStation driver built in wfica32.exe at the main control terminal.
And step 405, controlling the RPA robot to create and execute the operation flow of the interface operable element according to the automatic flow service program.
In the embodiment of the present application, the steps 401, 402, and 405 may be implemented by any one of the embodiments of the present application, and the embodiments of the present disclosure do not limit this and are not described again.
In conclusion, the controlled terminal is remotely controlled by controlling the RPA robot to manage the extension program through the process service extension management program, and the controlled terminal is controlled to acquire interface operable elements through the extension program in combination with the natural language processing technology NLP and/or the optical character recognition technology OCR; and controlling the RPA robot to remotely control the controlled terminal to send the interface operable elements to the main control terminal, so that the main control terminal can accurately acquire the interface operable elements of all the controlled terminals.
In order to enable the controlled terminal not to need to install the automated flow service program, so as to not cause interface confusion with the main control terminal and improve the work efficiency, as shown in fig. 7, fig. 7 is a schematic diagram of a remote control method combining an AI and an RPA according to another embodiment of the present application, in an embodiment of the present application, the RPA robot may be controlled to extend a management program for a flow service corresponding to the automated flow service program to the controlled terminal through a virtual channel, and the embodiment shown in fig. 7 may include the following steps:
step 701, controlling an RPA robot to install an automatic flow service program on a main control terminal; the automatic process service program is used for creating and executing the operation process.
Step 702, a virtual channel is established between the master control terminal and the controlled terminal.
In the embodiment of the application, the RPA robot can be controlled to establish a virtual channel according to the virtual driver of the master control terminal communicating with the application program of the controlled terminal, and data interaction can be performed between the master control terminal and the controlled terminal through the virtual channel.
It should be noted that, when the main control terminal is connected to the controlled terminal, the main control terminal may transmit information of the virtual channel supported by the main control terminal to the controlled terminal, and the controlled terminal starts the relevant application program to obtain the handle of the virtual channel and selectively query other information related to the virtual channel. When the controlled terminal sends data to the main control terminal through the virtual channel, the data can be sent in real time, and when the main control terminal receives the data, a driver WinStation of the main control terminal multiplexes the data of the virtual channel from an Intelligent Console Architecture (ICA) stream and immediately transmits the multiplexed data to a virtual driver of the main control terminal.
In addition, when the virtual driver of the main control terminal sends the data to the controlled terminal, the data is sent when the driver of the main control terminal WinStation polls next time. And when the controlled terminal receives the data, queuing the data until the virtual channel application program reads the data.
And 703, controlling the RPA robot to send the automatic process service program to the controlled terminal through the virtual channel, so that the controlled terminal installs the process service extended management program.
And then, the controlled terminal is controlled to install the flow service extension management program.
For example, as shown in fig. 8, the main control terminal sends a flow service extension management program corresponding to the automated flow service program to the controlled terminal through the virtual channel, and the controlled terminal manages extension programs (such as Chrome extension, FireFox extension, Java extension, Windows remote desktop extension, and Citrix extension) through the flow service extension management program and obtains interface operable elements through the extension programs.
And 704, controlling the RPA robot to remotely control the controlled terminal so as to acquire interface operable elements according to the process service extension management program.
Step 705, controlling the RPA robot to create and execute the operation flow of the interface operable element according to the automatic flow service program.
In the embodiment of the present application, the steps 701 and 704-705 may be implemented by any one of the embodiments of the present application, and the embodiment of the present disclosure is not limited thereto and will not be described again.
In summary, a virtual channel is established between the master control terminal and the controlled terminal; and controlling the RPA robot to send the automatic process service program to the controlled terminal through the virtual channel and sending the process service extension management program corresponding to the automatic process service program to the controlled terminal. Therefore, by establishing the virtual channel between the master control terminal and the controlled terminal, the master control terminal can send the process service expansion management program corresponding to the automatic process service program to the controlled terminal, so that the controlled terminal does not need to install the automatic process service program, the interface confusion with the master control terminal is avoided, and the working efficiency of a user is improved.
In order to save related resources and further improve efficiency, as shown in fig. 9, fig. 9 is a schematic diagram of a remote control method combining AI and RPA according to another embodiment of the present application, in which when creation and execution of an operation flow are completed, a virtual channel may be closed and resources allocated to the virtual channel may be released. The embodiment shown in fig. 9 may include the following steps:
step 901, controlling the RPA robot to install an automatic flow service program on a main control terminal; the automatic process service program is used for creating and executing the operation process.
And step 902, controlling the RPA robot to establish a virtual channel between the master control terminal and the controlled terminal.
And 903, controlling the RPA robot to send the automatic process service program to the controlled terminal through the virtual channel, so that the controlled terminal installs the process service extension management program.
And 904, controlling the RPA robot to remotely control the controlled terminal so as to obtain the interface operable elements according to the process service extension management program.
And step 905, controlling the RPA robot to create and execute the operation flow of the interface operable element according to the automatic flow service program.
Step 906, when the creation and execution of the operation flow are completed, closing the virtual channel and releasing the resources allocated by the virtual channel.
In order to save related resources and further improve efficiency, in the embodiment of the present application, when the creation and execution of the operation flow are completed, the virtual channel may be closed and resources allocated to the virtual channel may be released.
In the embodiment of the present application, the steps 901-905 may be implemented by any one of the embodiments of the present application, and the embodiments of the present disclosure are not limited thereto and will not be described again.
In summary, when the creation and execution of the operation flow are completed, the virtual channel is closed and the resources allocated by the virtual channel are released, so that the related resources can be saved and the efficiency is further improved.
The remote control method combining the artificial intelligence AI and the robot process automation RPA is applied to a main control terminal, an automatic process service program is installed on the main control terminal by controlling the RPA robot, and a process service extension management program corresponding to the automatic process service program is sent to a controlled terminal, so that the controlled terminal installs the process service extension management program, and further, the RPA robot is controlled to carry out remote control on the controlled terminal, so that interface operable elements are obtained according to the process service extension management program, and the interface operable elements are created and executed according to the automatic process service program. Therefore, the RPA robot is controlled to remotely control the controlled terminal, the operation flow on the controlled terminal is created and executed according to the automatic flow service program of the main control terminal, the controlled terminal does not need to install the automatic flow service program, the interface confusion with the main control terminal is avoided, and the working efficiency is improved.
In order to implement the above embodiments, the present application provides another remote control device that combines an artificial intelligence AI and a robot process automation RPA. The remote control method combining AI and RPA may be applied to a controlled terminal, which may be a Personal Computer (PC), a mobile terminal, a server, and the like, and the mobile terminal may be a hardware device having various operating systems, touch screens, and/or display screens, such as an in-vehicle device, a mobile phone, a tablet Computer, a Personal digital assistant, and a wearable device.
Fig. 10 is a schematic diagram of another remote control method combining AI and RPA according to an embodiment of the present application.
As shown in fig. 10, the remote control method combining AI and RPA may include:
step 1001, receiving a process service extension management program sent by the master control terminal through the RPA robot and installing the process service extension management program.
In the embodiment of the application, the RPA robot can be controlled to install an automatic flow service program on the main control terminal; and then, the control RPA robot can send the flow service extension management program corresponding to the automatic flow service program to the controlled terminal through the virtual channel, and the controlled terminal receives the flow service extension management program sent by the main control terminal through the RPA robot and installs the flow service extension management program. It should be noted that the process service extension management program may be an UiBot extension management tool, and the process service extension management program may manage the process service extension program of the controlled terminal, for example, the process service extension management program may download, uninstall, or upgrade a Chrome extension, a Firefox extension, a Java extension, a Citrix extension, and a Windows remote desktop extension.
It should be noted that, in order to facilitate the controlled terminal to install Citrix extension and Windows remote desktop extension, the controlled terminal may be deployed on a Citrix application server or a Windows remote target server. In addition, in order to better compatible with the process service extension management program sent by the master control terminal, the controlled terminal can clearly determine the version of the compatible process service extension management program.
Step 1002, obtaining interface operable elements according to the process service extension management program.
In the embodiment of the application, the RPA robot can be controlled to install a remote control tool through an automatic process service program so as to remotely control the controlled terminal. For example, Citrix extension and Windows remote desktop extension are installed through an automation flow service program to automate Citrix application programs and remote application programs, so as to realize remote control of a controlled terminal.
In the embodiment of the application, the controlled terminal can be controlled to download the process service extension program through the process service extension management program so as to obtain the interface operable element. The process service extension program can comprise at least one of Chrome extension, Firefox extension, java extension, Citrix extension, Windows remote desktop extension and the like; the interface operable elements may include at least one of links, titles, pictures, forms, buttons, and the like.
And 1003, sending the interface operable element to the main control terminal to control the RPA robot to create and execute an operation flow on the interface operable element according to the automatic flow service program.
And then, the controlled terminal can be controlled to send the interface operable element to the main control terminal through the virtual channel, and after receiving the interface operable element, the main control terminal controls the RPA robot to create and execute the operation flow of the interface operable element according to the automatic flow service program.
The remote control device combining the artificial intelligence AI and the robot process automation RPA is applied to a controlled terminal, receives a process service extension management program sent by a master control terminal through the RPA robot and installs the process service extension management program; acquiring an interface operable element according to the process service extension management program; and sending the interface operable elements to the main control terminal so as to control the RPA robot to create and execute the operation flow of the interface operable elements according to the automatic flow service program. Therefore, the RPA robot is controlled to remotely control the controlled terminal, the operation flow on the controlled terminal is created and executed according to the automatic flow service program of the main control terminal, the controlled terminal does not need to install the automatic flow service program, the interface confusion with the main control terminal is avoided, and the working efficiency is improved.
In correspondence with the remote control method combining the AI and the RPA proposed in the embodiment of fig. 1 to 9, an embodiment of the present application further proposes a remote control device combining the AI and the RPA, and since the remote control device combining the AI and the RPA proposed in the embodiment of the present application corresponds to the remote control method combining the AI and the RPA proposed in the embodiment of fig. 1 to 9, which is applied to the main control terminal, the embodiment of the remote control method combining the AI and the RPA described above is also applicable to the remote control device combining the AI and the RPA proposed in the embodiment of the present application, and will not be described in detail in the following embodiments.
Fig. 11 is a schematic structural diagram of a remote control device combining an AI and an RPA according to an embodiment of the present application, and as shown in fig. 11, the remote control device 1100 combining an AI and an RPA includes: a mounting module 1110, a transmitting module 1120, a control module 1130, and a processing module 1140.
The installation module 1110 is configured to control the RPA robot to install an automation process service program on the main control terminal; the automatic process service program is used for creating and executing an operation process; a sending module 1120, configured to control the RPA robot to send a process service extension management program corresponding to the automation process service program to the controlled terminal, so that the controlled terminal installs the process service extension management program; the control module 1130 is used for controlling the RPA robot to remotely control the controlled terminal so as to obtain the interface operable elements according to the process service extension management program; and the processing module 1140 is used for controlling the RPA robot to create and execute the operation flow of the interface operable element according to the automatic flow service program.
As a possible implementation manner of the embodiment of the present application, the control module 1130 is configured to: the controlled terminal is controlled to manage the extension program through the process service extension management program, and is controlled to acquire interface operable elements through the extension program in combination with the natural language output technology NLP; and controlling the controlled terminal to send the interface operable elements to the master control terminal.
As a possible implementation manner of the embodiment of the present application, the sending module 1120 is configured to control the RPA robot to establish a virtual channel between the master control terminal and the controlled terminal; and controlling the RPA robot to send the automatic process service program to the controlled terminal through the virtual channel and sending the process service extension management program corresponding to the automatic process service program to the controlled terminal.
As a possible implementation manner of the embodiment of the present application, the extension program includes at least one of the following extension programs: chrome extensions, FireFox extensions, Java extensions, Windows remote desktop extensions, and Citrix extensions.
As a possible implementation manner of the embodiment of the present application, the remote control device 1100 combining the AI and the RPA further includes: and releasing the module.
The releasing module is used for closing the virtual channel and releasing the resources distributed by the virtual channel when the creation and the execution of the operation flow are completed.
The remote control device combining the AI and the RPA is applied to a main control terminal, an automatic process service program is installed on the main control terminal by controlling the RPA robot, and a process service extension management program corresponding to the automatic process service program is sent to a controlled terminal, so that the controlled terminal installs the process service extension management program, and further, the RPA robot is controlled to remotely control the controlled terminal, interface operable elements are obtained according to the process service extension management program, and the interface operable elements are created and executed according to the automatic process service program. Therefore, the RPA robot is controlled to remotely control the controlled terminal, the operation flow on the controlled terminal is created and executed according to the automatic flow service program of the main control terminal, the controlled terminal does not need to install the automatic flow service program, the interface confusion with the main control terminal is avoided, and the working efficiency is improved.
In correspondence with the remote control method combining the AI and the RPA proposed by the embodiment shown in fig. 10, an embodiment of the present application also proposes another remote control device combining the AI and the RPA, and since the remote control device combining the AI and the RPA proposed by the embodiment of the present application corresponds to the remote control method combining the AI and the RPA proposed by the embodiment shown in fig. 10 and is applied to a controlled terminal, the embodiment of the remote control method combining the AI and the RPA proposed by the embodiment shown in fig. 10 is also applicable to the remote control device combining the AI and the RPA proposed by the embodiment of the present application, and will not be described in detail in the following embodiments.
Fig. 12 is a schematic structural diagram of a remote control device combining an AI and an RPA according to an embodiment of the present application, and as shown in fig. 12, the remote control device 1200 combining an AI and an RPA includes: a receiving module 1210, an obtaining module 1220 and a sending module 1230.
The receiving module 1210 is configured to receive a process service extension management program sent by a master control terminal through an RPA robot and install the process service extension management program; an obtaining module 1220, configured to obtain an interface operable element according to the process service extension management program; a sending module 1230, configured to send the interface operable element to the master control terminal, so as to control the RPA robot to create and execute an operation flow on the interface operable element according to the automation flow service program.
The remote control device combining the artificial intelligence AI and the robot process automation RPA is applied to a controlled terminal, receives a process service extension management program sent by a master control terminal through the RPA robot and installs the process service extension management program; acquiring an interface operable element according to the process service extension management program; and sending the interface operable elements to the main control terminal so as to control the RPA robot to create and execute the operation flow of the interface operable elements according to the automatic flow service program. Therefore, the RPA robot is controlled to remotely control the controlled terminal, the operation flow on the controlled terminal is created and executed according to the automatic flow service program of the main control terminal, the controlled terminal does not need to install the automatic flow service program, the interface confusion with the main control terminal is avoided, and the working efficiency is improved.
In order to implement the above embodiments, the present application also proposes an electronic device, which includes at least one processor; and a memory communicatively coupled to the at least one processor; wherein the memory stores instructions executable by the at least one processor to enable the at least one processor to perform the method of remote control in conjunction with artificial intelligence AI and robot flow automation RPA described in fig. 1-9 or to perform the method of remote control in conjunction with artificial intelligence AI and robot flow automation RPA described in fig. 10.
In order to implement the above embodiments, the present application also proposes a non-transitory computer readable storage medium storing computer instructions for causing the computer to execute the remote control method combining the artificial intelligence AI and the robot flow automation RPA described in fig. 1 to 9 or execute the remote control method combining the artificial intelligence AI and the robot flow automation RPA described in fig. 10.
In order to implement the above embodiments, the present application also proposes a computer program product comprising a computer program which, when executed by a processor, implements the remote control method combining artificial intelligence AI and robot flow automation RPA described in fig. 1 to 9, or implements the remote control method combining artificial intelligence AI and robot flow automation RPA described in fig. 10.
As shown in fig. 13, fig. 13 is a block diagram of an electronic device incorporating a remote control method of artificial intelligence AI and robot process automation RPA according to an embodiment of the present application. Electronic devices are intended to represent various forms of digital computers, such as laptops, desktops, workstations, personal digital assistants, servers, blade servers, mainframes, and other appropriate computers. The electronic device may also represent various forms of mobile devices, such as personal digital processing, cellular phones, smart phones, wearable devices, and other similar computing devices. The components shown herein, their connections and relationships, and their functions, are meant to be examples only, and are not meant to limit implementations of the present application that are described and/or claimed herein.
As shown in fig. 13, the electronic apparatus includes: one or more processors 1301, memory 1302, and interfaces for connecting the various components, including high speed interfaces and low speed interfaces. The various components are interconnected using different buses and may be mounted on a common motherboard or in other manners as desired. The processor may process instructions for execution within the electronic device, including instructions stored in or on the memory to display graphical information of a GUI on an external input/output apparatus (such as a display device coupled to the interface). In other embodiments, multiple processors and/or multiple buses may be used, along with multiple memories and multiple memories, as desired. Also, multiple electronic devices may be connected, with each device providing portions of the necessary operations (e.g., as a server array, a group of blade servers, or a multi-processor system). Fig. 13 illustrates an example of a processor 1301.
Memory 1302 is a non-transitory computer readable storage medium as provided herein. Wherein the memory stores instructions executable by at least one processor to cause the at least one processor to perform a method for remote control in conjunction with an artificial intelligence AI and a robot flow automation RPA as described in the embodiments of fig. 1-9 or in conjunction with an artificial intelligence AI and a robot flow automation RPA as described in the embodiment of fig. 10 provided herein. A non-transitory computer readable storage medium of the present application stores computer instructions for causing a computer to perform a remote control method combining an artificial intelligence AI and a robot flow automation RPA as described in the embodiments of fig. 1 to 9 of the present application or perform a remote control method combining an artificial intelligence AI and a robot flow automation RPA as described in the embodiment of fig. 10 of the present application.
The memory 1302, as a non-transitory computer readable storage medium, can be used for storing non-transitory software programs, non-transitory computer executable programs, and modules, as in the embodiments of fig. 1 to 9 of the present application, or program instructions/modules corresponding to the information processing method in conjunction with AI and RPA in the embodiment of fig. 10 (for example, the installation module 1110, the transmission module 1120, the control module 1130, and the processing module 1140 shown in fig. 11, and the receiving module 1210, the obtaining module 1220, and the transmitting module 1230 shown in fig. 12). The processor 1301 executes the non-transitory software programs, instructions and modules stored in the memory 1302 to execute various functional applications and data processing of the server, that is, to implement the remote control method combining the artificial intelligence AI and the robot flow automation RPA according to the embodiments of fig. 1 to 9 of the present application, or to implement the remote control method combining the artificial intelligence AI and the robot flow automation RPA according to the embodiment of fig. 10.
The memory 1302 may include a program storage area and a data storage area, wherein the program storage area may store an operating system, an application program required for at least one function; the storage data area may store data created from use of the electronic device according to generation of the semantic representation model, and the like. Further, the memory 1302 may include high speed random access memory, and may also include non-transitory memory, such as at least one magnetic disk storage device, flash memory device, or other non-transitory solid state storage device. In some embodiments, the memory 1302 may optionally include a memory remotely located with respect to the processor 1301, and these remote memories may be connected via a network to an electronic device incorporating the remote control method of artificial intelligence AI and robotic process automation RPA. Examples of such networks include, but are not limited to, the internet, intranets, local area networks, mobile communication networks, and combinations thereof.
The electronic device combining the artificial intelligence AI and the remote control method of the robot process automation RPA may further include: an input device 1303 and an output device 1304. The processor 1301, the memory 1302, the input device 1303 and the output device 1304 may be connected by a bus or other means, and fig. 13 illustrates the bus connection.
The input device 1303 may receive input numeric or character information and generate key signal inputs related to user settings and function control of the electronic device in conjunction with generation of information processing of the AI and RPA, such as an input device like a touch screen, a keypad, a mouse, a track pad, a touch pad, a pointing stick, one or more mouse buttons, a track ball, a joystick, etc. The output devices 1304 may include a display device, auxiliary lighting devices (e.g., LEDs), tactile feedback devices (e.g., vibrating motors), and the like. The display device may include, but is not limited to, a Liquid Crystal Display (LCD), a Light Emitting Diode (LED) display, and a plasma display. In some implementations, the display device can be a touch screen.
Various implementations of the systems and techniques described here can be realized in digital electronic circuitry, integrated circuitry, application specific ASICs (application specific integrated circuits), computer hardware, firmware, software, and/or combinations thereof. These various embodiments may include: implemented in one or more computer programs that are executable and/or interpretable on a programmable system including at least one programmable processor, which may be special or general purpose, receiving data and instructions from, and transmitting data and instructions to, a storage system, at least one input device, and at least one output device.
These computer programs (also known as programs, software applications, or code) include machine instructions for a programmable processor, and may be implemented using high-level procedural and/or object-oriented programming languages, and/or assembly/machine languages. As used herein, the terms "machine-readable medium" and "computer-readable medium" refer to any computer program product, apparatus, and/or device (e.g., magnetic discs, optical disks, memory, Programmable Logic Devices (PLDs)) used to provide machine instructions and/or data to a programmable processor, including a machine-readable medium that receives machine instructions as a machine-readable signal. The term "machine-readable signal" refers to any signal used to provide machine instructions and/or data to a programmable processor.
To provide for interaction with a user, the systems and techniques described here can be implemented on a computer having: a display device (e.g., a CRT (cathode ray tube) or LCD (liquid crystal display) monitor) for displaying information to a user; and a keyboard and a pointing device (e.g., a mouse or a trackball) by which a user can provide input to the computer. Other kinds of devices may also be used to provide for interaction with a user; for example, feedback provided to the user can be any form of sensory feedback (e.g., visual feedback, auditory feedback, or tactile feedback); and input from the user may be received in any form, including acoustic, speech, or tactile input.
The systems and techniques described here can be implemented in a computing system that includes a back-end component (e.g., as a data server), or that includes a middleware component (e.g., an application server), or that includes a front-end component (e.g., a user computer having a graphical user interface or a web browser through which a user can interact with an implementation of the systems and techniques described here), or any combination of such back-end, middleware, or front-end components. The components of the system can be interconnected by any form or medium of digital data communication (e.g., a communication network). Examples of communication networks include: local Area Networks (LANs), Wide Area Networks (WANs), and the Internet.
The computer system may include clients and servers. A client and server are generally remote from each other and typically interact through a communication network. The relationship of client and server arises by virtue of computer programs running on the respective computers and having a client-server relationship to each other.
In addition, the information acquisition, storage, application and the like in the technical scheme of the application all accord with the regulations of related laws and regulations and do not violate the good customs of the public order.
It should be understood that various forms of the flows shown above may be used, with steps reordered, added, or deleted. For example, the steps described in the present application may be executed in parallel, sequentially, or in different orders, as long as the desired results of the technical solutions proposed in the present application can be achieved, and the present invention is not limited herein.
The above-described embodiments should not be construed as limiting the scope of the present application. It should be understood by those skilled in the art that various modifications, combinations, sub-combinations and substitutions may be made in accordance with design requirements and other factors. Any modification, equivalent replacement, and improvement made within the spirit and principle of the present application shall be included in the protection scope of the present application.

Claims (14)

1. A remote control method combining artificial intelligence AI and robot process automation RPA is characterized by being applied to a main control terminal and comprising the following steps:
controlling the RPA robot to install an automatic flow service program on the main control terminal; wherein the automatic process service program is used for creating and executing an operation process;
controlling the RPA robot to send a process service extension management program corresponding to the automatic process service program to a controlled terminal so that the controlled terminal installs the process service extension management program;
controlling an RPA robot to remotely control the controlled terminal so as to obtain interface operable elements according to the process service extension management program;
and controlling the RPA robot to create and execute the operation flow of the interface operable element according to the automatic flow service program.
2. The method of claim 1, wherein extending a hypervisor to obtain interface actionable elements according to the process service comprises:
the controlled terminal is controlled to manage an extension program through a process service extension management program, and the controlled terminal is controlled to acquire the interface operable element through the extension program in combination with a natural language processing technology NLP and/or an optical character recognition technology OCR;
and controlling the controlled terminal to send the interface operable element to the master control terminal.
3. The method according to claim 1, wherein the controlling the RPA robot to send the process service extension management program corresponding to the automated process service program to the controlled terminal includes:
controlling an RPA robot to establish a virtual channel between the main control terminal and the controlled terminal;
and controlling the RPA robot to send the automatic process service program to the controlled terminal through the virtual channel and the process service expansion management program corresponding to the automatic process service program.
4. The method of claim 2, wherein the extension program comprises at least one of the following extension programs: chrome extensions, FireFox extensions, Java extensions, Windows remote desktop extensions, and Citrix extensions.
5. The method of claim 3, further comprising:
and when the creation and the execution of the operation flow are completed, closing the virtual channel and releasing the resources distributed by the virtual channel.
6. A remote control method combining artificial intelligence AI and robot process automation RPA is characterized in that the method is applied to a controlled terminal and comprises the following steps:
receiving a process service extension management program sent by the master control terminal through the RPA robot and installing the process service extension management program;
acquiring an interface operable element according to the process service extension management program;
and sending the interface operable element to the main control terminal so as to control the RPA robot to create and execute the operation flow of the interface operable element according to the automatic flow service program.
7. The utility model provides a combine artificial intelligence AI and robot process automation RPA's remote control device which characterized in that is applied to main control terminal, includes:
the installation module is used for controlling the RPA robot to install an automatic flow service program on the main control terminal; wherein the automatic process service program is used for creating and executing an operation process;
the transmitting module is used for controlling the RPA robot to transmit the process service extension management program corresponding to the automatic process service program to a controlled terminal so that the controlled terminal can install the process service extension management program;
the control module is used for controlling the RPA robot to remotely control the controlled terminal so as to obtain interface operable elements according to the process service extension management program;
and the processing module is used for controlling the RPA robot to create and execute the operation flow of the interface operable element according to the automatic flow service program.
8. The apparatus of claim 7, wherein the control module is configured to:
the controlled terminal is controlled to manage an extension program through a process service extension management program, and the controlled terminal is controlled to acquire the interface operable element through the extension program in combination with a natural language evolution technology NLP and/or an optical character recognition technology OCR;
and controlling the controlled terminal to send the interface operable element to the master control terminal.
9. The apparatus of claim 8, wherein the sending module is configured to:
controlling an RPA robot to establish a virtual channel between the main control terminal and the controlled terminal;
and controlling the RPA robot to send the automatic process service program to a controlled terminal through the virtual channel and sending a process service expansion management program corresponding to the automatic process service program to the controlled terminal.
10. The apparatus of claim 9, further comprising:
and the releasing module is used for closing the virtual channel and releasing the resources distributed by the virtual channel when the creation and the execution of the operation flow are completed.
11. A remote control device combining artificial intelligence AI and robot process automation RPA is characterized in that the remote control device is applied to a controlled terminal and comprises:
the receiving module is used for receiving the process service extension management program sent by the master control terminal through the RPA robot and installing the process service extension management program;
the acquisition module is used for acquiring interface operable elements according to the process service extension management program;
and the sending module is used for sending the interface operable element to the main control terminal so as to control the RPA robot to create and execute the operation flow of the interface operable element according to the automatic flow service program.
12. An electronic device, comprising:
at least one processor; and
a memory communicatively coupled to the at least one processor; wherein,
the memory stores instructions executable by the at least one processor to enable the at least one processor to perform the method of any one of claims 1-5 or to perform the method of claim 6.
13. A non-transitory computer readable storage medium having stored thereon computer instructions for causing a computer to perform the method of any one of claims 1-5 or the method of claim 6.
14. A computer program product comprising a computer program which, when executed by a processor, implements the method of any one of claims 1-5 or the method of claim 6.
CN202111138297.4A 2021-09-27 2021-09-27 Remote control method and device combining AI and RPA, electronic equipment and medium Active CN113885982B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202111138297.4A CN113885982B (en) 2021-09-27 2021-09-27 Remote control method and device combining AI and RPA, electronic equipment and medium

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202111138297.4A CN113885982B (en) 2021-09-27 2021-09-27 Remote control method and device combining AI and RPA, electronic equipment and medium

Publications (2)

Publication Number Publication Date
CN113885982A true CN113885982A (en) 2022-01-04
CN113885982B CN113885982B (en) 2024-07-12

Family

ID=79007091

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202111138297.4A Active CN113885982B (en) 2021-09-27 2021-09-27 Remote control method and device combining AI and RPA, electronic equipment and medium

Country Status (1)

Country Link
CN (1) CN113885982B (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN115964027A (en) * 2023-03-16 2023-04-14 杭州实在智能科技有限公司 Desktop embedded RPA flow configuration system and method based on artificial intelligence

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105872655A (en) * 2016-03-25 2016-08-17 北京小米移动软件有限公司 Device control methods and apparatuses, and electronic devices
CN112217906A (en) * 2020-06-30 2021-01-12 北京来也网络科技有限公司 Communication method, device, equipment and storage medium combining AI and RPA
CN112416505A (en) * 2021-01-22 2021-02-26 统信软件技术有限公司 Remote control system, method and computing equipment
US20210107141A1 (en) * 2019-10-15 2021-04-15 UiPath, Inc. Integration of heterogeneous models into robotic process automation workflows
CN113051019A (en) * 2021-03-31 2021-06-29 北京和信融慧信息科技有限公司 Flow task execution control method, device and equipment
CN113157409A (en) * 2021-03-25 2021-07-23 北京来也网络科技有限公司 AI-based RPA task scheduling method, device, electronic equipment and storage medium

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105872655A (en) * 2016-03-25 2016-08-17 北京小米移动软件有限公司 Device control methods and apparatuses, and electronic devices
US20210107141A1 (en) * 2019-10-15 2021-04-15 UiPath, Inc. Integration of heterogeneous models into robotic process automation workflows
CN112217906A (en) * 2020-06-30 2021-01-12 北京来也网络科技有限公司 Communication method, device, equipment and storage medium combining AI and RPA
CN112416505A (en) * 2021-01-22 2021-02-26 统信软件技术有限公司 Remote control system, method and computing equipment
CN113157409A (en) * 2021-03-25 2021-07-23 北京来也网络科技有限公司 AI-based RPA task scheduling method, device, electronic equipment and storage medium
CN113051019A (en) * 2021-03-31 2021-06-29 北京和信融慧信息科技有限公司 Flow task execution control method, device and equipment

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN115964027A (en) * 2023-03-16 2023-04-14 杭州实在智能科技有限公司 Desktop embedded RPA flow configuration system and method based on artificial intelligence

Also Published As

Publication number Publication date
CN113885982B (en) 2024-07-12

Similar Documents

Publication Publication Date Title
US20140082511A1 (en) Method and system for emulating desktop software applications in a mobile communication network
CN111984476B (en) Test method and device
CN110704162B (en) Method, device and equipment for sharing container mirror image by physical machine and storage medium
CN111475259B (en) Applet loading method and device and electronic equipment
CN101699403B (en) Method for graphically installing distributed system
CN113934464A (en) Method and device for starting android application in Linux system and electronic equipment
CN111290768B (en) Updating method, device, equipment and medium of containerized application system
CN111913884A (en) Distributed test method, device, equipment, system and readable storage medium
CN112948018B (en) Dynamic library loading method, device, equipment and medium for applet
CN111885114B (en) Method, device and storage medium for upgrading application program interface module in gateway
CN113885982B (en) Remote control method and device combining AI and RPA, electronic equipment and medium
CN111930539A (en) Task management method, device and equipment based on label engine and storage medium
CN113435012B (en) Distributed aircraft simulation method and device and electronic equipment
CN110908675A (en) Operating environment acquisition method and device and electronic equipment
CN114416578A (en) Test method and device
KR100609667B1 (en) Renewal system for Graphical User Interface
CN110618944A (en) Device simulation method, device, electronic device and storage medium
CN111506399B (en) Task migration method and device, electronic equipment and storage medium
CN114327945A (en) Scanning method, device and system
CN111367963B (en) Method, device, equipment and computer storage medium for determining source channel
McComas et al. Opensatkit enables quick startup for cubesat missions
CN112085471A (en) Task distribution method and device, electronic equipment and storage medium
CN112017528B (en) Vehicle-mounted machine map configuration method and device and electronic equipment
CN111158645A (en) System and method for providing an integrated development environment
CN113051122A (en) Performance data acquisition method, performance data acquisition device, electronic equipment and medium

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant