WO2024022399A1

WO2024022399A1 - Ia robot monitoring method and apparatus based on rpa and ai

Info

Publication number: WO2024022399A1
Application number: PCT/CN2023/109386
Authority: WO
Inventors: 殷星; 王瑞丰
Original assignee: 北京来也网络科技有限公司; 来也科技(北京)有限公司
Priority date: 2022-07-26
Filing date: 2023-07-26
Publication date: 2024-02-01
Also published as: CN115297025A

Abstract

The present disclosure provides an IA robot monitoring method based on RPA and AI. The method comprises: recognizing data information currently obtained from each VNC server, and/or the connection state of an RPA robot associated with each VNC server and a console, so as to determine the current operating state of each RPA robot; and then, according to the current operating state of each RPA robot, updating a monitoring card corresponding to each RPA robot in an RPA monitoring interface. Thus, the current operating state of the RPA robot is determined by means of recognition, and the RPA monitoring interface is automatically updated according to the current operating state of the RPA robot, so that IA robot monitoring is achieved, thereby improving the efficiency of operation and maintenance of the RPA robot.

Description

IA robot monitoring method and device based on RPA and AI

Cross-references to related applications

This application claims priority to Chinese Patent Application No. 2022108877779 filed in China on July 26, 2022, the entire content of which is incorporated herein by reference.

Technical field

The present disclosure relates to the field of automation technology, and specifically to an IA robot monitoring method and device based on RPA and AI.

Background technique

Robotic Process Automation, referred to as RPA, uses specific "robot software" to simulate human operations on a computer and automatically execute process tasks according to rules.

Artificial Intelligence (AI) is a technical science that studies and develops theories, methods, technologies and application systems for simulating, extending and expanding human intelligence.

Intelligent Automation (IA) is a general term for a series of technologies from robotic process automation to artificial intelligence. It combines RPA with Optical Character Recognition (OCR), Intelligent Character Recognition (ICR), process mining ( Process Mining), Deep Learning (Deep Learning, DL), Machine Learning (ML), Natural Language Processing (NLP), Speech Recognition (Automatic Speech Recognition, ASR), Speech Synthesis (Text To Speech, TTS), Computer Vision (CV) and other AI technologies are combined to create end-to-end business processes that can think, learn and adapt, covering process discovery, process automation, and automatic and continuous data collection Collect and understand the meaning of data, and use data to manage and optimize the entire process of business processes.

With the continuous development of automation technology, RPA robots are increasingly used in enterprises, which makes it increasingly difficult to control robots. Since RPA robots may be deployed in various regions and offices within the enterprise, operation and maintenance personnel cannot uniformly monitor the operating status of the RPA robots, resulting in the inability to detect possible failures of the RPA robots in a timely manner and low operation and maintenance efficiency.

Contents of the invention

The embodiment of this disclosure provides an IA robot monitoring method based on RPA and AI. The technical solution is as follows:

The first embodiment of the present disclosure provides an IA robot monitoring method based on RPA and AI, including:

Identify the data information currently obtained from each virtual network console VNC server and/or the connection status of the RPA robot associated with each VNC server and the console to determine the current running status of each RPA robot;

According to the current running status of each RPA robot, the monitoring card corresponding to each RPA robot in the RPA monitoring interface is updated.

In one implementation, the data information currently obtained from each virtual network console VNC server and/or the connection status of the RPA robot associated with each VNC server and the console is identified to determine each The current operating status of the RPA robot, including:

In response to the natural language processing NLP result corresponding to the data information, any VNC server sends a screenshot of the current corresponding running screen of the associated RPA robot to determine that the associated RPA robot is currently in a running state; and/or,

In response to the NLP result corresponding to the connection status between the RPA robot associated with any VNC server and the console indicating that the connection is disconnected, it is determined that the RPA robot associated with any VNC server is in an offline state.

In one implementation, the monitoring card corresponding to each RPA robot in the RPA monitoring interface is updated according to the current operating status of each RPA robot, including:

In response to any RPA robot being in a running state, use the current corresponding screenshot of the running screen of any RPA robot to update the monitoring card corresponding to any RPA robot in the RPA monitoring interface; and/or,

In response to any RPA robot being in a running timeout state, update the monitoring card corresponding to any RPA robot in the RPA monitoring interface based on the current running timeout duration of any RPA robot; and/or,

In response to any RPA robot being offline, the monitoring card corresponding to any RPA robot in the RPA monitoring interface is updated based on the current offline duration of any RPA robot.

In one embodiment, the method further includes:

In response to the first preset control being triggered in the RPA monitoring interface, a candidate list associated with the first preset control is displayed in the RPA monitoring interface;

In response to any candidate item in the candidate list being selected, obtain the first RPA robot with the same running status as indicated by any candidate item;

The monitoring card corresponding to the first RPA robot is displayed in the RPA monitoring interface.

In one embodiment, the method further includes:

In response to the second preset control in the RPA monitoring interface being triggered, obtain the target search term entered in the second preset control;

Determine the second RPA robot that matches the target search term;

Display the monitoring card corresponding to the second RPA robot in the RPA monitoring interface.

In one implementation, each VNC server corresponding to each VNC server is determined based on the data information currently obtained from each VNC server and/or the connection status of the RPA robot associated with each VNC server and the console. The current operating status of the RPA robot, including:

In response to the third preset control in the RPA monitoring interface being triggered, based on the data information currently obtained from each VNC server and/or the connection status of the RPA robot associated with each VNC server and the console, determine each The current running status of each RPA robot corresponding to each VNC server.

In one implementation, after updating the monitoring card corresponding to each RPA robot in the RPA monitoring interface, it also includes:

In response to the monitoring card corresponding to any RPA robot being triggered, the operating data of any RPA robot and/or the first attribute information of any RPA robot is displayed on the display interface.

In one implementation, the operation data of any RPA robot and/or the first attribute information of any RPA robot are displayed on the display interface, including:

In response to any RPA robot being in a running state, display the real-time running screen and/or first attribute information of any RPA robot on the display interface; or,

In response to any RPA robot being offline, historical operating data and/or first attribute information of any RPA robot is displayed on the display interface.

In one implementation, the historical running data includes at least one of the following: historical screen recording data, historical running results, historical running task names, and historical running time.

In one embodiment, after displaying the operation data of any RPA robot and/or the attribute information of any RPA robot on the display interface, it also includes:

In response to the fourth preset control in the display interface being triggered, start a remote control connection between the VNC server associated with any RPA robot; or,

In response to the fifth preset control in the display interface being triggered, display the virtual input control on the display interface; or,

In response to the sixth preset control in the display interface being triggered, the number of objects currently monitoring any RPA robot and/or the attribute information of the objects are displayed on the display interface.

In one implementation, the first attribute information includes at least one of the following: task name, task number, and start running time of any RPA robot.

In one implementation, the VNC server and the RPA robot associated with the VNC server are deployed independently.

The second embodiment of the present disclosure provides an IA robot monitoring device based on RPA and AI, including:

The determination module identifies the data information currently obtained from each virtual network console VNC server and/or the connection status of the RPA robot associated with each VNC server and the console to determine the current status of each RPA robot. Operating status;

The update module is used to update the monitoring card corresponding to each RPA robot in the RPA monitoring interface based on the current running status of each RPA robot.

In one implementation, the above determination module is used to:

In one implementation, the above update module is used for:

In one embodiment, the device further includes:

A display module, configured to display a candidate list associated with the first preset control in the RPA monitoring interface in response to the first preset control being triggered in the RPA monitoring interface;

An acquisition module, configured to obtain the first RPA robot with the same operating status as indicated by any candidate in response to any candidate being selected in the candidate list;

The above display module is used to display the monitoring card corresponding to the first RPA robot in the RPA monitoring interface.

In one implementation, the above acquisition module is also used to:

The above-mentioned determination module is also used to determine the second RPA robot that matches the target search term;

The above display module is also used to display the monitoring card corresponding to the second RPA robot in the RPA monitoring interface.

In one implementation, the above determination module is used to:

In one implementation, the above-mentioned display module is also used for:

In one implementation, the above display module is used for:

In one embodiment, the device further includes:

A startup module, configured to start a remote control connection between the VNC server associated with any RPA robot in response to the fourth preset control in the display interface being triggered; or,

The above-mentioned display module is also used to display virtual input controls on the display interface in response to the fifth preset control in the display interface being triggered; or,

The above-mentioned display module is also configured to display the number of objects currently monitoring any RPA robot and/or the attribute information of the objects on the display interface in response to the sixth preset control in the display interface being triggered.

The third embodiment of the present disclosure provides an IA robot monitoring device based on RPA and AI. The device includes: a memory and a processor. Wherein, the memory and the processor communicate with each other through an internal connection path, the memory is used to store instructions, the processor is used to execute the instructions stored in the memory, and when the processor executes the instructions stored in the memory, the processor The method described in the above-mentioned embodiment of the first aspect of the present disclosure is executed.

The fourth embodiment of the present disclosure provides a computer-readable storage medium. The computer-readable storage medium stores a computer program. When the computer program is run on a computer, the method described in the first embodiment of the present disclosure is executed.

The fifth embodiment of the present disclosure provides a computer program product, which includes a computer program. When executed by a processor, the computer program implements the method described in the first embodiment of the disclosure.

A sixth embodiment of the present disclosure provides a computer program. The computer program includes computer program code. When the computer program code is run on a computer, it causes the computer to execute the method described in the first embodiment of the present disclosure. .

The advantages or beneficial effects of the above technical solution include at least: identifying the data information currently obtained from each VNC server and/or the connection status of the RPA robot associated with each VNC server and the console to determine each After checking the current running status of each RPA robot, you can update the monitoring card corresponding to each RPA robot in the RPA monitoring interface based on the current running status of each RPA robot. As a result, by identifying and determining the current operating status of the RPA robot, and automatically updating the RPA monitoring interface based on the current operating status of the RPA robot, IA's monitoring of the robot is realized and the efficiency of RPA robot operation and maintenance is improved.

The above summary is for illustration purposes only and is not intended to be limiting in any way. In addition to the illustrative aspects, embodiments and features described above, further aspects, embodiments and features of the present disclosure will be readily apparent by reference to the drawings and the following detailed description.

Description of drawings

In the drawings, unless otherwise specified, the same reference numbers refer to the same or similar parts or elements throughout the several figures. The drawings are not necessarily to scale. It should be understood that these drawings depict only some embodiments in accordance with the disclosure and are not to be considered limiting of the scope of the disclosure.

Figure 1 is a schematic flow chart of an IA robot monitoring method based on RPA and AI provided by an embodiment of the present disclosure;

Figure 2 is a schematic diagram of VNC integration provided by an embodiment of the present disclosure;

Figure 3 is a schematic diagram of an RPA monitoring interface provided by an embodiment of the present disclosure;

Figure 4 is a schematic flow chart of another IA robot monitoring method based on RPA and AI provided by an embodiment of the present disclosure;

Figure 5 is a schematic flow chart of another IA robot monitoring method based on RPA and AI provided by an embodiment of the present disclosure;

Figure 6 is a schematic flow chart of another IA robot monitoring method based on RPA and AI provided by an embodiment of the present disclosure;

Figure 7 is a schematic flow chart of another IA robot monitoring method based on RPA and AI provided by an embodiment of the present disclosure;

Figure 8 is a schematic flow chart of another IA robot monitoring method based on RPA and AI provided by an embodiment of the present disclosure;

Figure 9 is a schematic diagram of an RPA monitoring interface provided by an embodiment of the present disclosure;

Figure 10 is a schematic diagram of an RPA monitoring interface provided by an embodiment of the present disclosure;

Figure 11 is a schematic flow chart of another IA robot monitoring method based on RPA and AI provided by an embodiment of the present disclosure;

Figure 12 is a schematic diagram of another RPA monitoring interface provided by an embodiment of the present disclosure;

Figure 13 is a schematic structural diagram of an IA robot monitoring device based on RPA and AI provided by an embodiment of the present disclosure;

Figure 14 is a block diagram of a computer device of an IA robot monitoring method based on RPA and AI provided by an embodiment of the present disclosure.

Detailed ways

Embodiments of the present disclosure are described in detail below, examples of which are illustrated in the accompanying drawings, wherein the same or similar reference numerals throughout represent the same or similar elements or elements having the same or similar functions. The embodiments described below with reference to the drawings are exemplary and are only used to explain the present disclosure and are not to be construed as limitations of the present disclosure.

In the description of the present disclosure, the term "plurality" means two or more.

In the description of this disclosure, the term "RPA robot" refers to any robot that can call an RPA program to implement corresponding services or functions.

In the description of this disclosure, the term "console" is a server product with a B/S architecture, which is mainly used to manage all automated processes in the enterprise and remotely allocate the processes to various robots in the enterprise.

In the description of this disclosure, the term "data information" means that data information may include running data information such as screenshots of the running screen corresponding to the RPA robot.

In the description of this disclosure, the term "running state" refers to the working state of the RPA robot operation, which may include offline state, online state, inactive state, etc.

In the description of this disclosure, the term "monitoring card" is a module used to display data information of each RPA robot.

In the description of this disclosure, the term "running screen" refers to the screen displayed on the desktop of the device when the RPA robot is running.

In the description of the present disclosure, the term "first preset control" is a control that filters RPA robots by running status.

In the description of the present disclosure, the term "candidate list" is a list containing all operating states of the RPA robot.

In the description of the present disclosure, the term "second preset control" is a control for filtering RPA robots by RPA robot names.

In the description of the present disclosure, the term "target search term" is the search term in the input box corresponding to the second preset control obtained by the console.

In the description of the present disclosure, the term "third preset control" is a control used to refresh the monitoring card.

In the description of this disclosure, the term "first attribute information" is the property information of the RPA robot, which can include at least one of the following: the task name, task number, start running time and other information running in any RPA robot.

In the description of the present disclosure, the term "fourth preset control" is a control used to control entering the remote control mode.

In the description of the present disclosure, the term "fifth preset control" is a control used to control activation of the analog input control.

In the description of the present disclosure, the term "sixth preset control" is a control used to view object information that monitors the RPA robot.

In the description of this disclosure, the term "property information of an object" is information used to determine the object for monitoring the RPA robot, and may include the name of the object, the IP corresponding to the object, and other information.

In the description of the present disclosure, the term "virtual input control" is a control used to implement part of the functions of the virtual keyboard.

In the description of the present disclosure, the term "seventh preset control" is a control used to control the full-screen display of the real-time running picture.

These and other aspects of embodiments of the present disclosure will become apparent with reference to the following description and accompanying drawings. In these descriptions and drawings, some specific implementations of the embodiments of the disclosure are specifically disclosed to represent some of the ways of implementing the principles of the embodiments of the disclosure, but it should be understood that the scope of the embodiments of the disclosure is not limited by this restriction. On the contrary, the disclosed embodiments include all changes, modifications and equivalents falling within the spirit and scope of the appended claims.

In the embodiment of the present disclosure, by adding the remote monitoring function, the user can remotely view the RPA robot environment and remotely control the RPA robot, thereby no longer needing to go to the location of the RPA robot to maintain the RPA robot. Improved efficiency of maintaining RPA robots.

The intelligent automation (Intelligent Automation, IA) robot monitoring method and device based on Robotic Process Automation (RPA) and Artificial Intelligence (AI) according to embodiments of the present disclosure are described below with reference to the accompanying drawings.

Figure 1 is a flow chart of an intelligent automation (Intelligent Automation, IA) robot monitoring method based on Robotic Process Automation (RPA) and Artificial Intelligence (AI) according to an embodiment of the present disclosure, as shown in Figure 1 , the method may include the following steps S101 to S102.

Step S101: Identify the data information currently obtained from each virtual network console VNC server and/or the connection status of the RPA robot associated with each VNC server and the console to determine the current status of each RPA robot. Operating status.

The data information may include operation data information such as screenshots of the operation screen corresponding to the RPA robot, and this disclosure does not limit this.

As shown in Figure 2, in the embodiment of the present disclosure, in order to realize the function of remote monitoring of RPA robots, the VNC server can be deployed on the device where each RPA robot is located based on the open source Virtual Network Console (VNC) technology. , deploy the VNC client in the console server, and embed the VNC service into the console service. The console can call the interface of the VNC client to obtain the data information of the corresponding RPA robot from each VNC server, thereby realizing any When you enter the console page through a browser on the device, you can obtain the data information corresponding to the RPA robot to monitor the RPA robot. Among them, the VNC server deployed on the device where the RPA robot is located and the RPA robot are deployed independently of each other, which can effectively avoid the impact on the VNC service process when the RPA robot process crashes.

In this disclosed embodiment, in order to save network resources, after the console and RPA robot equipment are deployed to complete the VNC service, each VNC server can send its corresponding RPA robot data information to the VNC client according to the preset time interval. The console can identify the data information, for example, perform natural language processing (NLP) on the data information to obtain the key data in the data information, and determine the current status of each RPA robot based on the key data. Operating status. Among them, the key data may include identification information used to determine the operating status of the RPA robot, etc., and this disclosure does not limit this.

Alternatively, the console can determine the connection status of each RPA robot and the console based on the heartbeat information sent by each RPA robot, and determine the current running status of each RPA robot corresponding to each VNC server based on the connection status. For example, based on the fact that the connection status between the RPA robot and the console is a normal connection status, it is determined that the current running status of the RPA robot is online (i.e. running status).

Step S102: Update the monitoring card corresponding to each RPA robot in the RPA monitoring interface according to the current operating status of each RPA robot.

In the embodiment of the present disclosure, the corresponding data information may be different for different RPA robot operating states, so the information displayed in the monitoring card corresponding to each RPA robot may be different. Therefore, according to the current operating state of each RPA robot, the corresponding data information may be different. The monitoring card corresponding to each RPA robot in the RPA monitoring interface is updated. Among them, the monitoring card can be used to display the data information of each RPA robot.

As shown in Figure 3, each RPA robot can correspond to a monitoring card. The monitoring card can contain the name of the RPA robot, the running status information of the RPA robot (such as online, offline, disconnection time, etc. in Figure 3), etc. According to the current running status of each RPA robot, the monitoring card corresponding to each RPA robot in the RPA monitoring interface is updated to realize the function of remote monitoring of each RPA robot.

It should be noted that the style of the schematic diagram of the RPA monitoring interface in Figure 3 and the names of each control in the figure are only schematic explanations. This disclosure does not make any reference to the names, positions and display styles of each control in the RPA monitoring interface. limited.

In the embodiment of the present disclosure, the console identifies the data information currently obtained from each VNC server and/or the connection status of the RPA robot associated with each VNC server and the console to determine the current status of each RPA robot. After the running status of each RPA robot is determined, the monitoring card corresponding to each RPA robot in the RPA monitoring interface can be updated based on the current running status of each RPA robot. As a result, by identifying and determining the current operating status of the RPA robot, and automatically updating the RPA monitoring interface based on the current operating status of the RPA robot, IA's monitoring of the robot is realized and the efficiency of RPA robot operation and maintenance is improved.

Figure 4 is a flow chart of an intelligent automation (Intelligent Automation, IA) robot monitoring method based on Robotic Process Automation (RPA) and Artificial Intelligence (AI) according to an embodiment of the present disclosure, as shown in Figure 4 , the method may include the following steps S401 to S402.

Step S401: In response to the NLP result corresponding to the data information indicating that any VNC server sends a screenshot of the current corresponding running screen of the associated RPA robot, determine that the associated RPA robot is currently in a running state.

In this disclosed embodiment, when the RPA robot is running, the running screen will be displayed on the desktop of the device where the RPA robot is located. At this time, the data information sent by the VNC server to the VNC client includes a screenshot of the current corresponding running screen of the RPA robot. , after that, after the console obtains the data information, it can compare the data information with the preset reference data to determine that the data information is a screenshot of the current corresponding running screen of the RPA robot, and then it can be determined that the RPA robot is currently in a running state. , that is, online status. Among them, the reference data can be RPA robot running screen data.

Alternatively, the console can perform NLP on the data information to obtain key data in the data information. When the identification information used to determine the running status of the RPA robot in the key data is a running status identification, it can be determined that the associated RPA robot is currently running. state.

In some embodiments, if the NLP result indication corresponding to the data information is not a screenshot of the current running screen corresponding to the associated RPA robot sent by any VNC server, it can be determined that the RPA robot is currently in an idle state.

In some embodiments, after the RPA robot completes the task, it can send the task execution result to the console. If the console does not receive the operation result data sent by an RPA robot within the preset time, it is determined that the RPA robot is in a running timeout state.

In some embodiments, based on the NLP result corresponding to the connection status of the RPA robot associated with any VNC server and the console indicating that the connection is disconnected, it is determined that the RPA robot associated with any VNC server is in an offline state.

In this disclosed embodiment, after the RPA robot is started, it can report heartbeat information to the console at a preset time interval to indicate whether the RPA robot is online. Based on the fact that the console does not receive the message sent by the RPA robot within the preset time period, Heartbeat information determines that the connection status between the RPA robot and the console is disconnected, and the RPA robot is offline.

In some embodiments, based on the fact that the RPA robot associated with any VNC server is not activated, it is determined that the RPA robot associated with any VNC server is in an inactive state.

In some embodiments, when the third preset control in the RPA monitoring interface is triggered, the console can use the data information currently obtained from each VNC server and/or the RPA robot associated with each VNC server. The connection status with the console determines the current running status of each RPA robot corresponding to each VNC server. Among them, the third preset control can be a control used to refresh the monitoring card. In response to the user clicking the third preset control in the RPA monitoring interface, such as clicking the "Refresh" button in Figure 3, the console determines the third preset control. is triggered.

Step S402: Update the monitoring card corresponding to each RPA robot in the RPA monitoring interface according to the current operating status of each RPA robot.

In the embodiment of the present disclosure, for the specific implementation process of step S402, please refer to the detailed description of any embodiment of the present disclosure, and will not be described again here.

In this disclosed embodiment, based on the data information, it is determined that the associated RPA robot is currently in a running state based on the screenshot of the current running screen corresponding to the associated RPA robot sent by any VNC server. After that, the current running state of each RPA robot can be determined. , update the monitoring card corresponding to each RPA robot in the RPA monitoring interface. Therefore, through the VNC service, the operating data information of the RPA robot is obtained, thereby realizing the monitoring of the RPA robot and improving the efficiency of RPA robot operation and maintenance.

Figure 5 is a flow chart of an intelligent automation (Intelligent Automation, IA) robot monitoring method based on Robotic Process Automation (RPA) and Artificial Intelligence (AI) according to an embodiment of the present disclosure, as shown in Figure 5 , the method may include the following steps S501 to S502.

Step S501: Identify the data information currently obtained from each VNC server and/or the connection status of the RPA robot associated with each VNC server and the console to determine the current operating status of each RPA robot.

In the embodiment of the present disclosure, for the specific implementation process of step 501, please refer to the detailed description of any embodiment of the present disclosure, and will not be described again here.

Step S502: In response to any RPA robot being in a running state, use the current corresponding information of any RPA robot to Take a screenshot of the running screen and update the monitoring card corresponding to any RPA robot in the RPA monitoring interface.

In the embodiment of the present disclosure, based on the fact that the RPA robot is in a running state, that is, in an online state, the current corresponding running screen screenshot of the RPA robot is displayed in the monitoring card corresponding to the RPA robot, so as to realize the monitoring of the RPA robot.

As shown in Figure 3, the running status of the RPA robot Worker1 is online, and the screenshot of the current running screen of the RPA robot can be displayed in the monitoring card corresponding to the RPA robot Worker1.

In some embodiments, in response to a certain RPA robot being in a running timeout state, the monitoring card corresponding to the RPA robot in the RPA monitoring interface can be updated based on the current running timeout duration of the RPA robot. For example, the current running timeout duration of the RPA robot can be displayed in the monitoring card corresponding to the RPA robot to remind the RPA robot that the RPA robot has run out of time.

In some embodiments, in response to a certain RPA robot being offline, the monitoring card corresponding to any RPA robot in the RPA monitoring interface is updated based on the current offline duration of the RPA robot.

For example, the current offline duration of the RPA robot can be displayed in the monitoring card corresponding to the RPA robot to remind that the RPA robot is offline. Alternatively, the specific moment when the RPA robot disconnected can also be displayed in the monitoring card corresponding to the RPA robot. Or, when the offline time exceeds the preset threshold, a reminder message of "offline time too long" can be displayed in the monitoring card corresponding to the RPA robot. Or, when the console detects that the RPA robot is offline due to network reasons, the "unresponsive" reminder message can be displayed in the monitoring card corresponding to the RPA robot.

As shown in Figure 3, the running status of RPA robot Worker2 is offline. The disconnection time can be displayed in the monitoring card corresponding to RPA robot Worker2 as 2022-04-24 19:45:52, and "Not Responding" is displayed.

In some embodiments, in response to a certain RPA robot being in an inactive state, the monitoring card corresponding to any RPA robot in the RPA monitoring interface is updated based on the current inactive duration of the RPA robot.

For example, the current inactive time of the RPA robot can be displayed in the monitoring card corresponding to the RPA robot to remind that the RPA robot is not activated. Alternatively, the creation time of the RPA robot can be displayed in the monitoring card corresponding to the RPA robot to remind that the RPA robot is not activated. Or, when the inactivity period exceeds the preset threshold, a reminder message of "Long Inactivity" can be displayed in the monitoring card corresponding to the RPA robot.

As shown in Figure 3, the running status of RPA robot Worker4 is inactive. The creation time can be displayed in the monitoring card corresponding to RPA robot Worker4 as 2022-04-01 19:45:52, and "Inactive for a long time" is displayed. .

In the embodiment of the present disclosure, the current data information obtained from each VNC server and/or the connection status of the RPA robot associated with each VNC server and the console is identified to determine the current status of each RPA robot. After the running status, based on the fact that any RPA robot is in the running status, use the current corresponding running screen screenshot of any RPA robot to update the monitoring card corresponding to any RPA robot in the RPA monitoring interface. Therefore, through the VNC service, the operating data information of the RPA robot is obtained, thereby realizing the monitoring of the RPA robot and improving the efficiency of RPA robot operation and maintenance.

Figure 6 is a flow chart of an intelligent automation (Intelligent Automation, IA) robot monitoring method based on Robotic Process Automation (RPA) and Artificial Intelligence (AI) according to an embodiment of the present disclosure, as shown in Figure 6 , the method may include the following steps S601 to S605.

Step S601: Identify the data information currently obtained from each VNC server and/or the connection status of the RPA robot associated with each VNC server and the console to determine the current operating status of each RPA robot.

Step S602: Update the monitoring card corresponding to each RPA robot in the RPA monitoring interface according to the current operating status of each RPA robot.

In the embodiment of the present disclosure, for the specific implementation process of steps S601 to S602, please refer to the detailed description of any embodiment of the present disclosure, and will not be described again here.

Step S603: In response to the first preset control being triggered in the RPA monitoring interface, display a candidate list associated with the first preset control in the RPA monitoring interface.

Among them, the first preset control may be a control for screening RPA robots by running status.

In this disclosed embodiment, in response to the user clicking on the first preset control in the RPA monitoring interface, such as clicking on the "all status" control in Figure 3, the console determines that the first preset control is triggered. At this time, the console can A list of candidates associated with the first preset control is displayed on the RPA monitoring interface for the user to select. Among them, the candidate option list can include all running states of the RPA robot.

Step S604: In response to any candidate item in the candidate list being selected, obtain the first RPA robot with the same operating status as indicated by any candidate item.

In this disclosed embodiment, when the user clicks on a candidate item in the candidate list to be selected, it means that the user needs to filter out all RPA robots in the running state corresponding to the candidate item. The console can filter based on the running state corresponding to the candidate item. Output the first RPA robot in this running state.

Step S605: Display the monitoring card corresponding to the first RPA robot in the RPA monitoring interface.

In this disclosed embodiment, when the user selects a certain candidate, it means that the user needs to view the RPA robot in the running state corresponding to the selected candidate. Therefore, the console can only display the RPA robot corresponding to the first RPA robot in the RPA monitoring interface. Monitoring cards allow users to quickly view all RPA robots in the running status corresponding to the selected candidate.

In the embodiment of the present disclosure, the current data information obtained from each VNC server and/or the connection status of the RPA robot associated with each VNC server and the console is identified to determine the current status of each RPA robot. After the running status, the monitoring card corresponding to each RPA robot in the RPA monitoring interface can be updated according to the current running status of each RPA robot. When the first preset control in the RPA monitoring interface is triggered, the monitoring card can be updated in the RPA monitoring interface. The candidate list associated with the first preset control is displayed. When any candidate in the candidate list is selected, the first RPA robot with the same running status indicated by any candidate can be obtained and displayed in the RPA monitoring interface Display the monitoring card corresponding to the first RPA robot. From this, through the VNC service, the operating data information of the RPA robot is obtained. This enables monitoring of RPA robots and improves the efficiency of RPA robot operation and maintenance.

Figure 7 is a flow chart of an intelligent automation (Intelligent Automation, IA) robot monitoring method based on Robotic Process Automation (RPA) and Artificial Intelligence (AI) according to an embodiment of the present disclosure, as shown in Figure 7 , the method may include the following steps S701 to S705.

Step S701: Identify the data information currently obtained from each VNC server and/or the connection status of the RPA robot associated with each VNC server and the console to determine the current operating status of each RPA robot.

Step S702: Update the monitoring card corresponding to each RPA robot in the RPA monitoring interface according to the current running status of each RPA robot.

In the embodiment of the present disclosure, for the specific implementation process of steps S701 to S702, please refer to the detailed description of any embodiment of the present disclosure, and will not be described again here.

Step S703: In response to the second preset control being triggered in the RPA monitoring interface, obtain the target search term entered in the second preset control.

The second preset control may be a control for filtering RPA robots by RPA robot name.

In the embodiment of the present disclosure, the user can enter a search term in the input box corresponding to the second preset control, for example, the name of the RPA robot to be searched, and then click the second preset control, for example, click the search in Figure 3 icon button, the console can determine that the second preset control is triggered, and obtain the target search term in the input box corresponding to the second preset control.

Step S704: Determine the second RPA robot matching the target search term.

In this disclosed embodiment, the console can calculate the distance between the vector corresponding to the target search term and the vectors corresponding to the names of all RPA robots in the console, and determine the corresponding matching degree based on the distance. When the target search term matches a certain When the RPA robot name matching degree is greater than the threshold, it means that the RPA robot corresponding to the RPA robot name may be the RPA robot searched by the user, and the RPA robot can be determined to be the second RPA robot.

It should be noted that there may be multiple RPA robot names that match the target search term, so there may be multiple second RPA robots.

Step S705: Display the monitoring card corresponding to the second RPA robot in the RPA monitoring interface.

In this disclosed embodiment, when the user triggers the second preset control, it means that the user needs to view the RPA robot in the running state corresponding to the target search term. Therefore, the console can only display the RPA robot corresponding to the second RPA robot in the RPA monitoring interface. Monitoring cards allow users to quickly view the RPA robot in the running status corresponding to the target search term.

In the embodiment of the present disclosure, the current data information obtained from each VNC server and/or the connection status of the RPA robot associated with each VNC server and the console is identified to determine the current status of each RPA robot. After the running status, the monitoring card corresponding to each RPA robot in the RPA monitoring interface can be updated according to the current running status of each RPA robot. In response to the second preset control in the RPA monitoring interface being triggered, obtain the second preset control Enter the target search term and determine the second RPA robot that matches the target search term, which can then be used in the RPA monitoring community The monitoring card corresponding to the second RPA robot is displayed in the screen. Therefore, through the VNC service, the operating data information of the RPA robot is obtained, thereby realizing the monitoring of the RPA robot and improving the efficiency of RPA robot operation and maintenance.

Figure 8 is a flow chart of an intelligent automation (Intelligent Automation, IA) robot monitoring method based on Robotic Process Automation (RPA) and Artificial Intelligence (AI) according to an embodiment of the present disclosure, as shown in Figure 8 , the method may include the following steps S801 to S803.

Step S801: Identify the data information currently obtained from each VNC server and/or the connection status of the RPA robot associated with each VNC server and the console to determine the current operating status of each RPA robot.

Step S802: Update the monitoring card corresponding to each RPA robot in the RPA monitoring interface according to the current operating status of each RPA robot.

In the embodiment of the present disclosure, for the specific implementation process of step S801 to step S802, please refer to the detailed description of any embodiment of the present disclosure, and will not be described again here.

Step S803: In response to the monitoring card corresponding to any RPA robot being triggered, display the operating data of any RPA robot and/or the first attribute information of any RPA robot on the display interface.

The first attribute information may include at least one of the following: task name, task number, start running time and other information running in any RPA robot, and this disclosure does not limit this.

The operating data may include information such as real-time operating pictures, and this disclosure does not limit this.

In the embodiment of the present disclosure, when the user clicks on the monitoring card corresponding to a certain RPA robot, it means that the user needs to check the operation status of the RPA robot. Therefore, the console can display the operation data and/or corresponding to the RPA robot in the display interface. First attribute information.

In some embodiments, based on the fact that a certain RPA robot is in a running state, the real-time running screen and/or the first attribute information of the RPA robot can be displayed on the display interface.

As shown in Figure 9, based on the fact that the RPA robot is in running status, the real-time running screen of the RPA robot can be displayed in the real-time monitoring window in the display interface. In the right pane, the list of tasks that the RPA robot is running is displayed, and The list of tasks to be run, etc., displays information such as the RPA robot name Worker1, the Internet Protocol (IP) corresponding to the RPA robot, and other information in the bottom pane. The running task list may include first attribute information such as task number and task name corresponding to each running task.

In addition, in response to the view details control in the operation bar corresponding to each running task being triggered, the console can display the task log and other information corresponding to each running task in the display interface.

In some embodiments, based on the fact that a certain RPA robot is offline, the historical operating data and/or first attribute information of the RPA robot may be displayed on the display interface.

The historical running data may include at least one of the following: historical screen recording data, historical running results, historical running task names, and historical running time.

In the embodiment of the present disclosure, since the RPA robot is in an offline state, the user pays more attention to the historical operation data of the RPA robot. Therefore, the historical operation data and/or the first attribute information of the RPA robot can be displayed on the display interface for the user to check the data. RPA robot historical operation data.

As shown in Figure 10, based on the fact that the RPA robot is offline, the console can display the RPA robot name Worker2, the IP corresponding to the RPA robot and other information in the bottom pane. The RPA robot can be displayed in the right pane of the display interface. A list of historical running records. Each historical running record includes the historical running time corresponding to the historical running tasks of the RPA robot, the name of the historical running tasks, the historical running results and other information. For example, the task name corresponding to the first historical running record is Test1, the historical running time is 2022-04-21 19:20:22, "√" indicates that the running result is successful, and the corresponding "√" indicates the historical running task Test2 The running result is failure.

In addition, in response to the view control corresponding to a certain historical running record being triggered, as shown in Figure 10, in response to the user clicking the view control corresponding to the historical running record Test1, the console can display the detailed historical running data of the historical running task. Based on the detailed The historical running data contains historical screen recording files. In response to the viewing control corresponding to the historical screen recording data being triggered, the console can play the historical screen recording in the real-time monitoring window.

In some embodiments, in response to the real-time monitoring control in the display interface being triggered, for example, when the user clicks on the "real-time monitoring" control in Figure 9, the real-time running screen and/or the first attribute information of the RPA robot is displayed in the display interface, In response to the history record control in the display interface being triggered, for example, in response to the user clicking the "history record" control in Figure 9, the historical operating data and/or first attribute information of the RPA robot is displayed in the display interface.

It should be noted that A, B, C, D, E, F, etc. in the above-mentioned Figures 9 and 10 can represent different numbers or characters. The styles of the schematic diagrams of the RPA monitoring interface in Figures 9 and 10 and the names of the controls in the figures are only schematic illustrations. This disclosure does not limit the names, positions, display styles, etc. of the controls in the RPA monitoring interface.

In the embodiment of the present disclosure, the current data information obtained from each VNC server and/or the connection status of the RPA robot associated with each VNC server and the console is identified to determine the current status of each RPA robot. After the running status, the monitoring card corresponding to each RPA robot in the RPA monitoring interface can be updated according to the current running status of each RPA robot. In response to the monitoring card corresponding to any RPA robot being triggered, any RPA robot is displayed on the display interface. The operating data and/or the first attribute information of any RPA robot. Therefore, through the VNC service, the operating data information of the RPA robot is obtained, thereby realizing the monitoring of the RPA robot and improving the efficiency of RPA robot operation and maintenance.

Figure 11 is a flow chart of an intelligent automation (Intelligent Automation, IA) robot monitoring method based on Robotic Process Automation (RPA) and Artificial Intelligence (AI) according to an embodiment of the present disclosure, as shown in Figure 11 , the method may include the following steps S1101 to S1104.

Step S1101: Identify the data information currently obtained from each VNC server and/or the connection status of the RPA robot associated with each VNC server and the console to determine the current operating status of each RPA robot.

Step S1102: Update the monitoring card corresponding to each RPA robot in the RPA monitoring interface according to the current operating status of each RPA robot.

Step S1103: In response to the monitoring card corresponding to any RPA robot being triggered, display the operating data of any RPA robot and/or the first attribute information of any RPA robot on the display interface.

In the embodiment of the present disclosure, for the specific implementation process of steps S1101 to S1103, please refer to the detailed description of any embodiment of the present disclosure, and will not be described again here.

Step S1104: In response to the fourth preset control in the display interface being triggered, start a remote control connection between the VNC server associated with any RPA robot.

The fourth preset control may be a control used to control entering the remote control mode.

In this disclosed embodiment, in order to prevent the monitoring personnel from misoperation affecting the robot operating environment, the initial state of the remote control function is a disabled state. In response to the user clicking on the fourth preset control, the console can enter the remote control mode, where remote control In this mode, users can remotely control the RPA robot.

As shown in Figure 9, on the right side of the real-time monitoring window, set a hidden operation menu control. In response to the user clicking the control, the console can display the hidden operation menu. In response to clicking the control again, the console can hide the operation menu. , wherein the operation menu may include controls for entering the remote control mode, controls for starting the analog input controls, controls for controlling the full-screen display of the running monitoring window, etc., and this disclosure does not limit this.

In response to the user clicking the "Remote Control" control, the console can initiate a remote control connection between the VNC server associated with the RPA robot, allowing the user to remotely control the RPA robot.

In some embodiments, in response to the fifth preset control in the display interface being triggered, such as clicking the "virtual keyboard" control in Figure 9, the console can display a virtual input control on the display interface for the user to use the virtual input control Enter the corresponding control command of the RPA robot, such as each virtual input control shown in Figure 12. Among them, the fifth preset control can be a control used to control the startup of the simulated input control. The virtual input control can include the Ctrl key, the Alt key, the Windows key, the Tab key, the Esc key, the Ctrl+Alt+Del key combination, etc. Each virtual input control The initial state of the input control and the fifth preset control is unselected, and when clicked, they become selected.

It should be noted that the style of the schematic diagram of the RPA monitoring interface in Figure 12 and the names of each control in the figure are only schematic explanations. This disclosure does not make any reference to the names, positions and display styles of each control in the RPA monitoring interface. limited.

In some embodiments, the console can monitor the objects that monitor the RPA robot. In response to the user clicking the sixth preset control, such as clicking the "User" control in Figure 9, the console can display the RPA currently being monitored on the display interface. The number of robot objects and/or object attribute information. The sixth preset control may be a control used to view object information for monitoring the RPA robot. The attribute information may include the name of the object, the IP corresponding to the object, and other information. This disclosure does not limit this.

In some embodiments, in response to the seventh preset control in the display interface being triggered, such as clicking "All "screen" control to display the real-time running picture in full screen in the display interface. The seventh preset control may be a control used to control the full-screen display of the real-time running picture.

In the embodiment of the present disclosure, the current data information obtained from each VNC server and/or the connection status of the RPA robot associated with each VNC server and the console is identified to determine the current status of each RPA robot. After the running status, the monitoring card corresponding to each RPA robot in the RPA monitoring interface can be updated according to the current running status of each RPA robot. In response to the monitoring card corresponding to any RPA robot being triggered, any RPA can be displayed on the display interface. The robot's operating data and/or the first attribute information of any RPA robot, in response to the fourth preset control in the display interface being triggered, can initiate a remote control connection between the VNC server associated with any RPA robot. As a result, the RPA robot can be controlled through the VNC service, thereby improving the efficiency of RPA robot operation and maintenance.

In order to implement the above embodiments, embodiments of the present disclosure also propose an intelligent automation (Intelligent Automation, IA) robot monitoring device based on Robotic Process Automation (RPA) and Artificial Intelligence (Artificial Intelligence, AI). Figure 13 is a schematic structural diagram of an intelligent automation (Intelligent Automation, IA) robot monitoring device based on Robotic Process Automation (RPA) and Artificial Intelligence (AI) provided by an embodiment of the present disclosure.

As shown in Figure 13, the intelligent automation (Intelligent Automation, IA) robot monitoring device based on Robotic Process Automation (RPA) and Artificial Intelligence (AI) includes: a determination module 1310 and an update module 1320.

The determination module 1310 identifies the data information currently obtained from each virtual network console VNC server and/or the connection status of the RPA robot associated with each VNC server and the console to determine the current status of each RPA robot. operating status;

The update module 1320 is used to update the monitoring card corresponding to each RPA robot in the RPA monitoring interface according to the current operating status of each RPA robot.

In some embodiments, the above-mentioned determination module 1310 is used to:

In one implementation, the above-mentioned update module 1320 is used for:

In one embodiment, it also includes:

In one implementation, the above acquisition module is also used to:

The above-mentioned determination module 1310 is also used to determine the second RPA robot that matches the target search term;

In one implementation, the above-mentioned determination module 1310 is used to:

In one implementation, the above-mentioned display module is also used for:

In one implementation, the above display module is used for:

In one embodiment, it also includes:

In the embodiment of the present disclosure, the data information currently obtained from each VNC server and/or the connection status of the RPA robot associated with each VNC server and the console is identified to determine the current operation of each RPA robot. After checking the status, the monitoring card corresponding to each RPA robot in the RPA monitoring interface can be updated based on the current running status of each RPA robot. Therefore, through the VNC service, the operating data information of the RPA robot is obtained, thereby realizing the monitoring of the RPA robot and improving the efficiency of RPA robot operation and maintenance.

For the functions of each module in each device of the embodiment of the present disclosure, please refer to the corresponding description in the above method, and will not be described again here.

Figure 14 shows a structural block diagram of a computer device according to an embodiment of the present disclosure. As shown in Figure 14, the computer device includes: a memory 1410 and a processor 1420. The memory 1410 stores a computer program that can run on the processor 1420. When the processor 1420 executes the computer program, the IA robot monitoring method based on RPA and AI in the above embodiment is implemented. The number of memory 1410 and processor 1420 may be one or more.

The computer equipment also includes:

Communication interface 1430 is used to communicate with external devices and perform data interactive transmission.

If the memory 1410, the processor 1420, and the communication interface 1430 are implemented independently, the memory 1410, the processor 1420, and the communication interface 1430 may be connected to each other through a bus and communicate with each other. The bus can be an Industry Standard Architecture (ISA) bus, a Peripheral Component Interconnect (PCI) bus or an Extended Industry Standard Architecture (EISA) bus, etc. The bus can be divided into address bus, data bus, control bus, etc. For ease of presentation, only one thick line is used in Figure 14, but it does not mean that there is only one bus or one type of bus.

In some embodiments, in terms of specific implementation, based on the memory 1410, the processor 1420 and the communication interface 1430 being integrated on one chip, the memory 1410, the processor 1420 and the communication interface 1430 can communicate with each other through the internal interface.

Embodiments of the present disclosure provide a computer-readable storage medium, which stores a computer program. When the program is executed by a processor, the method provided in the embodiment of the present disclosure is implemented.

Embodiments of the present disclosure also provide a chip, which includes a processor for calling and The instructions stored in the memory are executed to cause the communication device equipped with the chip to execute the method provided by the embodiment of the present disclosure.

Embodiments of the present disclosure also provide a chip, including: an input interface, an output interface, a processor, and a memory. The input interface, the output interface, the processor, and the memory are connected through an internal connection path. The processor is used to execute the code in the memory. , when the code is executed, the processor is used to execute the method provided by the embodiment of the present disclosure.

An embodiment of the present disclosure also provides a computer program product, including a computer program that implements the method provided by the embodiment of the present disclosure when executed by a processor.

An embodiment of the present disclosure also provides a computer program. The computer program includes a computer program code. When the computer program code is run on a computer, it causes the computer to execute the method provided by the embodiment of the present disclosure.

It should be noted that the foregoing explanations of the IA robot monitoring method and device embodiments based on RPA and AI are also applicable to the electronic equipment, computer-readable storage media, computer program products and computer programs of the embodiments of the present disclosure, and are not used here. Again.

All embodiments of the present disclosure can be executed alone or in combination with other embodiments, which are considered to be within the scope of protection claimed by the present disclosure.

It should be understood that the above-mentioned processor can be a central processing unit (CPU), or other general-purpose processor, digital signal processor (digital signal processing, DSP), application specific integrated circuit (application specific integrated circuit), ASIC), field programmable gate array (FPGA) or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, etc. A general-purpose processor can be a microprocessor or any conventional processor, etc. It is worth noting that the processor may be a processor that supports advanced RISC machines (ARM) architecture.

In some embodiments, the above-mentioned memory may include read-only memory and random access memory, and may also include non-volatile random access memory. The memory may be volatile memory or non-volatile memory, or may include both volatile and non-volatile memory. Among them, non-volatile memory can include read-only memory (ROM), programmable ROM (PROM), erasable programmable read-only memory (erasable PROM, EPROM), electrically removable memory. Erase electrically programmable read-only memory (EPROM, EEPROM) or flash memory. Volatile memory may include random access memory (RAM), which acts as an external cache. By way of illustration, but not limitation, many forms of RAM are available. For example, static random access memory (static RAM, SRAM), dynamic random access memory (dynamic random access memory, DRAM), synchronous dynamic random access memory (synchronous DRAM, SDRAM), double data rate synchronous dynamic random access Memory (double data date SDRAM, DDR SDRAM), enhanced synchronous dynamic random access memory (enhanced SDRAM, ESDRAM), synchronous link dynamic random access memory (synchlink DRAM, SLDRAM) and direct memory bus random access memory (direct rambus RAM, DR RAM).

In the above embodiments, it may be implemented in whole or in part by software, hardware, firmware, or any combination thereof. When implemented using software, it may be implemented in whole or in part in the form of a computer program product. A computer program product includes one or more computer instructions. When computer program instructions are loaded and executed on a computer, processes or functions in accordance with the present disclosure are produced, in whole or in part. The computer may be a general purpose computer, a special purpose computer, a computer network, or other programmable device. Computer instructions may be stored in or transmitted from one computer-readable storage medium to another computer-readable storage medium.

In the description of this specification, reference to the terms "one embodiment," "some embodiments," "an example," "specific examples," or "some examples" or the like means that specific features are described in connection with the embodiment or example. , structures, materials, or features are included in at least one embodiment or example of the present disclosure. Furthermore, the specific features, structures, materials or characteristics described may be combined in any suitable manner in any one or more embodiments or examples. Furthermore, those skilled in the art may combine and combine different embodiments or examples and features of different embodiments or examples described in this specification unless they are inconsistent with each other.

In addition, the terms “first” and “second” are used for descriptive purposes only and cannot be understood as indicating or implying relative importance or implicitly indicating the quantity of indicated technical features. Thus, features defined as "first" and "second" may explicitly or implicitly include at least one of these features. In the description of the present disclosure, "plurality" means two or more than two, unless otherwise expressly and specifically limited.

Any process or method descriptions in flowcharts or otherwise described herein may be understood to represent modules, segments, or portions of code that include one or more executable instructions for implementing the specified logical functions or steps of the process. . And the scope of the preferred embodiments of the present disclosure includes additional implementations in which functions may be performed out of the order shown or discussed, including in a substantially concurrent manner or in the reverse order, depending on the functionality involved.

The logic and/or steps represented in the flowcharts or otherwise described herein, for example, may be considered a sequenced list of executable instructions for implementing the logical functions, and may be embodied in any computer-readable medium, For use by, or in combination with, instruction execution systems, devices or devices (such as computer-based systems, systems including processors or other systems that can fetch instructions from and execute instructions from the instruction execution system, device or device) or equipment.

It should be understood that various parts of the present disclosure may be implemented in hardware, software, firmware, or combinations thereof. In the above embodiments, various steps or methods may be implemented in software or firmware stored in a memory and executed by a suitable instruction execution system. All or part of the steps of the method in the above embodiment can be completed by instructing relevant hardware through a program. The program can be stored in a computer-readable storage medium. When executed, the program includes one of the steps of the method embodiment or other steps. combination.

In addition, each functional unit in various embodiments of the present disclosure may be integrated into one processing module, each unit may exist physically alone, or two or more units may be integrated into one module. The above integrated modules can be implemented in the form of hardware or software function modules. If the above integrated module is When the software function module is implemented and sold or used as an independent product, it can also be stored in a computer-readable storage medium. The storage medium can be a read-only memory, a magnetic disk or an optical disk, etc.

The above are only specific embodiments of the present disclosure, but the protection scope of the present disclosure is not limited thereto. Any person familiar with the technical field can easily think of various changes or modifications within the technical scope of the present disclosure. alternatives, these should all be covered by the protection scope of this disclosure. Therefore, the protection scope of the present disclosure should be subject to the protection scope of the claims.

Claims

An IA robot monitoring method based on RPA and AI, including:

Identify the data information currently obtained from each virtual network console VNC server and/or the connection status of the RPA robot associated with each VNC server and the console to determine the current status of each RPA robot. operating status;

According to the current operating status of each RPA robot, the monitoring card corresponding to each RPA robot in the RPA monitoring interface is updated.
The method of claim 1, wherein the data information currently obtained from each virtual network console VNC server, and/or the connection between the RPA robot associated with each VNC server and the console Status is identified to determine the current operating status of each RPA robot, including:

In response to the natural language processing NLP result corresponding to the data information indicating the currently corresponding running screen screenshot of the associated RPA robot sent by any VNC server, it is determined that the associated RPA robot is currently in a running state; and/or,

In response to the NLP result corresponding to the connection status of the RPA robot associated with any VNC server and the console indicating that the connection is disconnected, it is determined that the RPA robot associated with any VNC server is in an offline state.
The method according to claim 1 or 2, wherein updating the monitoring card corresponding to each RPA robot in the RPA monitoring interface according to the current operating status of each RPA robot includes:

In response to any RPA robot being in a running state, update the monitoring card corresponding to any RPA robot in the RPA monitoring interface using the currently corresponding screenshot of the running screen of any RPA robot; and/or,

In response to any RPA robot being in a running timeout state, based on the current running timeout duration of any RPA robot, update the monitoring card corresponding to any RPA robot in the RPA monitoring interface; and/or,

In response to any RPA robot being offline, the monitoring card corresponding to any RPA robot in the RPA monitoring interface is updated based on the current offline duration of the any RPA robot.
The method according to any one of claims 1 to 3, further comprising:

In response to the first preset control being triggered in the RPA monitoring interface, displaying a candidate list associated with the first preset control in the RPA monitoring interface;

In response to any candidate item in the candidate list being selected, obtain the first RPA robot with the same operating status as indicated by any candidate item;

The monitoring card corresponding to the first RPA robot is displayed in the RPA monitoring interface.
The method according to any one of claims 1 to 4, further comprising:

In response to the second preset control in the RPA monitoring interface being triggered, obtain the target search term entered in the second preset control;

Determine a second RPA robot that matches the target search term;

The monitoring card corresponding to the second RPA robot is displayed in the RPA monitoring interface.
The method according to any one of claims 1 to 5, wherein, according to the data information currently obtained from each VNC server, and/or the connection between the RPA robot associated with each VNC server and the console Status, determine the current running status of each RPA robot corresponding to each VNC server, including:

In response to the third preset control in the RPA monitoring interface being triggered, based on the data information currently obtained from each VNC server, and/or the connection between the RPA robot associated with each VNC server and the console Status, determine the current running status of each RPA robot corresponding to each VNC server.
The method according to any one of claims 1 to 6, wherein after updating the monitoring card corresponding to each RPA robot in the RPA monitoring interface, it further includes:

In response to the monitoring card corresponding to any RPA robot being triggered, the operating data of the any RPA robot and/or the first attribute information of the any RPA robot is displayed on the display interface.
The method of claim 7, wherein displaying the operating data of any RPA robot and/or the first attribute information of any RPA robot on the display interface includes:

In response to the RPA robot being in a running state, display the real-time running screen of the RPA robot and/or the first attribute information on the display interface; or,

In response to the RPA robot being in an offline state, the historical operating data and/or the first attribute information of the RPA robot are displayed on the display interface.
The method of claim 8, wherein the historical running data includes at least one of the following: historical screen recording data, historical running results, historical running task names, and historical running time.
The method according to any one of claims 7 to 9, wherein after the display interface displays the operation data of any RPA robot and/or the attribute information of any RPA robot, it further includes:

In response to the fourth preset control in the display interface being triggered, start a remote control connection between the VNC server associated with any of the RPA robots; or,

In response to the fifth preset control in the display interface being triggered, a virtual input control is displayed on the display interface; or,

In response to the sixth preset control in the display interface being triggered, the number of objects currently monitoring any of the RPA robots and/or the attribute information of the objects are displayed on the display interface.
The method according to any one of claims 7 to 10, wherein the first attribute information includes at least one of the following: task name, task number, and start running time of any RPA robot.
The method according to any one of claims 1 to 11, wherein the VNC server is deployed independently from the RPA robot associated with the VNC server.
An IA robot monitoring device based on RPA and AI, including:

The determination module identifies the data information currently obtained from each VNC server and/or the connection status of the RPA robot associated with each VNC server and the console to determine the current status of each RPA robot. Operating status;

An update module is used to update the monitoring card corresponding to each RPA robot in the RPA monitoring interface according to the current operating status of each RPA robot.
The device according to claim 13, wherein the determining module is used for:

In response to the natural language processing NLP result corresponding to the data information indicating the currently corresponding running screen screenshot of the associated RPA robot sent by any VNC server, it is determined that the associated RPA robot is currently in a running state; and/or,

In response to the NLP result corresponding to the connection status of the RPA robot associated with any VNC server and the console indicating that the connection is disconnected, it is determined that the RPA robot associated with any VNC server is in an offline state.
The device according to claim 13 or 14, wherein the update module is used for:

In response to any RPA robot being in a running state, update the monitoring card corresponding to any RPA robot in the RPA monitoring interface using the currently corresponding screenshot of the running screen of any RPA robot; and/or,

In response to any RPA robot being in a running timeout state, based on the current running timeout duration of any RPA robot, update the monitoring card corresponding to any RPA robot in the RPA monitoring interface; and/or,

In response to any RPA robot being offline, the monitoring card corresponding to any RPA robot in the RPA monitoring interface is updated based on the current offline duration of the any RPA robot.
The device of any one of claims 13 to 15, further comprising:

A display module configured to display a candidate list associated with the first preset control in the RPA monitoring interface in response to the first preset control being triggered in the RPA monitoring interface;

An acquisition module, configured to, in response to any candidate item in the candidate list being selected, acquire the first RPA robot with the same operating status as indicated by any candidate item;

The display module is used to display the monitoring card corresponding to the first RPA robot in the RPA monitoring interface.
The device according to claim 13, wherein the determining module is used for:

In response to the third preset control in the RPA monitoring interface being triggered, based on the data information currently obtained from each VNC server, and/or the connection between the RPA robot associated with each VNC server and the console Status, determine the current running status of each RPA robot corresponding to each VNC server.
The device according to any one of claims 13 to 17, wherein the display module is also used for:

In response to the monitoring card corresponding to any RPA robot being triggered, the operating data of the any RPA robot and/or the first attribute information of the any RPA robot is displayed on the display interface.
A computer device includes: a processor and a memory, instructions are stored in the memory, and the instructions are loaded and executed by the processor to implement the method according to any one of claims 1 to 12.
A computer-readable storage medium. A computer program is stored in the computer-readable storage medium. When the computer program is executed by a processor, the method according to any one of claims 1 to 12 is implemented.
A computer program product comprising a computer program which, when executed by a processor, implements the method of any one of claims 1 to 12.
A computer program, comprising computer program code, when the computer program code is run on a computer, causes the computer to perform the method according to any one of claims 1 to 12.