CN113589767A - Robot process automation RPA processing method and related device - Google Patents
Robot process automation RPA processing method and related device Download PDFInfo
- Publication number
- CN113589767A CN113589767A CN202110844441.XA CN202110844441A CN113589767A CN 113589767 A CN113589767 A CN 113589767A CN 202110844441 A CN202110844441 A CN 202110844441A CN 113589767 A CN113589767 A CN 113589767A
- Authority
- CN
- China
- Prior art keywords
- rpa
- target
- video
- abnormal
- video information
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000004801 process automation Methods 0.000 title claims abstract description 21
- 238000003672 processing method Methods 0.000 title claims abstract description 14
- 230000002159 abnormal effect Effects 0.000 claims abstract description 193
- 238000000034 method Methods 0.000 claims abstract description 90
- 230000008569 process Effects 0.000 claims abstract description 50
- 238000012545 processing Methods 0.000 claims description 8
- 230000005856 abnormality Effects 0.000 description 12
- 230000009471 action Effects 0.000 description 5
- 238000010586 diagram Methods 0.000 description 3
- 230000004048 modification Effects 0.000 description 3
- 238000012986 modification Methods 0.000 description 3
- 238000005516 engineering process Methods 0.000 description 2
- 230000000903 blocking effect Effects 0.000 description 1
- 230000008859 change Effects 0.000 description 1
- 238000012217 deletion Methods 0.000 description 1
- 230000037430 deletion Effects 0.000 description 1
- 238000013461 design Methods 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 230000010354 integration Effects 0.000 description 1
- 230000003993 interaction Effects 0.000 description 1
- 230000000750 progressive effect Effects 0.000 description 1
- 238000011160 research Methods 0.000 description 1
- 230000004044 response Effects 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G05—CONTROLLING; REGULATING
- G05B—CONTROL OR REGULATING SYSTEMS IN GENERAL; FUNCTIONAL ELEMENTS OF SUCH SYSTEMS; MONITORING OR TESTING ARRANGEMENTS FOR SUCH SYSTEMS OR ELEMENTS
- G05B19/00—Programme-control systems
- G05B19/02—Programme-control systems electric
- G05B19/418—Total factory control, i.e. centrally controlling a plurality of machines, e.g. direct or distributed numerical control [DNC], flexible manufacturing systems [FMS], integrated manufacturing systems [IMS] or computer integrated manufacturing [CIM]
- G05B19/4184—Total factory control, i.e. centrally controlling a plurality of machines, e.g. direct or distributed numerical control [DNC], flexible manufacturing systems [FMS], integrated manufacturing systems [IMS] or computer integrated manufacturing [CIM] characterised by fault tolerance, reliability of production system
-
- G—PHYSICS
- G05—CONTROLLING; REGULATING
- G05B—CONTROL OR REGULATING SYSTEMS IN GENERAL; FUNCTIONAL ELEMENTS OF SUCH SYSTEMS; MONITORING OR TESTING ARRANGEMENTS FOR SUCH SYSTEMS OR ELEMENTS
- G05B2219/00—Program-control systems
- G05B2219/30—Nc systems
- G05B2219/31—From computer integrated manufacturing till monitoring
- G05B2219/31088—Network communication between supervisor and cell, machine group
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
- Y02P—CLIMATE CHANGE MITIGATION TECHNOLOGIES IN THE PRODUCTION OR PROCESSING OF GOODS
- Y02P90/00—Enabling technologies with a potential contribution to greenhouse gas [GHG] emissions mitigation
- Y02P90/02—Total factory control, e.g. smart factories, flexible manufacturing systems [FMS] or integrated manufacturing systems [IMS]
Landscapes
- Engineering & Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Manufacturing & Machinery (AREA)
- Quality & Reliability (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Automation & Control Theory (AREA)
- User Interface Of Digital Computer (AREA)
Abstract
The application discloses a robot process automation RPA processing method and a related device, wherein the method comprises the following steps: starting to collect a video corresponding to the target RPA when the target RPA is started; if abnormal operation is detected in the running process of the target RPA, recording abnormal video information corresponding to the abnormal operation; ending the collection of the video corresponding to the target RPA when the target RPA is closed; acquiring a target video corresponding to a target RPA based on the acquired video corresponding to the target RPA and the abnormal video information; and responding to the operation of backtracking the target RPA by the user, and playing the target video which displays abnormal video information on the time axis corresponding to the target RPA. The target video corresponding to the target RPA visually records abnormal operation caused by some influence reasons inside and outside the system, and the root cause of the abnormal operation of the RPA is quickly and simply determined by backtracking the video displaying abnormal video information on the time axis corresponding to the RPA.
Description
The present application claims priority from chinese patent application entitled "a robotic process automated RPA processing method and related apparatus" filed by chinese patent office, application No. 202110368895.4 on 06/04/2021, the entire contents of which are incorporated herein by reference.
Technical Field
The application relates to the technical field of computers, in particular to a Robot Process Automation (RPA) processing method and a related device.
Background
With the rapid development of the Robot Process Automation (RPA) technology, the RPA technology is more and more widely applied. The RPA is usually operated under unattended condition, and may cause the RPA to operate abnormally due to some influence reason inside or outside the system, and at this time, the root cause of the RPA operation abnormality needs to be determined and provided to the RPA service personnel.
Generally, in order to determine the root cause of the RPA running abnormality, it is necessary to record each operation into a log during the RPA running, if the RPA running abnormality occurs, the abnormal operation is also recorded in the log, and the root cause of the RPA running abnormality is determined by looking up the abnormal operation in the log.
However, the inventor finds that the log cannot record some influence reasons outside the system and abnormal operations caused by the influence reasons in real time, for example, an advertisement window randomly popped by some software blocks an operation page to cause the abnormal operations; therefore, even if the above-described manner of recording each operation into the log at the time of RPA operation is adopted, it is practically difficult to determine the root cause of the RPA operation abnormality by looking up the abnormal operation in the log.
Disclosure of Invention
In view of this, embodiments of the present application provide a robot process automation RPA method and a related apparatus, which can quickly and simply determine a root cause of an RPA operation anomaly.
In a first aspect, an embodiment of the present application provides a robot process automation RPA method, which is applied to an RPA system, and the method includes:
starting to acquire a video corresponding to a target RPA when the target RPA is started;
if abnormal operation is detected in the running process of the target RPA, recording abnormal video information corresponding to the abnormal operation;
finishing collecting the video corresponding to the target RPA when the target RPA is closed;
acquiring a target video corresponding to the target RPA based on the acquired video corresponding to the target RPA and the abnormal video information;
and responding to the operation of a user for backtracking the running process of the target RPA, playing a target video corresponding to the target RPA, and displaying the abnormal video information on the time axis of the target video.
Optionally, the abnormal video information includes an abnormal operation step and an abnormal operation time.
Optionally, the method further includes:
and responding to the operation that the user triggers the abnormal video information, and playing the video clip corresponding to the abnormal video information in the target video.
Optionally, the method further includes:
recording key video information corresponding to key operation in the target RPA in the running process of the target RPA;
correspondingly, the displaying the abnormal video information on the time axis of the target video specifically includes:
and displaying the abnormal video information and the key video information on a time axis of the target video.
Optionally, the key video information includes a key operation step and a key operation time.
Optionally, the method further includes:
writing the collected video into a local hard disk from a cache according to a preset period to obtain a video segment corresponding to the target RPA;
uploading a video segment corresponding to the target RPA in the local hard disk;
correspondingly, the obtaining of the target video corresponding to the target RPA based on the collected video corresponding to the target RPA and the abnormal video information specifically includes:
and combining the uploaded video segment corresponding to the target RPA and the abnormal video information to obtain a target video corresponding to the target RPA.
Optionally, the method further includes:
and deleting the video segment corresponding to the uploaded target RPA in the local hard disk.
In a second aspect, an embodiment of the present application provides a robot process automation RPA processing apparatus, which is applied in an RPA system, and the apparatus includes:
the starting acquisition unit is used for starting to acquire a video corresponding to a target RPA when the target RPA is started;
the abnormal recording unit is used for recording abnormal video information corresponding to abnormal operation if the abnormal operation is detected in the running process of the target RPA;
the collection ending unit is used for ending the collection of the video corresponding to the target RPA when the target RPA is closed;
the video obtaining unit is used for obtaining a target video corresponding to the target RPA based on the collected video corresponding to the target RPA and the abnormal video information;
and the video playing unit is used for responding to the operation of a user for backtracking the running process of the target RPA, playing the target video corresponding to the target RPA and displaying the abnormal video information on the time axis of the target video.
Optionally, the abnormal video information includes an abnormal operation step and an abnormal operation time.
Optionally, the apparatus further comprises:
and the segment playing unit is used for responding to the operation of triggering the abnormal video information by a user and playing the video segment corresponding to the abnormal video information in the target video.
Optionally, the apparatus further comprises:
the key recording unit is used for recording key video information corresponding to key operation in the target RPA in the running process of the target RPA;
correspondingly, the video playing unit 304 is configured to:
and responding to the operation of a user for backtracking the running process of the target RPA, playing a target video corresponding to the target RPA, and displaying the abnormal video information and the key video information on the time axis of the target video.
Optionally, the key video information includes a key operation step and a key operation time.
Optionally, the apparatus further comprises:
a segment writing unit, configured to write the acquired video from the cache to a local hard disk according to a preset period, and obtain a video segment corresponding to the target RPA;
a segment uploading unit, configured to upload a video segment corresponding to the target RPA in the local hard disk;
correspondingly, the video obtaining unit is configured to:
and combining the uploaded video segment corresponding to the target RPA and the abnormal video information to obtain a target video corresponding to the target RPA.
Optionally, the apparatus further comprises:
and the segment deleting unit is used for deleting the video segment corresponding to the uploaded target RPA in the local hard disk.
In a third aspect, an embodiment of the present application provides an apparatus for robot procedure automation RPA processing, the apparatus including a processor and a memory:
the memory is used for storing program codes and transmitting the program codes to the processor;
the processor is configured to execute the robot procedure automation RPA processing method according to any one of the first aspect above according to instructions in the program code.
In a fourth aspect, an embodiment of the present application provides a computer-readable storage medium for storing program code for executing the robot process automation RPA processing method according to any one of the first aspect.
Compared with the prior art, the method has the advantages that:
by adopting the technical scheme of the embodiment of the application, when the target RPA is started, the video corresponding to the target RPA is collected; if abnormal operation is detected in the running process of the target RPA, recording abnormal video information corresponding to the abnormal operation; ending the collection of the video corresponding to the target RPA when the target RPA is closed; acquiring a target video corresponding to a target RPA based on the acquired video corresponding to the target RPA and the abnormal video information; and responding to the operation of backtracking the target RPA by the user, playing the target video corresponding to the target RPA, and displaying abnormal video information on the time axis of the target video. Therefore, videos corresponding to each operation are collected in the operation process of the RPA, abnormal video information corresponding to the abnormal operation is recorded, the videos corresponding to the RPA can visually record abnormal operations caused by some influence reasons inside and outside the system, and the root cause of the abnormal operation of the RPA can be quickly and simply determined by backtracking the videos of the abnormal video information displayed on the time axis corresponding to the RPA.
Drawings
In order to more clearly illustrate the technical solutions of the embodiments of the present application, the drawings needed to be used in the description of the embodiments of the present application will be briefly described below, and it is obvious that the drawings in the following description are only some embodiments described in the present application, and it is obvious for those skilled in the art that other drawings can be obtained according to the drawings without creative efforts.
Fig. 1 is a schematic diagram of a system framework related to an application scenario in an embodiment of the present application;
fig. 2 is a schematic flowchart of a robot process automation RPA method according to an embodiment of the present disclosure;
fig. 3 is a schematic structural diagram of a robot process automation RPA device according to an embodiment of the present disclosure.
Detailed Description
In order to make the technical solutions of the present application better understood, the technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application, and it is obvious that the described embodiments are only a part of the embodiments of the present application, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present application.
At present, the RPA usually runs under an unattended condition, and may cause the RPA to run abnormally due to some influence reasons inside or outside the system, in order to determine that the root cause of the RPA running abnormality is provided for RPA service personnel, it is necessary to record each operation into a log during the RPA running, if the RPA runs abnormally, the abnormal operation is also recorded in the log, and the root cause of the RPA running abnormality is determined by searching the abnormal operation in the log.
However, the inventor has found through research that the log cannot record some influence reasons outside the system and abnormal operations caused by the influence reasons in real time, for example, in the running process of the RPA, some software randomly pops up an advertisement window to block an operation page of the RPA, the original "click a button (coordinates: 300, 500)" operation actually becomes the "click an advertisement window" operation due to the blocking of the advertisement window when the "click a button (coordinates: 300, 500)" operation is clicked, and subsequent operations are wrong, while the "click a button (coordinates: 300, 500)" operation recorded in the log is still not recorded as an abnormal operation, and is recorded as an abnormal operation only after a certain subsequent operation. Based on this, even if an abnormal operation is found in the log lookup, it is practically difficult to determine the root cause of the RPA running abnormality.
In order to solve the problem, in the embodiment of the application, when the target RPA is started, a video corresponding to the target RPA is collected; if abnormal operation is detected in the running process of the target RPA, recording abnormal video information corresponding to the abnormal operation; ending the collection of the video corresponding to the target RPA when the target RPA is closed; acquiring a target video corresponding to a target RPA based on the acquired video corresponding to the target RPA and the abnormal video information; and responding to the operation of backtracking the target RPA by the user, playing the target video corresponding to the target RPA, and displaying abnormal video information on the time axis of the target video. Therefore, videos corresponding to each operation are collected in the operation process of the RPA, abnormal video information corresponding to the abnormal operation is recorded, the videos corresponding to the RPA can intuitively record abnormal operation caused by some influence reasons inside and outside the system in real time, and the root cause of the RPA operation abnormality can be quickly and simply determined by backtracking the videos of the abnormal video information displayed on the time axis corresponding to the RPA.
For example, one of the scenarios in the embodiment of the present application may be applied to the scenario shown in fig. 1. The scenario includes an RPA system 100, the RPA system 100 includes an RPA client 101 and an RPA server 102, the RPA client 101 includes an RPA operator for operating an RPA, and the RPA server 102 includes an RPA controller for controlling and coordinating the RPA operator. The robot process automation RPA processing method provided by the embodiment of the present application is executed in the RPA system 100 through interaction between the RPA client 101 and the RPA server 102.
First, in the application scenario described above, although the actions of the embodiment provided in the embodiment of the present application are described as being performed by the RPA system 100; however, the embodiments of the present application are not limited in terms of executing subjects as long as the actions disclosed in the embodiments provided by the embodiments of the present application are executed.
Next, the above scenario is only one example of the scenario provided in the embodiment of the present application, and the embodiment of the present application is not limited to this scenario.
The following describes in detail a specific implementation manner of the robot process automation RPA method and related apparatus in the embodiments of the present application by way of embodiments with reference to the accompanying drawings.
Exemplary method
Referring to fig. 2, a schematic flow chart of a robot process automation RPA method in an embodiment of the present application is shown. In this embodiment, the method is applied to an RPA system, and may include the following steps:
step 201: and starting to acquire the video corresponding to the target RPA when the target RPA is started.
Due to the mode of recording each operation into the log during the operation of the RPA, some influence reasons outside the system and abnormal operations caused by the influence reasons cannot be recorded in real time, so that even if abnormal operations in the log are searched, the root cause of the abnormal operation of the RPA is difficult to determine in practice. Therefore, in the embodiment of the application, in consideration of the manner of acquiring the video corresponding to the RPA, abnormal operations caused by some influence reasons inside and outside the system can be intuitively recorded in real time, and when the target RPA is started, the video acquisition module can be started to start to acquire the video corresponding to the target RPA, that is, to start to acquire the picture displayed when the target RPA runs.
Step 202: and if abnormal operation is detected in the running process of the target RPA, recording abnormal video information corresponding to the abnormal operation.
On the basis of starting to acquire the video corresponding to the target RPA in step 201, in the running process of the target RPA, the situation that the RPA runs abnormally may occur, that is, abnormal operation is detected in the running process of the target RPA; at this time, it is also necessary to separately record the abnormal video information corresponding to the abnormal operation, so that a video segment corresponding to the abnormal operation can be found in the video corresponding to the acquired target RPA through the abnormal video information corresponding to the abnormal operation in the following.
In order to clarify the details of the abnormal operation detected during the operation of the target RPA, it is necessary to record not only the specific step of the abnormal operation, but also the occurrence time of the abnormal operation, that is, the step of the abnormal operation and the time of the abnormal operation as abnormal video information. Therefore, in an optional implementation manner of the embodiment of the present application, the abnormal video information includes an abnormal operation step and an abnormal operation time.
In addition, in the embodiment of the application, some key operations exist in the running process of the target RPA, and the key operations generally have a greater relevance with the abnormal operations, or a certain auxiliary effect is provided for subsequently determining that the root cause of the abnormal operation of the RPA is abnormal; and then, in the running process of the target RPA, independently recording key video information corresponding to the key operation, so that a video segment corresponding to the key operation can be found in the collected video corresponding to the target RPA through the key video information corresponding to the key operation in the following process. Therefore, in an optional implementation manner of the embodiment of the present application, for example, the method may further include step a: and recording key video information corresponding to key operation in the target RPA in the running process of the target RPA.
Referring to the above description of the abnormal video information, it can be similarly obtained that, in order to be able to clarify the details of the key operation in the running process of the target RPA, not only the specific step of the key operation but also the occurrence time of the key operation need to be recorded, that is, the key operation step and the key operation time need to be recorded as the key video information. Therefore, in an optional implementation manner of this embodiment of the present application, the key video information includes a key operation step and a key operation time.
Step 203: and finishing the collection of the video corresponding to the target RPA when the target RPA is closed.
Corresponding to step 201, when the target RPA is closed, the video capture module may be closed, and the capture of the video corresponding to the target RPA is finished, that is, the capture of the picture displayed when the target RPA is running is finished.
Step 204: and acquiring a target video corresponding to the target RPA based on the acquired video corresponding to the target RPA and the abnormal video information.
On the basis of the video corresponding to the target RPA acquired in steps 201 to 203 and the recorded abnormal video information corresponding to the abnormal operation, the target video corresponding to the target RPA can be obtained only by performing integration processing based on the data. The target video corresponding to the target RPA not only includes the video corresponding to the acquired target RPA, but also needs to include the recorded abnormal video information corresponding to the abnormal operation, so that the target video corresponding to the target RPA can intuitively record the abnormal operation caused by some influence reasons inside and outside the system.
In addition, in this embodiment of the application, videos corresponding to the target RPA acquired in steps 201 to 203 are stored in a cache in real time, and in order to store the acquired video corresponding to the target RPA, the acquired video corresponding to the target RPA needs to be written into a local hard disk from the cache, and uploaded to a server from the local hard disk; considering the system resources occupied by writing and uploading, the video corresponding to the target RPA can be written into the local hard disk from the cache in a segmented manner based on a certain preset period, so as to obtain a video segment corresponding to the target RPA; and uploading the video segment corresponding to the target RPA in the local hard disk to the server. Therefore, in an optional implementation manner of the embodiment of the present application, for example, the following steps may be further included:
and B: and writing the collected video into a local hard disk from a cache according to a preset period to obtain a video segment corresponding to the target RPA.
And C: and uploading the video segment corresponding to the target RPA in the local hard disk.
Correspondingly, since the video segments corresponding to the target RPA are obtained in steps B to C, in order to obtain the target video corresponding to the target RPA, the video segments corresponding to the target RPA and the abnormal video information corresponding to the abnormal operation need to be merged. The step 204 may specifically be, for example: and combining the uploaded video segment corresponding to the target RPA and the abnormal video information to obtain a target video corresponding to the target RPA.
Based on the above description, in order to save storage resources in the local hard disk, after the uploading of the video segment corresponding to the target RPA in the local hard disk is completed, the video segment corresponding to the target RPA uploaded in the local hard disk may also be deleted. Therefore, in an optional implementation manner of the embodiment of the present application, for example, the following step D may be further included: and deleting the video segment corresponding to the uploaded target RPA in the local hard disk. Specifically, after the uploading of the video segment corresponding to the target RPA in the local hard disk is completed, the deletion of the video segment corresponding to the uploaded target RPA in the local hard disk may be immediately performed; or periodically deleting the video segments corresponding to the uploaded target RPA in the local hard disk based on a certain preset period.
Step 205: and responding to the operation of a user for backtracking the running process of the target RPA, playing a target video corresponding to the target RPA, and displaying the abnormal video information on the time axis of the target video.
In the embodiment of the application, after the target video corresponding to the target RPA is obtained in step 204, in order to determine the root cause of the abnormal operation of the RPA, a user may trace back the operation process of the target RPA; and responding to the operation of the user for backtracking the target RPA running process, realizing the backtracking of the target RPA running process in a mode of playing the target video corresponding to the target RPA, wherein abnormal video information can be displayed on the time axis of the target video corresponding to the target RPA, so that the user can determine the root cause of the RPA running abnormality based on the abnormal video information.
Corresponding to the above step a, not only the abnormal video information but also the key video information can be displayed on the time axis of the target video corresponding to the target RPA in step 205. Therefore, in an optional implementation manner of the embodiment of the present application, in the step 205, the abnormal video information is displayed on a time axis of the target video, and for example, the abnormal video information may specifically be: and displaying the abnormal video information and the key video information on a time axis of the target video.
In addition, in the embodiment of the application, on the basis of displaying the abnormal video information on the time axis of the target video corresponding to the target RPA, the user can also directly trigger the abnormal video information to backtrack the abnormal operation process of the target RPA instead of backtracking the whole operation process of the target RPA; and responding to the operation that the user triggers the abnormal video information, and playing the video segment corresponding to the abnormal video information in the target video corresponding to the target RPA instead of the target video corresponding to the whole target RPA, so that the root cause of the abnormal operation of the RPA can be conveniently determined, the time consumed for determining the root cause of the abnormal operation of the RPA can be saved, and the root cause of the abnormal operation of the RPA can be further quickly and simply determined. Therefore, in an optional implementation manner of this embodiment of the present application, after the step 205, for example, a step E may further be included: and responding to the operation that the user triggers the abnormal video information, and playing the video clip corresponding to the abnormal video information in the target video.
Correspondingly to the step a, the same can be obtained, in an alternative implementation manner of the embodiment of the present application, after the step 205, for example, the method may further include the step F: and responding to the operation that a user triggers the key video information, and playing a video clip corresponding to the key video information in the target video.
Through various implementation manners provided by the embodiment, when the target RPA is started, a video corresponding to the target RPA is collected; if abnormal operation is detected in the running process of the target RPA, recording abnormal video information corresponding to the abnormal operation; ending the collection of the video corresponding to the target RPA when the target RPA is closed; acquiring a target video corresponding to a target RPA based on the acquired video corresponding to the target RPA and the abnormal video information; and responding to the operation of backtracking the target RPA by the user, playing the target video corresponding to the target RPA, and displaying abnormal video information on the time axis of the target video. Therefore, videos corresponding to each operation are collected in the operation process of the RPA, abnormal video information corresponding to the abnormal operation is recorded, the videos corresponding to the RPA can intuitively record abnormal operation caused by some influence reasons inside and outside the system in real time, and the root cause of the RPA operation abnormality can be quickly and simply determined by backtracking the videos of the abnormal video information displayed on the time axis corresponding to the RPA.
Exemplary devices
Corresponding to the robot flow automatic RPA processing method, the embodiment of the application provides a robot flow automatic RPA processing device.
Referring to fig. 3, a schematic structural diagram of a robot process automation RPA processing apparatus in an embodiment of the present application is shown. In this embodiment, the apparatus is applied to an RPA system, and may specifically include:
a start collecting unit 301, configured to start collecting a video corresponding to a target RPA when the target RPA is started;
an exception recording unit 302, configured to record, if an exception operation is detected in the running process of the target RPA, exception video information corresponding to the exception operation;
the ending acquisition unit 303 is configured to end acquisition of a video corresponding to the target RPA when the target RPA is closed;
a video obtaining unit 304, configured to obtain a target video corresponding to the target RPA based on the collected video corresponding to the target RPA and the abnormal video information;
the backtracking playing unit 305 is configured to play a target video corresponding to the target RPA in response to an operation of a user backtracking the running process of the target RPA, and display the abnormal video information on a time axis of the target video.
In an optional implementation manner of the embodiment of the present application, the abnormal video information includes an abnormal operation step and an abnormal operation time.
In an optional implementation manner of the embodiment of the present application, the apparatus further includes:
and the segment playing unit is used for responding to the operation of triggering the abnormal video information by a user and playing the video segment corresponding to the abnormal video information in the target video.
In an optional implementation manner of the embodiment of the present application, the apparatus further includes:
the key recording unit is used for recording key video information corresponding to key operation in the target RPA in the running process of the target RPA;
correspondingly, the video playing unit 304 is configured to:
and responding to the operation of a user for backtracking the running process of the target RPA, playing a target video corresponding to the target RPA, and displaying the abnormal video information and the key video information on the time axis of the target video.
In an optional implementation manner of the embodiment of the present application, the key video information includes a key operation step and a key operation time.
In an optional implementation manner of the embodiment of the present application, the apparatus further includes:
a segment writing unit, configured to write the acquired video from the cache to a local hard disk according to a preset period, and obtain a video segment corresponding to the target RPA;
a segment uploading unit, configured to upload a video segment corresponding to the target RPA in the local hard disk;
correspondingly, the video obtaining unit is configured to:
and combining the uploaded video segment corresponding to the target RPA and the abnormal video information to obtain a target video corresponding to the target RPA.
In an optional implementation manner of the embodiment of the present application, the apparatus further includes:
and the segment deleting unit is used for deleting the video segment corresponding to the uploaded target RPA in the local hard disk.
Through various implementation manners provided by the embodiment, when the target RPA is started, a video corresponding to the target RPA is collected; if abnormal operation is detected in the running process of the target RPA, recording abnormal video information corresponding to the abnormal operation; ending the collection of the video corresponding to the target RPA when the target RPA is closed; acquiring a target video corresponding to a target RPA based on the acquired video corresponding to the target RPA and the abnormal video information; and responding to the operation of backtracking the target RPA by the user, playing the target video corresponding to the target RPA, and displaying abnormal video information on the time axis of the target video. Therefore, videos corresponding to each operation are collected in the operation process of the RPA, abnormal video information corresponding to the abnormal operation is recorded, the videos corresponding to the RPA can intuitively record abnormal operation caused by some influence reasons inside and outside the system in real time, and the root cause of the RPA operation abnormality can be quickly and simply determined by backtracking the videos of the abnormal video information displayed on the time axis corresponding to the RPA.
In addition, the embodiment of the present application further provides an apparatus for robot process automation RPA processing, where the apparatus includes a processor and a memory:
the memory is used for storing program codes and transmitting the program codes to the processor;
the processor is used for executing a Robot Process Automation (RPA) processing method according to instructions in the program codes, and comprises the following steps:
starting to acquire a video corresponding to a target RPA when the target RPA is started;
if abnormal operation is detected in the running process of the target RPA, recording abnormal video information corresponding to the abnormal operation;
finishing collecting the video corresponding to the target RPA when the target RPA is closed;
acquiring a target video corresponding to the target RPA based on the acquired video corresponding to the target RPA and the abnormal video information;
and responding to the operation of a user for backtracking the running process of the target RPA, playing a target video corresponding to the target RPA, and displaying the abnormal video information on the time axis of the target video.
In an optional implementation manner of the embodiment of the present application, the abnormal video information includes an abnormal operation step and an abnormal operation time.
In an optional implementation manner of the embodiment of the present application, the method further includes:
and responding to the operation that the user triggers the abnormal video information, and playing the video clip corresponding to the abnormal video information in the target video.
In an optional implementation manner of the embodiment of the present application, the method further includes:
recording key video information corresponding to key operation in the target RPA in the running process of the target RPA;
correspondingly, the displaying the abnormal video information on the time axis of the target video specifically includes:
and displaying the abnormal video information and the key video information on a time axis of the target video.
In an optional implementation manner of the embodiment of the present application, the key video information includes a key operation step and a key operation time.
In an optional implementation manner of the embodiment of the present application, the method further includes:
writing the collected video into a local hard disk from a cache according to a preset period to obtain a video segment corresponding to the target RPA;
uploading a video segment corresponding to the target RPA in the local hard disk;
correspondingly, the obtaining of the target video corresponding to the target RPA based on the collected video corresponding to the target RPA and the abnormal video information specifically includes:
and combining the uploaded video segment corresponding to the target RPA and the abnormal video information to obtain a target video corresponding to the target RPA.
In an optional implementation manner of the embodiment of the present application, the method further includes:
and deleting the video segment corresponding to the uploaded target RPA in the local hard disk.
An embodiment of the present application further provides a computer-readable storage medium for storing a program code, where the program code is configured to execute a robot process automation RPA processing method, and the method includes:
starting to acquire a video corresponding to a target RPA when the target RPA is started;
if abnormal operation is detected in the running process of the target RPA, recording abnormal video information corresponding to the abnormal operation;
finishing collecting the video corresponding to the target RPA when the target RPA is closed;
acquiring a target video corresponding to the target RPA based on the acquired video corresponding to the target RPA and the abnormal video information;
and responding to the operation of a user for backtracking the running process of the target RPA, playing a target video corresponding to the target RPA, and displaying the abnormal video information on the time axis of the target video.
In an optional implementation manner of the embodiment of the present application, the abnormal video information includes an abnormal operation step and an abnormal operation time.
In an optional implementation manner of the embodiment of the present application, the method further includes:
and responding to the operation that the user triggers the abnormal video information, and playing the video clip corresponding to the abnormal video information in the target video.
In an optional implementation manner of the embodiment of the present application, the method further includes:
recording key video information corresponding to key operation in the target RPA in the running process of the target RPA;
correspondingly, the displaying the abnormal video information on the time axis of the target video specifically includes:
and displaying the abnormal video information and the key video information on a time axis of the target video.
In an optional implementation manner of the embodiment of the present application, the key video information includes a key operation step and a key operation time.
In an optional implementation manner of the embodiment of the present application, the method further includes:
writing the collected video into a local hard disk from a cache according to a preset period to obtain a video segment corresponding to the target RPA;
uploading a video segment corresponding to the target RPA in the local hard disk;
correspondingly, the obtaining of the target video corresponding to the target RPA based on the collected video corresponding to the target RPA and the abnormal video information specifically includes:
and combining the uploaded video segment corresponding to the target RPA and the abnormal video information to obtain a target video corresponding to the target RPA.
In an optional implementation manner of the embodiment of the present application, the method further includes:
and deleting the video segment corresponding to the uploaded target RPA in the local hard disk.
The embodiments in the present description are described in a progressive manner, each embodiment focuses on differences from other embodiments, and the same and similar parts among the embodiments are referred to each other. For the embodiment disclosing device, the description is relatively simple because the embodiment disclosing device corresponds to the embodiment disclosing method, and the relevant part can be referred to the method part for description.
Those of skill would further appreciate that the various illustrative elements and algorithm steps described in connection with the embodiments disclosed herein may be implemented as electronic hardware, computer software, or combinations of both, and that the various illustrative components and steps have been described above generally in terms of their functionality in order to clearly illustrate this interchangeability of hardware and software. Whether such functionality is implemented as hardware or software depends upon the particular application and design constraints imposed on the implementation. Skilled artisans may implement the described functionality in varying ways for each particular application, but such implementation decisions should not be interpreted as causing a departure from the scope of the present application.
It is noted that, herein, relational terms such as first and second, and the like may be used solely to distinguish one entity or action from another entity or action without necessarily requiring or implying any actual such relationship or order between such entities or actions. The terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other identical elements in a process, method, article, or apparatus that comprises the element.
The foregoing is merely a preferred embodiment of the present application and is not intended to limit the present application in any way. Although the present application has been described with reference to the preferred embodiments, it is not intended to limit the present application. Those skilled in the art can now make numerous changes and modifications to the disclosed embodiments, or modify equivalent embodiments, without departing from the scope of the claimed embodiments, utilizing the teachings and teachings set forth above. Therefore, any simple modification, equivalent change and modification made to the above embodiments according to the technical essence of the present application still fall within the protection scope of the technical solution of the present application without departing from the content of the technical solution of the present application.
Claims (10)
1. A robot process automation RPA processing method is applied to an RPA system and comprises the following steps:
starting to acquire a video corresponding to a target RPA when the target RPA is started;
if abnormal operation is detected in the running process of the target RPA, recording abnormal video information corresponding to the abnormal operation;
finishing collecting the video corresponding to the target RPA when the target RPA is closed;
acquiring a target video corresponding to the target RPA based on the acquired video corresponding to the target RPA and the abnormal video information;
and responding to the operation of a user for backtracking the running process of the target RPA, playing a target video corresponding to the target RPA, and displaying the abnormal video information on the time axis of the target video.
2. The method of claim 1, wherein the abnormal video information comprises an abnormal operation step and an abnormal operation time.
3. The method of claim 1, further comprising:
and responding to the operation that the user triggers the abnormal video information, and playing the video clip corresponding to the abnormal video information in the target video.
4. The method of claim 1, further comprising:
recording key video information corresponding to key operation in the target RPA in the running process of the target RPA;
correspondingly, the displaying the abnormal video information on the time axis of the target video specifically includes:
and displaying the abnormal video information and the key video information on a time axis of the target video.
5. The method of claim 1, wherein the key video information comprises key operation steps and key operation times.
6. The method of claim 1, further comprising:
writing the collected video into a local hard disk from a cache according to a preset period to obtain a video segment corresponding to the target RPA;
uploading a video segment corresponding to the target RPA in the local hard disk;
correspondingly, the obtaining of the target video corresponding to the target RPA based on the collected video corresponding to the target RPA and the abnormal video information specifically includes:
and combining the uploaded video segment corresponding to the target RPA and the abnormal video information to obtain a target video corresponding to the target RPA.
7. The method of claim 6, further comprising:
and deleting the video segment corresponding to the uploaded target RPA in the local hard disk.
8. The utility model provides a robot process automation RPA processing apparatus which is characterized in that, is applied to the RPA system, includes:
the starting acquisition unit is used for starting to acquire a video corresponding to a target RPA when the target RPA is started;
the abnormal recording unit is used for recording abnormal video information corresponding to abnormal operation if the abnormal operation is detected in the running process of the target RPA;
the collection ending unit is used for ending the collection of the video corresponding to the target RPA when the target RPA is closed;
the video obtaining unit is used for obtaining a target video corresponding to the target RPA based on the collected video corresponding to the target RPA and the abnormal video information;
and the video playing unit is used for responding to the operation of a user for backtracking the running process of the target RPA, playing the target video corresponding to the target RPA and displaying the abnormal video information on the time axis of the target video.
9. An apparatus for Robotic Process Automation (RPA) processing, the apparatus comprising a processor and a memory:
the memory is used for storing program codes and transmitting the program codes to the processor;
the processor is configured to execute the robotic procedure automation RPA processing method of any one of claims 1-7 in accordance with instructions in the program code.
10. A computer-readable storage medium, wherein the computer-readable storage medium is configured to store program code for performing the robotic procedure automation RPA processing method of any of claims 1-7.
Applications Claiming Priority (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN2021103688954 | 2021-04-06 | ||
| CN202110368895 | 2021-04-06 |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN113589767A true CN113589767A (en) | 2021-11-02 |
Family
ID=78249965
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202110844441.XA Pending CN113589767A (en) | 2021-04-06 | 2021-07-26 | Robot process automation RPA processing method and related device |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN113589767A (en) |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114661459A (en) * | 2022-01-19 | 2022-06-24 | 浙江网商银行股份有限公司 | Operation method, device and system of robot process automation RPA and electronic equipment |
| CN114915807A (en) * | 2022-07-14 | 2022-08-16 | 飞狐信息技术（天津）有限公司 | Information processing method and device |
| CN116185881A (en) * | 2023-04-27 | 2023-05-30 | 杭州城市大数据运营有限公司 | Source system page change detection positioning method, device, equipment and storage medium |
Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110617965A (en) * | 2019-04-26 | 2019-12-27 | 深圳市豪视智能科技有限公司 | Method for detecting gear set abnormality and related product |
| US20200026263A1 (en) * | 2018-07-17 | 2020-01-23 | Accenture Global Solutions Limited | Smart resource manager in unified automation platforms for robotic process automation |
| CN111209438A (en) * | 2020-01-14 | 2020-05-29 | 上海摩象网络科技有限公司 | Video processing method, device, equipment and computer storage medium |
| CN112182655A (en) * | 2020-10-13 | 2021-01-05 | 深圳壹账通智能科技有限公司 | Data interaction method among multiple devices and related devices |
| CN112423135A (en) * | 2020-09-18 | 2021-02-26 | 苏宁云计算有限公司 | Information processing method and device for video playback, computer equipment and storage medium |
| CN112464623A (en) * | 2020-11-24 | 2021-03-09 | 金蝶软件（中国）有限公司 | RPA flow file generation method and device, computer equipment and storage medium |
| CN112581444A (en) * | 2020-12-15 | 2021-03-30 | 中国建设银行股份有限公司 | Anomaly detection method, device and equipment |
-
2021
- 2021-07-26 CN CN202110844441.XA patent/CN113589767A/en active Pending
Patent Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20200026263A1 (en) * | 2018-07-17 | 2020-01-23 | Accenture Global Solutions Limited | Smart resource manager in unified automation platforms for robotic process automation |
| CN110617965A (en) * | 2019-04-26 | 2019-12-27 | 深圳市豪视智能科技有限公司 | Method for detecting gear set abnormality and related product |
| CN111209438A (en) * | 2020-01-14 | 2020-05-29 | 上海摩象网络科技有限公司 | Video processing method, device, equipment and computer storage medium |
| CN112423135A (en) * | 2020-09-18 | 2021-02-26 | 苏宁云计算有限公司 | Information processing method and device for video playback, computer equipment and storage medium |
| CN112182655A (en) * | 2020-10-13 | 2021-01-05 | 深圳壹账通智能科技有限公司 | Data interaction method among multiple devices and related devices |
| CN112464623A (en) * | 2020-11-24 | 2021-03-09 | 金蝶软件（中国）有限公司 | RPA flow file generation method and device, computer equipment and storage medium |
| CN112581444A (en) * | 2020-12-15 | 2021-03-30 | 中国建设银行股份有限公司 | Anomaly detection method, device and equipment |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114661459A (en) * | 2022-01-19 | 2022-06-24 | 浙江网商银行股份有限公司 | Operation method, device and system of robot process automation RPA and electronic equipment |
| CN114915807A (en) * | 2022-07-14 | 2022-08-16 | 飞狐信息技术（天津）有限公司 | Information processing method and device |
| CN116185881A (en) * | 2023-04-27 | 2023-05-30 | 杭州城市大数据运营有限公司 | Source system page change detection positioning method, device, equipment and storage medium |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN113589767A (en) | Robot process automation RPA processing method and related device | |
| EP2717564B1 (en) | Method, device and system for realizing video retrieval | |
| US7292961B2 (en) | Capturing session activity as in-memory snapshots using a time-based sampling technique within a database for performance tuning and problem diagnosis | |
| US8116179B2 (en) | Simultaneous viewing of multiple tool execution results | |
| US8086904B2 (en) | Event-based setting of process tracing scope | |
| US7802233B2 (en) | Automated display of trace historical data | |
| EP2801943A1 (en) | A system and method for generating a chronological timesheet | |
| KR20060128022A (en) | Automated system and method for conducting usability testing | |
| CN112423135B (en) | Information processing method, apparatus, computer device and storage medium for video playback | |
| CN105144117B (en) | To the automatic correlation analysis method of allocating stack and context data | |
| US8930911B2 (en) | Execution difference identification tool | |
| CN108600779B (en) | Target object operation method and device based on video content | |
| JP4350137B2 (en) | Terminal monitoring method, terminal monitoring apparatus, and terminal monitoring program | |
| CN110659435A (en) | Page data acquisition processing method and device, computer equipment and storage medium | |
| CN113824987A (en) | Method, medium, device and computing equipment for determining time consumption of first frame of live broadcast room | |
| CN108647284B (en) | Method and device for recording user behavior, medium and computing equipment | |
| CN111757037B (en) | Video file reading and writing method and device | |
| US7500145B2 (en) | Anomaly-driven software switch to capture event responses and automate recovery | |
| CN113505015B (en) | Application anomaly information acquisition method, device, computer equipment and storage medium | |
| US20230142311A1 (en) | Method and apparatus for monitoring usage of at least one application executed within an operating system | |
| JP2022043130A5 (en) | ||
| CN110990239A (en) | System and method for collecting user data in user equipment based on soft sensor | |
| US20160119200A1 (en) | Systems and methods for providing user analytics | |
| WO2021036599A1 (en) | Method and apparatus for testing set top box, set top box, and computer-readable storage medium | |
| JP6887131B2 (en) | Playback device, playback method and playback program |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |