KR20200082801A - System and Method for Robot Process Automation - Google Patents

Abstract

The present invention relates to a system for robot process automation and a method thereof. According to an aspect of the present invention, the system for robot process automation comprises: at least one process setting device for setting a task consisting of at least one event and a process consisting of at least one task and generating a task automation script for performing the task and a process automation script for performing the process; at least one process execution device for executing the at least one event constituting the task to execute the task automation script and the process automation script; a process management device for managing execution of the task automation script and the process automation script with respect to the at least one process execution device; and at least one process control device for interlocking with the at least one process execution device to control execution of a process and a task automation script of the corresponding process execution device.

Description

Robot Process Automation System and Method {System and Method for Robot Process Automation}

The present invention relates to a robot process automation system and method, and more particularly, to a robot process automation system and method for automatically executing and processing a user's task.

With the development of information and communication technology, the task of processing using a computer (hereinafter referred to as "computing task") has increased significantly, and the task of repeatedly processing in a certain pattern using a computer has also increased.

Accordingly, in the case of a somewhat standardized task, there is a high demand for an automatic processing system capable of automatically processing a user even if the user is not involved.

However, in the case of the prior art, it was the level of a macro program capable of executing only a very simple task, and thus could not satisfy the user's needs. In particular, if the user's computing environment is slightly different, the user's work is not executed properly. There was a problem that could not reach the level that can be automatically processed.

In addition, in the case of the prior art, in order to automatically perform the user's business processing, the execution order, location, and method must be set in detail. In the case of a general user, it is difficult to set perfectly without errors because there is no expert knowledge. .

Korean Registered Patent Publication No. 10-1915802

The present invention has been devised to meet the above-described needs, and an object of the present invention is to provide a robot process automation system and method for automatically executing and processing a user's computing task.

Another object of the present invention is to provide a robot process automation system and method for generating an automation script for a user's computing task and automatically executing it according to a user request and/or a preset condition.

Another object of the present invention is to provide a robot process automation system and method for executing an automation script by reflecting this when the computing environment is changed.

Another object of the present invention is to provide a robot process automation system and method that allows a user to easily control a remote process execution device by accessing a process management device through a process control device.

Another object of the present invention is to provide a robot process automation system and method for recording a behavior pattern in which a user executes a process and a task and generating a process automation script and a task automation script based on the recorded data.

Another object of the present invention is to provide a robot process automation system and method for implementing a plurality of events as one integrated event, a plurality of tasks as one integrated task, and implementing a plurality of processes as one integrated process. .

Another object of the present invention is to provide a robotic process automation system and method for easily extracting a desired character and/or character string from a document image using template information for a document to be subjected to optical character reading.

For this purpose, the robot process automation system according to one embodiment of the present invention sets a task composed of at least one event and a process composed of at least one task, and performs a task automation script and the process for performing the task At least one process setting device for generating a process automation script; At least one process execution device that executes at least one event constituting the task to execute the task automation script and the process automation script; A process management device that manages execution of the task automation script and the process automation script for the at least one process execution device; And at least one process control device interlocked with the at least one process execution device and controlling execution of processes and task automation scripts of the corresponding process execution device.

Preferably, the at least one process control device corresponds to each of the at least one process execution device, and the command processing unit of the process control device commands the execution of the process automation script and the task automation script, and the process execution device The command processing unit executes the process automation script and task automation script.

Preferably, the process control device includes a script management unit that provides a process automation script and a task automation script processed by the at least one process execution device to the process execution device; And a command processing unit instructing execution of the process automation script and the task automation script to each command processing unit of the at least one process execution device.

Preferably, the process management device manages the process automation script and the task automation script generated in the at least one process setting device, and transmits the process automation script and the task automation script to the process execution device.

Preferably, the process setting device includes: a process setting unit capable of setting a process composed of one or more tasks; A task setting unit capable of setting a task composed of one or more events; And a script generator for generating a process automation script for performing the process and a task automation script for performing the task.

Preferably, the process execution apparatus comprises: a script execution unit for executing at least one of a process automation script for performing a process consisting of one or more tasks and a task automation script for performing a task consisting of one or more events; And at least one of an image object detection event, a web object detection event, a user interface (UI) object detection event, an optical character reader (OCR) detection event, a system event, and a user event, according to an event execution request of the script execution unit. It includes an event execution unit for executing.

Preferably, the process management device includes: a device management unit that manages one or more process execution devices; A script management unit managing a process automation script performing a process consisting of one or more tasks and a task automation script performing a task consisting of one or more events; And a command processor for transmitting the process automation script and the task automation script to the one or more process execution devices and instructing execution.

According to the present invention, by setting a task composed of one or more tasks and one or more events for a user's computing task, and generating and executing a process automation script for performing the process and a task automation script for performing the task It has the effect of automatically executing and processing the user's computing tasks.

And, according to the present invention, even when the computing environment is changed, the process execution device reflects this and executes the process/task automation script to smoothly perform the user's computing task without error without being affected by the computing environment or conditions. It has an effect.

Further, according to the present invention, it is possible to request and execute a desired process/task automation script for a number of process/task automation scripts stored in the process management device as well as process/task automation scripts existing in the process execution device.

Further, according to the present invention, it is possible to execute a process/task automation script on a remote process execution device through a process management device as well as a process execution device directly linked to the process control device.

In addition, according to the present invention, a user can record process/task recording data by recording a behavior pattern of executing processes and tasks, and generate and execute process automation scripts and task automation scripts based on the process/task recording data. Therefore, even if the user does not directly set the process and task, it has an effect that the user's computing task can be easily executed.

Further, according to the present invention, a plurality of events sequentially executed among one or more events constituting a task are implemented and executed as one integrated event, thereby having an effect of easily and quickly executing the task.

In addition, according to the present invention, for a document to be subjected to optical character reading, set template information including document form information, document alignment information, area location information, area attribute information, and the like, and use the desired character in the document image and / Or, because it extracts a string, it has the effect of automatically and accurately extracting the information the user wants.

1 is a configuration diagram of a robot process automation system according to an embodiment of the present invention.
2 illustrates a process setting method according to an embodiment of the present invention.
3 shows a task setting method according to an embodiment of the present invention.
4 shows a task setting method according to another embodiment of the present invention.
5 illustrates that a script execution unit executes a task according to an embodiment of the present invention.
6 is a block diagram of an event execution unit according to an embodiment of the present invention.
7 is a block diagram of an OCR manager according to an embodiment of the present invention.
8 is a flowchart of an optical character reading method according to an embodiment of the present invention.
9 is a diagram illustrating a template editor provided by the template setting means according to an embodiment of the present invention.
10 is a flowchart of a robot process automation method according to an embodiment of the present invention.
11 is a flowchart of a robot process automation method according to another embodiment of the present invention.
12 is a flowchart of a robot process automation method according to another embodiment of the present invention.

Hereinafter, the present invention will be described in detail with reference to the accompanying drawings and preferred embodiments. For reference, in the following description, detailed descriptions of well-known functions and configurations that may unnecessarily obscure the subject matter of the present invention are omitted.

1 is a configuration diagram of a robot process automation system according to an embodiment of the present invention.

Referring to Figure 1, the robot process automation system according to an embodiment of the present invention at least one process setting device (100-1, ..., 100-m), at least one process execution device (200-1, ..., 200-n), a process management device 300, at least one process control device 400-1, ..., 400-n.

For reference, in the case of a robot process automation system according to an embodiment of the present invention, the process management device 300 includes at least one process setting device (100-1, ..., 100-m) (hereinafter, reference numeral 100) Collectively) and at least one process execution device (200-1, ..., 200-n), and at least one process execution device (200-1, ..., 200-n) (hereinafter referred to as Reference numeral 200) and at least one process control device 400-1, ..., 400-n (hereinafter referred to as reference number 400) are interlocked one to one, respectively, to control one process. The structure 400 controls one process execution device 200.

First, the process setting device 100 is a device that allows a user to create an automated script for a repetitive or standardized computing task. The process setting device 100 provides an editor capable of producing an automated script that executes a computing task to the user, and the user specifically defines a process, task, event, etc. through the editor. When set to, debugging is generated for this to generate an automated script, and it is transmitted to the process execution device 200 and/or the process management device 300 so that the automation script can be actually executed.

For reference, in the present invention, the term'event' refers to an event that a user performs an arbitrary action on an object or a system (eg, OS) generates regardless of the user's will. Examples include, window object detection, web object detection, UI (User Interface) entity detection, image detection, OCR (Optical Character Reader) detection, key input, and mouse input. And,'task (task)' refers to a unit execution operation of a user composed of one or more events, and'process (process)' refers to a unit computing task of a user composed of one or more tasks.

According to an embodiment of the present invention, the process setting device 100 includes a process setting unit 110, a task setting unit 120, a script generation unit 130, and the like.

The process setting unit 110 provides a user with a function to set and edit a process. For example, the process setting unit 110 provides a process editor for setting and editing a process to the user, and the user creates or selects one or more tasks through the process editor and sets properties, execution conditions, and execution order for the process editor. Decide to set up the process. To this end, the process editor may include a task creation manager that manages the creation of one or more tasks, a task property manager that manages the properties of one or more tasks, a task connection manager that manages the interconnection of one or more tasks, and the like.

In this regard, Figure 2 shows a process setting method according to an embodiment of the present invention.

Referring to FIG. 2, a user creates one or more tasks through a process editor provided by the process setting unit 110 and sets their properties, execution conditions, and execution order. The attribute of the task can be at least one of the name of the task, input data, input method, output data, output method, processing time, and delay time, and the execution condition is executed when the preset predecessor task ends, and the preset input data When is received, it may be at least one of execution, and execution at a preset execution time. And, in the execution order, each task is continuously input and output, and a plurality of tasks are interconnected, so that one process can be created.

For example, the business (process) of creating a customer list insured by an insurance company, for example, the user creates a first task to identify the applicant, a second task to extract customer information, and a third task to create a customer list to create attributes Set execution conditions, etc., and connect these tasks with arrows to determine the execution order. For reference, FIG. 2 illustrates a case where tasks are sequentially performed in one direction, but it is also possible to implement in a form including branching, iterative execution, error handling, etc. according to conditions.

The task setting unit 120 provides a user with a function to set and edit tasks. For example, the task setting unit 120 provides a task editor for setting and editing a task to the user, and the user creates or selects one or more events through the task editor and sets properties, execution conditions, and execution order for the task editor. Decide to set up the task. To this end, the task editor may include an event creation manager that manages the generation of one or more events, an event property manager that manages the properties of one or more events, an event connection manager that manages the interconnection of one or more events, and the like.

In this regard, Figure 3 shows a task setting method according to an embodiment of the present invention.

Referring to FIG. 3, a user generates one or more events through a task editor provided by the task setting unit 120 and sets their properties, execution conditions, and execution order. The attributes of the event are the name of the event, the object (eg text, image, object, file), execution method (eg object detection, key input, mouse input), execution result (eg simple execution, text storage, image storage, File creation), and at least one of execution time, and the execution condition is executed when a predetermined preceding event ends, execution after a predetermined time elapses when the predetermined preceding event ends, and at least one of execution at a predetermined execution time Can be And, in the execution order, each event is continuously input and output, and a plurality of events are interconnected to generate a single task.

As an example of the second task of extracting customer information during the task (process) of creating a list of customers who are insured by the above-mentioned insurance company, the user may use the first event to detect the customer folder image on the desktop, or the detected customer folder. The second event to click the mouse for the third event, the third event to click the mouse for the customer file stored in the customer folder, the fourth event to copy the text if the customer file is a text file, if the customer file is an image file In case of generating the fifth event to OCR the image, the sixth event to extract text from the OCR detected result, and the seventh event to extract customer information for the text that is the result of the fourth or sixth event to generate attributes, execution conditions Set each, etc., and connect these events with arrows to determine the execution order. For reference, in FIG. 3, key events are mainly listed to facilitate the description, but in actual implementation, more detailed events may be further included.

On the other hand, Figure 4 shows a task setting method according to another embodiment of the present invention.

Referring to FIG. 4 compared to FIG. 3, in FIG. 4, the first event in FIG. 3 (the event that detects the customer folder image on the desktop), the second event (the event that clicks the mouse on the detected customer folder), And the third event (the event of clicking the mouse with respect to the customer file stored in the customer folder) is integrated into one, and the rest of the fourth to seventh events are the same. That is, in the present invention, a plurality of events sequentially executed among events constituting a task may be set as one integrated event, and a plurality of tasks sequentially executed among tasks constituting a process may be set as one integrated task. Can. And, it can be applied to extend to the process, it is possible to set a plurality of processes that are sequentially executed as one integrated process.

On the other hand, according to a preferred embodiment of the present invention, the process setting unit 110 and the task setting unit 120 record the process recording data and the task recording data (for reference, computing by recording a behavior pattern in which the user executes the process and the task) Environment information is reflected), and attributes of processes and tasks, execution conditions, and execution order can be extracted based on the process/task recording data.

As an example of the second task of extracting customer information during the task (process) of creating a list of customers insured by the aforementioned insurance company, the user selects recording for the second task in the task setting unit 120 and actually removes the second task. 2 Perform the task. That is, the user actually detects the customer folder image on the desktop under the current computing environment (first event), clicks the mouse on the detected customer folder (second event), and stores the customer file stored in the customer folder. When clicking on the mouse (3rd event) to open the customer file, the task setting unit 120 records this process. Then, if the customer file is a text file, and the user copies the text (4th event) and extracts customer information for the text (7th event), the task setting unit 120 similarly records this process. On the other hand, if the customer file is an image file, the user performs OCR detection on the image (the fifth event), extracts the text from the result of the OCR detection (the sixth event), and then extracts the customer information on the extracted text. (Seventh event), the task setting unit 120 similarly records this process. Then, when the recording is completed, the task setting unit 120 extracts the attributes, execution conditions, execution order, etc. of the events constituting the second task based on the recorded data, and computes the second task when the second task is executed. Extracts environmental information (screen resolution, screen layout, screen size, etc.). For reference, a behavior pattern of a user executing a process/task and recording thereof may be completed in one execution when there are no special conditions or branches (see FIG. 2), and when there are conditions or branches (FIG. 3) can be completed by executing the number of times corresponding to the number of each case.

Referring back to FIG. 1, the script generation unit 130 generates an automation script so that processes and tasks set by the user through the process setting unit 110 and the task setting unit 120 can be automatically executed. For example, the script generation unit 130 generates a process automation script that performs a process set by the process setting unit 110, and similarly generates a task automation script that performs a task set by the task setting unit 120. In addition, the script generator 130 verifies and debugs one or more events constituting a task in connection with the process execution device 200 (more specifically, the event execution unit 220) to operate normally in an actual execution order. Debugging by verifying that one or more tasks constituting the process can operate normally in the actual execution order.

In addition, the script generation unit 130 transmits the thus generated process automation script and task automation script to the process execution device 200 (more specifically, the script execution unit 210) for actual execution, and also reuses them later. And a process management device 300 (more specifically, the first script management unit 320) for management.

The process execution device 200 is a device that automatically executes an automation script generated by the process setting device 100 to automatically process a user's computing task. The process execution device 200 receives the process automation script and the task automation script from the at least one process setting device 100 and/or the process management device 300, and the process management device 300 and/or the process control device ( When an execution command is received from 400), a process/task automation script is executed to process a user's computing task. In addition, the process execution device 200 interlocks them between the process management device 300 and the process control device 400 so that the process control device 400 controls the remote process execution device through the process management device 300. To do it.

To this end, the process execution apparatus 200 according to an embodiment of the present invention includes a script execution unit 210, an event execution unit 220, a first command processing unit 230, a security management unit 240, and a log management unit 250 ) And the like.

The script execution unit 210 executes the process/task automation script transmitted from the process setting device 100 and/or the process management device 300. For example, the script execution unit 210 analyzes the process/task automation script to determine attributes, execution conditions, priorities, etc. for each event, task, process, and schedules the execution order. Then, the script execution unit 210 interlocks with the event execution unit 220 to sequentially execute each event according to the execution order to execute the task, and also executes each task sequentially according to the execution order to execute the process. do.

In this regard, FIG. 5 illustrates that the script execution unit 210 executes a task according to an embodiment of the present invention. For reference, FIG. 5 is a script execution unit 210 of a task automation script generated by recording a second task in which a user extracts customer information during a task (process) of creating a customer list insured by the above-mentioned insurance company. An example of automatically executing in conjunction with the event execution unit 220 is illustrated.

Referring to FIG. 5, first, the script execution unit 210 executes a system setting event to adjust the current computing environment (screen resolution, screen layout, screen size, etc.) by referring to the computing environment information at the time of recording. For reference, when the current computing environment is the same as the computing environment at the time of recording, the system setting event is omitted.

Then, the script execution unit 210 executes a first event that detects a customer folder image on the desktop, executes a second event that clicks a mouse on the detected customer folder, and then stores the customer stored in the customer folder. Fire a third event that clicks the mouse on the file. Then, if the customer file is a text file, the script execution unit 210 executes a fourth event for copying the text in the customer file, and executes a seventh event for extracting customer information for the text. On the other hand, if the customer file is an image file, the script execution unit 210 executes a fifth event for performing OCR detection on the image, and after executing a sixth event for extracting text from the OCR detected result, The seventh event for extracting customer information is executed for the extracted text.

Referring back to FIG. 1, the event execution unit 220 includes one or more administrators who manage and execute it according to event characteristics (by type), and all events constituting processes and tasks in conjunction with the script execution unit 210. Runs sequentially according to the computing environment.

In this regard, FIG. 6 shows the configuration of the event execution unit 220 according to an embodiment of the present invention.

Referring to FIG. 6, the event execution unit 220 according to an embodiment of the present invention includes an image object manager 221, a web object manager 222, a UI object manager 223, an OCR manager 224, and system events. Administrator 225, user event manager 226, and other event managers 227.

The image object manager 221 performs an image object detection event that recognizes and detects an image on the desktop or execution screen as an object (object), and the web object manager 222 is a web object that detects a web object on the web. Perform a detection event. Then, the UI object manager 223 performs a UI object detection event that recognizes elements of programs on the system (eg, OS) as an object, and the OCR manager 224 recognizes text using an OCR (Optical Character Reader). The OCR detection event is performed, and the system event manager 225 functions to process system events generated or performed by a system (eg, an OS). In addition, the user event manager 226 performs a function of processing user events such as key input and mouse input, and the other event manager 227 provides a function of processing system events and other events except user events. Perform.

Referring back to FIG. 1, the first command processing unit 230 processes in conjunction with the second command processing unit 340 of the process management device 300 and/or the third command processing unit 430 of the process control device 400. /Performs functions to send and receive commands such as task execution commands, execution result reports, script requests, security information requests, log information requests, and billing information requests.

The security management unit 240 verifies the user's authority by checking the user account with respect to the process execution device 200, and determines whether to execute the process/task automation script according to the verified user authority.

The log management unit 250 manages a user's login time, logout time, execution start time, execution end time, actual execution time, executed automation script, and execution number of the process execution device 200.

Meanwhile, FIG. 7 is a configuration diagram of an OCR manager according to an embodiment of the present invention. And, Figure 8 is a flow chart of an optical character reading method according to an embodiment of the present invention.

7 and 8, in one embodiment of the present invention, the OCR manager 224 includes template setting means 224-1, image recognition means 224-2, image alignment means 224-3, and repetition. Precision calculation means 14, character reading means 224-5, information extraction means 224-6, and the like.

The template setting means 224-1 provides a user with the ability to set and edit the template information of the document to be subjected to optical character reading (see step S810). For example, the template setting means 224-1 provides the user with a template editor capable of setting and editing template information so as to accurately extract desired information from a document subject to optical character reading, and the user opens the template editor. Through this, document form information, document alignment information, area location information, area attribute information, etc. are specifically set, and template information including these information is set.

In this regard, FIG. 9 is a diagram illustrating a template editor provided by the template setting means 224-1 according to an embodiment of the present invention.

Referring to FIG. 9, a user sets a type or form of a document (eg, resident registration card, Giro paper, bank passbook, subscription application) that is the object of optical character reading on the template editor, and the corresponding document (hereinafter referred to as'sample document') ), and designate all areas of the document image where desired information is displayed. Then, the template editor generates document form information corresponding to the type or form of the document set by the user, and extracts feature points of the sample document for sorting the document image in the future to generate document alignment information. Region location information is generated for each region. For reference, the area location information may be generated by calculating the top, left, width, and height values based on, for example, an image coordinate system, but is not limited thereto, and it is sufficient if a specified area can be specified.

And, the user through the template editor, the items (key values serving as labels or labels), the language (eg, Korean, English, numbers, symbols), string length, blacklist (blacklist) (not to be recognized) Text), whitelist (characters to be recognized as priority), and type (eg text, picture, table), etc. Then, the template editor matches each region location information and the corresponding region attribute information, and finally generates template information including document form information, document alignment information, region location information, and region attribute information.

Referring again to FIGS. 7 and 8, the image recognition means 224-2 actually scans a document to perform optical character reading (hereinafter referred to as a'read target document') to recognize a document image, and/or already The document image is recognized from the generated image file of the document to be read (see step S820).

Then, the image alignment means 224-3 performs image alignment on the document image to be read recognized by the image recognition means 224-2 based on the document alignment information included in the template information (see step S830).

In detail, even if the image recognition means 224-2 scans a document of the same form with the same format and the same dots (dots per inch), in reality, the positions of all documents do not exactly match, but the image alignment means according to the present invention (224-3) performs image alignment to eliminate this position mismatch.

For example, the image alignment means 224-3 extracts feature points of the document to be read, compares them with feature points of the sample document (which can be obtained from document alignment information of the template information), and reads having similar characteristics to each other Feature point pairs are generated by matching the feature points of the target document and the feature points of the sample document, respectively. For reference, the feature points may be extracted using Harris Corner Detection or the like.

Then, the image alignment means 224-3 removes an error or mismatched feature point pair by using the RANSAC (RANdom SAmple Consensus) algorithm for the feature point pairs generated in this way, and then 2D Homography Create and compute a matrix. Then, the image alignment means 224-3 performs a backward mapping based on the calculation result of the 2D homography matrix to sample each pixel of the document image to be read corresponding to the sample document image Image alignment is performed by moving to the position of each pixel in.

The repeatability determination means 224-4 determines the repeatability using the two-dimensional homography matrix generated by the image alignment means 224-3 and a pair of mutually matched feature points (see step S840).

For example, the iterative precision determination means 224-4 calculates a Root-Mean-Square Error (RMSE) of the x and y coordinates using several pairs of feature points used to calculate a two-dimensional homography matrix. Then, iterative precision is determined using the calculated RMSE value. Specifically, when the RMSE value is below a preset threshold (when repeatability satisfies a preset fit condition), there are fewer errors in the image converted to a two-dimensional homography matrix, and each component of the document to be read and the sample document If the location is judged to be the same and, on the contrary, the RMSE value exceeds a preset threshold (if the repeatability does not satisfy the preset fit condition), the converted image has many errors and the components of the document to be read and the sample document It is judged that the position is different (determined by non-repetition precision).

The character reading means 224-5 performs optical character reading on the image of the character to be read in different ways according to the repetition precision determination result.

If it is determined that the repetition precision determination means 224-4 is suitable for repetition precision, the character reading means 224-5 performs optical character reading based on the template information (see step S850).

For example, the character reading means 224-5 separates one or more regions designated by the user into separate images by referring to the region location information of the template information. In this case, according to a preferred embodiment of the present invention, the character reading means 224-5 performs a convolution operation or the like by copying and padding the periphery of the area designated by the user to the remaining area. Even if it does, do not lose data. Then, the character reading means 224-5 refers to the region attribute information for each separated region and performs optical character reading for the region. As described above, the region attribute information included in the template information includes items for the region (key values serving as labels or labels), languages (eg, Korean, English, numbers, symbols), string length, and blacklist (blacklist). ), whitelist, type (e.g., text, picture, table), etc. are set, and the character reading means 224-5 refers to the region attribute information for the region and/or meets the character and/or Recognize strings.

Conversely, if it is determined by the repeatability determination means 224-4 that the repeatability is not suitable, the character reading means 224-5 performs optical character reading on the entire area of the image of the document to be read (step) S860).

For example, the character reading means 224-5 performs optical character reading on the entire area of the document image to be read, finds and recognizes all the characters described in the document to be read, and provides the recognized characters and their location information (output )do.

Finally, the information extraction means 224-6 extracts necessary information from the characters and/or character strings read by the character reading means 224-5.

If the repetition precision is determined to be suitable and the optical character reading is performed by the character reading means 224-5 based on the template information, the information extracting means 224-6 is read by the character reading means 224-5. The contents (characters and/or character strings) are determined as information desired by the user, and a result file is generated based on the information (see step S870).

However, if it is determined that the repetition precision is not suitable, the character reading means 224-5 performs optical character reading for the entire document area, and the information extracting means 224-6 targets all characters described in the document to be read. Then, necessary information is extracted based on the template information (see step S880).

For example, the information extraction means 224-6 refers to the region attribute information of the template information, and the item of the extraction target information (key value serving as a label or label), language (eg, Korean, English, numbers, symbols), string It recognizes length, blacklist, whitelist, and type (e.g. text, picture, table), etc., and considers this to determine whether it is suitable for all characters and/or character strings in the document to be read. Extract the necessary information and generate a result file. Specifically, according to a preferred embodiment of the present invention, in view of the fact that an item (eg, account number) and specific content (eg, 101-12-700-302) corresponding to the item are mainly located adjacent to each other, information is extracted The means 224-6 extracts characters and/or character strings matching the items of the information to be extracted, and based on the location information, one or more characters and/or character strings located nearby correspond to the specific contents of the items Selected as a candidate. Then, the information extraction means 224-6 targets the characters and/or character strings included in the candidate group, weights according to distances, and respective attribute information (language, character string length, black list, etc.) corresponding to the area to which the item belongs. After calculating the weight according to the fitness of white list, type, etc.), the character and/or character string with the highest weight are recognized as the information to be extracted and a result file is generated.

Referring back to FIG. 1, the process management device 300 is a device that manages these in conjunction with at least one process setting device 100 and/or at least one process execution device 200. The process management device 300 is interlocked with at least one process setting device 100 and receives and manages a process/task automation script from the at least one process setting device 100. In addition, the process management device 300 is interlocked with at least one process execution device 200, commands the execution of a process/task automation script to the at least one process execution device 200, and receives and manages the execution result do.

To this end, the process management apparatus 300 according to an embodiment of the present invention includes a device management unit 310, a first script management unit 320, a scheduler 330, a second command processing unit 340, and a security management unit 350 , A billing management unit 360, a monitoring unit 370, a script storage unit 380, an information storage unit 390, and the like.

The device manager 310 manages at least one process setting device 100 and/or at least one process execution device 200. For example, the device management unit 310 manages a user account, user authority, device location, engine information, execution function, execution speed, processing capacity, and the like for each process setting device 100 and the process execution device 200. .

The first script management unit 320 manages the process/task automation script transmitted from the at least one process setting device 100. For example, the first script management unit 320 receives the process/task automation script from the script generation unit 130 of the process setting device 100 and stores it in the script storage unit 380, and requests the process execution device 200 According to or according to the request of the scheduler 330, the corresponding process/task automation script is searched and transmitted to the process execution device 200.

The scheduler 330 manages the execution schedule of the process/task automation script for at least one process execution device 200. For example, the scheduler 330 works with the second command processing unit 340 to manage an execution schedule for which process/task automation script to execute in which order for each process execution apparatus 200 at any time.

The second command processing unit 340 instructs each process execution device 200 to execute the process/task automation script and receives the execution result. For example, the second command processing unit 340 instructs and executes the execution of the first process/task automation script to the first command processing unit 230' of the first process execution device 200' at the request of the scheduler 330 Receive results. In addition, the second command processing unit 340 may request the first command processing unit 230 ′ of the second process execution device 200 ″ at the request of the first command processing unit 230 ′ of the first process execution device 200 ′. Command the execution of the second process/task automation script, receive the execution result, and transmit it to the first command processing unit 230' of the first process execution apparatus 200'.

The security management unit 350 manages security for each process execution device 200. For example, the security management unit 350 works with the security management unit 240 of each process execution device 200 to verify a user account with respect to the process execution device 200 to verify the user's authority, and verified user rights According to this, it determines and manages whether to connect to the corresponding process execution device 200, whether to execute an automated script, and the like.

The billing management unit 360 manages billing information of a user for each process execution device 200. For example, the billing management unit 360 works with the log management unit 250 of each process execution device 200 to log in the user, log out time, execution start time, execution end time, actual execution time, and executed automation script , Collects information on the number of executions, and generates and manages the billing information corresponding to it.

The monitoring unit 370 monitors the current state of each process execution device 200 and displays the result to the user or the administrator. For example, the monitoring unit 370 displays a process/task execution status, a progress state, an execution result, etc. in each process execution apparatus 200 in conjunction with the scheduler 330, the second command processing unit 340, and the like.

The script storage unit 380 stores the process/task automation script transmitted from the at least one process setting device 100 under the management of the first script management unit 320.

And, the information storage unit 390 is the device management unit 310, the first script management unit 320, the security management unit 350, the billing management unit 360, such as a process setting device, process execution device, process automation script, Stores information about task automation scripts, users, security, and billing.

The process control device 400 is a device for a user to control the process execution device 200. The process control device 400 is interlocked with the process execution device 200 as a control target, selects a process/task automation script to be processed by the process execution device 200, and commands execution. In addition, execution results are received.

To this end, the process control apparatus 400 according to an embodiment of the present invention includes at least one of a user interface unit 410, a second script management unit 420, and a third command processing unit 430.

The user interface unit 410 provides a user interface so that the user can control the process execution device 200 through the process control device 400. For example, the user interface unit 410 provides a graphical user interface (GUI) for at least one of a user's login/logout, process execution device selection, and process/task automation script execution/stop, and the process execution device The progress status, execution result, etc. of the task (process) being executed in 200 are displayed.

The second script manager 420 provides a user with a process/task automation script that can be processed by the process execution device 200. In addition, when a user registers or deletes any process/task automation script for the process execution device 200, the process/task automation script can be executed or canceled accordingly.

The third command processing unit 430 instructs the first command processing unit 230 of the process execution device 200 to execute the corresponding process/task automation script, receives the execution result, and receives the execution result from the user through the user interface unit 410. Notify.

Hereinafter, a robot process automation method according to the present invention will be described with reference to FIGS. 10 to 12.

First, FIG. 10 is a flowchart of a robot process automation method according to an embodiment of the present invention, in which a process setting device 100, a process execution device 200, and a process management device 300 interoperate with each other to perform a computing task of a user ( Process).

Referring to FIG. 10, the process setting unit 110 and the task setting unit 120 of the process setting device 100 provide a process/task editor to the user, and the user may use one or more processes/task editors. A process consisting of a task and a task consisting of one or more events are set (see step S1010). Then, the script generation unit 130 of the process setting device 100 generates a process automation script that performs a process and a task automation script that performs a task (see step S1020).

Then, the script generation unit 130 of the process setting device 100 transmits the process/task automation script to the script execution unit 210 of the process execution device 200 for actual execution (see step S1030a), and can be reused later. And for management, the process/task automation script is also transmitted to the first script management unit 320 of the process management device 300 (see step S1030b).

Meanwhile, the second command processing unit 340 of the process management device 300 executes the process/task automation script to the first command processing unit 230 of the process execution device 200 according to an execution schedule or a user request. Command (see step S1040), then the first command processing unit 230 of the process execution device 200 runs the process/task automation script in conjunction with the script execution unit 210 (see step S1050), and the execution result Is transmitted to the second command processing unit 340 of the process management device 300 (see step S1060).

For reference, the script execution command may also be issued by the third command processing unit 430 of the process control device 400. In this case, the third command processing unit 430 of the process control device 400 may be issued according to a user's request. The first command processing unit 230 of the process execution device 200 instructs the execution of the process/task automation script, and then the first command processing unit 240 of the process execution device 200 executes the process/task automation script. After that, the execution result is transmitted to the third command processing unit 430 of the process control device 400.

11 is a flowchart of a robot process automation method according to another embodiment of the present invention, the process control device 400, the process execution device 200, and the process management device 300 interoperate with each other to perform a user's computing task (process) It shows the way to process automatically.

Referring to FIG. 11, the user interface unit 410 of the process control device 400 provides a user interface to a user, and the user registers execution of a desired process/task automation script through the user interface (step S1110) Reference). Then, the third command processing unit 430 of the process control device 400 instructs the first command processing unit 230 of the process execution device 200 to execute the corresponding process/task automation script, and the process execution device 200 The first command processing unit 230 receives it (see step S1120).

Then, the first command processing unit 230 of the process execution device 200 requests the corresponding process/task automation script from the second command processing unit 340 of the process management device 300 (see step S1130), and the process management device The second command processing unit 340 of 300 transmits the corresponding process/task automation script process execution device 200 in conjunction with the first script management unit 320 (see step S1140). For reference, as in the case of FIG. 10 described above, if the corresponding process/task automation script already exists in the process execution device 200, steps S1130 and S1140 may be omitted.

Then, the first command processing unit 230 of the process execution device 200 works with the script execution unit 210 to execute the corresponding process/task automation script (see step S1150), and the execution result of the process control device 400 ) (See step S1160).

Accordingly, the present invention can request and execute a desired process/task automation script for a number of process/task automation scripts stored in the process management device 300 as well as process/task automation scripts existing in the process execution device 200. .

12 is a flowchart of a robot process automation method according to another embodiment of the present invention, a process control device 400, a first process execution device 200', a second process execution device 200", and a process management device It shows a method in which the 300 automatically processes a user's computing task (process) by interworking with each other.

Referring to FIG. 12, the user interface unit 410 of the process control device 400 provides a user interface to a user, and the user may execute a process execution device desired by the user through a user interface, for example, a remote second process execution device ( 200") to register execution of the desired process/task automation script (see step S1210).

Then, the third command processing unit 430 of the process control device 400 is the second process execution device 200" to the first command processing unit 230' of the first process execution device 200' that directly interoperates with itself. Command the process/task automation script execution of the process (see step S1220), and the first command processing unit 230' of the first process execution device 200' is the second command processing unit 340 of the process management device 300 It is transmitted to (see step S1230).

Then, the second command processing unit 340 of the process management device 300 commands the execution while transmitting the process/task automation script to the first command processing unit 230" of the second process execution device 200" (step S1240).

Then, the first command processing unit 230" of the second process execution device 200" works in conjunction with the script execution unit 210" to execute the process/task automation script (see step S1250), and processes the execution result. It is transmitted to the second command processing unit 340 of the management device 300 (see step S1260).

Then, the second command processing unit 340 of the process management device 300 transmits the process/task automation script execution result to the first command processing unit 230' of the first process execution device 200' (see step S1270). ), the first command processing unit 230 ′ of the first process execution device 200 ′ transmits it to the third command processing unit 430 of the process control device 400 (see step S1280 ).

Accordingly, the present invention allows the user to remotely process the second process execution device 200 ″ through the process management device 300 as well as the first process execution device 200 ′ directly linked to the process control device 400. You can command the execution of the desired process/task automation script.

So far, the present invention has been described in detail with reference to preferred embodiments, but the person skilled in the art to which the present invention belongs can be implemented in other specific various forms without changing the technical spirit or essential features of the present invention. It should be understood that the embodiments described in the above are illustrative in all respects and not restrictive.

And, the scope of the present invention is specified by the claims, which will be described later, rather than by the detailed description, and all changes or modifications derived from the meaning and scope of the claims and their equivalent concepts are included in the scope of the present invention. It should be interpreted as.

Claims (16)

At least one process setting device for setting a task consisting of at least one event and a process consisting of at least one task, and generating a task automation script for performing the task and a process automation script for performing the process;
At least one process execution device that executes at least one event constituting the task to execute the task automation script and the process automation script;
A process management device that manages execution of the task automation script and the process automation script for the at least one process execution device; And
And at least one process control device interlocked with the at least one process execution device and controlling execution of processes and task automation scripts of the process execution device. According to claim 1,
The at least one process control device is respectively associated with the at least one process execution device,
The command processing unit of the process control device commands the execution of the process automation script and the task automation script to the at least one process execution device, and the command processing unit of the at least one process execution device executes the process automation script and the task automation script Process automatic processing system, characterized in that. According to claim 1,
The process control device,
A script management unit that provides a process automation script and a task automation script processed by the at least one process execution device to the process execution device; And
And a command processing unit for instructing the execution of the process automation script and the task automation script to each command processing unit of the at least one process execution device. According to claim 1,
And the process management device manages the process automation script and the task automation script generated in the at least one process setting device, and transmits the process automation script and the task automation script to the process execution device. Process automation system. According to claim 1,
The process setting device,
A process setting unit capable of setting a process consisting of one or more tasks;
A task setting unit capable of setting a task composed of one or more events; And
And a script generation unit for generating a process automation script for performing the process and a task automation script for performing the task. The method of claim 5,
The process setting unit provides a process editor that allows a user to create one or more tasks constituting the process to define task properties and determine an execution order,
The task setting unit provides a task editor for defining a property of an event and determining an execution order by generating one or more events constituting the task. The method of claim 5,
The process setting unit extracts an attribute and an execution order of one or more tasks constituting the process by recording a behavior pattern in which the user executes the process,
The task setting unit is a robot process automation system, characterized in that by extracting an attribute and an execution order of one or more events constituting the task by recording a behavior pattern of a user executing the task. The method according to any one of claims 5 to 7,
The script generator is a robot process automation system, characterized in that the process automation script and the task automation script are debugged in conjunction with an event execution unit that executes the one or more events. The method according to any one of claims 5 to 7,
A robot process automation system, characterized in that a plurality of events sequentially executed among one or more events constituting the task can be set as one integrated event. According to claim 1,
The process execution device,
A script execution unit for executing at least one of a process automation script performing a process consisting of one or more tasks and a task automation script performing a task consisting of one or more events; And
According to the event execution request of the script execution unit, at least one of an image object detection event, a web object detection event, a UI (User Interface) object detection event, an OCR (Optical Character Reader) detection event, a system event, and a user event is generated. A robot process automation system comprising an event execution unit to execute. The method of claim 10,
The process execution device,
And a command processing unit for requesting execution of the corresponding process automation script and task automation script from the script execution unit, and receiving an execution result from the script execution unit. The method of claim 10 or 11,
The event execution unit,
An image object manager that fires image object detection events,
A web object manager that fires web object detection events,
UI object manager that fires UI object detection events,
OCR manager that triggers OCR detection events,
A system event manager that fires system events, and
A robot process automation system comprising at least one manager of a user event manager executing a user event. The method of claim 10 or 11,
The event execution unit includes an OCR manager that executes an OCR detection event based on template information including area location information and area attribute information for a document image. According to claim 1,
The process management device,
A device manager that manages one or more process execution devices;
A script management unit managing a process automation script performing a process consisting of one or more tasks and a task automation script performing a task consisting of one or more events; And
And a command processing unit for transmitting the process automation script and the task automation script to the one or more process execution devices and instructing execution. The method of claim 14,
The process management device,
And a scheduler that schedules the execution of the process automation script and the task automation script for the one or more process execution devices. The method of claim 14 or 15,
When the command processing unit is requested to execute a predetermined process automation script and task automation script from the first process execution device, the command processing unit transmits the predetermined process automation script and task automation script to the second process execution device and commands execution. Robot process automation system.

Images