KR20040075307A - System and method for policy quorum grid resource management - Google Patents

Abstract

PURPOSE: A system and a method for managing grid resource based on a policy quorum are provided to satisfy the SLA(Service Level Agreements) of a user by allotting a task to the resource in a selected resource set, and guarantee the reliability for task execution by allotting the task again when the resource is separated from the quorum before the task completion through reformation of the resources. CONSTITUTION: A client(100) inputs a feature and an environment of the task needed from the user while functioning as an interface with the user, and transmits a requirement of the user by deciding the feature of the resource. A server(200) certifies the user and a resource use priority while communicating with the client, generates the available resource quorum by converging a required performance for the resources and a required level of a grid service into an SLA form, and plans/executes the user's task through the resource obtained in the available resource quorum.

Description

Policy quorum-based grid resource management system and method thereof {SYSTEM AND METHOD FOR POLICY QUORUM GRID RESOURCE MANAGEMENT}

The present invention relates to a grid computing middleware system. In particular, the SLA and the application of the user are defined by defining service level agreements (SLAs) as performance requirements and grid service requirements for user resources. A policy quorum-based grid resource management system and method for resource allocation and task management based on the characteristics of a program.

Grid computing means that when you run a PC or other device connected to the Internet, you are not just connecting to the resources on your desktop, but sharing the resources of the virtual machine. Virtual computers include computing power, storage, applications, data, and I / O devices, and can be distributed anywhere over the Internet.

Grid computing is a next-generation digital neural network service that allows resources such as high-performance computers, mass storage devices, and advanced equipment, which are geographically dispersed, to be shared and used by high-speed networks. Grid computing naturally evolves the Internet to the next level, evolving into a virtual organization that shares resources among distributed computer systems.

Typically, grids become infrastructures that provide applications or services that can be performed using high performance computing or multiple network resources in geographically dispersed environments. Grid computing middleware is the main element technology supporting this grid, and grid computing middleware is composed of functional blocks such as various service access, control and allocation.

Conventional grid computing middleware is for monitoring, controlling, and distributing the demand for resources within a widely distributed computer networked environment.

"System and method for integrated load balancing and resource management in the Internet environment" disclosed in Korean Patent Application No. 2000-30978, among the conventional grid computing middleware technology, provides access to a web object, and provides a prediction request for the web object. A system is provided for matching available capacity on a server.

The above system implements a method of dynamically constructing both demand and capacity based on predetermined criteria, and provides a method of dynamically constructing requirements for an object based on criteria such as arrival time, destination geography, and price requirements. do.

Since these resource management systems are designed to be optimized in the local environment, they are less efficient for resource sharing on the Internet such as grid computing environment.

In particular, when hundreds or thousands of resources are available, the existing linear programming (LP) -based optimized resource management system has a problem in that it cannot flexibly cope with changes in time and environment in order to select the most suitable resource for users. .

Grid computing environments need to be flexible in adapting to changes and considerations, because the parameters of the required resources vary according to the characteristics of the application.

Therefore, among the grid computing middleware technologies, the resource management technology monitors the status of resources that change in time and space in consideration of the complexity and uncertainty of the grid computing environment, and actively discovers and requires the resources that users need in the current state. There is a need for resource management and scheduling techniques that can be implemented and ensured reliability until the task is completed.

The technical problem to be achieved by the present invention is to establish a policy quorum resource management system (PQRM) to allocate tasks to resources in the selected resource set to satisfy the user's SLA as well as reconfiguration of resources. Through this, it provides a policy quorum-based grid resource management system and method for ensuring reliability of the execution of a task by reallocating the task when the resource is released within the quorum before completing the task.

1 illustrates an overall configuration of a policy quorum based grid resource management system according to an embodiment of the present invention.

2 is a flowchart illustrating a policy quorum based grid resource management method according to an embodiment of the present invention.

FIG. 3 is a flowchart illustrating a method of processing resource acquisition by a quorum manager, which is a part of FIG. 1.

FIG. 4 illustrates a flowchart of a method of job scheduling and resource reconfiguration of a job manager, which is a component of FIG. 1.

5 illustrates a graphical user interface in a policy quorum based grid resource management system according to an embodiment of the present invention.

In order to solve this problem, the present invention defines a policy quorum determined by resource requirements constrained by the user's SLA in the technique of discovering, selecting, and allocating resources for executing tasks in a grid computing environment. And, by reconfiguring the quorum according to the state change in the quorum over time, it provides policy quorum-based resource management technique that provides users with a certain level of reliability.

In the policy quorum-based grid resource management system according to the first aspect of the present invention, a policy quorum-based grid resource management method for discovering, selecting, and allocating grid resources required by a user in a grid computing environment includes: a) a server; Performing user authentication and resource use authority authentication through a session connection attempt of the client; b) When the authentication is completed in the step a), the server defines the required performance of the user's resources and the required service level of the grid service as service level agreements (SLAs), and the SLA and application programs. Generating an available resource quorum according to characteristics and optimization policies; c) scheduling and executing a task requested by a user through the resources obtained in the available resource quorum generated in step b); d) reconfiguring resources by monitoring the work being executed through step c) and reallocating the work to maintain a certain level of the required resource of the user; And e) notifying the user of the completion of the job and storing the job record when the job being executed through the step c) is completed.

The step b) may include b-1) generating a resource vector through the SLA and resource state information; b-2) generating a quality of service (QoS) vector by determining a resource acquisition policy based on the SLA; b-3) binary mapping the resource vector and the quality of service vector to determine a level of the resource; And b-4) generating an available resource quorum by applying the resource acquisition policy determined based on the SLA.

In step c), it is preferable to dynamically allocate the grid resources to the grid resources by receiving a parallel, distributed, independent characteristic of the task, and an environment such as a directory, standard input / output, execution time, and status of the task.

The step c) may include: c-1) allocating a job input by a user to a resource acquired in the available resource quorum and registering it in a job queue; And c-2) it is preferable that the task rule includes the step of requesting the task execution by determining the execution method according to the characteristics of the application.

In step d), if the deterioration or failure condition of the resource is detected by monitoring the job being executed in step c), the task is re-executed or the reallocation of the resource is determined. It is preferable to select.

The step e) preferably includes a post-processing step of transmitting the execution result data and the log file for the completed job.

The policy quorum-based grid resource management system according to the second aspect of the present invention is a policy quorum-based grid resource management system for discovering, selecting, and allocating grid resources required by a user in a grid computing environment. A client that performs a role of an interface, inputs characteristics and environments of a task required by a user, determines characteristics of resources, and transmits user requirements; And perform user authentication and resource usage authority authentication while communicating with the client, and converge user's requirements in terms of resource requirements and grid service requirements in the form of service level agreements (SLAs). And a server to generate an available resource quorum, and to plan and execute a user's work through the resources obtained in the available resource quorum.

The server may be externally connected to a resource state storage server that manages the resource state information, and a resource state monitoring server that continuously monitors the resource state and detects deterioration or failure of resources.

The server preferably includes a resource reconfiguration function that monitors a running job and reassigns the job by detecting deterioration and failure of a resource state below a user's demand level.

The server may include: a client connection module configured to perform socket communication with the client to control and store information for determining the SLA-based resource acquisition policy; A quorum manager extracting the resource state information to determine a resource that satisfies a user requirement; And a task manager for allocating a user's task to the resource obtained by the quorum manager and ensuring a certain level of task completion to the user while monitoring a running task.

The quorum manager generates a resource vector based on the resource state information, generates a service quality vector according to a policy determined by the resource requirement, and then expresses the level of the resource vector and the service quality vector value in binary. It is desirable to manage resources by determining the level of resources.

DETAILED DESCRIPTION Hereinafter, exemplary embodiments of the present invention will be described in detail with reference to the accompanying drawings so that those skilled in the art may easily implement the present invention. As those skilled in the art would realize, the described embodiments may be modified in various different ways, all without departing from the spirit or scope of the present invention. In the drawings, parts irrelevant to the description are omitted in order to clearly describe the present invention. Like parts are designated by like reference numerals throughout the specification.

A policy quorum based grid resource management system according to an embodiment of the present invention will be described in detail with reference to FIG. 1.

1 illustrates an overall configuration of a policy quorum based grid resource management system according to an embodiment of the present invention.

As shown in FIG. 1, a policy quorum-based grid resource management system according to an embodiment of the present invention includes a client 100 and a server 200, and the server 200 includes a client connection module 210 and a quorum. The manager 220 and the job manager 230 are included.

An external module of the policy quorum-based grid resource management system includes a resource state storage server 400 and a resource state monitoring server 300.

The client 100 performs client / server socket communication through the client connection module 210 of the server 200 and serves as an interface with a user.

The client 100 includes a grid portal, an SLA contractor, a resource table, a work table, and the like. The grid portal provides a web page for a user in the form of a web portal, and the SLA contractor includes a policy repository 212 in the server 200. In order to determine the characteristics of the resources required while communicating with each other, the quorum manager 220 of the resources required by the user is determined by the SLA contractor.

In the work table, the work requested by the user is sent to the work scheduler 231 in the work manager 230 of the server 200 through the resources from the resource table.

The client connection module 210 includes a session admission controller 211, a policy store 212, an SLA contractor 213, and an application property store 214.

The session admission controller 211 controls session connection from a client to perform user authentication and resource permission authentication, and the policy store 212 implements a policy determined by the requirements of the resource constrained by the user's SLA. The SLA contractor 213 determines the characteristics of the resource needed by the user, and the application characteristic store 214 stores the application characteristics of the user.

The quorum manager 220 includes a policy quorum generator 221, a resource table 222, and a resource state query module 223.

The policy quorum generator 221 generates the resource table 222 through the policy store 214 and the resource state query module 223, and the resource state query module 223 provides resource state information of the resource state storage server 400. Bring up

The task manager 230 includes a task scheduler 231, a task dispatcher 232, a resource reconfiguration module 233, and a task monitor 234.

The job scheduler 231 requests the job dispatcher 232 to execute the job, the job dispatcher 232 requests user query processing, and registers the job with the resource reconfiguration module 233 to execute the job. Monitor through the monitor 234.

The resource reconfiguration module 233 determines whether to reconfigure resources through monitoring of tasks and resources, and when reconfiguring resources, calls the task scheduler 231 to attempt reallocation.

Next, the operation of the policy quorum-based grid resource management system according to an embodiment of the present invention will be described in detail with reference to FIGS. 2 to 5.

2 is a flowchart illustrating a policy quorum based grid resource management method according to an embodiment of the present invention.

As shown in FIG. 2, the policy quorum-based grid resource management method according to an embodiment of the present invention first performs user authentication and resource use authority authentication through a proxy authentication scheme of a client / server structure, and then a user resource. Receive requirements for performance, required levels of grid services, and requirements for work.

At this time, the server 200 defines the user's requirements as SLAs and converges them in the form of SLAs, and generates available resource quorum according to the user's requirement level, application characteristics, and optimization policy through policy quorum.

The server 200 analyzes the user's work to plan and execute the user's work through the resources acquired in the available resource quorum, and monitors the running work.

At this time, the server 200 performs a resource reconfiguration function that automatically reassigns a job in preparation for deterioration and failure of a resource state when a running job is below a user's requirement level.

When the server 200 detects that the running job is completed, the server 200 notifies the user and stores the job record.

FIG. 3 is a flowchart illustrating a method of processing resource acquisition by a quorum manager, which is a part of FIG. 1.

As shown in FIG. 3, the quorum manager 220 is connected to the resource state storage server 400 to obtain information about the state of the resource and determine a resource that satisfies the user's request.

That is, the quorum manager 220 determines the resource set based on the SLA obtained from the client 100 and the state information of the resource obtained through the resource state storage server 400, and the resource vector when the resource set satisfies the SLA. Expressed as

In addition, the quorum manager 220 generates a QoS vector available by SLA, service class, and QoS policy, and determines the level of resources by binary mapping of the resource vector and the QoS vector through a mapper (not shown) to determine the available resource quorum. Create

At this time, the quorum manager 220 finally optimizes the available resource quorum by applying an optimization policy of two levels of performance and cost. The generated resource quorum is then presented to the user as a resource table, ready to run the task.

FIG. 4 illustrates a flowchart of a method of job scheduling and resource reconfiguration of a job manager, which is a component of FIG. 1.

As shown in FIG. 4, the task manager 230 allocates a user's task to a resource obtained from the quorum manager 220, monitors the task, and ensures that the task is finally completed.

That is, the task scheduler 231 of the task manager 230 is provided with the optimized available resource quorum from the quorum manager 220. Then, the resource reconfiguration module 233 allocates the work input by the user from the work table and registers the work in the work queue. At this time, the user inputs the characteristics of the job (parallel, distributed, independent) and the environment (directory, standard input / output, execution time, state, etc.) to the job table.

The job queue calls the runtime system library (RSL) generator (not shown) or the MPICH-G2 caller (not shown) according to the characteristics of the application, and requests the job dispatcher 233 to execute the job through the GRAM caller.

The MPICH-G2 is a middleware that uses resource management and security of the global bus to execute a message-passing interface (MPI) application.

The task monitor 234 monitors the status of the task attempted to be executed above, and the resource reconfiguration module 233 checks the status of the task to determine the reconfiguration of the resource if the execution worsens or fails.

The task manager 230 completes the execution of the task, and when the application is terminated, the task manager 230 displays to the user that the task is completed in the task table of the client 100.

5 illustrates a graphical user interface in a policy quorum based grid resource management system according to an embodiment of the present invention.

As shown in FIG. 5, the client 100 attempts a session connection with the server 200 through user authentication, and undergoes a proxy authentication procedure for grid resource use authority authentication after user authentication.

After successfully completing the above authentication process, the user selects the quorum manager using module (a-1) and the quorum manager not using module (a-2) and attempts to discover available resources.

The available resources are displayed in the resource table and shown to the user. Once the resources are determined, the user selects a resource reconfiguration policy (b-1) and a resource reconfiguration algorithm (b-2) and submits the task to manage the task. Done.

The submitted job is confirmed by the user through the submit job confirmation part, and the submitted job is displayed in the job table with necessary parameters including the ID of the job.

As described above, the policy quorum-based grid resource management system and method according to an embodiment of the present invention can find a set of resources that satisfy the user's SLA according to the state of resources that change temporally and spatially in the grid. It provides a flexible system and method. In particular, the policy quorum-based grid resource management system and method according to an embodiment of the present invention can be manufactured to optimize QoS by continuously maintaining a certain level of resources required by a user.

Although the preferred embodiment of the present invention has been described in detail above, the present invention is not limited thereto, and various other changes and modifications are possible.

As described above, the policy quorum-based grid resource management system and method according to the present invention can find a set of resources that satisfy the user's SLA according to the state of resources that change temporally and spatially in the grid, and the user requests QoS can be optimized by maintaining a certain level of resources.

In addition, the policy quorum-based grid resource management system and method according to the present invention can check the progress of the task through continuous monitoring of the task after assigning the task to the resource, and can flexibly cope with resource deterioration or failure. By reconfiguring resources so that users can have a reliable job execution environment in a complex resource distribution environment.

Claims (20)

In a grid quorum-based grid resource management method for discovering, selecting, and allocating grid resources required by a user in a grid computing environment, a) the server performing user authentication and resource usage authorization through a session connection attempt of the client; b) When the authentication is completed in the step a), the server defines the required performance of the user's resources and the required service level of the grid service as service level agreements (SLAs), and the SLA and application programs. Generating an available resource quorum according to characteristics and optimization policies; c) scheduling and executing a task requested by a user through the resources obtained in the available resource quorum generated in step b); d) reconfiguring resources by monitoring the work being executed through step c) and reallocating the work to maintain a certain level of the required resource of the user; And e) notifying the user of completion of the job and storing the job record when the running job is completed through step c). Policy quorum-based grid resource management method comprising a. The method of claim 1, B), b-1) generating a resource vector through the SLA and resource state information; b-2) generating a quality of service (QoS) vector by determining a resource acquisition policy based on the SLA; b-3) binary mapping the resource vector and the quality of service vector to determine a level of the resource; And b-4) generating an available resource quorum by applying the resource acquisition policy determined based on the SLA Policy quorum-based grid resource management method comprising a. The method of claim 2, A policy quorum-based grid resource management method of determining a resource acquisition policy based on the SLA based on an SLA, a service class, an optimization policy, and a service quality policy. The method according to claim 2 or 3, In step b-4), the policy quorum-based grid resource management method of finally optimizing the available resource quorum by applying the performance and cost optimization policy in the resource acquisition policy based on the SLA. The method of claim 2, In step b-4, the quorum-based grid resource management method of displaying the available resource quorum in a resource table for the user to view. The method of claim 1, C), A policy quorum-based grid resource management method of receiving a parallel, distributed, independent characteristic of the task from the user, and an environment such as a directory, standard input / output, execution time, and status of the task and dynamically assigning them to grid resources. The method of claim 1, C), c-1) allocating a work input by a user to a resource obtained in the available resource quorum and registering the same in a work queue; And c-2) the task rule requesting the task execution by determining the execution method according to the characteristics of the application Policy quorum-based grid resource management method comprising a. The method of claim 1, Step d), Policy quorum base that monitors the work being executed in step c) and decides to re-execute the work or reallocate the resource when the deterioration or failure of the resource is detected, and select the newly allocated resource when the reallocation of the resource is determined. How to manage grid resources. The method of claim 1, Step e), A policy quorum-based grid resource management method comprising a post-processing step of transmitting execution result data and a log file of the completed task. In a grid quorum-based grid resource management system for discovering, selecting, and allocating grid resources required by a user in a grid computing environment, A client that performs a role of an interface with a user, inputs a characteristic and an environment of a task required by the user, determines a characteristic of a resource, and transmits the user's requirements; And Performs user authentication and resource usage authentication while communicating with the client, and converges the user's requirements to the required performance of the resource and the required level of the grid service in the form of service level agreements (SLAs). A server for creating an available resource quorum and for planning and executing a user's work through the resources obtained in the available resource quorum. Policy quorum-based grid resource management system comprising a. The method of claim 10, The server, A policy quorum-based grid resource management system externally connected to a resource state storage server for managing the resource state information, and a resource state monitoring server for continuously monitoring the resource state to detect deterioration or failure of resources. The method of claim 10, The server quorum-based grid resource management system including a resource reconstruction function to monitor the running work to detect the deterioration and failure of the resource status below the user's demand level and reallocate the work. The method of claim 10, The client, A grid portal for providing a web page for the user; An SLA contractor communicating with the server to determine characteristics of a resource requested by a user; And Resource table and job table to enter the properties of the resource, the properties of the job, and the environment that you require Policy quorum-based grid resource management system comprising a. The method of claim 1, The server, A client connection module configured to perform socket communication with the client to control and store information for determining the SLA-based resource acquisition policy; A quorum manager extracting the resource state information to determine a resource that satisfies a user requirement; And Task manager that assigns the user's work to the resources obtained by the quorum manager, and monitors the running work while ensuring the user completes a certain level of work Policy quorum-based grid resource management system comprising a. The method of claim 13, The client connection module, A session admission controller for controlling a session connection from the client to perform user authentication and resource use authority authentication; A policy store for storing a policy determined by a requirement of a resource constrained by a user's SLA; An SLA contractor that determines the nature of the resource the user needs; And Application attribute store, which stores user application attributes Policy quorum-based grid resource management system comprising a. The method of claim 13, The quorum manager is A resource status query module for collecting information on the resource status from the outside; And A policy quorum generator for generating a resource table for available resource quorum through policy determined by resource state information collected through the resource state query module and resource requirements constrained by the user's SLA. Policy quorum-based grid resource management system comprising a. The method of claim 13, The quorum manager is A resource vector is generated through the resource state information, and a service quality vector is generated according to a policy determined by the resource requirement. Policy quorum-based grid resource management system to manage resources. The method of claim 13, The quorum manager is A policy quorum-based grid resource management system that generates an optimized available resource quorum by applying an optimization policy of performance and cost in a policy determined by the resource requirement. The method of claim 13, The task manager, A task scheduler for allocating a user task according to an application characteristic to a resource obtained in the available resource quorum; A task dispatcher (DISPATCHER) for executing a task assigned by the task scheduler; A job monitor that continuously monitors the execution of the job being executed by the job dispatcher; And The resource reconfiguration module determines whether to reconfigure resources according to the monitoring result of the job monitor, and attempts to reassign a job by calling the job scheduler when reconfiguring the resources. Policy quorum-based grid resource management system comprising a. The method of claim 13, The task manager, A policy quorum-based grid resource management system that notifies the user of the completion of the job when the running job is completed and supports post-processing of transmitting job execution result data and log files.