JP7047429B2 - Storage device management system, storage device management device, storage device management method, and program - Google Patents

Description

The present invention relates to the management of storage devices, and more particularly to a storage device management system for managing a plurality of distributed storage devices.

As the scale of an information processing system such as a High Performance Computing (HPC) system increases, various devices are distributed and arranged using a network or the like in relation to the installation location or the like.

In information processing systems, performance requirements for storage devices (sometimes referred to as "storage" in the following description) are increasing. However, there are restrictions on the procurement cost of the system. Therefore, in an information processing system, an Input and Output (IO) system including a storage device is required to suppress costs and improve IO performance (see, for example, Patent Documents 1 and 2).

The distributed storage system described in Patent Document 1 realizes efficient data supply between a server and a storage by using a cache in the distributed storage system.

The storage system described in Patent Document 2 determines the capacity of the partition area to which the cache is allocated based on the buffer size.

In order to improve IO performance, Solid State Drive (SSD), which has a higher access speed than the magnetic disk device, is increasingly used instead of the magnetic disk device. For example, an SSD is used as a storage device that is directly connected to a device that executes a job (hereinafter, referred to as a “job execution device”).

However, the number of storage devices that can be individually connected to each job execution device is limited. For example, when the job execution device uses the SSD connected to each, the capacity that can be used by the job execution device cannot exceed the capacity of the connected SSD. That is, when the SSDs to which the job execution devices are individually connected are used, there is a problem that the performance of the job execution devices is limited.

Further, each job execution device has a different storage area capacity. For example, an SSD connected to a job execution device with a small used capacity has a large unused area. That is, when the SSDs to which the job execution devices are individually connected are used, there is a problem that the utilization efficiency of the SSDs is lowered.

As described above, the information processing system using the SSD to which the job execution device is individually connected has a problem that the performance is limited and the utilization efficiency of the SSD is low.

As a countermeasure to the above problems, an information processing system using a dedicated server (for example, a file server) equipped with a plurality of SSDs is assumed. In this system, when realizing a storage area that satisfies the desired throughput and capacity for the job execution device, the dedicated server bundles the SDDs connected to the dedicated server and stores them with the required performance. The area is provided to the job execution device.

Japanese Unexamined Patent Publication No. 2016-212819 Japanese Unexamined Patent Publication No. 2008-181243

However, in the above case, all access from the job execution device that uses the storage area is concentrated on the dedicated server. Therefore, when accessing a plurality of SSDs from the job execution device, access conflict occurs. Access contention can reduce access performance in information processing systems.

That is, in a general information processing system using a dedicated server, there is a problem that the access performance is deteriorated when accessing a plurality of storage devices.

The inventions described in Patent Documents 1 and 2 are inventions relating to a cache, and do not improve the competition for access to a storage area configured by using a plurality of storage devices.

An object of the present invention is to provide a storage device management system or the like that solves the above problems and improves the performance of access to a storage area secured by using a plurality of storage devices.

The storage device management system according to one embodiment of the present invention analyzes a plurality of job execution devices, each including a storage device, and a job schedule processed by the job execution device, and jobs in the schedule. A job management device that includes a schedule extraction means that extracts the performance of the storage area used by the user, a job management means that sets the scheduled usage time for allocating the storage area to the job, and the performance in the storage area at the scheduled usage time. Includes a storage device management device including storage device determination means for determining a plurality of storage devices to be assigned to a job.

In the storage device management method according to one embodiment of the present invention, a storage device management system including a storage device and a plurality of job execution devices that execute a predetermined job analyzes the schedule of jobs processed by the job execution device. Then, the performance of the storage area used by the job in the schedule is extracted, the scheduled usage time for allocating the storage area to the job is set, and multiple storages allocated to the job so as to satisfy the performance in the storage area at the scheduled usage time. Determine the device.

Each of the storage device management devices in one embodiment of the present invention is connected to a storage device management system including a storage device and a plurality of job execution devices for executing a predetermined job, and a job scheduled to be processed by the job execution device. Satisfies the performance in the storage area at the scheduled usage time, the schedule extraction means that extracts the performance of the storage area used by the job in the schedule, and the job management means that sets the scheduled usage time to allocate the storage area to the job. As such, it includes storage device determining means for determining a plurality of storage devices to be assigned to a job.

In the storage device management method according to one embodiment of the present invention, a storage device management device connected to a storage device management system including a storage device including a storage device and a plurality of job execution devices for executing a predetermined job is a job execution device. Analyzes the schedule of the job processed by, extracts the performance of the storage area used by the job in the schedule, sets the scheduled usage time to allocate the storage device to the job, and satisfies the performance in the storage area at the scheduled usage time. Determine multiple storage devices to assign to the job.

The program in one embodiment of the present invention is a scheduled job to be processed by a job execution device on a computer connected to a storage device management system, each of which includes a storage device and includes a plurality of job execution devices for executing a predetermined job. The process of extracting the performance of the storage area used by the job in the schedule, the process of setting the scheduled usage time to allocate the storage area to the job, and the process of setting the scheduled usage time, so as to satisfy the performance in the storage area at the scheduled usage time. Executes the process of determining multiple storage devices to be assigned to the job.

Based on the present invention, it is possible to achieve the effect of improving the access performance to the storage area secured by using a plurality of storage devices.

FIG. 1 is a block diagram showing an example of the configuration of the storage device management system according to the first embodiment of the present invention. FIG. 2 is a diagram showing an example of a storage device management table according to the first embodiment. FIG. 3 is a diagram showing an example of a storage device allocation table according to the first embodiment. FIG. 4 is a flow chart showing an example of an operation of setting a storage area in the job management device according to the first embodiment. FIG. 5 is a flow chart showing an example of the allocation operation in the storage device management device according to the first embodiment. FIG. 6 is a flow chart showing an example of an operation at the start of a job in the storage device management device according to the first embodiment. FIG. 7 is a flow chart showing an example of an operation of opening the assigned storage device in the storage device management device according to the first embodiment. FIG. 8 is a diagram showing an example of job request information. FIG. 9 is a block diagram showing an example of the configuration of the outline of the storage device management system according to the first embodiment. FIG. 10 is a block diagram showing another example of the configuration of the outline according to the first embodiment. FIG. 11 is a block diagram showing an example of a hardware configuration in the storage device management device according to the first embodiment.

Next, an embodiment of the present invention will be described with reference to the drawings.

Each drawing is for explaining an embodiment in the present invention. However, the present invention is not limited to the description of each drawing. Further, similar configurations of the drawings may be numbered the same, and the repeated description thereof may be omitted. Further, in the drawings used in the following description, the description of the structure of the portion not related to the description of the present invention may be omitted and not shown.

First, the terms used in the description of the embodiments of the present invention will be summarized.

In the following description, a "job" is used as a processing unit. However, this does not limit the embodiment in the present invention. The unit of processing may be any unit for allocating the storage area. For example, the unit of processing may be a "task" or a "thread".

"Job schedule" is a schedule of a job to be executed in the job execution device. The job schedule is created based on the job request (request information) to the job execution device. The request information is not limited in its content and format. For example, the request information may specify a calculation resource such as the amount of memory used in the job, the number of CPUs, the upper limit of elapsed time, and / or the batch queue. Further, the request information may be described using, for example, a predetermined programming language or a script language.

Note that the job schedule used in the following description includes performance related to the storage area to be used by the job. However, the performance is not limited. In the following description, "capacity" and "throughput" are used as an example of performance. Further, the performance of the storage area is not limited to the access performance as described above, and may include other requirements such as functional contents (for example, a predetermined RAID (Redundant Arrays of Inexpenive Disks) function).

Further, the unit of physical configuration allocation assigned to the storage area in each embodiment is not limited. In each embodiment, a storage device may be used as a unit of allocation, or an area (hereinafter, referred to as “partition”) in which the storage device is logically divided may be used. In the following description, a partition is used as an example of the allocation unit. When the storage device is used as the unit of allocation, the partition in the following description may be appropriately changed to the storage device.

<First Embodiment>
Hereinafter, the first embodiment will be described with reference to the drawings.

[Description of configuration]
First, the configuration of the storage device management system 100 according to the first embodiment will be described with reference to the drawings.

FIG. 1 is a diagram showing an example of the configuration of the storage device management system 100 according to the first embodiment of the present invention.

The storage device management system 100 includes a plurality of job execution devices 1, a job management device 2, a network 3, and a storage device management device 4.

The network 3 is a communication network that connects each device. The network 3 is not limited in its configuration as long as each device can be connected with predetermined performance. For example, network 3 is a Fiber Channel, Loall Area Network (LAN), or telephone line network.

The job execution devices 1 are distributed and arranged via the network 3. Then, each job execution device 1 executes a predetermined process (job). For example, the job execution device 1 is a server that provides a predetermined service. However, the job execution device 1 is not limited to the server.

Further, the job execution device 1 includes at least one storage device 11. That is, the storage devices 11 are distributed and arranged.

The storage device 11 is optional. However, as will be described later, the storage device 11 constitutes a storage area 12 used by the job. Therefore, it is desirable that the storage device 11 has high performance (for example, access performance). For example, the storage device 11 is an SSD.

Further, the interface of the storage device 11 is arbitrary. The interface is, for example, Fiber Channel.

However, these are not limited to the storage device 11.

It should be noted that any job execution device 1 may execute a job using the storage area 12. Further, the storage area 12 may be configured by using the storage device 11 in any job execution device 1. As an example, FIG. 1 shows a case where a storage area 12 configured by using the storage device 11 of the upper job execution device 1 is assigned to a job of the job execution device 1 in the center right.

The job management device 2 manages the jobs executed by the job execution device 1. Specifically, the job management device 2 executes the process of setting the schedule of the storage area 12 used by the job, allocating the storage area 12 at the start of the job, and releasing the storage area 12 at the end of the job. do.

The job management device 2 includes a schedule extraction unit 21 and a job management unit 22.

The schedule extraction unit 21 analyzes the schedule of the job and extracts the performance in the storage area 12 used by the job. For example, the schedule extraction unit 21 analyzes request information (for example, a job script) transmitted as a job schedule from a user or the like to the job execution device 1. Then, the schedule extraction unit 21 extracts the performance of the storage area 12 used by the job based on the request (for example, the request instruction line) regarding the storage area 12 in the request information. The schedule extraction unit 21 transmits the performance of the storage area 12 used by the job to the job management unit 22.

FIG. 8 is a diagram showing an example of job request information.

In FIG. 8, the line surrounded by the broken line is the request instruction line for the storage area 12. In this request instruction line, the job of "JOB_NAME" requests the storage area 12 having a capacity of M [GB] and a throughput of N [GB / s].

The request instruction line is not limited to the above. The request instruction line may be described using a predetermined format set in advance in the job management device 2.

Returning to the explanation with reference to FIG.

The job management unit 22 sets a time (hereinafter, referred to as “scheduled use time”) for allocating the storage area 12 to the job. Then, the job management unit 22 transmits the performance and the scheduled usage time to the storage device management device 4, and requests the storage device management device 4 to reserve the allocation of the storage device 11 corresponding to the storage area 12.

Further, the job management unit 22 transmits a “assignment request”, which is a request for allocating the storage device 11 to the job, to the storage device management device 4 at the start of the job in the job execution device 1.

Further, when the job in the job execution device 1 is completed, the job management unit 22 sends a "release request", which is a request to release the storage device 11 assigned to the job, to the storage device management device 4.

The job management unit 22 is not limited in the method of setting the time for allocating the storage area 12 to the job. The job management unit 22 may use a method of setting a job schedule used in a general information processing system as a method of setting a time for allocating a storage area 12 to a job.

The storage device management device 4 manages the storage area 12 using the storage device 11 in the storage device management system 100. Further, the storage device management device 4 may manage a process for securing the storage area 12 (for example, sharing a partition of the storage device 11).

The storage device management device 4 includes a storage device determination unit 41 and a storage device allocation unit 43. The storage device management device 4 may further include a storage device sharing unit 42.

The storage device determination unit 41 determines a partition allocation schedule in the storage device 11 so as to satisfy the performance of the storage area 12 used by the job and the scheduled use time received from the job management device 2. In this state, the partition allocated to the storage area 12 is in the reserved state. That is, the storage device determination unit 41 reserves a partition based on the performance and the scheduled usage time.

The storage device determination unit 41 may consider the arrangement of the job execution device 1 (and the storage device 11) in determining the schedule (reservation). For example, the storage device determination unit 41 determines the storage device 11 based on the logical and / or physical distance between the job execution device 1 that executes the job and the job execution device 1 including the storage device 11. May be good. Specifically, the storage device determination unit 41 is a storage device 11 that satisfies the performance and minimizes the total number of hops (or the number of intervening devices) with the job execution device 1 that executes the job. You may choose the combination of.

Upon receiving the "allocation request", the storage device allocation unit 43 allocates the storage device 11 constituting the storage area 12 to the job. More specifically, the storage device allocation unit 43 allocates the partition of the storage device 11 constituting the storage area 12 reserved for allocation to the job.

Further, when the storage device allocation unit 43 receives the "release request", the storage device allocation unit 43 releases the partition of the storage device 11 constituting the allocated storage area 12.

The storage device sharing unit 42 sets the partition sharing in the storage area 12 using the partition of the storage device 11 when the partition needs to be shared in the construction. Further, when the storage device sharing unit 42 shares the partition, the partition sharing is released when the storage area 12 is opened.

However, the storage device management system 100 does not have to use the storage device sharing unit 42. For example, the storage device management system 100 may include a RAID controller (not shown), and the RAID controller may be made to manage a partition of the storage device 11 allocated to the storage area 12 as a RAID. In this case, the partition constitutes a stripe in RAID.

The storage device management device 4 manages information for realizing these operations. An example of this information will be described with reference to the drawings. However, the storage device management device 4 may use information different from the information described below.

FIG. 2 is a diagram showing an example of the storage device management table 411 according to the first embodiment. The storage device management table 411 holds information about the storage device 11 included in the job execution device 1. The storage device management table 411 shown in FIG. 2 includes a job execution device identifier, a storage device identifier, a storage capacity, and a throughput.

The "job execution device identifier" is information for uniquely identifying the job execution device 1.

The "storage device identifier" is information for uniquely identifying the storage device 11.

The "storage capacity" is the capacity available in the storage device 11.

The "throughput" is the processing capacity of the storage device 11 per unit time.

For example, in the first line in FIG. 2, the storage device identifier “1-sda” in which the job execution device 1 having the job execution device identifier “NODE1” has a storage capacity of 1 [TB] and a throughput of 1.2 [GB / s]. It is shown that the storage device 11 is provided.

The storage device management table 411 shown in FIG. 2 includes one storage device 11 in one job execution device 1. However, this is just an example. The job execution device 1 may include a plurality of storage devices 11.

FIG. 3 is a diagram showing an example of the storage device allocation table 412 according to the first embodiment. The storage device allocation table 412 is information for managing partitions provided in each storage device 11, and is created for each storage device 11. The storage device allocation table 412 includes a partition identifier, a partition capacity, a start time, an end time, an allocation identifier, and an allocation state.

The "partition identifier" is information for uniquely identifying a partition.

"Partition capacity" is the capacity of each partition.

"Start time" and "end time" are examples of scheduled usage times, and are a start time and an end time for allocating a partition.

The "allocation identifier" is information for uniquely identifying the job to which the partition is allocated (specifically, the storage area 12 allocated to the job). A plurality of partitions may be allocated to the storage area 12. If a plurality of partitions are allocated to the same storage area 12, the same allocation identifier is set for those partitions.

In the following description, it is assumed that the storage area 12 is allocated a partition in a plurality of storage devices 11. However, as long as there are a plurality of storage devices 11, at least a part of the partitions may be partitions of the same storage device 11. For example, if the number of partitions allocated to the storage area 12 is larger than the number of storage devices 11, at least some of the storage devices 11 are allocated a plurality of partitions.

"Allocation status" indicates the current allocation status of the partition. In FIG. 3, "QUEUE" indicates reserved. "FREE" indicates an assignable state. "USE" indicates in use.

For example, the first line of FIG. 3 shows that the partition with the partition identifier “1” having a capacity of 0.1 [TB] is used from “H1: M1: S1” to “H2: M2: S2”. Further, the first line indicates that the allocation identifier of the partition is "ZZZ" and the allocation state is "QUEUE (reserved)".

Even if the storage device management device 4 manages the storage device 11 by using the information that summarizes the information about the storage device 11 (storage device management table 411) and the information about the partition (storage device allocation table 412). good.

[Explanation of operation]
Next, the operation of the storage device management system 100 according to the first embodiment will be described with reference to the drawings.

First, the operation of the job management device 2 in allocating the storage area 12 will be described with reference to the drawings.

FIG. 4 is a flow chart showing an example of an operation of setting the storage area 12 in the job management device 2 according to the first embodiment.

First, the job management device 2 receives the request information of the job in the job execution device 1 (step A400).

Next, the schedule extraction unit 21 of the job management device 2 has the performance of the storage area 12 that is planned to be used by the job included in the request information of the job (for example, the "capacity" and "throughput" of the storage area 12 allocated to the job. ) Is extracted (step A402). For example, the schedule extraction unit 21 extracts the request instruction line included in the request information.

The job management unit 22 sets the scheduled usage time for allocating the storage area 12 to the job (step A403). The job management unit 22 is not limited to the method of setting the scheduled usage time. For example, the job management unit 22 may set the scheduled usage time for allocating the storage area 12 to the job by using the job schedule method in a general information processing system.

Next, the job management unit 22 transmits the performance of the storage area 12 used by the job and the scheduled usage time to the storage device management device 4 (step A404).

The job management device 2 waits until the allocation result is received from the storage device management device 4 (No in step A415).

Upon receiving the result (Yes in step A415), the job management unit 22 determines whether or not the allocation was successful (step A405).

If the allocation is successful (Yes in step A405), the job management unit 22 adds the job to the processing queue (step A406). At that time, the job management unit 22 saves the "allocation identifier" received together with the "successful allocation" in relation to the job. For example, the job management unit 22 may include an "allocation identifier" in the job queue. Alternatively, the job management unit 22 may save the "assignment identifier" so as to be related to the job by using a database or the like. Then, the job management device 2 ends the process.

If the allocation is not possible (No in step A405), the job management unit 22 returns to step A403. Then, the job management unit 22 sets different scheduled usage times for the job to use the storage area 12. Then, the job management unit 22 repeats the above operation. That is, the job management device 2 repeats the operation until the storage device 11 to be assigned by the storage device management device 4 is determined.

Next, the operation of the storage device management device 4 will be described.

First, the operation of the storage device management device 4 in allocating the storage area 12 will be described with reference to the drawings.

FIG. 5 is a flow chart showing an example of the allocation operation in the storage device management device 4 according to the first embodiment.

The storage device determination unit 41 confirms whether or not there is a partition that satisfies the "scheduled use time" and "performance" of the storage area 12 used by the job transmitted from the job management device 2 (step B502).

The storage device determination unit 41 refers to the storage device management table 411 and the storage device allocation table 412 for this confirmation. For example, the storage device determination unit 41 uses the partition capacity of the storage device allocation table 412 to select a combination of partitions so as to satisfy the capacity of the storage area 12. Alternatively, the storage device determination unit 41 uses the throughput of the storage device management table 411 to select the storage device 11 including the partition so as to satisfy the throughput performance of the storage area 12.

However, in the description of the present embodiment, the storage device determination unit 41 determines the allocation using the partitions of the plurality of storage devices 11.

When the allocation is possible (Yes in step B502), the storage device determination unit 41 sets the partition allocation in the storage device allocation table 412 (step B503). Specifically, the storage device determination unit 41 assigns an allocation identifier (allocation identifier corresponding to a job), which is a unique value, to the partition to be allocated in the storage device allocation table 412. Then, the storage device determination unit 41 changes the allocation state of the partition to which the allocation identifier is assigned to reserved (for example, “QUEUE”). In this case, the partition to which "QUEUE" is assigned is in the reserved state to be used when the job is executed.

When there are a plurality of combinations of partitions that satisfy the received performance, the storage device determination unit 41 selects partitions by using a predetermined method. For example, the storage device determination unit 41 may select a partition so as to shorten the communication path. For example, the storage device determination unit 41 minimizes the total number of relay routes (number of hops) from the job execution device 1 that executes the job to the job execution device 1 including the storage device 11 that constitutes the allocated partition. You may also select a partition. Alternatively, the storage device determination unit 41 may select a partition so that the number of storage devices 11 constituting the partition is large in order to improve the throughput or the degree of parallelism.

The storage device determination unit 41 may determine the allocation in consideration of other information, for example, the processing time at the time of switching such as the allocation operation.

Then, the storage device determination unit 41 transmits "allocation success" together with the "allocation identifier" to the job management device 2 (step B505).

If the allocation is not possible (No in step B502), the storage device determination unit 41 transmits "unassignable" to the job management device 2 (step B504).

When transmitting "unallocated", the storage device determination unit 41 may notify the combination of partitions that can be allocated. For example, the storage device determination unit 41 extracts a combination of allottable partitions that can satisfy the performance at a time other than the received scheduled use time based on the storage device management table 411 and the storage device allocation table 412. Then, the storage device determination unit 41 may transmit the time to the job management device 2. In this case, the job management unit 22 may newly set the scheduled usage time based on this time.

When the storage device 11 is a processing unit, the storage device determination unit 41 allocates a reservation for the storage device 11 instead of the partition. Further, the storage device determination unit 41 sets the state of the storage device 11 in the predetermined information.

Next, the operation of the storage device management device 4 at the start of the job will be described with reference to the drawings.

FIG. 6 is a flow chart showing an example of an operation at the start of a job in the storage device management device 4 according to the first embodiment.

Since the job uses the storage area 12, the job management device 2 assigns the storage device 11 to the storage device management device 4 before the start of the job (predetermined time before the scheduled start time). Send a "request". The "request for allocation" is not limited. The job management device 2 and the storage device management device 4 may determine the specifications of the "assignment request" in advance. In the following description, as an example, "request for allocation" is "notification of start of job" and "allocation identifier" of the job.

The storage device determination unit 41 of the storage device management device 4 receives a “assignment request” (“notification of job start” and “allocation identifier”) from the job management device 2 (step C601).

The storage device determination unit 41 uses the storage device allocation table 412 to extract partition information corresponding to the “allocation identifier” (step C602). For example, the storage device determination unit 41 extracts the identifier of the job execution device 1 including the storage device 11 constituting the partition, the identifier of the storage device 11, the identifier of the partition, and the like as the partition information corresponding to the “allocation identifier”. ..

Next, the storage device allocation unit 43 creates a storage area 12 used by the job using the partition based on the extracted information (step C603). It is desirable that the storage device allocation unit 43 configures partitions so that the degree of parallelism among the partitions of the plurality of storage devices 11 is high. For example, the storage device allocation unit 43 creates striping using partitions.

After the creation of the storage area 12 is completed, the storage device allocation unit 43 saves the allocation setting of the created storage area 12 (step C604). For example, the storage device allocation unit 43 changes the partition allocation state in the storage device allocation table 412 to a state indicating that it is in use (for example, “USE”).

When the storage device management device 4 includes the storage device sharing unit 42, the storage device determination unit 41 may realize sharing in the storage area 12 by using the storage device sharing unit 42.

Further, the storage device management system 100 may use the created storage area 12 as a predetermined area. For example, the storage device management system 100 may use the created storage area 12 as a burst buffer area.

The burst buffer area is an area in which small access blocks are collectively accessed as a large block unit. Generally, the burst buffer area is used for high speed access. Therefore, it is desirable that the device constituting the burst buffer area has high-speed access performance.

For example, the storage device management device 4 creates a storage area 12 to be used as a burst buffer area by using an SSD whose access speed is higher than that of the magnetic storage device. Then, the storage device allocation unit 43 duplicates the file stored in the magnetic storage device in the created storage area 12. In this case, the job can operate using the file stored in the burst buffer area configured by the SSD, so that high-speed processing can be realized. However, the storage area 12 may be used as an area other than the burst buffer area.

When the storage device 11 is a processing unit, the storage device determination unit 41 allocates the storage device 11 in place of the partition. Further, the storage device determination unit 41 sets the state of the storage device 11 in the predetermined information.

Next, the operation of deleting the storage area 12 (releasing the partition allocation) in the storage device management device 4 will be described with reference to the drawings.

FIG. 7 is a flow chart showing an example of an operation of opening the assigned storage device 11 in the storage device management device 4 according to the first embodiment.

When the job is completed, the job management unit 22 of the job management device 2 sends a "request for release" of the storage device 11 assigned to the job to the storage device management device 4. The "request for opening" is not limited. The job management device 2 and the storage device management device 4 may determine the specifications of the "opening request" in advance. In the following description, as an example, the "request for release" is a "notification of the end of a job" and a "assignment identifier" of the job.

The storage device determination unit 41 of the storage device management device 4 receives a “release request” (“notification of job end” and “assignment identifier”) from the job management device 2 (step D701).

The storage device determination unit 41 extracts the partition (partition to be released) allocated to the storage area 12 based on the “allocation identifier” (step D711).

The storage device allocation unit 43 executes a necessary operation before opening the partition (step D702). For example, if there is a copied file in the storage area 12, the storage device allocation unit 43 moves or writes the file back to the copy source device. Alternatively, if there is a newly created file in the storage area 12, the storage device allocation unit 43 copies the file to a predetermined device.

The operation of step D702 may be executed by the storage device determination unit 41, the storage device sharing unit 42, or another configuration (not shown) of the storage device management device 4.

After performing the required operation, the storage device determination unit 41 releases the partition (deletes the storage area 12) (step D703). When sharing is realized by using the storage device sharing unit 42, the storage device determination unit 41 requests the storage device sharing unit 42 to release the sharing, and after the sharing is released, the partition is released.

Then, the storage device determination unit 41 updates the partition allocation state (step D704). Specifically, the storage device determination unit 41 changes the allocation state of the partition corresponding to the deleted storage area 12 in the storage device allocation table 412 to an allottable state (for example, “FREE”).

When the storage device 11 is a processing unit, the storage device determination unit 41 opens the storage device 11 in place of the partition. Further, the storage device determination unit 41 updates the state of the storage device 11 in the predetermined information.

[Explanation of effect]
Next, the effect of the storage device management system 100 according to the first embodiment will be described.

The storage device management system 100 according to the first embodiment has an effect of improving the access performance to the storage area 12 secured by using the plurality of storage devices 11.

The reason is as follows.

The storage device management system 100 includes a plurality of job execution devices 1, a job management device 2, and a storage device management device 4. Each of the job execution devices 1 includes the storage device 11 and executes a predetermined job. The job management device 2 includes a schedule extraction unit 21 and a job management unit 22. The schedule extraction unit 21 analyzes the schedule of the job processed by the job execution device 1 and extracts the performance of the storage area 12 used by the job in the schedule. The job management unit 22 sets the scheduled usage time for allocating the storage area 12 to the job. The storage device management device 4 includes a storage device determination unit 41. The storage device determination unit 41 determines a plurality of storage devices 11 to be assigned to the job so as to satisfy the performance in the storage area 12 at the scheduled use time.

As described above, the storage device management system 100 according to the first embodiment uses the storage devices 11 included in the plurality of job execution devices 1 to satisfy the performance and the scheduled usage time in the storage area 12 used by the job. The area 12 is secured. The job of the job execution device 1 uses the storage area 12 configured by using the storage devices 11 of the plurality of job execution devices 1. Therefore, the job of the job execution device 1 accesses the storage device 11 provided in the plurality of job execution devices 1. The access of the plurality of storage devices 11 is a distributed access to the plurality of job execution devices 1. Therefore, the storage device management system 100 can reduce the contention of access to individual devices (in this case, the job execution device 1).

Further, the storage device management system 100 according to the first embodiment has an effect that the storage area 12 having the performance (for example, throughput and capacity) used by the job can be set.

The reason is as follows.

First, the job management device 2 transmits the performance required for the job to the storage device management device 4. Then, the storage device management device 4 is provided in the job execution device 1 and uses the storage device 11 to construct a storage area 12 that satisfies the performance. Since it is constructed in this way, the storage area 12 constructed by using the storage device 11 is an area that satisfies the performance required by the job.

It should be noted that the job execution device 1 does not necessarily have all the same storage devices 11. For example, some job execution devices 1 may include a storage device 11 having low access performance. In this case, the storage device determination unit 41 of the storage device management device 4 may select the storage device 11 that satisfies the performance of the storage area 12 based on the performance of the storage device 11.

In general, a high performance storage device 11 is more expensive than a low performance storage device 11. Therefore, providing a storage device 11 having high performance within a necessary range can reduce the overall cost of the storage device management system 100.

[Outline of Embodiment]
Next, the outline of the first embodiment will be described.

FIG. 9 is a block diagram showing an example of the configuration of the storage device management system 101, which is an example of the outline of the storage device management system 100 according to the first embodiment.

The storage device management system 101 includes a plurality of job execution devices 1, a job management device 2, and a storage device management device 5. Each of the job execution devices 1 includes the storage device 11 and executes a predetermined job. The job management device 2 includes a schedule extraction unit 21 and a job management unit 22. The schedule extraction unit 21 analyzes the schedule of the job processed by the job execution device 1 and extracts the performance of the storage area 12 used by the job in the schedule. The job management unit 22 sets the scheduled usage time for allocating the storage area 12 to the job. The storage device management device 5 includes a storage device determination unit 41. The storage device determination unit 41 determines a plurality of storage devices 11 to be assigned to the job so as to satisfy the performance in the storage area 12 at the scheduled use time.

The storage device management system 101 configured in this way can obtain the same effect as the storage device management system 100.

The reason is that each configuration of the job management device 2 and the storage device management device 5 included in the storage device management system 101 operates in the same manner as the corresponding configuration in the storage device management system 100.

The storage device management system 101 is the minimum configuration in the embodiment of the present invention.

The job management device 2 and the storage device management device 4 may be included in one device.

FIG. 10 is a block diagram showing another configuration example outlined in the first embodiment.

The storage device management device 6 is connected to a plurality of job execution devices 1. Each of the job execution devices 1 includes the storage device 11 and executes a predetermined job. The storage device management device 6 includes a schedule extraction unit 21, a job management unit 22, and a storage device determination unit 41. The schedule extraction unit 21 analyzes the schedule of the job processed by the job execution device 1 and extracts the performance of the storage area 12 used by the recorded job in the schedule. The job management unit 22 sets the scheduled usage time for allocating the storage area 12 to the job. The storage device determination unit 41 determines a plurality of storage devices 11 to be assigned to the job so as to satisfy the performance in the storage area 12 at the scheduled use time.

The storage device management device 6 configured in this way can obtain the same effect as the storage device management system 100. The reason is that each configuration included in the storage device management device 6 operates in the same manner as the corresponding configuration in the storage device management system 100.

[Hardware configuration]
Next, the hardware configurations of the job execution device 1, the job management device 2, the storage device management device 4, the storage device management device 5, and the storage device management device 6 will be described using the storage device management device 4. Regarding the job execution device 1 and the job management device 2, the storage device management device 4 in the following description may be appropriately read as the job execution device 1, the job management device 2, the storage device management device 5, or the storage device management device 6. Just do it.

For example, each component of the storage device management device 4 may be configured by a hardware circuit.

Alternatively, in the storage device management device 4, each component unit may be configured by using a plurality of devices connected via a network.

Alternatively, in the storage device management device 4, the plurality of components may be configured by one piece of hardware.

Alternatively, the storage device management device 4 may be realized as a computer device including a CPU (Central Processing Unit), a ROM (Read Only Memory), and a RAM (Random Access Memory). The storage device management device 4 may be realized as a computer device including an input / output connection circuit (IOC: Input and Output Circuit) in addition to the above configuration. The storage device management device 4 may be realized as a computer device including a network interface circuit (NIC: Network Interface Circuit) in addition to the above configuration.

FIG. 11 is a block diagram showing a configuration of an information processing device 600, which is an example of a hardware configuration including a CPU in the storage device management device 4 according to the first embodiment.

The information processing device 600 includes a CPU 610, a ROM 620, a RAM 630, an internal storage device 640, an IOC 650, and a NIC 680, and constitutes a computer device.

The CPU 610 reads the program from the ROM 620. Then, the CPU 610 controls the RAM 630, the internal storage device 640, the IOC 650, and the NIC 680 based on the read program. Then, the computer including the CPU 610 controls these configurations and realizes each function as the storage device determination unit 41, the storage device allocation unit 43, and the storage device sharing unit 42 shown in FIG.

The CPU 610 may use the RAM 630 or the internal storage device 640 as a temporary storage medium for the program when realizing each function.

Further, the CPU 610 may read the program included in the recording medium 700 that stores the program so that it can be read by a computer by using a recording medium reading device (not shown). Alternatively, the CPU 610 may receive a program from an external device (not shown) via the NIC 680, store it in the RAM 630 or the internal storage device 640, and operate based on the stored program.

The ROM 620 stores a program executed by the CPU 610 and fixed data. The ROM 620 is, for example, a P-ROM (Programmable-ROM) or a flash ROM.

The RAM 630 temporarily stores programs and data executed by the CPU 610. The RAM 630 is, for example, a D-RAM (Synamic-RAM).

The internal storage device 640 stores data and programs stored in the information processing device 600 for a long period of time. Further, the internal storage device 640 may operate as a temporary storage device of the CPU 610. The internal storage device 640 is, for example, a hard disk device, a magneto-optical disk device, an SSD or a disk array device.

Here, the ROM 620 and the internal storage device 640 are non-volatile recording media. On the other hand, the RAM 630 is a volatile recording medium. Then, the CPU 610 can operate based on the program stored in the ROM 620, the internal storage device 640, or the RAM 630. That is, the CPU 610 can operate using a non-volatile recording medium or a volatile recording medium.

The IOC650 mediates data between the CPU 610 and the input device 660 and the display device 670. The IOC650 is, for example, an IO interface card or a USB (Universal Serial Bus) card. Further, the IOC650 is not limited to wired such as USB, and wireless may be used.

The input device 660 is a device that receives an input instruction from the operator of the information processing device 600. The input device 660 is, for example, a keyboard, a mouse, or a touch panel.

The display device 670 is a device that displays information to the operator of the information processing device 600. The display device 670 is, for example, a liquid crystal display.

NIC680 relays the exchange of data with an external device (not shown) via a network. NIC680 is, for example, a Fiber Channel card. Further, the NIC680 is not limited to wired, and wireless may be used.

The information processing device 600 configured in this way can obtain the same effect as the storage device management device 4.

The reason is that the CPU 610 of the information processing device 600 can realize the same function as the storage device management device 4 based on the program.

Although the invention of the present application has been described above with reference to the embodiments, the invention of the present application is not limited to the above-described embodiment. Various modifications that can be understood by those skilled in the art can be made to the structure and details of the present invention within the scope of the present invention.

The present invention can be applied to an information processing system that requires high performance in a storage area, for example, an HPC system, a supercomputer, and the like.

1 Job execution device 2 Job management device 3 Network 4 Storage device management device 5 Storage device management device 6 Storage device management device 11 Storage device 12 Storage area 21 Schedule extraction unit 22 Job management unit 41 Storage device determination unit 42 Storage device sharing unit 43 Storage device allocation unit 100 Storage device management system 101 Storage device management system 411 Storage device management table 412 Storage device allocation table 600 Information processing device 610 CPU
620 ROM
630 RAM
640 internal storage device 650 IOC
660 Input device 670 Display device 680 NIC
700 Recording medium

Claims (9)

A plurality of job execution devices, each including a storage device, for executing a predetermined job,
A schedule extraction means that analyzes the schedule of the job processed by the job execution device and extracts the performance of the storage area used by the job in the schedule.
A job management device including a job management means for setting a scheduled usage time for allocating the storage area to the job, and
A storage device management device including a storage device determining means for determining a plurality of the storage devices to be assigned to the job so as to satisfy the performance in the storage area at the scheduled use time.
The schedule extraction means includes the capacity and throughput of the storage area requested by the job executed in the job execution device, and the job is based on the request for the storage area included in the request information transmitted as the schedule. Extracts the performance of the storage area used by
Storage management system. The job management means sends a request for allocation of the storage device to the job to the storage device management device at the start of the job in the job execution device.
The storage device management system according to claim 1, further comprising a storage device allocation means that allocates the storage device to the job when the storage device management device receives the allocation request. At the end of the job, the job management means sends a request for opening the storage device assigned to the job to the storage device management device.
The storage device management system according to claim 2, wherein when the storage device allocating means receives the release request, the storage device assigned to the job is released. The job execution devices are distributed over the network.
The storage device management system according to any one of claims 1 to 3 . The performance includes at least the capacity and throughput that the job uses as the storage area.
The scheduled use time includes a start time and an end time.
The storage device management system according to any one of claims 1 to 4 . A storage device management system, each of which includes a storage device and includes a plurality of job execution devices that execute a predetermined job.
The schedule of the job processed by the job execution device is analyzed, and the performance of the storage area used by the job in the schedule is extracted.
Set the scheduled usage time to allocate the storage area to the job,
A plurality of the storage devices to be assigned to the job are determined so as to satisfy the performance in the storage area at the scheduled use time.
Extracting the performance of the storage area used by the job in the schedule includes the capacity and throughput of the storage area requested by the job executed in the job execution device, and the request information transmitted as the schedule Extract the performance of the storage area used by the job based on the request for the storage area including
Storage device management method. Each is connected to multiple job execution devices, including storage devices, that perform a given job.
A schedule extraction means that analyzes the schedule of the job processed by the job execution device and extracts the performance of the storage area used by the job in the schedule.
A job management means for setting the scheduled usage time for allocating the storage area to the job, and
A storage device determining means for determining a plurality of the storage devices to be assigned to the job so as to satisfy the performance in the storage area at the scheduled use time .
The schedule extraction means includes the capacity and throughput of the storage area requested by the job executed in the job execution device, and the job is based on the request for the storage area included in the request information transmitted as the schedule. Extracts the performance of the storage area used by
Storage device management device. A storage device management device, each of which includes a storage device and is connected to a plurality of job execution devices that execute a predetermined job.
The schedule of the job processed by the job execution device is analyzed, and the performance of the storage area used by the job in the schedule is extracted.
Set the scheduled usage time to allocate the storage device to the job,
A plurality of the storage devices to be assigned to the job are determined so as to satisfy the performance in the storage area at the scheduled use time.
Extracting the performance of the storage area used by the job in the schedule includes the capacity and throughput of the storage area requested by the job executed in the job execution device, and the request information transmitted as the schedule Extract the performance of the storage area used by the job based on the request for the storage area including
Storage device management method. To a computer, each of which is connected to multiple job execution devices, including storage devices, that perform a given job.
A process of analyzing the schedule of the job processed by the job execution device and extracting the performance of the storage area used by the job in the schedule.
A process of setting the scheduled usage time for allocating the storage area to the job, and
A process of determining a plurality of the storage devices to be assigned to the job is executed so as to satisfy the performance in the storage area at the scheduled use time.
The process of extracting the performance of the storage area used by the job in the schedule includes the capacity and throughput of the storage area requested by the job executed in the job execution device, and the request transmitted as the schedule. Extract the performance of the storage area used by the job based on the request for the storage area contained in the information.
program.

Images