JP6942977B2 - File distribution storage device, program, file distribution management method - Google Patents

Description

The present invention relates to a file distributed storage device, a program, and a file distributed management method, and more particularly to a file distributed storage device, a program, and a file distributed management method for managing files in a distributed manner.

A distributed file system is known in which files are distributed and stored in a plurality of servers and storage devices.

As an example of such a distributed file system, there is, for example, Patent Document 1. Patent Document 1 includes either a first file storage method in which one file is stored in one storage subsystem, or a second file storage method in which one file is stored in a plurality of storage subsystems. Describes the applicable file storage method. According to Patent Document 1, the file storage method is changed based on the usage status of the file. With this configuration, files can be properly stored in the storage subsystem.

Japanese Unexamined Patent Publication No. 2008-191915

When one file is distributed and stored in disk devices as in Patent Document 1, the file data is distributed to each disk device even when only small-sized I / O is performed. Because of this, all disk devices could be in the booted state. As a result, it is difficult to reduce the power consumption by stopping the disk device.

As described above, there has been a problem that it is difficult to suppress power consumption in a device that stores files in a distributed manner.

Therefore, an object of the present invention is to provide a file distributed storage device, a program, and a file distributed storage method that solves the problem that it is difficult to suppress power consumption in a device that stores files in a distributed manner.

A file distributed storage device, which is an embodiment of the present invention, is used to achieve such an object.
A file distribution storage device that distributes and stores files in multiple storage devices.
In response to the write request, the process of writing the data requested by the write request to one of a plurality of the storage devices according to the position in the file to which the data is written, or the read request in response to the read request. A file system control means for executing at least one of the processes of reading the requested data from any of the plurality of storage devices is provided.
The file system control means said, depending on the position in the file of the write request data for which the write request requests writing, or the position in the file for the read request data for which the read request requests reading. The configuration is to control the startup state of the storage device.

In addition, the program which is another form of the present invention
In a file distributed storage device that stores files in a distributed manner in multiple storage devices,
In response to the write request, the process of writing the data requested by the write request to one of a plurality of the storage devices according to the position in the file to which the data is written, or the read request in response to the read request. Realize a file system control means that executes at least one of the processes of reading the requested data from any of the plurality of storage devices.
The file system control means said, depending on the position in the file of the write request data for which the write request requests writing, or the position in the file for the read request data for which the read request requests reading. A program that controls the startup state of the storage device.

Further, the file distributed storage method, which is another form of the present invention, is
A file distribution storage device that distributes and stores files in multiple storage devices
In response to the write request, the process of writing the data requested by the write request to one of a plurality of the storage devices according to the position in the file to which the data is written, or the read request in response to the read request. Performing at least one of the processes of reading the requested data from any of the plurality of storage devices,
The activation state of the storage device is controlled according to the position in the file of the write request data for which the write request requests writing, or the position in the file for the read request data for which the read request requests reading. Take the configuration of doing.

The present invention provides a file distributed storage device, a program, and a file distributed storage method that solves the problem that it is difficult to suppress power consumption in a device that distributes and stores files by being configured as described above. It will be possible to provide.

It is a figure which shows an example of the whole structure of the distributed parallel file system which concerns on 1st Embodiment of this invention. It is a block diagram which shows an example of the structure of the server apparatus shown in FIG. It is a figure which shows an example of the threshold value management table shown in FIG. It is a figure which shows an example of the disk operation management table shown in FIG. It is a block diagram which shows an example of the structure of the storage device shown in FIG. It is a flowchart which shows an example of the process at the time of starting a server device. It is a flowchart which shows an example of the process when a server device generates an actual file. It is a flowchart which shows an example of the process when a server device writes data. It is a flowchart which shows an example of the process when a server device reads data. It is a flowchart which shows an example of the process of writing the data stored in a high-speed storage area to a real file storage area. It is a flowchart which shows an example of the process which controls the operation state of a real file storage area according to the free space of a real file storage area. It is a flowchart which shows an example of the process which controls the operation state of the real file storage area according to the statistical information. It is a figure which shows an example of the disk of the I / O target which changes according to the size of a file. It is a block diagram which shows an example of the structure of the file distributed storage device which concerns on 2nd Embodiment of this invention.

[First Embodiment]
The first embodiment of the present invention will be described with reference to FIGS. 1 to 13. FIG. 1 is a diagram showing an example of the overall configuration of the distributed parallel file system 1. FIG. 2 is a block diagram showing an example of the configuration of the server device 30. FIG. 3 is a diagram showing an example of the threshold value management table 303. FIG. 4 is a diagram showing an example of the disk operation management table 306. FIG. 5 is a block diagram showing an example of the configuration of the storage device 40. FIG. 6 is a flowchart showing an example of processing when starting the server device 30. FIG. 7 is a flowchart showing an example of processing when the server device 30 generates an actual file. FIG. 8 is a flowchart showing an example of processing when the server device 30 writes data. FIG. 9 is a flowchart showing an example of processing when the server device 30 reads data. FIG. 10 is a flowchart showing an example of a process of writing the data stored in the high-speed storage area 401 to the actual file storage area (actual file storage area B404, actual file storage area C405). FIG. 11 controls the operating state of the real file storage area (real file storage area B404, real file storage area C405) according to the free space of the real file storage area (real file storage area A403 or real file storage area B404). It is a flowchart which shows an example of a process. FIG. 12 is a flowchart showing an example of a process of controlling the operating state of the actual file storage area (actual file storage area B404, actual file storage area C405) according to the statistical information. FIG. 13 is a diagram showing an example of an I / O target disk that changes according to the file size.

In the first embodiment, a distributed parallel file system 1 (distributed file system) in which files are distributed and stored on a plurality of disks included in the storage device 40 will be described. The storage device 40 in the present embodiment has three disk devices, that is, a disk corresponding to the actual file storage area A403, a disk corresponding to the actual file storage area B404, and a disk corresponding to the actual file storage area C405. ing. As will be described later, the server device 30 in the present embodiment specifies an actual file storage area for writing data according to the file offset (position in the file) of the data writing destination. In other words, the server device 30 writes the data to the disk according to the file offset of the data writing destination. Further, the server device 30 controls the startup state of the disk (actual file storage area) according to the data to be written and the file offset of the data to be read. By controlling the boot state of the disc according to the file offset in this way, it is possible to boot the disc corresponding to the data to be written or the data to be read, and to keep the unnecessary disc stopped.

Referring to FIG. 1, the distributed parallel file system 1 in the present embodiment includes a plurality of client devices 10 (client devices 10-1, 10-2, ..., 10-n. Unless otherwise specified, the distributed parallel file system 1 and the client device 10 are used. (Notated), a plurality of server devices 30 (server devices 30-1, 30-2, ..., 30-m; unless otherwise specified, referred to as a server device 30) and a plurality of storage devices 40 (storage). Devices 40-1, 40-2, ..., 40-l. Unless otherwise specified, it is referred to as a storage device 40).

As shown in FIG. 1, the client device 10 and the server device 30 are connected to each other so as to be able to communicate with each other via the network 20. Communication is performed between the client device 10 and the server device 30 and between the server device 30 via the network 20. Further, one or a plurality of storage devices 40 are connected to the server device 30 so as to be able to communicate with each other.

In the present embodiment, the number of client devices 10 and the number of server devices 30 and the number of storage devices 40 included in the distributed parallel file system 1 are not particularly limited. The distributed parallel file system 1 may have one or a plurality of (any number may be) client devices 10, a server device 30, and a storage device 40.

The client device 10 is an information processing device such as a smartphone, a tablet, or a personal computer. The client device 10 operates as a client of the distributed parallel file system 1. The client device 10 performs input / output in parallel to, for example, the server device 30 which is a server of the distributed parallel file system 1. Requests sent by the client device 10 to the server device 30 include, for example, a file creation request requesting the creation of an actual file, a data write request requesting data to be written at a position specified by a file offset, and a position specified by a file offset. There is a data read request that requests data read from.

The server device 30 performs processing according to the request received from the client device 10. Referring to FIG. 2, the server device 30 includes, for example, a file system control means 301, an actual file arrangement management means 302 (a part of the file system control means 301), a threshold management table 303, and a disk monitoring timer means 304. , A storage communication means 305, a disk operation management table 306, a disk operation means 307, and a high-speed storage area monitoring means 308.

The server device 30 has, for example, a storage device (not shown) and an arithmetic unit (not shown), and the arithmetic unit executes a program stored in the storage device (not shown) to realize each of the above means.

When a request is received from the client device 10, the file system control means 301 performs processing according to the request. Then, the file system control means 301 returns the result of the processing according to the request to the client device 10. The requests received by the file system control means 301 from the client device 10 include, for example, a file creation request, a data write request, and a data read request.

For example, the file system control means 301 receives a data write request from the client device 10. Then, the file system control means 301 inquires the real file placement management means 302 about the placement location of the corresponding real file to which the data is written. After that, the file system control means 301 receives information indicating the inquiry result from the actual file arrangement management means 302. Then, the file system control means 301 writes data to the area indicated by the information returned from the actual file arrangement management means 302. As will be described later, the area in which the file system control means 301 writes data includes, for example, a high-speed storage area 401, a real file storage area A403, a real file storage area B404, and a real file storage area C405. ..

Further, the file system control means 301 receives a data read request from the client device 10. Then, the file system control means 301 refers to the metadata stored in the metadata storage area 402 and confirms whether or not the data to be read is stored in the high-speed storage area 401. Then, when the data to be read is stored in the high-speed storage area 401, the file system control means 301 reads the data from the high-speed storage area 401. On the other hand, when the data to be read is not stored in the high-speed storage area 401, the file system control means 301 inquires the actual file arrangement management means 302 for the disk startup determination. In response to this, the actual file arrangement management means 302 activates the necessary disks (actual file storage area B404 and actual file storage area C405) by using the disk operation means 307. After that, the file system control means 301 reads the data from the position corresponding to the request.

Further, the file system control means 301 determines the storage device 40 to create the actual file when the file creation request is received from the client device 10 or when the actual file needs to be created in response to the data writing request. Then, the file system control means 301 inquires of the actual file arrangement management means 302 for the I / O (Input / Output) target area. After that, the file system control means 301 receives the inquiry result from the actual file arrangement management means 302. Then, the file system control means 301 determines the actual file storage area for creating the actual file based on the returned information, and executes the actual file creation process. Further, the file system control means 301 stores the actual file storage area (location of the actual file) of the actual file creation destination in the metadata storage area 402 as metadata.

In this way, the file system control means 301 performs processing according to the request received from the client device 10.

Further, the file system control means 301 writes the data stored in the high-speed storage area 401 to the real file storage area B404 or the real file storage area C405 based on the monitoring result by the high-speed storage area monitoring means 308 described later. .. For example, when the file system control means 301 receives information from the high-speed storage area monitoring means 308 that the data size written in the high-speed storage area 401 exceeds the disk write threshold (any value may be used), the file system control means 301 actually receives information. The file arrangement management means 302 is instructed to activate the real file storage area B404 and the real file storage area C405 as needed. After that, the file system control means 301 writes data from the high-speed storage area 401 to the activated real file storage area B404 or real file storage area C405 according to the file offset of the data.

Further, the file system control means 301 reads a setting file created in advance at the time of starting the server device 30, and performs various settings based on the read setting file. For example, the file system control means 301 sets a disk write threshold value in the high-speed storage area monitoring means 308 based on the read setting file. Further, the file system control means 301 sets the disk stop time of the real file storage area B404 and the real file storage area C405 (that is, the disk) in the disk monitoring timer means 304 based on the read setting file. Further, the file system control means 301 sets each threshold value in the threshold value management table 303 based on the read setting file. Further, the file system control means 301 requests the disk operation means 307 to start or stop the actual file storage area based on the disk start threshold set in the threshold management table 303.

In this way, the file system control means 301 reads the setting file when the server device 30 is started, and performs various necessary processes. The setting file is, for example, created in advance and stored in a storage device (not shown) included in the server device 30. In the setting file, for example, disk stop time, disk write threshold value, disk start threshold value (read threshold value) for each actual file storage area, I / O target threshold value (write threshold value), free space threshold value, file tendency threshold value, etc. Contains information to indicate. The disk stop time may be different for each real file storage area, or may be common to each real file storage area.

Further, when writing data to the real file storage area that is always activated, the file system control means 301 confirms the free space of the real file storage area after the data is written. For example, the file system control means 301 confirms the free space of the actual file storage area A403 after writing data to the actual file storage area A403 in response to the data write request. Then, when the free space of the real file storage area A403 is lower than the free space threshold corresponding to the real file storage area A403, the disk start threshold and the I / O target threshold of the real file storage area B404, which is the next storage area, are actually set. Rewrite to the same value as the file storage area A403. In this way, the file system control means 301 controls the disk start threshold value and the I / O target threshold value of the threshold value management table 303 according to the free space of the actual file storage area.

Further, the file system control means 301 acquires statistical information indicating the size and number of files stored in the storage device 40 directly under the server device 30. Then, the file system control means 301 sets the disk startup threshold value to 0 when the status of the stored file satisfies a predetermined condition according to the statistical information. As a result, the file system control means 301 controls the boot state (that is, the boot state of the disk) of the real file storage area B404 and the real file storage area C405.

The statistical information may be, for example, the number of files for each predetermined file size or the ratio of the total number of files to be stored. The file system control means 301 acquires the above statistical information by, for example, when the storage device 40 stores a file, the size of the stored file is managed by a storage device (not shown) or the like. The file system control means 301 may acquire statistical information from an external device such as a file statistical information acquisition device (not shown).

As described above, the file system control means 301 is required for processing according to the request received from the client device 10, writing out the data stored in the high-speed storage area 401, and starting the server device 30. The threshold value is controlled according to the free space of the actual file storage area, and the threshold value is controlled based on the statistical information. In this way, the file system control means 301 performs overall processing of the server device 30, such as reading / writing data and initial setting.

The actual file arrangement management means 302 executes a process in response to an inquiry received from the file system control means 301. The inquiries received by the actual file arrangement management means 302 from the file system control means 301 include, for example, an inquiry of an I / O target area, an inquiry of an actual file arrangement location, an inquiry of a disk startup determination, and the like. Further, the actual file arrangement management means 302 activates the actual file storage area B404 and the actual file storage area C405 by instructing the disk operation means 307 as necessary in response to the instruction from the file system control means 301. ..

For example, the actual file arrangement management means 302 receives an inquiry of the I / O target area from the file system control means 301 when the file system control means 301 creates the actual file. Then, the actual file arrangement management means 302 compares the file size of the created actual file with the I / O target threshold value A and the I / O target threshold value B stored in the threshold value management table 303. Then, the actual file arrangement management means 302 determines the I / O target area based on the comparison result. After that, the actual file arrangement management means 302 returns the I / O target area, which is the inquiry result, to the file system control means 301.

Further, the actual file arrangement management means 302 receives an inquiry of the actual file arrangement location from the file system control means 301 when the file system control means 301 performs a process according to the write request. Then, the actual file arrangement management means 302 compares the file offset of the data writing destination (file offset of the data to be written) with the I / O target threshold value A and the I / O target threshold value B stored in the threshold value management table. Check the free space of the high-speed storage area 401. Then, the actual file arrangement management means 302 specifies the arrangement location of the actual file to which the data is written, based on the comparison result and the confirmation result. Further, the actual file arrangement management means 302 instructs the disk operating means 307 to start the stopped disk (actual file storage area B404 or actual file storage area C405) as necessary. After that, the actual file arrangement management means 302 returns the information indicating the arrangement location (area) of the actual file, which is the inquiry result, to the file system control means 301.

Further, the actual file arrangement management means 302 receives an inquiry for disc startup determination from the file system control means 301 when the file system control means 301 performs a process according to the read request. Then, the actual file arrangement management means 302 compares the file offset of the data reading destination (file offset of the data to be read) with the disk startup threshold value A and the disk startup threshold value B stored in the threshold value management table. Then, the actual file arrangement management means 302 instructs the disk operating means 307 to start the stopped disk (actual file storage area B404 or actual file storage area C405) based on the comparison result. After that, the actual file arrangement management means 302 returns to the file system control means 301 that the process corresponding to the inquiry of the disk startup determination is completed.

In this way, the actual file arrangement management means 302 executes the process in response to the inquiry received from the file system control means 301. The details of each of the above processes performed by the actual file layout management means 302 will be described later.

The threshold value management table 303 has parameters of a disk startup threshold value, an I / O target threshold value, a free space threshold value, and a file tendency threshold value for each of the actual file storage area A403, the actual file storage area B404, and the actual file storage area C405. Each parameter is set, for example, by the file system control means 301 when the server device 30 is started, based on a setting file input in advance. In other words, the threshold management table 303 is initialized by the file system control means 301 when the server device 30 is started, based on the setting file for each actual file storage area.

FIG. 3 is an example of each parameter stored in the threshold value management table 303. Referring to FIG. 3, in the threshold value management table 303, for example, as the threshold value corresponding to the actual file storage area A403, the disk startup threshold value “0”, the I / O target threshold value “0”, and the free space threshold value “free capacity threshold value A” are displayed. , The file tendency threshold "0" is set. Further, in the threshold value management table 303, for example, as the threshold value corresponding to the actual file storage area B404, the disk startup threshold value “disk startup threshold value A”, the I / O target threshold value “I / O target threshold value A”, and the free space threshold value “ Free space threshold B ”and file tendency threshold“ file tendency threshold A ”are set. Further, in the threshold value management table 303, for example, as the threshold value corresponding to the actual file storage area C405, the disk startup threshold value “disk startup threshold value B”, the I / O target threshold value “I / O target threshold value B”, and the free space threshold value “ 0 ”and the file tendency threshold“ file tendency threshold B ”are set.

The disk start threshold (read threshold) is a parameter for starting a stopped disk during the read process. The real file arrangement management means 302 is used when the file offset of the data to be read when reading data from the storage area (real file storage area A403, real file storage area B404, real file storage area C405) exceeds the disk startup threshold. The corresponding real file storage area will be activated via the disk operating means 307.

In the case of FIG. 3, the values of the disk startup threshold value A and the disk startup threshold value B may be arbitrary values, but the disk startup threshold value A is smaller than the disk startup threshold value B. Further, by setting the disk startup threshold value to a value smaller than the I / O target threshold value, the next disk to be I / O can be started before the stopped disk is accessed. Therefore, it is desirable that the disk startup threshold value is smaller than the I / O target threshold value (that is, the disk startup threshold value is preferably different from the I / O target threshold value). In other words, the disk start-up threshold value A is preferably a value smaller than the I / O target threshold value A, and the disk start-up threshold value B is preferably a value smaller than the I / O target threshold value B. When the disk startup threshold is 0, the corresponding real file storage area (disk) is always in the boot state. For example, in the case of FIG. 3, since the disk startup threshold value corresponding to the actual file storage area A403 is “0”, the actual file storage area A403 is always activated.

The I / O target threshold value (write threshold value) is a parameter for determining whether or not the corresponding storage area is the I / O target of the file. When the file size exceeds the I / O target threshold value, the storage area is targeted for I / O. For example, in the case of FIG. 3, when the file size exceeds the I / O target threshold value A, the actual file storage area A403 and the actual file storage area B404 become the I / O target area. When the file size exceeds the I / O target threshold A and further exceeds the I / O target threshold B, the actual file storage area A403, the actual file storage area B404, and the actual file storage area C405 are subject to I / O. It becomes an area. The I / O target threshold value A is smaller than the I / O target threshold value B.

As described above, according to the above-mentioned I / O target threshold value, the larger the file size, the larger the storage area can be used to ensure the performance. The actual file storage area in which 0 is set as the I / O target threshold is always the I / O target. For example, in the case of FIG. 3, the actual file storage area A403 is always an I / O target.

The free space threshold is a parameter for changing the storage area to be I / O-targeted for each file size according to the free space of the corresponding storage area. When the free space of the corresponding storage area falls below the free space threshold value, the disk start threshold value of the next storage area and the I / O target threshold value are rewritten to the same values as the values of the corresponding storage area, so that the free space due to the bias can be used. Eliminate the shortage.

For example, in the case of FIG. 3, when the free space of the real file storage area A403 is lower than the free space threshold value A, the file system control means 301 sets the disk start threshold value of the real file storage area B404, which is the next storage area, and I / O. O Rewrite the target threshold value to the same value as the value corresponding to the actual file storage area A403. That is, the file system control means 301 rewrites the disk startup threshold value A and the I / O target threshold value A to “0”. After that, when the free space of the real file storage area B404 falls below the free space threshold value B, the file system control means 301 uses the disk startup threshold value and the I / O target threshold value of the real file storage area C405, which is the next storage area. Will be rewritten to "0".

The value of the free space threshold value A and the value of the free space threshold value B may be arbitrarily set. The value of the free capacity threshold A may be a value different from the free capacity threshold B, for example, smaller than the free capacity threshold B, or may be the same value as the free capacity threshold B.

The file tendency threshold value is a parameter for dynamically changing the disk that is always started according to the file size tendency of the file stored in the storage device 40 connected to the server device 30 (own device). For example, the file system control means 301 determines based on statistical information that the proportion of all files stored in the storage device 40 whose file size exceeds the I / O target threshold is equal to or greater than the file tendency threshold. In this case, the disk startup threshold of the corresponding real file storage area is set to 0. As a result, the target real file storage area is always started, and excessive disk start / stop is prevented. The file system control means 301 corresponds to the actual file based on whether or not the ratio of the files whose file size exceeds the disk startup threshold is equal to or greater than the file tendency threshold among all the files stored in the storage device 40. It may be configured to control the disk startup threshold of the storage area.

For example, in the case of FIG. 3, when the ratio of the number of files whose file size exceeds the I / O target threshold value A is equal to or greater than the file tendency threshold value A, the file system control means 301 starts the disk of the corresponding real file storage area B404. Set the threshold to 0. Further, the file system control means 301 sets the disk startup threshold of the corresponding real file storage area C405 to 0 when the ratio of the number of files whose file size exceeds the I / O target threshold B is equal to or greater than the file tendency threshold B. It will be set.

The value of the file tendency threshold value A and the value of the file tendency threshold value B may be arbitrarily set. The value of the file tendency threshold value A may be a value different from the file tendency threshold value B, for example, smaller than the file tendency threshold value B, or may be the same value as the file tendency threshold value B.

The disk monitoring timer means 304 counts the time until the actual file storage area (disk) is stopped. Then, the disk monitoring timer means 304 instructs the disk operating means 307 to stop the disk when the timer becomes 0.

The disk monitoring timer means 304 has a timer for each actual file storage area in which the disk startup threshold value is not 0. For example, the disk monitoring timer means 304 has a timer for the real file storage area B404 and a timer for the real file storage area C405. Then, the disk monitoring timer means 304 sets a timer when the disk operating means 307 executes the booting of the disk and when the file system control means 301 writes / reads data to the corresponding real file storage area. do. In other words, for example, the disk monitoring timer means 304 sets the remaining time of the timer corresponding to the real file storage area B404 to a predetermined disk stop time when the disk operation means 307 starts the real file storage area B404. do. Further, for example, the disk monitoring timer means 304 corresponds to the real file storage area B404 when the file system control means 301 writes data to the real file storage area B404 or reads data from the real file storage area B404. Set the remaining time of the timer to a predetermined disk stop time. If the timer has already been set and the timer is being counted, the disk monitoring timer means 304 resets the timer again. That is, the disk monitoring timer means 304 sets the remaining time of the corresponding timer to a predetermined disk stop time. The disk stop time, which is a value set in the timer, is set by the file system control means 301 by inputting a setting file when the system is started.

The storage communication means 305 communicates with the storage device 40 connected to the server device 30 which is its own device.

The disk operation management table 306 has the operation state of the disk as parameters for the actual file storage area A403, the actual file storage area B404, and the actual file storage area C405. The disk operating means 307 registers the operating state (“starting”, “stopping”) of the disk when the disk operating means 307 starts / stops the disk. When the disk is started, the disk operation means 307 sets the timer of the started real file storage area in the disk monitoring timer means 304.

FIG. 4 is an example of the parameters stored in the disk operation management table 306. Referring to FIG. 4, in the disk operation management table 306, for example, the operation state “start” is set as a threshold value corresponding to the actual file storage area A403. Further, in the disk operation management table 306, for example, the operation state "stop" is set as a threshold value corresponding to the actual file storage area B404. Further, in the disk operation management table 306, for example, the operation state "stop" is set as a threshold value corresponding to the actual file storage area C405. Therefore, in the case shown in FIG. 4, it can be seen that the actual file storage area A403 is activated, while the actual file storage area B404 and the actual file storage area C405 are stopped.

The disk operating means 307 receives a request from the actual file arrangement management means 302, and uses the storage communication means 305 to start or stop the disk in response to the request. Further, the disk operating means 307 registers and reflects the operating status of the disk after the operation in the disk operation management table 306.

The high-speed storage area monitoring means 308 monitors the data size written in the high-speed storage area 401 at regular time intervals (any interval is acceptable) via the file system control means 301. When the data size written in the high-speed storage area 401 exceeds the disk writing threshold, the high-speed storage area monitoring means 308 transfers the data written in the high-speed storage area 401 to the real file storage area B404 or the real file storage area C405. Instruct the file system control means 301 to write. As described above, the disk write threshold is set by the file system control means 301 by inputting the setting file when the system is started.

The above is an example of the configuration of the server device 30.

The storage device 40 stores data based on the control from the server device 30. Referring to FIG. 5, the storage device 40 has, for example, a high-speed storage area 401, a metadata storage area 402, a real file storage area A403, a real file storage area B404, and a real file storage area C405. ing. As described above, the actual file storage area A403, the actual file storage area B404, and the actual file storage area C405 each correspond to a disk.

The high-speed storage area 401 is a storage device such as a memory. The high-speed storage area 401 is used as a temporary buffer for concealing the disk startup time when writing data to the real file storage area B404 or the real file storage area C405, for example.

As described above, the usage of the high-speed storage area 401 is monitored by the high-speed storage area monitoring means 308. When the used capacity of the high-speed storage area 401 exceeds the disk writing threshold value, the file system control means 301 writes the data stored in the high-speed storage area 401 to the real file storage area B404 or the real file storage area C405. When the file system control means 301 succeeds in writing, the file system control means 301 deletes the corresponding data in the high-speed storage area 401.

The metadata storage area 402 stores the metadata information of the file managed by the file system control means 301. The metadata information includes information on which area the actual file is located.

The real file storage area A403 is a disk device that stores the divided real files (data). The real file storage area A403 is started by the disk operating means 307 when the server is started. In the case of this embodiment, the actual file storage area A403 is always in the activated state.

The actual file storage area B404 and the actual file storage area C405 are disk devices for storing the divided actual files (data). The real file storage area B404 and the real file storage area C405 are started and stopped based on an instruction from the disk operating means 307. The operating status of the actual file storage area B404 and the actual file storage area C405 is managed by the disk operation management table 306.

The above is an example of the configuration of the storage device 40.

Subsequently, an example of the processing performed by the server device 30 and the storage device 40 will be described with reference to FIGS. 6 to 12. First, with reference to FIG. 6, an example of a process (initialization process) when starting the server device 30 will be described.

Referring to FIG. 6, when the server device 30 is started in step S101, the file system control means 301 is started. Then, the activated file system control means 301 reads the setting file created in advance (step S102).

The file system control means 301 takes the read setting file as an input and sets a disk write threshold value in the high-speed storage area monitoring means 308 (step S103). Further, the file system control means 301 sets the disk stop time of the real file storage area B404 and the real file storage area C405 in the disk monitoring timer means 304 by inputting the read setting file (step S104). Further, the file system control means 301 sets each threshold value in the threshold value management table 303 by inputting the read setting file (step S105). The processing of step S103, the processing of step S104, and the processing of step S105 are in no particular order. For example, the process of step S104 or the process of step S105 may be performed before the process of step S103.

After the process of step S105, the file system control means 301 confirms the value set in the threshold value management table 303. Then, the file system control means 301 requests the disk operation means 307 to start the disk for the actual file storage area in which the disk start threshold value is 0 (step S106). Further, the file system control means 301 requests the disk operation means 307 to stop the disk for the actual file storage area in which the disk start threshold value is not 0 (step S106). For example, when the threshold management table 303 is as shown in FIG. 3, the file system control means 301 requests the disk operation means 307 to start the disk for the real file storage area A403, while the real file storage area B404 and the real file. Requests the disk operating means 307 to stop the disk for the storage area C405.

The above is an example of the initialization process of the server device 30. Subsequently, with reference to FIG. 7, an example of the determination process of the I / O target area when a new actual file is created by the file creation request or the data write request from the client device 10 will be described.

Referring to FIG. 7, when creating a new real file, the file system control means 301 determines the storage device 40 to which the real file is created (step S201). In the present embodiment, the method of determining the storage device 40 of the actual file creation destination is not particularly limited. The file system control means 301 can determine the storage device 40 of the actual file creation destination by using various methods such as determining the storage device 40 of the actual file creation destination based on the free space of the storage device 40. You can. After that, the file system control means 301 inquires of the real file arrangement management means 302 about the real file storage area to be the I / O target (step S202). In other words, the file system control means 301 inquires of the actual file arrangement management means 302 for the I / O target area.

Upon receiving the inquiry of the I / O target area, the actual file arrangement management means 302 refers to the threshold value management table 303 and confirms whether or not the file size of the actual file to be created exceeds the I / O target threshold value A ( Step S203). When the file size exceeds the I / O target threshold value A (step S203, Yes), the actual file arrangement management means 302 targets the actual file storage area B404 as the I / O target. That is, the real file storage area B404 is added to the I / O target area (step S207). Further, the actual file arrangement management means 302 confirms whether or not the file size of the created actual file exceeds the I / O target threshold value B (step S208). When the file size exceeds the I / O target threshold value B (step S208, Yes), the actual file arrangement management means 302 targets the actual file storage area C405 as the I / O target. That is, the real file storage area C405 is added to the I / O target area (step S209).

When the file size is equal to or less than the I / O target threshold A (step S203, No), or when the file size is equal to or less than the I / O target threshold B (step S208, No), or after the processing of step S209. , The actual file arrangement management means 302 returns the I / O target area to the file system control means 301 (step S204). In other words, when the file size is equal to or less than the I / O target threshold value A, the actual file layout management means 302 returns information to the effect that the actual file storage area A403 is the I / O target to the file system control means 301. Further, when the file size exceeds the I / O target threshold A and is equal to or less than the I / O target threshold B, the actual file arrangement management means 302 sets the actual file storage area A403 and the actual file storage area B404 to I / O. The information to that effect is returned to the file system control means 301. Further, when the file size exceeds the I / O target threshold B, the actual file arrangement management means 302 provides information that the actual file storage area A403, the actual file storage area B404, and the actual file storage area C405 are targeted for I / O. Is returned to the file system control means 301.

The file system control means 301 determines the real file storage area for creating the real file based on the information received from the real file arrangement management means 302 (step S205). For example, when the file system control means 301 receives information from the real file arrangement management means 302 that the real file storage area A403 is the target of I / O, the real file storage area for creating the real file is the real file storage area. Determine to be A403.

The file system control means 301 executes a real file creation process in the determined real file storage area (step S206). After that, the file system control means 301 registers the real file storage area of the creation destination where the real file is created in the metadata, and ends the process.

The above is an example of processing when creating an actual file. Subsequently, with reference to FIG. 8, an example of processing when a data write request is received from the client device 10 will be described.

Referring to FIG. 8, the file system control means 301 receives a data write request. Then, the file system control means 301 refers to the metadata stored in the metadata storage area 402 and confirms whether or not it is necessary to create an actual file (step S301). When it is necessary to create an actual file (step S301, Yes), the file system control means 301 executes the actual file creation process (step S302). Since the actual file creation process has already been described with reference to FIG. 7, the details will be omitted.

When it is not necessary to create the actual file (step S301, No), or after the actual file is created, the file system control means 301 inquires the actual file arrangement management means 302 about the actual file arrangement location (step S303).

Upon receiving the inquiry of the actual file arrangement location, the actual file arrangement management means 302 confirms whether the file offset of the data writing destination exceeds the I / O target threshold value A registered in the threshold value management table 303 (step S304). ).

When the file offset of the data writing destination is equal to or less than the I / O target threshold A registered in the threshold management table 303 (step S304, No), the data writing destination of the actual file arrangement management means 302 stores the actual file. Information indicating that the area is A403 is returned to the file system control means 301. As a result, the file system control means 301 writes data to the actual file storage area A403 and ends the process (step S305).

On the other hand, when the file offset exceeds the I / O target threshold value A (step S304, Yes), the actual file arrangement management means 302 confirms whether or not there is sufficient free space in the high-speed storage area 401 (step S306). .. The actual file layout management means 302 confirms whether or not there is sufficient free space in the high-speed storage area 401 by comparing, for example, a predetermined threshold value with the free space in the high-speed storage area 401. How much free space is judged to be sufficient free space (that is, a threshold value) may be arbitrarily set.

When there is sufficient free space in the high-speed storage area 401 (step S306, Yes), the actual file arrangement management means 302 sends information indicating that the data writing destination is the high-speed storage area 401 to the file system control means 301. return. As a result, the file system control means 301 writes data to the high-speed storage area 401 and ends the process (step S307). On the other hand, when there is not enough free space in the high-speed storage area 401 (step S306, No), the actual file arrangement management means 302 confirms whether the file offset exceeds the I / O target threshold value B (step S308).

When the file offset is equal to or less than the I / O target threshold value B (steps S308, No), the actual file allocation management means 302 refers to the disk operation management table 306 and confirms whether or not the actual file storage area B404 is stopped. (Step S309). Then, when the actual file storage area B404 is stopped (step S309, Yes), the actual file arrangement management means 302 issues a start request for the actual file storage area B404 to the disk operating means 307. As a result, the disk operating means 307 activates the actual file storage area B404 (step S311). After the processing of step S311 or when the actual file storage area B404 is not stopped (step S309, No), the actual file arrangement management means 302 indicates that the data is written to the actual file storage area B404. The indicated information is returned to the file system control means 301. As a result, the file system control means 301 writes data to the actual file storage area B404 (step S310). Further, the file system control means 301 requests the disk monitoring timer means 304 to set a timer for the actual file storage area B404. After that, the file system control means 301 ends the process.

On the other hand, when the file offset exceeds the I / O target threshold value B (step S308, Yes), the actual file allocation management means 302 refers to the disk operation management table 306 and determines whether the actual file storage area C405 is stopped. Confirm (step S312). Then, when the actual file storage area C405 is stopped (step S312, Yes), the actual file arrangement management means 302 issues a start request for the actual file storage area C405 to the disk operating means 307. As a result, the disk operating means 307 activates the actual file storage area C405 (step S314). After the processing of step S314, or when the actual file storage area C405 is not stopped (step S312, No), the actual file arrangement management means 302 indicates that the data writing destination is the actual file storage area C405. The indicated information is returned to the file system control means 301. As a result, the file system control means 301 writes data to the actual file storage area C405 (step S310). Further, the file system control means 301 requests the disk monitoring timer means 304 to set a timer for the actual file storage area C405. After that, the file system control means 301 ends the process.

The above is an example of processing when a data write request is received from the client device 10. Subsequently, with reference to FIG. 9, an example of processing when a data read request is received from the client device 10 will be described.

Referring to FIG. 9, the file system control means 301 receives a data read request. Then, the file system control means 301 refers to the metadata stored in the metadata storage area 402 and confirms whether or not the data to be read is stored in the high-speed storage area 401 (step S401).

When the data to be read is stored in the high-speed storage area 401 (step S401, Yes), the file system control means 301 reads the data from the high-speed storage area 401 and ends the process (step S402). On the other hand, when the data to be read is not stored in the high-speed storage area 401 (step S401, No), the file system control means 301 inquires the actual file arrangement management means 302 for a disk start determination (step S403).

Upon receiving the inquiry for determining the disk startup, the actual file layout management means 302 confirms whether or not the file offset of the data read destination exceeds the disk startup threshold value A registered in the threshold value management table 303 (step S404).

When the file offset exceeds the disk startup threshold value A (step S404, Yes), the actual file allocation management means 302 refers to the disk operation management table 306 and confirms whether or not the actual file storage area B404 is stopped (step S406). ). Then, when the actual file storage area B404 is stopped (step S406, Yes), the actual file arrangement management means 302 issues a start request for the actual file storage area B404 to the disk operating means 307. As a result, the disk operating means 307 activates the real file storage area B404 (step S408).

After the processing of step S408, or when the actual file storage area B404 is not stopped (step S406, No), the actual file arrangement management means 302 causes the file offset of the data read destination to exceed the disk start threshold value B. Whether or not it is confirmed (step S407).

When the file offset exceeds the disk startup threshold value B (step S407, Yes), the actual file allocation management means 302 refers to the disk operation management table 306 and confirms whether or not the actual file storage area C405 is stopped (step S409). ). Then, when the actual file storage area C405 is stopped (step S409, Yes), the actual file arrangement management means 302 issues a start request for the actual file storage area C405 to the disk operating means 307. As a result, the disk operating means 307 activates the actual file storage area C405 (step S410).

After the processing of step S410, when the file offset is equal to or less than the disk startup threshold B (step S407, No), or when the file offset is equal to or less than the disk startup threshold A (step S404, No), the actual situation. The file arrangement management means 302 returns to the file system control means 301 that the process corresponding to the inquiry of the disk startup determination has been completed.

The file system control means 301 reads the data for which the read request has been made from the storage area indicated by the read request (step S405). After that, the file system control means 301 requests the disk monitoring timer means 304 to set a timer, and ends the process.

The above is an example of processing when a data read request is received from the client device 10. Subsequently, with reference to FIG. 10, an example of a process of writing the data written in the high-speed storage area 401 to the real file storage area B404 or the real file storage area C405 will be described.

Referring to FIG. 10, the high-speed storage area monitoring means 308 monitors, for example, the data size written in the high-speed storage area 401 at predetermined intervals (step S501). The timing at which the high-speed storage area monitoring means 308 monitors the high-speed storage area 401 may be arbitrarily set.

When the data size written in the high-speed storage area 401 exceeds the data writing threshold (any value may be used) (step S501, Yes), the high-speed storage area monitoring means 308 actually outputs the data written in the high-speed storage area 401. Instruct the file system control means 301 to write to the file storage area B404 or the actual file storage area C405.

Upon receiving the above instruction, the file system control means 301 instructs the real file arrangement management means 302 to activate the real file storage area B404 and the real file storage area C405 as needed. Then, the actual file arrangement management means 302 refers to the disk operation management table 306 and confirms whether or not the actual file storage area B404 is stopped (step S502). Then, when the actual file storage area B404 is stopped (step S502, Yes), the actual file arrangement management means 302 issues a start request for the actual file storage area B404 to the disk operation means 307. As a result, the disk operating means 307 activates the actual file storage area B404 (step S505).

After the processing of step S505, or when the actual file storage area B404 is not stopped (steps S502, No), the actual file arrangement management means 302 has a file offset in the data stored in the high-speed storage area 401. It is confirmed whether or not there is data exceeding the I / O target threshold value B registered in the threshold value management table 303 (step S503).

When there is data whose file offset exceeds the I / O target threshold value B (step S503, Yes), the actual file allocation management means 302 refers to the disk operation management table 306 and determines whether the actual file storage area C405 is stopped. Is confirmed (step S506). Then, when the actual file storage area C405 is stopped (step S506, Yes), the actual file arrangement management means 302 issues a start request for the actual file storage area C405 to the disk operation means 307. As a result, the disk operating means 307 activates the actual file storage area C405 (step S507).

After the processing of step S507, when the actual file storage area C405 is not stopped (step S506, No), or when there is no data whose file offset exceeds the I / O target threshold value B (step). S503, No), the actual file arrangement management means 302 returns to the file system control means 301 that the processing according to the instruction has been completed.

The file system control means 301 writes data to an area corresponding to the file offset (step S504). For example, when there is no data whose file offset exceeds the I / O target threshold value B, the file system control means 301 writes the data from the high-speed storage area 401 to the actual file storage area B404. Further, the file system control means 301 requests the disk monitoring timer means 304 to set a timer for the actual file storage area B404. After that, the file system control means 301 ends the process. Further, for example, when there is data whose file offset exceeds the I / O target threshold B, the file system control means 301 changes from the high-speed storage area 401 to the actual file storage area B404 or the actual file according to the file offset of the data. Write data to the file storage area C405. Further, the file system control means 301 requests the disk monitoring timer means 304 to set timers for the real file storage area B404 and the real file storage area C405. After that, the file system control means 301 ends the process.

The above is an example of the process of writing the data written in the high-speed storage area 401 to the real file storage area B404 or the real file storage area C405. Subsequently, with reference to FIG. 11, an example of a process of controlling the disk startup threshold value and the I / O target threshold value according to the free space of the actual file storage area will be described. By changing the I / O target area for each file size when the free disk space is reduced, the area can be expanded before the free space of one storage area is exhausted.

Referring to FIG. 11, when writing to the actual file storage area A403, the file system control means 301 has the free space of the actual file storage area A403 equal to or greater than the free space threshold value A registered in the threshold value management table 303. Whether or not it is confirmed (step S601).

When the free space of the real file storage area A403 is equal to or greater than the free space threshold value A (step S601, Yes), the file system control means 301 ends the process. On the other hand, when the free space of the real file storage area A403 is less than the free space threshold value A (step S601, No), the file system control means 301 is a disk corresponding to the real file storage area B404 registered in the threshold value management table 303. Set the activation threshold to "0". That is, the file system control means 301 sets the value of the disk startup threshold value A to "0" (step S602). Further, the file system control means 301 sets the I / O target threshold value corresponding to the actual file storage area B404 registered in the threshold value management table 303 to “0”. That is, the file system control means 301 sets the value of the I / O target threshold value A to “0” (step S603).

The file system control means 301 confirms whether or not the free space of the actual file storage area B404 is equal to or greater than the free space threshold B registered in the threshold management table 303 (step S604). If the actual file storage area B404 is already in the always-started state, the file system control means 301 may start the process from the process of step S604. That is, the file system control means 301 can confirm whether or not the free space of the real file storage area B404 is equal to or greater than the free space threshold value B when writing to the real file storage area B404.

When the free space of the real file storage area B404 is equal to or greater than the free space threshold value B (step S604, Yes), the file system control means 301 ends the process. On the other hand, when the free space of the real file storage area B404 is less than the free space threshold value B (step S604, No), the file system control means 301 is a disk corresponding to the real file storage area C405 registered in the threshold value management table 303. Set the activation threshold to "0". That is, the file system control means 301 sets the value of the disk startup threshold value B to “0” (step S605). Further, the file system control means 301 sets the I / O target threshold value corresponding to the actual file storage area C405 registered in the threshold value management table 303 to “0”. That is, the file system control means 301 sets the value of the I / O target threshold value B to “0” (step S606).

The above is an example of the process of controlling the disk startup threshold value and the I / O target threshold value according to the free space of the actual file storage area. Subsequently, with reference to FIG. 12, an example of the process of controlling the disk startup threshold value based on the statistical information will be described. By resetting the disk boot threshold according to the tendency of the file size, it is possible to prevent excessive booting or stopping of the disc.

Referring to FIG. 12, the file system control means 301 confirms the status (trend) of the file based on the statistical information, for example, periodically (at any interval). For example, the file system control means 301 refers to the threshold value management table 303, and the file size of the entire file stored in the storage device 40 connected to the server device 30 which is its own device is the I / O target threshold value. It is confirmed whether or not the ratio of the number of files exceeding A is equal to or higher than the file tendency threshold A (step S701).

When the ratio of the number of files whose file size exceeds the I / O target threshold value A to the total files stored in the storage device 40 is less than the file tendency threshold value A (step S701, No), the file system control means 301 determines. End the process. On the other hand, when the ratio of the number of files whose file size exceeds the I / O target threshold value A to the total files stored in the storage device 40 is equal to or greater than the file tendency threshold value A (step S701, Yes), the file system control means 301. Sets the disk startup threshold corresponding to the actual file storage area B404 registered in the threshold management table 303 to 0. That is, the file system control means 301 sets the value of the disk startup threshold value A to "0" (step S702).

Subsequently, the file system control means 301 confirms whether or not the ratio of the number of files whose file size exceeds the I / O target threshold B is equal to or greater than the file tendency threshold B among the entire files stored in the storage device 40. (Step S703).

When the ratio of the number of files whose file size exceeds the I / O target threshold value B to the total files stored in the storage device 40 is less than the file tendency threshold value B (step S703, No), the file system control means 301 determines. End the process. On the other hand, when the ratio of the number of files whose file size exceeds the I / O target threshold value B to the entire files stored in the storage device 40 is equal to or greater than the file tendency threshold value B (step S703, Yes), the file system control means 301. Sets the disk startup threshold corresponding to the actual file storage area C405 registered in the threshold management table 303 to 0. That is, the file system control means 301 sets the value of the disk startup threshold value B to "0" (step S704).

The above is an example of the process of controlling the disk boot threshold value based on the statistical information.

The items described in the present embodiment can be summarized as shown in FIG. 13, for example. Referring to FIG. 13, when the file size is equal to or less than the I / O target threshold value A, only the actual file storage area A403 is the I / O target disk. When the file size exceeds the I / O target threshold A and is equal to or less than the I / O target threshold B, the actual file storage area A403 and the actual file storage area B404 become I / O target disks. .. When the file size exceeds the I / O target threshold value B, the actual file storage area A403, the actual file storage area B404, and the actual file storage area C405 become I / O target disks.

In other words, when the file offset of the data writing destination or the file offset of the data reading destination is equal to or less than the I / O target threshold value A, the data writing destination or reading destination is the actual file storage area A403. If the file offset of the data writing destination or the file offset of the data reading destination exceeds the I / O target threshold A and is equal to or less than the I / O target threshold B, the data writing destination or reading destination is stored in the actual file. Area B404 (when high-speed storage area 401 is not considered). When the file offset of the data writing destination or the file offset of the data reading destination exceeds the I / O target threshold value B, the data writing destination or reading destination becomes the actual file storage area C405 (considering the high-speed storage area 401). If not).

As described above, the server device 30 in the present embodiment has the file system control means 301, the actual file arrangement management means 302, and the threshold value management table 303. With such a configuration, the actual file arrangement management means 302 can specify the actual file storage area of the data write destination and the read destination based on the threshold value management table 303 and the file offset of the data write destination / read destination. You can. As a result, it is possible to concentrate access to the disk to a part of the disk, and it is possible to provide a disk that can be stopped by the power saving function of the storage. By stopping the disk, it becomes possible to reduce power consumption while maintaining the required performance as compared with the conventional case.

In the present embodiment, the storage device 40 has three real file storage areas, a real file storage area A403, a real file storage area B404, and a real file storage area C405. However, the number of actual file storage areas included in the storage device 40 is not limited to three. The storage device 40 may have two real file storage areas, or may have an arbitrary number of four or more real file storage areas. Further, in the present embodiment, the threshold value is set in two stages, but a smaller threshold value may be set, or a more multi-step threshold value may be set. Further, in the present embodiment, it is assumed that the storage device 40 has a high-speed storage area 401. However, the high-speed storage area 401 may be possessed by the server device 30. The server device 30 may be configured to have a plurality of real file storage areas.

Further, the server device 30 may be configured to calculate the I / O target area each time an actual file is needed, or may be configured according to the file size specified at the file creation stage. The I / O target area may be determined and an actual file may be created.

Further, in the present embodiment, an example in which one file is distributed to a plurality of real file storage areas in one storage device 40 has been described. However, the server device 30 may be configured to distribute one file to a plurality of real file storage areas in the plurality of storage devices.

[Second Embodiment]
Next, a second embodiment of the present invention will be described with reference to FIG. FIG. 14 shows an example of the configuration of the file distributed storage device 5.

In the second embodiment of the present invention, the outline of the configuration of the file distributed storage device 5 that distributes and stores files in a plurality of storage devices will be described. The plurality of storage devices are provided outside the file distribution storage device 5, for example. The file distributed storage device 5 may have the plurality of storage devices.

Referring to FIG. 14, the file distribution storage device 5 includes a file system control means 51. For example, the file distributed storage device 5 has an arithmetic unit (not shown) and a storage device (not shown), and the file system control is performed by the arithmetic unit (not shown) executing a program stored in the storage device (not shown). The means 51 is realized.

In response to a write request from an external device or the like, the file system control means 51 writes data to any of a plurality of storage devices according to the position in the file of the write destination of the data requested by the write request, or , At least one of the processes of reading the data requested by the read request from any of the plurality of storage devices in response to the read request is executed.

Further, the file system control means 51 sets the storage device according to the position in the file of the write request data for which the write request requests writing, or the position in the file for the read request data for which the read request requests reading. Control the startup state

As described above, the file distributed storage device 5 in the present embodiment has the file system control means 51. With such a configuration, the file system control means 51 responds to the position in the file of the write request data for which the write request requests writing, or the position in the file for the read request data for which the read request requests reading. , It is possible to control the activation state of the storage device. As a result, it is possible to activate only the necessary storage devices, and it is possible to suppress power consumption in the devices that store files in a distributed manner.

Further, the above-mentioned file distributed storage device 5 can be realized by incorporating a predetermined program into the file distributed storage device 5. Specifically, the program according to another embodiment of the present invention stores the data in the file distributed storage device 5 in which the files are distributed and stored in a plurality of storage devices, in response to the write request, the data requested by the write request is stored in the data. At least the process of writing to one of a plurality of storage devices according to the position in the file to which the data is written, or the process of reading the data requested by the read request from any of the plurality of storage devices in response to a read request. The file system control means 51 that executes one of the two is realized, and the file system control means 51 is the position in the file of the write request data that the write request requests to write, or the read request data that the read request requests to read. This is a program for realizing a process of controlling the startup state of a storage device according to a position in a file.

Further, in the file distributed storage method executed by the file distributed storage device 5 described above, the file distributed storage device 5 that distributes and stores the files in a plurality of storage devices requests the write request in response to the write request. The process of writing data to one of a plurality of storage devices according to the position in the file to which the data is written, or the process of reading the data requested by the read request from one of the plurality of storage devices in response to a read request. Performs at least one of the processes, depending on the location in the file of the write request data that the write request requests to write, or the position in the file of the read request data that the read request requests to read. It is a method of controlling the startup state.

Even the invention of the program or the file distributed storage method having the above-mentioned configuration can achieve the above-mentioned object of the present invention because it has the same operation as the above-mentioned file distributed storage device 5.

<Additional notes>
Part or all of the above embodiments may also be described as in the appendix below. Hereinafter, the outline of the file distributed storage device and the like in the present invention will be described. However, the present invention is not limited to the following configurations.

(Appendix 1)
A file distribution storage device that distributes and stores files in multiple storage devices.
In response to a write request, a process of writing data to one of a plurality of the storage devices according to a position in a file to which the data to be written requested by the write request is written, or a read request is requested in response to a read request. A file system control means for executing at least one of a process of reading data to be stored from one of the plurality of storage devices is provided.
The file system control means said, depending on the position in the file of the write request data for which the write request requests writing, or the position in the file for the read request data for which the read request requests reading. A file-distributed storage device that controls the startup state of the storage device.
(Appendix 2)
The file distributed storage device according to Appendix 1.
The file system control means is a file distributed storage device that activates the storage device based on the position of the write request data or the read request data in the file and a predetermined threshold value.
(Appendix 3)
The file distributed storage device described in Appendix 2,
The file system control means is a file distributed storage device that activates a new storage device when the position of the write request data or the read request data in the file exceeds the threshold value.
(Appendix 4)
The file distributed storage device according to Appendix 2 or 3.
The write threshold value, which is the threshold value to be compared with the position of the write request data in the file, and the read threshold value, which is the threshold value to be compared with the position of the read request data in the file, have different values. File distributed storage device.
(Appendix 5)
The file distributed storage device according to Appendix 4, wherein the file is distributed and stored.
A file distributed storage device in which the read threshold value is smaller than the write threshold value.
(Appendix 6)
The file distributed storage device according to any one of Appendix 1 to 5.
At least one of the storage devices is always in the activated state
The file system control means is a file that controls the storage device that is always in the activated state so that when the free space of the storage device becomes less than a predetermined free space threshold value, the new storage device is always in the activated state. Distributed storage device.
(Appendix 7)
The file distributed storage device according to any one of Supplementary notes 1 to 6.
The file system control means is a file distributed storage device that controls an activation state of the storage device based on a file status stored by the storage device and a predetermined file tendency threshold value.
(Appendix 8)
The file distributed storage device according to Appendix 7.
When the ratio of the number of files in which the size of the file to the number of files stored in the storage device exceeds the predetermined comparison threshold value is equal to or larger than the predetermined file tendency threshold value, the file system control means newly described. A file distribution management device that controls the storage device so that it is always in the activated state.
(Appendix 9)
In a file distributed storage device that stores files in a distributed manner in multiple storage devices,
In response to the write request, the process of writing the data requested by the write request to one of a plurality of the storage devices according to the position in the file to which the data is written, or the read request in response to the read request. Realize a file system control means that executes at least one of the processes of reading the requested data from any of the plurality of storage devices.
The file system control means said, depending on the position in the file of the write request data for which the write request requests writing, or the position in the file for the read request data for which the read request requests reading. A program that controls the startup state of a storage device.
(Appendix 9-1)
The program described in Appendix 9
The file system control means is a program that activates the storage device based on the position of the write request data or the read request data in the file and a predetermined threshold value.
(Appendix 9-2)
The program described in Appendix 9-1.
The file system control means is a program that activates a new storage device when the position of the write request data or the read request data in the file exceeds the threshold value.
(Appendix 10)
A file distribution storage device that distributes and stores files in multiple storage devices
In response to the write request, the process of writing the data requested by the write request to one of a plurality of the storage devices according to the position in the file to which the data is written, or the read request in response to the read request. Performing at least one of the processes of reading the requested data from any of the plurality of storage devices,
The activation state of the storage device is controlled according to the position in the file of the write request data for which the write request requests writing, or the position in the file for the read request data for which the read request requests reading. File distributed storage method.
(Appendix 10-1)
The file distributed storage method according to Appendix 10.
A file distributed storage method for activating the storage device based on the position of the write request data or the read request data in the file and a predetermined threshold value.
(Appendix 10-2)
The file distributed storage method according to Appendix 10-1.
A file distributed storage method for activating a new storage device when the position of the write request data or the read request data in the file exceeds the threshold value.

The programs described in each of the above embodiments and appendices may be stored in a storage device or recorded in a computer-readable recording medium. For example, the recording medium is a portable medium such as a flexible disk, an optical disk, a magneto-optical disk, and a semiconductor memory.

Although the present invention has been described above with reference to each of the above embodiments, the present invention is not limited to the above-described embodiments. Various changes that can be understood by those skilled in the art can be made to the structure and details of the present invention within the scope of the present invention.

1 Distributed parallel file system 10 Client device 20 Network 30 Server device 301 File system control means 302 Actual file placement management means 303 Threshold management table 304 Disk monitoring timer means 305 Storage communication means 306 Disk operation management table 307 Disk operation means 308 High-speed storage area Monitoring means 40 Storage device 401 High-speed storage area 402 Metadata storage area 403 Real file storage area A
404 Real file storage area B
405 Real file storage area C
5 File distributed storage device 51 File system control means

Claims (10)

A file distribution storage device that distributes and stores files in multiple storage devices.
In response to a write request, the management means is inquired about the file location, and data is written to any of the plurality of storage devices according to the file offset of the data write destination requested by the write request, or the read request is made. A file system control means for executing at least one of a process of reading data requested by the read request from any of the plurality of storage devices is provided.
The file system control means activates the storage device according to the file offset of the write request data for which the write request requests writing, or the file offset of the read request data for which the read request requests reading. Control the state,
The file system control means activates the storage device based on the file offset of the write request data or the read request data and a predetermined threshold value.
The file distribution has different values between the write threshold value, which is the threshold value to be compared with the file offset of the write request data, and the read threshold value, which is the threshold value to be compared with the file offset of the read request data. Storage device. The file distributed storage device according to claim 1.
A file distributed storage device in which the read threshold value is smaller than the write threshold value. The file distributed storage device according to claim 1 or 2.
At least one of the storage devices is always in the activated state
The file system control means is a file that controls the storage device that is always in the activated state so that when the free space of the storage device becomes less than a predetermined free space threshold value, the new storage device is always in the activated state. Distributed storage device. The file distributed storage device according to any one of claims 1 to 3.
The file system control means is a file distributed storage device that controls an activation state of the storage device based on a file status stored by the storage device and a predetermined file tendency threshold value. The file distributed storage device according to claim 4.
When the ratio of the number of files in which the size of the file to the number of files stored in the storage device exceeds the predetermined comparison threshold value is equal to or larger than the predetermined file tendency threshold value, the file system control means newly described. A file distribution management device that controls the storage device so that it is always in the activated state. In a file distributed storage device that stores files in a distributed manner in multiple storage devices,
In response to a write request, the management means is inquired about the file location, and data is written to any of the plurality of storage devices according to the file offset of the data write destination requested by the write request, or the read request is made. A file system control means for executing at least one of the processes of reading the data requested by the read request from any of the plurality of storage devices is realized.
The file system control means activates the storage device according to the file offset of the write request data for which the write request requests writing, or the file offset of the read request data for which the read request requests reading. Control the state,
The file system control means activates the storage device based on the file offset of the write request data or the read request data and a predetermined threshold value.
A program having different values between the write threshold value, which is the threshold value to be compared with the file offset of the write request data, and the read threshold value, which is the threshold value to be compared with the file offset of the read request data. A file distribution storage device that distributes and stores files in multiple storage devices
In response to a write request, the management means is inquired about the file location, and data is written to any of the plurality of storage devices according to the file offset of the data write destination requested by the write request, or the read request is made. In response, at least one of the processes of reading the data requested by the read request from any of the plurality of storage devices is executed.
The activation state of the storage device is controlled according to the file offset of the write request data for which the write request requests writing, or the file offset of the read request data for which the read request requests reading.
The storage device is activated based on the file offset of the write request data or the read request data and a predetermined threshold value.
The file distribution has different values between the write threshold value, which is the threshold value to be compared with the file offset of the write request data, and the read threshold value, which is the threshold value to be compared with the file offset of the read request data. Storage method. A file distribution storage device that distributes and stores files in multiple storage devices.
A file system control means for executing a process of reading the data requested by the read request from any of the plurality of storage devices in response to the read request is provided.
It said file system control unit, depending on the file offset of the read request data to which the read request requests a read, controls the activation state of the storage device,
At least one of the storage devices is always in the activated state
The file system control means is a file that controls the storage device that is always in the activated state so that when the free space of the storage device becomes less than a predetermined free space threshold value, the new storage device is always in the activated state. Distributed storage device. In a file distributed storage device that stores files in a distributed manner in multiple storage devices,
A file system control means for executing a process of reading the data requested by the read request from any of the plurality of storage devices in response to the read request is realized.
It said file system control unit, depending on the file offset of the read request data to which the read request requests a read, controls the activation state of the storage device,
At least one of the storage devices is always in the activated state
The file system control means is a program that controls so that when the free space of the storage device that is always in the activated state becomes less than a predetermined free space threshold value, the new storage device is always in the activated state. .. A file distribution storage device that distributes and stores files in multiple storage devices
In response to the read request, the process of reading the data requested by the read request from any of the plurality of storage devices is executed, and the process is executed.
Depending on the file offset of the read request data to which the read request requests a read, controls the activation state of the storage device,
At least one of the storage devices is always in the activated state
A file-distributed storage method that controls a new storage device to be always started when the free space of the storage device that is always in the activated state becomes less than a predetermined free space threshold value.

Images