KR101527058B1 - Distributed file management apparatus and method - Google Patents

Abstract

The present invention relates to an apparatus and method for managing distributed files. In order to improve data stability and performance, a distributed file management apparatus for distributing replicas to a plurality of storage spaces and creating and managing them is provided. It is possible to determine the optimum distributed storage location of the original file and the replica file based on the accumulated connection history information by generating or updating the connection history information, It can support fast data transmission by locating widely used data in each region, and it is possible to store data in a storage space which is geographically far from the user's connection position, and to provide high data stability for unpredictable emergencies such as natural disasters There is an advantage to guarantee.

Description

[0001] DISTRIBUTED FILE MANAGEMENT APPARATUS AND METHOD [0002]

The present invention relates to a distributed file management apparatus and method, and more particularly, to a distributed file management apparatus for distributing and creating replicas in a plurality of storage spaces on a file-by-file basis for improving data stability and performance, The present invention relates to a distributed file management apparatus and method capable of determining an optimum distributed storage location of an original file and a replica file based on cumulative access history information by generating or updating access history information by checking an area.

Generally, in a general-purpose hardware-based distributed file management apparatus, replicas are generated and managed for each file on a plurality of computers in order to improve data stability and performance.

In the distributed file management apparatus according to the related art, the number of replicas is determined by reviewing the execution speed of data reading and writing and the storage requirement in a comprehensive manner, and the distribution of the original file and the replica file The storage location is determined.

However, in the case of a cloud storage or the like in which virtualized storage resources are provided according to a user's demand through a network, a plurality of users access from different geographical locations through a communication network, There is no consideration for this in the past to affect the speed. That is, it is desirable to locate frequently used data for each user or region in the storage space closest to the user's connection position for fast data transfer. However, since the distributed storage position of the file is determined by a consistent criterion, There is a case where the dispersed storage location is distant from the long distance. In this case, there is a problem that fast data transmission is not supported.

On the other hand, considering the unpredictable emergencies such as natural disasters, it is desirable to store data in a geographically remote storage space, but there has been no consideration in the past. In other words, in order to guarantee the data stability, it is necessary to separate the main access area and the distributed storage location from each other at a long distance, but the main access area and the distributed storage location are close to each other In this case, there is a problem that data stability can not be guaranteed.

In order to solve the problems of the related art, in order to improve the data stability and performance, the distributed file management apparatus distributes replicas to a plurality of storage spaces and creates and manages the replicas for each file, And more particularly, to a distributed file management apparatus and method capable of determining an optimum distributed storage location of an original file and a replica file based on cumulative access history information by generating or updating access history information.

As a first aspect of the present invention, a distributed file management apparatus includes a plurality of file servers for distributively storing an original file and a replica file, and a plurality of file servers for distributing the original file and the replica file stored in the plurality of file servers, An access history database which stores the connection history information created or updated by the connection location confirmation unit in a database for each user or each file; A file distribution processor for reading the access history information accumulated in the history database and transmitting usage environment information or usage status information for each user to the monitoring terminal or the system administrator through the set path; At least two of the file servers It can include a controller to select a file server for controlling the storage of the original file and the replica file.

Here, the preset replication criterion may be such that a file server having the closest communication distance is selected as essential from the plurality of file servers in accordance with the per-user usage environment information or per-file usage status information, Lt; / RTI >

The predetermined duplication criterion may be to select a file server that is most distant from the plurality of file servers in the geographical distances from the plurality of file servers to the user access information or the file access information by file, .

The connection location confirmation unit may reset the connection history information at a preset time.

The connection position confirmation unit may assign a weighted value to the connection area confirmation unit according to the passage of time for confirming the connection area, thereby confirming the main connection area.

As a second aspect of the present invention, a distributed file management apparatus includes a plurality of file servers for distributively storing an original file and a replica file, and a plurality of file servers for distributing the original file and the replica file stored in the plurality of file servers, An access history database which stores the connection history information created or updated by the connection location confirmation unit in a database for each user or each file; A file distribution processor for reading the access history information accumulated in the history database and transmitting usage environment information or usage status information for each file through the set path; According to the updated replication criterion, Selecting at least two or more files from the server and may comprise a control unit for controlling the storage of the original file and the replica file.

Here, the updated replication criterion may be such that a file server closest to the communication distance is selected as essential from the plurality of file servers in accordance with the per-user usage environment information or per-file usage status information, Lt; / RTI >

The updated replication criterion may be to select a file server furthest from the plurality of file servers, which is furthest from the user's per-user or per-file primary access location according to the per-user use environment information or per-file usage status information .

The connection location confirmation unit may reset the connection history information at a preset time.

The connection position confirmation unit may assign a weighted value to the connection area confirmation unit according to the passage of time for confirming the connection area, thereby confirming the main connection area.

According to a third aspect of the present invention, there is provided a distributed file management method comprising the steps of: generating or updating access history information by checking connection regions for each user or each file for original files and replica files stored in a plurality of file servers; A step of storing the updated connection history information in a database for each user or each file and storing the updated connection history information in a database for each user or a file, And selecting and distributing at least two file servers among the plurality of file servers in accordance with a predetermined copy criterion to distribute and store the original file and the replica file.

Here, the distributed storage may be performed by selecting a file server having the closest communication distance from the plurality of file servers in accordance with the per-user usage environment information or per-file usage status information, have.

The distributing and storing may be performed by selecting a file server that is most distant from the plurality of file servers in terms of the per-user usage environment information or per-file usage status information.

The step of generating or updating the connection history information may reset the connection history information at each preset time.

In the step of generating or updating the connection history information, the changed connection weight can be given to the main connection area according to the passage of time for confirming the connection area.

According to a fourth aspect of the present invention, there is provided a distributed file management method comprising the steps of: generating or updating connection history information by confirming an access area for each user or each file with respect to an original file and a replica file stored in a plurality of file servers; Storing the updated connection history information in a database for each user or each file and storing the updated connection history information in a database; and updating at least two of the plurality of file servers in accordance with a replication criterion updated based on the usage environment information or the usage- Selecting the file server and distributing the original file and the replica file in a distributed manner.

Here, the distributed storage may be performed by selecting a file server having the closest communication distance from the plurality of file servers in accordance with the per-user usage environment information or per-file usage status information, have.

The distributing and storing may be performed by selecting a file server that is most distant from the plurality of file servers in terms of the per-user usage environment information or per-file usage status information.

The step of generating or updating the connection history information may reset the connection history information at each preset time.

In the step of generating or updating the connection history information, the changed connection weight can be given to the main connection area according to the passage of time for confirming the connection area.

According to an embodiment of the present invention, in order to improve data stability and performance, a distributed file management apparatus for distributing replicas to a plurality of storage spaces for each file to generate and manage the access areas is checked for each user or each file to generate access history information Or the update history of the original file and the replica file based on the accumulated access history information.

For example, it is possible to support fast data transmission by locating data frequently used for each user or region in a storage space closest to the communication distance at the user's connection position.

In addition, data is stored in geographically remote storage locations at the user's location to ensure high data reliability, such as unpredictable emergencies, such as natural disasters.

1 is a configuration diagram of a distributed file system to which a distributed file management apparatus according to an embodiment of the present invention can be applied;
2 is a detailed block diagram of a distributed file management apparatus according to an embodiment of the present invention;
FIG. 3 is a flowchart illustrating a distributed file management method according to an embodiment of the present invention. FIG.

BRIEF DESCRIPTION OF THE DRAWINGS The advantages and features of the present invention and the manner of achieving them will become apparent with reference to the embodiments described in detail below with reference to the accompanying drawings. The present invention may, however, be embodied in many different forms and should not be construed as limited to the embodiments set forth herein. Rather, these embodiments are provided so that this disclosure will be thorough and complete, and will fully convey the scope of the invention to those skilled in the art. To fully disclose the scope of the invention to those skilled in the art, and the invention is only defined by the scope of the claims.

In the following description of the present invention, a detailed description of known functions and configurations incorporated herein will be omitted when it may make the subject matter of the present invention rather unclear. The following terms are defined in consideration of the functions in the embodiments of the present invention, which may vary depending on the intention of the user, the intention or the custom of the operator. Therefore, the definition should be based on the contents throughout this specification.

Each block of the accompanying block diagrams and combinations of steps of the flowchart may be performed by computer program instructions. These computer program instructions may be loaded into a processor of a general purpose computer, special purpose computer, or other programmable data processing apparatus so that the instructions, which may be executed by a processor of a computer or other programmable data processing apparatus, And means for performing the functions described in each step are created. These computer program instructions may also be stored in a computer usable or computer readable memory capable of directing a computer or other programmable data processing apparatus to implement the functionality in a particular manner so that the computer usable or computer readable memory It is also possible for the instructions stored in the block diagram to produce a manufacturing item containing instruction means for performing the functions described in each block or flowchart of the block diagram. Computer program instructions may also be stored on a computer or other programmable data processing equipment so that a series of operating steps may be performed on a computer or other programmable data processing equipment to create a computer- It is also possible that the instructions that perform the processing equipment provide the steps for executing the functions described in each block of the block diagram and at each step of the flowchart.

Also, each block or each step may represent a module, segment, or portion of code that includes one or more executable instructions for executing the specified logical function (s). It should also be noted that in some alternative embodiments, the functions mentioned in the blocks or steps may occur out of order. For example, two blocks or steps shown in succession may in fact be performed substantially concurrently, or the blocks or steps may sometimes be performed in reverse order according to the corresponding function.

1 is a configuration diagram of a distributed file system to which a distributed file management apparatus according to an embodiment of the present invention can be applied. 1, a distributed file management system according to an embodiment of the present invention is connected to a plurality of user terminals 310, 320, and 330 through a communication network 200 such as the Internet, a private line, and a wireless network . 1 illustrates a case in which the distributed file management apparatus 100 is connected to three user terminals 310, 320, and 330, a system for providing a data storage service called a web hard, an internet hard, Lt; RTI ID = 0.0 > user terminals. ≪ / RTI > Accordingly, the present invention can include a component that can access the user terminals 310, 320, and 330 to perform user authentication, process data storage and management, and settle payment, but these components are not the core of the present invention A detailed description thereof will be omitted.

2 is a detailed block diagram of a distributed file management apparatus according to an embodiment of the present invention. 2, the distributed file management apparatus 100 includes a file list management unit 110, a file list database 120, a connection location confirmation unit 130, an access history database 140, a file distribution processing unit 150, a controller 160, a first file server 170, and a plurality of file servers 180, which can be expressed as a second file server 180 to an nth file server 190, for example. For example, the first file server 170 to the nth file server 190 may be implemented by an IDC (Internet Data Center).

The file list management unit 110 generates a list of files stored in the first file server 170 to the nth file server 190 and the file list database 120 stores a list of files generated by the file list management unit 110 . For example, the location of a file uploaded from the user terminal 310 and stored in the first file server 170 may be displayed in the form of a directory. The file list management unit 110 and the file list database 120 may be installed in the first file server 170 to the nth file server 190 that actually store files and may be managed and operated by the controller 160 .

The file list management unit 110 periodically updates the list of files stored in the first file server 170 to the nth file server 190. For example, the file list management unit 110 may finally synchronize with the first file server 170 to the nth file server 190.

The first file server 170 may include a first file management unit 171 for storing a file to be stored and a first file database 173 for actually storing the file. The second file server 180 may include a file And a second file database 183 for actually storing the file. Similarly, the n-th file server 190 may include an n-th file management unit 191 for recording a file to be stored, And a control file database 194 that actually stores the file.

The number of file servers that can be represented by the first file server 170, the second file server 180, and the nth file server 190 can be variously changed according to the storage capacity, the number of users, .

The connection location confirmation unit 130 generates or updates the connection history information by checking connection areas for each user or each file with respect to the files stored in the first file server 170 to the nth file server 190. For example, the main access area can be identified for each user or each file based on an installation area of the first file server 170 to the nth file server 190. Here, the connection location confirmation unit 130 may reset and delete the connection history information at the preset time so that the relatively recent file connection situation may be reflected in the connection history information. In addition, it is possible to assign a weight to a file access situation that occurred relatively recently than a file access state that has passed a predetermined time, so that a relatively recent file access situation may be reflected in the connection history information with a larger weight. For example, it is possible to identify the main access area by assigning changed weights according to the passage of time for confirming the access area.

The connection history database 140 stores the connection history information created or updated by the connection location confirmation unit 130 in a database for each user or each file.

The file distribution processing unit 150 reads the connection history information accumulated in the connection history database 140 and transmits the usage history information per user or the file to the monitoring terminal (not shown), the system administrator or the control unit 160 through the set path It is possible to determine the distributed storage location of the original file and the replica file based on the access history accumulated per user or file by transmitting or notifying the usage information.

The control unit 160 controls various components included in the distributed file management apparatus 100. The control unit 160 manages various components included in the distributed file management apparatus 100 from among the first file server 170 to the nth file server 190, And controls the storage of the original file and the replica file, or updates the replica basis on the basis of the per-user usage information or the per-file usage information received from the file distribution processing unit 150, And controls the storage of the original file and the replica file on at least two or more file servers selected from the n-th file server (190). For example, a file server having the closest communication distance from the first file server 170 to the nth file server 190 at the main access location for each user or each file may be referred to as a space for storing any one of the original file and the replica file The user can select the file server which is the geographically farthest from the user or the main access point of the file as the space for storing the other file among the original file and the replica file.

3 is a flowchart illustrating an exemplary distributed file management method by the distributed file management apparatus according to an embodiment of the present invention. Referring to FIG. 3, two embodiments of the present invention can be considered.

The distributed file management method according to the first embodiment is a method for managing connection information by checking connection regions for each user or each file with respect to an original file and a replica file stored in a plurality of file servers to generate or update connection history information, (S401 to S405) of storing the history information in a database for each user or for each file, and a step (S401 to S405) for storing the usage information for each user or the usage status for each file (Step S411) of selecting at least two file servers among a plurality of file servers in accordance with a predetermined copy criterion and distributing the original files and the replica files in a distributed manner.

The distributed file management method according to the second embodiment is a method for managing connection files by checking connection areas for each user or each file with respect to an original file and a replica file stored in a plurality of file servers to generate or update connection history information, (S401 to S405) of storing the history information in a database for each user or each file and storing the history information in a database by at least two or more Selecting a file server to distributively store the original file and the replica file (S407 to S411), and the like.

Hereinafter, a process of managing a distributed file by a file distributing apparatus according to an embodiment of the present invention will be described with reference to FIG. 1 to FIG.

First, the controller 160 selects a file server according to an initial replication criterion among the first to nth file servers 170 to 190, controls the storage of the original file and the replica file, 170 to n-th file server 190 distributes and stores a predetermined number of replica files and original files under the control of the controller 160 (S401).

The connection location confirmation unit 130 confirms the access area for each user or each file with respect to the original file and the replica file stored in the first file server 170 to the nth file server 190 at step S403, Create or update. For example, the main access area can be identified for each user or each file based on an installation area of the first file server 170 to the nth file server 190. Here, the connection location confirmation unit 130 may reset and delete the connection history information at the preset time so that the relatively recent file connection situation may be reflected in the connection history information. In addition, it is possible to assign a weight to a file access situation that occurred relatively recently than a file access state that has passed a predetermined time, so that a relatively recent file access situation may be reflected in the connection history information with a larger weight. For example, it is possible to identify the main access area by assigning changed weights according to the passage of time for confirming the access area.

Then, the connection history database 140 stores the connection history information created or updated by the connection location confirmation unit 130 in a database for each user or each file (S405).

When the predetermined replication reference update condition is satisfied (S407), the file distribution processing unit 150 updates the connection history information accumulated in the connection history database 140, for example, And transmits the usage status information for each user or file to the monitoring terminal, the system administrator or the control unit 160 through the predetermined path. For example, it is possible to determine that the replication criterion update condition is satisfied when a daytime time set in advance is set by setting a nighttime time in which the number of times of access to the file is small or not. As a result, the system administrator can grasp the usage status for each user or each file, and based on this, the replication standard for distributing and storing the original file and the replica file can be changed. The process of manually setting the copy criteria is omitted from the illustration of FIG.

Then, the control unit 160 selects a file server among the first file server 170 to the nth file server 190 according to a replication criterion preset by the system administrator, and controls the storage of the original file and the replica file.

Alternatively, the control unit 160 may update the copy criteria based on the usage status information or the usage status information for each file received from the file distribution processing unit 150 (S409) (190), and controls the storage of the original file and the replica file.

Finally, the file server among the first file server 170 to the nth file server 190 distributes the original file or the replica file under the control of the controller 160 (S411). For example, a file server having the closest communication distance from the first file server 170 to the nth file server 190 at the main access location for each user or each file may be stored as either an original file or a duplicate file, The file server that is most distant from the main access point by user or file can store the original file and the other one of the replicated files.

Embodiments of the present invention can be applied to a data storage service server called a web hard and an internet hard, a service system using the same, a cloud storage server that provides virtualized storage resources according to a user's demand, In order to improve data stability and performance such as general wired communication or wireless communication service system and its service method in which a plurality of IDCs are operated by using the service system and its operation method using the same, And can be used in the technical field to be managed.

100: Distributed file management apparatus 110: File list management unit
120: file list database 130: connection location routine
140: connection history database 150: file distribution processor
160: control unit 170: first file server
171: First file management unit 173: First file database
180: second file server 181: second file manager
183: second file database 190: control file server
191: control file manager 193: control file database

Claims (20)

A plurality of file servers for distributively storing original files and replica files,
A connection location confirmation unit for generating or updating the connection history information by checking the connection area for each user or each file with respect to the original file and the replica file stored in the plurality of file servers,
An access history database for storing the connection history information generated or updated by the connection location confirmation unit in a database for each user or each file,
A file distribution processing unit for reading the connection history information accumulated in the connection history database and transmitting usage environment information or usage status information for each user through the set path,
Selecting one of the plurality of file servers from among the plurality of file servers according to the copy criteria set based on the per-user use environment information or per-file usage status information to store either the original file or the replica file, And a controller for controlling the storage of the remaining one by selecting a second file server farthest from the first file server
Distributed file management device.
The method according to claim 1,
And selects a file server having the closest communication distance as a first file server at a user-specific or file-by-file primary access location according to the per-user usage environment information or per-file usage status information. The method according to claim 1,
And selects a file server which is furthest from the geographical location of the user or the main access point by file according to the user environment information or the file usage information by file as the first file server. The method according to claim 1,
The connection location confirmation unit resets the connection history information every predetermined time
Distributed file management device. The method according to claim 1,
The connection position confirmation unit may assign a changed weight to the main connection area according to an elapse of time for confirming the connection area
Distributed file management device. delete delete delete delete delete delete delete delete delete delete Generating or updating connection history information by checking connection regions for each user or each file with respect to original files and replica files stored in a plurality of file servers,
Accumulating and storing the connection history information created or updated in a database for each user or each file for a predetermined period of time;
Reading the accumulated connection history information to generate usage environment information for each user or usage status information for each file;
Selecting one of the plurality of file servers from among the plurality of file servers according to the copy criteria set based on the per-user use environment information or per-file usage status information to store either the original file or the replica file, And selecting the second file server that is the closest to the geographically distant one and storing the remaining one
How to manage distributed files. 17. The method of claim 16,
Wherein the file server having the closest communication distance is selected as the first file server from the plurality of file servers according to the per-user usage environment information or the per-file usage status information, And storing the original file and the replica file. 17. The method of claim 16,
Selecting a first file server as a first file server which is furthest from the plurality of file servers in a user-specific or main access point for each file according to the per-user usage environment information or per-file usage status information, A distributed file management method for storing either a source file or a replica file. 17. The method of claim 16,
Wherein the step of generating or updating the connection history information comprises the steps of:
How to manage distributed files. 17. The method of claim 16,
The step of generating or updating the connection history information may further include the step of assigning a changed weight to the main connection area according to an elapse of time for confirming the connection area
How to manage distributed files.

Images