KR20120013475A - Apparatus for managing data by using url information in a distributed file system and method thereof - Google Patents

Abstract

PURPOSE: A device for managing data using URL(Uniform Resource Locator) information in a distributed file system and a method thereof are provided to support conditions under which permitted users can immediately access a specific file in a cloud storage service based on a distributed file system. CONSTITUTION: A protocol server(110) searches metadata corresponding to specific URL information from a URL database. The protocol server requests a location of a metadata server where a specific file is stored by the searched metadata. The protocol server receives the response to the request. When each file is stored in at least one file server, the metadata server stores metadata of each file to manage a file list. The metadata server provides file server information in which a specific file is stored by a request of the protocol server.

Description

Device for managing data using QR information in distributed file system and its method {APPARATUS FOR MANAGING DATA BY USING URL INFORMATION IN A DISTRIBUTED FILE SYSTEM AND METHOD THEREOF}

The present invention relates to a data management apparatus and method using uniform resource locator (URL) information in a distributed file system, and more particularly, to copy multiple copies of each file to various storage spaces in order to improve data stability and performance. Based on the distributed file system that is distributed and created and managed, the cloud storage service automatically generates a URL that directly accesses a specific file at the request of a file owner, and uses the file to automatically create a URL. The present invention relates to a data management apparatus and method using URL information in a distributed file system suitable for immediately performing access.

Generally, in a distributed file system based on general-purpose hardware, replicas are distributed and distributed to multiple computers for each file in order to improve data stability and performance.

The distributed file system includes a symmetrical structure for distributing copies in storage devices having the same storage capacity, a storage device having various storage capacities, and an asymmetric structure for storing copies in various storage media media.

In particular, in the case of cloud storage that provides virtualized storage resources according to user's needs in an asymmetric distributed file system, a large number of files exist, so that users of various types of computing devices connected in a wired or wireless manner Uses the hierarchical file interface to search for and access desired files.

By accessing each folder in this hierarchical file interface, it is possible to access the subfolders connected to each parent folder. To access the files located in the lowest subfolders of the 10 hierarchical folders, Perform individual access to each folder, or enter the address of the upper level folder of each hierarchy in the address bar (eg S: \ 1 \ 2 \ 3 \ 4 \ 5 \ 6 \ 7 \ 8 \ 9 \ 10 \) Only the 10th folder could be accessed.

In a distributed file system according to the prior art operating as described above, files stored in cloud storage must be accessed by various kinds of computing devices in a wired / wireless environment and easily shared with other users on the premise of the data owner's approval. do.

However, the hierarchical file interface used in general computing devices, i.e., the structure of subfolders and files within folders, is often mobile and relatively limited in input / output environment compared to computing devices (eg, personal computers (PCs)). In a computing device having a problem, there is a problem that it is not an interface that can be suitably used.

Accordingly, the present invention provides a URL in a distributed file system that can support an environment in which authorized users can directly access specific files in a distributed file system-based cloud storage service in an environment where continuous network access is not guaranteed, such as a mobile wireless environment. A data management apparatus using information and a method thereof are provided.

In addition, the present invention automatically generates a URL that can directly access a specific file at the request of the file owner within the cloud storage service implemented as a general-purpose hardware (H / W) -based distributed file system, using the file to Provided are a data management apparatus and method using URL information in a distributed file system that can be directly accessed.

According to an embodiment of the present invention, a device may include: a user interface unit receiving a file from at least one computing device and receiving URL information; and generating a string for the file received from the user interface unit, based on the generated string. A control unit for generating URL information and storing the generated URL information and metadata information about the file in a URL database, and when the specific URL information is received from the user interface unit, the URL database corresponds to the specific URL information. A protocol server for retrieving metadata information, and requesting a storage location of the specific file from a metadata server based on the retrieved metadata information, and receiving each response if the file is stored in at least one file server. Manage file lists by storing metadata information from And, it includes at the request of the protocol server the metadata server that provides a file server information is stored in the specified file.

The controller, when receiving the access authority setting request message for the specific file from the computing device, transmits the access authority setting information to the file server in which the specific file is stored.

The file server determines whether to set an access right for the specific file transmitted from the metadata server, and if the access right is set, the file server determines the access right to the computing device requesting file access. And a file management unit for transmitting access permission to the protocol server, and a file database storing the respective files.

The user interface unit may transfer the input URL information to a protocol server preset by a load balancing function.

The protocol server may be at least one HTTP server.

According to an embodiment of the present invention, a process of receiving each file from at least one computing device connected to a distributed file system in a control unit, generating a string for each file, and generating URL information based on the generated string Generating, storing the generated URL information and metadata information of each file transmitted from the metadata server in a URL database, and transmitting the URL information for each file to the computing device of each file owner. Process.

In the receiving of the input, when the access authority setting request message for the specific file is received from the computing device, the access authority setting information is transmitted to the file server in which the specific file is stored.

The string may be generated using at least one of an identification ID (UUID), string generation time information, and time information at the time when metadata information of the corresponding file is registered in the metadata server.

The URL information may be generated in the format of protocol: // representative IP / string or protocol: // representative domain / string.

In another embodiment of the present invention, a method for receiving URL information input by at least one computing device from a user interface unit in a protocol server, and a URL in which URL information of each file is stored using a string included in the URL information. Retrieving metadata information of a file corresponding to the string from a database, transmitting the retrieved metadata information to a metadata server, requesting a location of the file, and receiving file server information at which the file is located; And performing access to the received file server.

The receiving of the file server information may include receiving an access permission message when an access right for the corresponding file is set.

In the receiving of the user interface unit, the URL information may be delivered to a protocol server preset by a load balancing function.

The protocol server may be at least one HTTP server.

The URL information may be generated in a protocol: // representative IP / string or protocol: // representative domain / string format including a string for each file stored in the file server.

The string may be generated using at least one of an identification ID (UUID), string generation time information, and time information at the time when metadata information of the corresponding file is registered in the metadata server.

In the present invention, effects obtained by representative ones of the disclosed inventions will be briefly described as follows.

The present invention provides continuous network access, such as mobile wireless environment, by enabling access to the file through a URL rather than a hierarchical file interface for the files shared in a cloud storage service implemented based on a distributed file system. In a non-guaranteed environment, it is possible to immediately access the file in a short time, thereby facilitating easy file searching and network connection load.

1 is a block diagram showing the structure of a distributed file system according to an embodiment of the present invention;
2 is a flowchart illustrating an operation procedure of a controller in a distributed file system according to an embodiment of the present invention;
3 is a flowchart illustrating an operation procedure of an HTTP server in a distributed file system according to an embodiment of the present invention.

Advantages and features of the present invention and methods for achieving them will be apparent with reference to the embodiments described below in detail with the accompanying drawings. However, the present invention is not limited to the embodiments disclosed below, but can be implemented in various different forms, and only the embodiments make the disclosure of the present invention complete, and the general knowledge in the art to which the present invention belongs. It is provided to fully inform the person having the scope of the invention, which is defined only by the scope of the claims.

In describing the embodiments of the present invention, if it is determined that a detailed description of a known function or configuration may unnecessarily obscure the gist of the present invention, the detailed description thereof will be omitted. In addition, terms to be described below are terms defined in consideration of functions in the embodiments of the present invention, which may vary according to intentions or customs of users and operators. Therefore, the definition should be based on the contents throughout this specification.

Each block of the accompanying block diagrams and combinations of steps of the flowchart may be performed by computer program instructions. These computer program instructions may be mounted on a processor of a general purpose computer, special purpose computer, or other programmable data processing equipment such that instructions executed through the processor of the computer or other programmable data processing equipment may not be included in each block or flowchart of the block diagram. It will create means for performing the functions described in each step. These computer program instructions may be stored in a computer usable or computer readable memory that can be directed to a computer or other programmable data processing equipment to implement functionality in a particular manner, and thus the computer usable or computer readable memory. It is also possible for the instructions stored in to produce an article of manufacture containing instruction means for performing the functions described in each block or flowchart of each step of the block diagram. Computer program instructions may also be mounted on a computer or other programmable data processing equipment, such that a series of operating steps may be performed on the computer or other programmable data processing equipment to create a computer-implemented process to create a computer or other programmable data. Instructions that perform processing equipment may also provide steps for performing the functions described in each block of the block diagram and in each step of the flowchart.

In addition, each block or step may represent a portion of a module, segment or code that includes one or more executable instructions for executing a specified logical function (s). It should also be noted that in some alternative embodiments, the functions noted in the blocks or steps may occur out of order. For example, the two blocks or steps shown in succession may in fact be executed substantially concurrently or the blocks or steps may sometimes be performed in the reverse order, depending on the functionality involved.

 An embodiment of the present invention is to support an environment in which authorized users can directly access specific files in a distributed file system-based cloud storage service in an environment where continuous network access is not guaranteed, such as a mobile wireless environment. This is to automatically generate a URL that can directly access a specific file at the request of the file owner within the storage service, and use the file to perform the access.

Here, the URL is a standard for indicating the location of files in servers providing various services of a web document, and the general scheme is, for example, "computer name / directory name / file name with protocol: // information". Can be configured. Accordingly, in the embodiment of the present invention, by generating a URL such as "protocol: // representative IP / string" or "protocol: // representative domain / string" for a specific file selected by a user, the location of the specific file corresponding to the string Can be configured to be unknown, and the generated URL allows direct access to a specific file.

1 is a block diagram illustrating a structure of a distributed file system according to an embodiment of the present invention.

Referring to FIG. 1, the distributed file system 100 includes a protocol server 110, a controller 120, a URL database (DB) 130, a metadata server 140, a first file server 150, and a second. The file server 160, the n-th file server 170, the user interface unit 180, and the like may be connected to a plurality of computing devices through a communication network such as the Internet, a dedicated line, a wireless network, and the like. . That is, it can be connected to various computing devices such as mobile communication terminals, PDAs, notebooks, and personal computers including smartphones through wired and wireless environments, such as systems providing data storage services called terms such as web hard and internet hard. .

In addition, the computing devices may be connected to the distributed file system 100 to perform user authentication, and may process data storage, management, deletion request, and payment according to system use.

The user interface unit 180 is an L4 switch that performs a load balancing function, performs a connection with computing devices, and then transfers data transmitted from a specific computing device to the protocol server 110, and a protocol. Data transferred from the server 110 may be transferred to the corresponding computing device.

The protocol server 110 includes a plurality of servers, and may include, for example, an HTTP or FTP server. In general, an internet network using hypertext uses an HTTP server, and may be continuously added such as HTTP server 1 112 and HTTP server n 114 according to URL connection loads requested from a plurality of computing devices. .

The protocol server 110 may transmit a file to the controller 120 and access a file requested from the computing device.

The controller 120 controls various components included in the distributed file system 100 and controls the files received from the protocol server 110 from the first file server 150 to the nth file connected to the metadata server 140. Control to be transmitted to and stored in the server 170. At this time, the controller 120 analyzes the file based on the type, extension name, size, etc. of the file, selects one of the first file server 150 to the n th file server 170 to be stored in the corresponding file server. Can be controlled.

The metadata server 140 delivers the file transferred from the control unit 120 to the first file server 150 to the n th file server 170, and extracts a list and metadata information about each file to the metadata server. It may be registered through the database or URL DB 130 included in (140). And periodically, the list of files and metadata information stored in the first file server 150 to the n-th file server 170 is updated, for example, the first file server 150 to the n-th file server 170 You can also synchronize with.

On the other hand, when the protocol server 110 requests a search for a specific file through metadata information, the protocol server 110 performs a location search for a specific file corresponding to the metadata to display file server information where the specific file is located. Can be delivered to.

The first file server 150 may include a first file manager 152 for recording a file to be stored and a first file database 154 for actually storing the file. The second file server 160 may store a file to be stored. A second file manager 162 for recording and a second file database 164 for actually storing the file. Similarly, the n-th file server 170 may include an n-th file manager 172 for recording a file to be stored. And an n-th file database 174 that actually stores the file.

As described above, the number of file servers that can be represented by the first file server 150, the second file server 160, or the n-th file server 170 may vary depending on the storage capacity, the number of users, and the state of the system. Can be.

On the other hand, the controller 120 generates a string and a URL for each file and later, when accessing the file through the protocol server 110 in the computing device, it is possible to easily access only by the URL information. .

The controller 120 may include a string generator 122 and a URL generator 124. The string generator 122 generates a string that can be identified for each file uploaded from a plurality of computing devices. For example, when the "2010_6_2.txt" file is stored in a virtual storage space of a specific user. We can create the string "11ccbb" to identify this file. Such strings may be identified using identification IDs (UUID: Universally Unique Identifiers), string generation time information in the string generation unit 122, time information at the time when metadata information of the corresponding file is registered in the metadata server 140, and the like. Of course, it is possible to apply a variety of other string generation algorithm.

Meanwhile, the string generated by the string generator 122 may be stored in the URL DB 130 along with metadata information of the “2010_6_2.txt” file.

The URL generator 124 may generate a URL based on the string “11ccbb” generated by the string generator 122. For example, it may be generated in a format such as "http: // representative IP / 11ccbb" or "http: // representative domain / 11ccbb". That is, the string can be placed immediately after the representative IP or the representative domain, so that the file owner and the user accessing the file cannot know at all which file server the file corresponding to the string is located in the lower layer. Can be. The generated URL information may be transferred to the file owner's computing device. The generated URL may be generated only for important files selected by the file owner at the request of the file owner, but may be implemented to generate all files.

Accordingly, the controller 120 transmits the URL information generated by the URL generator 124 to the protocol server 110 to be transmitted to the computing device of the file owner, and whether to set an access right to access the URL. You can request In response to receiving the access authority setting request message from the computing device of the file owner, it is linked with the URL information in the URL DB 130 (for example, URL: http: // representative IP / 11ccbb, linked file: 2010_6_2.txt ( Access authority setting: yes)) to be saved. Meanwhile, the access authority setting information of the file may be stored in the file server DB in which the file is stored, for example, accessing the file stored in the first file DB 154 of the first file server 150 in a specific computing device. In this case, the first file manager 152 may check whether the permission is present and notify whether or not it is accessible.

When the computing device accesses a specific file in the distributed file system 100 using URL information, the computing device accesses a specific file through a URL generated by accessing the distributed file system 100 (for example, 2010_6_2.txt). In order to access), http: // representative IP / 11ccbb is transmitted to the user interface unit 180 as URL information about the file, and the user interface unit 180 uses the internal load balancing algorithm to set the protocol server 110. The request message can be delivered to one of the HTTP server 1 (112) to the HTTP server n (114).

For example, when the HTTP server 1 112 is selected, the selected HTTP server 1 112 checks the metadata information of the 2010_6_2.txt file corresponding to the string 11ccbb of the corresponding URL information in the URL DB 130, and 2010_6_2. The storage location of the file may be requested to the metadata server 140 based on metadata information of the .txt file. Accordingly, when the response message indicating that the 2010_6_2.txt file is stored in the first file server 150 is received from the metadata server 140, the HTTP server 1 112 may access the first file server 150. .

In this case, the first file manager 152 may determine whether to set the access right of the 2010_6_2.txt file, and if the access right is set, it may determine whether the access right of the computing device is possible. Accordingly, when only the file owner is accessible and determines that the computing device requesting access is not the computing device of the file owner, it may transmit a message indicating that the file cannot be accessed to the computing device.

However, if the computing device is a predetermined computing device, or if the computing device of the file owner or all computing devices is set as an accessible file, an accessible message may be transmitted to the data of the file, or access to the file may be allowed without a separate message. .

On the other hand, when the first file management unit 152 receives a deletion request for the file 2010_6_2.txt from the computing device, the file is deleted and the deletion information of the file is transmitted to the metadata server 140 and the controller 120. By doing so, the metadata information and the URL information of the file stored in the URL DB 130 may be deleted, and the deletion order may be changed.

When the first file management unit 152 receives a deletion request for URL information of the 2010_6_2.txt file from the computing device, the first file manager 152 deletes all of the 2010_6_2.txt file and the related information corresponding to the URL information according to the implementation method. Only URL information can be deleted. That is, when all the information related to the 2010_6_2.txt file is deleted, the same as when the file is deleted, and when deleting only the URL information, the deletion request information is transmitted to the control unit 120 to the URL DB 130 from the control unit 120. Only URL information of saved files can be deleted.

2 is a flowchart illustrating an operation procedure of a controller in a distributed file system according to an exemplary embodiment of the present invention.

Referring to FIG. 2, in step 200, the controller 120 of the distributed file system 100 transmits a file transmitted from a user's computing device to one of the first file server 150 to the n th file server 170. Saves it by passing it, and controls new file created by modifying and copying the file.

In operation 202, when a file for which URL generation is requested from the computing device of the user is stored, the string generator 122 generates a string for the file.

In operation 204, the URL generator 124 of the controller 120 generates URL information based on the string generated by the string generator 122. In step 206, the generated URL information is stored in the URL DB 130 to be linked with metadata of the corresponding file.

In operation 208, the controller 120 transmits the generated URL information to the computing device of the file owner.

3 is a flowchart illustrating an operation procedure of an HTTP server in a distributed file system according to an embodiment of the present invention.

Referring to FIG. 3, a user of a computing device transmits URL information to the user interface 180 to access a specific file. In addition, the user interface 180 selects one HTTP server (eg, HTTP server 1 112) from the protocol server 110 through a load balancing algorithm, and delivers URL information.

That is, the HTTP server 1 112 receives the URL information from the user interface unit 180 in step 300, and retrieves metadata information of the file from the URL DB 130 based on the string included in the URL information in step 302. Done. When metadata information is found, the metadata information retrieved in step 304 is transmitted to the metadata server 140 to request location information of the file.

In response to receiving the information of the file server storing the file from the metadata server 140, the file server is accessed to access the file. However, when the access authority is set for the file, the file management unit in the file server checks the access authority of the computing device that requested the file access in step 306.

In the case of a computing device that does not have an access right, in step 308, a file access disable message is notified from the file server. However, in the case of a computing device having an access right set in step 310, the file access message is received from the file server or the file is allowed to be accessed without a separate message.

In this way, the user can easily access the file based on URL information previously known to the file in the computing device, so that the user does not have to perform folder-by-fold access as in a hierarchical file interface.

As described above, the embodiment of the present invention automatically generates a URL for directly accessing a specific file at the request of a file owner in a cloud storage service implemented as a general-purpose hardware-based distributed file system, and uses the corresponding Perform direct access to the file.

While the present invention has been described in connection with what is presently considered to be the most practical and preferred embodiment, it is to be understood that the invention is not limited to the disclosed embodiments, but is capable of various modifications within the scope of the invention. Therefore, the scope of the present invention should not be limited to the described embodiments, but should be determined by the scope of the appended claims, and equivalents thereof.

As described above, the data management apparatus and method using the URL information in the distributed file system according to the present invention, distributed file system for generating and managing the distribution by copying the copies to multiple storage spaces for each file to improve data stability and performance In addition, the cloud storage service based on the distributed file system enables access to the shared files through URLs rather than hierarchical file interfaces, thereby ensuring continuous network access such as mobile wireless environment. It is suitable for supporting an environment where the file can be accessed directly in a timely environment.

100: distributed file system 110: protocol server
112: HTTP server 1 114: HTTP server n
120: control unit 122: string generation unit
124: URL generation unit 130: URL DB
140: metadata server 150: the first file server
152: first file management unit 154: first file database
160: second file server 162: second file management unit
164: second file database 170: the n-th file server
172: n-th file management unit 174: n-th file database
180: user interface unit

Claims (15)

A user interface unit receiving a file from at least one computing device and receiving URL information;
A controller for generating a string for the file received from the user interface unit, generating URL information based on the generated string, and storing the generated URL information and metadata information about the file in a URL database;
When the specific URL information is received from the user interface unit, search for metadata information corresponding to the specific URL information in the URL database, and request a storage location of the specific file from a metadata server based on the retrieved metadata information. The protocol server receiving the response,
When each file is stored in at least one file server, the metadata storing the metadata information of each file to manage a file list, and providing the file server information storing the specific file at the request of the protocol server. server
Data management apparatus using URL information in a distributed file system including a. The method of claim 1,
The control unit,
When the access authority setting request message for the specific file is received from the computing device, the data management device using the URL information in the distributed file system, characterized in that for transmitting the access authority setting information to the file server where the specific file is stored. The method of claim 1,
The file server,
It is determined whether the access right for the specific file transmitted from the metadata server is set, and if the access right is set, the access right is determined for the computing device that requested the file access to determine whether to permit the access. File management unit to deliver to the server,
A file database for storing each of the files
Data management apparatus using the URL information in a distributed file system comprising a. The method of claim 1,
The user interface unit,
Device for managing data using URL information in a distributed file system, characterized in that for transmitting the input URL information to a protocol server set by the load balancing function. The method of claim 1,
The protocol server,
Data management apparatus using URL information in the distributed file system, characterized in that at least one HTTP server. Receiving each file from at least one computing device connected to the distributed file system in a control unit;
Generating a string for each file and generating URL information based on the generated string;
Storing the generated URL information and metadata information of each file transmitted from the metadata server in a URL database;
Delivering the URL information for each file to the computing device of each file owner;
Data management method using URL information in a distributed file system including a. The method of claim 6,
The process of receiving the input,
When the access permission setting message for a specific file is received from the computing device,
Data management method using the URL information in the distributed file system, characterized in that for transmitting the access authority setting information to the file server in which the specific file is stored. The method of claim 6,
The string is
Data using URL information in a distributed file system, characterized in that it is generated using at least one of identification ID (UUID), character string generation time information, and time information at the time when metadata information of the corresponding file is registered in the metadata server. How to manage. The method of claim 6,
The URL information,
A method of data management using URL information in a distributed file system, characterized in that the protocol: // representative IP / string or protocol: // representative domain / string is generated. Receiving, at a protocol server, URL information input by at least one computing device from a user interface unit;
Searching for metadata information of a file corresponding to the string in a URL database in which URL information of each file is stored by using the string included in the URL information;
Transmitting the retrieved metadata information to a metadata server to request a location of a corresponding file to receive file server information on which the corresponding file is located;
Process of performing access to the received file server
Data management method using URL information in a distributed file system including a. The method of claim 10,
Receiving the file server information,
If the access authority for the corresponding file is set, the data management method using the URL information in the distributed file system, characterized in that for receiving an access permission message. The method of claim 10,
The process of receiving from the user interface unit,
The data management method using the URL information in the distributed file system, characterized in that for transmitting the URL information to a protocol server set by the load balancing function. The method of claim 10,
The protocol server,
Data management method using URL information in a distributed file system, characterized in that at least one HTTP server. The method of claim 10,
The URL information,
Method for managing data using URL information in a distributed file system, including a string for each file stored in the file server, and generating in a protocol: // representative IP / string or protocol: // representative domain / string method. . The method of claim 10,
The string is
Data using URL information in a distributed file system, characterized in that it is generated using at least one of identification ID (UUID), character string generation time information, and time information at the time when metadata information of the corresponding file is registered in the metadata server. How to manage.

Images