New! View global litigation for patent families

CN102045399B - Cloud computing mode file system and file reading method - Google Patents

Cloud computing mode file system and file reading method Download PDF

Info

Publication number
CN102045399B
CN102045399B CN 201010609600 CN201010609600A CN102045399B CN 102045399 B CN102045399 B CN 102045399B CN 201010609600 CN201010609600 CN 201010609600 CN 201010609600 A CN201010609600 A CN 201010609600A CN 102045399 B CN102045399 B CN 102045399B
Authority
CN
Grant status
Grant
Patent type
Prior art keywords
file
system
computing
method
mode
Prior art date
Application number
CN 201010609600
Other languages
Chinese (zh)
Other versions
CN102045399A (en )
Inventor
郭强
贾宝军
郝芸霞
Original Assignee
中国联合网络通信集团有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Grant date

Links

Abstract

本发明提供一种云计算模式文件系统及文件读取方法。 The present invention provides a cloud model file system and document reading method. 其中,所述系统包括:第一客户端模块,用于发出文件读取请求;文件管理模块,用于根据第一客户端模块发出的所述文件读取请求发出索引获取请求;分布式管理模块,用于根据文件管理模块发出的所述索引获取请求获取所需文件的索引信息及该文件所在服务器的IP地址;分布式传输模块,用于根据分布式管理模块获取的所述索引信息及所述IP地址从相应的服务器读取所述文件,经所述文件管理模块发送给所述第一客户端模块。 Wherein, said system comprising: a first client module for sending a file read request; file management module, for sending the index file acquisition request sent by a first client module in accordance with a read request; Distributed Management Module for obtaining the index file according to management module issues a request to obtain the IP address of the index file and the information required for the server where the file; distributed transmission module, for acquiring the index information according to the distributed management module and said IP address read from the corresponding file server via said file management module transmits to the first client module. 本发明实现了基于IP的文件读取方式,适用于IP分布式构造,具有开放统一的标准接口,扩展性能强大。 The invention achieves the reading of papers based on IP, for IP distributed structure, with open and unified standard interface, extend strong performance.

Description

云计算模式文件系统及文件读取方法 Cloud computing mode file system and file reading method

技术领域 FIELD

[0001] 本发明涉及一种云计算模式文件系统及文件读取方法,属于云计算技术领域。 [0001] The present invention relates to a cloud computing model file system and document reading method, belonging to the technical field of cloud computing.

背景技术 Background technique

[0002] 云计算模式是一种通过网络将多个成本相对较低的计算实体整合成一个具有强大计算能力的模式,其中一个重要的部分是文件系统。 [0002] is a cloud computing model by integrating network a plurality of relatively low-cost mode of computing entities as a powerful computing capability, which is an important part of the file system. 现有的单机文件系统主要基于裸机设备构建;而现有存储域网络(Storage AreaNetwork,简称:SAN)方式文件系统基于各个厂商的独立冗余磁盘阵列(Redundant Array of Independent Disk,简称:RAID)方式构建。 Existing single file system apparatus constructed mainly based on bare metal; the existing storage area network (Storage AreaNetwork, abbreviation: SAN) file system based on the respective vendors manner independent redundant disk array (Redundant Array of Independent Disk, abbreviation: RAID) mode Construct.

[0003] 现有技术中至少存在如下问题:现有云计算模式文件系统没有统一的标准接口,只能使用昂贵的存储设备和高性能的计算服务器,因此开放性差且适应性弱。 The presence of [0003] the prior art, at least the following problems: the prior cloud model no uniform standard file system interfaces, only the use of expensive high-performance computing and storage servers, and so open poor adaptability weak.

发明内容 SUMMARY

[0004] 本发明提供一种云计算模式文件系统及文件读取方法,用以提高文件系统的扩展性能。 [0004] The present invention provides a cloud model file system and document reading method, extended to improve file system performance.

[0005] 本发明一方面提供一种云计算模式文件系统,其中包括: [0005] In one aspect the present invention provides a cloud model file system, including:

[0006] 第一客户端模块,用于发出文件读取请求; [0006] The first client module for sending a file read request;

[0007] 文件管理模块,用于根据第一客户端模块发出的所述文件读取请求发出索引获取请求; [0007] The file management module, for sending the index file acquisition request based on said first client module issues a read request;

[0008] 分布式管理模块,用于根据文件管理模块发出的所述索引获取请求获取所需文件的索引信息及该文件所在服务器的IP地址; [0008] The distributed management module, the index for emitting module according to the file management information acquisition request to acquire the desired file and the index file server where the IP address;

[0009] 分布式传输模块,用于根据分布式管理模块获取的所述索引信息及所述IP地址从相应的服务器读取所述文件,经所述文件管理模块发送给所述第一客户端模块。 [0009] distributed transmission module for reading according to the index information and the IP address of the distributed management module acquires the file from a corresponding server via the file management module transmits to the first client module.

[0010] 本发明另一方面提供一种文件读取方法,其中包括: [0010] In another aspect of the present invention to provide a document reading method, which comprises:

[0011] 接收由第一客户端模块发出的文件读取请求; [0011] receiving a document issued by a first client module read request;

[0012] 根据所述文件读取请求获取所需文件的索引信息及该文件所在服务器的IP地址; [0012] according to the file read request to obtain the IP address of the index file and the information required of the server file;

[0013] 根据所述索引信息及所述IP地址从相应的服务器读取所述文件; [0013] reading the file from a corresponding server according to the index information and the IP address;

[0014] 将读取的所述文件发送给所述第一客户端模块。 [0014] reading the file sent to the first client module.

[0015] 本发明实现了基于IP的文件读取方式,适用于IP分布式构造,具有开放统一的标准接口,扩展性能强大,仅需要扩展廉价PC服务器,便可扩展存储性能和计算能力,使用户不必采用昂贵的存储和高性能的计算服务器便可搭建自己的云计算平台,开发自己的云计 [0015] The present invention enables the reading of papers based on IP, for IP distributed structure, with open and unified standard interface, extended strong performance, low-cost PC servers only need to expand, you can expand storage performance and computing power, so users do not have to use expensive storage and high performance computing server can build their own cloud computing platform to develop their own cloud

算应用。 Computing applications.

附图说明 BRIEF DESCRIPTION

[0016] 为了更清楚地说明本发明实施例或现有技术中的技术方案,下面将对实施例或现有技术描述中所需要使用的附图作一简单地介绍,显而易见地,下面描述中的附图是本发明的一些实施例,对于本领域普通技术人员来讲,在不付出创造性劳动的前提下,还可以根据这些附图获得其他的附图。 [0016] In order to more clearly illustrate the technical solutions in the embodiments or the prior art embodiment of the present invention, the accompanying drawings for illustrating the prior art described or needed to be used in an embodiment will be briefly introduced hereinafter, the description below the figures show some embodiments of the present invention, those of ordinary skill in the art is concerned, without creative efforts, can derive from these drawings other drawings.

[0017] 图1为本发明所述文件读取方法实施例一的流程图; [0017] Figure 1 is a file reading method of the invention, a flow diagram embodiment;

[0018] 图2为本发明所述文件读取方法实施例二的流程图; [0018] FIG 2 is a flowchart of the invention of the document reading method according to the second embodiment;

[0019]图3为本发明所述云计算模式文件系统实施例的结构示意图; [0019] FIG. 3 of the cloud model file system schematic structural diagram of the embodiment of the present invention;

[0020] 图4为图3所示系统的函数调用命令传输过程示意图。 [0020] FIG. 4 is a view of the system shown in FIG. 3 a schematic diagram of a function call command transmission process.

具体实施方式 detailed description

[0021] 为使本发明实施例的目的、技术方案和优点更加清楚,下面将结合本发明实施例中的附图,对本发明实施例中的技术方案进行清楚、完整地描述,显然,所描述的实施例是本发明一部分实施例,而不是全部的实施例。 [0021] In order that the invention object, technical solutions, and advantages of the embodiments more clearly, the following the present invention in the accompanying drawings, technical solutions of embodiments of the present invention are clearly and completely described, obviously, the described the embodiment is an embodiment of the present invention is a part, but not all embodiments. 基于本发明中的实施例,本领域普通技术人员在没有作出创造性劳动前提下所获得的所有其他实施例,都属于本发明保护的范围。 Based on the embodiments of the present invention, those of ordinary skill in the art to make all other embodiments without creative work obtained by, it falls within the scope of the present invention.

[0022] 图1为本发明所述文件读取方法实施例的流程图,如图所示,包括如下步骤: [0022] FIG 1 The file reading method of the present invention flowchart of embodiment, as shown in Fig, comprising the steps of:

[0023] 步骤110,接收由第一客户端模块发出的文件读取请求。 [0023] Step 110, the received document issued by a first client module read request.

[0024] 其中,该文件读取请求是由第一用户通过操作第一客户端模块发出的,用以请求读取所需的文件。 [0024] wherein the request is a file read by the first user by operating the first client module issued a request to read the required file.

[0025] 步骤120,根据所述文件读取请求获取所需文件的索引信息及该文件所在服务器的IP地址。 [0025] Step 120, according to the file read request to obtain the IP address of the desired file and index information of the file of the server.

[0026] 具体地,可以先根据所述文件读取请求生成索引获取请求,根据该索引获取请求查找相应的资源分布配置信息;然后再根据查找到的所述资源分布配置信息获取所需文件的索引信息及该文件所在服务器的IP地址。 [0026] Specifically, according to the first read request to generate the index file acquisition request, the request of obtaining the index to find the appropriate configuration information resource distribution; then obtain the required distribution of configuration information file according to find the resource IP address information and the index file of the server.

[0027] 步骤130,根据所述索引信息及所述IP地址从相应的服务器读取所述文件。 [0027] Step 130, the file is read from a corresponding server according to the index information and the IP address.

[0028] 其中,索引信息中记录了所述文件在服务器中的本地物理存储位置。 [0028] wherein the index information is recorded in the local physical storage location of the file in the server. 索引信息与文件分离的方式是现有技术中主要的文件管理方式。 Index information file separate from the way the art is the main file management. 本实施例所述方法沿用该方式,以便于与现有服务器的本地文件系统相适应。 The method according to the present embodiment follow the way, in order to be compatible with existing local file system server.

[0029] 具体地,可以先根据所述服务器的本地文件系统格式对所述索引信息进行协议适配,得到适配后的索引信息;然后再根据所述适配后的索引信息及所述IP地址从相应的服务器读取所述文件。 [0029] In particular, the protocol can be adapted to the index information of the file system format according to the local server, the adapted to obtain index information; then the index of the adaptation information and the IP reading the address from the corresponding file server. 从而使所述索引信息能够与具有所述IP地址的服务器的本地文件系统相适配。 So that the index information can be adapted to the local file system of the server having the IP address.

[0030] 步骤140,将读取的所述文件发送给所述第一客户端模块。 [0030] Step 140, the read file is transmitted to the first client module.

[0031] 具体地,可以对读取的所述文件进行协议适配,得到适配后的文件;然后再将所述适配后的文件发送给所述第一客户端模块。 [0031] Specifically, the file may be read protocol adaptation, to obtain the adapted file; then send the file to the first client module then after the adaptation. 从而使所述文件能够与第一客户端模块相适配。 So that the document can be adapted to the first client module. 具体地,进行所述协议适配时可以将读取的所述文件转换为复合索引文件(CFS)格式,以使第一客户端模块可以处理该适配后的CFS格式文件。 Specifically, for the file into a composite index file (CFS) format adapted to the protocol can be read, so that a first client module may process the CFS file format adaptation.

[0032] 本实施例所述方法实现了基于IP的文件读取方式,适用于IP分布式构造,具有开放统一的标准接口,扩展性能强大,仅需要扩展廉价PC服务器,便可扩展存储性能和计算能力,使用户不必采用昂贵的存储和高性能的计算服务器便可搭建自己的云计算平台,开发自己的云计算应用。 [0032] The present embodiment of the method implemented IP-based document reading method is applicable to IP distributed structure having a uniform open standard interface, extended powerful, need only extend inexpensive PC servers, storage properties and can be extended computing power, so users do not have to use expensive storage and high performance computing server can build their own cloud computing platform to develop their own cloud computing applications. [0033] 图2为本发明所述文件读取方法实施例二的流程图,如图所示,本实施例所述方法在上述步骤130所述根据所述索引信息及所述IP地址从相应的服务器读取所述文件之后还包括如下步骤: [0033] FIG 2 is a flowchart of the invention of the document reading method according to the second embodiment, as shown, the present embodiment of the method according to the above step 130 to the index information and the IP address from the corresponding after reading the file server further comprises the steps of:

[0034] 步骤210,根据读取的所述文件生成相应的文件种子。 [0034] Step 210, the appropriate file seed generated based on the read file.

[0035] 其中,所述文件种子记录了该文件曾经被哪个客户端模块读取过的信息以及该文件的索引信息。 [0035] wherein the index file recording seed information for the file which has been read through the client module and the file information.

[0036] 步骤220,当接收到来自第二客户端模块发出的另一文件读取请求时,查询是否曾经向所述第一客户端模块传输过所述另一文件读取请求所要读取的文件,并将查询结果发送给所述第二客户端模块。 [0036] Step 220, when another file is received from a second client module issues read requests, to check whether been transmitted through the other of said first client module file read request to be read document, and the query result to the second client module.

[0037] 其中,所述另一文件读取请求是由第二用户通过操作第二客户端模块发出的,用以请求读取所需的文件。 [0037] wherein said another file read request is made by the second user operating the second client module issued a request to read the required file.

[0038] 步骤230,当所述查询结果为是时,所述第二客户端模块获取相应的文件种子。 [0038] Step 230, when the query result is yes, the second client module obtains the corresponding file seed.

[0039] 其中,如果所述查询结果为是,则表明所述第二客户端模块所需的文件与所述第一客户端模块曾经读取过的文件相同。 [0039] wherein, if the query result is YES, it indicates that the same desired second client module files and said first client module has read the file..

[0040] 步骤240,第二客户端模块根据所述文件种子以点对点方式从所述第一客户端模块获取与所述文件种子相应的文件。 [0040] Step 240, the second client module in a manner to obtain the corresponding point of the seed file from the first file according to the file client module seed.

[0041] 另外,如果所述查询结果为否,也就是说所述第一客户端模块没有读取过所述文件,则该第二客户端可以采用实施例一所述方法读取所需的文件,或者也可以从其他客户端模块以点对点方式传输所述文件。 [0041] Further, if the query result is NO, that is not the first client module to read through the file, the client can use the second method of the embodiment required to read a file, or may be in a point to point transfer the file from the other client modules.

[0042] 本实施例所述方法实现了客户端模块之间以点对点方式传输文件,节省了文件传输的时间也减轻了文件系统的工作负担。 [0042] The present embodiment implements the method in Example module between the client-to-point transfer files, saving time file transfer lightening the burden on the file system.

[0043]图3为本发明所述云计算模式文件系统实施例的结构示意图,如图所示,该系统至少包括:第一客户端模块11、文件管理模块12、分布式管理模块13及分布式传输模块14,其中,文件管理模块12、分布式管理模块13及分布式传输模块14位于服务器的主控单元中。 [0043] FIG. 3 of the cloud model file system schematic structural diagram of the embodiment of the present invention, as shown, the system comprising at least: a first client 11, 12, 13 and the distribution of the distributed management module file management module end module type transmission module 14, wherein the main control unit 14 in the server's file management module 12, the distributed management module 13 and the distributed transmission module.

[0044] 此处需要说明的是:本实施例所述客户端模块与服务器实际上是具有相同内部模块结构的同一种设备,只不过该设备在执行不同的操作时扮演了不同的角色。 [0044] It should be noted here that: the present embodiment, the client module and the server is actually the same as an apparatus having the same internal configuration of the module, the apparatus only play different roles in performing different operations. 例如,当该设备请求读取文件时,它作为客户端模块;而当该设备提供所请求的文件时,它作为服务器。 For example, when the device requests to read a file, which as a client module; and providing the requested file when the device, as the server.

[0045] 以下说明本实施例所述系统的工作原理: [0045] The following description of the system according to the present embodiment works:

[0046] 第一客户端模块11发出文件读取请求;文件管理模块12根据第一客户端模块11发出的所述文件读取请求发出索引获取请求;分布式管理模块13根据文件管理模块12发出的所述索引获取请求获取所需文件的索引信息及该文件所在服务器的IP地址;分布式传输模块14根据分布式管理模块13获取的所述索引信息及所述IP地址从相应的服务器读取所述文件,经所述文件管理模块12发送给所述第一客户端模块11。 [0046] The first client module 11 issues a file read request; request file management module 12 reads the index acquisition request issued in accordance with the first file issued by the client module 11; 13 issued according to the distributed management module file management module 12 the index IP address acquisition request for acquiring information required for the index file and the file server is located; distributed transmission module 14 reads from the corresponding server according to the index information and the IP address of the distributed management module 13 acquires the file via the file management module 12 transmits to the first client module 11. 具体地,所述服务器中还可以包括通信协议模块,其中保存有TCP/IP协议族,分布式传输模块14可以通过协议适配模块17调用通信协议模块中的TCP/IP协议族对IP地址进行适配后访问相应的服务器。 Specifically, the server may further include a communication protocol module, which holds the TCP / IP protocol suite, transmission module 14 may be distributed to the IP address via the protocol adaptation module 17 calls the communication protocol module TCP / IP protocol suite. after adapting to access the appropriate server.

[0047] 其中,所述分布式管理模块13主要负责调度查找当前云中可用的存储和计算资源,并创建和管理云缓存,保存云资源的索引。 [0047] wherein the distributed management module 13 is responsible for scheduling find the current cloud storage and computing resources available, and to create and manage cloud cache, saving the index cloud resources. 所述文件管理模块12主要负责完成文件操作和管理,包括:创建、删除、查找、命名、读取、写入、打开和关闭等操作。 The file management module 12 is responsible for the completion of file operations and management, including: create, delete, search, name, read, write, open and close operations. 所述分布式传输模块14主要负责在客户端模块与服务器之间完成分布式文件的传输。 14 is responsible for performing distributed files between the client module and the server module for transmitting the distributed transmission.

[0048] 具体地,该系统还可以进一步包括:配置管理模块15及核心算法模块16。 [0048] In particular, the system may further comprise: a configuration management module algorithm module 15 and core 16. 当上述文件管理模块12发出索引获取请求后,可以先由配置管理模块15查找相应的资源分布配置信息;然后再由核心算法模块16根据配置管理模块15查找到的资源分布配置信息获取所需文件的索引信息及该文件所在服务器的IP地址发送给所述分布式管理模块13。 When the above-described index file acquisition request issued by the management module 12 can find the appropriate configuration information resource distribution start with the configuration management module 15; then the core algorithm module 16 acquires the file according to the obtained resource distribution configuration information needed by the management module 15 and index information of the file server where the IP address is sent to the distributed management module 13.

[0049] 其中,所述核心算法模块16的功能可以包括:文件寻址算法、云资源调度算法、文件传输控制算法、点对点种子路径寻址算法、文件加密算法及文件传输压缩和解压算法等。 [0049] wherein the core function algorithm module 16 may include: documents addressing algorithm, cloud resource scheduling algorithm, the file transfer control algorithm, the seed point addressing path algorithm, the encryption algorithm and file transfer file compression and decompression algorithms. 所述配置管理模块15负责完成云配置资源的加载、重载、云服务器的启动、停止,并且负责和分布式管理模块13进行通信,以完成配置资源的变化。 The configuration management module 15 is responsible for allocation of resources to complete the loading of cloud, overloading, the cloud server to start, stop, and distributed and is responsible for managing communication module 13 to complete the change in the allocation of resources.

[0050] 具体地,该系统还可以进一步包括:协议适配模块17,根据所述服务器的本地文件系统格式对分布式管理模块13获取的所述索引信息进行协议适配,得到适配后的索引信息;然后由所述分布式传输模块14根据协议适配模块17得到的所述适配后的索引信息及所述IP地址从相应的服务器读取所述文件。 [0050] In particular, the system may further comprise: protocol adaptation module 17, the protocol adaptation of the index management module 13 acquires information distributed according to the format of the local file system server, adapted to obtain the index information; and the file of the distributed transmission module 14 reads from the corresponding server based on the index information of the adaptation protocol and the IP address obtained by the adaptation module 17. 并且,所述协议适配模块17还可以对分布式传输模块14读取的所述文件进行协议适配,得到适配后的文件,具体地,进行所述协议适配时可以将读取的所述文件转换为CFS格式;然后由所述分布式传输模块14经所述文件管理模块12将所述适配后的文件发送给所述第一客户端模块11。 And the protocol adaptation module 17 may also be distributed transmission protocol module is adapted to read the file 14, the file is adapted to obtain, in particular, can be performed when the read protocol adapted CFS file into the format; then 12 transmitted by the transmission module 14 via the distributed file management module adapted file to the said first client module 11. 其中,该协议适配模块17主要负责适配底层传输协议和本地文件系统。 Wherein the protocol adaptation module 17 is responsible for adapting the underlying transport protocol and the local file system.

[0051] 本实施例所述系统也可以称为云文件系统(Cloud File Systems,简称:CFS),该系统基于IP协议,适用于IP分布式构造,具有开放统一的标准接口,扩展性能强大,仅需要扩展廉价PC服务器,便可扩展存储性能和计算能力,使用户不必采用昂贵的存储和高性能的计算服务器便可搭建自己的云计算平台,开发自己的云计算应用。 [0051] The system according to the present embodiment may also be referred to as a cloud file system (Cloud File Systems, abbreviation: CFS), the system is based on IP protocol for IP distributed structure, has uniform open standard interface, extended powerful, only need to extend the low-cost PC servers, you can expand storage performance and computing power, so users do not have to use expensive storage and high performance computing server can build their own cloud computing platform to develop their own cloud computing applications.

[0052] 另外,如图3所示,所述系统中还可以进一步包括:点对点传输模块18和第二客户端模块19,其中,点对点传输模块18可以完成客户端模块间的点对点传输,产生种子监控器(tracker),用于在点对点(Peer to Peer)传输中获知正在传输的文件名称,然后提供给其他下载同样文件的对端设备的清单。 [0052] Further, as shown in FIG. 3, the system may further comprise: a transmission point and the second client module 18 module 19, wherein the point to point transmission point to point transmission module 18 can be completed between the client module, produce seeds monitor (tracker), for point to point (peer to peer) file transfer in the name of being informed of the transfer, and to provide a list of other peer devices download the same file. 该系统的工作原理如下: The system works as follows:

[0053] 所述分布式传输模块14在进行文件读取后,还可以进一步根据读取的所述文件生成相应的文件种子保存在所述点对点传输模块18中;当第二用户通过操作第二客户端模块19发出另一文件读取请求时,所述文件管理模块12根据所述另一文件读取请求查询所述分布式传输模块14是否曾经向所述第一客户端模块11传输过所述另一文件读取请求所要读取的文件,并将查询结果发送给所述第二客户端模块19 ;当所述查询结果为是时,所述第二客户端模块19则从所述点对点传输模块18中获取相应的文件种子,并根据该文件种子以点对点方式从相应的第一客户端模块11获取该第一客户端模块11中保存的与所述文件种子相应的文件。 [0053] The distributed transmission module 14 is performed after reading the file, may be further generated in accordance with the read file corresponding file stored in said seed point to point transmission module 18; when the second user operates a second when the client module 19 to issue another request to read a file, the file management module 12 according to the read request file to another distributed transmission module 14 to the query whether the transmission 11 to have the client module over the first said another file read request to read the file, and the query result to the second client module 19; when the query result is yes, the second client module 19 from the point the transmission module 18 obtains the corresponding file seed, P2P manner and acquire the files in the file seed respective first client module 11 from the respective stored first client module 11 based on the file seed. 具体地,第二客户端模块19可以通过点对点传输模块18调用核心算法模块16中的点对点种子路径寻址算法,以实现第二客户端模块19与第一客户端模块11之间的点对点文件传输。 Specifically, the second module 19 may invoke client-point addressing path algorithm seed core algorithm module 16 via the point to point transmission module 18, in order to achieve the 11 peer to peer file transfer between the second client module 19 with the first client module .

[0054] 其中,所述第一客户端模块11及第二客户端模块19可以为用户进行的CFS系统操作提供接口,创建并管理本地缓存,并负责点对点的传输调度。 [0054] wherein, CFS operating system client module 11 of the first and the second client module 19 can provide an interface for users to create and manage a local cache, and for point to point transmission schedule.

[0055] 此处需要说明的是,图3中所示的虚线箭头表示模块间的调用关系,例如:调用接口调用点对点传输模块18、文件管理模块12和分布式传输模块14 ;分布式管理模块13调用配置管理模块15、核心算法模块16和协议适配模块17 ;分布式传输模块14调用协议适配模块17 ;点对点传输模块18调用核心算法模块16,被调用的模块通过执行函数调用命令来实现如上所述的相应的功能。 [0055] Note that here, the dashed arrows shown in FIG. 3 indicates that the call between modules, for example: call interface call point transmission module 18, the distributed file management module 12 and transmitting module 14; Distributed Management Module 13 calls the configuration management module 15, the core module 16 and the protocol adaptation algorithm module 17; distributed transmission protocol module 14 calls the adaptation module 17; point transmission module 18 calls the core algorithm module 16, the module is called by executing the function call-up command to implement the corresponding functions as described above. 图4为图3所示系统的函数调用命令传输过程示意图,如图所示,包括如下函数命令调用过程: 4 is a view of the system shown in FIG. 3 is a schematic function call command transmission process, as shown, it comprises a function call command follows:

[0056] 1.用户A在客户端模块A调用read O函数命令进行文件读取; [0056] 1. User A read O function call client module A command file read;

[0057] 2.文件管理模块对readO函数命令进行缓冲,当此条命令进栈后,调用分布式管理模块的readlndexO函数命令; [0057] 2. The file management module readO command buffer function, when the push This command, function call command readlndexO distributed management module;

[0058] 3.分布式管理模块此时通过调用readConfigO函数命令读取配置管理模块的缓冲区(Buffer); [0058] 3. At this distributed management module by reading the module configuration management buffer (Buffer) readConfigO function call command;

[0059] 4.配置管理模块通过调用getQuickDatalndexO函数命令根据名字空间等索引信息调用核心算法模块,核心算法模块返回需要读取文件的索引信息和所在服务器的IP地址; [0059] 4. The configuration management module by calling getQuickDatalndexO function according to the command name space index information call the core algorithm module, the module core algorithm returns the IP address of the server where the index information and the need to read the file;

[0060] 5.分布式管理模块得到文件索引后,通过readLocalFilelndexO函数命令调用协议适配模块; After [0060] A distributed file management module to obtain an index, call protocol adaptation module readLocalFilelndexO function command;

[0061] 6.协议适配模块根据IP地址找到文件所在的服务器,并通过调用getAdpterFileHandlerO函数命令向服务器获取本地文件格式数据; [0061] 6. A protocol adaptation module server files found based on the IP address, and acquires the native file format data to the server by calling the function getAdpterFileHandlerO command;

[0062] 7.服务器通过调用getLocalHandlerO函数命令从本地文件系统中获取本地文件格式数据; [0062] 7. The server obtains data from the native file format local file system by calling the function getLocalHandlerO command;

[0063] 8.服务器通过调用getMatchToHandlerO函数命令将本地文件格式数据返回给协议适配模块,由协议适配模块根据该本地文件格式数据中记录的本地文件系统格式对所述索引信息进行适配,并将适配后的索引信息经分布式管理模块返回给文件管理模块; [0063] 8. getMatchToHandlerO server by calling the function command data back to the format of the local file protocol adaptation module for adaptation of the index information by the protocol adaptation module according to the local file system formats native file format of data recorded, and returns the adapted index information via a distributed management module to the file management module;

[0064] 9.文件管理模块获取适配后的索引信息后,调用readDatadndex)函数命令,以获取文件实体; [0064] 9. The file management module after obtaining the adapted index information, call readDatadndex) function command to obtain the file entity;

[0065] 10.分布式传输模块调用readLocalFileDataO函数命令,以获取文件实体; [0065] 10. The distributed transmission module calls a function readLocalFileDataO command to obtain the file entity;

[0066] 11.协议适配模块通过调用getAdpaterFileDataO函数命令从服务器的本地文件系统获取相应的文件实体返回给分布式传输模块,并由分布式传输模块经文件管理模块将文件实体传输给客户端模块A,从而完成对文件的读取。 [0066] 11. A protocol adaptation module by calling the Get command getAdpaterFileDataO function entity returns the corresponding document to the distributed transmission module from the local file system server, transmission by the distributed file management module to module is transmitted to the client entity file module a, thereby completing the reading of the file.

[0067] 12.用户B在客户端模块B调用readO函数命令,向文件管理模块请求进行文件读取; [0067] 12. The user B calls the function command readO client module B, a request to read the file management module files;

[0068] 13.文件管理模块通过调用haveLivelndexO函数命令从分布式传输模块获知是否存在此文件的种子,如果存在,返回给客户端模块B种子索引; [0068] The file management module 13 by calling the function command haveLivelndexO seed know whether this file is distributed from the transmission module, if present, is returned to the client module B index seeds;

[0069] 14.客户端模块B通过getLivelndexO函数命令从点对点传输模块得到文件种子后从相应的客户端模块点对点地传输所要读取的文件,例如,在图4中,如果该文件种子表明相应的文件保存在客户端模块A中,则客户端模块B从客户端模块A点对点地传输所要读取的文件;如果该文件种子表明相应的文件保存在客户端模块C中,则客户端模块B从客户端模块C点对点地传输所要读取的文件。 [0069] 14. The client file transfer to be read after the end of the module file B obtained from the seed point transmission module getLivelndexO function command corresponding client module from point to point, for example, in FIG. 4, if it indicates that the corresponding file seed file stored in the client module a, the file client module B client module a point to point transmission from a to be read; if the file seed indicates that the corresponding file stored in the client module C, then the client module B from file client module to transmit the point C to be read.

[0070] 本实施例所述系统还进一步实现了客户端模块之间以点对点方式传输文件,节省了文件传输的时间也减轻了文件系统的工作负担。 [0070] The system of the present embodiment to achieve a further embodiment between peer client module to transfer files, saving time file transfer lightening the burden on the file system. [0071] 本领域普通技术人员可以理解:实现上述方法实施例的全部或部分步骤可以通过程序指令相关的硬件来完成,前述的程序可以存储于一计算机可读取存储介质中,该程序在执行时,执行包括上述方法实施例的步骤;而前述的存储介质包括:R0M、RAM、磁碟或者光盘等各种可以存储程序代码的介质。 [0071] Those of ordinary skill in the art can be appreciated: realize all or part of the steps of the method described above may be implemented by a program instructing relevant hardware to complete, the program may be stored in a computer readable storage medium, the program execution when, comprising the step of performing the above-described embodiment of the method; and the storage medium comprising: a variety of medium may store program codes R0M, RAM, magnetic disk, or optical disk.

[0072] 最后应说明的是:以上实施例仅用以说明本发明的技术方案,而非对其限制;尽管参照前述实施例对本发明进行了详细的说明,本领域的普通技术人员应当理解:其依然可以对前述各实施例所记载的技术方案进行修改,或者对其中部分技术特征进行等同替换;而这些修改或者替换,并不使相应技术方案的本质脱离本发明各实施例技术方案的精神和范围。 [0072] Finally, it should be noted that: the above embodiments are intended to illustrate the present invention, rather than limiting;. Although the present invention has been described in detail embodiments, those of ordinary skill in the art should be understood: may still be made to the technical solutions described in each embodiment of the modified or part of the technical features equivalents; as such modifications or replacements do not cause the essence of corresponding technical solutions to depart from the technical solutions of the embodiments of the present invention and scope.

Claims (7)

  1. 1.一种云计算模式文件系统,其特征在于,包括: 第一客户端模块,用于发出文件读取请求; 文件管理模块,用于根据第一客户端模块发出的所述文件读取请求发出索引获取请求; 分布式管理模块,用于根据文件管理模块发出的所述索引获取请求获取所需文件的索引信息及该文件所在服务器的IP地址; 分布式传输模块,用于根据分布式管理模块获取的所述索引信息及所述IP地址从相应的服务器读取所述文件,经所述文件管理模块发送给所述第一客户端模块; 协议适配模块,根据所述服务器的本地文件系统格式对分布式管理模块获取的所述索弓I信息进行协议适配,得到适配后的索引信息; 所述分布式传输模块还用于根据协议适配模块得到的所述适配后的索引信息及所述IP地址从相应的服务器读取所述文件; 所述协议适配模块还用于对分布式传输模 A cloud computing model file system, characterized by comprising: a first client module for sending a file read request; file management module, a request for reading a file according to the first client module sent index acquisition request issued; distributed management module, configured to obtain the index file according to a request issued by the management module obtains the IP address of the desired file and index information of the file server is located; distributed transmission module for distributed management module acquires the index information and the corresponding IP address read from the file server, the file manager sends the first module to the client module; protocol adaptation module according to the local file server the system format of the index information I bow distributed management protocol module is adapted to acquire, to obtain the adapted index information; for the distributed transmission module is further adapted obtained after the adaptation module according to the protocol index information and the IP address read from the respective file server; the protocol module is further adapted for distributed transmission mode 读取的所述文件进行协议适配,得到适配后的文件; 所述分布式传输模块经所述文件管理模块将所述适配后的文件发送给所述第一客户端模块。 The adaptation protocol read file, get file adapter; the distributed transmission module via the file management module adapted to send the file to the first client module.
  2. 2.根据权利要求1所述的系统,其特征在于,还包括: 配置管理模块,用于根据文件管理模块发出的所述索引获取请求查找相应的资源分布配置信息; 核心算法模块,用于根据配置管理模块查找到的资源分布配置信息获取所需文件的索引信息及该文件所在服务器的IP地址发送给所述分布式管理模块。 2. The system according to claim 1, characterized in that, further comprising: a configuration management module, according to the index file management module issuing an acquisition request to find the appropriate configuration information resource distribution; core algorithm module for configuration management module to the distribution of resources to find configuration information needed to obtain the index information file and the file server where the IP address to the distributed management module.
  3. 3.根据权利要求1所述的系统,其特征在于,还包括:点对点传输模块;所述分布式传输模块还用于根据读取的所述文件生成相应的文件种子保存在所述点对点传输模块中。 3. The system of claim 1, characterized in that, further comprising: a point to point transmission module; the distributed transmission module is further configured to generate the corresponding read file seed according to the file stored in the point to point transmission module in.
  4. 4.根据权利要求3所述的系统,其特征在于,还包括: 第二客户端模块,用于发出另一文件读取请求; 所述文件管理模块还用于查询所述分布式传输模块是否曾经向所述第一客户端模块传输过所述另一文件读取请求所要读取的文件,并将查询结果发送给所述第二客户端模块; 当所述查询结果为是时,所述第二客户端模块还用于从所述点对点传输模块中获取相应的文件种子,并根据该文件种子以点对点方式从相应的第一客户端模块获取该第一客户端模块中保存的与所述文件种子相应的文件。 4. The system of claim 3, characterized in that, further comprising: a second client module for issuing another read request file; the file management module is further configured to query whether the distributed transmission module once transmitted to the first client module to another through the file read request to read the file, and sends the query result to the second client module; when the query result is yes, the the second client module is further configured to obtain the corresponding file from said seed point to point transmission module, and acquire the P2P manner stored in the first module of the client from the respective client module in accordance with the first file seed the corresponding file seed.
  5. 5.一种文件读取方法,其特征在于,包括: 接收由第一客户端模块发出的文件读取请求; 根据所述文件读取请求获取所需文件的索引信息及该文件所在服务器的IP地址; 根据所述索引信息及所述IP地址从相应的服务器读取所述文件; 将读取的所述文件发送给所述第一客户端模块; 根据所述索引信息及所述IP地址从相应的服务器读取所述文件包括: 根据所述服务器的本地文件系统格式对所述索引信息进行协议适配,得到适配后的索弓K目息;根据所述适配后的索引信息及所述IP地址从相应的服务器读取所述文件; 将读取的所述文件发送给所述第一客户端模块包括: 对读取的所述文件进行协议适配,得到适配后的文件; 将所述适配后的文件发送给所述第一客户端模块。 A document reading method, comprising: receiving a first file by the client module sends a read request; IP obtaining the required documents and index information of the file server where the file read request according address; read according to the index information and the corresponding IP address from the file server; read the file sent to the first client module; according to the index information and the IP address from reading the corresponding file server comprising: protocol adaptation index information according to the format of the local file system server, to obtain index information after bow K mesh adaptation; according to the index information and the adaptation the IP address read from the respective file server; the first client module will read the file to the comprising: file read the protocol adaptation is performed to obtain the adapted file ; adapted to transmit the file to the first client module.
  6. 6.根据权利要求5所述的方法,其特征在于,根据所述文件读取请求获取所需文件的索引信息及该文件所在服务器的IP地址包括: 根据所述文件读取请求生成索引获取请求; 根据所述索引获取请求查找相应的资源分布配置信息; 根据查找到的所述资源分布配置信息获取所需文件的索引信息及该文件所在服务器的IP地址。 6. The method as claimed in claim 5, wherein obtaining the IP address information of the desired file and the index file where the server comprises a file read request by: a file read request generated according to the index obtaining request ; obtained according to the index to find the corresponding resource distribution request configuration information; configuration information to find the desired resource distribution acquiring index information file and the file server where the IP address.
  7. 7.根据权利要求5所述的方法,其特征在于,根据所述索引信息及所述IP地址从相应的服务器读取所述文件之后还包括: 根据读取的所述文件生成相应的文件种子; 当接收到来自第二客户端模块发出的另一文件读取请求时,查询是否曾经向所述第一客户端模块传输过所述另一文件读取请求所要读取的文件,并将查询结果发送给所述第二客户块; 当所述查询结果为是时,`所述第二客户端模块获取相应的文件种子; 所述第二客户端模块根据所述文件种子以点对点方式从所述第一客户端模块获取与所述文件种子相应的文件。 7. The method as claimed in claim 5, characterized in that the read from the corresponding server according to the index information and the IP address of the file after further comprising: generating a seed corresponding file according to the file read ; when another file is received from a second client module issues read requests, to check whether the transmission has the first client module to another through the file read request to read the file, and the query result to the second client block; if the query result is yes, 'the second client module obtains the corresponding file seed; the second client module according to the file-to-point manner from the seed said first client module acquires the corresponding document file seed.
CN 201010609600 2010-12-30 2010-12-30 Cloud computing mode file system and file reading method CN102045399B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN 201010609600 CN102045399B (en) 2010-12-30 2010-12-30 Cloud computing mode file system and file reading method

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN 201010609600 CN102045399B (en) 2010-12-30 2010-12-30 Cloud computing mode file system and file reading method

Publications (2)

Publication Number Publication Date
CN102045399A true CN102045399A (en) 2011-05-04
CN102045399B true CN102045399B (en) 2013-09-18

Family

ID=43911159

Family Applications (1)

Application Number Title Priority Date Filing Date
CN 201010609600 CN102045399B (en) 2010-12-30 2010-12-30 Cloud computing mode file system and file reading method

Country Status (1)

Country Link
CN (1) CN102045399B (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9871840B2 (en) 2011-08-31 2018-01-16 Samsung Electronics Co., Ltd. Electronic apparatus and method for transferring contents on cloud system to device connected to DLNA

Families Citing this family (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR20130024788A (en) * 2011-08-31 2013-03-08 삼성전자주식회사 Apparatas and method for contents transfer to dlna connected device of cloud system in an electronic device
CN102724301B (en) * 2012-05-29 2015-02-04 中国联合网络通信集团有限公司 Cloud database system and method and equipment for reading and writing cloud data
CN103475743B (en) * 2013-09-30 2018-01-23 广州博冠信息科技有限公司 A method for a cloud service, device and system
CN103473379B (en) * 2013-09-30 2017-02-15 广州博冠信息科技有限公司 A method for an electronic map, device and system
CN104702634A (en) * 2013-12-04 2015-06-10 腾讯科技(深圳)有限公司 Method, device and system for processing data operation request

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7310629B1 (en) 1999-12-15 2007-12-18 Napster, Inc. Method and apparatus for controlling file sharing of multimedia files over a fluid, de-centralized network
CN101520793A (en) 2008-12-30 2009-09-02 深圳市同洲电子股份有限公司 Method and system for storing and reading stream media file and stream media server
CN101854387A (en) 2010-05-14 2010-10-06 中国科学院计算技术研究所 P2P flow optimization method and system based on distributed index server architecture
CN101873481A (en) 2010-03-01 2010-10-27 杭州海康威视数字技术股份有限公司 Method and system for playing back videos in video monitoring system and network monitoring client side
CN101901263A (en) 2010-07-22 2010-12-01 华为终端有限公司 Access method and device of file system

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7310629B1 (en) 1999-12-15 2007-12-18 Napster, Inc. Method and apparatus for controlling file sharing of multimedia files over a fluid, de-centralized network
CN101520793A (en) 2008-12-30 2009-09-02 深圳市同洲电子股份有限公司 Method and system for storing and reading stream media file and stream media server
CN101873481A (en) 2010-03-01 2010-10-27 杭州海康威视数字技术股份有限公司 Method and system for playing back videos in video monitoring system and network monitoring client side
CN101854387A (en) 2010-05-14 2010-10-06 中国科学院计算技术研究所 P2P flow optimization method and system based on distributed index server architecture
CN101901263A (en) 2010-07-22 2010-12-01 华为终端有限公司 Access method and device of file system

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9871840B2 (en) 2011-08-31 2018-01-16 Samsung Electronics Co., Ltd. Electronic apparatus and method for transferring contents on cloud system to device connected to DLNA

Also Published As

Publication number Publication date Type
CN102045399A (en) 2011-05-04 application

Similar Documents

Publication Publication Date Title
US6711572B2 (en) File system for distributing content in a data network and related methods
US8296398B2 (en) Peer-to-peer redundant file server system and methods
US20090240698A1 (en) Computing environment platform
US20080281908A1 (en) Hybrid segment-oriented file server and wan accelerator
US20090024752A1 (en) Method and apparatus for storage-service-provider-aware storage system
US20090037430A1 (en) Unwired enterprise platform
US20100180208A1 (en) Server side data cache system
US20100241731A1 (en) Method for virtualizing internet resources as a virtual computer
US20070038637A1 (en) Optimized network cache for virus scanning by examining the magic bytes of a file
US20070198478A1 (en) Distributed meta data management middleware
CN1771495A (en) Distributed file serving architecture system
US20090313260A1 (en) Methods and systems for assisting information processing by using storage system
US20090019223A1 (en) Method and systems for providing remote strage via a removable memory device
US20110167173A1 (en) Optimal Compression Process Selection Methods
CN101141476A (en) File storing, downloading method and device
US20110145367A1 (en) Scalable caching of remote file data in a cluster file system
US20110196828A1 (en) Method and System for Dynamically Replicating Data Within A Distributed Storage System
US20080271130A1 (en) Minimizing client-side inconsistencies in a distributed virtual file system
US20080144826A1 (en) System and procedure for rapid decompression and/or decryption of securely stored data
US20090164500A1 (en) System for providing a configurable adaptor for mediating systems
CN101930449A (en) Client, brokerage server and method for providing cloud storage
CN101815087A (en) Method for caching information of mobile communication terminal
CN101437044A (en) Method and system for downloading file by point-to-point network technique based on sliced sheet
EP1727056B1 (en) Data communication protocol
CN102355426A (en) Method for transmitting off-line file and system

Legal Events

Date Code Title Description
C06 Publication
C10 Request of examination as to substance
C14 Granted