WO2016065610A1 - Procédé pour accéder à des fichiers, système de stockage distribué et nœud de stockage - Google Patents

Procédé pour accéder à des fichiers, système de stockage distribué et nœud de stockage Download PDF

Info

Publication number
WO2016065610A1
WO2016065610A1 PCT/CN2014/090017 CN2014090017W WO2016065610A1 WO 2016065610 A1 WO2016065610 A1 WO 2016065610A1 CN 2014090017 W CN2014090017 W CN 2014090017W WO 2016065610 A1 WO2016065610 A1 WO 2016065610A1
Authority
WO
WIPO (PCT)
Prior art keywords
space
virtual address
local
address
storage node
Prior art date
Application number
PCT/CN2014/090017
Other languages
English (en)
Chinese (zh)
Inventor
朱冠宇
徐君
刘海燕
Original Assignee
华为技术有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 华为技术有限公司 filed Critical 华为技术有限公司
Priority to CN201480037251.5A priority Critical patent/CN105765542B/zh
Priority to PCT/CN2014/090017 priority patent/WO2016065610A1/fr
Publication of WO2016065610A1 publication Critical patent/WO2016065610A1/fr

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F12/00—Accessing, addressing or allocating within memory systems or architectures
    • G06F12/02—Addressing or allocation; Relocation
    • G06F12/08—Addressing or allocation; Relocation in hierarchically structured memory systems, e.g. virtual memory systems

Definitions

  • the present invention relates to the field of storage technologies, and in particular, to a method for accessing a file, a distributed storage system, and a storage node.
  • New non-violate memory (NVM) media such as Phase Change Memory (PCM), Resistive RAM (ReRAM), Magnetic Random Access Memory (Magnetic Random Access Memory) , MRAM), etc., with similar dynamic random access memory (DRAM) read and write characteristics, can be hung on the memory bus for access.
  • PCM Phase Change Memory
  • ReRAM Resistive RAM
  • MRAM Magnetic Random Access Memory
  • DRAM dynamic random access memory
  • NFS Network File System
  • CIFS Common Internet File System
  • RPC Remote Procedure Call
  • TCP/IP Transmission Control Protocol/Internet Protocol
  • the embodiment of the invention provides a method for accessing a file, a distributed storage system and a storage node, which can improve the efficiency of file access.
  • a method for accessing a file is provided, the method being applied to a distributed storage system, the distributed storage system comprising a management node, a plurality of storage nodes, and a network device, each storage node in the distributed storage system
  • the local virtual address space corresponds to a portion of the global virtual address space of the distributed storage system, and the method includes:
  • the first storage node Receiving, by the first storage node, an access request of the host forwarded by the network device, where the access request is used to access a first virtual space of the target file, where the first virtual space is the management node allocates the target file in the global virtual address space.
  • the destination address of the access request is the first virtual a global virtual address of the space, the first storage node being a storage node of the plurality of storage nodes for storing the target file;
  • the first storage node accesses the target file according to the local virtual address.
  • the number of bits of the destination address is 2N bits, where N is the number of bits of the local virtual address, and the high N bits of the destination address include the first storage node
  • the device information, the lower N bits of the destination address is the local virtual address, and the access request is forwarded by the network device to the first storage node according to the device information of the first storage node.
  • the first storage node accesses the target file according to the local virtual address.
  • the first storage node determines that there is a local physical space address corresponding to the local virtual address, the first storage node writes the data in the write request to the local physical space corresponding to the local physical space address;
  • the first storage node determines that there is no local physical space address corresponding to the local virtual address, the first storage node allocates a local physical space for the target file, and writes the data in the write request to the allocated local physical In space.
  • the first storage node accesses the target file according to the local virtual address.
  • the first storage node determines a local physical space address corresponding to the local virtual address, and reads data in the local physical space corresponding to the local physical space address.
  • the first storage node receives the network device forwarding Before the host's access request, the method also includes:
  • the first storage node allocates the local virtual address space to the target file according to the space allocation request
  • the first storage node establishes a correspondence between the destination address and a local virtual address of the local virtual address space.
  • the method further includes:
  • the first storage node deletes the correspondence between the destination address and the local virtual address according to the space collection message, and recovers the local virtual address space;
  • the first storage node reclaims the local physical space corresponding to the local virtual address space.
  • a distributed storage system including: a management node, a plurality of storage nodes, and a network device;
  • a local virtual address space of each of the plurality of storage nodes corresponds to a portion of a global virtual address space of the distributed storage system
  • the management node is configured to allocate a first virtual space to the target file in the global virtual address space
  • the network device is configured to forward an access request of the host to the first storage node, where the access request is used to access the first virtual space, and the destination address of the access request is a global virtual address of the first virtual space, the first storage node a storage node for storing the target file among the plurality of storage nodes;
  • the first storage node is configured to receive the access request by the network device, and determine the local virtual address corresponding to the destination address of the access request according to the correspondence between the destination address and the local virtual address in the first storage node, according to the The local virtual address accesses the target file.
  • the number of bits of the destination address is 2N bits
  • N is the number of bits of the local virtual address
  • the high N bits of the destination address include the device of the first storage node.
  • Information the lower N bits of the destination address are the local virtual address
  • the network device is specifically configured to forward the access request to the first storage node according to the device information of the first storage node.
  • the first storage node when the access request is a write request, is specifically configured to determine the presence and the local The local physical space address corresponding to the virtual address, the data in the write request is written to the The local physical space corresponding to the local physical space address; or, if it is determined that there is no local physical space address corresponding to the local virtual address, allocate a local physical space for the target file, and write the data in the write request to the allocated In the local physical space.
  • the first storage node when the access request is a read request, is specifically configured to determine the local virtual address Corresponding local physical space address, reading data in the local physical space corresponding to the local physical space address.
  • the first storage node is further configured to receive the management node a space allocation request for allocating a local virtual address space for the target file, the space allocation request carrying a global virtual address of the first virtual space;
  • the first storage node is further configured to receive a space collection message sent by the management node, where the space recovery message is used to recover the local a virtual address space, where the space reclaim message carries a global virtual address of the first virtual space;
  • a storage node including:
  • a receiving module configured to receive an access request of a host forwarded by a network device in the distributed storage system, where the access request is used to access a first virtual space of the target file, where the first virtual space is a management node in the distributed storage system a space allocated for the target file in the global virtual address space of the distributed storage system, where a local virtual address space of each storage node in the distributed storage system corresponds to a part of the global virtual address space, and the destination address of the access request a global virtual address for the first virtual space;
  • the processing module is configured to determine the local virtual address corresponding to the destination address of the access request according to the correspondence between the destination address and the local virtual address in the storage node, and access the target file according to the local virtual address.
  • the number of bits of the destination address is 2N. Bit, N is the number of bits of the local virtual address, the high N bits of the destination address contain device information of the storage node, and the lower N bits of the destination address are the local virtual address, and the access request is determined by the network device according to the storage The device information of the node is forwarded to the storage node.
  • the processing module when the access request is a write request, is specifically configured to:
  • the data in the write request is written to the local physical space corresponding to the local physical space address
  • the local physical space is allocated to the target file, and the data in the write request is written into the allocated local physical space.
  • the processing module when the access request is a read request, is specifically configured to determine, corresponding to the local virtual address.
  • the local physical space address reads the data in the local physical space corresponding to the local physical space address.
  • the receiving module is further configured to receive the sending by the management node a space allocation request, the space allocation request is used to allocate a local virtual address space for the target file, where the space allocation request carries a global virtual address of the first virtual space;
  • the processing module is further configured to allocate the local virtual address space to the target file according to the space allocation request, and establish a correspondence between the destination address and a local virtual address of the local virtual address space.
  • the receiving module is further configured to receive a space collection message sent by the management node, where the space recovery message is used to recover the local virtual address. a space, the space reclaim message carrying a global virtual address of the first virtual space;
  • the processing module is further configured to delete the correspondence between the destination address and the local virtual address according to the space collection message, recover the local virtual address space, and recover the local physical space corresponding to the local virtual address space.
  • a computer program product comprising a computer readable storage medium storing program code, the program code comprising instructions for performing the method of the first aspect described above.
  • the method for accessing a file, the distributed storage system, and the storage node in the embodiment of the present invention access the distributed storage system according to the local virtual address corresponding to the destination address by receiving an access request whose destination address is a global virtual address.
  • the files in the file enable the host to directly access files in the distributed storage system, thereby improving the efficiency of file access.
  • FIG. 1 is a schematic diagram of an application scenario of an embodiment of the present invention.
  • FIG. 2 is a schematic flowchart of a method for accessing a file according to an embodiment of the present invention.
  • FIG. 3 is a schematic block diagram of a distributed storage system in accordance with an embodiment of the present invention.
  • FIG. 4 is a schematic block diagram of a storage node in accordance with an embodiment of the present invention.
  • FIG. 5 is a schematic structural diagram of a storage node according to an embodiment of the present invention.
  • virtual address space may also be expressed as “virtual space”, that is, “virtual address space” and “virtual space” are common; similarly, “local physical storage space” “Common with “local physical space.”
  • FIG. 1 is a schematic diagram of an application scenario of an embodiment of the present invention.
  • host 130, storage node 120, and management node 110 are interconnected by network 140.
  • Storage node 120, management node 110, and network 140 form a distributed storage system.
  • the host 130 can be a computer or other user device, and the host 130 can communicate with the distributed storage system through a network.
  • Host 130 may include any computing device known in the art, such as a server, desktop computer, etc., with an operating system and other applications installed in host 130, and there may be multiple hosts 130.
  • Host 130 can access files of the distributed storage system.
  • the host 130 can provide a file access interface to an application on the host through the file interface module.
  • the storage node 120 is configured to store file data and process access requests to the file.
  • Storage node 120 may include at least one type of memory, for example, a new type of NVM having the ability to address and access in bytes, such as PCM, ReRAM, MRAM, and the like.
  • the file is stored in the NVM memory, and the storage node 120 can implement access to the new NVM through the memory bus.
  • the management node 110 is configured to manage metadata of the file, process metadata query, update request, and the like of the host to the file.
  • the metadata of the file may include information such as the starting address of the file, the size of the allocated space, and the actual size of the file.
  • the management node 110 can also be used to manage the global virtual address space of the distributed storage system.
  • the management node 110 and the storage node 120 may also be combined, that is, one node may have the functions of both the management node and the storage node.
  • the management node may be independently set (for example, the metadata management node 110 in FIG. 1), or may be a node having the functions of the metadata management node and the storage node at the same time.
  • the management node 110 will be described below as an example.
  • the physical layer and link layer of the network 140 may be based on Ethernet, a PCIE switching network, an InfiniBand network, and an optical network.
  • the network 140 is used to route access requests and access responses. Specifically, the routes may be performed by a network device such as a router or a switch. For convenience of description, the following describes a network device as an example.
  • FIG. 2 shows a schematic flow diagram of a method 200 of accessing a file in accordance with an embodiment of the present invention.
  • the method 200 is applied to a distributed storage system including a management node, a plurality of storage nodes, and a network device.
  • the local virtual address space of each storage node in the distributed storage system corresponds to a portion of the global virtual address space of the distributed storage system.
  • the first storage node receives an access request of the host forwarded by the network device, where the access request is used to access a first virtual space of the target file, where the first virtual space is the management node in the global virtual address space.
  • a space allocated by the file, the destination address of the access request is a global virtual address of the first virtual space, and the first storage node is a storage node of the plurality of storage nodes for storing the target file.
  • the global virtual address space of a distributed storage system is the space that is virtualized for managing files in the distributed storage system.
  • the local virtual address space of the different storage nodes in the distributed storage system corresponds to different portions of the global virtual address space of the distributed storage system. For example, global virtual Mapping a first portion of the virtual address space to a local virtual address space of the first storage node in the distributed storage system, and mapping a second portion of the global virtual address space to a second storage node in the distributed storage system
  • the local virtual address space wherein the first part of the space is different from the second part of the space.
  • the management node may allocate a continuous space (represented as the first virtual space) from the global virtual address space of the distributed storage system to the target file. Since the local virtual address space of each storage node in the distributed storage system corresponds to a portion of the global virtual address space of the distributed storage system, the first virtual space can be mapped to the local virtual address space of the storage node.
  • the local virtual address space may use an unused interval of the virtual address space of an operating system (OS) OS.
  • OS operating system
  • the 64-bit OS has a virtual address space size of 2 to the 64th power.
  • the local virtual address space can use the virtual address reserved by the OS. space. You can also re-divide the virtual address space of the operating system as needed, and divide a virtual address space into a local virtual address space.
  • the number of bits in the address of the local virtual address space is the number of bits in the OS. For example, for a 64-bit OS, the number of bits in the local virtual address is 64 bits.
  • the address of the global virtual address space is the global virtual address.
  • the number of bits in the global virtual address can be greater than the number of bits in the local virtual address.
  • the number of bits of the global virtual address may be twice the number of bits of the local virtual address, that is, if the number of bits of the local virtual address is N, the number of bits of the global virtual address is 2N.
  • the global virtual address can have 128 bits.
  • the global virtual address space of the distributed storage system can be mapped to the local virtual address space of the storage node by the correspondence between the global virtual address and the local virtual address.
  • the high N bits of the global virtual address may correspond to the device information of the node (eg, ID, or ID and node type), globally.
  • the lower N bits of the virtual address may correspond to a local virtual address within the node, such that the global virtual address space may correspond to the local virtual address space of each storage node. It should be understood that only a portion of the high N bits may carry the device information of the storage node (eg, the highest 8 bits are the ID of the first storage node), and the remaining bits may be reserved or reserved for other purposes.
  • the correspondence between the global virtual address and the local virtual address may be established in advance, or may be established when space is allocated for the target file.
  • the management node can configure the locals of all storage nodes on the management node.
  • Corresponding relationship between the local virtual address and the global virtual address (which may be referred to as a total mapping table), and the mapping between the local virtual address of the storage node and the global virtual address (which may be referred to as a sub-mapping table) is configured on each storage node.
  • the total mapping table can also be configured on each storage node. In this manner, the local virtual address of all available local virtual address spaces of each storage node is already in the global virtual address and local virtual address correspondence.
  • the management node allocates the first virtual space to the target file, the global virtual address in the corresponding relationship is allocated. Based on the correspondence, the first virtual space is automatically mapped to the local virtual address space of the storage node, and further mapped through the local virtual address space. Go to the local physical storage space.
  • the management node allocates the first virtual space to the target file, the global virtual address in the global virtual address space is allocated, and a space allocation request is sent to the storage node, and the allocated global virtual is carried.
  • the storage node allocates a local virtual address space for the target file, and associates the local virtual address of the allocated local virtual address space with the global virtual address in the space allocation request, that is, establishes the global virtual address of the first virtual space and the allocated local address.
  • the correspondence between the local virtual addresses of the virtual address space may also return the local virtual address of the local virtual address space allocated for the target file to the management node, and the management node establishes a correspondence between the global virtual address of the first virtual space and the local virtual address on the management node.
  • the host When the host accesses the target file in the distributed storage system, the host sends an access request to the network device to access the first virtual space of the target file.
  • the destination address of the access request is the global virtual address of the first virtual space.
  • the network device forwards the access request to the first storage node.
  • the number of bits of the destination address is 2N, where N is the number of bits of the local virtual address in the first storage node corresponding to the destination address, and the high N bit of the destination address includes the The device information of the first storage node, the lower N bits of the destination address is the local virtual address, and the access request is forwarded by the network device to the first storage node according to the device information of the first storage node.
  • the number of bits of the destination address of the access request is 2N
  • the high N bits of the destination address of the access request include device information (eg, ID, or ID and node type) of the first storage node
  • the lower N bits of the destination address of the access request are the local virtual addresses in the first storage node for storing the local virtual address space of the target file.
  • the network device may forward the access request of the host to the first storage node according to the device information of the first storage node.
  • the first storage node determines a local virtual address corresponding to the destination address of the access request according to the correspondence between the destination address and the local virtual address in the first storage node.
  • the first storage node After receiving the access request sent by the network device, the first storage node converts the destination address of the access request into a local virtual address in the first storage node.
  • the correspondence between the destination address and the local virtual address may be in the form of a correspondence table, that is, the correspondence relationship table is used to record the destination address corresponding to the local virtual address, in this case, the first storage.
  • the node determines a local virtual address corresponding to the destination address according to the correspondence relationship table; the correspondence between the destination address and the local virtual address may also be intangible, that is, pre-defining a part of the destination address (for example, a low of 2N bits)
  • the N-bit is the local virtual address corresponding to the destination address.
  • the first storage node directly determines the corresponding bit in the destination address as the local virtual address corresponding to the destination address.
  • the first storage node accesses the target file according to the local virtual address.
  • the first storage node accesses the target file according to the local virtual address obtained in S220.
  • the first storage node determines a local physical space address corresponding to the local virtual address, and reads a local physical medium corresponding to the local physical space address. Data in space.
  • the first storage node queries the local physical space address corresponding to the local virtual address, and if there is no corresponding local physical space address, the access error is generated, so an access error is sent to the network device. Access response. If there is a corresponding local physical space address, the data in the local physical space corresponding to the local physical space address is read, and the data is carried in the access response and sent to the network device.
  • the access request is a write request
  • the first storage node determines that there is a local physical space address corresponding to the local virtual address
  • the data in the write request is written to the local physical space corresponding to the local physical space address.
  • the first storage node allocates the local physical space for the target file, and writes the local physical space.
  • the data in the request is written to the allocated local physical space.
  • the first storage node queries the local physical space address corresponding to the local virtual address, and if the corresponding local physical space address does not exist, the local physical space is not allocated to the target file. Allocating a local physical space for the target file, then writing the data in the write request to the allocated local physical space, and sending a successful access response to the network device; if there is a corresponding local physical space address, the request is written The data in the local data space is written in the local physical space corresponding to the local physical space address, and the access to the network device is successfully sent. should.
  • the method for accessing a file in the embodiment of the present invention by receiving an access request whose destination address is a global virtual address, accessing a file in the distributed storage system according to a local virtual address corresponding to the destination address, enables the host to directly access the distributed storage. Files in the system, which can improve the efficiency of file access.
  • the method 200 further includes:
  • the first storage node allocates the local virtual address space to the target file according to the space allocation request
  • the first storage node establishes a correspondence between the destination address and a local virtual address of the local virtual address space.
  • the space allocation request may carry a starting global virtual address and size of the first virtual space of the target file.
  • the first storage node may first determine whether the local virtual address space satisfies the size requirement, and if not, return an error response; if yes, allocate a local virtual address space for the target file, and establish a corresponding The corresponding relationship returns a successful response.
  • the method 200 further includes:
  • the first storage node deletes the correspondence between the destination address and the local virtual address according to the space collection message, and recovers the local virtual address space;
  • the first storage node reclaims the local physical space corresponding to the local virtual address space.
  • the management node When the target file space is reclaimed, the management node sends a space reclamation message to the first storage node.
  • the space reclamation message may carry the global virtual address of the first virtual space.
  • the first storage node may first determine whether there is a local virtual address corresponding to the global virtual address, and if not, return an error response; if yes, delete the correspondence between the global virtual address and the local virtual address, and recycle the first The local virtual address space corresponding to the virtual space, and the local physical space corresponding to the local virtual address space is recovered, and a successful response is returned.
  • a method of accessing a file according to an embodiment of the present invention is described in detail above, and a distributed storage system and a storage node according to an embodiment of the present invention will be described below.
  • FIG. 3 shows a schematic block diagram of a distributed storage system 300 in accordance with an embodiment of the present invention.
  • the distributed storage system 300 includes a management node 310, a plurality of storage nodes 320, and a network device 330.
  • the local virtual address space of each of the plurality of storage nodes 320 corresponds to a portion of the global virtual address space of the distributed storage system 300.
  • the management node 310 is configured to allocate a first virtual space for the target file in the global virtual address space.
  • the network device 330 is configured to forward an access request of the host to the first storage node, where the access request is used to access the first virtual space, and the destination address of the access request is a global virtual address of the first virtual space, the first storage
  • the node is a storage node of the plurality of storage nodes 320 for storing the target file
  • the first storage node is configured to receive the access request by the network device 330, and determine the local virtual address corresponding to the destination address of the access request according to the correspondence between the destination address and the local virtual address in the first storage node.
  • the target file is accessed according to the local virtual address.
  • the distributed storage system of the embodiment of the present invention can directly access the distributed storage by accessing the file in the distributed storage system according to the local virtual address corresponding to the destination address by receiving the access request with the destination address being the global virtual address. Files in the system, which can improve the efficiency of file access.
  • the number of bits of the destination address is 2N, where N is the number of bits of the local virtual address, and the high N bits of the destination address include device information of the first storage node, and the destination address The lower N bits are the local virtual address;
  • the network device 330 is specifically configured to forward the access request to the first storage node according to the device information of the first storage node.
  • the access request is a write request
  • the access request is a write request
  • the first storage node determines that there is a local physical space address corresponding to the local virtual address
  • the data in the write request is written into the local physical space corresponding to the local physical space address.
  • the first storage node determines that there is no local physical space address corresponding to the local virtual address
  • the local physical space is allocated to the target file, and the data in the write request is written to the allocation. In the local physical space.
  • the first storage node when the access request is a read request, is specifically configured to determine a local physical space address corresponding to the local virtual address, and read the local physical space address. Data in the local physical space.
  • the first storage node is further configured to receive a space allocation request sent by the management node 310, where the space allocation request is used to allocate a local virtual address space to the target file, where the space allocation request is Carrying a global virtual address of the first virtual space;
  • the first storage node is further configured to receive a space collection message sent by the management node 310, where the space collection message is used to recover the local virtual address space, where the space recovery message carries the first a global virtual address of a virtual space;
  • the distributed storage system 300 may correspond to the distributed storage system in the foregoing method embodiments, and the first storage node may perform the corresponding processes of the foregoing various methods. For brevity, no further details are provided herein.
  • FIG. 4 shows a schematic block diagram of a storage node 400 in accordance with an embodiment of the present invention.
  • the storage node 400 includes:
  • the receiving module 410 is configured to receive an access request of a host forwarded by a network device in the distributed storage system, where the access request is used to access a first virtual space of the target file, where the first virtual space is a management in the distributed storage system.
  • the space allocated by the node in the global virtual address space of the distributed storage system for the target file, where the local virtual address space of each storage node in the distributed storage system corresponds to a part of the global virtual address space, and the purpose of the access request The address is a global virtual address of the first virtual space;
  • the processing module 420 is configured to: according to the destination address and a local virtual address in the storage node Corresponding relationship, determining the local virtual address corresponding to the destination address of the access request, and accessing the target file according to the local virtual address.
  • the storage node of the embodiment of the present invention can access the distributed storage system by directly accessing the file in the distributed storage system according to the local virtual address corresponding to the destination address by receiving the access request with the destination address being the global virtual address. Files, which can improve the efficiency of file access.
  • the number of bits of the destination address is 2N, where N is the number of bits of the local virtual address, and the high N bits of the destination address include device information of the storage node, and the destination address is low.
  • the N bit is the local virtual address, and the access request is forwarded by the network device to the storage node according to the device information of the storage node.
  • the processing module 420 is specifically configured to determine that a local physical space address corresponding to the local virtual address exists, and write the data in the write request to The local physical space address corresponds to the local physical space; or,
  • the processing module 420 when the access request is a read request, is specifically configured to determine a local physical space address corresponding to the local virtual address, and read the local corresponding to the local physical space address. Data in physical space.
  • the receiving module 410 is further configured to receive a space allocation request sent by the management node, where the space allocation request is used to allocate a local virtual address space for the target file, where the space allocation request carries the The global virtual address of the first virtual space;
  • the processing module 420 is further configured to allocate the local virtual address space to the target file according to the space allocation request, and establish a correspondence between the destination address and a local virtual address of the local virtual address space.
  • the receiving module 410 is further configured to receive a space collection message sent by the management node, where the space recovery message is used to recover the local virtual address space, where the space recovery message carries the first virtual The global virtual address of the space;
  • the processing module 420 is further configured to delete the correspondence between the destination address and the local virtual address according to the space collection message, recover the local virtual address space, and recover the local physical space corresponding to the local virtual address space.
  • the storage node 400 may correspond to a first storage node in the method 200 of accessing a file according to an embodiment of the present invention, and the above and other operations and/or functions of the respective modules in the storage node 400 are respectively The corresponding processes of the various methods are not described here for brevity.
  • FIG. 5 illustrates a structure of a storage node provided by still another embodiment of the present invention, including at least one processor 502 (eg, a CPU), at least one network interface 505 or other communication interface, memory 506, and at least one communication bus 503. among them:
  • Communication bus 503 is used to implement connection communication between these devices.
  • the processor 502 is configured to execute executable modules, such as computer programs, stored in the memory 506.
  • the memory 506 may include a high speed random access memory (RAM: Random Access Memory) and may also include an NVM, such as at least one disk storage.
  • RAM Random Access Memory
  • NVM such as at least one disk storage.
  • the storage node implements a communication connection with the network through at least one network interface 505, which may be wired or wireless.
  • the memory 506 stores a program 5061 that is used to execute the program 5061 to implement the various methods in the foregoing method embodiments.
  • the term "and/or” is merely an association relationship describing an associated object, indicating that there may be three relationships.
  • a and/or B may indicate that A exists separately, and A and B exist simultaneously, and B cases exist alone.
  • the character "/" in this article generally indicates that the contextual object is an "or" relationship.
  • the disclosed systems, devices, and methods may be implemented in other manners.
  • the device embodiments described above are merely illustrative
  • the division of the unit is only a logical function division, and the actual implementation may have another division manner, for example, multiple units or components may be combined or may be integrated into another system, or some features may be Ignore, or not execute.
  • the mutual coupling or direct coupling or communication connection shown or discussed may be an indirect coupling or communication connection through some interface, device or unit, or an electrical, mechanical or other form of connection.
  • the units described as separate components may or may not be physically separated, and the components displayed as units may or may not be physical units, that is, may be located in one place, or may be distributed to multiple network units. Some or all of the units may be selected according to actual needs to achieve the objectives of the embodiments of the present invention.
  • each functional unit in each embodiment of the present invention may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit.
  • the above integrated unit can be implemented in the form of hardware or in the form of a software functional unit.
  • the integrated unit if implemented in the form of a software functional unit and sold or used as a standalone product, may be stored in a computer readable storage medium.
  • the technical solution of the present invention contributes in essence or to the prior art, or all or part of the technical solution may be embodied in the form of a software product stored in a storage medium.
  • a number of instructions are included to cause a computer device (which may be a personal computer, server, or network device, etc.) to perform all or part of the steps of the methods described in various embodiments of the present invention.
  • the foregoing storage medium includes: a U disk, a mobile hard disk, a read-only memory (ROM), a random access memory (RAM), a magnetic disk, or an optical disk, and the like. .
  • ROM read-only memory
  • RAM random access memory
  • magnetic disk or an optical disk, and the like.

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Information Retrieval, Db Structures And Fs Structures Therefor (AREA)

Abstract

L'invention concerne un procédé pour accéder à des fichiers, un système de stockage distribué et un nœud de stockage. Le procédé comprend les opérations suivantes : un premier nœud de stockage reçoit une demande d'accès à un hôte transférée par un dispositif de réseau, ladite demande d'accès étant utilisée pour accéder à un premier espace virtuel d'un fichier cible, ledit premier espace virtuel étant un espace dans l'espace d'adresse virtuelle globale attribué pour le fichier cible par un nœud de gestion, et l'adresse cible de la demande d'accès étant l'adresse virtuelle globale dudit premier espace virtuel (S210), le premier nœud de stockage étant un nœud de stockage utilisé pour stocker ledit fichier cible ; le premier nœud de stockage, sur la base de la correspondance entre l'adresse cible et l'adresse virtuelle locale du premier nœud de stockage, détermine l'adresse virtuelle locale correspondant à l'adresse cible de la demande d'accès (S220) ; et le premier nœud de stockage, sur la base de l'adresse virtuelle locale, accède au fichier cible (S230). L'efficacité d'accès à un fichier peut ainsi être améliorée.
PCT/CN2014/090017 2014-10-31 2014-10-31 Procédé pour accéder à des fichiers, système de stockage distribué et nœud de stockage WO2016065610A1 (fr)

Priority Applications (2)

Application Number Priority Date Filing Date Title
CN201480037251.5A CN105765542B (zh) 2014-10-31 2014-10-31 访问文件的方法、分布式存储系统和存储节点
PCT/CN2014/090017 WO2016065610A1 (fr) 2014-10-31 2014-10-31 Procédé pour accéder à des fichiers, système de stockage distribué et nœud de stockage

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/CN2014/090017 WO2016065610A1 (fr) 2014-10-31 2014-10-31 Procédé pour accéder à des fichiers, système de stockage distribué et nœud de stockage

Publications (1)

Publication Number Publication Date
WO2016065610A1 true WO2016065610A1 (fr) 2016-05-06

Family

ID=55856428

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2014/090017 WO2016065610A1 (fr) 2014-10-31 2014-10-31 Procédé pour accéder à des fichiers, système de stockage distribué et nœud de stockage

Country Status (2)

Country Link
CN (1) CN105765542B (fr)
WO (1) WO2016065610A1 (fr)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106776361A (zh) * 2017-03-10 2017-05-31 安徽大学 一种面向大规模非易失性存储介质的缓存方法和系统
CN110825309A (zh) * 2018-08-08 2020-02-21 华为技术有限公司 数据读取方法、装置及系统、分布式系统

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109063061B (zh) * 2018-07-20 2022-09-30 北京百度网讯科技有限公司 跨分布式系统数据处理方法、装置、设备及存储介质

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101187930A (zh) * 2007-12-04 2008-05-28 浙江大学 分布式文件系统虚拟目录及命名空间的实现方法
CN101398768A (zh) * 2008-10-28 2009-04-01 北京航空航天大学 一种分布式虚拟机监视器系统的构建方法
CN102023932A (zh) * 2009-09-18 2011-04-20 英特尔公司 为本地与远程物理存储器之间的共享虚拟存储器提供硬件支持
CN102405460A (zh) * 2009-02-11 2012-04-04 艾梵尼达有限公司 虚拟存储系统及其运行方法
CN103475732A (zh) * 2013-09-25 2013-12-25 浪潮电子信息产业股份有限公司 一种基于虚拟地址池的分布式文件系统数据卷部署方法

Family Cites Families (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8301717B2 (en) * 2009-06-09 2012-10-30 Deshpande Enterprises, Inc. Extended virtual memory system and method in a computer cluster
US9170950B2 (en) * 2013-01-16 2015-10-27 International Business Machines Corporation Method, apparatus and computer programs providing cluster-wide page management

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101187930A (zh) * 2007-12-04 2008-05-28 浙江大学 分布式文件系统虚拟目录及命名空间的实现方法
CN101398768A (zh) * 2008-10-28 2009-04-01 北京航空航天大学 一种分布式虚拟机监视器系统的构建方法
CN102405460A (zh) * 2009-02-11 2012-04-04 艾梵尼达有限公司 虚拟存储系统及其运行方法
CN102023932A (zh) * 2009-09-18 2011-04-20 英特尔公司 为本地与远程物理存储器之间的共享虚拟存储器提供硬件支持
CN103475732A (zh) * 2013-09-25 2013-12-25 浪潮电子信息产业股份有限公司 一种基于虚拟地址池的分布式文件系统数据卷部署方法

Cited By (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106776361A (zh) * 2017-03-10 2017-05-31 安徽大学 一种面向大规模非易失性存储介质的缓存方法和系统
CN106776361B (zh) * 2017-03-10 2020-07-10 安徽大学 一种面向大规模非易失性存储介质的缓存方法和系统
CN110825309A (zh) * 2018-08-08 2020-02-21 华为技术有限公司 数据读取方法、装置及系统、分布式系统
CN110825309B (zh) * 2018-08-08 2021-06-29 华为技术有限公司 数据读取方法、装置及系统、分布式系统
US11455117B2 (en) 2018-08-08 2022-09-27 Huawei Technologies Co., Ltd. Data reading method, apparatus, and system, avoiding version rollback issues in distributed system

Also Published As

Publication number Publication date
CN105765542A (zh) 2016-07-13
CN105765542B (zh) 2019-11-15

Similar Documents

Publication Publication Date Title
US11656763B2 (en) File management method, distributed storage system, and management node
US9436720B2 (en) Safety for volume operations
US10372336B2 (en) File access method, system, and host
JP2019139759A (ja) ソリッドステートドライブ（ｓｓｄ）及び分散データストレージシステム並びにその方法
CN110235098B (zh) 存储系统访问方法及装置
CN110199512B (zh) 存储系统中存储设备的管理方法及装置
WO2017201984A1 (fr) Procédé de traitement de données, appareil associé et système de stockage de données
US11947419B2 (en) Storage device with data deduplication, operation method of storage device, and operation method of storage server
CN109302448A (zh) 一种数据处理方法及装置
US20190114076A1 (en) Method and Apparatus for Storing Data in Distributed Block Storage System, and Computer Readable Storage Medium
CN110199270B (zh) 存储系统中存储设备的管理方法及装置
WO2016065610A1 (fr) Procédé pour accéder à des fichiers, système de stockage distribué et nœud de stockage
WO2017177400A1 (fr) Procédé et système de traitement de données
US7146484B2 (en) Method and apparatus for caching storage system
CN108804355B (zh) 使用目标协作的快速排序写入的方法和系统
WO2016065613A1 (fr) Procédé d'accès à un fichier, système de mise en mémoire répartie et dispositif de réseau
WO2016065612A1 (fr) Procédé, système et hôte pour accéder à des fichiers

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 14904918

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 14904918

Country of ref document: EP

Kind code of ref document: A1