WO2010097848A1 - ストレージシステム - Google Patents
ストレージシステム Download PDFInfo
- Publication number
- WO2010097848A1 WO2010097848A1 PCT/JP2009/003965 JP2009003965W WO2010097848A1 WO 2010097848 A1 WO2010097848 A1 WO 2010097848A1 JP 2009003965 W JP2009003965 W JP 2009003965W WO 2010097848 A1 WO2010097848 A1 WO 2010097848A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- data
- storage
- address
- storing
- operation log
- Prior art date
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/10—File systems; File servers
Definitions
- the present invention relates to a storage system, and more particularly to a content address type storage system that specifies a storage location where the data is stored by a unique address specified according to the content of the stored data.
- a content address storage system has been developed in recent years as shown in Patent Document 1.
- data is distributed and stored in a plurality of storage devices, and the storage location where the data is stored is specified by a unique content address specified according to the content of the data.
- predetermined data is divided into a plurality of fragments, and a fragment that becomes redundant data is further added, and the plurality of fragments are respectively stored in a plurality of storage devices.
- a hash value of data is used for the content address, which is generated so as to be unique according to the content of the data. For this reason, if it is duplicate data, the data of the same content can be acquired by referring to the data at the same storage position. Therefore, it is not necessary to store the duplicate data separately, and duplicate recording can be eliminated and the data capacity can be reduced.
- a tree type file system is used. This means that a content address that refers to stored data is referred to by a content address located in a higher hierarchy, and the content address is formed in a tree structure and stored. Accordingly, the target storage data can be accessed by tracing the reference destination of the content address from the upper hierarchy to the lower hierarchy.
- FIG. 1 shows data stored in the data storage means of the content address storage system. Boxes indicated by “ca00” and “ca01” indicate data blocks, and “ca00” and “ca01” indicate content addresses indicating storage positions specified according to the data content of the boxes.
- the file is “open” to create “/ dir2 / file3”, and an entry of “file3” is created in “dir2”.
- this address “ca21-1” is stored as an address referred to by “dir2” (1-2), and an address referring to the data block of “dir2, ca21-1” is obtained as “ca20-1”.
- it is registered in the address correspondence table in association with “# 2” which is the indirect reference address of “dir2” (1-3).
- the tree structure of the address data is determined.
- an object of the present invention is to provide a high-performance storage system by reducing the storage capacity and the storage processing time, which are the problems described above.
- a storage system provides: Data storage means for storing the storage target data and storing the address data that is address data based on the data content and storage position of the reference destination and that refers to the storage target data or other address data in a tree structure; An operation log for generating an operation log representing the operation content for storing the storage target data in the data storage unit and the operation content for storing the address data having a tree structure referring to the storage target data in the data storage unit Generating means; Based on the operation log, a file system determination unit that stores the storage target data and the tree-structured address data in the data storage unit; Is provided.
- the program which is the other form of this invention is: Data storage means for storing storage target data and storing the address data which is address data based on the data content and storage position of the reference destination and which refers to the storage target data or other address data in a tree structure
- An operation log for generating an operation log indicating the operation content for storing the storage target data in the data storage unit and the operation content for storing the address data having a tree structure referring to the storage target data in the data storage unit Generating means; Based on the operation log, a file system determination unit that stores the storage target data and the tree-structured address data in the data storage unit; It is a program for realizing.
- a data storage method includes: Data storage means for storing storage target data and storing the address data which is address data based on the data content and storage position of the reference destination and which refers to the storage target data or other address data in a tree structure
- Data storage means for storing storage target data and storing the address data which is address data based on the data content and storage position of the reference destination and which refers to the storage target data or other address data in a tree structure
- the present invention which is configured as described above, can reduce storage capacity and storage processing time, and can provide a high-performance storage system.
- FIG. 1 is a block diagram showing an outline of a configuration of a storage system in the present invention.
- 1 is a functional block diagram showing a configuration of a storage system in Embodiment 1 of the present invention.
- 4 is a flowchart showing the operation of the storage system disclosed in FIG. 3.
- It is a figure which shows the mode of the data storage in the storage system disclosed in FIG.
- It is a figure which shows the mode of the data storage in the storage system disclosed in FIG.
- FIG. is a figure which shows the mode of the data storage in the storage system disclosed in FIG.
- FIG. is a figure which shows the mode of the data storage in the storage system disclosed in FIG.
- It is a functional block diagram which shows the structure of the storage system in Embodiment 2 of this invention.
- FIG. 2 is a block diagram showing an outline of the storage system
- FIG. 3 is a functional block diagram showing its configuration.
- FIG. 4 is a flowchart showing the operation of the storage system.
- 5 to 8 are diagrams showing how data is stored in the storage system.
- the present embodiment shows a specific example of the storage system described in the second embodiment to be described later.
- the storage system is configured by connecting a plurality of server computers.
- the storage system according to the present invention is not limited to being configured by a plurality of computers, and may be configured by a single computer.
- the storage system 10 is connected to, for example, a backup system that controls backup processing via a network (not shown). Then, the backup system acquires the backup target data (storage target data) stored in the backup target device connected via the network, and requests the storage system 10 to store it. Thereby, the storage system 10 stores the backup target data requested to be stored for backup.
- the user application 30 is illustrated as a backup system that requests the storage system 10 to store data.
- the storage system 10 in this embodiment has a configuration in which a plurality of server computers are connected.
- the storage system 10 includes an accelerator node 10A that is a server computer that controls storage and reproduction operations in the storage system 10 itself, and a storage node 10B that is a server computer including a storage device that stores data. Yes.
- the number of accelerator nodes 10A and the number of storage nodes 10B are not limited to those shown in FIG. 2, and more nodes 10A and 10B may be connected.
- the storage system 10 divides and redundantly stores the data, distributes and stores the data in a plurality of storage devices, and stores the data by a unique content address specified according to the content of the data.
- This is a content address storage system for specifying the storage location.
- the storage system 10 is one system, the configuration and functions of the storage system 10 will be described. That is, the configuration and function of the storage system 10 described below may be provided in either the accelerator node 10A or the storage node 10B. As shown in FIG. 2, the storage system 10 is not necessarily limited to including the accelerator node 10A and the storage node 10B, and may have any configuration.
- FIG. 3 shows the configuration of the storage system 10.
- the storage system 10 includes a file system access unit 11, a tree structure reproduction unit 12, a data reproduction unit 13, an operation log 14, a file system determination unit 15, a data storage unit 20, It has.
- the above configuration is realized by incorporating a program in an arithmetic device provided in the storage system 10 or by being formed as a data storage area in the storage device.
- the program is provided to the storage system 10 in a state of being stored in a storage medium such as a CD-ROM.
- the program may be stored in a storage device of another server computer on the network and provided to the storage system 10 from the other server computer via the network.
- the data storage unit 20 (data storage means) is a storage area for storing data and has a function of performing data storage processing. Specifically, as will be described later, when the storage target data to be stored is given from the file system determination unit 15 or the like, the data storage unit 20 stores the storage target data. At the same time, a hash value is calculated based on the data content of the stored storage target data, and a content address that is address data referring to the storage target data is returned. Further, the data storage unit 20 stores content addresses having a tree structure that refers to the storage target data and other content addresses. At this time, the content address that refers to another content address is a value that specifies the storage location of the other content address based on the data content of the other content address that is the reference destination.
- the content address is address data based on the data content to be referred to and the storage position
- the content address in the upper hierarchy refers to the content address in the lower hierarchy, and is finally stored. It is structured in a tree structure to refer to data. An example of the data storage state in the data storage unit 20 will be described later.
- the file system access unit 11 provides means for accessing the user application 30 that makes a data storage request or the like.
- the file system access unit 11 in this embodiment conforms to a system call used in UNIX (registered trademark) which is a kind of operating system, such as “open”, “read”, “write”, “close”. It is assumed that it corresponds to.
- the access means provided by the file system access unit 11 is not limited to the system call described above, and may be an arbitrary interface.
- the user application 30 may use a network file system interface such as NFS (Network File System) or CIFS (Common Internet File System), or may be a local file system in the same machine.
- NFS Network File System
- CIFS Common Internet File System
- requests from the user application 30 there are two types of requests from the user application 30: operations related to a tree structure such as “open”, “close”, “mkdir”, and “unlink”, and operations related to data such as “read” and “write”.
- the file system access unit 10 distributes operations related to the tree structure to the tree structure reproduction unit 12 and operations related to data to the data reproduction unit 13.
- the tree structure reproduction unit 12 receives a tree structure operation request from the file system access unit 11, reads data necessary for the operation of the tree structure from the data storage unit 20, and temporarily generates and holds the tree structure. To do. Since the generated tree structure needs to be finally stored in the data storage unit 20 as a file system, the operation content that generated the tree structure is stored in the operation log 14 as a “commit log”.
- the data reproduction unit 13 receives a data transfer request from the file system access unit 11 and processes “read” and “write”. For example, at the time of a data write request, the data reproduction unit 13 first temporarily stores data to be stored according to the write request, and then stores the held data in the data storage unit 20. When the content address is returned from the data storage unit 20, the file system access unit 11 is responded to the effect that the writing has been completed. In particular, when data is written, it can be performed asynchronously if a failure is dealt with. Therefore, when the data is temporarily stored, the user application 30 is notified of the completion of writing via the file system access unit 11. The next write request can be processed sequentially.
- the operation log 14 (cache memory) records tree operations and data writing sequentially. To determine the tree structure, it is necessary to complete data writing so far, and therefore information on both the tree structure and the data writing is required.
- the operation log 14 may be realized as a shared memory that can be accessed from both the tree structure reproduction unit 12 and the data reproduction unit 13 on the memory, or may be realized as a shared file. Further, it may be realized as a transaction for a database in order to ensure fault tolerance.
- the operation log 14 is a storage area different from a storage device such as a hard disk in which the data storage unit 20 is formed.
- the operation log 14 is formed in a flash memory having a higher data recording / reproducing speed. .
- the tree structure reproduction unit 12, the data reproduction unit 13, and the operation log 14 generate an operation log that represents the operation contents of the storage target data and the address data when the data storage unit 20 stores the temporary data. It functions as an operation log generation means for storing automatically.
- the data reproduction unit 13 temporarily stores data to be stored in the data storage unit 20, and the tree structure reproduction unit 12 generates a tree structure of address data that refers to the data to be stored. Functions to store temporarily.
- the file system determination unit 15 (file system determination unit) sequentially reads the “commit log” and the “flush log” stored in the operation log 14, and temporarily performs the tree structure reproduction unit 12 and the data reproduction unit 13.
- the updated tree structure and storage target data are stored in the data storage unit 20.
- all the data is shown to enter the data storage unit 20 via the file system determination unit 15, but the file system determination unit 15 includes the tree structure reproduction unit 12 and the data reproduction unit 13.
- Data storage unit 20 may be prompted to store data, and actual data transfer may not be performed via file system determination unit 15.
- the tree structure reproduction unit 12 can issue a file system determination request to the file system determination unit 15.
- the file system determination unit 15 determines the tree operation and data transfer in the correct order in the data storage unit 20, thereby enabling determination of the file system excluding the intermediate state.
- the file system can be determined at a predetermined time interval (for example, every two minutes) regardless of the trigger such as “close” described above. In this case, the elimination of the intermediate state is not complete, but it is possible to suppress recording of changes in the tree structure that occurred between the intervals.
- FIG. 5 shows data stored in the data storage unit 20, data cached by the tree structure reproduction unit 12, and data cached by the data reproduction unit 13 from file creation to writing of storage target data. It is illustrated.
- the tree structure reproduction unit 12 makes it possible to refer to “/ dir2” in the cache area “& 20” for accessing the tree structure, and reflects it in the address correspondence table on the tree structure reproduction unit 12. Then, the areas “& 21” and “& 50” for storing information related to “file3” are allocated (1-1), and the address “& 21” is assigned to the cache area “& 20” so that they can be accessed as “# 5”. Store and update information about file (1-2).
- the operation log 14 is recorded to confirm the tree structure by “commit” later. Specifically, the operation log 14 is recorded as “commit & 21” (confirm & 20) and “commit & 22 at close & 50” (confirm & 20 when & 50 is close).
- the data reproduction unit 13 stores the storage target data “data31” in the temporary area “& 51” (2-1). Then, the data reproduction unit 13 notifies the stored address “& 51” to the tree structure reproduction unit 12, and “& 51” is stored in the first area of “& 50” (2-2). Similarly, the data reproduction unit 13 stores the storage target data “data32” in the temporary area “& 52” (3-1), notifies the tree structure reproduction unit 12 of the stored address “& 52”, and “& 50”. "& 52" is stored in the area (3-2). As a result, since unconfirmed data remains in “& 51” and “& 52”, the operation log 14 for confirming the storage target data is recorded later by “flush”.
- the operation log 14 is recorded as “flush & 51 at close & 50” (write & 51 when & 50 is close) and “flush & 52 at close & 50” (write & 52 when & 50 is close). .
- “& 51”, “& 52”, and “& 50” are recorded in the operation log 14. This is used to search for items to be “commit” in advance when “commit” processing is performed before “flush” is completed.
- the recording target data is stored in the data reproduction unit 13, and the tree structure of the address data that refers to the storage target data is generated and stored in the tree structure reproduction unit 12 (step S1 in FIG. 4). Operation log is stored (step S2 in FIG. 4).
- the data may start to be stored as a data block when it exceeds the size that can be stored in the data storage unit 20.
- FIG. 6 illustrates the operation of determining data.
- the data reproduction unit 13 performs “flush ⁇ & 51 ”and“ flush ⁇ & 52” recorded in the operation log 14.
- the data “data31” held in the data reproduction unit 13 is stored in the data storage unit 13 (step S3 in FIG. 4), and the content address “ca51” of the stored storage target data is obtained (4 -1).
- the content address is obtained, it is reflected in the tree structure of the tree structure reproduction unit 12 (step S4 in FIG. 4) (4-2). That is, the address “ca51” is stored in “& 50” in the tree structure reproduction unit 12.
- the data reproduction unit 13 stores the retained data “data32” in the data storage unit 13 as needed, and obtains the content address “ca52” of the stored storage target data (5-1). When the content address is obtained, it is reflected in the tree structure of the tree structure reproduction unit 12 (5-2). Specifically, the address “ca52” is stored in “& 50” in the tree structure reproduction unit 12.
- FIG. 7 shows the operation when the file writing is completed and the tree structure is finalized.
- “File3” is “closed”
- the data “& 50” is determined as described above, and the content addresses “ca51” and “ca52” are stored in the data storage unit 20 (6-1).
- the data to be stored is stored, and the tree structure of the content address that refers to the data is stored (step S5 in FIG. 4). Therefore, an unnecessary intermediate state in the change of the tree structure when the tree structure file system is stored is not stored in the data storage unit 20. As a result, the storage capacity can be reduced and the storage processing time can be shortened, and a high-performance storage system can be provided.
- a plurality of storage target data (data31, data32) configuring the same file “File3” is stored in the data storage unit 20, and then the content address specified by this is used.
- the tree structure is determined in order from the lower hierarchy to the upper hierarchy. Therefore, the change of the tree structure of the address data on the data storage unit 20 can be suppressed, and the number of times the address data is stored can be suppressed. As a result, it is possible to more effectively suppress storing data representing the intermediate state of the content address accompanying the change in the tree structure.
- the tree structure of the address data can be stored more efficiently.
- a tree structure of address data referring to the storage target data may be stored.
- FIG. 9 is a functional block diagram showing the configuration of the storage system in this embodiment. In this embodiment, an outline of the above-described storage system will be described.
- the storage system 1 in this embodiment is Data storage means 2 for storing the storage target data and storing the address data which is address data based on the data content and storage location of the reference destination and which refers to the storage target data or other address data in a tree structure;
- An operation log for generating an operation log indicating the operation content for storing the storage target data in the data storage unit and the operation content for storing the address data having a tree structure referring to the storage target data in the data storage unit Generating means 3;
- a file system determination unit 4 for storing the storage target data and the tree-structured address data in the data storage unit; Is provided.
- the operation log generation unit stores the storage target data and the tree-structured address data in a cache memory which is a storage area different from the data storage unit, and generates the operation log based on the storage operation.
- the structure is taken.
- the file system determination unit uses the address data specified by storing the storage target data in the data storage unit based on the operation log and storing the storage target data in the data storage unit.
- the address data of the tree structure is stored in the data storage unit based on the operation log. The structure is taken.
- the file system determination means stores the address data in the data storage means in order from a lower hierarchy to an upper hierarchy in the tree structure address data based on the operation log. The structure is taken.
- the storage system when the storage system stores the storage target data and the tree-structured address data referring to the storage target data in the data storage means, the storage system represents the operation contents for storing each data. Generate an operation log. Specifically, storage target data and tree-structured address data that refers to the data are stored in a cache memory, and an operation log is generated based on the storage processing and stored in the cache memory. At this time, the storage object data and the tree-structured address data are not yet stored in the data storage means. Thereafter, the storage target data and the tree-structured address data are stored in the data storage unit based on the operation log. In particular, storage target data is first stored in the data storage means, and then the address data specified thereby is stored in the data storage means in order from the lower hierarchy to the upper hierarchy of the tree structure.
- the file system determination unit stores the address data in the data storage unit after storing a plurality of the storage target data in the data storage unit based on the operation log. The structure is taken.
- the file system determination unit stores the plurality of storage target data constituting the same file in the data storage unit. The structure is taken.
- the file system determination means stores all of the plurality of storage target data constituting the same file and the tree-structured address data referring to the plurality of storage target data in the cache memory, and Storing a plurality of storage target data and the address data of the tree structure in the data storage means; The structure is taken.
- the program which is another embodiment of the present invention is: Data storage means for storing storage target data and storing the address data which is address data based on the data content and storage position of the reference destination and which refers to the storage target data or other address data in a tree structure
- An operation log for generating an operation log indicating the operation content for storing the storage target data in the data storage unit and the operation content for storing the address data having a tree structure referring to the storage target data in the data storage unit Generating means; Based on the operation log, a file system determination unit that stores the storage target data and the tree-structured address data in the data storage unit; It is a program for realizing.
- the operation log generation unit stores the storage target data and the tree-structured address data in a cache memory which is a storage area different from the data storage unit, and generates the operation log based on the storage operation.
- the structure is taken.
- a data storage method which is executed when the above-described storage system operates, Data storage means for storing storage target data and storing the address data which is address data based on the data content and storage position of the reference destination and which refers to the storage target data or other address data in a tree structure
- Data storage means for storing storage target data and storing the address data which is address data based on the data content and storage position of the reference destination and which refers to the storage target data or other address data in a tree structure
- the operation log When the operation log is generated, the storage target data and the tree-structured address data are stored in a cache memory which is a storage area different from the data storage unit, and the operation log is generated based on the storage operation. Storing the operation log in the cache memory; The structure is taken.
- the present invention can be used for a content address type storage system that specifies a storage location where the data is stored by a unique address specified according to the content of the stored data, and has industrial applicability. Have.
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Data Mining & Analysis (AREA)
- Databases & Information Systems (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
Description
記憶対象データを格納すると共に、参照先のデータ内容及び格納位置に基づくアドレスデータであり上記記憶対象データ又は他のアドレスデータを参照する上記アドレスデータをツリー構造にて格納するデータ格納手段と、
上記記憶対象データを上記データ格納手段に格納する操作内容、及び、上記記憶対象データを参照するツリー構造の上記アドレスデータを上記データ格納手段に格納する操作内容、を表す操作ログを生成する操作ログ生成手段と、
上記操作ログに基づいて、上記データ格納手段に上記記憶対象データ及び上記ツリー構造のアドレスデータを格納するファイルシステム確定手段と、
を備える。
記憶対象データを格納すると共に、参照先のデータ内容及び格納位置に基づくアドレスデータであり上記記憶対象データ又は他のアドレスデータを参照する上記アドレスデータをツリー構造にて格納するデータ格納手段を備えた情報処理装置に、
上記記憶対象データを上記データ格納手段に格納する操作内容、及び、上記記憶対象データを参照するツリー構造の上記アドレスデータを上記データ格納手段に格納する操作内容、を表す操作ログを生成する操作ログ生成手段と、
上記操作ログに基づいて、上記データ格納手段に上記記憶対象データ及び上記ツリー構造のアドレスデータを格納するファイルシステム確定手段と、
を実現させるためのプログラムである。
記憶対象データを格納すると共に、参照先のデータ内容及び格納位置に基づくアドレスデータであり上記記憶対象データ又は他のアドレスデータを参照する上記アドレスデータをツリー構造にて格納するデータ格納手段を備えた情報処理装置にて、
上記記憶対象データを上記データ格納手段に格納する操作内容、及び、上記記憶対象データを参照するツリー構造の上記アドレスデータを上記データ格納手段に格納する操作内容、を表す操作ログを生成し、
上記操作ログに基づいて、上記データ格納手段に上記記憶対象データ及び上記ツリー構造のアドレスデータを格納する、
という構成を採る。
本発明の第1の実施形態を、図2乃至図8を参照して説明する。図2は、ストレージシステムの概略を示すブロック図であり、図3は、その構成を示す機能ブロック図である。図4は、ストレージシステムの動作を示すフローチャートである。図5乃至図8は、ストレージシステムにおけるデータ格納の様子を示す図である。
本発明におけるストレージシステム10は、例えば、図示しないネットワークを介してバックアップ処理を制御するバックアップシステムに接続している。そして、バックアップシステムは、ネットワークを介して接続されたバックアップ対象装置に格納されているバックアップ対象データ(記憶対象データ)を取得し、ストレージシステム10に対して記憶するよう要求する。これにより、ストレージシステム10は、記憶要求されたバックアップ対象データをバックアップ用に記憶する。なお、図3では、ストレージシステム10に対してデータを記憶要求するバックアップシステムとして、ユーザアプリケーション30を例示する。
次に、上述したストレージシステム10の動作を、図4乃至図8を参照して説明する。まず、図5は、ファイル作成から記憶対象データの書き込みまでについて、データ格納部20の格納データ、ツリー構造再現部12がキャッシュしているデータ、および、データ再現部13がキャッシュしているデータを図示したものである。
次に、本発明の第2の実施形態を、図9を参照して説明する。図9は、本実施形態におけるストレージシステムの構成を示す機能ブロック図である。なお、本実施形態では、上述したストレージシステムの概略を説明する。
記憶対象データを格納すると共に、参照先のデータ内容及び格納位置に基づくアドレスデータであり上記記憶対象データ又は他のアドレスデータを参照する上記アドレスデータをツリー構造にて格納するデータ格納手段2と、
上記記憶対象データを上記データ格納手段に格納する操作内容、及び、上記記憶対象データを参照するツリー構造の上記アドレスデータを上記データ格納手段に格納する操作内容、を表す操作ログを生成する操作ログ生成手段3と、
上記操作ログに基づいて、上記データ格納手段に上記記憶対象データ及び上記ツリー構造のアドレスデータを格納するファイルシステム確定手段4と、
を備える。
上記操作ログ生成手段は、上記記憶対象データ及び上記ツリー構造のアドレスデータを、上記データ格納手段とは異なる記憶領域であるキャッシュメモリに格納すると共に、この格納操作に基づいて上記操作ログを生成して当該操作ログを上記キャッシュメモリに記憶する、
という構成を採る。
上記ファイルシステム確定手段は、上記操作ログに基づいて上記記憶対象データを上記データ格納手段に格納すると共に、上記記憶対象データを上記データ格納手段に格納することによって特定された上記アドレスデータを用いた上記ツリー構造のアドレスデータを、上記操作ログに基づいて上記データ格納手段に格納する、
という構成を採る。
上記ファイルシステム確定手段は、上記操作ログに基づいて、上記アドレスデータを、上記ツリー構造のアドレスデータのうち下位階層から上位階層に向かって順に上記データ格納手段に格納する、
という構成を採る。
上記ファイルシステム確定手段は、上記操作ログに基づいて、複数の上記記憶対象データを上記データ格納手段に格納した後に上記アドレスデータを上記データ格納手段に格納する、
という構成を採る。
上記ファイルシステム確定手段は、同一のファイルを構成する上記複数の記憶対象データを上記データ格納手段に格納する、
という構成を採る。
上記ファイルシステム確定手段は、同一のファイルを構成する上記複数の記憶対象データの全て、及び、当該複数の記憶対象データを参照する上記ツリー構造のアドレスデータを、上記キャッシュメモリに格納した後に、上記複数の記憶対象データ及び上記ツリー構造のアドレスデータを、上記データ格納手段に格納する、
という構成を採る。
記憶対象データを格納すると共に、参照先のデータ内容及び格納位置に基づくアドレスデータであり上記記憶対象データ又は他のアドレスデータを参照する上記アドレスデータをツリー構造にて格納するデータ格納手段を備えた情報処理装置に、
上記記憶対象データを上記データ格納手段に格納する操作内容、及び、上記記憶対象データを参照するツリー構造の上記アドレスデータを上記データ格納手段に格納する操作内容、を表す操作ログを生成する操作ログ生成手段と、
上記操作ログに基づいて、上記データ格納手段に上記記憶対象データ及び上記ツリー構造のアドレスデータを格納するファイルシステム確定手段と、
を実現させるためのプログラムである。
上記操作ログ生成手段は、上記記憶対象データ及び上記ツリー構造のアドレスデータを、上記データ格納手段とは異なる記憶領域であるキャッシュメモリに格納すると共に、この格納操作に基づいて上記操作ログを生成して当該操作ログを上記キャッシュメモリに記憶する、
という構成を採る。
記憶対象データを格納すると共に、参照先のデータ内容及び格納位置に基づくアドレスデータであり上記記憶対象データ又は他のアドレスデータを参照する上記アドレスデータをツリー構造にて格納するデータ格納手段を備えた情報処理装置にて、
上記記憶対象データを上記データ格納手段に格納する操作内容、及び、上記記憶対象データを参照するツリー構造の上記アドレスデータを上記データ格納手段に格納する操作内容、を表す操作ログを生成し、
上記操作ログに基づいて、上記データ格納手段に上記記憶対象データ及び上記ツリー構造のアドレスデータを格納する、
という構成を採る。
上記操作ログ生成時に、上記記憶対象データ及び上記ツリー構造のアドレスデータを、上記データ格納手段とは異なる記憶領域であるキャッシュメモリに格納すると共に、この格納操作に基づいて上記操作ログを生成して当該操作ログを上記キャッシュメモリに記憶する、
という構成を採る。
2 データ格納手段
3 操作ログ生成手段
4 ファイルシステム確定手段
10 ストレージシステム
10A アクセラレータノード
10B ストレージノード
11 ファイルシステムアクセス部
12 ツリー構造再現部
13 データ再現部
14 操作ログ
15 ファイルシステム確定部
20 データ格納部
Claims (11)
- 記憶対象データを格納すると共に、参照先のデータ内容及び格納位置に基づくアドレスデータであり前記記憶対象データ又は他のアドレスデータを参照する前記アドレスデータをツリー構造にて格納するデータ格納手段と、
前記記憶対象データを前記データ格納手段に格納する操作内容、及び、前記記憶対象データを参照するツリー構造の前記アドレスデータを前記データ格納手段に格納する操作内容、を表す操作ログを生成する操作ログ生成手段と、
前記操作ログに基づいて、前記データ格納手段に前記記憶対象データ及び前記ツリー構造のアドレスデータを格納するファイルシステム確定手段と、
を備えたストレージシステム。 - 請求項1記載のストレージシステムであって、
前記操作ログ生成手段は、前記記憶対象データ及び前記ツリー構造のアドレスデータを、前記データ格納手段とは異なる記憶領域であるキャッシュメモリに格納すると共に、この格納操作に基づいて前記操作ログを生成して当該操作ログを前記キャッシュメモリに記憶する、
ストレージシステム。 - 請求項2記載のストレージシステムであって、
前記ファイルシステム確定手段は、前記操作ログに基づいて前記記憶対象データを前記データ格納手段に格納すると共に、前記記憶対象データを前記データ格納手段に格納することによって特定された前記アドレスデータを用いた前記ツリー構造のアドレスデータを、前記操作ログに基づいて前記データ格納手段に格納する、
ストレージシステム。 - 請求項3記載のストレージシステムであって、
前記ファイルシステム確定手段は、前記操作ログに基づいて、前記アドレスデータを、前記ツリー構造のアドレスデータのうち下位階層から上位階層に向かって順に前記データ格納手段に格納する、
ストレージシステム。 - 請求項3又は4記載のストレージシステムであって、
前記ファイルシステム確定手段は、前記操作ログに基づいて、複数の前記記憶対象データを前記データ格納手段に格納した後に前記アドレスデータを前記データ格納手段に格納する、
ストレージシステム。 - 請求項5記載のストレージシステムであって、
前記ファイルシステム確定手段は、同一のファイルを構成する前記複数の記憶対象データを前記データ格納手段に格納する、
ストレージシステム。 - 請求項6記載のストレージシステムであって、
前記ファイルシステム確定手段は、同一のファイルを構成する前記複数の記憶対象データの全て、及び、当該複数の記憶対象データを参照する前記ツリー構造のアドレスデータを、前記キャッシュメモリに格納した後に、前記複数の記憶対象データ及び前記ツリー構造のアドレスデータを、前記データ格納手段に格納する、
ストレージシステム。 - 記憶対象データを格納すると共に、参照先のデータ内容及び格納位置に基づくアドレスデータであり前記記憶対象データ又は他のアドレスデータを参照する前記アドレスデータをツリー構造にて格納するデータ格納手段を備えた情報処理装置に、
前記記憶対象データを前記データ格納手段に格納する操作内容、及び、前記記憶対象データを参照するツリー構造の前記アドレスデータを前記データ格納手段に格納する操作内容、を表す操作ログを生成する操作ログ生成手段と、
前記操作ログに基づいて、前記データ格納手段に前記記憶対象データ及び前記ツリー構造のアドレスデータを格納するファイルシステム確定手段と、
を実現させるためのプログラム。 - 請求項8記載のプログラムであって、
前記操作ログ生成手段は、前記記憶対象データ及び前記ツリー構造のアドレスデータを、前記データ格納手段とは異なる記憶領域であるキャッシュメモリに格納すると共に、この格納操作に基づいて前記操作ログを生成して当該操作ログを前記キャッシュメモリに記憶する、
プログラム。 - 記憶対象データを格納すると共に、参照先のデータ内容及び格納位置に基づくアドレスデータであり前記記憶対象データ又は他のアドレスデータを参照する前記アドレスデータをツリー構造にて格納するデータ格納手段を備えた情報処理装置にて、
前記記憶対象データを前記データ格納手段に格納する操作内容、及び、前記記憶対象データを参照するツリー構造の前記アドレスデータを前記データ格納手段に格納する操作内容、を表す操作ログを生成し、
前記操作ログに基づいて、前記データ格納手段に前記記憶対象データ及び前記ツリー構造のアドレスデータを格納する、
データ格納方法。 - 請求項10記載のデータ格納方法であって、
前記操作ログ生成時に、前記記憶対象データ及び前記ツリー構造のアドレスデータを、前記データ格納手段とは異なる記憶領域であるキャッシュメモリに格納すると共に、この格納操作に基づいて前記操作ログを生成して当該操作ログを前記キャッシュメモリに記憶する、
データ格納方法。
Priority Applications (3)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
EP09840702A EP2402861A4 (en) | 2009-02-27 | 2009-08-20 | STORING SYSTEM |
CN200980157264.5A CN102326151B (zh) | 2009-02-27 | 2009-08-20 | 存储系统 |
US13/202,290 US8612717B2 (en) | 2009-02-27 | 2009-08-20 | Storage system |
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
JP2009-045232 | 2009-02-27 | ||
JP2009045232A JP5556025B2 (ja) | 2009-02-27 | 2009-02-27 | ストレージシステム |
Publications (1)
Publication Number | Publication Date |
---|---|
WO2010097848A1 true WO2010097848A1 (ja) | 2010-09-02 |
Family
ID=42665076
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
PCT/JP2009/003965 WO2010097848A1 (ja) | 2009-02-27 | 2009-08-20 | ストレージシステム |
Country Status (5)
Country | Link |
---|---|
US (1) | US8612717B2 (ja) |
EP (1) | EP2402861A4 (ja) |
JP (1) | JP5556025B2 (ja) |
CN (1) | CN102326151B (ja) |
WO (1) | WO2010097848A1 (ja) |
Families Citing this family (6)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN102306168B (zh) * | 2011-08-23 | 2014-07-09 | 华为数字技术(成都)有限公司 | 日志操作方法、装置及文件系统 |
US9946976B2 (en) * | 2015-06-04 | 2018-04-17 | Corey Francis Stedman | System for enabling channel designation differentiation for hierarchically organizing and accessing address registers with address signifiers and elements |
JP6648596B2 (ja) * | 2016-03-28 | 2020-02-14 | 日本電気株式会社 | ファイルシステム制御装置、ストレージシステム、ファイルシステム制御方法、及び、プログラム |
CN106844491B (zh) * | 2016-12-26 | 2020-07-10 | 中国石油天然气集团公司 | 一种临时数据的写入、读取方法及写入、读取装置 |
KR20220049396A (ko) * | 2020-10-14 | 2022-04-21 | 삼성전자주식회사 | 간접 어드레싱을 위한 시스템, 장치 및 방법 |
US11501027B2 (en) * | 2021-02-08 | 2022-11-15 | Micron Technology, Inc. | Mechanism to support writing files into a file system mounted in a secure memory device |
Citations (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP2005235171A (ja) | 2003-12-09 | 2005-09-02 | Emc Corp | 時間的に近接して記憶システムに書き込まれたデータユニットを示すコンテンツアドレスの生成方法およびその装置 |
JP2008519362A (ja) * | 2004-11-08 | 2008-06-05 | イーエムシー コーポレイション | コンテンツアドレスマッピングを維持するためのコンテンツアドレス記憶デバイス |
JP2009045232A (ja) | 2007-08-20 | 2009-03-05 | Daiichi Shokai Co Ltd | 遊技機 |
Family Cites Families (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JPH0997178A (ja) * | 1995-09-29 | 1997-04-08 | Matsushita Electric Ind Co Ltd | 飽和演算処理装置および方法 |
JP2000056960A (ja) | 1998-08-13 | 2000-02-25 | Ricoh Co Ltd | ユーザインターフェイス装置 |
AU2003277666A1 (en) * | 2002-11-19 | 2004-06-15 | Matsushita Electric Industrial Co., Ltd. | Operation log cooperation utilizing device |
JP4248510B2 (ja) * | 2005-03-24 | 2009-04-02 | 株式会社東芝 | 計算機システム、ディスク装置およびデータ更新制御方法 |
-
2009
- 2009-02-27 JP JP2009045232A patent/JP5556025B2/ja active Active
- 2009-08-20 US US13/202,290 patent/US8612717B2/en active Active
- 2009-08-20 WO PCT/JP2009/003965 patent/WO2010097848A1/ja active Application Filing
- 2009-08-20 CN CN200980157264.5A patent/CN102326151B/zh active Active
- 2009-08-20 EP EP09840702A patent/EP2402861A4/en not_active Withdrawn
Patent Citations (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP2005235171A (ja) | 2003-12-09 | 2005-09-02 | Emc Corp | 時間的に近接して記憶システムに書き込まれたデータユニットを示すコンテンツアドレスの生成方法およびその装置 |
JP2008519362A (ja) * | 2004-11-08 | 2008-06-05 | イーエムシー コーポレイション | コンテンツアドレスマッピングを維持するためのコンテンツアドレス記憶デバイス |
JP2009045232A (ja) | 2007-08-20 | 2009-03-05 | Daiichi Shokai Co Ltd | 遊技機 |
Non-Patent Citations (3)
Title |
---|
REO KAWAI ET AL.: "ext3/ext4 Linux no Hyojun File System", UNIX MAGAZINE, vol. 23, no. 1, 1 January 2008 (2008-01-01), pages 60 - 65 * |
ROB PILE ET AL.: "Plan 9 from Bell Labs", COMPUTER TODAY, vol. 13, no. 6, 1 November 1996 (1996-11-01), pages 30 - 41 * |
See also references of EP2402861A4 * |
Also Published As
Publication number | Publication date |
---|---|
EP2402861A1 (en) | 2012-01-04 |
US20110302213A1 (en) | 2011-12-08 |
JP5556025B2 (ja) | 2014-07-23 |
JP2010198528A (ja) | 2010-09-09 |
CN102326151A (zh) | 2012-01-18 |
EP2402861A4 (en) | 2013-01-30 |
CN102326151B (zh) | 2015-06-24 |
US8612717B2 (en) | 2013-12-17 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US10936547B2 (en) | Filesystem replication using a minimal filesystem metadata changelog | |
EP2422282B1 (en) | Asynchronous distributed object uploading for replicated content addressable storage clusters | |
JP4168626B2 (ja) | 記憶装置間のファイル移行方法 | |
US7395389B2 (en) | Extending non-volatile storage at a computer system | |
US20110161297A1 (en) | Cloud synthetic backups | |
JP2010102738A (ja) | ハードウェアベースのファイルシステムのための装置および方法 | |
JP5556025B2 (ja) | ストレージシステム | |
US8977662B1 (en) | Storing data objects from a flat namespace in a hierarchical directory structured file system | |
JP4755244B2 (ja) | 情報生成方法、情報生成プログラム及び情報生成装置 | |
US10387384B1 (en) | Method and system for semantic metadata compression in a two-tier storage system using copy-on-write | |
EP2669806B1 (en) | Storage system | |
US11132141B2 (en) | System and method for synchronization of data containers | |
CN109154881B (zh) | 基于对象的存储复制和恢复 | |
JP6033420B2 (ja) | ストレージシステムおよびストレージシステムの制御方法 | |
US10268411B1 (en) | Policy and heuristic based conversion of write-optimized virtual disk format into read-optimized virtual disk format | |
JP2004252957A (ja) | 分散ファイルシステムのファイルレプリケーション方法及び装置 | |
JP6648596B2 (ja) | ファイルシステム制御装置、ストレージシステム、ファイルシステム制御方法、及び、プログラム | |
US8180793B2 (en) | Access to data stored in a file system | |
TWI769796B (zh) | 利用索引物件來進行簡易儲存服務無縫遷移的方法、主裝置以及儲存伺服器 | |
JP3754393B2 (ja) | 分散ファイル装置及びそのプロセスマイグレーション方法並びにコンピュータ装置 | |
CN118444856A (zh) | 一种提高渲染场景数据读取性能的方法 | |
CN111858516A (zh) | 数据处理方法及装置 | |
JP2001142759A (ja) | ファイルシステムアクセス方法 | |
JP2008097087A (ja) | 階層構造オブジェクトのコピー方法 |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
WWE | Wipo information: entry into national phase |
Ref document number: 200980157264.5 Country of ref document: CN |
|
121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 09840702 Country of ref document: EP Kind code of ref document: A1 |
|
REEP | Request for entry into the european phase |
Ref document number: 2009840702 Country of ref document: EP |
|
WWE | Wipo information: entry into national phase |
Ref document number: 2009840702 Country of ref document: EP |
|
WWE | Wipo information: entry into national phase |
Ref document number: 13202290 Country of ref document: US |
|
NENP | Non-entry into the national phase |
Ref country code: DE |