CN1845093A - Attribute extensible object file system - Google Patents
Attribute extensible object file system Download PDFInfo
- Publication number
- CN1845093A CN1845093A CN 200610019001 CN200610019001A CN1845093A CN 1845093 A CN1845093 A CN 1845093A CN 200610019001 CN200610019001 CN 200610019001 CN 200610019001 A CN200610019001 A CN 200610019001A CN 1845093 A CN1845093 A CN 1845093A
- Authority
- CN
- China
- Prior art keywords
- module
- data
- indexing
- attribute
- control information
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Images
Landscapes
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
The invention relates to an object document system with expandable functions. It comprises: a document building system module for setting the basic information of document system; an object character operating module for reading, setting or writing the object characters; an object data operating module for reading or writing object data; object index node manage module for distributing, setting or recycling the object index note; a data manage module for distributing and recycling the blocks of data section; a OSD initialize module; an object index note catch module; an object operational judge module and an object ID distribute module. The invention has better reliability and high efficiency, while it can distribute the object index note only by reading the group information list directly. The invention has better expandable property on the object character, to optimize the organization of OSD to improve efficiency, and make the OSD know the external condition better, to manage the resource more reasonably, to improve the hit radio and prefetch efficiency of Cache.
Description
Technical field
The invention belongs to computer memory technical field, be specifically related to the extendible object-based file system of a kind of attribute (SAOFS).
Background technology
Along with the complexity day by day of information stores application and the sharp increase of memory capacity thereof, New-generation distributed file system need support to have the high-performance computing environment of high reliability and extendability.For satisfying this demand, traditional distributed file system is divided into two logic modules by function: document component management and storage administration assembly.Document component management provides the user calling interface by logic data structure to the user, to realize layer management, name and access control; The storage administration assembly then is mapped to these logic data structures on the bottom physical storage medium, to realize the storage of physics.In the large-scale distributed storage system of a new generation, the storage administration assembly is moved down in each independent memory device, solved the bottleneck problem of meta data server in the storage system well, this memory device with ability of self-management can make storage system have high reliability and extendability.
Distributed memory system based on object storage also is to adopt above-mentioned model, and wherein the memory device of conservation object is called OSD (object-based memory device).Total system is divided into a series of objects with file, and with these object storage in a plurality of OSD.OSD is a kind of smart machine, comprises processor, internal memory, network interface, storage medium such as disk etc. and operates in wherein control assembly.OSD provides external object accesses interface, is in charge of the local object and the mapping relations of object and memory device.
Object among the OSD is made up of data and one group of attribute object ID number sign.These attributes comprise static attribute (as Time Created etc.), and dynamic attribute (as the last access time) is with the current accessed user's who uses relevant information (filename, group, user ID etc.) and object behavior, as read/write speed, service quality etc.According to different feature application, the founder can be provided with different contents and size to object properties.
Because memory capacity sharply increases, the memory device quantity of distributed memory system also will be on the increase, and the inefficient storage administration of memory device will cause the reduction of total system performance.Current existing a lot of ripe distributed systems based on object storage occur.But the OSD in these systems adopts the generic diskette file system to carry out storage administration usually, carries out storage administration as Lustre with the Ext3 file system under the Linux.Yet universal document system is used for OSD and has following problem:
In universal document system, the attribute of object adopts set form and size to deposit, and for the different objects among the OSD, the content of object properties and size may there are differences.The method that adopts set form and size to deposit attribute has limited the extensibility of attribute.
In addition, the index node in the universal document system is the address that is used for depositing object properties and object data.As in Ext3, file partition is divided into the group of equal sizes, every group includes data block, index node table and index node bitmap.The index node bitmap is used for managing the distribution and the recovery of index node, and promptly position in the index node bitmap and the index node in the group are corresponding one by one, represents that it is idle or has distributed: 0 expression index node free time, 1 expression index node distributes.In concrete batch operation, at first in group descriptor, select suitable group; Read the idle index node piece in this group then, find idle index node; Write index node at last.Though this method has been saved storage space greatly, the action need of primary distribution carries out twice visit to idle index node bitmap in group descriptor and the group.
Summary of the invention
The object of the present invention is to provide the extendible object-based file system of a kind of attribute, this system makes OSD can effectively store native object, and the optimum management mode increases system reliability, reducing the object access time, thereby improve the I/O speed and the data throughput of whole storage system.
For achieving the above object, the extendible object-based file system of a kind of attribute provided by the invention comprises establishment file system module, OSD initialization module, object indexing node acquisition module, object properties operational module, object operability judge module, object data operational module, object ID distribution module, object indexing connection point manager (CP manager) module and dina base administration module;
Create file system module and be used for being provided with file system essential information, initialization subregion key data structure, and send the OSD initialization command to the OSD initialization module with the establishment file partition;
The OSD initialization module is used for initialization OSD, and promptly establishment root object and Partition_ID are the zone object of 0h on file partition;
Object indexing node acquisition module is according to the inquiry of the object ID in the operating parameter and obtain the object indexing node, and the object indexing node that obtains is sent to object properties operational module, object indexing connection point manager (CP manager) module and dina base administration module respectively;
The object properties operational module is used to read, is provided with or writes object properties; This module reads and writes object properties in buffer zone according to the object indexing node in the object indexing node module; According in the buffer zone or the attribute updating information that sends of object data operational module object properties are set; Or, the attribute in the buffer zone is write in the free block of dina base administration module transmission, and the attribute address is sent to object indexing connection point manager (CP manager) module according to the object the created control information that object operability judge module sends;
Object operability judge module judges whether to authorize user's reading and writing, creates the right of object or deletion object according to the object properties in the buffer zone, and sends the readable control information of object data or object data can be write control information to the object data operational module; Or transmission can be created the object control information to object properties operational module, object ID distribution module, object indexing connection point manager (CP manager) module and dina base administration module; Or transmission can be deleted the object control information to object indexing connection point manager (CP manager) module and dina base administration module;
The object data operational module is used to read or write object data; The readable control information of object data that this module sends according to object operability judge module obtains data address and reading object data by the object indexing node; Or can write control information according to the object data that object operability judge module sends, and the data in the buffer zone are write in the free block that the dina base administration module sends, the upgating object index node, and attribute updating information sent to the object properties operational module;
The object the created control information that the object ID distribution module sends according to object operability judge module distributes object ID, and makes and this ID tool uniqueness in OSD ID is sent to object indexing connection point manager (CP manager) module;
Object indexing connection point manager (CP manager) module is used for distribution and setting or recycle object index node; The object the created control information that this module sends according to object operability judge module distributes the object indexing node number, receives the object ID of object ID distribution module transmission and the attribute address of object properties operational module transmission the object indexing node is set; Or according to receiving the object the deleted control information that object operability judge module sends, the object indexing node that recycle object index node acquisition module sends;
The dina base administration module is used for the distribution of data field piece and recovery; This module can be write control information according to object created or object data that object operability judge module sends, distributes the continuous free block of trying one's best in the data field, and free block is sent in object properties operational module or the object data operational module; Or the object the deleted control information that sends according to object operability judge module, the object indexing node that is sent by object indexing node acquisition module obtains object properties and data address, recycle object attribute and data occupancy piece.
File system of the present invention has following characteristics:
(1) extensibility of object properties is good.Can deposit the attribute of different-format and size at the object of different characteristic application.But based on this extended attribute, OSD can be optimized the tissue of data, and efficient is improved; Can better understand external environment condition, reasonably resource be reserved and distributed, improve the hit rate of Cache and the efficient of looking ahead.
(2) has reliability preferably.Utilize the characteristics that adopt unified NameSpace among the OSD, in the object indexing node, deposit the mapping relations of index node and object ID, like this when the corrupted data of zone object and root object, index node according to all user objects promptly can recover, and has guaranteed the consistance of object and object indexing node.
(3) has greater efficiency.Manage idle object indexing node by single-track link table, only need directly read a bunch information table to the batch operation of object indexing node and get final product.
Description of drawings
Fig. 1 is the structural representation of file system of the present invention;
Fig. 2 is the distribution plan of file partition of the present invention;
Fig. 3 is the distribution plan of shown in Figure 2 bunch of group in the file system of the present invention;
Fig. 4 is shown in Figure 3 bunch a distribution plan in the file system of the present invention;
Fig. 5 is the view before the object indexing node distributes in the file system of the present invention;
Fig. 6 is the view after the object indexing node distributes in the file system of the present invention;
Fig. 7 is the view after the object indexing node reclaims in the file system of the present invention.
Embodiment
Object among the OSD is divided into four classes: root object, zone object, collection object and user object.
Each OSD has and only has a root object, and it has comprised a series of zone object.The characteristic of its this OSD of attribute description, as total volume, at most can objects stored number and the information relevant with data integrity; It is a series of that its data have comprised, and each describes the zone object in this root object and the mapping of corresponding objects index node.
Zone object comprises one group of user object, and these user objects have some common attributes; Zone object can also comprise zero or a plurality of collection object.User object number in this zone object of the attribute description of zone object, user object occupation space, collection object data, collection object occupation space etc.It is a series of that the data of zone object have comprised, and each describes the collection object in this zone object or the mapping of user object and corresponding objects index node.
Collection object comprises one group of user object, is used to realize the quick retrieval of user object, and can only be subordinated to a zone object.Its user object number of being comprised of the attribute description of collection object, user object occupation space etc.It is a series of that the data of collection object have comprised, and each describes the user object in this collection object and the mapping of corresponding objects index node.
User object can belong to zero or a plurality of collection object, can only belong to a zone object.The creation-time of this user object of attribute description of user object, final modification time, data capacity and the information relevant etc. with data security.The data of user object are the True Datas of storage, as file data, data-base recording etc.
Object properties are that unit is deposited with the property pages, and first property pages is called the attribute catalogue page, and the attribute in the attribute catalogue page is the description to all other property pages of object.Can visit other property pages by reading the attribute catalogue page.
The object ID of object is made up of Partition_ID and User_ID.The Partition_ID and the User_ID of root object are 0h, and the User_ID of zone object is 0h, and user object that Partition_ID is identical and collection object belong to a zone object.Except that root object, claim that the object under the object is its upper strata object, be root object as the upper strata object of zone object, the upper strata object of collection object and user object is a zone object.
With reference to Fig. 1, file system of the present invention comprises creates file system module 1, OSD initialization module 2, object indexing node acquisition module 3, object properties operational module 4, object operability judge module 5, object data operational module 6, object ID distribution module 7, object indexing connection point manager (CP manager) module 8 and dina base administration module 9.The function of each module is described below:
Create the request triggering of file system module 1, create file partition, file partition is distributed as Fig. 2, Fig. 3 and shown in Figure 4 by the file system essential information is set by upper procedure; The information of primary structure comprises in the initialization subregion: initialization bunch information table, file system essential information and bunch information table are backuped in backup of file system essential information and bunch information table backup respectively, free block list and object indexing ode table in each bunch of initialization; Initialization OSD order is sent in the OSD initialization module 2.
With reference to Fig. 2, subregion comprises file system essential information, bunch information table, bunch group, the backup of file system essential information and bunch information table backup.Deposit in the file system essential information subregion essential information (size of piece, bunch size, bunch number), the start address and the size of subregion each several part; Deposit a plurality of bunches of items of information in bunch information table, wherein the number of bunch item of information with bunch number equate, each bunch item of information is described the state when prevariety, the ID that comprises bunch, bunch idle object indexing nodal point number, the head pointer of idle object indexing node chained list, the free block number of data field; Deposit the descriptor of free block in the attribute of object and data, object indexing node and the data field among bunch group; The backup of file system essential information is the backup fully of file system essential information; The backup of bunch information table is the backup fully of bunch information table.
With reference to Fig. 3, bunch group accounts for disk space by N and forms for equal-sized bunch, and wherein the size of N is decided each bunch size definition by whole partition size and founder.
With reference to Fig. 4, bunch comprise free block list, object indexing ode table and data field.The taking and idle condition of piece in the store data district in the free block list; Deposit a plurality of object indexing nodes in the object indexing ode table, comprise in each object indexing node that object indexing node number, object properties and data are at the address of data field, object ID three's mapping relations and the state of object indexing node, if the object indexing node free time, then also comprise the call number of next idle object indexing node; Deposit the attribute and the data of object in the data field.
Object indexing node acquisition module 3 is according to the inquiry of the object ID in the operating parameter and obtain the object indexing node.In the root object data, adopt Hash table to search the zone object index node of Partition_ID correspondence, according to zone object index node visit zone object data; In the zone object data, adopt Hash table to search the collection object or the user object index node of User_ID correspondence.Different operating according to the file system upper procedure sends sends to object properties operational module 4, object indexing connection point manager (CP manager) module 8 and dina base administration module 9 with the object indexing node that obtains.
Object properties operational module 4 is used for reading and writing or object properties is set.Object properties leave in the data field, and for ease of access, the attribute catalogue page takies a data block separately, and the address of attribute catalogue page is left in the object indexing node.The reading object attribute comprises: according to the object indexing node in the object indexing node module 3, obtain the address of object properties catalogue page, the storage address that inquiry need be read property pages in the attribute catalogue page reads and writes object properties to buffer zone then; Object properties are set to be comprised: receive in the operating parameter or attribute updating information that object data operational module 6 sends, searching in the attribute catalogue page needs the property pages that upgrades, and respective attributes is set then; Writing attribute comprises: according to the object the created control information of object operability judge module 5 transmissions, receive free block that dina base administration module 9 the sends catalogue page that sets a property, and the attribute in attribute catalogue page and the buffer zone write in the free block, the address that sends the attribute catalogue page is to object indexing connection point manager (CP manager) module 8.
Object operability judge module 5 reading object attribute from buffer zone, whether authorize user's reading and writing, create the right of object and deletion object according to the determined property of object, and send the readable control information of object data or object data can be write control information to object data operational module 6; Or transmission can be created the object control information to object properties operational module 4, object ID distribution module 7, object indexing connection point manager (CP manager) module 8 and dina base administration module 9; Or transmission can be deleted the object control information to object indexing connection point manager (CP manager) module 8 and dina base administration module 9.
Object data operational module 6 utilizes the piece of depositing of data B+ tree management object data, and the root address of B+ tree is left in the object indexing node, realizes the read-write operation to object data.These data B+ tree is filled by continuous blocks description entry (skew of continuous blocks in object, the start address of continuous blocks, the size of continuous blocks), and key word is the skews of continuous blocks in object.Reading of data comprises: the readable control information of object data according to object operability judge module 5 sends, obtain the storage address that object data B+ sets by the object indexing node, and search data B+ tree, the reading object data are in buffer zone; Writing data comprises: can write control information according to the object data that object operability judge module 5 sends, object data in the buffer zone is write in the free block of dina base administration module 9 transmissions, piece is inserted in the data B+ tree address of data B+ tree root in the upgating object index node.The read-write operation of object data can cause that some dynamic attributes of object change, so also need attribute updating information is sent to object properties operational module 4.
Object ID distribution module 7 is used to distribute object ID.The object created control information according to 5 transmissions of object operability judge module, in the root object data, adopt Hash table to search Partition_ID and distribute zone object ID, in the zone object data, adopt Hash table to search User_ID and distributing user object or collection object ID, and make this ID unique in OSD, send this ID to object indexing connection point manager (CP manager) module 8.
Object indexing connection point manager (CP manager) module 8 adopts single-track link tables to deposit idle index node, and the linked list head pointer is placed on the method for the fixed position in the subregion, realizes distribution and recovery to index node.In each bunch, an idle object indexing node chained list is formed in all idle object indexing node links.In bunch information table, deposit the head pointer of idle object indexing node chained list in this bunch in each bunch item of information.The distribution of object indexing node and recovery are all carried out from the chained list stem:
When distributing an object indexing node, the object created control information according to 5 transmissions of object operability judge module, distribute first idle object indexing node from the idle object indexing node of linked list head pointed, receive the object ID of object ID distribution module 7 transmissions and the attribute address of object properties operational module 4 transmissions the object indexing node is set, upgrade the linked list head pointer in bunch item of information; When reclaiming an object indexing node, according to receiving the object the deleted control information that object operability judge module 5 sends, the object indexing node that object indexing node module 3 is sent inserts the stem of idle object indexing node chained list, upgrades the linked list head pointer.Distribute and the recycle object index node is respectively that establishment and deletion by object causes, will cause the change of upper strata object properties and data, so all need to upgrade the attribute and the data of upper strata object.
To Fig. 7, is an example of the distribution and the recovery of object indexing node with reference to figure 5.Among the figure, first of object indexing node be bunch in call number, last is a pointer field, is used to refer to the idle index node of the next one.The pointer field of last idle object indexing node is null (sky).
Original state as shown in Figure 5, the head pointer of object indexing node chained list points to the single-track link table that 4 idle object indexing nodes are arranged in bunch item of information.
Distribution begins to carry out from the chained list stem, distributes and object indexing node 2 is set, and upgrade bunch item of information: idle object indexing node number is 3 in the chained list, and head pointer points to new chained list stem.The state of bunch item of information and chained list as shown in Figure 6 after distributing.
Recycle object index node 10 inserts the chained list stem with object indexing node 10.Upgating object index node 10 makes its pointer field point at objects index node 5.Upgrading a bunch item of information comprises: idle object indexing node number is 4 in the renewal chained list, and head pointer is pointed to new chained list stem.The state of recycle object index node 10 back bunch items of information and chained list as shown in Figure 7.
Compare with traditional bitmap management object indexing node, utilize single-track link table to manage idle object indexing node and simplify the distribution and the reclaimer operation of object indexing node a lot.With bitmap management object indexing node, batch operation need be read for twice just can find assignable object indexing node.Deposit the object indexing node with the list structure free time, and the linked list head pointer is placed in bunch information table, not only will search and to distribute the reading times of object indexing node to be reduced to once, and, will reduce time for reading if a bunch information table is called in main memory.In the OSD standard, object ID 128 bit representations, promptly in the object-oriented storage system, storage object quantity maximum can reach 2 128 powers.Distribute each object all to need to distribute the object indexing node.So, utilize single-track link table to manage the distribution time that idle object indexing node not only reduces the object indexing node, also can drive the performance boost of whole storage system.
Dina base administration module 9 is utilized the piece of depositing of free block B+ tree management object data, realizes distribution and recovery to piece in the data field.This free block B+ tree is filled by continuous free block description entry (start address of free block, the size of continuous blocks continuously), and root is in free block list, and different with data B+ tree is that the key word of this B+ tree is the start address of continuous free block.This module can be write control information according to object created or object data that object operability judge module 5 sends, search data B+ tree, distribute the continuous free block of trying one's best, if the Object Creation operation needs free block is sent to object properties operational module 4, if the object data write operation then sends to free block in the object data operational module 6; Or the object the deleted control information that sends according to object operability judge module 5, the object indexing node that is sent by object indexing node acquisition module 3 obtains object properties and data address, inserts free block B+ tree with shared.
Creating file system module 1 and OSD initialization module 2 moves when creating the OSD subregion.Other module triggers operation by the operation of file system upper procedure.
Below respectively with six operand data reads, object datas of upper procedure write, object properties read, object properties setting, Object Creation and object are deleted and illustrated that object indexing node acquisition module 3 is to the relation between the dina base administration module 9.
(a) object data read operation: according to operating parameter (object ID, data-bias address, reading of data length) reading object data in buffer zone.Its flow process is as follows:
(a1) object indexing node acquisition module 3 receives the object ID in the operating parameters, and the object indexing node of correspondence is sent to object properties operational module 4;
(a2) object properties operational module 4 obtains the address of object properties and reads attribute according to the object indexing node, and attribute is write in the buffer zone;
(a3) object operability judge module 5 reads association attributes and judges whether to authorize the right of user's reading object data from buffer zone, and the readable control information of object data is sent to object data operational module 6;
(a4) object data operational module 6 search in data B+ tree according to the data-bias address in the operating parameter and reading of data length and reading of data in buffer zone, attribute updating information is sent in the object properties operational module 4;
(a5) object properties operational module 4 is searched property pages according to attribute updating information, and upgrades association attributes.
(b) object data write operation: the data in the data buffer are write in the data field according to operating parameter (object ID, data-bias address, write data length).Its flow process is as follows:
(b1) object indexing node acquisition module 3 arrives described in the process such as object data read operation of object operability judge module 5.
(b2) object operability judge module 5 judges whether to authorize the right that the user writes object data according to association attributes, object data can be write control information send to object data operational module 6 and dina base administration module 9;
(b3) dina base administration module 9 is distributed the continuous free block of trying one's best according to writing data length, and these continuous free blocks is sent in the object data operational module 6 according to the tree of the data-bias address search free block B+ in the operating parameter;
(b4) object data operational module 6 can be write control information according to the object data that object operability judge module 5 sends, the data of buffer zone are write in the free block of dina base administration module 9 transmissions, these pieces are inserted in the data B+ tree, and attribute updating information is sent to object properties operational module 4;
(b5) object properties operational module 4 is searched property pages according to attribute updating information, and upgrades association attributes.
(c) object properties read operation: read and write attribute in buffer zone according to operating parameter (object ID, property pages).Its flow process is as follows:
(c1) object indexing node acquisition module 3 receives the object ID in the operating parameters, and the object indexing node of correspondence is sent to object properties operational module 4;
(c2) object properties operational module 4 is according to the address of object indexing node acquisition object properties catalogue page, and attribute is read and write in the address of inquiry and getattr page or leaf in buffer zone in the attribute catalogue page.
(d) object properties setting operation: association attributes is set according to operating parameter (object ID, attribute).Its flow process is as follows:
(d1) object indexing node acquisition module 3 receives the object ID in the operating parameters, and the object indexing node of correspondence is sent to object properties operational module 4;
(d2) object properties operational module 4 obtains the address of object properties and reads attribute according to the object indexing node, and the property value of needs setting is updated to property value in the buffer zone.
(e) Object Creation operation: according to operating parameter (upper strata object ID, object properties, the object properties size) object that creates the division, collection object or user object.
(e1) object indexing node acquisition module 3 receives the upper strata object ID in the operating parameters, and corresponding upper object indexing node is sent to object properties operational module 4;
(e2) object properties operational module 4 reads and writes attribute in buffer zone according to the address of object indexing node acquisition object properties catalogue page.
(e3) object operability judge module 5 reads association attributes and judges whether to authorize the right that the user creates object from buffer zone, can create the object control information and send to object properties operational module 4, object ID distribution module 7, object indexing connection point manager (CP manager) module 8 and dina base administration module 9;
(e4) dina base administration module 9 is distributed the continuous free block of trying one's best according to the size of the object properties in the operating parameter, and free block is sent in the object data operational module 4;
(e5) object properties operational module 4 is according to the object the created control information of object operability judge module 5 transmissions, object properties in the operating parameter are write in the free block of dina base administration module 9 transmissions, and the address of transmission attribute catalogue is in object indexing connection point manager (CP manager) module 8;
(e6) object ID distribution module 7 distributes also to send object ID in object indexing connection point manager (CP manager) module 8 according to the object the created control information of object operability judge module 5 transmissions;
(e7) object indexing connection point manager (CP manager) module 8 is according to the object the created control information of object operability judge module 5 transmissions, distribute the object indexing node, the object indexing node is set, and upgrades the attribute and the data of upper strata object by the object ID of object ID distribution module 7 transmissions, the attribute address that object properties operational module 4 sends;
(f) object deletion action: according to operating parameter (object ID) deletion object.
(f1) object indexing node acquisition module 3 receives the object ID in the operating parameters, and the object indexing node of correspondence is sent to object properties operational module 4, dina base administration module 9 and object indexing connection point manager (CP manager) module 8;
(f2) object properties operational module 4 obtains the address of object properties and reads attribute according to the object indexing node, and attribute is write buffer zone;
(f3) object operability judge module 5 reads association attributes and judges whether to authorize the right that the user deletes object from buffer zone, can delete the object control information and send in dina base administration module 9 and the object indexing connection point manager (CP manager) module 8;
(f4) dina base administration module 9 receives the object indexing node that object indexing node acquisition module 3 sends according to the object the deleted control information that object operability judge module 5 sends, and adopts the B+ tree to carry out recycle object data and the shared piece of attribute;
(f5) object indexing connection point manager (CP manager) module 8 is according to the object the deleted control information of object operability judge module 5 transmissions, receive the object indexing node that object indexing node acquisition module 3 sends, adopt single-track link table recycle object index node, and upgrade the attribute and the data of upper strata object.
Claims (1)
1, the extendible object-based file system of a kind of attribute is characterized in that: this system comprises creates file system module (1), OSD initialization module (2), object indexing node acquisition module (3), object properties operational module (4), object operability judge module (5), object data operational module (6), object ID distribution module (7), object indexing connection point manager (CP manager) module (8) and dina base administration module (9);
Create file system module (1) and be used for being provided with file system essential information, initialization subregion key data structure, and send the OSD initialization command to OSD initialization module (2) with the establishment file partition;
OSD initialization module (2) is used for initialization OSD, and promptly establishment root object and Partition_ID are the zone object of 0h on file partition;
Object indexing node acquisition module (3) is according to the inquiry of the object ID in the operating parameter and obtain the object indexing node, and the object indexing node that obtains is sent to object properties operational module (4), object indexing connection point manager (CP manager) module (8) and dina base administration module (9) respectively;
Object properties operational module (4) is used to read, is provided with or writes object properties; This module reads and writes object properties in buffer zone according to the object indexing node in the object indexing node module (3); According in the buffer zone or the attribute updating information that sends of object data operational module (6) object properties are set; Or, the attribute in the buffer zone is write in the free block of dina base administration module (9) transmission, and the attribute address is sent to object indexing connection point manager (CP manager) module (8) according to the object the created control information that object operability judge module (5) sends;
Object operability judge module (5) judges whether to authorize user's reading and writing, creates the right of object or deletion object according to the object properties in the buffer zone, and sends the readable control information of object data or object data can be write control information to object data operational module (6); Or transmission can be created the object control information to object properties operational module (4), object ID distribution module (7), object indexing connection point manager (CP manager) module (8) and dina base administration module (9); Or transmission can be deleted the object control information to object indexing connection point manager (CP manager) module (8) and dina base administration module (9);
Object data operational module (6) is used to read or write object data; The readable control information of object data that this module sends according to object operability judge module (5) obtains data address and reading object data by the object indexing node; Or can write control information according to the object data that object operability judge module (5) sends, data in the buffer zone are write in the free block of dina base administration module (9) transmission, the upgating object index node, and attribute updating information sent to object properties operational module (4);
The object the created control information that object ID distribution module (7) sends according to object operability judge module (5) distributes object ID, and makes this ID unique in OSD, and ID is sent to object indexing connection point manager (CP manager) module (8);
Object indexing connection point manager (CP manager) module (8) is used for distribution and setting or recycle object index node; The object the created control information that this module sends according to object operability judge module (5), distribute the object indexing node number, receive the object ID of object ID distribution module (7) transmission and the attribute address of object properties operational module (4) transmission the object indexing node is set; Or according to receiving the object the deleted control information that object operability judge module (5) sends, the object indexing node that recycle object index node acquisition module (3) sends;
Dina base administration module (9) is used for distribution and the recovery to the data field piece; This module can be write control information according to object created or object data that object operability judge module (5) sends, in the data field, distribute the continuous free block of trying one's best, free block is sent in object properties operational module (4) or the object data operational module (6); Or the object the deleted control information that sends according to object operability judge module (5), the object indexing node that is sent by object indexing node acquisition module (3) obtains object properties and data address, recycle object attribute and data occupancy piece.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CNB2006100190016A CN100424699C (en) | 2006-04-30 | 2006-04-30 | Attribute extensible object file system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CNB2006100190016A CN100424699C (en) | 2006-04-30 | 2006-04-30 | Attribute extensible object file system |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN1845093A true CN1845093A (en) | 2006-10-11 |
| CN100424699C CN100424699C (en) | 2008-10-08 |
Family
ID=37064021
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CNB2006100190016A Expired - Fee Related CN100424699C (en) | 2006-04-30 | 2006-04-30 | Attribute extensible object file system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN100424699C (en) |
Cited By (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2010040255A1 (en) * | 2008-10-07 | 2010-04-15 | 华中科技大学 | Method for managing object-based storage system |
| CN101118558B (en) * | 2007-07-10 | 2011-05-25 | 青岛海信移动通信技术股份有限公司 | Converting method and apparatus for resource file |
| CN102193997A (en) * | 2011-05-04 | 2011-09-21 | 北京神州数码思特奇信息技术股份有限公司 | Information storage method |
| CN102654878A (en) * | 2011-03-04 | 2012-09-05 | 迈普通信技术股份有限公司 | Data operation method for distributed database in embedded system and board card |
| CN102915340A (en) * | 2012-02-29 | 2013-02-06 | 浙江工商大学 | Expanded B+ tree-based object file system |
| CN103902260A (en) * | 2012-12-25 | 2014-07-02 | 华中科技大学 | Pre-fetch method of object file system |
| CN105243112A (en) * | 2015-09-25 | 2016-01-13 | 天脉聚源（北京）科技有限公司 | Object indexing control method and apparatus |
| CN106980647A (en) * | 2017-02-24 | 2017-07-25 | 深圳市中博睿存信息技术有限公司 | A kind of Distributed File System Data location mode and device |
| CN108509213A (en) * | 2018-03-15 | 2018-09-07 | 广州悦世界信息科技有限公司 | For the update of moving game data access and guard method |
| CN108776682A (en) * | 2018-06-01 | 2018-11-09 | 南京紫光云信息科技有限公司 | The method and system of random read-write object based on object storage |
Family Cites Families (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US5838964A (en) * | 1995-06-26 | 1998-11-17 | Gubser; David R. | Dynamic numeric compression methods |
| US6006232A (en) * | 1997-10-21 | 1999-12-21 | At&T Corp. | System and method for multirecord compression in a relational database |
| JP2001282820A (en) * | 2000-01-25 | 2001-10-12 | Sony Corp | Data compression method, retrieval method and device, data packet signal and recording medium |
-
2006
- 2006-04-30 CN CNB2006100190016A patent/CN100424699C/en not_active Expired - Fee Related
Cited By (12)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101118558B (en) * | 2007-07-10 | 2011-05-25 | 青岛海信移动通信技术股份有限公司 | Converting method and apparatus for resource file |
| WO2010040255A1 (en) * | 2008-10-07 | 2010-04-15 | 华中科技大学 | Method for managing object-based storage system |
| CN102654878A (en) * | 2011-03-04 | 2012-09-05 | 迈普通信技术股份有限公司 | Data operation method for distributed database in embedded system and board card |
| CN102654878B (en) * | 2011-03-04 | 2014-03-05 | 迈普通信技术股份有限公司 | Data operation method for distributed database in embedded system and board card |
| CN102193997A (en) * | 2011-05-04 | 2011-09-21 | 北京神州数码思特奇信息技术股份有限公司 | Information storage method |
| CN102915340A (en) * | 2012-02-29 | 2013-02-06 | 浙江工商大学 | Expanded B+ tree-based object file system |
| CN103902260A (en) * | 2012-12-25 | 2014-07-02 | 华中科技大学 | Pre-fetch method of object file system |
| CN103902260B (en) * | 2012-12-25 | 2016-08-31 | 华中科技大学 | A kind of forecasting method of object-based file system |
| CN105243112A (en) * | 2015-09-25 | 2016-01-13 | 天脉聚源（北京）科技有限公司 | Object indexing control method and apparatus |
| CN106980647A (en) * | 2017-02-24 | 2017-07-25 | 深圳市中博睿存信息技术有限公司 | A kind of Distributed File System Data location mode and device |
| CN108509213A (en) * | 2018-03-15 | 2018-09-07 | 广州悦世界信息科技有限公司 | For the update of moving game data access and guard method |
| CN108776682A (en) * | 2018-06-01 | 2018-11-09 | 南京紫光云信息科技有限公司 | The method and system of random read-write object based on object storage |
Also Published As
| Publication number | Publication date |
|---|---|
| CN100424699C (en) | 2008-10-08 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN1845093A (en) | Attribute extensible object file system | |
| CN102158546B (en) | Cluster file system and file service method thereof | |
| CN110825748B (en) | High-performance and easily-expandable key value storage method by utilizing differentiated indexing mechanism | |
| US9047301B2 (en) | Method for optimizing the memory usage and performance of data deduplication storage systems | |
| CN107180092B (en) | File system control method and device and terminal | |
| US9342528B2 (en) | Method and apparatus for tiered storage | |
| CN109299113B (en) | Range query method with storage-aware mixed index | |
| WO2016187974A1 (en) | Storage space management method and apparatus | |
| CN110119425A (en) | Solid state drive, distributed data-storage system and the method using key assignments storage | |
| CN1955958A (en) | Sort data storage and split catalog inquiry method based on catalog tree | |
| CN103186350A (en) | Hybrid storage system and hot spot data block migration method | |
| CN106682110B (en) | Image file storage and management system and method based on Hash grid index | |
| CN1492362A (en) | Data back up and recovering method of embedded data bank | |
| EP4100845A2 (en) | Data management system and method of controlling | |
| CN101789027A (en) | Metadata management method based on DBMS and metadata server | |
| CN102163232A (en) | SQL (Structured Query Language) interface implementing method supporting IEC61850 object query | |
| JP2022500723A (en) | Systems and methods for bulk deleting records in a database | |
| CN103473337A (en) | Massive catalogs and files oriented processing method in distributed type storage system | |
| CN100338607C (en) | Method for organizing and accessing distributive catalogue of document system | |
| CN105045850A (en) | Method for recovering junk data in cloud storage log file system | |
| CN103942301A (en) | Distributed file system oriented to access and application of multiple data types | |
| WO2022262381A1 (en) | Data compression method and apparatus | |
| CN1255748C (en) | Metadata hierarchy management method and system of storage virtualization system | |
| CN109213760B (en) | High-load service storage and retrieval method for non-relational data storage | |
| Xu et al. | Enhancing HDFS with a full-text search system for massive small files |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C14 | Grant of patent or utility model | ||
| GR01 | Patent grant | ||
| C17 | Cessation of patent right | ||
| CF01 | Termination of patent right due to non-payment of annual fee |
Granted publication date: 20081008 Termination date: 20120430 |