CN104268225A - File system architecture for addressing in multidimensional degree of freedom, as well as generating and accessing mode thereof - Google Patents
File system architecture for addressing in multidimensional degree of freedom, as well as generating and accessing mode thereof Download PDFInfo
- Publication number
- CN104268225A CN104268225A CN201410501252.2A CN201410501252A CN104268225A CN 104268225 A CN104268225 A CN 104268225A CN 201410501252 A CN201410501252 A CN 201410501252A CN 104268225 A CN104268225 A CN 104268225A
- Authority
- CN
- China
- Prior art keywords
- addressing
- data
- group
- file system
- write
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000013507 mapping Methods 0.000 claims abstract description 22
- 238000000034 method Methods 0.000 claims description 4
- 238000002679 ablation Methods 0.000 claims description 3
- 230000000977 initiatory effect Effects 0.000 claims description 3
- 238000012163 sequencing technique Methods 0.000 claims description 3
- 238000013500 data storage Methods 0.000 abstract description 2
- 230000007547 defect Effects 0.000 description 3
- 238000010586 diagram Methods 0.000 description 1
- 230000006870 function Effects 0.000 description 1
- 230000001360 synchronised effect Effects 0.000 description 1
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/10—File systems; File servers
- G06F16/13—File access structures, e.g. distributed indices
Abstract
The invention relates to an addressing mode of information storage and visitation, and particularly to file system architecture for addressing in multidimensional degree of freedom, as well as a generating and visiting mode thereof. The invention solves the problems that traditional file system architecture cannot visit files in parallel and cannot perform random positioning and rapid visitation on data in the files. The file system architecture for addressing in multidimensional degree of freedom comprises a file name with a path, an address chain table corresponding to the file name and n index mapping tables; each index mapping table is composed of multiple addressing factor combinatorial terms; the input value of each addressing factor combinatorial term is an addressing variable value of a group of data while the output value is an address chain table pointer, an offset and a data length corresponding to the addressing variable value; the address chain table pointer points to the position of a storage unit to be visited by the group of data in the address chain table. The invention is suitable for various storage systems, and is particularly suitable for big-data storage systems and cloud storage systems.
Description
Technical field
The information that the present invention relates to stores and the addressing mode of access, the file system architecture of specifically a kind of multidimensional degree of freedom addressing and generation thereof and access mode.
Background technology
At present, calculator memory utilizes memory address bus addressing, belongs to the addressing of one dimension degree of freedom.Computing machine exterior storage (as disk, tape or dish battle array etc.) utilizes file system architecture to carry out two-dimensional freedom addressing: one of them degree of freedom is the filename with path, and another degree of freedom is an access unit address chained list corresponding with this file famous prime minister.When writing in files, create this address link list, must first from the storage unit that file system application one is available, this element address is appended in address link list, and then data are write this storage unit, repeat until data write operation terminates according to this, the process that such file system sets up memory unit address chained list is synchronous with data write operation.When file reading, file system provides a pointer pointing to address link list, from the storage unit that this pointer is specified, sequentially must read data successively.
Mainly there are following two defects in above-mentioned traditional file systems framework: one, cannot concurrent access file; Two, random position and fast access cannot be carried out to the data in file.First defect comes from the not reenterability of address link list.Reenterability does not refer to: file opened can only provide the address link list of unique this file of pointed, and multiple thread can only share this unique pointer, can not access the same file opened from two or more diverse location simultaneously.Second defect comes from the sequential access of address link list.Sequential access refers to: the address link list pointer of a file cannot movement at random, the assigned address of address link list can only be sequentially moved to a step position from current location, then access the content of the storage unit that this position is specified, therefore traditional file systems can only be accessed in additional mode.Given this, be necessary a kind of brand-new file system architecture of invention and generation and access mode, with solve traditional file system architecture cannot concurrent access file, the problem of random position and fast access cannot be carried out to the data in file.
Summary of the invention
The present invention in order to solve traditional file system architecture cannot concurrent access file, the problem of random position and fast access cannot be carried out to the data in file, provide the file system architecture of a kind of multidimensional degree of freedom addressing and generation thereof and access mode.
The present invention adopts following technical scheme to realize: the file system architecture of a kind of multidimensional degree of freedom addressing, comprises a filename with path, the address link list corresponding with this file famous prime minister, a n index-mapping table;
Each index-mapping table forms by multiple addressing element group item;
The input value of each addressing element group item is the addressing variables value of one group of data, its output valve is an address link list pointer corresponding with this addressing variables value, side-play amount, a data length, the position of storage unit in address link list that these group data of this address link list pointed will be accessed, this side-play amount determines access start address in this storage unit, and this data length defines access profile; When this data length is default or be 0 time, represent access until the end of file;
N is positive integer.
The generating mode (which is for generating the file system architecture of a kind of multidimensional degree of freedom of the present invention addressing) of the file system architecture of a kind of multidimensional degree of freedom addressing, which adopts following steps to realize:
1) be multi-group data by the Data Placement of file system to be written;
2) for one group of data, the addressing variables value be associated with these group data is extracted, and the addressing element group item that definition is corresponding with these group data; Then this addressing variables value is designated as the input value of this addressing element group item, and makes the following judgment:
If the storage unit pointed by address link list pointer of current file system is not yet write full, then current address link list pointer and side-play amount are designated as the output valve of this addressing element group item;
Otherwise, if the storage unit pointed by address link list pointer of current file system has been write full, then to the storage unit that file system application one is new, and this access unit address is linked to address link list, then by current address link list pointer movement 1 position, current side-play amount is set to the output valve that 0 value postscript is this addressing element group item;
3) storage unit these group data write pointed by current address link list pointer is started; In ablation process, if storage unit is write full, then to the storage unit that file system application one is new, and this access unit address is linked to address link list, but do not change the output valve of this addressing element group item, then continue these group data to write this storage unit; After these group data have write, the data length of these group data is designated as the output valve of this addressing element group item; Now, the input value of this addressing element group item generates this addressing element group item corresponding with these group data jointly with output valve;
4) for often organizing data, circulation performs step 2)-3), until each group data have all write; Now, with each group of data one to one each addressing element group item all generate complete, each addressing element group item generates an index-mapping table jointly;
5) when adopting multiple thread by data writing in files system, then rank according to the sequencing of each thread initiation write operation, then for each thread, circulation performs step 1)-4).
The access mode (which is for accessing the file system architecture of a kind of multidimensional degree of freedom of the present invention addressing) of the file system architecture of a kind of multidimensional degree of freedom addressing, which adopts following steps to realize:
1) according to the addressing variables value search index mapping table of one group of data, an address link list pointer, side-play amount, a data length is obtained thus;
2) obtain by this address link list pointer the position of storage unit in address link list that these group data will read and write, obtain the read-write start address in storage unit that these group data will read and write by this side-play amount, obtain read-write scope by this data length; The read-write operation of these group data is carried out according to this position, this read-write start address, this read-write scope;
3) when adopting multiple thread to carry out the read-write operation of data, then each thread performs step 1)-2 separately), realize the concurrent reading and concurrent writing operation of multi-group data thus.
Compared with traditional file system architecture, the file system architecture of a kind of multidimensional degree of freedom of the present invention addressing and generate and access mode on the basis of the two-dimensional freedom addressing of inheriting tradition file system architecture, increase index-mapping table newly as new addressing degree of freedom, therefore it has possessed following advantage: one, by newly-increased index-mapping table as new addressing degree of freedom, the file system architecture of a kind of multidimensional degree of freedom of the present invention addressing and to generate and access mode can provide multiple different address link list pointer to point to the diverse location of the address link list that opens file simultaneously, make multiple thread can access the same file opened from two or more diverse location thus simultaneously, thus achieve concurrent access file.Two, by increasing index-mapping table newly as new addressing degree of freedom, the file system architecture of a kind of multidimensional degree of freedom of the present invention addressing and to generate and pointer that access mode provides can point to any one position of address link list randomly according to the output valve of addressing element group item, thus realize access file from any one position randomly, thus random position and fast access are carried out to file data.
The present invention is rational in infrastructure, simplicity of design is ingenious, efficiently solve traditional file system architecture cannot concurrent access file, the problem of random position and fast access cannot be carried out to the data in file, be applicable to various storage system, be particularly useful for large data-storage system and cloud storage system.
Accompanying drawing explanation
Fig. 1 is the schematic diagram of the file system architecture of a kind of multidimensional degree of freedom of the present invention addressing.
Fig. 2 is the structural representation of the index-mapping table of the file system architecture of a kind of multidimensional degree of freedom of the present invention addressing.
Embodiment
A file system architecture for multidimensional degree of freedom addressing, comprises a filename with path, the address link list corresponding with this file famous prime minister, a n index-mapping table;
Each index-mapping table forms by multiple addressing element group item;
The input value of each addressing element group item is the addressing variables value of one group of data, its output valve is an address link list pointer corresponding with this addressing variables value, side-play amount, a data length, the position of storage unit in address link list that these group data of this address link list pointed will be accessed, this side-play amount determines access start address in this storage unit, and this data length defines access profile; When this data length is default or be 0 time, represent access until the end of file;
N is positive integer.
The generating mode (which is for generating the file system architecture of a kind of multidimensional degree of freedom of the present invention addressing) of the file system architecture of a kind of multidimensional degree of freedom addressing, which adopts following steps to realize:
1) be multi-group data by the Data Placement of file system to be written;
2) for one group of data, the addressing variables value be associated with these group data is extracted, and the addressing element group item that definition is corresponding with these group data; Then this addressing variables value is designated as the input value of this addressing element group item, and makes the following judgment:
If the storage unit pointed by address link list pointer of current file system is not yet write full, then current address link list pointer and side-play amount are designated as the output valve of this addressing element group item;
Otherwise, if the storage unit pointed by address link list pointer of current file system has been write full, then to the storage unit that file system application one is new, and this access unit address is linked to address link list, then by current address link list pointer movement 1 position, current side-play amount is set to the output valve that 0 value postscript is this addressing element group item;
3) storage unit these group data write pointed by current address link list pointer is started; In ablation process, if storage unit is write full, then to the storage unit that file system application one is new, and this access unit address is linked to address link list, but do not change the output valve of this addressing element group item, then continue these group data to write this storage unit; After these group data have write, the data length of these group data is designated as the output valve of this addressing element group item; Now, the input value of this addressing element group item generates this addressing element group item corresponding with these group data jointly with output valve;
4) for often organizing data, circulation performs step 2)-3), until each group data have all write; Now, with each group of data one to one each addressing element group item all generate complete, each addressing element group item generates an index-mapping table jointly;
5) when adopting multiple thread by data writing in files system, then rank according to the sequencing of each thread initiation write operation, then for each thread, circulation performs step 1)-4).
The access mode (which is for accessing the file system architecture of a kind of multidimensional degree of freedom of the present invention addressing) of the file system architecture of a kind of multidimensional degree of freedom addressing, which adopts following steps to realize:
1) according to the addressing variables value search index mapping table of one group of data, an address link list pointer, side-play amount, a data length is obtained thus;
2) obtain by this address link list pointer the position of storage unit in address link list that these group data will read and write, obtain the read-write start address in storage unit that these group data will read and write by this side-play amount, obtain read-write scope by this data length; The read-write operation of these group data is carried out according to this position, this read-write start address, this read-write scope;
3) when adopting multiple thread to carry out the read-write operation of data, then each thread performs step 1)-2 separately), realize the concurrent reading and concurrent writing operation of multi-group data thus.
During concrete enforcement, described one group of data are the I frame of stream medium data; Described index-mapping table is the time index table based on hash function; Described addressing element group item is time variable group item; The addressing variables value of described one group of data be one by year, month, day, hour, the time variable that forms of minute, second combines.
Claims (6)
1. a file system architecture for multidimensional degree of freedom addressing, is characterized in that: comprise a filename with path, the address link list corresponding with this file famous prime minister, a n index-mapping table;
Each index-mapping table forms by multiple addressing element group item;
The input value of each addressing element group item is the addressing variables value of one group of data, its output valve is an address link list pointer corresponding with this addressing variables value, side-play amount, a data length, the position of storage unit in address link list that these group data of this address link list pointed will be accessed, this side-play amount determines access start address in this storage unit, and this data length defines access profile; When this data length is default or be 0 time, represent access until the end of file;
N is positive integer.
2. a generating mode for the file system architecture of multidimensional degree of freedom addressing, which, for generating the file system architecture of a kind of multidimensional degree of freedom as claimed in claim 1 addressing, is characterized in that: which adopts following steps to realize:
1) be multi-group data by the Data Placement of file system to be written;
2) for one group of data, the addressing variables value be associated with these group data is extracted, and the addressing element group item that definition is corresponding with these group data; Then this addressing variables value is designated as the input value of this addressing element group item, and makes the following judgment:
If the storage unit pointed by address link list pointer of current file system is not yet write full, then current address link list pointer and side-play amount are designated as the output valve of this addressing element group item;
Otherwise, if the storage unit pointed by address link list pointer of current file system has been write full, then to the storage unit that file system application one is new, and this access unit address is linked to address link list, then by current address link list pointer movement 1 position, current side-play amount is set to the output valve that 0 value postscript is this addressing element group item;
3) storage unit these group data write pointed by current address link list pointer is started; In ablation process, if storage unit is write full, then to the storage unit that file system application one is new, and this access unit address is linked to address link list, but do not change the output valve of this addressing element group item, then continue these group data to write this storage unit; After these group data have write, the data length of these group data is designated as the output valve of this addressing element group item; Now, the input value of this addressing element group item generates this addressing element group item corresponding with these group data jointly with output valve;
4) for often organizing data, circulation performs step 2)-3), until each group data have all write; Now, with each group of data one to one each addressing element group item all generate complete, each addressing element group item generates an index-mapping table jointly;
5) when adopting multiple thread by data writing in files system, then rank according to the sequencing of each thread initiation write operation, then for each thread, circulation performs step 1)-4).
3. an access mode for the file system architecture of multidimensional degree of freedom addressing, which, for accessing the file system architecture of a kind of multidimensional degree of freedom as claimed in claim 1 addressing, is characterized in that: which adopts following steps to realize:
1) according to the addressing variables value search index mapping table of one group of data, an address link list pointer, side-play amount, a data length is obtained thus;
2) obtain by this address link list pointer the position of storage unit in address link list that these group data will read and write, obtain the read-write start address in storage unit that these group data will read and write by this side-play amount, obtain read-write scope by this data length; The read-write operation of these group data is carried out according to this position, this read-write start address, this read-write scope;
3) when adopting multiple thread to carry out the read-write operation of data, then each thread performs step 1)-2 separately), realize the concurrent reading and concurrent writing operation of multi-group data thus.
4. the file system architecture of multidimensional degree of freedom according to claim 1 addressing, is characterized in that: described one group of data are the I frame of stream medium data; Described index-mapping table is the time index table based on hash function; Described addressing element group item is time variable group item; The addressing variables value of described one group of data be one by year, month, day, hour, the time variable that forms of minute, second combines.
5. the generating mode of the file system architecture of a kind of multidimensional degree of freedom according to claim 2 addressing, which, for generating the file system architecture of a kind of multidimensional degree of freedom as claimed in claim 4 addressing, is characterized in that: described one group of data are the I frame of stream medium data; Described index-mapping table is the time index table based on hash function; Described addressing element group item is time variable group item; The addressing variables value of described one group of data be one by year, month, day, hour, the time variable that forms of minute, second combines.
6. the access mode of the file system architecture of a kind of multidimensional degree of freedom according to claim 3 addressing, which, for accessing the file system architecture of a kind of multidimensional degree of freedom as claimed in claim 4 addressing, is characterized in that: described one group of data are the I frame of stream medium data; Described index-mapping table is the time index table based on hash function; Described addressing element group item is time variable group item; The addressing variables value of described one group of data be one by year, month, day, hour, the time variable that forms of minute, second combines.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201410501252.2A CN104268225B (en) | 2014-09-26 | 2014-09-26 | A kind of file system architecture and its generation and access mode of the addressing of the multidimensional free degree |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201410501252.2A CN104268225B (en) | 2014-09-26 | 2014-09-26 | A kind of file system architecture and its generation and access mode of the addressing of the multidimensional free degree |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN104268225A true CN104268225A (en) | 2015-01-07 |
| CN104268225B CN104268225B (en) | 2018-05-11 |
Family
ID=52159747
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201410501252.2A Active CN104268225B (en) | 2014-09-26 | 2014-09-26 | A kind of file system architecture and its generation and access mode of the addressing of the multidimensional free degree |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN104268225B (en) |
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106407050A (en) * | 2016-10-20 | 2017-02-15 | 厦门科华恒盛股份有限公司 | Data storage method |
| CN107357929A (en) * | 2017-07-27 | 2017-11-17 | 广东欧珀移动通信有限公司 | File reading, mobile terminal and readable storage medium storing program for executing |
| CN112732336A (en) * | 2020-12-31 | 2021-04-30 | 中国工商银行股份有限公司 | Egl type variable quantum structure access method for JAVA platform |
| CN114840356A (en) * | 2022-07-06 | 2022-08-02 | 山东矩阵软件工程股份有限公司 | Data processing method, data processing system and related device |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20090132599A1 (en) * | 2007-11-16 | 2009-05-21 | Kourosh Soroushian | Hierarchical and reduced index structures for multimedia files |
| CN101901263A (en) * | 2010-07-22 | 2010-12-01 | 华为终端有限公司 | Access method and device of file system |
| CN102880615A (en) * | 2011-07-15 | 2013-01-16 | 腾讯科技（深圳）有限公司 | Data storage method and device |
-
2014
- 2014-09-26 CN CN201410501252.2A patent/CN104268225B/en active Active
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20090132599A1 (en) * | 2007-11-16 | 2009-05-21 | Kourosh Soroushian | Hierarchical and reduced index structures for multimedia files |
| CN101901263A (en) * | 2010-07-22 | 2010-12-01 | 华为终端有限公司 | Access method and device of file system |
| CN102880615A (en) * | 2011-07-15 | 2013-01-16 | 腾讯科技（深圳）有限公司 | Data storage method and device |
Non-Patent Citations (2)
| Title |
|---|
| 王荣德: ""海量分布式日志检索技术的研究"", 《中国优秀硕士论文全文数据库-信息科技辑》 * |
| 黄金福: ""流媒体数据存储系统的研究与设计"", 《中国优秀硕士论文全文数据库-信息科技辑》 * |
Cited By (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106407050A (en) * | 2016-10-20 | 2017-02-15 | 厦门科华恒盛股份有限公司 | Data storage method |
| CN106407050B (en) * | 2016-10-20 | 2020-11-10 | 科华恒盛股份有限公司 | Data storage method |
| CN107357929A (en) * | 2017-07-27 | 2017-11-17 | 广东欧珀移动通信有限公司 | File reading, mobile terminal and readable storage medium storing program for executing |
| CN112732336A (en) * | 2020-12-31 | 2021-04-30 | 中国工商银行股份有限公司 | Egl type variable quantum structure access method for JAVA platform |
| CN112732336B (en) * | 2020-12-31 | 2024-01-30 | 中国工商银行股份有限公司 | Access method for Egl-type variable sub-structure of JAVA platform |
| CN114840356A (en) * | 2022-07-06 | 2022-08-02 | 山东矩阵软件工程股份有限公司 | Data processing method, data processing system and related device |
| CN114840356B (en) * | 2022-07-06 | 2022-11-01 | 山东矩阵软件工程股份有限公司 | Data processing method, data processing system and related device |
Also Published As
| Publication number | Publication date |
|---|---|
| CN104268225B (en) | 2018-05-11 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN105242881B (en) | Distributed memory system and its data read-write method | |
| CN102821138B (en) | Metadata distributed storage method applicable to cloud storage system | |
| CN103914483B (en) | File memory method, device and file reading, device | |
| US20120047324A1 (en) | Sequential access storage and data de-duplication | |
| CN104246722A (en) | Storage system for eliminating data duplication on basis of hash table, storage controller, and method | |
| CN103559027A (en) | Design method of separate-storage type key-value storage system | |
| CN111832065A (en) | Software implemented using circuitry and method for key-value storage | |
| TWI761419B (en) | Method, memory system and article for maximized dedupable memory | |
| CN104268225A (en) | File system architecture for addressing in multidimensional degree of freedom, as well as generating and accessing mode thereof | |
| CN103678603A (en) | Multi-source heterogeneous data efficient converging and storing frame system | |
| CN104536908B (en) | A kind of magnanimity small records efficient storage management method towards unit | |
| CN107741947A (en) | The storage of random number key based on HDFS file system and acquisition methods | |
| CN106354890A (en) | Implementation method of random access file system based on N-ary tree structure | |
| CN105260139B (en) | A kind of disk management method and system | |
| CN103942301A (en) | Distributed file system oriented to access and application of multiple data types | |
| CN104461384B (en) | A kind of method for writing data and storage device | |
| CN104158863A (en) | Cloud storage mechanism based on transaction-level whole-course high-speed buffer | |
| KR20140021793A (en) | Database method for b+ tree based on pram | |
| CN104573089A (en) | Incremental snapshot method in NewSQL database | |
| CN104615459A (en) | MoCA equipment parameter configuration method and device | |
| CN108228606A (en) | The wiring method and device of data | |
| CN105408893B (en) | A kind of data processing and wiring method and relevant apparatus | |
| CN106372002A (en) | Data storage method and data reading and restoring method | |
| US9542402B2 (en) | Computing devices with multi-layer file systems | |
| CN104378431A (en) | Metadata distributed-memory method suitable for cloud storage system |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant | ||
| TR01 | Transfer of patent right |
Effective date of registration: 20231205 Address after: 043000 In the courtyard of Weitao Food Factory, Tonghui Street, Houma Economic Development Zone, Linfen City, Shanxi Province Patentee after: Shanxi Zhongxinle Shihui Food Co.,Ltd. Address before: 030024 No. 79 West Main Street, Taiyuan, Shanxi, Yingze Patentee before: SHANXI DAXINHE TECHNOLOGY Co.,Ltd. |
|
| TR01 | Transfer of patent right |