CN101789027A - Metadata management method based on DBMS and metadata server - Google Patents

Metadata management method based on DBMS and metadata server Download PDF

Info

Publication number
CN101789027A
CN101789027A CN 201010124079 CN201010124079A CN101789027A CN 101789027 A CN101789027 A CN 101789027A CN 201010124079 CN201010124079 CN 201010124079 CN 201010124079 A CN201010124079 A CN 201010124079A CN 101789027 A CN101789027 A CN 101789027A
Authority
CN
China
Prior art keywords
metadata
file
catalogue
request
attribute
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN 201010124079
Other languages
Chinese (zh)
Inventor
牛德姣
蔡涛
鞠时光
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Jiangsu University
Original Assignee
Jiangsu University
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Jiangsu University filed Critical Jiangsu University
Priority to CN 201010124079 priority Critical patent/CN101789027A/en
Publication of CN101789027A publication Critical patent/CN101789027A/en
Pending legal-status Critical Current

Links

Images

Abstract

The invention provides a metadata management method based on DBMS and a metadata server. The metadata server is provided with DBMS for building and saving the metadata database of a mass storage system; five two-dimensional tables are built for storing metadata; after analysis, a metadata request is converted into a group of SQL statement which operates the metadata database so as to build the novel metadata database server for the mass storage system. The invention analyzes time and space consumption needed by performing typical metadata operation, manages the flexibility of metadata, verifies that the invention can reduce time and space consumption needed by managing metadata in the mass storage system, and improves the flexibility of managing the metadata.

Description

A kind of metadata management method and meta data server based on DBMS
Technical field
The invention belongs to technical field of memory, relate to mass storage system (MSS) wherein, be specifically related to meta data server and metadata management method.
Background technology
Need to preserve Terabyte, Petabyte rank even more massive data in the mass storage system (MSS), the metadata amount of mass data itself is also very huge, for the requirement of satisfying magnanimity storage system to high I/O performance and managerial flexibility, how managing the metadata of mass storage system (MSS) and designing the corresponding metadata server is a major issue.
The metadata of data in the mass storage system (MSS) all needs the concentrated area to be managed by meta data server as name, attribute and the access authorization etc. of file.When visiting the data in the mass storage system (MSS), at first need the accesses meta-data server, utilize the metadata of information inquiry files such as filename, behind the metadata informations such as acquisition data attribute and access authorization, could reading corresponding data.Mass storage system (MSS) need be handled a large amount of request of access simultaneously, and time and space expense that management of metadata is required and dirigibility have very big influence to the I/O performance of mass storage system (MSS).
Metadata management algorithm commonly used in the mass storage system (MSS) comprises: catalogue subtree subregion method and file hash algorithm.Catalogue subtree subregion (Directory SubtreePartitioning) algorithm that the people such as Popek of Massachusetts Institute Technology in 1986 propose, the bibliographic structure of hierarchy type is divided into some subtrees, different catalogue subtrees is distributed in the different meta data servers, thus the performance of raising metadata management.But there is the big problem of traversal expense in the bibliographic structure of hierarchy type, and catalogue renames and need move a large amount of metadata when changing operation such as access authorization carrying out, and has influenced the performance of mass storage system (MSS).Hash (Hash) algorithm that the people such as P.F.Corbett of IBM in 1996 propose by designing corresponding Hash function, can be distributed to the file under the same catalogue in the different meta data servers equably, can reduce the bottleneck in the metadata operation.But this algorithm has destroyed hierarchical structure of directory, when carrying out instruction such as directory listing relevant with catalogue and access authorization management, needs to travel through all metadata informations; The same existence carries out that catalogue renames and when changing operation such as access authorization, the problem that required time and space expense are bigger.The LH algorithm that the people such as Scott A.Brandt in California, USA Santa Cruz university storage system research centre in 2003 propose, in the hierarchical directory structure that keeps metadata, the position that the cryptographic hash of use Hash function calculation pathname determines to deposit file metadata; Aspect the authority visit of file, management is distinguished in the access authorization of file and the access authorization of catalogue, improved the performance of operations such as change access authorization.But since the access authorization of file not distributed and saved in access path in all catalogues and the file, after the access rights of the some catalogues of change, all sub-directories under this catalogue of need renewal and the access rights of file can cause the conforming problem of metadata in addition.The people such as Su Yong of Central China University of Science and Technology in 2007 propose metadata sharing storage pool management algorithm.Make up shared storage pool by network memory, metadata adopts the Hash function to distribute, and can avoid existing bottleneck problem when certain catalogue becomes the visit focus.But exist the Hash function to determine difficulty, problems such as bad adaptability.
The specificity analysis of metadata management in the mass storage system (MSS)
Usually with the metadata and the data separate storage of file, data are kept in the memory device in the mass storage system (MSS), and metadata comprises the information such as memory location of attribute, access authorization and the data of file, is managed by special meta data server.Main frame at first sends request to meta data server after the request that receives user accesses data, according to the data address information that meta data server returns, visit corresponding memory device.Meta data server need be finished searching of metadata, relatively sequence of operations such as access authorization information and extraction data address.Also have many users' request of access only need handle in addition, as the operation that renames, moves, revises attribute (attributes such as file size, the owner, creation-time and modification time) of file to metadata.
1, the unique identification of metadata
In order to solve the problem that file is born the same name, it is not enough only using filename to search metadata, also needs the information such as access path of file.In addition, when the metadata of access file, the metadata of being not only this document that need search, the metadata of all catalogues on this document access path in addition.
2, search the efficient of metadata
Adopt the metadata of hierarchical structure to organize mode before a certain file of visit, need to visit successively, layer by layer all catalogues on this document access path, be difficult to find quickly and easily certain file.
3, different metadata management requirement
Attribute type and number that different files and catalogue need be preserved have nothing in common with each other, and in the conventional metadata management algorithm, use single form to preserve the metadata of file and catalogue, have problems such as redundancy, very flexible.
4, catalogue and file is related
Catalogue is as the special file of a class in the mass storage system (MSS), and is different with general file, preserved affiliated file and the sub-directory information of catalogue, also preserved the hierarchical information between catalogue and the file, adopts text to preserve in the traditional file systems.
Summary of the invention
The objective of the invention is to solve in the mass storage system (MSS) problems such as the existing time and space expense of metadata management method is big, very flexible, a kind of method of high-efficiency management metadata is provided, and makes up a kind of meta data server that is used for mass storage system (MSS)
The technical scheme that realizes the object of the invention is that a kind of metadata management method based on DBMS comprises the following steps: 1), in meta data server, set up the metadata database system; 2), meta data server receives the metadata search request; 3), the request of meta data server metadata about transformation, search metadata; 4, meta data server returns metadata; Described step 1) specifically comprises: 1.1) set up DBMS (data base management system (DBMS)) in meta data server; 1.2) on the DBMS basis with bivariate table basic organization metadata, set up to preserve the metadata management system of mass storage system (MSS) metadata; Metadata about transformation request mode in the described step 3) is for to be converted to SQL statement with metadata operation.
Described step 1.2) specifically can comprise the following steps:
In the metadata database system, set up five bivariate table: File tables, File-Attribute table, Allocation table, Authorization table and Affiliation table; Wherein,
The File table is preserved the essential information of file and catalogue, and ID is the unique identification of file or catalogue, and PathName is the access path and the filename of file or catalogue, and DPID is the sign of this document upper directory.
Table 1File table
Figure GSA00000049879100031
The File-Attribute table is preserved the attribute of file and catalogue, ID is the unique identification of file or catalogue, AttributeName be file the name of corresponding attribute, AttributeValue is the pairing value of each attribute of file, AttributeType is the type of file attribute.This moment, the file all properties was all preserved with the form of character string, was converted to its corresponding type in use again.
Table 2File-Attribute table
The Allocation table is preserved the data block information at data place in the file, and ID is the unique identification of file, and SegmentID is the sign of data place data block in the file.
Table 3Allocation table
The Authorization table is preserved the information of file and directory access mandate, and ID is the unique identification of file or catalogue, and AC is the access authorization of file or catalogue.
Table 4Authorization table
Figure GSA00000049879100042
The Affiliation table is preserved the affiliated relation between file and catalogue and all upper directory, and ID is the unique identification of file and catalogue, and PID is all upper directory signs of file or catalogue.
Table 5Affiliation table
Figure GSA00000049879100043
Described step 3) more specifically can comprise the following steps:
(3.1) the required metadata operation requirement of finishing is decomposed in analysis of metadata request;
(3.2) according to the required metadata operation requirement of finishing, the SQL statement of generating run metadata database.
The present invention installs DBMS software in meta data server, be configured for preserving and managing the metadata database of metadata in the mass storage system (MSS), make up novel meta data server, reduce the required time and space expense of management of metadata in the mass storage system (MSS), improve the dirigibility of management of metadata.
The device of realizing the object of the invention is as follows:
A kind of meta data server based on DBMS, comprise and receive metadata request device, metadata about transformation request unit and return the metadata device, also be provided with the metadata database system in the described meta data server, the metadata that is used for preserving and managing mass storage system (MSS); Described metadata about transformation request unit is used for metadata request is converted to the SQL statement of Operand data database.
Described metadata database system specifically can comprise following modules:
DBMS (data base management system (DBMS)) module is used for foundation, operation and maintenance metadata database system;
The metadata database module is used for setting up File, File-Attribute, Allocation, Authorization and five bivariate tables of Affiliation in the DBMS module, preserves the metadata in the mass storage system (MSS).
Described metadata about transformation request unit specifically can comprise following modules:
The analysis of metadata request module: the analysis of metadata request, decompose the required metadata operation of finishing of acquisition.
The SQL statement module of generating run metadata database: based on the result of analysis of metadata request, decompose the required metadata operation of finishing of acquisition, construct and finish the required SQL statement of metadata request.
The present invention installs DBMS software in meta data server, make up novel meta data server, be used for preserving and managing the metadata database of mass storage system (MSS) metadata, reach the purpose that reduces the required time and space expense of management of metadata, raising dirigibility.
Beneficial effect of the present invention is:
1, uses DBMS to make up the meta data server of preserving mass storage system (MSS), can utilize efficient height that DBMS has, be convenient to characteristic such as expansion, improve the performance of management of metadata, the dirigibility of enhancing management of metadata.
2, use a plurality of bivariate tables to preserve metadata information, subordinate relation is converted to getting in touch between the tuple between the file of original layer aggregated(particle) structure and the catalogue.A plurality of index have been set up respectively at File table, File-Attribute table, Allocation table, Authorization table and Affiliation table in addition, changed the method that needs catalogues at different levels in the traversal access path, reduced effectively and searched the required time and space expense of metadata.
3, to inquire about more convenient bivariate table structure preservation file and the relation between the catalogue, preserved the hierarchical structure between file and the catalogue, when operational orders such as execution directory listing, only need the File table is carried out twice inquiry, required time and space expense is little, can change operational order required time and the excessive problems of space expense such as carrying out directory listing effectively.
4, when access file, only need check the access authorization of file and parent directory, avoid required plenty of time and the space expense of each catalogue in the traversal access path.Only need revise the access authorization information of sub-directory when revising the access authorization of catalogue, required time and space expense is little.
5, preserve the attribute information of file by the File-Attribute table, tuple in each attribute corresponding tables of file, the attribute number of different files, type etc. can have nothing in common with each other, and have realized the dirigibility of management document attribute.
6, the subordinate relation between file and the catalogue only need be revised the low volume data item in the bivariate table by related expression the between the tuple when move, and required time and space expense is little.
Description of drawings
The structural drawing of Fig. 1 embodiment of the invention 1 meta data server
The structural drawing of Fig. 2 metadata database
Embodiment
Embodiment 1
As shown in Figure 1, a kind of meta data server based on DBMS comprises the metadata database system, receives metadata request device, metadata about transformation request unit and returns the metadata device.The metadata database system is used for preserving and managing the metadata of mass storage system (MSS), receive the metadata request device and be used to receive the metadata request that main frame sends, the metadata about transformation request unit is used for metadata request is converted to the SQL statement of Operand data database, returns the metadata device and is used for the operating result to metadata is returned to main frame.
The method of metadata is organized, revises and searched to present embodiment on the basis of existing meta data server, increase metadata database system and metadata about transformation request unit, constitutes the meta data server that is used for mass storage system (MSS) of the present invention.
The structure of metadata database system comprises as shown in Figure 2: DBMS module and metadata database module.
The explanation of each function is as shown in table 1 in the metadata database system.
Functional module in the table 1 metadata database system
The module title Effect
The DBMS module DBMS software is installed in meta data server, is used for realizing preserving and managing the function of mass storage system (MSS) metadata.
The metadata database module In the DBMS module, set up File, File-Attribute, Allocation, Authorization and five bivariate tables of Affiliation, the metadata that is used for preserving mass storage system (MSS).
Embodiment 2
As shown in Figure 2, a kind of metadata management method based on DBMS comprises the following steps:
1, sets up the database of preserving metadata, organize metadata with bivariate table; 2, receive metadata request, 3, the metadata about transformation request; 4, return metadata; Wherein organizing metadata step and metadata about transformation request step with bivariate table is the key that is different from existing metadata management method.
Step 1 specifically can comprise following flow process:
(1) DBMS software is installed in meta data server, is set up the Database Systems of preserving the mass storage system (MSS) metadata.
(2) set up the File table in database: preserve the essential information of file and catalogue, ID is the unique identification of file or catalogue, and PathName is the access path and the filename of file or catalogue, and DPID is the sign of this document upper directory.
(3) in database, set up the File-Attribute table: the attribute of preserving file and catalogue, ID is the unique identification of file or catalogue, AttributeName be file the name of corresponding attribute, AttributeValue is the pairing value of each attribute of file, and AttributeType is the type of file attribute.This moment, the file all properties was all preserved with the form of character string, was converted to its corresponding type in use again.
(4) be based upon in database and set up Allocation table in the database: preserve the data block information at data place in the file, ID is the unique identification of file, and SegmentID is the sign of data place data block in the file.
(5) set up the Authorization table in database: preserve the information of file and directory access mandate, ID is the unique identification of file or catalogue, and AC is the access authorization of file or catalogue.
(6) set up the Affiliation table in database: preserve the affiliated relation between file and catalogue and all upper directory, ID is the unique identification of file and catalogue, and PID is all upper directory signs of file or catalogue.
The metadata about transformation request step specifically can comprise following flow process:
(1) analysis of metadata request: the analysis of metadata request is decomposed into the one group of metadata operation requirement that need finish with it.
(2) generate SQL statement: according to the required group metadata operation requirement of finishing, the SQL statement of generating run metadata database.
Provide the metadata request of several type specieses below, provide the method for analyzing and generating SQL statement.
Directory operation:
File and subordinate relation between the catalogue lie in the File table in related between the tuple, have comprised the access path of All Files and catalogue and the information of parent directory in the File table, only need to inquire about the File table when therefore handling directory listing; At first the directory access path of directory content being tabulated according to user's needs is made as dp_name, search the pairing sign of this catalogue id, search the DPID tuple identical in the File table according to the catalogue sign id that obtains again, can obtain the contents list of this catalogue with it.Corresponding SQL query statement is as follows:
SELECT?PathName
FROM?File
WHERE?DPID=(SELECT?ID
FROM?File
WHERE?PathName=dp_name)
When handling the operational order of revising directory attribute, need inquiry File table and File-Attribute table.At first obtain catalogue sign id, upgrade the attribute of this catalogue in the File-Attribute table again according to access path inquiry File table.As upgrade the directory access path be the modification time of dp_name for (obtaining) now by the now function, then Dui Ying SQL statement is as follows:
UPDATE?File-Attribute
SET?AttributeValue=now()
WHERE?AttributeName=‘ModifyTime’and?ID=(SELECT?ID
FROM?File
WHERE?PathName=dp_name)
File operation:
When creating file, at first in the File table, insert a tuple, the information such as sign of the access path of log file, sign and parent directory; Each attribute with file is inserted in the File-Attribute table as a tuple again; According to the access path of file, each upper directory of file is inserted in the Affiliation table as a tuple; With the data block information at file data place, be inserted in the Allocation table at last as a tuple.The work of being done during deleted file is opposite with the establishment file.
Set up the index of preserving the metadata bivariate table, and utilize the file access path to dwindle the scope of searching, reduce the required time and space expense of locating file.When the complete access path of known file, can utilize index to obtain the sign of file fast with access path as keyword query File table.When search file under a certain catalogue, can at first search the sign that the File table obtains this catalogue, search the pid value tuple identical in the Affiliation table again, thereby obtain the sign of required file fast with it.
During move, only need to revise the value of PathName in the File table, replace with new access path.During xcopy, then at first in File table, File-Attribute table, Affiliation table and Allocation table, search and need the pairing tuple of xcopy, add to again in the corresponding table after substituting with new file identification and access path.
The operation of file attribute:
Attribute number, type that files in different types need be preserved have nothing in common with each other, and an attribute of each certain file of element group representation in the File-Attribute table does not limit the number and the type of file attribute, thereby satisfies the requirement of preserving file attribute flexibly.
During the attribute of inquiry file, at first inquire about the sign that the File table obtains file, use file identification inquiry File-Attribute table then, obtain the attribute of file.
When adding file attribute, file identification, attribute-name, property value and attribute type are added in the File-Attribute table as a tuple.
During the revised file property value, in the File-Attribute table, search corresponding tuple, new property value is write in the AttributeValue field.During the attribute of deleted file, it is identical with file identification to search in the File-Attribute table ID value, and the AttributeName tuple identical with the attribute-name that will delete.
The operation of access authorization:
When access file, search the access authorization of this document and parent directory in the Authorization table, compare, as inequality, then with the access authorization of parent directory as new access authorization value, and upgrade the value of AC field in this document tuple.
After the access authorization of revising catalogue, search all sub-directories under this catalogue, upgrade corresponding tuple in the Authorization table with new access authorization.

Claims (6)

1. the metadata management method based on DBMS comprises the following steps: 1) in meta data server, set up the metadata database system; 2) meta data server receives the metadata search request; 3) metadata is searched in the request of meta data server metadata about transformation; 4) meta data server returns metadata; Described step 1) specifically comprises: 1.1) set up DBMS in meta data server; 1.2) on the DBMS basis, organize metadata with bivariate table, set up the metadata database system that preserves the mass storage system (MSS) metadata; Metadata about transformation request mode in the described step 3) is for to be converted to SQL statement with metadata operation.
2. metadata management method according to claim 1 is characterized in that, described step 1.2) specifically can comprise the following steps:
In the metadata database system, set up five bivariate table: File tables, File-Attribute table, Allocation table, Authorization table and Affiliation table; Wherein,
The File table is preserved the essential information of file and catalogue, and ID is the unique identification of file or catalogue, and PathName is the access path and the filename of file or catalogue, and DPID is the sign of this document upper directory;
The File-Attribute table is preserved the attribute of file and catalogue, ID is the unique identification of file or catalogue, AttributeName be file the name of corresponding attribute, AttributeValue is the pairing value of each attribute of file, AttributeType is the type of file attribute.This moment, the file all properties was all preserved with the form of character string, was converted to its corresponding type in use again;
The Allocation table is preserved the data block information at data place in the file, and ID is the unique identification of file, and SegmentID is the sign of data place data block in the file;
The Authorization table is preserved the information of file and directory access mandate, and ID is the unique identification of file or catalogue, and AC is the access authorization of file or catalogue;
The Affiliation table is preserved the affiliated relation between file and catalogue and all upper directory, and ID is the unique identification of file and catalogue, and PID is all upper directory signs of file or catalogue.
3. metadata management method according to claim 1 is characterized in that described step 3) more specifically can comprise the following steps:
(3.1) the required metadata operation requirement of finishing is decomposed in analysis of metadata request;
(3.2) according to the required metadata operation requirement of finishing, the SQL statement of generating run metadata database.
4. meta data server based on DBMS, comprise and receive metadata request device, metadata about transformation request unit and return the metadata device, it is characterized in that, also be provided with metadata database system, the metadata that is used for preserving and managing mass storage system (MSS) in the described meta data server; Described metadata about transformation request unit is used for metadata request is converted to the SQL statement of Operand data database.
5. according to the described meta data server of claim 4, it is characterized in that described metadata database system specifically can comprise following modules:
DBMS (data base management system (DBMS)) module is used for foundation, operation and maintenance metadata database system;
The metadata database module is used for setting up File, File-Attribute, Allocation, Authorization and five bivariate tables of Affiliation in the DBMS module, preserves the metadata in the mass storage system (MSS).
6. according to the described meta data server of claim 4, it is characterized in that described metadata about transformation request unit specifically can comprise following modules:
The analysis of metadata request module: the analysis of metadata request, decompose the required metadata operation of finishing of acquisition;
The SQL statement module of generating run metadata database: based on the result of analysis of metadata request, decompose the required metadata operation of finishing of acquisition, construct and finish the required SQL statement of metadata request.
CN 201010124079 2010-03-15 2010-03-15 Metadata management method based on DBMS and metadata server Pending CN101789027A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN 201010124079 CN101789027A (en) 2010-03-15 2010-03-15 Metadata management method based on DBMS and metadata server

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN 201010124079 CN101789027A (en) 2010-03-15 2010-03-15 Metadata management method based on DBMS and metadata server

Publications (1)

Publication Number Publication Date
CN101789027A true CN101789027A (en) 2010-07-28

Family

ID=42532241

Family Applications (1)

Application Number Title Priority Date Filing Date
CN 201010124079 Pending CN101789027A (en) 2010-03-15 2010-03-15 Metadata management method based on DBMS and metadata server

Country Status (1)

Country Link
CN (1) CN101789027A (en)

Cited By (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102419775A (en) * 2011-12-22 2012-04-18 厦门雅迅网络股份有限公司 Method for storing and retrieving massive small files
CN103186653A (en) * 2011-12-30 2013-07-03 国际商业机器公司 Method and equipment for assistance inquiry, method and equipment for inquiry, and named query system
CN106682064A (en) * 2016-11-03 2017-05-17 用友网络科技股份有限公司 Number picking device and method for enterprise report
CN106960011A (en) * 2017-02-28 2017-07-18 无锡紫光存储系统有限公司 Metadata of distributed type file system management system and method
CN107341110A (en) * 2017-07-11 2017-11-10 浪潮软件集团有限公司 Tool for modifying and affecting range of software test positioning patch and implementation method
CN107547648A (en) * 2017-08-31 2018-01-05 郑州云海信息技术有限公司 A kind of internal data clone method and device
CN108319645A (en) * 2017-12-25 2018-07-24 中国科学院信息工程研究所 Multi version file view management method and device under a kind of isomery storage environment
CN109766686A (en) * 2018-04-25 2019-05-17 新华三大数据技术有限公司 Rights management
WO2021142768A1 (en) * 2020-01-17 2021-07-22 华为技术有限公司 Method and apparatus for cloning file system
KR102499941B1 (en) * 2022-10-12 2023-02-16 비코어(주) System for providing DBMS based on storage and control method thereof

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1517906A (en) * 2003-01-14 2004-08-04 联想(北京)有限公司 Document system and document management method
CN1547137A (en) * 2003-12-02 2004-11-17 中国科学院计算技术研究所 Mass file management system and method based on database
CN1588369A (en) * 2004-09-06 2005-03-02 杭州恒生电子股份有限公司 Relation type data base system and its search and report method
CN101226540A (en) * 2008-02-01 2008-07-23 中国建设银行股份有限公司 Method and device for dynamic construction of guideline code

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1517906A (en) * 2003-01-14 2004-08-04 联想(北京)有限公司 Document system and document management method
CN1547137A (en) * 2003-12-02 2004-11-17 中国科学院计算技术研究所 Mass file management system and method based on database
CN1588369A (en) * 2004-09-06 2005-03-02 杭州恒生电子股份有限公司 Relation type data base system and its search and report method
CN101226540A (en) * 2008-02-01 2008-07-23 中国建设银行股份有限公司 Method and device for dynamic construction of guideline code

Cited By (15)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102419775A (en) * 2011-12-22 2012-04-18 厦门雅迅网络股份有限公司 Method for storing and retrieving massive small files
CN103186653A (en) * 2011-12-30 2013-07-03 国际商业机器公司 Method and equipment for assistance inquiry, method and equipment for inquiry, and named query system
CN103186653B (en) * 2011-12-30 2016-04-13 国际商业机器公司 Nonproductive poll method and apparatus, querying method and equipment and name inquiry system
US9811554B2 (en) 2011-12-30 2017-11-07 International Business Machines Corporation Assisting query and querying
CN106682064B (en) * 2016-11-03 2020-02-11 用友网络科技股份有限公司 Data acquisition device and method for enterprise report
CN106682064A (en) * 2016-11-03 2017-05-17 用友网络科技股份有限公司 Number picking device and method for enterprise report
CN106960011A (en) * 2017-02-28 2017-07-18 无锡紫光存储系统有限公司 Metadata of distributed type file system management system and method
CN107341110A (en) * 2017-07-11 2017-11-10 浪潮软件集团有限公司 Tool for modifying and affecting range of software test positioning patch and implementation method
CN107341110B (en) * 2017-07-11 2020-01-07 浪潮软件集团有限公司 Tool for modifying and affecting range of software test positioning patch and implementation method
CN107547648A (en) * 2017-08-31 2018-01-05 郑州云海信息技术有限公司 A kind of internal data clone method and device
CN108319645A (en) * 2017-12-25 2018-07-24 中国科学院信息工程研究所 Multi version file view management method and device under a kind of isomery storage environment
CN108319645B (en) * 2017-12-25 2022-09-16 中国科学院信息工程研究所 Multi-version file view management method and device in heterogeneous storage environment
CN109766686A (en) * 2018-04-25 2019-05-17 新华三大数据技术有限公司 Rights management
WO2021142768A1 (en) * 2020-01-17 2021-07-22 华为技术有限公司 Method and apparatus for cloning file system
KR102499941B1 (en) * 2022-10-12 2023-02-16 비코어(주) System for providing DBMS based on storage and control method thereof

Similar Documents

Publication Publication Date Title
CN101789027A (en) Metadata management method based on DBMS and metadata server
Meier et al. Nosql databases
EP3026578B1 (en) N-bit compressed versioned column data array for in-memory columnar stores
US9286336B2 (en) Unified architecture for hybrid database storage using fragments
CN1938701B (en) Metadata based prefetching
US9009439B2 (en) On-disk operations on fragments to support huge data sizes
CN101158958B (en) Fusion enquire method based on MySQL storage engines
CN101944134B (en) Metadata server of mass storage system and metadata indexing method
US20220083618A1 (en) Method And System For Scalable Search Using MicroService And Cloud Based Search With Records Indexes
CN101876983A (en) Method for partitioning database and system thereof
US20140279962A1 (en) Consolidation for updated/deleted records in old fragments
Terrovitis et al. Efficient answering of set containment queries for skewed item distributions
Das et al. A study on big data integration with data warehouse
CN1845093A (en) Attribute extensible object file system
EP2778964B1 (en) Hierarchical indices
Weintraub et al. Needle in a haystack queries in cloud data lakes.
Lu et al. Hybrid storage architecture and efficient MapReduce processing for unstructured data
CN103218433A (en) Method and module for managing metadata applied to random access
Liu et al. Using provenance to efficiently improve metadata searching performance in storage systems
Xu et al. Enhancing HDFS with a full-text search system for massive small files
Barkhordari et al. Atrak: a MapReduce-based data warehouse for big data
Rammer et al. Atlas: A distributed file system for spatiotemporal data
CN102521383A (en) Method for storing and accessing mass files in distributed system
Ptiček et al. Big data and new data warehousing approaches
Mondal et al. Efficient indexing of top-k entities in systems of engagement with extensions for geo-tagged entities

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
C12 Rejection of a patent application after its publication
RJ01 Rejection of invention patent application after publication

Open date: 20100728