CN105069091B - A kind of Virtual File System and its implementation based on HBASE - Google Patents

A kind of Virtual File System and its implementation based on HBASE Download PDF

Info

Publication number
CN105069091B
CN105069091B CN201510473964.2A CN201510473964A CN105069091B CN 105069091 B CN105069091 B CN 105069091B CN 201510473964 A CN201510473964 A CN 201510473964A CN 105069091 B CN105069091 B CN 105069091B
Authority
CN
China
Prior art keywords
file
hbase
catalogue
module
distributed memory
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201510473964.2A
Other languages
Chinese (zh)
Other versions
CN105069091A (en
Inventor
王敏
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Beijing Si Tech Information Technology Co Ltd
Original Assignee
Beijing Si Tech Information Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Beijing Si Tech Information Technology Co Ltd filed Critical Beijing Si Tech Information Technology Co Ltd
Priority to CN201510473964.2A priority Critical patent/CN105069091B/en
Publication of CN105069091A publication Critical patent/CN105069091A/en
Application granted granted Critical
Publication of CN105069091B publication Critical patent/CN105069091B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/10File systems; File servers
    • G06F16/16File or folder operations, e.g. details of user interfaces specifically adapted to file systems
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/10File systems; File servers
    • G06F16/18File system types
    • G06F16/182Distributed file systems
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/10File systems; File servers
    • G06F16/18File system types
    • G06F16/188Virtual file systems

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Data Mining & Analysis (AREA)
  • Databases & Information Systems (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Human Computer Interaction (AREA)
  • Information Retrieval, Db Structures And Fs Structures Therefor (AREA)

Abstract

The present invention relates to a kind of Virtual File System and its implementation based on HBASE, wherein method include:Step 1:Initialization is carried out to Virtual File System with distributed memory library to connect;Step 2:Open catalogue, by under catalogue All Files and subdirectory be loaded into memory;Step 3:Catalogue is read, the All Files being loaded into memory and subdirectory are sequentially returned successively;Step 4:File in distributed memory library is opened, data is read from being obtained in HBASE or stores data into HBASE;Step 5:Execute file close operation;Step 6:Catalogue is closed, is terminated.The present invention solves in big data storing process, when carrying out big data storage using HBASE, the problem of needing significantly to change date storage method.Reduce the influence that operation layer changes data storage layer so that operation system is more convenient by the change of traditional file systems memory module to big data memory module.

Description

A kind of Virtual File System and its implementation based on HBASE
Technical field
The present invention relates to a kind of Virtual File System and its implementation based on HBASE.
Background technology
With the arrival in big data epoch, quick response mass memory becomes the main feature of data storage scheme.Then HBASE based on distributed structure/architecture rapidly becomes the preferred embodiment of big data storage, but is arrived carrying out traditional file systems In HBASE file system migration process, the change of data storage principle becomes one and unavoidable assaults fortified position a little.
Invention content
Technical problem to be solved by the invention is to provide one kind to solve in big data storing process, using HBASE into Row big data store when, need to date storage method carry out significantly change the problem of virtual text of the use based on HBASE Part system and its implementation.
The data storage characteristics of present invention combination traditional file systems and HBASE file system, use distributed memory library As secondary storage medium storage file grade directory index traditional file system is simulated using HBASE storage file data contents The file read-write operations of system effectively reduce during data migration, the shadow that business changes data storage layer medium It rings.
The technical solution that the present invention solves above-mentioned technical problem is as follows:A kind of reality of the Virtual File System based on HBASE Existing method, specifically includes following steps:
Step 1:Initialization is carried out to Virtual File System with distributed memory library to connect;
Step 2:Catalogue is opened, reads the directory information stored in distributed memory library, and by the All Files under catalogue And subdirectory is loaded into memory;
Step 3:Catalogue is read, and the All Files being loaded into memory and subdirectory are sequentially returned successively;
Step 4:The file in distributed memory library is opened, data are read from HBASE or stores data into HBASE In;
Step 5:Execute file close operation;
Step 6:Catalogue is closed, is terminated.
The beneficial effects of the invention are as follows:The present invention solves in big data storing process, and carrying out big data using HBASE deposits Chu Shi, the problem of needing significantly to change date storage method.It is virtual using distributed memory database and HBASE Traditional file system reduces the influence that operation layer changes data storage layer so that operation system is by traditional file system The change for memory module to the big data memory module of uniting is more convenient.
Based on the above technical solution, the present invention can also be improved as follows.
Further, the step 4 specifically includes following steps:
Step 4.1:Judge whether current operation is read mode, if so, executing step 4.2;Otherwise, step is executed 4.4;
Step 4.2:The corresponding unique I D of locating file from distributed memory library open scanner, are generated using this ID Rowkey prefixes carry out HBASE table scans, obtain scan data;
Step 4.3:Scan data is read, step 5 is executed;
Step 4.4:It is currently write mode, unique I D is generated to data in distributed memory library, and carry out HBASE Table handling is opened, the I D for controlling generation generate corresponding rowkey prefixes;
Step 4.5:By additional index after rowkey prefixes, indexed as rowkey with this, it will by keyword of file record In data storage to HBASE, step 5 is executed.
Further, the step 5 specifically includes following steps:
Step 5.1:Whether judgment step 4 executes read mode, if so, executing step 5.2;Otherwise, step is executed 5.3;
Step 5.2:The scanner opened in step 4.2 is closed, step 6 is executed;
Step 5.3:Refresh interface is called, HBASE is carried out and operation, assuring data security is submitted to execute step 6.
Further, the index relative of file and catalogue is stored in distributed memory library in the step 1, virtual file system System can obtain corresponding directory index relationship after establishing connection with distributed memory library.
Further, when opening catalogue in the step 2, pair for reading catalogue and file index in distributed memory library is needed It should be related to, search the All Files and subdirectory under current directory.
Further, when carrying out file reading in the step 4.2, the state letter for reading file in distributed memory library is needed Breath, and file data record is obtained from HBASE.
Further, it when carrying out file deletion, needs to change corresponding file status information in distributed memory library, makes it be Invalid state is subsequently carried out the delete operation of corresponding data in HBASE by auxiliary tool, avoids the efficiency that data are directly deleted Problem.
The technical solution that the present invention solves above-mentioned technical problem is as follows:A kind of Virtual File System based on HBASE, including Link block, catalogue open module, catalogue read module, File Open module, closing of a file module and catalogue closedown module;
The link block is connected for carrying out initialization with distributed memory library to Virtual File System;
The catalogue opens module and is used to open catalogue, reads the directory information stored in distributed memory library, and by mesh All Files and subdirectory under record are loaded into memory;
The catalogue read module for reading catalogue, and by the All Files and subdirectory that are loaded into memory sequentially according to Secondary return distributed memory library;
The File Open module is used to open the file in distributed memory library, and data are read from HABSE or will be counted According in storage to HBASE;
The closing of a file module is for executing file close operation;
The catalogue closedown module terminates for closing catalogue.
Based on the above technical solution, the present invention can also be improved as follows.
Further, the File Open module includes mode deciding module, read module and writing module;
The mode deciding module is for judging whether current operation is read mode, if so, triggering read module;It is no Then, writing module is triggered;
The read module is used for the corresponding unique ID of locating file from distributed memory library, opens scanner, utilizes This ID generates rowkey prefixes and carries out HBASE table scans, obtains scan data;Read scan data;
Said write module is used to generate unique ID to data in distributed memory library, and carries out HBASE opening tables behaviour Make, the ID for controlling generation generates corresponding rowkey prefixes;By additional index after rowkey prefixes, indexed as rowkey with this, It is stored data into HBASE by keyword of file record.
Further, it when the catalogue opens opening catalogue in module, needs to read catalogue and file in distributed memory library The correspondence of index searches All Files and subdirectory under current directory.
Further, when carrying out file reading in the read module, the state for reading file in distributed memory library is needed Information, and file data record is obtained from HBASE.
Further, it when carrying out file deletion, needs to change corresponding file status information in distributed memory library, makes it be Invalid state is subsequently carried out the delete operation of corresponding data in HBASE by auxiliary tool.
Traditional file systems form unique file path with file directory and file name, are based on HBASE virtual files The implementation method of system, using distributed memory library as file path and the storage medium of index, in HBASE with rowkey, Unique record of row cluster, row name, value mark specified files.
Based on HBASE Virtual File Systems, it is necessary first in a distributed manner memory bank as file directory and file name and The storage medium of index, least unit are file, the unique index of each file or catalogue pair one, the relationship of catalogue and file It is stored in the form of recursive in distributed memory library.
Based on HBASE Virtual File Systems, next corresponding data of file is stored in HBASE, and least unit is record, The organizational form of rowkey is " file unique index inverted order " plus record unique index, is convenient for the read-write of file.
Based on HBASE Virtual File Systems, the read-write interface similar to traditional file systems is again provided, including catalogue Operation and file operation, interface parameters and return value meaning are essentially identical with traditional file systems, reduce operation layer for number The change called according to storage method and interface.
The main thought of the present invention is:The characteristics of storing data in conjunction with traditional file systems and HBASE file system, leads to Cross the use of design and distributed memory library to the rowkey and value of HBASE data, the data of virtual traditional file systems Storage mode, provide the file operations such as sopen (File Open), swrite (data write-in), sclose (closing of a file) and Smkdir (createing directory), sopendir (opening catalogue), sreaddir (reading catalogue), sclosedir (closing catalogue) etc. Directory operation.Simultaneously by data according in the form storage to HBASE of key-value.Service application is reduced to the greatest extent for data Layer storage medium change perception, while based on Virtual File System the characteristics of, the querying method of Virtual File System is provided, from And realize when carrying out different file system data inquiries, inquire the consistency of principle.
Description of the drawings
Fig. 1 is a kind of implementation method flow chart of Virtual File System based on HBASE described in the embodiment of the present invention;
Fig. 2 is a kind of structure diagram of Virtual File System based on HBASE described in the embodiment of the present invention
In attached drawing, parts list represented by the reference numerals are as follows:
1, link block, 2, catalogue open module, 3, catalogue read module, 4, File Open module, 5, closing of a file mould Block, 6, catalogue closedown module, 41, mode deciding module, 42, read module, 43, writing module.
Specific implementation mode
The principle and features of the present invention will be described below with reference to the accompanying drawings, and the given examples are served only to explain the present invention, and It is non-to be used to limit the scope of the present invention.
As shown in Figure 1, for a kind of implementation method of Virtual File System based on HBASE described in the embodiment of the present invention, Specifically include following steps:
Step 1:Initialization is carried out to Virtual File System with distributed memory library to connect;
Step 2:Catalogue is opened, reads the directory information stored in distributed memory library, and by the All Files under catalogue And subdirectory is loaded into memory;
Step 3:Catalogue is read, and the All Files being loaded into memory and subdirectory are sequentially returned successively;
Step 4:Judge whether current operation is read mode, if so, executing step 5;Otherwise, step 7 is executed;
Step 5:The corresponding unique ID of locating file from distributed memory library opens scanner, is generated using this ID Rowkey prefixes carry out HBASE table scans, obtain scan data;
Step 6:Scan data is read, step 9 is executed;
Step 7:It is currently write mode, unique ID is generated to data in distributed memory library, and carry out HBASE openings Table handling, the ID for controlling generation generate corresponding rowkey prefixes;
Step 8:By additional index after rowkey prefixes, is indexed as rowkey with this, will be counted by keyword of file record According in storage to HBASE, step 9 is executed;
Step 9:Execute file close operation;
Step 10:Catalogue is closed, is terminated.
The step 9 specifically includes following steps:
Step 9:Whether judgment step 4 executes read mode, if so, executing step 9.2;Otherwise, step 9.3 is executed;
Step 9.2:The scanner opened in step 5 is closed, step 10 is executed;
Step 9.3:Refresh interface is called, HBASE is carried out and operation, assuring data security is submitted to execute step 10.
When opening catalogue in the step 2, the correspondence for reading catalogue and file index in distributed memory library is needed, Search the All Files and subdirectory under current directory.
When carrying out file reading in the step 5, the status information for reading file in distributed memory library is needed, and from File data record is obtained in HBASE.
It when carrying out file deletion, needs to change corresponding file status information in distributed memory library, it is invalid shape to make it State is subsequently carried out the delete operation of corresponding data in HBASE by auxiliary tool.
As shown in Fig. 2, for a kind of Virtual File System based on HBASE described in the embodiment of the present invention, including connection mould Block 1, catalogue open module 2, catalogue read module 3, File Open module 4, closing of a file module 5 and catalogue closedown module 6;
The link block 1 is connected for carrying out initialization with distributed memory library to Virtual File System;
The catalogue opens module 2 and is used to open catalogue, reads the directory information stored in distributed memory library, and by mesh All Files and subdirectory under record are loaded into memory;
The catalogue read module 3 is used to read catalogue, and sequentially by the All Files and subdirectory that are loaded into memory Distributed memory library is returned to successively;
The File Open module 4 is used to open the file in distributed memory library, and data are read from HBASE or will be counted According in storage to HBASE;
The closing of a file module 5 is for executing file close operation;
The catalogue closedown module 6 terminates for closing catalogue.
The File Open module 4 includes mode deciding module 41, read module 42 and writing module 43;
The mode deciding module 41 is for judging whether current operation is read mode, if so, triggering read module 42;Otherwise, writing module 43 is triggered;
The read module 42 is used for the corresponding unique ID of locating file from distributed memory library, opens scanner, profit Rowkey prefixes are generated with this ID and carry out HBASE table scans, obtain scan data;Read scan data;
Said write module 43 is used to generate unique ID to data in distributed memory library, and carries out HBASE opening tables Operation, the ID for controlling generation generate corresponding rowkey prefixes;By additional index after rowkey prefixes, is indexed with this and be Rowkey is stored data by keyword of file record in HBASE.
The catalogue is opened when opening catalogue in module 2, needs to read catalogue and file index in distributed memory library Correspondence searches All Files and subdirectory under current directory.
When carrying out file reading in the read module 42, the status information for reading file in distributed memory library is needed, And file data record is obtained from HBASE.
It when carrying out file deletion, needs to change corresponding file status information in distributed memory library, it is invalid shape to make it State is subsequently carried out the delete operation of corresponding data in HBASE by auxiliary tool.
HBASE file system is distributed file system, be first to HABSE files before using the storage of HBASE systems System carries out initialization connection.It, can be right in conjunction with the file and directory index relationship in distributed memory library after normal connection HBASE file system uses the file read/write method similar to traditional file systems to be operated.Operating process is as follows:
1. sinit is called to carry out the connection of distributed memory library and HBASE attended operations;
2. calling sopendir into column catalogue opening operation, need to read catalogue in distributed memory library in this operating process Information, and by under catalogue All Files and subdirectory be loaded into memory;
3. calling sreaddir into column catalogue read operation, this operating process needs the text being loaded into step 2 in memory Part and catalogue return successively in sequence;
4. sopen is called to carry out file open operation, this operating process includes both of which, and one kind is read mode, from The corresponding unique ID of locating file in distributed memory library, using this ID generate rowkey prefix carry out HBASE table scans, one Class is write mode, and unique ID is generated in distributed memory library, and carries out HBASE and open table handling;
5. sread is called to carry out File read operation, this operating process needs 4 read mode of read step to scan Data;
6. swrite is called to carry out file write operations, this operating process needs after the rowkey prefixes that step 4 generates Additional record indexes, and is that value is stored into HBASE with file record as rowkey;
7. sclose is called to carry out file close operation, this operating process then needs closing step 4 to beat if read mode The scanner opened then needs to call sflush interfaces if write mode, carries out HBASE and submits operation, guarantees data security Property;
8. calling sclosedir into column catalogue shutoff operation;
9. system discharges sdestroy.
The data storage characteristics of present invention combination traditional file systems and HBASE file system, in a distributed manner internal storage data Library is secondary storage medium, the storage relationship of file and catalogue is stored in distributed memory in a recursive manner, minimum is deposited Storage unit is file, single file or catalogue has unique ID to identify in distributed memory library, and single file or catalogue are being divided There are fileinfo state, file data to be stored in HBASE in cloth memory bank, minimum memory unit is record, rowkey's Organizational form is " file unique index inverted order " plus record unique index, and value is file data record.
Memory bank is secondary storage medium in a distributed manner, and the storage relationship of file-level catalogue is stored in point in a recursive manner In cloth memory bank;
Minimum memory unit is file in distributed memory, is had in single file or catalogue redistribution formula memory bank unique ID is identified;
File data record is stored in the form of key-value in HBASE, and minimum memory unit is record, rowkey Organizational form be " file unique index inverted order " plus record unique index, value be file data record;
When carrying out opening directory operation, the correspondence for reading catalogue and file index in distributed memory library is needed, is looked into Look for the All Files and catalogue under current directory;
When carrying out File read operation, the status information for reading file in distributed memory library is needed, and obtained from HBASE File data is taken to record;
When carrying out file write operations, the status information for reading file in distributed memory library is needed, and by file data HBASE is written, and updates the status information of file in distributed memory library;
In the case where file is write mode, needs to carry out sflush operations to HBASE write-ins end when closing file, ensure The integrality of HBASE data;
When carrying out file deletion, need to change corresponding file status information in distributed memory library, it is invalid to make it State is subsequently carried out the delete operation of corresponding data in HBASE by auxiliary tool.
It is the specific embodiment of the present invention below:
Operation layer needs that a file is read and stored into Virtual File System, it is assumed that the target directory of file be/ Test, source filename are known as test.txt, directory file name store.txt;
Initialization and the connection of HBASE file system and the connection of memory bank;
Sopendir is called to open the catalogue/test to be operated;
It calls sreaddir to read the file or directory information opened in catalogue, reads file by test.txt;
Sopen read modes are called to open file/test/test.txt;
Sopen write modes are called to open file/test/store.txt;
Call the data content in sread readings/test/test.txt;
Call swrite the content read is written to/test/store.txt in;
Sclose is called to close file/test/test.txt;
Sclose is called to close file/test/store.txt;
Call sclosedir shutoff operation catalogues;
Call sdestory release HBASE connections and memory bank connection;
After the completion of aforesaid operations call, there is/related the rope of test/store.txt this file in distributed memory library Fuse ceases and file status generates, and a batch record is stored in HBASE, these records belong to/test/store.txt.
The foregoing is merely presently preferred embodiments of the present invention, is not intended to limit the invention, it is all the present invention spirit and Within principle, any modification, equivalent replacement, improvement and so on should all be included in the protection scope of the present invention.

Claims (8)

1. a kind of implementation method of the Virtual File System based on HBASE, which is characterized in that specifically include following steps:
Step 1:Initialization is carried out to Virtual File System with distributed memory library to connect;
Step 2:Catalogue is opened, reads the directory information stored in distributed memory library, and by the All Files and son under catalogue Catalogue is loaded into memory;
Step 3:Catalogue is read, and the All Files being loaded into memory and subdirectory are sequentially returned successively;
Step 4:The file in distributed memory library is opened, reading data are obtained from HBASE or stores data into HBASE In;
Step 5:Execute file close operation;
Step 6:Catalogue is closed, is terminated;
Wherein, the step 4 specifically includes following steps:
Step 4.1:Judge whether current operation is read mode, if so, executing step 4.2;Otherwise, step 4.4 is executed;
Step 4.2:The corresponding unique ID of locating file from distributed memory library opens scanner, is generated using this ID Rowkey prefixes carry out HBASE table scans, obtain scan data;
Step 4.3:Scan data is read, step 5 is executed;
Step 4.4:It is currently write mode, unique ID is generated to data in distributed memory library, and carry out HBASE opening tables Operation, the ID for controlling generation generate corresponding rowkey prefixes;
Step 4.5:Will additional index after rowkey prefixes, indexed as rowkey with this, be keyword by data using file record It stores in HBASE, executes step 5.
2. a kind of implementation method of Virtual File System based on HBASE according to claim 1, which is characterized in that institute It states step 5 and specifically includes following steps:
Step 5.1:Whether judgment step 4 executes read mode, if so, executing step 5.2;Otherwise, step 5.3 is executed;
Step 5.2:The scanner opened in step 4.2 is closed, step 6 is executed;
Step 5.3:Refresh interface is called, HBASE is carried out and operation, assuring data security is submitted to execute step 6.
3. a kind of implementation method of Virtual File System based on HBASE according to claim 1, which is characterized in that institute It states the index relative of file and catalogue in step 1 to be stored in distributed memory library, Virtual File System and distributed memory library Corresponding directory index relationship can be obtained after establishing connection.
4. a kind of implementation method of Virtual File System based on HBASE according to claim 1, which is characterized in that institute When stating opening catalogue in step 2, the correspondence for reading catalogue and file index in distributed memory library is needed, current mesh is searched All Files and subdirectory under record.
5. a kind of implementation method of Virtual File System based on HBASE according to claim 1, which is characterized in that institute When stating progress file reading in step 4.2, the status information for reading file in distributed memory library is needed, and obtained from HBASE File data is taken to record.
6. according to a kind of implementation method of the Virtual File System based on HBASE of claim 1-5 any one of them, feature It is, when carrying out file deletion, need to change corresponding file status information in distributed memory library, it is invalid state to make it, The delete operation of corresponding data in HBASE is subsequently carried out by auxiliary tool.
7. a kind of Virtual File System based on HBASE, which is characterized in that open module including link block, catalogue, catalogue is read Modulus block, File Open module, closing of a file module and catalogue closedown module;
The link block is connected for carrying out initialization with distributed memory library to Virtual File System;
The catalogue opens module and is used to open catalogue, reads the directory information stored in distributed memory library, and will be under catalogue All Files and subdirectory be loaded into memory;
The catalogue read module sequentially returns the All Files being loaded into memory and subdirectory for reading catalogue successively Go back to distributed memory library;
The File Open module is used to open the file in distributed memory library, and data are read from HBASE or deposit data It stores up in HBASE;
The closing of a file module is for executing file close operation;
The catalogue closedown module terminates for closing catalogue;
Wherein, the File Open module includes mode deciding module, read module and writing module;
The mode deciding module is for judging whether current operation is read mode, if so, triggering read module;Otherwise, Trigger writing module;
The read module is used for the corresponding unique ID of locating file from distributed memory library, opens scanner, utilizes this ID It generates rowkey prefixes and carries out HBASE table scans, obtain scan data;Read scan data;
Said write module is used to generate unique ID to data in distributed memory library, and carries out HBASE and open table handling, control The ID that system generates generates corresponding rowkey prefixes;By additional index after rowkey prefixes, indexed for rowkey, with file with this Keyword is recorded as to store data into HBASE.
8. a kind of Virtual File System based on HBASE according to claim 7, which is characterized in that the catalogue is opened When opening catalogue in module, the correspondence for reading catalogue and file index in distributed memory library is needed, current directory is searched Under All Files and subdirectory;When carrying out file reading in the read module, need to read file in distributed memory library Status information, and from HBASE obtain file data record.
CN201510473964.2A 2015-08-05 2015-08-05 A kind of Virtual File System and its implementation based on HBASE Active CN105069091B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201510473964.2A CN105069091B (en) 2015-08-05 2015-08-05 A kind of Virtual File System and its implementation based on HBASE

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201510473964.2A CN105069091B (en) 2015-08-05 2015-08-05 A kind of Virtual File System and its implementation based on HBASE

Publications (2)

Publication Number Publication Date
CN105069091A CN105069091A (en) 2015-11-18
CN105069091B true CN105069091B (en) 2018-09-11

Family

ID=54498461

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201510473964.2A Active CN105069091B (en) 2015-08-05 2015-08-05 A kind of Virtual File System and its implementation based on HBASE

Country Status (1)

Country Link
CN (1) CN105069091B (en)

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110287201A (en) * 2019-07-02 2019-09-27 重庆紫光华山智安科技有限公司 Data access method, device, equipment and storage medium

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101398824A (en) * 2007-09-26 2009-04-01 新奥特硅谷视频技术有限责任公司 Method for implementing data storage by virtual file systems technology after processing
CN103116618A (en) * 2013-01-28 2013-05-22 南开大学 Telefile system mirror image method and system based on lasting caching of client-side
CN104462185A (en) * 2014-10-13 2015-03-25 南京邮电大学 Digital library cloud storage system based on mixed structure

Family Cites Families (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9218343B2 (en) * 2010-12-20 2015-12-22 International Business Machines Corporation Partition file system for virtual machine memory management

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101398824A (en) * 2007-09-26 2009-04-01 新奥特硅谷视频技术有限责任公司 Method for implementing data storage by virtual file systems technology after processing
CN103116618A (en) * 2013-01-28 2013-05-22 南开大学 Telefile system mirror image method and system based on lasting caching of client-side
CN104462185A (en) * 2014-10-13 2015-03-25 南京邮电大学 Digital library cloud storage system based on mixed structure

Also Published As

Publication number Publication date
CN105069091A (en) 2015-11-18

Similar Documents

Publication Publication Date Title
CN107045530B (en) A method of object storage system is embodied as local file system
CN104657459B (en) A kind of mass data storage means based on file granularity
CN105320775B (en) The access method and device of data
US7558802B2 (en) Information retrieving system
CN110083601A (en) Index tree constructing method and system towards key assignments storage system
CN104184812B (en) A kind of multipoint data transmission method based on private clound
CN105956123A (en) Local updating software-based data processing method and apparatus
CN107918612A (en) The implementation method and device of key assignments memory system data structure
CN109614226A (en) A kind of stateful application memory management method based on Kubernetes
CN104408111A (en) Method and device for deleting duplicate data
CN105608162B (en) Document handling method and device
CN103473298B (en) Data archiving method and device and storage system
CN110399333A (en) Delete method, equipment and the computer program product of snapshot
CN106354805A (en) Optimization method and system for searching and caching distribution storage system NoSQL
CN103440285B (en) Large-scale mobile phone games system and database update method thereof
CN109445685A (en) A kind of User space file system processing method
CN110109886A (en) The file memory method and distributed file system of distributed file system
CN109690522A (en) A kind of data-updating method, device and storage device based on B+ tree index
CN107665255A (en) Method, apparatus, equipment and the storage medium of key value database data change
CN105512325B (en) Update, deletion and the method for building up and device of multi-edition data index
CN106406748A (en) Memory centric database architecture
CN104077078B (en) Read memory block, update the method and device of memory block
CN109189759A (en) Method for reading data, data query method, device and equipment in KV storage system
CN106649530B (en) Cloud detail query management system and method
CN105069091B (en) A kind of Virtual File System and its implementation based on HBASE

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant