CN106610979A - Distributed electronic file management system - Google Patents
Distributed electronic file management system Download PDFInfo
- Publication number
- CN106610979A CN106610979A CN201510690489.4A CN201510690489A CN106610979A CN 106610979 A CN106610979 A CN 106610979A CN 201510690489 A CN201510690489 A CN 201510690489A CN 106610979 A CN106610979 A CN 106610979A
- Authority
- CN
- China
- Prior art keywords
- data
- nodes
- management system
- electronic document
- file
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/10—File systems; File servers
- G06F16/18—File system types
- G06F16/182—Distributed file systems
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/10—File systems; File servers
- G06F16/13—File access structures, e.g. distributed indices
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Data Mining & Analysis (AREA)
- Databases & Information Systems (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
In recent years, the cloud computing technology is quickly developed. The operation core of a cloud computing system is a distributed operating system, and as the core of an operating system, the file management system is more important. Therefore, the core of the efficient cloud computer system needs an efficient distributed file management system. The invention puts forward a construction scheme for the distributed electronic file management system on the basis of Windows.
Description
Technical field
The present invention relates to information data management technique field, particularly relates to a kind of multiple step format electronic document management system.
Background technology
In recent years, cloud computing technology quickly grows.The core of cloud computing system operation is distributed operating system, and file management system then seems more important as the core of operating system.Thus, the core of an efficient cloud computing system, it is desirable to have an efficient distributed file management system.The present invention proposes a kind of constructing plan of distributed electronic file management system.
The content of the invention
The technical problem to be solved in the present invention is to provide a kind of multiple step format electronic document management system.To solve above-mentioned technical problem, a kind of multiple step format electronic document management system of the present invention, including following ingredient：
Filename node：It is made up of Name nodes and Data nodes, wherein Name nodes are used for administrative directory tree and metadata management, externally provide naming space and access for client, and Data nodes undertake data access, periodically data message is sent to namenode, and process the task that namenode is issued；
Metadata management module：The metadata of NameSpace, All Files and the catalogue of whole file system is managed, these data unifications are stored in the local disk of node, and in system operation, Name nodes can first load both of these documents so as to construct a complete file tree；
Blocks of files management module：Manage and preserve the data block distribution situation of each file, these information are mainly collected by Data nodes after Name nodes start and form；
Fault management module：By each item data for periodically receiving Data nodes come the availability of monitoring node, to guarantee node failure after still be able to ensure the availability of data.
Interactive maintenance module：Name nodes are externally interacted with client by ICP/IP protocol by specific communication protocol；
Data organization and management module：By a file division into one or more data blocks, after these data blocks are numbered, preserved by Name nodes, including the information such as filename, divided block number, the copy amount per block, each data block deposit position, its copy deposit position.
Thus the foundation of multiple step format electronic document management system is completed.
Specific embodiment
To make the technical problem to be solved in the present invention, technical scheme and advantage clearer, specific embodiment will be described in detail below.
Embodiment
1
A kind of multiple step format electronic document management system of the present invention, including following ingredient：
Filename node：It is made up of Name nodes and Data nodes, wherein Name nodes are used for administrative directory tree and metadata management, externally provide naming space to access for client, Data nodes undertake data access, periodically heartbeat data packets, data block list are sent to namenode, and process the task that namenode is issued；
Metadata management module：The metadata of NameSpace, All Files and the catalogue of whole file system is managed, these data unifications are stored in the local disk of node, and in system operation, Name nodes can first load both of these documents so as to construct a complete file tree；
Blocks of files management module：Manage and preserve the data block distribution situation of each file, these information are mainly collected by Data nodes after Name nodes start and form；
Fault management module：By each item data for periodically receiving Data nodes come the availability of monitoring node, to guarantee node failure after still be able to ensure the availability of data.
Interactive maintenance module：Name nodes are externally interacted with client by ICP/IP protocol by specific communication protocol；
Data organization and management module：By a file division into one or more data blocks, after these data blocks are numbered, preserved by Name nodes, including the information such as filename, divided block number, the copy amount per block, each data block deposit position, its copy deposit position.
The above is the preferred embodiment of the present invention; it should be pointed out that for those skilled in the art, on the premise of without departing from principle of the present invention; some improvements and modifications can also be made, these improvements and modifications also should be regarded as protection scope of the present invention.
Claims (6)
1. a kind of multiple step format electronic document management system, including following ingredient：
Filename node：It is made up of Name nodes and Data nodes, wherein Name nodes are used for administrative directory tree and metadata management, externally provide naming space and access for client, and Data nodes undertake data access, periodically data message is sent to namenode, and process the task that namenode is issued；
Metadata management module：The metadata of NameSpace, All Files and the catalogue of whole file system is managed, these data unifications are stored in the local disk of node, and in system operation, Name nodes can first load both of these documents so as to construct a complete file tree；
Blocks of files management module：Manage and preserve the data block distribution situation of each file, these information are mainly collected by Data nodes after Name nodes start and form；
Fault management module：By each item data for periodically receiving Data nodes come the availability of monitoring node, to guarantee node failure after still be able to ensure the availability of data；
Interactive maintenance module：Name nodes are externally interacted with client by ICP/IP protocol by specific communication protocol；
Data organization and management module：By a file division into one or more data blocks, after these data blocks are numbered, preserved by Name nodes, including the information such as filename, divided block number, the copy amount per block, each data block deposit position, its copy deposit position.
2. a kind of multiple step format electronic document management system according to claim 1, its feature in：It is main to use in a distributed computing environment.
3. a kind of multiple step format electronic document management system according to claim 1, it is characterised in that the data message, including heartbeat data packets and data block list.
4. a kind of multiple step format electronic document management system according to claim 1, it is characterised in that the network communication protocol, is ClientProtocal agreements.
5. a kind of multiple step format electronic document management system according to claim 2, it is characterised in that the file structure is Windows file structures.
6. a kind of multiple step format electronic document management system according to claim 2, it is characterised in that each node need to externally open RPC service.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201510690489.4A CN106610979A (en) | 2015-10-23 | 2015-10-23 | Distributed electronic file management system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201510690489.4A CN106610979A (en) | 2015-10-23 | 2015-10-23 | Distributed electronic file management system |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN106610979A true CN106610979A (en) | 2017-05-03 |
Family
ID=58611676
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201510690489.4A Pending CN106610979A (en) | 2015-10-23 | 2015-10-23 | Distributed electronic file management system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN106610979A (en) |
Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102073739A (en) * | 2011-01-25 | 2011-05-25 | 中国科学院计算技术研究所 | Method for reading and writing data in distributed file system with snapshot function |
| CN102136003A (en) * | 2011-03-25 | 2011-07-27 | 上海交通大学 | Large-scale distributed storage system |
-
2015
- 2015-10-23 CN CN201510690489.4A patent/CN106610979A/en active Pending
Patent Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102073739A (en) * | 2011-01-25 | 2011-05-25 | 中国科学院计算技术研究所 | Method for reading and writing data in distributed file system with snapshot function |
| CN102136003A (en) * | 2011-03-25 | 2011-07-27 | 上海交通大学 | Large-scale distributed storage system |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN102411637B (en) | Metadata management method of distributed file system | |
| CN102693324B (en) | Distributed database synchronization system, synchronization method and node management method | |
| CN105025053A (en) | Distributed file upload method based on cloud storage technology and system | |
| CN104539659B (en) | Multi-user's exchange files sharing method and device based on NAS storages | |
| US20120173596A1 (en) | Relational objects for the optimized management of fixed-content storage systems | |
| CN104506632A (en) | Resource sharing system and method based on distributed multi-center | |
| CN109194711B (en) | Synchronization method, client, server and medium for organization architecture | |
| EP2429120A1 (en) | Distributed network management system, network element management server, and data configuration management method | |
| CN104391930A (en) | Distributed file storage device and method | |
| CN102196049B (en) | Method suitable for secure migration of data in storage cloud | |
| CN107888666B (en) | Cross-region data storage system and data synchronization method and device | |
| CN102855239A (en) | Distributed geographical file system | |
| CN107734026A (en) | A kind of design method, device and the equipment of network attached storage cluster | |
| CN102122306A (en) | Data processing method and distributed file system applying same | |
| CN107800808A (en) | A kind of data-storage system based on Hadoop framework | |
| CN101673289A (en) | Method and device for constructing distributed file storage framework | |
| CN102833580A (en) | High-definition video application system and method based on infiniband | |
| CN105205402A (en) | Privacy cluster metadata separation based cloud storage privacy protection method | |
| CN105828017A (en) | Cloud storage access system and method for video conferences | |
| CN111050188A (en) | Data stream scheduling method, system, device and medium | |
| Dev et al. | A survey of different technologies and recent challenges of big data | |
| CN103036952A (en) | Enterprise-level heterogeneous fusion memory management system | |
| CN102932443A (en) | HDFS (hadoop distributed file system) cluster based distributed cloud storage system | |
| CN108063779A (en) | A kind of cloud storage method and system synchronous with realization is locally stored | |
| CN104199919A (en) | Method for achieving real-time reading of super-large-scale data |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| WD01 | Invention patent application deemed withdrawn after publication |
Application publication date: 20170503 |
|
| WD01 | Invention patent application deemed withdrawn after publication |