CN104050248B - A kind of document storage system and storage method - Google Patents
A kind of document storage system and storage method Download PDFInfo
- Publication number
- CN104050248B CN104050248B CN201410247433.7A CN201410247433A CN104050248B CN 104050248 B CN104050248 B CN 104050248B CN 201410247433 A CN201410247433 A CN 201410247433A CN 104050248 B CN104050248 B CN 104050248B
- Authority
- CN
- China
- Prior art keywords
- file
- storage device
- data
- file data
- client
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Expired - Fee Related
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/10—File systems; File servers
- G06F16/13—File access structures, e.g. distributed indices
Abstract
The present invention provides a kind of document storage system, including storage device, for storage file data；File system database, for storing the store path of the file data, and ensure the uniformity of file metadata；File server, for being managed collectively the storage device and the file system database, and the file data is obtained from the storage device according to the path that the file system database is specified and provides feedback information to client；Operating system, run for control program, and provide the user interactive operation interface.This document storage system simplifies management, avoids confusion, can effectively utilize memory space, reduces cost, and client will not perceive in dilatation.
Description
Technical field
The present invention relates to memory technology, and in particular to a kind of document storage system and file memory method.
Background technology
" media asset " refers to data existing in the form of the business datums such as video and audio, picture, multimedia, word." media
Assets " are important intangible assets, by accumulation for many years, the content such as these video and audios, word and picture, all with high
Value.The function of " media asset " includes collection and storage at present, automated cataloging, browses and retrieves, downloads, editing, issuing.
" media asset " is managed by media asset management system, i.e. using database form establish cataloguing index, related data,
The satellite informations such as brief introduction, authority, make and can be can be used for issuing again, made by the resource for repeating effectively to utilize
For the new program of material-making or sell.
As the storage system of media asset management system important component, it is used for the storage of " media asset " data.
During media asset management system operation, client passes through network accessed storage system.Common network structure has single network mode and double nets
Pattern.
For double net patterns, as shown in figure 1, client 11 is networked by optical networking and Ethernet with SAN equipment 12,
MDS metadata managements server 13 and management subsystem 14 are used to manage media asset management system.This double net patterns need to install
Polylith network interface card (Ethernet card and HBA sonet cards), also need to configure optical fiber switch, network design is complicated, and the cost of networking is higher.
For single network mode, as shown in Fig. 2 client 21 and SAN equipment 22 are networked by Ethernet, MDS member numbers
It is used to manage media asset management system according to management server 23 and management subsystem 24.Although single network mode simplifies network structure,
But the same with double net patterns, client needs to install special client software, is interoperated between the software that different vendor provides tired
It is difficult.
In addition, person skilled also proposes to utilize NAS (Network Attached Storage:Network attached storage)
Equipment stores, as shown in figure 3, client 31 and SAN equipment 32 are networked by Ethernet.Although but this storage mode network
Networking is simple, and construction cost is low, and client can work without special software is installed.But due to no unified metadata pipe
Reason, easily causes data, the confusion of file management, the data redundancy increase between nas server, waste of storage space, every
NAS device is required for managing respectively, wastes time and energy and easily malfunctions, and upgrade expanding needs to notify client.
The content of the invention
In order to solve the above technical problems, the present invention provides a kind of document storage system and storage method, it can simplify pipe
Reason, avoids confusion, and can effectively utilize memory space, reduces cost, client in document storage system dilatation not
It can perceive.
The used technical scheme for solving above-mentioned technical problem is to provide a kind of document storage system, including：
Storage device, for storage file data；
File system database, for storing the store path of the file data, and ensure the consistent of file metadata
Property；
File server, for being managed collectively the storage device and the file system database, and according to the text
The path that part system database is specified obtains the file data from the storage device and provides feedback information to client；
Operating system, run for control program, and provide the user interactive operation interface.
Wherein, the file server includes：
File system interface, for the communication between the client and document storage system；
Unified file management module, the storage device and the file system database are managed collectively, and according to described
The path that file system database is specified obtains the file data from the storage device.
Wherein, the file system interface supports CIFS, FTP and http protocol.
Wherein, the unified file management module includes：
File metadata administrative unit, for generating file metadata, and safeguard the file metadata；
File data I/O units, the file metadata for being provided according to the file metadata administrative unit are visited
The storage device is asked to obtain the file data, and the file data is supplied to the visitor by the operating system
Family end.
Wherein, the file metadata includes file inode, file size, access and modification time and file data
Store path.
Wherein, led between file data I/O units and the operating system by file interface and/or block data-interface
News.
Wherein, the storage device is mixed for one kind in NAS device, SNA equipment and iscsi device, or plurality of devices
Take, the file server passes through optical networking and/or ethernet communication with the storage device.
Wherein, including the more file servers, the more file servers are run parallel, and pass through share and access
The file system database；
Load balancing module, the workload for the balanced more file servers.
The present invention also provides a kind of file memory method, and it is based on document storage system, and the document storage system includes：
Storage device, for storage file data；File system database, for storing the store path of the file data, and protect
Demonstrate,prove the uniformity of file metadata；File server, for being managed collectively the storage device and the file system database,
And the file data is obtained from the storage device according to the path that the file system database is specified and carried to client
For feedback information；Operating system, run for control program, and provide the user interactive operation interface；Comprise the following steps：
Client proposes access request to the operating system；
Described in the file server obtains according to the access request of the operating system from the file system database
The store path of file data；
The file server accesses the storage device according to the store path and obtains the file data and to institute
State file data described in operating system carry；
The file data is sent client by the operating system.
Wherein, client proposes that access request includes read request and write request to the operating system.
Wherein, the file server passes through file data described in file data I/O units to the operating system carry.
Wherein, the file data I/O units are directly by operating system described in the file data carry；Or pass through
Block number is according to file data described in the backward operating system carry of encapsulation.
Wherein, including parallel the multiple file servers run, the multiple file server pass through load balancing
Module assignment workload.
The invention has the advantages that：
File data is stored in storage device by document storage system provided by the invention, file system database storage
The store path of file data, and ensure the uniformity of file metadata, when client proposes access request, file server
The store path of file data is obtained from file system database, and is accessed and is stored in storage device according to the store path
File data, i.e. file system database are managed collectively storage device, have both simplified management, and have avoided the confusion of management；Keep away again
Exempt from data redundancy, efficiently utilize memory space.Client not DASD, but pass through file server
Indirectly obtain access data, therefore, client will not perceive storage backstage, can with it is obstructed know client and to document storage system
Any upgrade expanding；Moreover, client can use multiple standards protocol access document storage system, deposited so as to extend file
The use range of storage system.In addition, the networking of client and file server is no longer influenceed by storage device, networking is reduced
Cost.On the other hand, the framework of storage device is not influenceed by client, can merge a variety of storage architectures, compatible multiple types
Type storage device, and meet the application demand of various document storage systems.
As a preferred embodiment of the present invention, document storage system includes multiple file servers, multiple file clothes
Business device is run parallel, and document storage system can be with the dilatation of improving the standard of performance, and client will not perceive.
Brief description of the drawings
Fig. 1 is the structure chart for double net patterns that existing media asset management system uses；
Fig. 2 is the structure chart for the single network mode that existing media asset management system uses；
Fig. 3 is the NAS device that existing media asset management system uses；
Fig. 4 is document storage system of the embodiment of the present invention and the theory diagram of client；
Fig. 5 is the theory diagram of file server of the embodiment of the present invention；
Fig. 6 is the theory diagram of unified file management module of the embodiment of the present invention；
Fig. 7 is the flow chart of file memory method of the embodiment of the present invention.
Embodiment
To make those skilled in the art more fully understand technical scheme, the present invention is carried below in conjunction with the accompanying drawings
The document storage system and file memory method of confession are described in detail.
As shown in figure 4, the present embodiment document storage system includes storage device 41, file system database 42, file clothes
Business device 43 and operating system (not shown).Wherein, storage device 41 is used for storage file data；File system database 42
For the store path of storage file data, and ensure the uniformity of file metadata；File server 43 is used to be managed collectively
Storage device and file system database, and the path specified according to file system database obtains file data from storage device
And provide feedback information to client 40；Operating system, run for control program, and provide the user interactive operation interface.
Storage device 41 can use a kind of equipment or plurality of devices in NAS device, SNA equipment and iscsi device
It is mashed up.In order to expand the memory space of document storage system, document storage system would generally set multiple storage devices 41, file
Server 43, which finds required file data, to be needed to take a long time.The present embodiment is recorded by file system database 42
The specific storage location of file data, it is possible to reduce the time of the inquiry file data of file server 43, so as to improve file
The operational efficiency of server 43.File server 43 can be connected with storage device 41 by optical networking and/or Ethernet.
The document storage system of the present embodiment is provided with three file servers 43, and these three file servers 43 are transported parallel
OK, share and access file system database 42 is passed through.As shown in figure 5, each file server 43 includes file system interface 51
The communication being used for unified file management module 52, file system interface 51 between client and document storage system.Unified text
Part management module 52 is used to be managed collectively storage device 41 and file system database 42, and is referred to according to file system database 42
Fixed path obtains file data from storage device 41.File system interface supports CIFS agreements, File Transfer Protocol and http protocol,
CIFS agreements, File Transfer Protocol and http protocol are run under the environment of operating system 45.
As shown in fig. 6, unified file management module 52 includes file metadata administrative unit 61 and file data I/O units
62, file metadata administrative unit 61 is used to generate file metadata and maintenance documentation metadata.In other words, file metadata
Administrative unit 61 configures the access path of storage device 41, in order to which file data I/O units 62 are subsequently to the behaviour of storage device
Make.The file metadata that file data I/O units 62 are used to be provided according to file metadata administrative unit 61 accesses storage device
41, to obtain file data, and file data is supplied to client by operating system 45.File metadata includes file rope
Draw the store path of node, file size, access and modification time and file data.
Communication between file data I/O units 62 and operating system 45 is real by file interface and/or block data-interface
It is existing.
In the present embodiment, in order to improve the operational efficiency of more file servers 43, document storage system also includes negative
Balance module 44 is carried, the workload for balanced (distribution) more file servers 43.More file servers 43 are run parallel,
Document storage system can be with the dilatation of improving the standard of performance, and client will not perceive.
File data is stored in storage device by the document storage system that the present embodiment provides, and file system database is deposited
The store path of file data is stored up, when client proposes access request, file server obtains text from file system database
The store path of number of packages evidence, and the file data being stored in storage device, i.e. file system number are accessed according to the store path
Storage device is managed collectively according to storehouse, management had both been simplified, and had avoided the confusion of management；It turn avoid data redundancy, effective land productivity
With memory space.Client not DASD, but obtain access data indirectly by file server, because
This, client will not perceive storage backstage, can with it is obstructed know client and to any upgrade expanding of document storage system；Moreover,
Client can use multiple standards protocol access document storage system, so as to extend the use range of document storage system.
In addition, the networking of client and file server is no longer influenceed by storage device, networking cost is reduced.On the other hand, deposit
The framework of storage equipment is not influenceed by client, can merge a variety of storage architectures, compatible polytype storage device, and meet
The application demand of various document storage systems.
The present embodiment also provides a kind of file memory method, the document storage system that this method is provided based on the present embodiment,
The concrete structure of document storage system is as detailed above, will not be repeated here.As shown in Figure 7 and Figure 8, file memory method it include
Following steps：
Step S1, client propose access request to operating system.
User proposes access request by client to operating system 45, and access request includes read request, write request or more
New request.Illustrated below by taking read request as an example.
Step S2, file server obtain file data according to the access request of operating system from file system database
Store path.
Operating system 45 proposes access request, the file metadata administrative unit 61 in server to file server
Request is sent to file system database 42 according to the access request of operating system 45 and obtains metadata, i.e. file metadata management
Unit 61 sends the request in the path of inquiry file data to file system database 42, and file system database 42 is by metadata
Send file metadata administrative unit 61.
Step S3, file server access storage device according to store path and obtain file data and to operating system carry
File data.
The metadata provided located at the file metadata administrative unit 61 of file server according to file system database 42,
Storage device 41 is accessed by file data I/O units 62 to obtain file data, file data I/O units 62 are by file data
Send operating system 45.
Communication modes between file data I/O units 62 and storage device 41 are relevant with storage device 41.Deposited for example, working as
When storage equipment 41 is SAN equipment or NAS device, without carrying out block number according to encapsulation, directly using file interface；When storage device 41
For SCSI-type equipment when, it is necessary to carry out data encapsulation (if reversely, need file data piecemeal operate).
File data is sent client by step S4, operating system.
The file data of acquisition is sent client by operating system 45.
In the file memory method that the present embodiment provides, client not DASD, but pass through text
Part server obtains file data, and client will not perceive storage backstage, can with it is obstructed know client and file is stored be
Unite any upgrade expanding；And the networking of client and file server is no longer influenceed by storage device, reduce networking into
This.On the other hand, the framework of storage device is not influenceed by client, can merge a variety of storage architectures, compatible polytype
Storage device, and meet the application demand of various document storage systems.The store path of file data is by file system database
Unified management, the store path that file server provides according to file system database access storage device, had both simplified management,
Avoid the confusion of management；Data redundancy is turn avoid, efficiently utilizes memory space.
It is understood that the principle that embodiment of above is intended to be merely illustrative of the present and the exemplary implementation that uses
Mode, but the invention is not limited in this.For those skilled in the art, the essence of the present invention is not being departed from
In the case of refreshing and essence, various changes and modifications can be made therein, and these variations and modifications are also considered as protection scope of the present invention.
Claims (9)
- A kind of 1. document storage system, it is characterised in that including：Storage device, for storage file data；File system database, for storing the store path of the file data, and ensure the uniformity of file metadata；File server, for being managed collectively the storage device and the file system database, and according to the file system The path that system database is specified obtains the file data from the storage device and provides feedback information to client；The text Part server includes：Unified file management module, is managed collectively the storage device and the file system database, and according to The path that the file system database is specified obtains the file data from the storage device；The unified file manages mould Block includes：File metadata administrative unit, for generating file metadata, and safeguard the file metadata；File data I/O units, for the file metadata that is provided according to the file metadata administrative unit access the storage device with The file data is obtained, and the file data is supplied to the client by operating system；The file metadata Store path including file inode, file size, access and modification time and file data；Operating system, run for control program, and provide the user interactive operation interface；Including the more file servers, the more file servers are run parallel, and pass through file described in share and access System database；Load balancing module, the workload for the balanced more file servers.
- 2. document storage system according to claim 1, it is characterised in that the file server includes：File system interface, for the communication between the client and document storage system.
- 3. document storage system according to claim 2, it is characterised in that the file system interface supports CIFS, FTP And http protocol.
- 4. document storage system according to claim 1, it is characterised in that file data I/O units and the operation system By file interface and/or block number according to interface communication between system.
- 5. document storage system according to claim 1, it is characterised in that the storage device is NAS device, SNA is set One kind in standby and iscsi device, or plurality of devices are mashed up, and the file server passes through optical networking with the storage device And/or ethernet communication.
- 6. a kind of file memory method, it is based on document storage system, and the document storage system includes：Storage device, it is used for Storage file data；File system database, for storing the store path of the file data, and ensure file metadata Uniformity；File server, for being managed collectively the storage device and the file system database, and according to the file The path that system database is specified obtains the file data from the storage device and provides feedback information to client；Operation System, run for control program, and provide the user interactive operation interface；It is characterised in that it includes following steps：Client proposes access request to the operating system；The file server is according to the access request of the operating system The store path of the file data is obtained from the file system database；The file server accesses the storage device according to the store path and obtains the file data and to the behaviour Make file data described in system carry；Including：The storage device and the file system database are managed collectively, and according to institute State the path that file system database is specified and obtain the file data from the storage device；Specifically include：Generate file member Data, and safeguard the file metadata；The file metadata provided according to the file metadata administrative unit is visited The storage device is asked to obtain the file data, and the file data is supplied to the visitor by the operating system Family end；The file metadata includes the storage road of file inode, file size, access and modification time and file data Footpath；The file data is sent client by the operating system；Including the multiple file servers run parallel, the multiple file server distributes work by load balancing module Measure.
- 7. file memory method according to claim 6, it is characterised in that client proposes to access to the operating system Request includes read request and write request.
- 8. file memory method according to claim 6, it is characterised in that the file server passes through file data I/ File data described in O unit to the operating system carry.
- 9. file memory method according to claim 7, it is characterised in that the file data I/O units are directly by institute State operating system described in file data carry；Or by block number according to number of files described in the backward operating system carry of encapsulation According to.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201410247433.7A CN104050248B (en) | 2014-06-05 | 2014-06-05 | A kind of document storage system and storage method |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201410247433.7A CN104050248B (en) | 2014-06-05 | 2014-06-05 | A kind of document storage system and storage method |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN104050248A CN104050248A (en) | 2014-09-17 |
| CN104050248B true CN104050248B (en) | 2018-03-02 |
Family
ID=51503080
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201410247433.7A Expired - Fee Related CN104050248B (en) | 2014-06-05 | 2014-06-05 | A kind of document storage system and storage method |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN104050248B (en) |
Families Citing this family (11)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105069012B (en) * | 2015-07-07 | 2018-09-21 | 浪潮(北京)电子信息产业有限公司 | A kind of file access method and system |
| CN106610967B (en) | 2015-10-21 | 2020-06-12 | 杭州海康威视数字技术股份有限公司 | Method and device for reading and writing video data in NAS (network attached storage) equipment |
| WO2017187263A1 (en) * | 2016-04-26 | 2017-11-02 | Umbra Technologies Ltd. | Sling-routing logic and load balancing |
| CN106484322A (en) * | 2016-09-12 | 2017-03-08 | 华为技术有限公司 | A kind of method of carry file system, device and equipment |
| CN106254544A (en) * | 2016-09-28 | 2016-12-21 | 乐视控股（北京）有限公司 | Data access method and device |
| CN106528739B (en) * | 2016-10-28 | 2019-07-23 | 杭州米绘科技有限公司 | A kind of method for building up in Digital Dyeing picture material big data warehouse |
| CN106844111B (en) * | 2016-12-26 | 2021-01-08 | 深圳创新科技术有限公司 | Access method of cloud storage network file system |
| CN107357524B (en) * | 2017-06-30 | 2021-02-09 | 四川九洲电器集团有限责任公司 | File storage method, file reading method and electronic equipment |
| CN109117156A (en) * | 2018-07-18 | 2019-01-01 | 郑州云海信息技术有限公司 | A kind of upgrade method and system of storage system |
| CN110879760B (en) * | 2018-09-05 | 2022-09-02 | 北京鲸鲨软件科技有限公司 | Unified storage system and method and electronic equipment |
| CN112380178A (en) * | 2020-11-25 | 2021-02-19 | 北京明略软件系统有限公司 | File storage and management method and system |
Citations (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101370027A (en) * | 2008-07-09 | 2009-02-18 | 中国网通集团宽带业务应用国家工程实验室有限公司 | Network storage system, method and application server |
-
2014
- 2014-06-05 CN CN201410247433.7A patent/CN104050248B/en not_active Expired - Fee Related
Patent Citations (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101370027A (en) * | 2008-07-09 | 2009-02-18 | 中国网通集团宽带业务应用国家工程实验室有限公司 | Network storage system, method and application server |
Also Published As
| Publication number | Publication date |
|---|---|
| CN104050248A (en) | 2014-09-17 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN104050248B (en) | A kind of document storage system and storage method | |
| CN109643312B (en) | Hosted query service | |
| CN102571916B (en) | A kind of framework of renting software of cloud memory space and method of operation | |
| CN106980669B (en) | A kind of storage of data, acquisition methods and device | |
| US9621572B2 (en) | Storage appliance and threat indicator query framework | |
| US8996647B2 (en) | Optimizing storage between mobile devices and cloud storage providers | |
| CN107315776A (en) | A kind of data management system based on cloud computing | |
| CN106559488A (en) | A kind of method of the electrical network geographical information space service for setting up tenant's driving | |
| CN109683911B (en) | System for realizing automatic application deployment and influence analysis | |
| CN102202087B (en) | Method for identifying storage equipment and system thereof | |
| CN104506632A (en) | Resource sharing system and method based on distributed multi-center | |
| EP3646226A1 (en) | Access control manager configuration based on log files mining | |
| US9104745B1 (en) | Distributed log collector and report generation | |
| CN104660633A (en) | New media public service platform | |
| CN109906597A (en) | To with data set that restricted data set and untethered system are stored and fetched from cloud network | |
| CN105095103A (en) | Storage device management method and device used for cloud environment | |
| CN104182487A (en) | Unified storage method supporting various storage modes | |
| CN108268344A (en) | A kind of data processing method and device | |
| CN103414762A (en) | Cloud backup method and cloud backup device | |
| CN106537347A (en) | Distributing and processing streams over one or more networks for on-the-fly schema evolution | |
| CN103793457A (en) | System and method for managing memory usage by using usage analytics | |
| CN202872848U (en) | Cloud storage terminal equipment based on cloud information and cloud computing services | |
| CN104205730A (en) | Network element data access method, device and network management system | |
| KR20150055776A (en) | Personal cloud storage chain service method and system | |
| CN110457307A (en) | Metadata management system, user's cluster creation method, device, equipment and medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant | ||
| CF01 | Termination of patent right due to non-payment of annual fee |
Granted publication date: 20180302 Termination date: 20210605 |
|
| CF01 | Termination of patent right due to non-payment of annual fee |