CN103259869B - A kind of concentration approaches to IM based on Distributed Storage - Google Patents
A kind of concentration approaches to IM based on Distributed Storage Download PDFInfo
- Publication number
- CN103259869B CN103259869B CN201310213232.0A CN201310213232A CN103259869B CN 103259869 B CN103259869 B CN 103259869B CN 201310213232 A CN201310213232 A CN 201310213232A CN 103259869 B CN103259869 B CN 103259869B
- Authority
- CN
- China
- Prior art keywords
- data
- information
- terminal
- server
- metadata
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Expired - Fee Related
Links
Abstract
A kind of concentration approaches to IM based on Distributed Storage, relates to computer information management field, includes many station terminals and a station server.It utilizes distributed storage technology, initial data is stored in each terminal, reasonably make use of the idle storage space of terminal；Server calls primary data information (pdi) by routing iinformation for storing the routing iinformation of each initial data, terminal and server on corresponding address, decreases the load of server, improves the operational efficiency of system；Meanwhile, the present invention uses flattening flexible management system, it is not necessary to change the original network structure of terminal, it is only necessary to increase by a station server on the basis of legacy network structure, have Large strain ability and flexibility.
Description
Technical field
The present invention relates to computer information management field.
Background technology
Existing information management platform typically requires to be set up database server cluster and meets with unstructured data
Explosion type increases to the ultrahigh-density data storage needs represented, and causes increase and intra-company's free time storage sky of hardware cost
Between waste.Platform is managed for existing information, uses uniform data storage, when all departments need corresponding data,
Through management platform request data, response speed is by current network conditions, and hardware configuration impact.And bulk information
Transmission takies the network bandwidth, it is possible to causes network congestion, affects operating efficiency.Platform is managed for existing information,
Restricted by Platform Designing and hardware, when processing magnanimity information, it is impossible to ensure the terminal flattening of management, specification
Change.
Summary of the invention
It is an object of the invention to provide a kind of concentration approaches to IM based on Distributed Storage, it can be by
Initial data is stored in the idle space of each terminal, reduces the data of server, improves utilization rate and the operation of equipment
Speed.
It is an object of the invention to be realized by such technical scheme, it includes many station terminals and a station server,
Every station terminal is all mutual with server data, and concrete management method is: terminal receives primary data information (pdi), by original number
It is believed that breath is packaged into metadata bag, and be stored in this hard disk of ground, metadata bag includes primary data information (pdi), former
Beginning data message is in locally stored data address information and the terminal address information of this primary data information (pdi) of reception, terminal
Data address information and the terminal address of each metadata bag are packaged into routing iinformation, and send to server；Service
When device calls corresponding raw information, open routing iinformation, find corresponding terminal by terminal address information, by number
Corresponding metadata bag and primary data information (pdi) is found according to address information.
Further, described metadata bag and routing iinformation also include the number information that terminal is raw information distribution,
Server determines the raw information of required lookup by number information.
Further, terminal is called the method for initial data and is: be connected to server by network, searches server memory
The routing iinformation of storage, determines the raw information of required lookup according to number information, further according to the terminal ground in routing iinformation
The terminal that location information searching is corresponding, finds corresponding metadata bag and primary data information (pdi) by data address information.
Further, terminal is called the method for initial data and is: terminal first looks for locally stored routing iinformation, according to
Whether the raw information that the number information in routing iinformation is called needed for determining is stored in this locality, the most then according to route
Data address information in information calls metadata bag and the primary data information (pdi) of correspondence；If it is not, then pass through network
It is connected to server, searches the routing iinformation of server memory storage, determine the original letter of required lookup according to number information
Breath, finds corresponding terminal further according to the terminal address information in routing iinformation, finds correspondence by data address information
Metadata bag and primary data information (pdi).
Further, described server is multiple, the metadata that upper level node uses the plurality of data clothes from network
Positioning at least one data server in business device, metadata bag includes at least a data server address.
Further, request is received from a high level or the bottom layer node of communication network, and described method comprises following step:
Logging request is received from described node by communication network；
Perform the access Licensing Authority of this node；
A formation data request is received from described node；
The metadata of described formation data request is asked from metadatabase；
Sent the metadata of described formation data request to described node by dedicated communications network.
Further, the metadata of described request of data is a part of described request of data, comprises the following steps: for
The metadata that another component requests of data file is extra.
Further, metadatabase asks the metadata of described formation data request to include a key.
Owing to have employed technique scheme, present invention have the advantage that:
1, the present invention utilizes distributed storage technology, each scattered terminal storage space is integrated by network,
Constitute a virtual storage device, improve the utilization rate of equipment；
2, the present invention is by setting up a server, by control stream and data stream separation, improves set expandability and I/O
Concurrency, server itself does not store primary data information (pdi), only stores routing iinformation, decreases the load of server,
Improve the operational efficiency of system；
3, the present invention uses flattening flexible management system, it is not necessary to change the original network structure of terminal, it is only necessary to
On the basis of legacy network structure, increase by a station server, there is Large strain ability and flexibility.
Other advantages, target and the feature of the present invention will be illustrated to a certain extent in the following description, and
And to a certain extent, will be apparent to those skilled in the art based on to investigating hereafter, or
Person can be instructed from the practice of the present invention.The target of the present invention and other advantages can pass through description below
Realize with claims and obtain.
Accompanying drawing explanation
The accompanying drawing of the present invention is described as follows.
Fig. 1 is the schematic network structure of the present invention.
Detailed description of the invention
The invention will be further described with embodiment below in conjunction with the accompanying drawings.
A kind of concentration approaches to IM based on Distributed Storage, includes many station terminals and a station server,
As it is shown in figure 1, every station terminal is all mutual with server data, concrete management method is: terminal receives original number and it is believed that
Breath, is packaged into primary data information (pdi) metadata bag, and is stored in this hard disk of ground, include original in metadata bag
Data message, primary data information (pdi) locally stored data address information and receive this primary data information (pdi) terminal ground
Location information, data address information and the terminal address of each metadata bag are packaged into routing iinformation, and send extremely by terminal
Server；During the corresponding raw information of server calls, open routing iinformation, find correspondence by terminal address information
Terminal, finds corresponding metadata bag and primary data information (pdi) by data address information.
Also including the number information that terminal is raw information distribution in described metadata bag and routing iinformation, server leads to
Cross number information and determine the raw information of required lookup.
Terminal calls the method for initial data: be connected to server by network, searches the route of server memory storage
Information, determines the raw information of required lookup, seeks further according to the terminal address information in routing iinformation according to number information
Look for the terminal of correspondence, find corresponding metadata bag and primary data information (pdi) by data address information.
Terminal calls the method for initial data: terminal first looks for locally stored routing iinformation, according to routing iinformation
In number information determine needed for the raw information called whether be stored in this locality, the most then according to routing iinformation information
In data address information call correspondence metadata bag and primary data information (pdi)；If it is not, be then connected to clothes by network
Business device, searches the routing iinformation of server memory storage, determines the raw information of required lookup, then root according to number information
Find corresponding terminal according to the terminal address information in routing iinformation, find corresponding metadata by data address information
Bag and primary data information (pdi).
Described server is multiple, and the metadata that upper level node uses is fixed in the plurality of data server from network
At least one data server of position, metadata bag includes at least a data server address.
Request is received from a high level or the bottom layer node of communication network, and described method comprises following step:
Logging request is received from described node by communication network；
Perform the access Licensing Authority of this node；
A formation data request is received from described node；
The metadata of described formation data request is asked from metadatabase；
Sent the metadata of described formation data request to described node by dedicated communications network.
The metadata of described request of data is a part of described request of data, comprises the following steps: for data file
The extra metadata of another component requests.
Metadatabase asks the metadata of described formation data request to include a key.
Finally illustrating, above example is only in order to illustrate technical scheme and unrestricted, although with reference to relatively
The present invention has been described in detail by good embodiment, it will be understood by those within the art that, can be to the present invention
Technical scheme modify or equivalent, without deviating from objective and the scope of the technical program, it all should be contained
In the middle of scope of the presently claimed invention.
Claims (5)
1. a concentration approaches to IM based on Distributed Storage, it is characterised in that described method includes
Having server and many station terminals, every station terminal is all mutual with server data, and concrete management method is: terminal receives former
Beginning data message, is packaged into primary data information (pdi) metadata bag, and is stored in local hard drive, wraps in metadata bag
Include primary data information (pdi), primary data information (pdi) is in locally stored data address information and receives this primary data information (pdi)
Terminal address information, data address information and the terminal address of each metadata bag are packaged into routing iinformation by terminal,
And send to server；During the corresponding raw information of server calls, open routing iinformation, sought by terminal address information
Look for the terminal of correspondence, find corresponding metadata bag and primary data information (pdi) by data address information；
Also including the number information that terminal is raw information distribution in described metadata bag and routing iinformation, server leads to
Cross number information and determine the raw information of required lookup；
Terminal calls the method for initial data: be connected to server by network, searches the route of server memory storage
Information, determines the raw information of required lookup, seeks further according to the terminal address information in routing iinformation according to number information
Look for the terminal of correspondence, find corresponding metadata bag and primary data information (pdi) by data address information.
2. concentration approaches to IM based on Distributed Storage as claimed in claim 1, it is characterised in that
Described server is multiple, and the metadata that upper level node uses positions at least one in the multiple data servers from network
Individual data server, metadata bag includes at least a data server address.
3. concentration approaches to IM based on Distributed Storage as claimed in claim 2, it is characterised in that
Request is received from a high level or the bottom layer node of communication network, and described method comprises following step:
Logging request is received from described node by communication network；
Perform the access Licensing Authority of this node；
A formation data request is received from described node；
The metadata of described formation data request is asked from metadatabase；
Sent the metadata of described formation data request to described node by dedicated communications network.
4. concentration approaches to IM based on Distributed Storage as claimed in claim 3, it is characterised in that
The metadata of formation data request is a part of formation data request, comprises the following steps: another for data file
The metadata that one component requests is extra.
5. concentration approaches to IM based on Distributed Storage as claimed in claim 4, it is characterised in that
Metadatabase asks the metadata of described formation data request to include a key.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201310213232.0A CN103259869B (en) | 2013-05-31 | 2013-05-31 | A kind of concentration approaches to IM based on Distributed Storage |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201310213232.0A CN103259869B (en) | 2013-05-31 | 2013-05-31 | A kind of concentration approaches to IM based on Distributed Storage |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN103259869A CN103259869A (en) | 2013-08-21 |
| CN103259869B true CN103259869B (en) | 2016-08-17 |
Family
ID=48963558
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201310213232.0A Expired - Fee Related CN103259869B (en) | 2013-05-31 | 2013-05-31 | A kind of concentration approaches to IM based on Distributed Storage |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN103259869B (en) |
Families Citing this family (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104462596B (en) * | 2014-12-30 | 2019-02-01 | 广州视睿电子科技有限公司 | Junk data delet method and system |
| CN105450944A (en) * | 2015-11-13 | 2016-03-30 | 北京自由坊科技有限责任公司 | Method and device for synchronously recording and reproducing slides and live presentation speech |
| CN109767247A (en) * | 2019-01-15 | 2019-05-17 | 武汉费米坊科技有限公司 | A kind of distribution commodity traceability system and source tracing method |
| CN112256199B (en) * | 2020-10-21 | 2023-07-07 | 张立旭 | Distributed data storage method and system for improving utilization rate of storage resources |
| CN112270527A (en) * | 2020-10-28 | 2021-01-26 | 河北时代电子有限公司 | Processing method for managing data information of social security card |
| CN112487089A (en) * | 2020-11-26 | 2021-03-12 | 广州海量数据库技术有限公司 | Distributed storage method and system based on data page routing |
Citations (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101141482A (en) * | 2007-09-29 | 2008-03-12 | 腾讯科技（深圳）有限公司 | Network resource management system and method |
-
2013
- 2013-05-31 CN CN201310213232.0A patent/CN103259869B/en not_active Expired - Fee Related
Patent Citations (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101141482A (en) * | 2007-09-29 | 2008-03-12 | 腾讯科技（深圳）有限公司 | Network resource management system and method |
Also Published As
| Publication number | Publication date |
|---|---|
| CN103259869A (en) | 2013-08-21 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN103259869B (en) | A kind of concentration approaches to IM based on Distributed Storage | |
| US20200396119A1 (en) | Intelligent network | |
| CN112105035B (en) | Deployment method and device of mobile edge computing server | |
| CN103119907B (en) | It is provided for the system and method for the smart group of access control | |
| CN104521199A (en) | Adaptive infrastructure for distributed virtual switch | |
| US20150215394A1 (en) | Load distribution method taking into account each node in multi-level hierarchy | |
| CN105471700B (en) | A kind of methods, devices and systems of Message Processing | |
| CN105791381A (en) | Access control method and apparatus | |
| CN106776013B (en) | Multi-system resource scheduling method and device | |
| CN107025223B (en) | A kind of buffer management method and server towards multi-tenant | |
| CN103200071A (en) | MTSP multiple-case calculating method and MTSP multiple-case calculating equipment | |
| CN108023857B (en) | Method and device for accessing regional interval matching network and client | |
| CN105282045B (en) | A kind of distributed computing and storage method based on consistency hash algorithm | |
| CN114157710A (en) | Communication strategy configuration method, device, storage medium and equipment | |
| CN114021056A (en) | Dynamic partitioning method and partitioning system for ICT (information communication technology) resource link virtual operation platform | |
| CN112202681B (en) | Data congestion processing method and device, computer equipment and storage medium | |
| CN113794650A (en) | Concurrent request processing method, computer device and computer-readable storage medium | |
| CN106506647A (en) | A kind of client has the intelligence community cloud storage system of data backup device | |
| CN107682573B (en) | High-concurrency outbound method, system, equipment and storage medium | |
| CN116032614A (en) | Container network micro-isolation method, device, equipment and medium | |
| US20140136647A1 (en) | Router and operating method thereof | |
| CN111770179B (en) | High-performance high-availability cloud networking gateway implementation method, medium and terminal | |
| CN204425400U (en) | Application server system | |
| CN112346758B (en) | Digital infrastructure service updating platform, updating method and electronic equipment | |
| CN105025042A (en) | Method of determining data information, system and proxy servers |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C14 | Grant of patent or utility model | ||
| GR01 | Patent grant | ||
| CF01 | Termination of patent right due to non-payment of annual fee |
Granted publication date: 20160817 |
|
| CF01 | Termination of patent right due to non-payment of annual fee |