CN103023995A - Hadoop-based distributive type cloud storage type automatic grading data managing system - Google Patents
Hadoop-based distributive type cloud storage type automatic grading data managing system Download PDFInfo
- Publication number
- CN103023995A CN103023995A CN201210499413XA CN201210499413A CN103023995A CN 103023995 A CN103023995 A CN 103023995A CN 201210499413X A CN201210499413X A CN 201210499413XA CN 201210499413 A CN201210499413 A CN 201210499413A CN 103023995 A CN103023995 A CN 103023995A
- Authority
- CN
- China
- Prior art keywords
- data
- message
- module
- node
- information
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Images
Landscapes
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
- Information Transfer Between Computers (AREA)
Abstract
The invention provides a Hadoop-based distributive type cloud storage type automatic grading data managing system. The Hadoop-based distributive type cloud storage type automatic grading data managing system comprises a node server and a central server, wherein the node server is used for acquiring state messages of the server and the data temperature distribution messages, and sending the acquired messages to a data gradating managing module of the central server. According to the Hadoop-based distributive type cloud storage type automatic grading data managing system, the data grading managing module is arranged at the upper part of the central server, the messages sent by data nodes and name nodes in an HDFS (Hadoop Distributed File System) set are unified to be received and then processed to generate out-of-band data grading commands, and the out-of-band data grading commands are sent to the name nodes in the HDFS set in order to redistribute the data blocks at last, so that the automatic data grading management of the Hadoop-based distributive cloud storage system is realized, and the utilization rate of the storage resource is increased.
Description
Technical field
The invention belongs to field of computer technology, be specifically related to a kind of distributed cloud storage automatic classification data management system based on Hadoop.
Background technology
Along with cloud computing technology high speed development at home and abroad, be widely used based on the cloud memory technology of Hadoop distributed file system (HDFS).By reusing and the mode of newly-increased PC server is set up HDFS cluster in large scale, but utilize local disk on the PC server that the distributed cloud stores service of high-performance, high performance-price ratio resilient expansion is provided.
Because form the otherness of the server node of HDFS cluster, node probably has different memory properties and memory capacity in the cluster.Therefore, how to take into full account internodal otherness, the distribution of optimization storage resources is the distributed cloud storage system problem demanding prompt solution that makes up based on Hadoop.
Summary of the invention
In order to overcome above-mentioned the deficiencies in the prior art, the invention provides a kind of distributed cloud storage automatic classification data management system based on Hadoop, realize the automaticdata differentiated control, improve utilization ratio of storage resources.
In order to realize the foregoing invention purpose, the present invention takes following technical scheme:
A kind of distributed cloud storage automatic classification data management system based on Hadoop is provided, described system comprises node server and central server, described node server acquisition server status message and data Temperature Distribution message, and the message that gathers is sent to the data staging administration module of described central server.
Described node server comprises server info acquisition module, data temperature collect module and data staging proxy module; Described server info acquisition module and data temperature collect module be acquisition server status message and data Temperature Distribution message respectively, and respectively the message that gathers is sent to described data staging administration module.
Described server info acquisition module is deployed on the back end of HDFS cluster, described data temperature collect module and data staging proxy module are deployed on the namenode of described HDFS cluster, and described data staging administration module is deployed on the described central server.
Described server state message comprises hardware configuration and the running state information of back end, and described data Temperature Distribution message comprises data temperature message and data distribution message.
Described message includes message header and message body, and described message header comprises central server title, IP address, node ID, encryption method, verification and timestamp; Described message body comprises through message header specifies node hardware configuration, node running status, data temperature and data after encryption method is encrypted to distribute.
The outer data staging order of described data staging proxy module receiving belt, resolving the outer data staging order of described band obtains and needs the Mobile data block message, and institute's obtaining information informed namenode, described namenode copies target data block to destination node when receiving information, and the data block on the deletion source data node, after needing Mobile data piece message all to obtain end, namenode sends success message to the data staging proxy module, and described data staging proxy module sends acknowledge message to the data staging administration module.
The described Mobile data block message that needs comprises target data block ID, source data node ID and destination node ID that needs are mobile.
Described central server comprises message sink module, information persistence module, information cache module, data staging administration module, instruction processing module, instruction sending module, analysis engine module node and Registering modules.
Described message sink module receives server state message and the data Temperature Distribution message that sends respectively from back end and namenode, and described data staging administration module is resolved and be sent to message;
Described data staging administration module generates the outer data staging order of band, and periodically sends to namenode;
Described information cache module receives the message from the message sink module, be formed with effective information through processing and deposit the information cache district in, administer and maintain simultaneously information cache district content, and will sending to the data staging administration module after the information classification, described information cache district content comprises establishment, renewal and the deletion of information;
When the information cache district exceeded capacity or time counter end or service stopping, described information persistence module was written to disk to the message after processing through information cache module, and the data staging administration module is sent into the information cache district from the disk reading information;
Server state message and data Temperature Distribution message that described analysis engine module information cache module sends form data Temperature Distribution formula polar plot, and the state of service data Temperature Distribution polar plot upgrade; Form the outer data staging instruction of band according to data Temperature Distribution formula polar plot, send to the instruction processing module;
Described instruction processing module is processed to form the instruction encoding that can be sent to by instruction sending module specific node according to the content of analysis engine module output;
Described instruction sending module receives the outer data staging order of the band that generates from described data staging administration module, and sends instruction according to the reception instruction to destination node;
Described node Registering modules receives the log-on message from the information cache district, and the information of registration or renewal specified node.
Compared with prior art, beneficial effect of the present invention is:
1, is different from other layering storage meanss data are distributed on the different storage medium (internal memory, solid magnetic disc, disk, SAN network, tape), the situation of utilizing local disk (SATA interface, scsi interface) the storage data of X86 server based on the distributed cloud storage automatic classification data management system of Hadoop provided by the invention; Compare by static informations such as node server configuration information contrast disk size, quantity, interface type, read-write speed, in conjunction with operation condition of server message (multidate informations such as disk size, CPU, the network bandwidth) and data Temperature Distribution message breath (number of times, time, frequency that data are accessed), be implemented on the server of different performance and deposit the different temperatures data, the optimization that reaches the server stores resource is used.
2, not the reasonable layout of at the beginning of the data storage, considering data block, the present invention uses is the data block Distribution Strategy again of off-line, namely by sending the outer data hierarchy instruction of band, carry out the movement of data block in the lightest or only time of whole HDFS cluster load, thereby more reasonably calculate the temperature information of data, reduce simultaneously storing the impact of normal use.
3, the Hadoop distributed file system of the present invention and indication is the loose coupling state, only need to make amendment to HDFS at two places in the design process, can be transplanted to very soon on other cloud storage platform that adopts distributed file system (metadata centralized management), the data staging storage scheme is provided, has stronger portability.
Description of drawings
Fig. 1 is based on the data stewardship program figure of the distributed cloud storage of Hadoop;
Fig. 2 is based on the distributed cloud storage automatic classification data management system logical architecture schematic diagram of Hadoop;
Fig. 3 is that central server forms module diagram.
Embodiment
Below in conjunction with accompanying drawing the present invention is described in further detail.
Such as Fig. 1 and Fig. 2, a kind of distributed cloud storage automatic classification data management system based on Hadoop is provided, described system comprises node server and central server, described node server acquisition server status message and data Temperature Distribution message, and the message that gathers is sent to the data staging administration module of described central server.
Described node server comprises server info acquisition module, data temperature collect module and data staging proxy module;
Described server info acquisition module will be collected the hardware configuration information (static information that comprises the configuring conditions such as CPU, internal memory, hard disk, network) of back end, send to central server behind the generation server status message; Afterwards, this service is the running status message of image data node (multidate information that comprises the operating positions such as CPU, internal memory, hard disk, network) periodically, forms server state message after processing by analysis and send to central server.
The number of times that described data temperature collect module is accessed with record data and frequency (can be by revising the direct mode of namenode source code in the HDFS cluster, or in distributed cloud storage system client read request message, embed the more indirect mode of New count), calculate the temperature information of each data (existing with document form) in the storage; By the metadata information on the resolve Name node, obtain the distributed intelligence of file; Periodically there is the ground of renewal information generated data Temperature Distribution message to send to central server with above-mentioned.
Described server info acquisition module is deployed on the back end of HDFS cluster, described data temperature collect module and data staging proxy module are deployed on the namenode of described HDFS cluster, and described data staging administration module is deployed on the described central server.
Described server state message comprises hardware configuration and the running state information of back end, and described data Temperature Distribution message comprises data temperature message and data distribution message.
Described message includes message header and message body, and described message header comprises central server title, IP address, node ID, encryption method, verification and timestamp; Described message body comprises through message header specifies node hardware configuration, node running status, data temperature and data after encryption method is encrypted to distribute.
The outer data staging order of described data staging proxy module receiving belt, resolving the outer data staging order of described band obtains and needs the Mobile data block message, and institute's obtaining information informed namenode, described namenode copies target data block to destination node when receiving information, and the data block on the deletion source data node, after needing Mobile data piece message all to obtain end, namenode sends success message to the data staging proxy module, and described data staging proxy module sends acknowledge message to the data staging administration module.
The described Mobile data block message that needs comprises target data block ID, source data node ID and destination node ID that needs are mobile.
Such as Fig. 3, described central server comprises message sink module, information persistence module, information cache module, data staging administration module, instruction processing module, instruction sending module, analysis engine module node and Registering modules.
Described message sink module receives server state message and the data Temperature Distribution message that sends respectively from back end and namenode, and described data staging administration module is resolved and be sent to message;
Described data staging administration module generates the outer data staging order of band, and periodically sends to namenode;
Described information cache module receives the message from the message sink module, be formed with effective information through processing and deposit the information cache district in, administer and maintain simultaneously information cache district content, and will sending to the data staging administration module after the information classification, described information cache district content comprises establishment, renewal and the deletion of information;
When the information cache district exceeded capacity or time counter end or service stopping, described information persistence module was written to disk to the message after processing through information cache module, and the data staging administration module is sent into the information cache district from the disk reading information;
Server state message and data Temperature Distribution message that described analysis engine module information cache module sends form data Temperature Distribution formula polar plot, and the state of service data Temperature Distribution polar plot upgrade; Form the outer data staging instruction of band according to data Temperature Distribution formula polar plot, send to the instruction processing module;
Described instruction processing module is processed to form the instruction encoding that can be sent to by instruction sending module specific node according to the content of analysis engine module output;
Described instruction sending module receives the outer data staging order of the band that generates from described data staging administration module, and sends instruction according to the reception instruction to destination node;
Described node Registering modules receives the log-on message from the information cache district, and the information of registration or renewal specified node (form the ID of node, supply the operations such as analysis engine completion status information and the parsing of data temperature distribution information, node identification, generation instruction).
Should be noted that at last: above embodiment is only in order to illustrate that technical scheme of the present invention is not intended to limit, although with reference to above-described embodiment the present invention is had been described in detail, those of ordinary skill in the field are to be understood that: still can make amendment or be equal to replacement the specific embodiment of the present invention, and do not break away from any modification of spirit and scope of the invention or be equal to replacement, it all should be encompassed in the middle of the claim scope of the present invention.
Claims (9)
1. the distributed cloud based on Hadoop is stored the automatic classification data management system, it is characterized in that: described system comprises node server and central server, described node server acquisition server status message and data Temperature Distribution message, and the message that gathers is sent to the data staging administration module of described central server.
2. the distributed cloud based on Hadoop according to claim 1 is stored the automatic classification data management system, and it is characterized in that: described node server comprises server info acquisition module, data temperature collect module and data staging proxy module; Described server info acquisition module and data temperature collect module be acquisition server status message and data Temperature Distribution message respectively, and respectively the message that gathers is sent to described data staging administration module.
3. the distributed cloud based on Hadoop according to claim 2 is stored the automatic classification data management system, it is characterized in that: described server info acquisition module is deployed on the back end of HDFS cluster, described data temperature collect module and data staging proxy module are deployed on the namenode of described HDFS cluster, and described data staging administration module is deployed on the described central server.
4. the distributed cloud based on Hadoop according to claim 2 is stored the automatic classification data management system, it is characterized in that: described server state message comprises hardware configuration and the running state information of back end, and described data Temperature Distribution message comprises data temperature message and data distribution message.
5. the distributed cloud based on Hadoop according to claim 1 is stored the automatic classification data management system, it is characterized in that: described message includes message header and message body, and described message header comprises central server title, IP address, node ID, encryption method, verification and timestamp; Described message body comprises through message header specifies node hardware configuration, node running status, data temperature and data after encryption method is encrypted to distribute.
6. the distributed cloud based on Hadoop according to claim 1 is stored the automatic classification data management system, it is characterized in that: the outer data staging order of described data staging proxy module receiving belt, resolving the outer data staging order of described band obtains and needs the Mobile data block message, and institute's obtaining information informed namenode, described namenode copies target data block to destination node when receiving information, and the data block on the deletion source data node, after needing Mobile data piece message all to obtain end, namenode sends success message to the data staging proxy module, and described data staging proxy module sends acknowledge message to the data staging administration module.
7. the distributed cloud based on Hadoop according to claim 6 is stored the automatic classification data management system, it is characterized in that: the described Mobile data block message that needs comprises target data block ID, source data node ID and destination node ID that needs are mobile.
8. arbitrary described distributed cloud based on Hadoop is stored the automatic classification data management system according to claim 1-3, and it is characterized in that: described central server comprises message sink module, information persistence module, information cache module, data staging administration module, instruction processing module, instruction sending module, analysis engine module node and Registering modules.
9. arbitrary described distributed cloud based on Hadoop is stored the automatic classification data management system according to claim 8, it is characterized in that: described message sink module receives server state message and the data Temperature Distribution message that sends respectively from back end and namenode, and described data staging administration module is resolved and be sent to message;
Described data staging administration module generates the outer data staging order of band, and periodically sends to namenode;
Described information cache module receives the message from the message sink module, be formed with effective information through processing and deposit the information cache district in, administer and maintain simultaneously information cache district content, and will sending to the data staging administration module after the information classification, described information cache district content comprises establishment, renewal and the deletion of information;
When the information cache district exceeded capacity or time counter end or service stopping, described information persistence module was written to disk to the message after processing through information cache module, and the data staging administration module is sent into the information cache district from the disk reading information;
Server state message and data Temperature Distribution message that described analysis engine module information cache module sends form data Temperature Distribution formula polar plot, and the state of service data Temperature Distribution polar plot upgrade; Form the outer data staging instruction of band according to data Temperature Distribution formula polar plot, send to the instruction processing module;
Described instruction processing module is processed to form the instruction encoding that can be sent to by instruction sending module specific node according to the content of analysis engine module output;
Described instruction sending module receives the outer data staging order of the band that generates from described data staging administration module, and sends instruction according to the reception instruction to destination node;
Described node Registering modules receives the log-on message from the information cache district, and the information of registration or renewal specified node.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201210499413.XA CN103023995B (en) | 2012-11-29 | 2012-11-29 | A kind of distributed cloud based on Hadoop stores automatic classification data management system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201210499413.XA CN103023995B (en) | 2012-11-29 | 2012-11-29 | A kind of distributed cloud based on Hadoop stores automatic classification data management system |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN103023995A true CN103023995A (en) | 2013-04-03 |
| CN103023995B CN103023995B (en) | 2015-09-09 |
Family
ID=47972119
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201210499413.XA Active CN103023995B (en) | 2012-11-29 | 2012-11-29 | A kind of distributed cloud based on Hadoop stores automatic classification data management system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN103023995B (en) |
Cited By (14)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103336670A (en) * | 2013-06-04 | 2013-10-02 | 华为技术有限公司 | Method and device for automatic distribution of data blocks based on data temperature |
| CN103780622A (en) * | 2014-01-24 | 2014-05-07 | 华中科技大学 | Data classification and encryption method for cloud storage |
| CN104021503A (en) * | 2014-05-08 | 2014-09-03 | 国家电网公司 | Relaying cloud establishing method based on virtualized Hadoop cluster |
| CN104135516A (en) * | 2014-07-29 | 2014-11-05 | 浪潮软件集团有限公司 | Distributed cloud storage method based on industry data acquisition |
| CN104462577A (en) * | 2014-12-29 | 2015-03-25 | 北京奇艺世纪科技有限公司 | Data storing method and device |
| CN105930102A (en) * | 2016-05-06 | 2016-09-07 | 歌尔声学股份有限公司 | MEMS product test data synchronous and safe transfer method and system |
| CN106470242A (en) * | 2016-09-07 | 2017-03-01 | 东南大学 | A kind of large scale scale heterogeneous clustered node fast quantification stage division of cloud data center |
| CN107135274A (en) * | 2017-06-20 | 2017-09-05 | 郑州云海信息技术有限公司 | The memory management method and device of a kind of distributed cluster system |
| CN108600281A (en) * | 2017-03-16 | 2018-09-28 | 杭州海康威视数字技术股份有限公司 | A kind of cloud storage system, media data storage method and system |
| CN109361560A (en) * | 2018-01-24 | 2019-02-19 | 广州Tcl智能家居科技有限公司 | A kind of clustered node Communication processing method, system, storage medium and server |
| CN111177486A (en) * | 2019-12-19 | 2020-05-19 | 四川蜀天梦图数据科技有限公司 | Message transmission method and device in distributed graph calculation process |
| CN113407620A (en) * | 2020-03-17 | 2021-09-17 | 北京信息科技大学 | Data block placement method and system based on heterogeneous Hadoop cluster environment |
| CN115190168A (en) * | 2022-07-08 | 2022-10-14 | 苏州浪潮智能科技有限公司 | Edge server management system and server cluster |
| CN118193503A (en) * | 2024-05-17 | 2024-06-14 | 维沃多科技（北京）有限公司 | Hierarchical management system for server center data |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101957863A (en) * | 2010-10-14 | 2011-01-26 | 广州从兴电子开发有限公司 | Data parallel processing method, device and system |
| CN102263822A (en) * | 2011-07-22 | 2011-11-30 | 北京星网锐捷网络技术有限公司 | Distributed cache control method, system and device |
| CN102638566A (en) * | 2012-02-28 | 2012-08-15 | 山东大学 | BLOG system running method based on cloud storage |
| CN102646121A (en) * | 2012-02-23 | 2012-08-22 | 武汉大学 | Two-stage storage method combined with RDBMS (relational database management system) and Hadoop cloud storage |
-
2012
- 2012-11-29 CN CN201210499413.XA patent/CN103023995B/en active Active
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101957863A (en) * | 2010-10-14 | 2011-01-26 | 广州从兴电子开发有限公司 | Data parallel processing method, device and system |
| CN102263822A (en) * | 2011-07-22 | 2011-11-30 | 北京星网锐捷网络技术有限公司 | Distributed cache control method, system and device |
| CN102646121A (en) * | 2012-02-23 | 2012-08-22 | 武汉大学 | Two-stage storage method combined with RDBMS (relational database management system) and Hadoop cloud storage |
| CN102638566A (en) * | 2012-02-28 | 2012-08-15 | 山东大学 | BLOG system running method based on cloud storage |
Non-Patent Citations (1)
| Title |
|---|
| 王峰，雷葆华: "Hadoop分布式文件系统的模型分析", 《研究与开发》 * |
Cited By (24)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103336670A (en) * | 2013-06-04 | 2013-10-02 | 华为技术有限公司 | Method and device for automatic distribution of data blocks based on data temperature |
| CN103336670B (en) * | 2013-06-04 | 2016-11-23 | 华为技术有限公司 | A kind of method and apparatus data block being distributed automatically based on data temperature |
| CN103780622B (en) * | 2014-01-24 | 2016-09-28 | 华中科技大学 | A kind of data classification encryption method of facing cloud storage |
| CN103780622A (en) * | 2014-01-24 | 2014-05-07 | 华中科技大学 | Data classification and encryption method for cloud storage |
| CN104021503A (en) * | 2014-05-08 | 2014-09-03 | 国家电网公司 | Relaying cloud establishing method based on virtualized Hadoop cluster |
| CN104135516A (en) * | 2014-07-29 | 2014-11-05 | 浪潮软件集团有限公司 | Distributed cloud storage method based on industry data acquisition |
| CN104135516B (en) * | 2014-07-29 | 2017-04-05 | 浪潮软件集团有限公司 | Distributed cloud storage method based on industry data acquisition |
| CN104462577A (en) * | 2014-12-29 | 2015-03-25 | 北京奇艺世纪科技有限公司 | Data storing method and device |
| CN104462577B (en) * | 2014-12-29 | 2018-04-13 | 北京奇艺世纪科技有限公司 | A kind of date storage method and device |
| CN105930102A (en) * | 2016-05-06 | 2016-09-07 | 歌尔声学股份有限公司 | MEMS product test data synchronous and safe transfer method and system |
| CN105930102B (en) * | 2016-05-06 | 2018-12-21 | 歌尔股份有限公司 | A kind of micro electronmechanical product test data synchronous safety transfer method and system |
| CN106470242A (en) * | 2016-09-07 | 2017-03-01 | 东南大学 | A kind of large scale scale heterogeneous clustered node fast quantification stage division of cloud data center |
| CN106470242B (en) * | 2016-09-07 | 2019-07-19 | 东南大学 | A kind of large scale scale heterogeneous clustered node fast quantification stage division of cloud data center |
| CN108600281A (en) * | 2017-03-16 | 2018-09-28 | 杭州海康威视数字技术股份有限公司 | A kind of cloud storage system, media data storage method and system |
| CN107135274A (en) * | 2017-06-20 | 2017-09-05 | 郑州云海信息技术有限公司 | The memory management method and device of a kind of distributed cluster system |
| CN109361560A (en) * | 2018-01-24 | 2019-02-19 | 广州Tcl智能家居科技有限公司 | A kind of clustered node Communication processing method, system, storage medium and server |
| CN111177486A (en) * | 2019-12-19 | 2020-05-19 | 四川蜀天梦图数据科技有限公司 | Message transmission method and device in distributed graph calculation process |
| CN111177486B (en) * | 2019-12-19 | 2020-09-08 | 四川蜀天梦图数据科技有限公司 | Message transmission method and device in distributed graph calculation process |
| CN113407620A (en) * | 2020-03-17 | 2021-09-17 | 北京信息科技大学 | Data block placement method and system based on heterogeneous Hadoop cluster environment |
| CN113407620B (en) * | 2020-03-17 | 2023-04-21 | 北京信息科技大学 | Data block placement method and system based on heterogeneous Hadoop cluster environment |
| CN115190168A (en) * | 2022-07-08 | 2022-10-14 | 苏州浪潮智能科技有限公司 | Edge server management system and server cluster |
| CN115190168B (en) * | 2022-07-08 | 2023-08-04 | 苏州浪潮智能科技有限公司 | Edge server management system and server cluster |
| CN118193503A (en) * | 2024-05-17 | 2024-06-14 | 维沃多科技（北京）有限公司 | Hierarchical management system for server center data |
| CN118193503B (en) * | 2024-05-17 | 2024-07-12 | 维沃多科技（北京）有限公司 | Hierarchical management system for server center data |
Also Published As
| Publication number | Publication date |
|---|---|
| CN103023995B (en) | 2015-09-09 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN103023995A (en) | Hadoop-based distributive type cloud storage type automatic grading data managing system | |
| CA2935215C (en) | Hierarchical chunking of objects in a distributed storage system | |
| CN103559217B (en) | A kind of massive multicast data towards isomeric data storehouse warehouse-in implementation method | |
| CA2871313C (en) | Method and system for managing power grid data | |
| US9842153B2 (en) | Usage and bandwidth utilization collection mechanism for a distributed storage system | |
| CN105335513B (en) | A kind of distributed file system and file memory method | |
| TW202111564A (en) | Log-structured storage systems | |
| CN103581332B (en) | HDFS framework and pressure decomposition method for NameNodes in HDFS framework | |
| CN103440244A (en) | Large-data storage and optimization method | |
| CN103095806B (en) | A kind of load balancing management system of the real-time dataBase system towards bulk power grid | |
| CN103533058A (en) | HDFS (Hadoop distributed file system)/Hadoop storage cluster-oriented resource monitoring system and HDFS/Hadoop storage cluster-oriented resource monitoring method | |
| CN103763368B (en) | A kind of method of data synchronization across data center | |
| CN108573029A (en) | Method, device and storage medium for acquiring network access relation data | |
| Copie et al. | Benchmarking cloud databases for the requirements of the internet of things | |
| CN103853612A (en) | Method for reading data based on digital family content under distributed storage | |
| CN106020713A (en) | File storage method based on buffer area | |
| CN105760391A (en) | Data dynamic redistribution method and system, data node and name node | |
| CN103281383B (en) | A kind of time sequence information recording method of Based on Distributed data source | |
| CN104038314A (en) | Novel safety-monitoring networking real-time dynamic data transmission system and method | |
| Chen et al. | Big data storage architecture design in cloud computing | |
| Dongsheng et al. | Distributed cache memory data migration strategy based on cloud computing | |
| CN105677853A (en) | Data storage method and device based on big data technology framework | |
| KR102459465B1 (en) | Method and system for distributed data storage integrated in-network computing in information centric networking | |
| Chen et al. | Research on Information Interaction Technology Between Multi-service Application Systems of Power Grid | |
| CN109784064A (en) | Computer Data Security management system |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C14 | Grant of patent or utility model | ||
| GR01 | Patent grant |