CN106294010A - The storage method and system of big data in distributed system - Google Patents
The storage method and system of big data in distributed system Download PDFInfo
- Publication number
- CN106294010A CN106294010A CN201610640763.1A CN201610640763A CN106294010A CN 106294010 A CN106294010 A CN 106294010A CN 201610640763 A CN201610640763 A CN 201610640763A CN 106294010 A CN106294010 A CN 106294010A
- Authority
- CN
- China
- Prior art keywords
- storage
- data
- distributed
- backup
- big data
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/07—Responding to the occurrence of a fault, e.g. fault tolerance
- G06F11/14—Error detection or correction of the data by redundancy in operation
- G06F11/1402—Saving, restoring, recovering or retrying
- G06F11/1446—Point-in-time backing up or restoration of persistent data
- G06F11/1448—Management of the data involved in backup or backup restore
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Quality & Reliability (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
The invention provides the storage method and system of big data in a kind of distributed system, described method comprises the steps: to receive the data needing storage;After this data storage being completed, search the position of its distributed storage, need the data of storage in the backup of the position of this distributed storage.The technical scheme that the present invention provides has the advantage that safety is high.
Description
Technical field
The present invention relates to big data fields, particularly relate to the storage method and system of big data in a kind of distributed system.
Background technology
Big data (big data), or claim flood tide data, refer to need new tupe just can have higher decision-making
Power, insight and the magnanimity of process optimization ability, high growth rate and diversified information assets.At Victor mayer-She En
In " big data age " that Burger and Kenneth Cook are write, big data refer to without random analysis method (sampling survey) so
Shortcut, and use all data be analyzed process.The 4V feature of big data: Volume (in a large number), Velocity (at a high speed),
Variety (various), Value (value).
Existing big data cannot be carried out back-up processing, and Information Security is low.
Summary of the invention
A kind of storage method of big data in distributed system is provided, which solves low the lacking of prior art Information Security
Point.
On the one hand, it is provided that a kind of storage method of big data in distributed system, described method comprises the steps:
Receive the data needing storage;
After this data storage being completed, search the position of its distributed storage;
The data of storage are needed in the backup of the position of this distributed storage.
Optionally, described method also includes:
After distributed storage completes, send backup completion message.
Optionally, described method also includes:
Prompting residue memory capacity.
Second aspect, it is provided that a kind of provide the storage system of big data in distributed system, described system includes:
Receive unit, for receiving the data needing storage;
Search unit, after this data storage being completed, search the position of its distributed storage;
Backup units, for needing the data of storage in the backup of the position of this distributed storage.
Optionally, described system also includes:
Transmitting element, for after distributed storage completes, sends backup completion message.
Optionally, described system also includes:
Tip element, for prompting residue memory capacity.
The technical scheme that the specific embodiment of the invention provides receives the data needing storage, this data storage is completed
After, search the position of its distributed storage, need the data of storage in the backup of the position of this distributed storage, so it can be real
The advantage of existing back-up processing.
Accompanying drawing explanation
In order to be illustrated more clearly that the embodiment of the present invention or technical scheme of the prior art, below will be to embodiment or existing
In having technology to describe, the required accompanying drawing used is briefly described, it should be apparent that, the accompanying drawing in describing below is only this
Some embodiments of invention, for those of ordinary skill in the art, on the premise of not paying creative work, it is also possible to
Other accompanying drawing is obtained according to these accompanying drawings.
The flow chart of the storage method of big data in a kind of distributed system that Fig. 1 provides for the present invention;
The structure chart of the storage system of big data in a kind of distributed system that Fig. 2 provides for the present invention.
Detailed description of the invention
Below in conjunction with the accompanying drawing in the embodiment of the present invention, the technical scheme in the embodiment of the present invention is carried out clear, complete
Describe, it is clear that described embodiment is only a part of embodiment of the present invention rather than whole embodiments wholely.Based on
Embodiment in the present invention, it is every other that those of ordinary skill in the art are obtained under not making creative work premise
Embodiment, broadly falls into the scope of protection of the invention.
The storage method of big data in distributed system is provided for the present invention the first better embodiment refering to Fig. 1, Fig. 1
Flow chart, the method is completed by server, and the method is as it is shown in figure 1, comprise the steps:
Step S101, reception need the data of storage;
Step S102, this data storage is completed after, search the position of its distributed storage;
Step S103, the data stored at the position of this distributed storage backup needs.
The technical scheme that the specific embodiment of the invention provides receives the data needing storage, this data storage is completed
After, search the position of its distributed storage, need the data of storage in the backup of the position of this distributed storage, so it can be real
The advantage of existing back-up processing.
Optionally, said method can also include after step s 103:
After distributed storage completes, send backup completion message.
Optionally, said method can also include after step s 103:
Prompting residue memory capacity.
The storage system of big data in distributed system is provided for the present invention the second better embodiment refering to Fig. 2, Fig. 2,
This system includes:
Receive unit 201, for receiving the data needing storage;
Search unit 202, after this data storage being completed, search the position of its distributed storage;
Backup units 203, for needing the data of storage in the backup of the position of this distributed storage.
The technical scheme that the specific embodiment of the invention provides receives the data needing storage, this data storage is completed
After, search the position of its distributed storage, need the data of storage in the backup of the position of this distributed storage, so it can be real
The advantage of existing back-up processing.
Optionally, said system can also include:
Transmitting element 204, for after distributed storage completes, sends backup completion message.
Optionally, said system can also include:
Tip element 205, for prompting residue memory capacity.
It should be noted that for aforesaid each method embodiment or embodiment, in order to be briefly described, therefore by its all table
Stating as a series of combination of actions, but those skilled in the art should know, the present invention is not by described sequence of movement
Restriction, because of according to the present invention, some step can use other orders or carry out simultaneously.Secondly, people in the art
Member also should know, embodiment described in the specification or embodiment belong to preferred embodiment, involved action and list
Necessary to the unit not necessarily present invention.
In the above-described embodiments, the description to each embodiment all emphasizes particularly on different fields, and does not has the portion described in detail in certain embodiment
Point, may refer to the associated description of other embodiments.
Step in embodiment of the present invention method can carry out order according to actual needs and adjust, merges and delete.
Unit in embodiment of the present invention device can merge according to actual needs, divides and delete.This area
The feature of the different embodiments described in this specification and different embodiment can be combined or combine by technical staff.
Through the above description of the embodiments, those skilled in the art it can be understood that to the present invention permissible
Realize with hardware, or firmware realizes, or combinations thereof mode realizes.When implemented in software, can be by above-mentioned functions
It is stored in computer-readable medium or is transmitted as the one or more instructions on computer-readable medium or code.Meter
Calculation machine computer-readable recording medium includes computer-readable storage medium and communication media, and wherein communication media includes being easy to from a place to another
The individual local any medium transmitting computer program.Storage medium can be any usable medium that computer can access.With
As a example by this but be not limited to: computer-readable medium can include random access memory (Random Access Memory,
RAM), read only memory (Read-Only Memory, ROM), EEPROM (Electrically
Erasable Programmable Read-Only Memory, EEPROM), read-only optical disc (Compact Disc Read-
Only Memory, CD-ROM) or other optical disc storage, magnetic disk storage medium or other magnetic storage apparatus or can be used in
Carry or store and there is instruction or the desired program code of data structure form can be by any other of computer access
Medium.In addition.Any connection can be suitable become computer-readable medium.Such as, if software is to use coaxial cable, light
Fine optical cable, twisted-pair feeder, Digital Subscriber Line (DigitalSubscriber Line, DSL) or such as infrared ray, radio and micro-
The wireless technology of ripple etc from website, server or other remote source, then coaxial cable, optical fiber cable, multiple twin
The wireless technology of line, DSL or such as infrared ray, wireless and microwave etc be included in affiliated medium fixing in.Such as the present invention
Being used, dish (Disk) and dish (disc) include compressing laser disc (CD), laser dish, laser disc, Digital Versatile Disc (DVD), soft
Dish and Blu-ray Disc, the duplication data of the usual magnetic of its mid-game, dish then carrys out the duplication data of optics with laser.Above combination above
Within should also be as being included in the protection domain of computer-readable medium.
In a word, the foregoing is only the preferred embodiment of technical solution of the present invention, be not intended to limit the present invention's
Protection domain.All within the spirit and principles in the present invention, any modification, equivalent substitution and improvement etc. made, should be included in
Within protection scope of the present invention.
Claims (6)
1. the storage method of big data in a distributed system, it is characterised in that described method comprises the steps:
Receive the data needing storage;
After this data storage being completed, search the position of its distributed storage;
The data of storage are needed in the backup of the position of this distributed storage.
Method the most according to claim 1, it is characterised in that described method also includes:
After distributed storage completes, send backup completion message.
Method the most according to claim 1, it is characterised in that described method also includes:
Prompting residue memory capacity.
4. one kind provides the storage system of big data in distributed system, it is characterised in that described system includes:
Receive unit, for receiving the data needing storage;
Search unit, after this data storage being completed, search the position of its distributed storage;
Backup units, for needing the data of storage in the backup of the position of this distributed storage.
System the most according to claim 4, it is characterised in that described system also includes:
Transmitting element, for after distributed storage completes, sends backup completion message.
System the most according to claim 4, it is characterised in that described system also includes:
Tip element, for prompting residue memory capacity.
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201610640763.1A CN106294010A (en) | 2016-08-08 | 2016-08-08 | The storage method and system of big data in distributed system |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201610640763.1A CN106294010A (en) | 2016-08-08 | 2016-08-08 | The storage method and system of big data in distributed system |
Publications (1)
Publication Number | Publication Date |
---|---|
CN106294010A true CN106294010A (en) | 2017-01-04 |
Family
ID=57666294
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN201610640763.1A Pending CN106294010A (en) | 2016-08-08 | 2016-08-08 | The storage method and system of big data in distributed system |
Country Status (1)
Country | Link |
---|---|
CN (1) | CN106294010A (en) |
Cited By (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN106897031A (en) * | 2017-03-01 | 2017-06-27 | 深圳市博信诺达经贸咨询有限公司 | It is applied to the storage method and system of big data |
WO2018027466A1 (en) * | 2016-08-08 | 2018-02-15 | 马岩 | Method and system for storing big data in distributed system |
WO2018157331A1 (en) * | 2017-03-01 | 2018-09-07 | 深圳市博信诺达经贸咨询有限公司 | Storage method and system applied to big data |
Citations (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN102880531A (en) * | 2012-09-27 | 2013-01-16 | 新浪网技术(中国)有限公司 | Database backup system and backup method and slave database server of database backup system |
CN103095754A (en) * | 2011-10-31 | 2013-05-08 | 台达电子工业股份有限公司 | Distributed document system and back-up position decision method thereof |
CN105530294A (en) * | 2015-12-04 | 2016-04-27 | 中科院成都信息技术股份有限公司 | Mass data distributed storage method |
-
2016
- 2016-08-08 CN CN201610640763.1A patent/CN106294010A/en active Pending
Patent Citations (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN103095754A (en) * | 2011-10-31 | 2013-05-08 | 台达电子工业股份有限公司 | Distributed document system and back-up position decision method thereof |
CN102880531A (en) * | 2012-09-27 | 2013-01-16 | 新浪网技术(中国)有限公司 | Database backup system and backup method and slave database server of database backup system |
CN105530294A (en) * | 2015-12-04 | 2016-04-27 | 中科院成都信息技术股份有限公司 | Mass data distributed storage method |
Cited By (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
WO2018027466A1 (en) * | 2016-08-08 | 2018-02-15 | 马岩 | Method and system for storing big data in distributed system |
CN106897031A (en) * | 2017-03-01 | 2017-06-27 | 深圳市博信诺达经贸咨询有限公司 | It is applied to the storage method and system of big data |
WO2018157331A1 (en) * | 2017-03-01 | 2018-09-07 | 深圳市博信诺达经贸咨询有限公司 | Storage method and system applied to big data |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
CN106294010A (en) | The storage method and system of big data in distributed system | |
CN106293528A (en) | Dropbox stores the method and system of big data | |
CN106294011A (en) | The big date storage method of sort-type and system | |
CN106292662A (en) | Robot trajectory's method for drafting and system | |
CN106250538A (en) | Wechat is shared the method and system of big data | |
CN106294637A (en) | Realize the method and system of phonetic search | |
CN106250516A (en) | Synonym application process in big data search and system | |
CN106296428A (en) | Horizontal coil winding machine rotates forward control method and system | |
CN106157196A (en) | The evaluation methodology in house and system | |
CN106241504A (en) | The method and system of foot Bit andits control vertical coil winding machine | |
CN106161799A (en) | The method for closing of application program of mobile phone and system | |
CN106294645A (en) | Different part of speech realization method and systems in big data search | |
CN106253787A (en) | The rotating speed method and system of closed loop control horizontal coil winding machine | |
CN106250509A (en) | Key class searching method and system in big data | |
CN106250535A (en) | Application process that key word stores in big data and system | |
CN106326033A (en) | Real-time backup method and system based on big data | |
CN106254662A (en) | Interior of mobile phone control method and system | |
CN106303036A (en) | The hidden method of app and system under specific use scene | |
CN106241503A (en) | Vertical coil winding machine control method based on pressure and system | |
CN106296859A (en) | The attendance recording method of GPRS and system in security protection | |
CN106295818A (en) | Customization method and system when of English course | |
CN106157195A (en) | Property price method for drafting and system | |
CN106326875A (en) | Security protection fingerprint recognition method and system | |
CN106294711A (en) | Different part of speech realization method and systems in big data search | |
CN106094911A (en) | Closed loop control application process in vertical coil winding machine and system |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
C06 | Publication | ||
PB01 | Publication | ||
C10 | Entry into substantive examination | ||
SE01 | Entry into force of request for substantive examination | ||
RJ01 | Rejection of invention patent application after publication |
Application publication date: 20170104 |
|
RJ01 | Rejection of invention patent application after publication |