CN105187551A - Distributed computing method based on cloud platform - Google Patents
Distributed computing method based on cloud platform Download PDFInfo
- Publication number
- CN105187551A CN105187551A CN201510629235.1A CN201510629235A CN105187551A CN 105187551 A CN105187551 A CN 105187551A CN 201510629235 A CN201510629235 A CN 201510629235A CN 105187551 A CN105187551 A CN 105187551A
- Authority
- CN
- China
- Prior art keywords
- file
- segmentation
- value
- check value
- segmentation object
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/10—Protocols in which an application is distributed across nodes in the network
- H04L67/1097—Protocols in which an application is distributed across nodes in the network for distributed storage of data in networks, e.g. transport arrangements for network file system [NFS], storage area networks [SAN] or network attached storage [NAS]
Abstract
The invention provides a distributed computing method based on a cloud platform. The method comprises the following steps: splitting a file to be stored into a plurality of segmented objects, establishing an index file to record all segments, and transmitting the plurality of segmented objects to a cloud storage server side by a cloud storage client; and when downloading files, retrieving corresponding segmented objects through the index file and then aggregating the files into original files. The invention provides the distributed computing method based on the cloud platform, which provides a big data files storage solution for the client, facilitates users to call, expands easily, breaks through the limit on the file size by the cloud storage service and greatly improves the transmission speed of files.
Description
Technical field
The present invention relates to cloud computing, particularly a kind of distributed computing method based on cloud platform.
Background technology
At present in the face of the storage demand of large data, there is very large deficiency in the direction such as reliability, carrying cost of memory capacity, data in traditional date storage method.Cloud storage has the advantage of self uniqueness, can carry out expanding and configuring dynamically, neatly, makes user can be obtained the software and hardware resources of cloud storage as required by network.The object stores service of cloud computing platform can be used for building redundancy, extendible storage cluster, and memory capacity can reach PB level, in conjunction with the authentication service of cloud computing platform, can provide safe and reliable cloud stores service.But existing stores service still exists that some is not enough, the file of arbitrary size can not be stored, and be only the solution of server end, flexibility and autgmentability poor.
Summary of the invention
For solving the problem existing for above-mentioned prior art, the present invention proposes a kind of distributed computing method based on cloud platform, comprising:
Carried out being split as multiple segmentation object by file to be stored, and set up index file to record all segmentations, cloud stores client and described multiple segmentation object is sent to cloud storage server end; When download file, after retrieving corresponding segmentation object by index file, aggregate into original.
Preferably, described server end comprises following four layers in logic: presentation layer, for user interactions, the authorization information of configure user, the quantity of thread pool, for user provides the synchronous and asynchronous interface of upload file and download file; Logical layer, for user provides logic and controlling functions, the authentication vs. authorization of storage policy, user, task workflow, task scheduling, log recording; Service layer, provides stores service and authentication service; Resource layer, comprise disk, the network switch, router and other resource, all storing process realize in client; Described index file record forms the information of all segmentation object of a file, comprises the binary data length of the Container Name at segmentation object place, the name of segmentation object, segmentation object side-play amount hereof, segmentation object; When the information of search index file, the metadata of index file turns to all segmentation object information sequences the character string of XML format, according to the title of Container Name and segmentation object during download file, the position of location cloud storage server end segmentation object, and according to side-play amount and fragment size, the position of segmentation object in original, location.
Preferably, described and set up index file to record all segmentations, comprise further: the metadata of index of reference file represents the metadata of original, the metadata of described index file comprises: the HASH check value of (1) original document, for carrying out HASH verification to file after download file; (2) total length of original document; Defined attribute Etag, as the HASH check value for whole file, the Etag value of segmentation object is the HASH check value of file fragmentation, and the Etag value of index file is the HASH check value of XML character string; During upload file, add Etag value in Http header file, the HASH value of cloud stores service object of contrast server end after uploading end and Etag value, to verify the consistency of data before and after transmission;
During upload file, first determining whether to need segmentation to upload according to the size of file, if need segmentation, is multiple segmentation object and an index file by file transform; When uploading whole file, upload file segmentation and upload index file, the HASH check value of equal calculated data, Etag key-value pair is added in the header file uploading HTTP request, cloud stores service completes the consistency desired result of data according to Etag value, when uploading index file, except calculating the HASH check value of its XML character string, also calculate the HASH check value of whole file, the key-value pair as original document check value adds in Http header file; For high in the clouds object to be downloaded, first must verify whether this object is index file, if index file, the then segmentation object information of parsing XML format, download segmentation object, and merge mutually with the segmentation of downloading, after whole segmentation has all been downloaded, compare the HASH check value of the file after download and the HASH check value of original; If the corresponding single object of file, then the HASH check value of file is the Etag value of object, if the corresponding index file of file and multiple segmentation object, then the HASH check value of file is the original document check value of index file;
In the implementation, when user calls the upload command of cloud storage client, the task of uploading is handed to files passe class, and files passe class has 4 methods: preprocessing tasks, process upload task, process follow-up work, handling procedure extremely; Preprocessing tasks is carried out file fragmentation, is calculated the HASH value of each segmentation; The task of uploading comprises to be uploaded general object and uploads index file; Preprocessing tasks and task of uploading relate to and read hard disk, network service, and files passe class can give task thread pool to perform; Download file is realized by file download class, and file download class and files passe class achieve identical interface, has following 4 methods: preprocessing tasks, Processing tasks, process follow-up work, handling procedure are extremely; Wherein the HASH of preprocessing tasks, download file, file verifies these 3 processes and gives thread pool to perform; Segmentation object aggregates into the operation of original, directly be polymerized in the process downloaded, the direct side-play amount according to segmentation object is written to the assigned address of original, when all segmental files are all downloaded complete, and original just complete downloading on the disk of client.
The present invention compared to existing technology, has the following advantages:
The present invention proposes a kind of distributed computing method based on cloud platform, for client provides large data files storage solution, be convenient to user and call, be easy to expansion, breach the restriction of cloud stores service to file size, substantially increase the transmission speed of file.
Accompanying drawing explanation
Fig. 1 is the flow chart of the distributed computing method based on cloud platform according to the embodiment of the present invention.
Embodiment
Detailed description to one or more embodiment of the present invention is hereafter provided together with the accompanying drawing of the diagram principle of the invention.Describe the present invention in conjunction with such embodiment, but the invention is not restricted to any embodiment.Scope of the present invention is only defined by the claims, and the present invention contain many substitute, amendment and equivalent.Set forth many details in the following description to provide thorough understanding of the present invention.These details are provided for exemplary purposes, and also can realize the present invention according to claims without some in these details or all details.
An aspect of of the present present invention provides a kind of distributed computing method based on cloud platform.Fig. 1 is the distributed computing method flow chart based on cloud platform according to the embodiment of the present invention.The deficiency that the present invention stores to solve large data files, has designed and Implemented the storage means based on distributed storage platform.The present invention, by improving the level framework of cloud storage system, formulates the flow process of file storage policy and upload and download.And the solution of the present invention is the solution of client, is convenient to user and calls, be easy to expansion, breach the restriction of cloud stores service to file size, substantially increase the upload and download speed of file.
In order to safety, store GB level large data files fast, cloud storage system is divided two parts by the present invention: server end and client, and server end is made up of primary file storage module and authentication module, and all storage meanss realize in client.Overall structure divides following four layers:
Presentation layer, with user interactions, can the authorization information of configure user, the quantity etc. of thread pool, for user provides the synchronous and asynchronous interface of upload file and download file.
Logical layer, for user provides logic and controlling functions, comprises storage policy, the authentication vs. authorization of user, the workflow of complex task, the scheduling, log recording etc. of task.
Service layer, for upper strata provides stores service and authentication service.
Orlop is resource layer, comprises disk, the network switch, router and other some resources.
Overall storage strategy of the present invention is: when uploading a large files, and a large files is split as a series of small documents, uploads to cloud storage server end respectively.During download, then these small documents are polymerized to a large files.At cloud storage server end, replace a large object with the object of two types:
(1) segmentation object a: large data files is split into little segmentation, upload these segmentations respectively as an independent object, these objects are called segmentation object.
(2) index file: for recording the information of all segmentation object of a formation large data files, comprises the binary data length of the Container Name at segmentation object place, the name of segmentation object, segmentation object side-play amount hereof, segmentation object.
According to these information, a large data files can be split as multiple segmentation, and multiple segmentation can be synthesized original again.That is, a large data files is made up of unique index file and multiple segmentation object at cloud storage server end.Segmentation object and general object are without any difference, but index file represents the large data files in disk, when downloading index file, needing that all segmentation object are connected into an entirety and returning to user; When the information of search index file, the association attributes of the metadata representation file of index file.For the ease of organizational information, all segmentation object information sequences are turned to the character string of XML format, as the content of index file.So the content of index file is exactly the list of all segmentation object information of XML format.According to the title of Container Name and segmentation object, the position of cloud storage server end segmentation object can be located, according to side-play amount and fragment size, the position of segmentation object in original can be located, in segment information list in xml format, segment information does not need according to they order arrangements in original.
File often has some attributes to need to be stored in cloud storage server end, because index file and original are one-to-one relationships, therefore the metadata of index of reference file can represent the metadata of original, the i.e. association attributes of original.School Affairs for the ease of carrying out file is downloaded, and index file comprises following two self-defining metadatas:
(1) the HASH check value of original document, for carrying out HASH verification to download file after download file; (2) total length of original document.
Cloud stores service defines a lot of intrinsic metadata of object, all objects, comprise segmentation object and index file, comprise attribute Etag, the Etag value of the general object uploaded as a whole is the HASH check value of whole file, the Etag value of segmentation object is the HASH check value of file fragmentation, and the Etag value of index file is the HASH check value of XML character string.During upload file, add Etag value in Http header file, the HASH value of cloud stores service object of contrast server end after uploading end and Etag value, to verify the consistency of data before and after transmission.
In order to uploading, in downloading process, ensure that data are in the consistency of client, server end, upload, download, retrieve and follow consistent flow process.During upload file, needing first to determine whether to need segmentation to upload according to the size of file, if need segmentation, is multiple segmentation object and an index file by file transform.Consistent in client with cloud storage server end in order to ensure data, when uploading whole file, upload file segmentation and upload index file, all want the HASH check value of calculated data, in the header file uploading HTTP request, add Etag key-value pair, cloud stores service can complete the consistency desired result of data according to Etag value.When uploading index file, except calculating the HASH check value of its XML character string, also need the HASH check value calculating whole large data files, the key-value pair as original document check value adds in Http header file.
Download file is corresponding with the flow process of upload file.Index file during cloud stores represents a large data files, it have recorded the relevant information of the segmentation object of composing document, general object during cloud stores can represent a file not having segmentation to upload, and also can represent a segmentation of a large data files.So, for high in the clouds object to be downloaded, first must verify that this is to liking index file or general object, if index file, then the segmentation object information of parsing XML format, downloads segmentation object, and merge mutually with the segmentation of downloading, after whole segmentation has all been downloaded.The last of two kinds of downloading modes all needs the HASH check value of the file after comparing download and the HASH check value of original, to guarantee the consistency of file.If the corresponding single object of file, then the HASH check value of file is the Etag value of object, if the corresponding index file of file and multiple segmentation object, then the HASH check value of file is the original document check value of index file.
When user calls the upload command of cloud storage client, the task of uploading can be handed to files passe class, files passe class has 4 methods: preprocessing tasks, process upload task, process follow-up work, handling procedure extremely.Preprocessing tasks is carried out file fragmentation, is calculated the HASH value of each segmentation; The task of uploading comprises to be uploaded general object (comprise and upload segmentation object) and uploads index file.Preprocessing tasks and task of uploading relate to and read hard disk, network service, and program may be caused to block, and when therefore performing preprocessing tasks and upload task, in order to improve processing speed, files passe class can give task thread pool to perform.Segmentation object and index file can be uploaded according to random order, so task of uploading is applicable to being performed by multithreading very much.
Download file function is realized by file download class, and file download class and files passe class achieve identical interface, and they have 4 same methods: preprocessing tasks, Processing tasks, process follow-up work, handling procedure are extremely.The HASH of preprocessing tasks, download file, file verifies these 3 processes and relates to network service and hard disk access, and in order to improve execution speed, these 3 tasks can give thread pool to perform.Its principle with upload corresponding.In downloading process, all segmentation object are all downloaded complete, and " polymerization " just can carry out HASH verification after becoming a large data files, therefore need to ensure that download segmental file and HASH verify precedence correct.Segmentation object aggregates into the operation of original, directly carry out " polymerization " in the process downloaded, the direct side-play amount according to segmentation object is written to the assigned address of original, when all segmental files are all downloaded complete, and original just complete downloading on the disk of client.
In sum, the present invention proposes a kind of distributed computing method based on cloud platform, for client provides large data files storage solution, be convenient to user call, be easy to expansion, breach the restriction of cloud stores service to file size, substantially increase the transmission speed of file.
Obviously, it should be appreciated by those skilled in the art, above-mentioned of the present invention each module or each step can realize with general computing system, they can concentrate on single computing system, or be distributed on network that multiple computing system forms, alternatively, they can realize with the executable program code of computing system, thus, they can be stored and be performed by computing system within the storage system.Like this, the present invention is not restricted to any specific hardware and software combination.
Should be understood that, above-mentioned embodiment of the present invention only for exemplary illustration or explain principle of the present invention, and is not construed as limiting the invention.Therefore, any amendment made when without departing from the spirit and scope of the present invention, equivalent replacement, improvement etc., all should be included within protection scope of the present invention.In addition, claims of the present invention be intended to contain fall into claims scope and border or this scope and border equivalents in whole change and modification.
Claims (3)
1. based on a distributed computing method for cloud platform, it is characterized in that, comprising:
Carried out being split as multiple segmentation object by file to be stored, and set up index file to record all segmentations, cloud stores client and described multiple segmentation object is sent to cloud storage server end; When download file, after retrieving corresponding segmentation object by index file, aggregate into original.
2. method according to claim 1, it is characterized in that, described server end comprises following four layers in logic: presentation layer, for user interactions, the authorization information of configure user, the quantity of thread pool, for user provides the synchronous and asynchronous interface of upload file and download file; Logical layer, for user provides logic and controlling functions, the authentication vs. authorization of storage policy, user, task workflow, task scheduling, log recording; Service layer, provides stores service and authentication service; Resource layer, comprise disk, the network switch, router and other resource, all storing process realize in client; Described index file record forms the information of all segmentation object of a file, comprises the binary data length of the Container Name at segmentation object place, the name of segmentation object, segmentation object side-play amount hereof, segmentation object; When the information of search index file, the metadata of index file turns to all segmentation object information sequences the character string of XML format, according to the title of Container Name and segmentation object during download file, the position of location cloud storage server end segmentation object, and according to side-play amount and fragment size, the position of segmentation object in original, location.
3. method according to claim 2, it is characterized in that, described and set up index file to record all segmentations, comprise further: the metadata of index of reference file represents the metadata of original, the metadata of described index file comprises: the HASH check value of (1) original document, for carrying out HASH verification to file after download file; (2) total length of original document; Defined attribute Etag, as the HASH check value for whole file, the Etag value of segmentation object is the HASH check value of file fragmentation, and the Etag value of index file is the HASH check value of XML character string; During upload file, add Etag value in Http header file, the HASH value of cloud stores service object of contrast server end after uploading end and Etag value, to verify the consistency of data before and after transmission;
During upload file, first determining whether to need segmentation to upload according to the size of file, if need segmentation, is multiple segmentation object and an index file by file transform; When uploading whole file, upload file segmentation and upload index file, the HASH check value of equal calculated data, Etag key-value pair is added in the header file uploading HTTP request, cloud stores service completes the consistency desired result of data according to Etag value, when uploading index file, except calculating the HASH check value of its XML character string, also calculate the HASH check value of whole file, the key-value pair as original document check value adds in Http header file; For high in the clouds object to be downloaded, first must verify whether this object is index file, if index file, the then segmentation object information of parsing XML format, download segmentation object, and merge mutually with the segmentation of downloading, after whole segmentation has all been downloaded, compare the HASH check value of the file after download and the HASH check value of original; If the corresponding single object of file, then the HASH check value of file is the Etag value of object, if the corresponding index file of file and multiple segmentation object, then the HASH check value of file is the original document check value of index file;
In the implementation, when user calls the upload command of cloud storage client, the task of uploading is handed to files passe class, and files passe class has 4 methods: preprocessing tasks, process upload task, process follow-up work, handling procedure extremely; Preprocessing tasks is carried out file fragmentation, is calculated the HASH value of each segmentation; The task of uploading comprises to be uploaded general object and uploads index file; Preprocessing tasks and task of uploading relate to and read hard disk, network service, and files passe class can give task thread pool to perform; Download file is realized by file download class, and file download class and files passe class achieve identical interface, has following 4 methods: preprocessing tasks, Processing tasks, process follow-up work, handling procedure are extremely; Wherein the HASH of preprocessing tasks, download file, file verifies these 3 processes and gives thread pool to perform; Segmentation object aggregates into the operation of original, directly be polymerized in the process downloaded, the direct side-play amount according to segmentation object is written to the assigned address of original, when all segmental files are all downloaded complete, and original just complete downloading on the disk of client.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201510629235.1A CN105187551A (en) | 2015-09-29 | 2015-09-29 | Distributed computing method based on cloud platform |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201510629235.1A CN105187551A (en) | 2015-09-29 | 2015-09-29 | Distributed computing method based on cloud platform |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN105187551A true CN105187551A (en) | 2015-12-23 |
Family
ID=54909390
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201510629235.1A Pending CN105187551A (en) | 2015-09-29 | 2015-09-29 | Distributed computing method based on cloud platform |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN105187551A (en) |
Cited By (22)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105681717A (en) * | 2016-03-04 | 2016-06-15 | 广州星唯信息科技有限公司 | Bus monitoring video distributed storage method and system |
| CN106021327A (en) * | 2016-05-06 | 2016-10-12 | 南开大学 | A method for constructing a network disk system supporting simultaneous reading and writing of multiple users |
| CN106131078A (en) * | 2016-08-29 | 2016-11-16 | 联动优势科技有限公司 | A kind of method and device processing service request |
| CN106294870A (en) * | 2016-08-25 | 2017-01-04 | 苏州酷伴软件科技有限公司 | Object-based distributed cloud storage method |
| CN107273540A (en) * | 2017-07-05 | 2017-10-20 | 北京三快在线科技有限公司 | Distributed search and index updating method, system, server and computer equipment |
| CN108563396A (en) * | 2017-12-11 | 2018-09-21 | 上海高顿教育培训有限公司 | A kind of safe high in the clouds object storage method |
| CN108629196A (en) * | 2017-03-21 | 2018-10-09 | 北京京东尚科信息技术有限公司 | Method, apparatus, electronic equipment and the readable storage medium storing program for executing of data storage and query |
| CN109359144A (en) * | 2018-08-24 | 2019-02-19 | 中国建设银行股份有限公司 | Date storage method and system, device and storage medium |
| CN109426579A (en) * | 2017-08-28 | 2019-03-05 | 西门子公司 | The interruption restoration methods of machine tooling file and the lathe for being applicable in this method |
| JP2019049914A (en) * | 2017-09-12 | 2019-03-28 | 株式会社日立システムズ | File transfer system and file transfer method |
| CN109828828A (en) * | 2019-01-23 | 2019-05-31 | 杭州宏杉科技股份有限公司 | Object method for uploading, device, electronic equipment and machine readable storage medium |
| CN110399545A (en) * | 2018-04-20 | 2019-11-01 | 伊姆西Ip控股有限责任公司 | The method and apparatus of management document index |
| CN110661829A (en) * | 2018-06-28 | 2020-01-07 | 杭州海康威视系统技术有限公司 | File downloading method and device, client and computer readable storage medium |
| CN110674249A (en) * | 2019-09-29 | 2020-01-10 | 北京幻想纵横网络技术有限公司 | Information processing method and device |
| CN111367926A (en) * | 2020-02-27 | 2020-07-03 | 星辰天合（北京）数据科技有限公司 | Data processing method and device for distributed system |
| CN111752894A (en) * | 2020-06-23 | 2020-10-09 | 深圳市得一微电子有限责任公司 | Method, system, host and storage medium for writing and reading confidential files in storage device based on data splitting |
| CN112039969A (en) * | 2020-08-26 | 2020-12-04 | 浪潮云信息技术股份公司 | AWS 3 URL uploading method based on Redis distributed lock development |
| CN112256642A (en) * | 2020-10-13 | 2021-01-22 | 北京神州数字科技有限公司 | Mechanism and system for writing, reading and processing files distributed under micro-service system |
| CN112328701A (en) * | 2020-11-27 | 2021-02-05 | 广东睿住智能科技有限公司 | Data synchronization method, terminal device and computer readable storage medium |
| CN112422686A (en) * | 2020-11-19 | 2021-02-26 | 北京浪潮数据技术有限公司 | Cloud platform optimization method, device, equipment and readable storage medium |
| CN112783896A (en) * | 2021-01-12 | 2021-05-11 | 湖北宸威玺链信息技术有限公司 | Method for reducing memory usage rate for loading files |
| CN113726832A (en) * | 2020-05-26 | 2021-11-30 | 杭州海康存储科技有限公司 | Data storage method, device, system and equipment of distributed storage system |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101188569A (en) * | 2006-11-16 | 2008-05-28 | 饶大平 | Method for constructing data quanta space in network and distributed file storage system |
| CN102065113A (en) * | 2009-11-16 | 2011-05-18 | 北大方正集团有限公司 | Method and system for accelerating to upload files |
| CN103873505A (en) * | 2012-12-12 | 2014-06-18 | 中国电信股份有限公司 | Method, system and device for offline uploading to cloud storage server |
| CN104023085A (en) * | 2014-06-25 | 2014-09-03 | 武汉大学 | Security cloud storage system based on increment synchronization |
-
2015
- 2015-09-29 CN CN201510629235.1A patent/CN105187551A/en active Pending
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101188569A (en) * | 2006-11-16 | 2008-05-28 | 饶大平 | Method for constructing data quanta space in network and distributed file storage system |
| CN102065113A (en) * | 2009-11-16 | 2011-05-18 | 北大方正集团有限公司 | Method and system for accelerating to upload files |
| CN103873505A (en) * | 2012-12-12 | 2014-06-18 | 中国电信股份有限公司 | Method, system and device for offline uploading to cloud storage server |
| CN104023085A (en) * | 2014-06-25 | 2014-09-03 | 武汉大学 | Security cloud storage system based on increment synchronization |
Non-Patent Citations (1)
| Title |
|---|
| 绍珠兴，陈彩: "基于OpenStack的云存储系统的大文件存储方案", 《计算机工程与设计》 * |
Cited By (35)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105681717A (en) * | 2016-03-04 | 2016-06-15 | 广州星唯信息科技有限公司 | Bus monitoring video distributed storage method and system |
| CN105681717B (en) * | 2016-03-04 | 2019-09-17 | 广州星唯信息科技有限公司 | The distributed storage method and system of public transport vehicle-mounted monitoring video |
| CN106021327A (en) * | 2016-05-06 | 2016-10-12 | 南开大学 | A method for constructing a network disk system supporting simultaneous reading and writing of multiple users |
| CN106021327B (en) * | 2016-05-06 | 2019-10-01 | 南开大学 | A kind of Dropbox system for supporting multi-user to read while write and its read document method, written document method |
| CN106294870B (en) * | 2016-08-25 | 2019-09-17 | 北京酷成长科技有限公司 | Object-based distribution cloud storage method |
| CN106294870A (en) * | 2016-08-25 | 2017-01-04 | 苏州酷伴软件科技有限公司 | Object-based distributed cloud storage method |
| CN106131078A (en) * | 2016-08-29 | 2016-11-16 | 联动优势科技有限公司 | A kind of method and device processing service request |
| CN108629196A (en) * | 2017-03-21 | 2018-10-09 | 北京京东尚科信息技术有限公司 | Method, apparatus, electronic equipment and the readable storage medium storing program for executing of data storage and query |
| CN108629196B (en) * | 2017-03-21 | 2021-04-30 | 北京京东尚科信息技术有限公司 | Data storage and query method and device, electronic equipment and readable storage medium |
| CN107273540A (en) * | 2017-07-05 | 2017-10-20 | 北京三快在线科技有限公司 | Distributed search and index updating method, system, server and computer equipment |
| TWI740029B (en) * | 2017-07-05 | 2021-09-21 | 大陸商北京三快在線科技有限公司 | Distributed search and index updating method, system, server and computer equipment |
| CN109426579A (en) * | 2017-08-28 | 2019-03-05 | 西门子公司 | The interruption restoration methods of machine tooling file and the lathe for being applicable in this method |
| US11467558B2 (en) | 2017-08-28 | 2022-10-11 | Siemens Aktiengesellschaft | Interruption recovery method for machine tool machining file and machine tool applying same |
| JP2019049914A (en) * | 2017-09-12 | 2019-03-28 | 株式会社日立システムズ | File transfer system and file transfer method |
| CN108563396A (en) * | 2017-12-11 | 2018-09-21 | 上海高顿教育培训有限公司 | A kind of safe high in the clouds object storage method |
| CN110399545A (en) * | 2018-04-20 | 2019-11-01 | 伊姆西Ip控股有限责任公司 | The method and apparatus of management document index |
| CN110399545B (en) * | 2018-04-20 | 2023-06-02 | 伊姆西Ip控股有限责任公司 | Method and apparatus for managing document index |
| CN110661829A (en) * | 2018-06-28 | 2020-01-07 | 杭州海康威视系统技术有限公司 | File downloading method and device, client and computer readable storage medium |
| CN109359144A (en) * | 2018-08-24 | 2019-02-19 | 中国建设银行股份有限公司 | Date storage method and system, device and storage medium |
| CN109828828A (en) * | 2019-01-23 | 2019-05-31 | 杭州宏杉科技股份有限公司 | Object method for uploading, device, electronic equipment and machine readable storage medium |
| CN110674249A (en) * | 2019-09-29 | 2020-01-10 | 北京幻想纵横网络技术有限公司 | Information processing method and device |
| CN110674249B (en) * | 2019-09-29 | 2020-10-20 | 北京幻想纵横网络技术有限公司 | Information processing method and device |
| CN111367926A (en) * | 2020-02-27 | 2020-07-03 | 星辰天合（北京）数据科技有限公司 | Data processing method and device for distributed system |
| CN113726832A (en) * | 2020-05-26 | 2021-11-30 | 杭州海康存储科技有限公司 | Data storage method, device, system and equipment of distributed storage system |
| CN113726832B (en) * | 2020-05-26 | 2024-03-05 | 杭州海康存储科技有限公司 | Data storage method, device, system and equipment of distributed storage system |
| CN111752894A (en) * | 2020-06-23 | 2020-10-09 | 深圳市得一微电子有限责任公司 | Method, system, host and storage medium for writing and reading confidential files in storage device based on data splitting |
| CN112039969B (en) * | 2020-08-26 | 2022-04-08 | 浪潮云信息技术股份公司 | AWS 3 URL uploading method based on Redis distributed lock development |
| CN112039969A (en) * | 2020-08-26 | 2020-12-04 | 浪潮云信息技术股份公司 | AWS 3 URL uploading method based on Redis distributed lock development |
| CN112256642A (en) * | 2020-10-13 | 2021-01-22 | 北京神州数字科技有限公司 | Mechanism and system for writing, reading and processing files distributed under micro-service system |
| CN112422686A (en) * | 2020-11-19 | 2021-02-26 | 北京浪潮数据技术有限公司 | Cloud platform optimization method, device, equipment and readable storage medium |
| CN112422686B (en) * | 2020-11-19 | 2023-01-24 | 北京浪潮数据技术有限公司 | Cloud platform optimization method, device, equipment and readable storage medium |
| CN112328701A (en) * | 2020-11-27 | 2021-02-05 | 广东睿住智能科技有限公司 | Data synchronization method, terminal device and computer readable storage medium |
| CN112328701B (en) * | 2020-11-27 | 2023-11-10 | 广东睿住智能科技有限公司 | Data synchronization method, terminal device and computer readable storage medium |
| CN112783896A (en) * | 2021-01-12 | 2021-05-11 | 湖北宸威玺链信息技术有限公司 | Method for reducing memory usage rate for loading files |
| CN112783896B (en) * | 2021-01-12 | 2023-05-23 | 湖北宸威玺链信息技术有限公司 | Method for reducing memory usage rate by loading files |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN105187551A (en) | Distributed computing method based on cloud platform | |
| US11537556B2 (en) | Optimized content object storage service for large scale content | |
| US11741046B2 (en) | Method and apparatus for creating system disk snapshot of virtual machine | |
| US10037340B2 (en) | Tiered distributed storage policies | |
| US9495197B2 (en) | Reliable and scalable image transfer for data centers with low connectivity using redundancy detection | |
| US11296940B2 (en) | Centralized configuration data in a distributed file system | |
| US9116728B2 (en) | Providing a persona-based application experience | |
| US10284433B2 (en) | Data synchronization using redundancy detection | |
| US10210191B2 (en) | Accelerated access to objects in an object store implemented utilizing a file storage system | |
| US9910906B2 (en) | Data synchronization using redundancy detection | |
| US10102210B2 (en) | Systems and methods for multi-threaded shadow migration | |
| US10467424B2 (en) | File system content based security | |
| US10346458B2 (en) | Media asset access control system | |
| US11463446B2 (en) | Team member transfer tool | |
| CN111273863A (en) | Cache management | |
| US20180203636A1 (en) | Likelihood of access based object storage in a cloud environment | |
| US10002135B2 (en) | Simplifying the check-in of checked-out files in an ECM system | |
| US20110047165A1 (en) | Network cache, a user device, a computer program product and a method for managing files | |
| US11809381B2 (en) | Accessing network based content items by a mobile device while offline | |
| US10936550B2 (en) | Synchronizing different representations of content | |
| US11262944B1 (en) | Placement of data objects in storage for improved retrieval | |
| CN113791735A (en) | Video data storage method and device, computer equipment and storage medium | |
| WO2024001304A1 (en) | Data processing method and related device | |
| CN116107514A (en) | Data processing method and device for object storage |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20151223 |