CN108459829B - Data storage method and device and computer storage medium - Google Patents
Data storage method and device and computer storage medium Download PDFInfo
- Publication number
- CN108459829B CN108459829B CN201810326747.4A CN201810326747A CN108459829B CN 108459829 B CN108459829 B CN 108459829B CN 201810326747 A CN201810326747 A CN 201810326747A CN 108459829 B CN108459829 B CN 108459829B
- Authority
- CN
- China
- Prior art keywords
- storage
- data
- resource
- allocable
- data storage
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
- G06F3/0601—Interfaces specially adapted for storage systems
- G06F3/0628—Interfaces specially adapted for storage systems making use of a particular technique
- G06F3/0629—Configuration or reconfiguration of storage systems
- G06F3/0631—Configuration or reconfiguration of storage systems by allocating resources to storage systems
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
- G06F3/0601—Interfaces specially adapted for storage systems
- G06F3/0602—Interfaces specially adapted for storage systems specifically adapted to achieve a particular effect
- G06F3/0604—Improving or facilitating administration, e.g. storage management
- G06F3/0607—Improving or facilitating administration, e.g. storage management by facilitating the process of upgrading existing storage systems, e.g. for improving compatibility between host and storage device
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
- G06F3/0601—Interfaces specially adapted for storage systems
- G06F3/0668—Interfaces specially adapted for storage systems adopting a particular infrastructure
- G06F3/067—Distributed or networked storage systems, e.g. storage area networks [SAN], network attached storage [NAS]
Abstract
A data storage method, a data storage device and a computer storage medium comprise: converting the authorized free storage resources into allocable storage resources; adding the allocable storage resources obtained by conversion to a preset resource allocation system; and acquiring a storage resource use certificate corresponding to the size of the allocable storage resource according to the allocable storage resource added to the resource allocation system. The embodiment of the invention reduces the expansion requirement on the storage nodes when the storage data is increased; the application efficiency of the storage resources is improved.
Description
Technical Field
The present disclosure relates to, but not limited to, cloud computing technologies, and in particular, to a data storage method and apparatus, and a computer storage medium.
Background
At present, data storage in a cloud computing platform mainly depends on a storage system at a back end, and the storage system includes: cloud storage project (Swift), distributed file system (Ceph), Logical Volume Manager (LVM), and the like.
Data storage that relies on a back-end storage system has the following problems:
1. safety issues; data in the cloud platform are stored on a single or a plurality of storage nodes in a centralized manner, so that the storage service requirements of industries with higher requirements on safety cannot be met; for example, a public cloud enterprise hosts data on public cloud servers of other enterprises, and the data is at risk of being copied; although the private cloud enters a self-management mode, the private cloud has the problems of high failure rate, easy misoperation and the like of the public cloud, and partial or all data loss is easily caused.
2. The problem of expansion; depending on a storage system at the back end, the total amount of data storage cannot exceed the total amount of bottom-layer physical resources, and storage nodes need to be increased continuously along with explosive increase of data storage amount; if data backup is added, more storage nodes are needed to expand the storage space, and a large amount of storage resources are needed to be added during expansion.
3. Data transmission problems; in the related art, data transmission in a heterogeneous platform mostly uses a file Transfer tool based on a HyperText Transfer Protocol (HTTP); when data transmission with high frequency or large data volume is carried out, the problems of time consumption, easy data loss and the like often exist in the data transmission process;
4. the problem of resource utilization efficiency; at present, a large cloud platform is generally designed and realized in a mode of a plurality of data centers; the storage resources of the data centers are mutually independent, and the resource utilization efficiency is low; and each cloud platform mainly uses a self storage system as a core and reduces the storage cost of a user in a storage multiplexing mode, so that the resources among the cloud platforms cannot be flexibly applied.
With the ever-increasing amount of data, the above-mentioned back-end dependent storage systems cannot meet the increasing data storage requirements.
Disclosure of Invention
The following is a summary of the subject matter described in detail herein. This summary is not intended to limit the scope of the claims.
The embodiment of the invention provides a data storage method, a data storage device and a computer storage medium, which can reduce the expansion requirement on storage nodes when the storage data is increased; the application efficiency of the storage resources is improved.
The embodiment of the invention provides a data storage method, which comprises the following steps:
converting the authorized free storage resources into allocable storage resources;
adding the allocable storage resources obtained by conversion to a preset resource allocation system;
and acquiring a storage resource use certificate corresponding to the size of the allocable storage resource according to the allocable storage resource added to the resource allocation system.
Optionally, the converting the authorized free storage resource into an allocable storage resource includes:
and converting the authorized free storage resources into a corresponding number of blocks for data storage through a preset check algorithm in a network attached storage NAS chain logic layer.
Optionally, the obtaining the storage resource usage credential corresponding to the size of the allocable storage resource includes:
acquiring virtual currency corresponding to the number of the blocks according to the number of the blocks added to the resource allocation system.
Optionally, the resource allocation system includes: NAS chain system.
Optionally, after obtaining the storage resource usage credential corresponding to the size of the allocable storage resource, the data storage method further includes:
when data storage processing is carried out, obtaining blocks for data storage from the resource distribution system according to the obtained storage resource use certificate;
and storing the data on the acquired block.
Optionally, the obtaining the block for data storage includes:
and acquiring blocks for data storage from the resource distribution system according to the acquired storage resource use certificate through a preset Network Attached Storage (NAS) service.
On the other hand, the embodiment of the present invention further provides a computer storage medium, where computer-executable instructions are stored in the computer storage medium, and the computer-executable instructions are used to execute the data storage method.
In another aspect, an embodiment of the present invention further provides a data storage method, where the data storage method includes:
determining a size of an allocable storage resource to add to the resource allocation system;
and allocating the storage resource use voucher according to the determined size of the allocable storage resource.
Optionally, before determining the size of the allocable storage resource added to the resource allocation system, the data storage method further includes:
binding a preset management client with a cloud host;
and after the management client is subjected to identity authentication, accessing the management client passing the identity authentication to the resource allocation system.
Optionally, the resource allocation system includes: a NAS chain system;
the allocable storage resources include: and converting the obtained blocks for data storage by the authorized idle storage resources through a preset checking algorithm in a network attached storage NAS chain logic layer.
Optionally, after the allocating the storage resource usage credential, the data storage method further includes:
when a data storage request is received, determining required allocable storage resources according to the size of storage data;
determining available allocable storage resources according to the storage resource use voucher;
obtaining allocable storage resources for data storage from the NAS chain system when the determined available allocable storage resources are greater than the required allocable storage resources;
and performing data storage on the acquired allocable storage resources for data storage.
Optionally, the data storage on the acquired allocable storage resource for data storage includes:
segmenting data needing to be stored into data fragments;
adding report head and fragment association information to the data fragments obtained by the segmentation according to the acquired distributable storage resources;
and writing the data fragments into the acquired allocable storage resources for data storage according to the added report head.
Optionally, before writing the data fragment into the acquired allocable storage resource, the method further includes:
and encrypting the data fragments obtained by splitting according to a preset block chain encryption algorithm.
Optionally, after performing data storage on the acquired allocable storage resource for data storage, the data storage method further includes:
deleting the allocable storage resource after storing data from the resource allocation system.
In another aspect, an embodiment of the present invention further provides a data storage device, where the data storage device includes: the system comprises a conversion unit, an adding unit and a certificate acquiring unit; wherein the content of the first and second substances,
the conversion unit is used for: converting the authorized free storage resources into allocable storage resources;
the adding unit is used for: adding the allocable storage resources obtained by conversion to a preset resource allocation system;
the acquisition credential unit is to: and acquiring a storage resource use certificate corresponding to the size of the allocable storage resource according to the allocable storage resource added to the resource allocation system.
Optionally, the conversion unit is specifically configured to:
and converting the authorized free storage resources into a corresponding number of blocks for data storage through a preset check algorithm in a network attached storage NAS chain logic layer.
Optionally, the credential obtaining unit is specifically configured to:
acquiring virtual currency corresponding to the number of the blocks according to the number of the blocks added to the resource allocation system.
Optionally, the resource allocation system includes: NAS chain system.
Optionally, the data storage device further includes a resource applying unit, configured to:
and when data storage processing is carried out, applying for a block for data storage from the resource distribution system according to the acquired storage resource use certificate so as to store data on the block obtained by applying.
Optionally, the application resource unit is specifically configured to: :
and applying for a block for data storage from the resource distribution system according to the acquired storage resource use certificate through a preset Network Attached Storage (NAS) service.
In another aspect, an embodiment of the present invention further provides a data storage device, including: a determination unit and an allocation unit; wherein the content of the first and second substances,
the determination unit is used for: determining a size of an allocable storage resource to add to the resource allocation system;
the allocation unit is used for: and allocating the storage resource use voucher according to the determined size of the allocable storage resource.
Optionally, the apparatus further includes a binding unit and an access unit; wherein the content of the first and second substances,
the binding unit is used for: binding a preset management client with a cloud host;
the access unit is used for: and after the management client is subjected to identity authentication, accessing the management client passing the identity authentication to the resource allocation system.
Optionally, the resource allocation system includes: a NAS chain system;
the allocable storage resources include: and converting the obtained blocks for data storage by the authorized idle storage resources through a preset checking algorithm in a network attached storage NAS chain logic layer.
Optionally, the data storage device further includes a computing unit, an obtaining resource unit, and a storage unit; wherein the content of the first and second substances,
the computing unit is to: when a data storage request is received, determining required allocable storage resources according to the size of storage data; determining available allocable storage resources according to the storage resource use voucher;
the acquisition resource unit is to: obtaining allocable storage resources for data storage from the NAS chain system when the determined available allocable storage resources are greater than the required allocable storage resources;
the storage unit is used for: and performing data storage on the acquired allocable storage resources for data storage.
Optionally, the storage unit is specifically configured to:
segmenting data needing to be stored into data fragments;
adding report head and fragment association information to the data fragments obtained by the segmentation according to the acquired distributable storage resources;
and writing the data fragments into the acquired allocable storage resources for data storage according to the added report head.
Optionally, the storage unit is further configured to:
before the data fragments are written into the acquired allocable storage resources, the data fragments obtained by segmentation are encrypted according to a preset block chain encryption algorithm.
Optionally, the data storage device further includes a deleting unit, configured to:
deleting the allocable storage resource after storing data from the resource allocation system.
In still another aspect, an embodiment of the present invention further provides a computer storage medium, where computer-executable instructions are stored in the computer storage medium, and the computer-executable instructions are used to execute the data storage method.
Compared with the related art, the technical scheme of the application comprises the following steps: converting the authorized free storage resources into allocable storage resources; adding the allocable storage resources obtained by conversion to a preset resource allocation system; and acquiring a storage resource use certificate corresponding to the size of the allocable storage resource according to the allocable storage resource added to the resource allocation system. The embodiment of the invention reduces the expansion requirement on the storage nodes when the storage data is increased; the application efficiency of the storage resources is improved.
Additional features and advantages of the invention will be set forth in the description which follows, and in part will be obvious from the description, or may be learned by practice of the invention. The objectives and other advantages of the invention will be realized and attained by the structure particularly pointed out in the written description and claims hereof as well as the appended drawings.
Drawings
The accompanying drawings are included to provide a further understanding of the invention and are incorporated in and constitute a part of this specification, illustrate embodiments of the invention and together with the example serve to explain the principles of the invention and not to limit the invention.
FIG. 1 is a flow chart of a data storage method according to an embodiment of the present invention;
FIG. 2 is a flow chart of a data storage method according to another embodiment of the present invention;
FIG. 3 is a block diagram of a data storage device according to an embodiment of the present invention;
FIG. 4 is a block diagram of a data storage device according to another embodiment of the present invention;
FIG. 5 is a flow chart of an exemplary data store for use with the present invention;
fig. 6 is a schematic structural diagram of an exemplary system to which the present invention is applied.
Detailed Description
In order to make the objects, technical solutions and advantages of the present invention more apparent, embodiments of the present invention will be described in detail below with reference to the accompanying drawings. It should be noted that the embodiments and features of the embodiments in the present application may be arbitrarily combined with each other without conflict.
The steps illustrated in the flow charts of the figures may be performed in a computer system such as a set of computer-executable instructions. Also, while a logical order is shown in the flow diagrams, in some cases, the steps shown or described may be performed in an order different than here.
Fig. 1 is a flowchart of a data storage method according to an embodiment of the present invention, as shown in fig. 1, including:
optionally, the converting the authorized idle storage resource into an allocable storage resource in the embodiment of the present invention includes:
and converting the authorized free storage resources into a corresponding number of blocks for data storage through a preset check algorithm in a Network Attached Storage (NAS) chain logic layer.
It should be noted that the preset checking algorithm may be an existing mining algorithm in the related art; when the embodiment of the invention is implemented, a user logs in an account through a pre-established NAS chain user client and then joins NAS chain service; submitting the authorized free storage resources to an NAS chain logic layer; generating a block for data storage based on authorized idle storage resources through a preset check algorithm in an NAS chain logic layer;
optionally, the resource allocation system in the embodiment of the present invention includes: NAS chain system.
And 103, acquiring a storage resource use certificate corresponding to the size of the allocable storage resource according to the allocable storage resource added to the resource allocation system.
Optionally, the obtaining of the storage resource usage certificate corresponding to the size of the allocable storage resource in the embodiment of the present invention includes:
acquiring virtual currency corresponding to the number of the blocks according to the number of the blocks added to the resource allocation system.
The embodiment of the invention is explained by using one account to obtain the storage resource using voucher through the authorized free storage space, and when a plurality of accounts of different platforms use the method of the embodiment of the invention to apply and store the storage resource, the expansion requirement on the storage node when the data is increased can be greatly reduced; by adding the allocable storage resources to the preset resource allocation system, the effective application of the storage resources can be realized, and the utilization rate of the storage resources is improved.
Optionally, after obtaining the storage resource usage credential corresponding to the size of the allocable storage resource, the data storage method according to the embodiment of the present invention further includes:
when data storage processing is carried out, a block for data storage is applied from the resource distribution system according to the acquired storage resource use certificate;
and storing the data on the acquired block.
Optionally, the block for data storage according to the embodiment of the present invention includes:
and applying for a block for data storage from the resource distribution system according to the acquired storage resource use certificate through a preset Network Attached Storage (NAS) service.
Compared with the related art, the technical scheme of the application comprises the following steps: converting the authorized free storage resources into allocable storage resources; adding the allocable storage resources obtained by conversion to a preset resource allocation system; and acquiring a storage resource use certificate corresponding to the size of the allocable storage resource according to the allocable storage resource added to the resource allocation system. The embodiment of the invention reduces the expansion requirement on the storage nodes when the storage data is increased; the application efficiency of the storage resources is improved.
The embodiment of the invention also provides a computer storage medium, wherein the computer storage medium stores computer executable instructions, and the computer executable instructions are used for executing the data storage method.
Fig. 2 is a flowchart of a data storage method according to another embodiment of the present invention, as shown in fig. 2, including:
optionally, before determining the size of the allocable storage resource added to the resource allocation system, the data storage method in the embodiment of the present invention further includes:
binding a preset management client with a cloud host;
and after the management client is subjected to identity authentication, accessing the management client passing the identity authentication to the resource allocation system.
Optionally, in the embodiments of the present invention:
the resource allocation system includes: a NAS chain system;
the allocable storage resources include: and converting the obtained blocks for data storage by the authorized idle storage resources through a preset checking algorithm in a network attached storage NAS chain logic layer.
Optionally, after the storage resource usage credential is allocated, the data storage method according to the embodiment of the present invention further includes:
when a data storage request is received, determining required allocable storage resources according to the size of storage data;
determining available allocable storage resources according to the storage resource use voucher;
obtaining allocable storage resources for data storage from the NAS chain system when the determined available allocable storage resources are greater than the required allocable storage resources;
and performing data storage on the acquired allocable storage resources for data storage.
Optionally, the data storage on the acquired allocable storage resource for data storage in the embodiment of the present invention includes:
segmenting data needing to be stored into data fragments;
adding report head and fragment association information to the data fragments obtained by the segmentation according to the acquired distributable storage resources;
and writing the data fragments into the acquired allocable storage resources for data storage according to the added report head.
Optionally, before writing the data fragment into the acquired allocable storage resource, the method according to the embodiment of the present invention further includes:
and encrypting the data fragments obtained by splitting according to a preset block chain encryption algorithm.
Optionally, after the data storage is performed on the acquired allocable storage resource for data storage, the data storage method according to the embodiment of the present invention further includes:
deleting the allocable storage resource after storing data from the resource allocation system.
It should be noted that, after the allocable storage resources after the storage data are deleted from the resource allocation system, the embodiment of the present invention may notify each cloud platform according to an algorithm of the related art, so as to implement real-time update of the allocable storage resources.
The embodiment of the invention reduces the expansion requirement on the storage nodes when the storage data is increased; the application efficiency of the storage resources is improved.
The embodiment of the invention also provides a computer storage medium, wherein the computer storage medium stores computer executable instructions, and the computer executable instructions are used for executing the data storage method.
Fig. 3 is a block diagram of a data storage device according to an embodiment of the present invention, as shown in fig. 3, including: the system comprises a conversion unit, an adding unit and a certificate acquiring unit; wherein the content of the first and second substances,
the conversion unit is used for: converting the authorized free storage resources into allocable storage resources;
the adding unit is used for: adding the allocable storage resources obtained by conversion to a preset resource allocation system;
the acquisition credential unit is to: and acquiring a storage resource use certificate corresponding to the size of the allocable storage resource according to the allocable storage resource added to the resource allocation system.
The embodiment of the invention is explained by using one account to obtain the storage resource using voucher through the authorized free storage space, and when a plurality of accounts of different platforms use the method of the embodiment of the invention to apply and store the storage resource, the expansion requirement on the storage node when the data is increased can be greatly reduced; by adding the allocable storage resources to the preset resource allocation system, the effective application of the storage resources can be realized, and the utilization rate of the storage resources is improved.
Optionally, the conversion unit in the embodiment of the present invention is specifically configured to:
and converting the authorized free storage resources into a corresponding number of blocks for data storage through a preset check algorithm in a network attached storage NAS chain logic layer.
Optionally, the credential obtaining unit in the embodiment of the present invention is specifically configured to:
acquiring virtual currency corresponding to the number of the blocks according to the number of the blocks added to the resource allocation system.
Optionally, the resource allocation system in the embodiment of the present invention includes: NAS chain system.
Optionally, the data storage apparatus in the embodiment of the present invention further includes a resource applying unit, configured to:
and when data storage processing is carried out, applying for a block for data storage from the resource distribution system according to the acquired storage resource use certificate so as to store data on the block obtained by applying.
Optionally, the resource unit applied in the embodiment of the present invention is specifically configured to: :
and applying for a block for data storage from the resource distribution system according to the acquired storage resource use certificate through a preset Network Attached Storage (NAS) service.
Fig. 4 is a block diagram of a data storage device according to another embodiment of the present invention, as shown in fig. 4, including: a determination unit and an allocation unit; wherein the content of the first and second substances,
the determination unit is used for: determining a size of an allocable storage resource to add to the resource allocation system;
the allocation unit is used for: and allocating the storage resource use voucher according to the determined size of the allocable storage resource.
Optionally, the apparatus further includes a binding unit and an access unit; wherein the content of the first and second substances,
the binding unit is used for: binding a preset management client with a cloud host;
the access unit is used for: and after the management client is subjected to identity authentication, accessing the management client passing the identity authentication to the resource allocation system.
Alternatively to this, the first and second parts may,
the resource allocation system includes: a NAS chain system;
the allocable storage resources include: and converting the obtained blocks for data storage by the authorized idle storage resources through a preset checking algorithm in a network attached storage NAS chain logic layer.
Optionally, the data storage device further includes a computing unit, an obtaining resource unit, and a storage unit; wherein the content of the first and second substances,
the computing unit is to: when a data storage request is received, determining required allocable storage resources according to the size of storage data; determining available allocable storage resources according to the storage resource use voucher;
the acquisition resource unit is to: obtaining allocable storage resources for data storage from the NAS chain system when the determined available allocable storage resources are greater than the required allocable storage resources;
the storage unit is used for: and performing data storage on the acquired allocable storage resources for data storage.
Optionally, the storage unit is specifically configured to:
segmenting data needing to be stored into data fragments;
adding report head and fragment association information to the data fragments obtained by the segmentation according to the acquired distributable storage resources;
and writing the data fragments into the acquired allocable storage resources for data storage according to the added report head.
Optionally, the storage unit is further configured to:
before the data fragments are written into the acquired allocable storage resources, the data fragments obtained by segmentation are encrypted according to a preset block chain encryption algorithm.
Optionally, the data storage device further includes a deleting unit, configured to:
deleting the allocable storage resource after storing data from the resource allocation system.
The embodiment of the invention also provides a computer storage medium, wherein the computer storage medium stores computer executable instructions, and the computer executable instructions are used for executing the data storage method.
The method of the embodiment of the present invention is described in detail below by using application examples, which are only used for illustrating the present invention and are not used for limiting the protection scope of the present invention.
Application example
The following describes the embodiments of the present invention from the user side and the management server side, respectively;
the user side:
the application example is applied to two or more cloud platforms, and for each cloud platform implementing the embodiment of the invention, a user on the cloud platform can obtain the application of the storage resource in the following modes:
firstly, a user logs in an account through a preset NAS chain user client, and after the account logging is completed, the subsequent processing of the application example is realized; here, the account authentication information used for the login account is generally set as key information for the user to perform the data storage operation.
After a user logs in an account, determining available idle storage resources in the account;
determining authorized free storage resources from the determined available free storage resources;
optionally, the application example may determine an available free storage space in the account according to a preset resource evaluation algorithm; receiving an external instruction, and selecting the authorized free storage resource from the determined available free storage space; it should be noted that the preset resource evaluation algorithm may be an existing evaluation algorithm in the related art, and the evaluation algorithm may be preset in the NAS link user client; in addition, the external instruction is the percentage of free storage resources used for analyzing the adjustment authorization to the available free storage space, and the highest percentage can be 100%;
converting the authorized free storage resources into allocable storage resources;
optionally, the converting the authorized free storage resource into an allocable storage resource in this application example includes:
in the NAS chain logic layer, idle storage resources authorized by an account are converted into blocks with corresponding quantity for data storage through a preset verification algorithm; a chunk is an alternative embodiment of the allocable storage resource of the present application example, and the size of the chunk can be determined by analysis by those skilled in the art; the preset checking algorithm can be an existing ore digging algorithm in the related technology; when the embodiment of the invention is implemented, a user logs in an account through a pre-established NAS chain user client and then joins NAS chain service; submitting the authorized free storage resources to an NAS chain logic layer; generating a block for data storage based on authorized idle storage resources through a preset check algorithm in an NAS chain logic layer;
adding the allocable storage resources obtained by conversion to a preset resource allocation system;
and acquiring a storage resource use certificate corresponding to the size of the allocable storage resource according to the allocable storage resource added to the resource allocation system. Determining resources contributed by a user by using idle storage resources provided by an account, and configuring corresponding storage resource use certificates for the user according to the resources contributed by the user; when allocable storage resources exist in blocks, the storage resource usage credentials include: how many blocks can be used for the credentials of the data storage.
Optionally, taking a block of the resource allocation system when the allocable storage resource is added as an example, the obtaining of the storage resource usage credential corresponding to the size of the allocable storage resource in the embodiment of the present invention includes:
and acquiring virtual currency which is used as the storage resource use voucher and corresponds to the number of the blocks according to the number of the blocks obtained by conversion. Here, the virtual currency is only an optional mode of the embodiment of the present invention, and the embodiment of the present invention may also define the storage resource usage credential by using other metrics; such as integration.
The resource allocation system includes: NAS chain system. Here, the NAS chain system may be a system known in the related art.
Optionally, the method in the embodiment of the present invention further includes:
when data storage is carried out, obtaining blocks for data storage from the resource distribution system according to the obtained storage resource use certificate and the size of the stored data;
and storing data on the acquired block.
Alternatively, the blocks for data storage may be obtained from the resource allocation system based on the storage resource usage credential and the size of the stored data through a preset Network Attached Storage (NAS) service.
It should be noted that, when the storage resource usage credential in the account cannot obtain a sufficient number of blocks, the user may perform the following processing: 1. abandoning data storage on the block; 2. obtaining more storage resource using certificates by authorizing more idle storage resources; 3. and obtaining more storage resource use certificates in other ways.
In addition, the data storage process in the embodiment of the invention is a process of writing the data fragments into one or more blocks, and in the storage process, after the data writing of the previous block is completed, the block for storing the data is continuously provided in an additional mode.
Optionally, after the user logs in the account, the embodiment of the present invention may also perform processing such as deleting and updating on the stored data; when the user deletes the stored data and releases the block resources, the embodiment of the invention can also add the released blocks to the value resource allocation system again and allocate the corresponding storage resource use certificates for the user according to the number of the blocks.
Management server side
The application example can bind a preset NAS chain management client with the cloud host, and can realize application of allocable storage resources through the cloud platform; different cloud platforms can set corresponding NAS chain management client accounts, and allocable storage resources are obtained for users when the accounts under the platforms store data; the following is a process of data storage, including:
the NAS chain management client accesses the NAS chain system after passing the identity authentication;
when the NAS chain management client receives a data storage request of an NAS chain user client, the NAS chain management client transmits data to an NAS chain system through a cloud host;
the NAS chain management client calculates the required allocable storage resources according to the size of the storage data;
the NAS chain management client determines acquirable allocable storage resources according to the NAS user client and the storage resource use certificate of the account; when the available allocable storage resource is larger than the required allocable storage resource, acquiring the required allocable storage resource;
performing data storage on the acquired allocable storage resources;
taking allocable storage resources as blocks in a block chain, taking a storage resource use certificate as virtual currency as an example, assuming that a user needs a first numerical block for data storage; if the second value is larger than the first value, the user can obtain the first value block by replacing the virtual currency required by the first value block; and realizing the storage of the data through the obtained block of the first numerical value.
It should be noted that, if the storage resource usage credential in the user account is not enough to obtain a sufficient number of blocks, the NAS chain management client cannot obtain enough blocks for the NAS chain user client to store the user data, and the data cannot be stored.
When data storage is carried out, the NAS chain management client distributes information of the allocable storage resources added to the resource allocation system to one or more cloud platforms; specifically, the information of the allocable storage resources added to the resource allocation system can be distributed to one or more cloud platforms through the NAS link network layer; when the allocable storage resources are stored by the user data, the information of the applied allocable storage resources in the resource allocation system is distributed to one or more cloud platforms. Here, the distributed cloud platform is a cloud platform implementing the embodiment of the present invention.
Fig. 5 is a flowchart of an application example of data storage of the present invention, and as shown in fig. 3, the processing of data storage performed on the NAS chain includes:
optionally, the segmenting the data to be stored into the data segments includes:
the NAS chain management client side adopts a preset first algorithm (contract algorithm) to upload data needing to be stored to a preset central node, so that the data needing to be stored are segmented in a fragmentation mode through the central node;
Fig. 6 is a schematic structural diagram of an application example system of the present invention, and as shown in fig. 6, after a user from each cloud platform logs in an account through an NAS chain user client, an authorized free storage resource is converted into a block and added to a storage tier of the NAS chain system; the NAS chain management client allocates corresponding virtual money for an account of a user client for logging in the NAS chain; when the NAS chain user client side stores data, the NAS chain user client side acquires a block for storing the data, and when the data is stored, the block is additionally used for data storage; when logging in an account of an NAS chain user client side for data storage, consuming virtual currency distributed in the account, uploading consumed blocks to a cloud platform, and realizing timely updating of available blocks through communication between the cloud platforms.
It will be understood by those skilled in the art that all or part of the steps of the above methods may be implemented by a program instructing associated hardware (e.g., a processor) to perform the steps, and the program may be stored in a computer readable storage medium, such as a read only memory, a magnetic or optical disk, and the like. Alternatively, all or part of the steps of the above embodiments may be implemented using one or more integrated circuits. Accordingly, each module/unit in the above embodiments may be implemented in hardware, for example, by an integrated circuit to implement its corresponding function, or in software, for example, by a processor executing a program/instruction stored in a memory to implement its corresponding function. The present invention is not limited to any specific form of combination of hardware and software.
Although the embodiments of the present invention have been described above, the above description is only for the convenience of understanding the present invention, and is not intended to limit the present invention. It will be understood by those skilled in the art that various changes in form and details may be made therein without departing from the spirit and scope of the invention as defined by the appended claims.
Claims (18)
1. A method of storing data, comprising:
converting the authorized free storage resources into allocable storage resources;
adding the allocable storage resources obtained by conversion to a preset resource allocation system;
acquiring a storage resource use certificate corresponding to the size of an allocable storage resource according to the allocable storage resource added to a resource allocation system, wherein the resource allocation system comprises: a NAS chain system;
wherein converting the granted free storage resource to an allocable storage resource comprises:
in a network attached storage NAS chain logic layer, converting the authorized idle storage resources into a corresponding number of blocks for data storage through a preset check algorithm;
after obtaining the storage resource usage certificate corresponding to the size of the allocable storage resource, the data storage method further includes:
when data storage processing is carried out, a block for data storage is applied from the resource distribution system according to the acquired storage resource use certificate;
and storing the data on the acquired block.
2. The data storage method according to claim 1, wherein said obtaining storage resource usage credentials corresponding to allocable storage resource sizes comprises:
acquiring virtual currency corresponding to the number of the blocks according to the number of the blocks added to the resource allocation system.
3. The data storage method of claim 1, wherein applying for blocks for data storage comprises:
and applying for a block for data storage from the resource distribution system according to the acquired storage resource use certificate through a preset Network Attached Storage (NAS) service.
4. A method of storing data, comprising:
determining a size of an allocable storage resource to add to the resource allocation system; wherein the resource allocation system comprises: a NAS chain system;
the allocation of the storage resource usage credentials is performed according to the determined size of the allocable storage resource,
the allocable storage resources include: in a network attached storage NAS chain logic layer, converting an obtained block for data storage by authorized idle storage resources through a preset check algorithm;
after the allocating of the storage resource usage credential, the data storage method further includes:
when a data storage request is received, determining required allocable storage resources according to the size of storage data;
determining available allocable storage resources according to the storage resource use voucher;
obtaining allocable storage resources for data storage from the NAS chain system when the determined available allocable storage resources are greater than the required allocable storage resources;
and performing data storage on the acquired allocable storage resources for data storage.
5. The data storage method of claim 4, wherein prior to determining the size of the allocable storage resource to add to the resource allocation system, the data storage method further comprises:
binding a preset management client with a cloud host;
and after the management client is subjected to identity authentication, accessing the management client passing the identity authentication to the resource allocation system.
6. The data storage method according to claim 4, wherein the data storage on the acquired allocable storage resource for data storage comprises:
segmenting data needing to be stored into data fragments;
adding report head and fragment association information to the data fragments obtained by the segmentation according to the acquired distributable storage resources;
and writing the data fragments into the acquired allocable storage resources for data storage according to the added report head.
7. The data storage method of claim 6, wherein prior to writing the data slice to the acquired allocable storage resource, the method further comprises:
and encrypting the data fragments obtained by splitting according to a preset block chain encryption algorithm.
8. The data storage method according to claim 4, wherein after the data storage is performed on the acquired allocable storage resource for data storage, the data storage method further comprises:
deleting the allocable storage resource after storing data from the resource allocation system.
9. A data storage device, comprising: the system comprises a conversion unit, an adding unit and a certificate acquiring unit; wherein the content of the first and second substances,
the conversion unit is used for: converting the authorized free storage resources into allocable storage resources;
the adding unit is used for: adding the allocable storage resources obtained by conversion to a preset resource allocation system; wherein the resource allocation system comprises: a NAS chain system;
the acquisition credential unit is to: obtaining a storage resource using certificate corresponding to the size of the allocable storage resource according to the allocable storage resource added to the resource allocation system,
the conversion unit is specifically configured to:
in a network attached storage NAS chain logic layer, converting the authorized idle storage resources into a corresponding number of blocks for data storage through a preset check algorithm;
the data storage device further comprises an application resource unit for:
and when data storage processing is carried out, applying for a block for data storage from the resource distribution system according to the acquired storage resource use certificate so as to store data on the block obtained by applying.
10. The data storage device of claim 9, wherein the credential obtaining unit is specifically configured to:
acquiring virtual currency corresponding to the number of the blocks according to the number of the blocks added to the resource allocation system.
11. The data storage device of claim 9, wherein the application resource unit is specifically configured to:
and applying for a block for data storage from the resource distribution system according to the acquired storage resource use certificate through a preset Network Attached Storage (NAS) service.
12. A data storage device, comprising: a determination unit and an allocation unit; wherein the content of the first and second substances,
the determination unit is used for: determining a size of an allocable storage resource to add to the resource allocation system; wherein the resource allocation system comprises: a NAS chain system;
the allocation unit is used for: the allocation of the storage resource usage credentials is performed according to the determined size of the allocable storage resource,
the allocable storage resources include: in a network attached storage NAS chain logic layer, converting an obtained block for data storage by authorized idle storage resources through a preset check algorithm;
the data storage device also comprises a computing unit, an acquisition resource unit and a storage unit; wherein the content of the first and second substances,
the computing unit is to: when a data storage request is received, determining required allocable storage resources according to the size of storage data; determining available allocable storage resources according to the storage resource use voucher;
the acquisition resource unit is to: obtaining allocable storage resources for data storage from the NAS chain system when the determined available allocable storage resources are greater than the required allocable storage resources;
the storage unit is used for: and performing data storage on the acquired allocable storage resources for data storage.
13. The data storage device of claim 12, wherein the device further comprises a binding unit and an access unit; wherein the content of the first and second substances,
the binding unit is used for: binding a preset management client with a cloud host;
the access unit is used for: and after the management client is subjected to identity authentication, accessing the management client passing the identity authentication to the resource allocation system.
14. The data storage device of claim 12, wherein the storage unit is specifically configured to:
segmenting data needing to be stored into data fragments;
adding report head and fragment association information to the data fragments obtained by the segmentation according to the acquired distributable storage resources;
and writing the data fragments into the acquired allocable storage resources for data storage according to the added report head.
15. The data storage device of claim 14, wherein the storage unit is further configured to:
before the data fragments are written into the acquired allocable storage resources, the data fragments obtained by segmentation are encrypted according to a preset block chain encryption algorithm.
16. The data storage device of claim 12, further comprising a deletion unit to:
deleting the allocable storage resource after storing data from the resource allocation system.
17. A computer storage medium having computer-executable instructions stored thereon for performing the data storage method of any one of claims 1-3.
18. A computer storage medium having computer-executable instructions stored thereon for performing the data storage method of any one of claims 4 to 8.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810326747.4A CN108459829B (en) | 2018-04-12 | 2018-04-12 | Data storage method and device and computer storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810326747.4A CN108459829B (en) | 2018-04-12 | 2018-04-12 | Data storage method and device and computer storage medium |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN108459829A CN108459829A (en) | 2018-08-28 |
| CN108459829B true CN108459829B (en) | 2021-11-12 |
Family
ID=63234698
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201810326747.4A Active CN108459829B (en) | 2018-04-12 | 2018-04-12 | Data storage method and device and computer storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN108459829B (en) |
Families Citing this family (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110958211B (en) * | 2018-09-27 | 2022-05-27 | 安徽华峪文化科技有限公司 | Data processing system and method based on block chain |
| CN109981586B (en) * | 2019-02-27 | 2021-09-07 | 北京柏链基石科技有限公司 | Node marking method and device |
| CN110554616B (en) * | 2019-09-24 | 2021-04-27 | 北京瑞策科技有限公司 | Intelligent home data chaining method and system of Internet of things on block chain |
| CN112667123B (en) * | 2020-12-15 | 2023-01-20 | 歌尔科技有限公司 | Health detection project customization method and device, wearable device and storage medium |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104737132A (en) * | 2012-09-12 | 2015-06-24 | 萨勒斯福斯通讯有限公司 | Auction-based resource sharing for message queues in an on-demand services environment |
| CN105677478A (en) * | 2015-12-30 | 2016-06-15 | 深圳市阿拉互联网金融服务有限公司 | Method and apparatus for resources management |
| CN106576114A (en) * | 2014-08-08 | 2017-04-19 | 甲骨文国际公司 | Policy based resource management and allocation system |
| CN107688492A (en) * | 2016-08-05 | 2018-02-13 | 阿里巴巴集团控股有限公司 | Control method, device and the cluster resource management system of resource |
-
2018
- 2018-04-12 CN CN201810326747.4A patent/CN108459829B/en active Active
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104737132A (en) * | 2012-09-12 | 2015-06-24 | 萨勒斯福斯通讯有限公司 | Auction-based resource sharing for message queues in an on-demand services environment |
| CN106576114A (en) * | 2014-08-08 | 2017-04-19 | 甲骨文国际公司 | Policy based resource management and allocation system |
| CN105677478A (en) * | 2015-12-30 | 2016-06-15 | 深圳市阿拉互联网金融服务有限公司 | Method and apparatus for resources management |
| CN107688492A (en) * | 2016-08-05 | 2018-02-13 | 阿里巴巴集团控股有限公司 | Control method, device and the cluster resource management system of resource |
Also Published As
| Publication number | Publication date |
|---|---|
| CN108459829A (en) | 2018-08-28 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN108459829B (en) | Data storage method and device and computer storage medium | |
| US9483540B2 (en) | Cloud based data migration and replication | |
| CN107465656B (en) | Security monitoring big data processing method and system based on cloud computing | |
| CN112153085B (en) | Data processing method, node and block chain system | |
| US8762743B2 (en) | Encrypting data objects to back-up | |
| US8473585B1 (en) | Multi-threaded optimization for data upload | |
| US11620401B2 (en) | System and method for automatically securing sensitive data in public cloud using a serverless architecture | |
| US11841861B1 (en) | Constrained query execution | |
| US9576144B2 (en) | Secured file system management | |
| US20110238737A1 (en) | Decentralized cloud storage | |
| US10318747B1 (en) | Block chain based authentication | |
| CN106648938B (en) | Linux system application program memory management method and system | |
| CN102404389A (en) | Network invoicing method based on cloud compute and data asynchronous transmission technology | |
| US10587686B2 (en) | Sustaining backup service level objectives using dynamic resource allocation | |
| KR101714412B1 (en) | Method and apparatus for organizing database system in cloud environment | |
| CN111988262B (en) | Authentication method, authentication device, server and storage medium | |
| Jogdand et al. | CSaaS-a multi-cloud framework for secure file storage technology using open ZFS | |
| KR101993309B1 (en) | Method and program for storing service data by cloud account | |
| CN109754251B (en) | Data processing method and device, medium and terminal thereof | |
| KR102247132B1 (en) | Extended Authentication Method for Resource Access Control in a Cloud Environment Composed of Multiple Edge Servers | |
| US10963303B2 (en) | Independent storage and processing of data with centralized event control | |
| KR102278185B1 (en) | System and method for serverless service using blockchain node | |
| CN109739615A (en) | A kind of mapping method of virtual hard disk, equipment and cloud computing platform | |
| CN111399763B (en) | Method, device, system, equipment and storage medium for data storage | |
| JP5494363B2 (en) | File management program, file management method, and file management apparatus |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |