CN109933286A - Date storage method, device, computer equipment and computer readable storage medium - Google Patents
Date storage method, device, computer equipment and computer readable storage medium Download PDFInfo
- Publication number
- CN109933286A CN109933286A CN201910145362.2A CN201910145362A CN109933286A CN 109933286 A CN109933286 A CN 109933286A CN 201910145362 A CN201910145362 A CN 201910145362A CN 109933286 A CN109933286 A CN 109933286A
- Authority
- CN
- China
- Prior art keywords
- data
- super
- operation request
- aggregators
- write
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Landscapes
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
The present invention relates to several field of computer technology, a kind of date storage method, device, computer equipment and computer readable storage medium are provided.The date storage method is applied in super fusion cloud computing system, the super fusion cloud computing system includes multiple super aggregators and switch, each super aggregators include memory module, the memory module of multiple super aggregators is connected to the network to form cloud resource pond by switch, method specifically includes: receiving the first data operation request of current super aggregators, first data operation request is write operation request or read operation request；According to first data operation request, write operation or read operation are carried out to cloud resource pond.Therefore, the present invention forms cloud resource pond by integrating the memory module of multiple super aggregators, can be stored with unified planning using the memory module that unified cloud resource pond manages multiple super aggregators, reduce unnecessary data redundancy.
Description
Technical field
The invention belongs to field of computer technology more particularly to a kind of date storage method, device, computer equipment and meters
Calculation machine readable storage medium storing program for executing.
Background technique
In computer field, with to big data excavate using more and more common, need temporarily to use or persistently use
Mass data, to need a large amount of memory space.Simultaneously because business and the difference in place, cause data to generally use distribution
Formula storage, and the service for needing to carry out memory space resilient expansion, such as cloud application, at present in field of data storage institute
It is that will store equipment and using being placed in a machine, so as to cause storage equipment and apply very high integrity by the way of
Coupling is unfavorable for the extension of storage；Simultaneously for group system, the excessively dispersion of storage be easy to cause data redundancy.Therefore, existing
The problem of extension difficulty causes data redundancy greatly and due to storing dispersion is stored with the presence of technology.
Summary of the invention
It can in view of this, the embodiment of the invention provides a kind of date storage method, device, computer equipment and computers
Storage medium is read, storage extension difficulty is big present in the prior art and causes asking for data redundancy because storing dispersion to solve
Topic.
The first aspect of the embodiment of the present invention provides a kind of date storage method, applies in super fusion cloud computing system,
The super fusion cloud computing system includes multiple super aggregators and switch, and each super aggregators include depositing
Module is stored up, the memory module of multiple super aggregators is connected to the network to form cloud money by the switch
Source pond, the date storage method include:
The first data operation request of current super aggregators is received, first data operation request is asked for write operation
It asks or read operation request；
According to first data operation request, write operation or read operation are carried out to cloud resource pond.
The second aspect of the embodiment of the present invention provides a kind of data storage device, applies in super fusion cloud computing system,
The super fusion cloud computing system includes multiple super aggregators and switch, and each super aggregators include depositing
Module is stored up, the memory module of multiple super aggregators is connected to the network to form cloud money by the switch
Source pond, the data storage device include:
First receiving unit, for receiving the first data operation request of current super aggregators, the first data behaviour
Making request is write operation request or read operation request；
Operating unit, for carrying out write operation or reading to cloud resource pond according to first data operation request
Operation.
The third aspect of the embodiment of the present invention provides a kind of super fusion all-in-one machine, including memory, processor and deposits
Store up the computer program that can be run in the memory and on the processor, which is characterized in that the processor executes
It is performed the steps of when the computer program
The first data operation request of current super aggregators is received, first data operation request is asked for write operation
It asks or read operation request；
According to first data operation request, write operation or read operation are carried out to cloud resource pond.
The fourth aspect of the embodiment of the present invention provides a kind of computer readable storage medium, the computer-readable storage
Media storage has computer program, and the computer program performs the steps of when being executed by processor
The first data operation request of current super aggregators is received, first data operation request is asked for write operation
It asks or read operation request；
According to first data operation request, write operation or read operation are carried out to cloud resource pond.
Date storage method in the embodiment of the present invention is applied in super fusion cloud computing system, the super fusion cloud computing
System includes multiple super aggregators and switch, and each super aggregators include memory module, multiple described
The memory module of super aggregators is connected to the network to form cloud resource pond by the switch, and the data are deposited
Method for storing includes: the first data operation request for receiving current super aggregators, and first data operation request is write-in behaviour
Make request or read operation request；According to first data operation request, write operation or reading are carried out to cloud resource pond
Operation.Therefore, the embodiment of the present invention forms cloud resource pond by integrating the memory module of multiple super aggregators, due to using system
One cloud resource pond manages the memory module of multiple super aggregators, can be stored with unified planning, reduces unnecessary data
Redundancy, in addition, can be extended by increasing super aggregators to storage, data storage scalability is strong, improves storage
Efficiency has stronger practicability and ease for use.
Detailed description of the invention
It to describe the technical solutions in the embodiments of the present invention more clearly, below will be to embodiment or description of the prior art
Needed in attached drawing be briefly described, it should be apparent that, the accompanying drawings in the following description is only of the invention some
Embodiment for those of ordinary skill in the art without any creative labor, can also be according to these
Attached drawing obtains other attached drawings.
Fig. 1 is the schematic diagram of super fusion cloud computing system provided in an embodiment of the present invention；
Fig. 2 is the implementation process schematic diagram for the date storage method that the embodiment of the present invention one provides；
Fig. 3 is the structural schematic diagram of data storage device provided by Embodiment 2 of the present invention；
Fig. 4 is the structural schematic diagram of another data storage device provided in an embodiment of the present invention；
Fig. 5 is the structural schematic diagram of generation unit provided in an embodiment of the present invention；
Fig. 6 is the structural schematic diagram of another data storage device provided in an embodiment of the present invention；
Fig. 7 is the structural schematic diagram of operating unit provided in an embodiment of the present invention；
Fig. 8 is the structural schematic diagram of operating unit provided in an embodiment of the present invention；
Fig. 9 is the schematic diagram for the computer equipment that the embodiment of the present invention three provides.
Specific embodiment
In being described below, for illustration and not for limitation, the tool of such as particular system structure, technology etc is proposed
Body details, to understand thoroughly the embodiment of the present invention.However, it will be clear to one skilled in the art that there is no these specific
The present invention also may be implemented in the other embodiments of details.In other situations, it omits to well-known system, device, electricity
The detailed description of road and method, in case unnecessary details interferes description of the invention.
In order to illustrate technical solutions according to the invention, the following is a description of specific embodiments.
Fig. 1 shows the schematic diagram of super fusion cloud computing system provided in an embodiment of the present invention.As shown in Figure 1, super fusion
Cloud computing system includes multiple super aggregators and switch, and each super aggregators include memory module, more
The memory module of a super aggregators is connected to the network to form cloud resource pond by the switch.
Embodiment one:
Fig. 2 shows the implementation process schematic diagrames for the date storage method that the embodiment of the present invention one provides.As shown in Fig. 2,
It should be applied to date storage method specifically comprise the following steps 101 to step 102.
Step 101: receiving the first data operation request of current super aggregators, first data operation request is to write
Enter operation requests or read operation request.
Wherein, the first data operation request can be is issued by a super fusion all-in-one machine in currently super aggregators.
First data operation request can be write operation request, be also possible to read operation request.Wherein, write operation request refers to
Data in one memory module are written to the request in another memory module, read operation request is from memory module
The middle request for reading data.For example, including two super aggregators in super fusion cloud computing system, each super aggregators include
Two super fusion all-in-one machines, the first surpassing aggregators includes super fusion all-in-one machine A1 and A2, and the second surpassing aggregators includes super melt
Close all-in-one machine B1 and B2.When receive the first surpass in aggregators surpass fusion all-in-one machine A1 issue write operation request when, connect
Receive the write operation request.When receive the second surpass in aggregators surpass fusion all-in-one machine B2 issue write operation request when,
Receive the write operation request.
Step 102: according to first data operation request, write operation or read operation being carried out to cloud resource pond.
When first data operation request is write operation, the data being written will be needed to be written to the cloud resource
Data are read from the cloud resource pond when first data operation request is read operation in pond.Due to using unification
Cloud resource pond manages the memory module of multiple super aggregators, can be stored with unified planning, reduces unnecessary data redundancy.
Date storage method in the embodiment of the present invention is applied in super fusion cloud computing system, the super fusion cloud computing
System includes multiple super aggregators and switch, and each super aggregators include memory module, multiple described
The memory module of super aggregators is connected to the network to form cloud resource pond by the switch, and the data are deposited
Method for storing includes: the first data operation request for receiving current super aggregators, and first data operation request is write-in behaviour
Make request or read operation request；According to first data operation request, write operation or reading are carried out to cloud resource pond
Operation.Therefore, the embodiment of the present invention forms cloud resource pond by integrating the memory module of multiple super aggregators, due to using system
One cloud resource pond manages the memory module of multiple super aggregators, can be stored with unified planning, reduces unnecessary data
Redundancy, in addition, can be extended by increasing super aggregators to storage, data storage scalability is strong, improves storage
Efficiency has stronger practicability and ease for use.
As an embodiment of the present invention, step 102 includes step 201, step 202 and step 203, specific as follows:
Step 201: when first data operation request is read operation request, being asked according to first data manipulation
Seek the resource information for obtaining object to be read；The resource information includes the operating status and the access of continuing of super aggregators
According to path.
Wherein, the operating status of super aggregators includes normal operation and operation exception.The path of the data to be read
For determining the reading order for reading the super aggregators being related to and data to be read.
Step 202: according to the resource information, determining the reading order of data to be read.
For example, surpassing in fusion cloud computing system includes three super aggregators, each super aggregators surpass including two to be melted
All-in-one machine is closed, the first surpassing aggregators includes super fusion all-in-one machine C1, C2 and C3, and the second surpassing aggregators includes super fusion one
Machine D1, D2 and D3, the super aggregators of third include super fusion all-in-one machine E1, E2 and E3.According to read operation request, reading is got
Path is taken to include the following three types: C1, D1, E2；C1,D2,E2；C1,D3,E2.If D2 operating status is abnormal, data to be read
Reading order is C1, D1, E2 or C1, D3, E2.
Step 203: the position of the super aggregators where the reading order and the data to be read, from described
Cloud resource pond obtains the data to be read, and the data to be read that will acquire return to the current super fusion section
Point.
The position of example in undertaking, the super aggregators where data to be read can be followed successively by C1d2, D1d1, E2d3,
Middle C1d2, D1d1, E2d3 successively indicate the second memory module of super fusion all-in-one machine C1, surpass the first storage of fusion all-in-one machine D1
Module surpasses the third memory module of fusion all-in-one machine E2.The position of super aggregators where data to be read can be followed successively by
C1d2, D3d2, E2d3, wherein C1d2, D3d2, E2d3 successively indicate the second memory module of super fusion all-in-one machine C1, surpass fusion
The second memory module of all-in-one machine D3 surpasses the third memory module of fusion all-in-one machine E2.According to above two mode, from the cloud
Resource pool obtains the data to be read, and the data to be read that will acquire return to the current super aggregators.
Optionally, before the first data operation request that step 101 receives current super aggregators, further includes:
Step 301: receiving the second data operation request of current super aggregators.
Step 302: when second data operation request is write operation request, being asked according to second data manipulation
Sum the cloud resource pond directory information generate write-in planning information；Said write planning information includes each data to be stored
The information of super aggregators where corresponding memory module, the data to be stored are the execution object of said write operation.
Step 303: sending said write planning information to the current super aggregators, so that the current super fusion section
Point generates first data operation request comprising said write planning information.
For step 301 and 302, generated according to the directory information in second data operation request and the cloud resource pond
Planning information is written, combines the directory information of data to be stored and cloud resource pond, ensure that cloud resource pond can satisfy and write
The needs entered, and after step 302, said write planning information is sent to the current super aggregators, so that described
Current super aggregators generate first data operation request comprising said write planning information, so that the behaviour of write-in
It is more convenient to make, and directly carries out write operation to cloud resource pond according to the write-in planning information in first data operation request
?.
As an embodiment of the present invention, step 302 includes step 401, step 402, step 403, step 404 and step
Rapid 405, specific as follows:
Step 401: the pre-stored capacity of the data to be stored is obtained according to second data operation request.Wherein,
The pre-stored capacity of data to be stored is the sum of size or size of each data volume of the data volume of data to be stored.
Step 402: according to the directory information in the cloud resource pond, obtaining in the super fusion cloud computing system except current super
The information and resources occupation rate of super aggregators outside aggregators, obtain in the directory information according to the resources occupation rate
The idle capacity of related super aggregators.
It should be noted that the resources occupation rate can be in the super fusion cloud computing system except current super fusion section
The synthesis occupancy of super aggregators outside point, such as occupancy are 70%, then surpassing fusion section involved in directory information
Total capacity × (1-70%) of super aggregators involved in idle capacity=directory information of point.
Step 403: according to the pre-stored capacity and the free memory capacity, filtering out candidate super aggregators；Institute
Stating candidate super aggregators is the super aggregators that free memory capacity is greater than pre-stored capacity.
Example in undertaking, the super aggregators that free memory capacity is greater than free memory capacity × 0.3 are candidate super fusion section
Point.
Step 404: the shortest super aggregators of candidate of migration path are selected from the super aggregators of candidate.
Step 405: being written planning information according to the shortest super aggregators of candidate of the migration path；Said write
Planning information includes the target object of data to be stored and data to be stored write-in；The target object may is that target is super
Memory module in the super fusion all-in-one machine of the super merging point of merging point, target or the super fusion all-in-one machine of the super merging point of target.
For step 404 and 405, for example, the path of the super fusion section of the candidate for carrying out write operation to data to be stored is
F, G, H or F, G, M.Calculate path length, if it is determined that the path of F, G, H are shorter, then using super aggregators F, G, H as
The target object of said write operation, to be written planning information；Said write planning information includes data to be stored and institute
The target object of data to be stored write-in is stated, which is the super aggregators of target.
Further, step 405 can be with are as follows:
It is when the quantity of the shortest super aggregators of candidate of migration path is one, the migration path is shortest candidate super
Aggregators are as the super aggregators of target.
When the quantity of the shortest super aggregators of candidate of migration path is not less than two, to the shortest candidate of migration path
Super aggregators are screened to obtain the super aggregators of target, and using the super aggregators of the target as the target pair
As.
Wherein, the condition that the above-mentioned super aggregators of candidate shortest to migration path are screened are as follows: the super fusion section of candidate
The space utilisation highest of point, and space utilisation is no more than default utilization threshold (such as 50%).For example, migration path is most short
The super aggregators of candidate be F, G and H, the space utilisation after data to be stored is written is followed successively by M1, M2 and M3, will migrate
The shortest super aggregators of candidate in path are compared for space utilisation, if comparison result are as follows: default utilization threshold > M1
> M2 > M3, then the super aggregators of target are super aggregators F, and super aggregators F is as the target object in write-in planning information.
It as shown in the above, can be quick in the shortest not unique situation of the super aggregators of candidate of migration path
It determines unique target object, so that write-in planning information is more acurrate, improves the efficiency of write operation.
Further, step 405 can also include:
When the quantity of the shortest super aggregators of candidate in path is one, by the shortest super aggregators of candidate in the path
Surpass aggregators as target.
When the quantity of the shortest super aggregators of candidate in path is not less than two, candidate shortest to migration path is super to melt
Node is closed to be screened to obtain the super aggregators of target.
Super fusion all-in-one machine in the super aggregators of above-mentioned target is screened to obtain the super fusion all-in-one machine of target, it will
The super fusion all-in-one machine of target is as the target object in said write planning information.
Wherein, the condition screened to candidate super aggregators is identical as foregoing teachings, therefore repeats no more.To above-mentioned
The condition that super fusion all-in-one machine in the super aggregators of target is screened are as follows: the super fusion all-in-one machine in the super aggregators of target
Space utilisation highest, and space utilisation is no more than default utilization threshold (such as 80%).Such as: assuming that by screening
The super aggregators of the target arrived are F, include super fusion all-in-one machine F1, F2 and F3 in the super aggregators F of target.Super fusion all-in-one machine
Space utilisation of the F1 after data to be stored is written is W1, surpasses storage benefit of the fusion all-in-one machine F2 after data to be stored is written
It is W2 with rate, surpassing space utilisation of the fusion all-in-one machine F3 after data to be stored is written is W3, by depositing for super fusion all-in-one machine
Storage utilization rate is compared, if comparison result are as follows: default utilization threshold > W1 > W2 > W3, then in the super aggregators F of target
The super fusion all-in-one machine of target is super fusion all-in-one machine F1, surpasses fusion all-in-one machine F1 as the target object in write-in planning information.
As shown in the above, the super aggregators of target are further determined that on the basis of target super aggregators have been determined
The super fusion all-in-one machine of interior target, using the super fusion all-in-one machine of target as the target object in said write planning information, so that
Planning information is written specifically, improves the efficiency of write operation, in addition also ensures the high storage benefit of super fusion all-in-one machine
With rate, the waste of storage resource is avoided.It should be noted that the number of the super fusion all-in-one machine of target in the super aggregators of target
Amount can be one, two or more, be not limited thereto.
Further, step 405 specifically can also include:
When the quantity of the shortest super aggregators of candidate in path is one, by the shortest super aggregators of candidate in the path
Surpass aggregators as target.
When the quantity of the shortest super aggregators of candidate in path is not less than two, candidate shortest to migration path is super to melt
Node is closed to be screened to obtain the super aggregators of target.
Super fusion all-in-one machine in the super aggregators of above-mentioned target is screened to obtain the super fusion all-in-one machine of target.
The memory module of the super fusion all-in-one machine of above-mentioned target is screened to obtain target memory module, and target is deposited
Module is stored up as the target object in said write planning information.
Wherein, to merge the condition that all-in-one machine is screened to candidate super aggregators and surpassing identical as foregoing teachings, therefore
It repeats no more.The condition that the memory module of the super fusion all-in-one machine of above-mentioned target is screened are as follows: in the super fusion all-in-one machine of target
Memory module space utilisation highest, and space utilisation is no more than default utilization threshold (such as 70%).Such as: assuming that
The super fusion all-in-one machine of the target obtained by screening is F1, include in the super fusion all-in-one machine F1 of target memory module F1d1,
F1d2 and F1d3.Space utilisation of the memory module F1d1 after data to be stored is written is w1, and memory module F1d2 is being written
Space utilisation after data to be stored is w2, and space utilisation of the memory module F1d3 after data to be stored is written is w3,
The space utilisation of the memory module of the super fusion all-in-one machine of target is compared, if comparison result are as follows: default utilization rate threshold
Value > w1 > w2 > w3, then the target memory module in the super fusion all-in-one machine F1 of target is memory module F1d1, then memory module F1d1
As the target object in write-in planning information.
As shown in the above, target super fusion one is further determined that on the basis of being determined that target is super and having merged all-in-one machine
Target memory module in body machine, using target memory module as the target object in said write planning information, so that write-in
Planning information specifically, further improves the efficiency of write operation, in addition also ensures that the high storage of memory module utilizes
Rate avoids the waste of storage resource.It should be noted that the quantity of the target memory module in the super fusion all-in-one machine of target can
To be one, two or more, it is not limited thereto.
As an embodiment of the present invention, may also include that after above-mentioned steps 401
When the free memory capacity low pre-stored capacity of the super aggregators involved in the directory information,
Longitudinal capacity extension or lateral capacity extension are carried out to the super aggregators in the super fusion cloud computing system.
For example, pre-stored capacity is 50G, the free memory capacity of super aggregators involved in the directory information is
48G then carries out longitudinal capacity extension or lateral capacity extension to the super aggregators in the super fusion cloud computing system, to expand
The capacity of fuzz resource pool.
Wherein, longitudinal capacity extension are as follows: the number carried out between multiple super fusion all-in-one machines in same super aggregators
According to backup and/or Data Migration；The transverse direction capacity extension are as follows: when the quantity of the super aggregators is greater than one, not
With the Data Migration carried out between super aggregators.
Accordingly, as one embodiment of the present of invention, step 102 is specific can include:
Step 501: when first data operation request is write operation request, obtaining in said write operation requests
Write-in planning information.
Step 502: the super aggregators of target corresponding with write operation are obtained according to said write planning information.
Step 503: the data to be stored being written in the memory module of the super aggregators of the target.
For example, it is preferable to which the write-in planning information obtained in said write operation requests includes F1d2, G1d1, H2d3, then lock
Surely memory module F1d2, G1d1, H2d3 in super aggregators F, G, H, data to be stored is respectively written into cloud resource pond
Memory module F1d2, G1d1, H2d3.
It should be understood that the size of the serial number of each step is not meant that the order of the execution order in above-described embodiment, each process
Execution sequence should be determined by its function and internal logic, the implementation process without coping with the embodiment of the present invention constitutes any limit
It is fixed.
Embodiment two:
Referring to FIG. 3, it illustrates the structural block diagrams of data storage device provided by Embodiment 2 of the present invention.Data storage
Device is applied in super fusion cloud computing system, and the super fusion cloud computing system includes that multiple super aggregators and data exchange are set
Standby, each super aggregators include memory module, and the memory module of multiple super aggregators is handed over by the data
Exchange device is connected to the network to form cloud resource pond.Data storage device 30 includes: the first receiving unit 31 and operating unit
32.Wherein, the concrete function of each unit is as follows:
First receiving unit 31, for receiving the first data operation request of current super aggregators, first data
Operation requests are write operation request or read operation request.
Operating unit 32, for carrying out write operation or reading to cloud resource pond according to first data operation request
Extract operation.
Optionally, as shown in figure 4, data storage device further include:
Receiving unit 33, for receiving the second data operation request of current super aggregators.
Generation unit 34, for being counted according to described second when second data operation request is write operation request
Write-in planning information is generated according to the directory information in operation requests and the cloud resource pond；Said write planning information include each to
The information of super aggregators where the corresponding memory module of storing data, the data to be stored are holding for said write operation
Row object.
Transmission unit 35, for sending said write planning information to the current super aggregators, so that described current
Super aggregators generate first data operation request comprising said write planning information.
Optionally, as shown in figure 5, the generation unit 34 includes:
First obtains subelement 341, for obtaining the pre- of the data to be stored according to second data operation request
Memory capacity.
Second obtains subelement 342, for the directory information according to the cloud resource pond, obtains the super fusion cloud computing
The information and resources occupation rate of super aggregators in system in addition to current super aggregators, obtain according to the resources occupation rate
The idle capacity of super aggregators involved in the directory information.
Subelement 343 is screened, candidate is super to melt for filtering out according to the pre-stored capacity and the free memory capacity
Close node；The super aggregators of candidate are the super aggregators that free memory capacity is greater than pre-stored capacity.
Subelement 344 is selected, for selecting the shortest candidate super fusion of migration path from the super aggregators of candidate
Node.
Subelement 345 is determined, for being written planning letter according to the shortest super aggregators of candidate of the migration path
Breath；Said write planning information includes the target object of data to be stored and data to be stored write-in.
Optionally, as shown in fig. 6, the data storage device further include:
Expanding element 36, for working as the low institute of free memory capacity of super aggregators involved in the directory information
When stating pre-stored capacity, longitudinal capacity extension or lateral capacity are carried out to the super aggregators in the super fusion cloud computing system
Extension；The longitudinal direction capacity extension are as follows: in same super aggregators between multiple super fusion all-in-one machines the data backup that carries out and/
Or Data Migration；The transverse direction capacity extension are as follows: when the quantity of the super aggregators is greater than one, in the super fusion section of difference
The Data Migration carried out between point.
Optionally, as shown in fig. 7, the operating unit 32 includes:
Read operation request obtains subelement 321, is used for when first data operation request is read operation request,
The resource information of object to be read is obtained according to first data operation request；The resource information includes super aggregators
The path of operating status and the data to be read.
Reading order determines subelement 323, for determining the reading order of data to be read according to the resource information.
Subelement 335 is returned to, for according to the super aggregators where the reading order and the data to be read
Position obtains the data to be read from the cloud resource pond, and the data to be read that will acquire return to described work as
Preceding super aggregators.
Optionally, as shown in figure 8, the operating unit 32 includes:
Write operation request obtains subelement 322, is used for when first data operation request is write operation request,
Obtain the write-in planning information in said write operation requests.
The super aggregators of target obtain subelement 324, for being obtained and write operation pair according to said write planning information
The super aggregators of the target answered.
Subelement 326 is written, for the data to be stored being written in the memory module of the super aggregators of the target.
Data storage device in the embodiment of the present invention is applied in super fusion cloud computing system, the super fusion cloud computing
System includes multiple super aggregators and switch, and each super aggregators include memory module, multiple described
The memory module of super aggregators is connected to the network to form cloud resource pond by the switch, and the data are deposited
Method for storing includes: the first data operation request for receiving current super aggregators, and first data operation request is write-in behaviour
Make request or read operation request；According to first data operation request, write operation or reading are carried out to cloud resource pond
Operation.Therefore, the embodiment of the present invention forms cloud resource pond by integrating the memory module of multiple super aggregators, due to using system
One cloud resource pond manages the memory module of multiple super aggregators, can be stored with unified planning, reduces unnecessary data
Redundancy, in addition, can be extended by increasing super aggregators to storage, data storage scalability is strong, improves storage
Efficiency has stronger practicability and ease for use.
Embodiment three:
Fig. 9 is the schematic diagram for the computer equipment that the embodiment of the present invention three provides.As shown in figure 9, the calculating of the embodiment
Machine equipment 9 includes: processor 90, memory 91 and is stored in the memory 91 and can run on the processor 90
Computer program 92, such as date storage method program.The processor 90 is realized when executing the computer program 92
State the step in each date storage method embodiment, such as step 101 shown in Fig. 2 is to 102.Alternatively, the processor 90
Realize the function of each unit in above-mentioned each Installation practice when executing the computer program 92, for example, module 31 shown in Fig. 3 to
32 function.
Illustratively, the computer program 92 can be divided into one or more module/units, it is one or
Multiple module/units are stored in the memory 91, and are executed by the processor 90, to complete the present invention.Described one
A or multiple module/units can be the series of computation machine program instruction section that can complete specific function, which is used for
Implementation procedure of the computer program 92 in the data storage device 9 of the computer equipment is described.For example, the calculating
Machine program 92 can be divided into the first receiving unit and operating unit, and the concrete function of each unit is as follows:
First receiving unit, for receiving the first data operation request of current super aggregators, the first data behaviour
Making request is write operation request or read operation request.
Operating unit, for carrying out write operation or reading to cloud resource pond according to first data operation request
Operation.
The computer equipment 9 can be the calculating such as desktop PC, notebook, palm PC and cloud server and set
It is standby.The computer equipment may include, but be not limited only to, processor 90, memory 91.It will be understood by those skilled in the art that
Fig. 9 is only the example of computer equipment, does not constitute the restriction to computer equipment, may include more more or less than illustrating
Component, perhaps combine certain components or different components, such as the computer equipment can also be set including input and output
Standby, network access equipment, bus etc..
Alleged processor 90 can be central processing unit (Central Processing Unit, CPU), can also be
Other general processors, digital signal processor (Digital Signal Processor, DSP), specific integrated circuit
(Application Specific Integrated Circuit, ASIC), ready-made programmable gate array (Field-
Programmable Gate Array, FPGA) either other programmable logic device, discrete gate or transistor logic,
Discrete hardware components etc..General processor can be microprocessor or the processor is also possible to any conventional processor
Deng.
The memory 91 can be the internal storage unit of the computer equipment 9, such as the hard disk of computer equipment 9
Or memory.The memory 91 is also possible to the External memory equipment of the computer equipment 9, such as the computer equipment 9
The plug-in type hard disk of upper outfit, intelligent memory card (Smart Media Card, SMC), secure digital (Secure Digital,
SD) block, flash card (Flash Card) etc..Further, the memory 91 can also both include the computer equipment 9
Internal storage unit also includes External memory equipment.The memory 91 is for storing the computer program and the calculating
Other programs and data needed for machine equipment.The memory 91, which can be also used for temporarily storing, have been exported or will be defeated
Data out.
It should be understood that the size of the serial number of each step is not meant that the order of the execution order in above-described embodiment, each process
Execution sequence should be determined by its function and internal logic, the implementation process without coping with the embodiment of the present invention constitutes any limit
It is fixed.
It is apparent to those skilled in the art that for convenience of description and succinctly, only with above-mentioned each function
Can unit, module division progress for example, in practical application, can according to need and by above-mentioned function distribution by different
Functional unit, module are completed, i.e., the internal structure of described device is divided into different functional unit or module, more than completing
The all or part of function of description.Each functional unit in embodiment, module can integrate in one processing unit, can also
To be that each unit physically exists alone, can also be integrated in one unit with two or more units, it is above-mentioned integrated
Unit both can take the form of hardware realization, can also realize in the form of software functional units.In addition, each function list
Member, the specific name of module are also only for convenience of distinguishing each other, the protection scope being not intended to limit this application.Above system
The specific work process of middle unit, module, can refer to corresponding processes in the foregoing method embodiment, and details are not described herein.
In the above-described embodiments, it all emphasizes particularly on different fields to the description of each embodiment, is not described in detail or remembers in some embodiment
The part of load may refer to the associated description of other embodiments.
Those of ordinary skill in the art may be aware that list described in conjunction with the examples disclosed in the embodiments of the present disclosure
Member and algorithm steps can be realized with the combination of electronic hardware or computer software and electronic hardware.These functions are actually
It is implemented in hardware or software, the specific application and design constraint depending on technical solution.Professional technician
Each specific application can be used different methods to achieve the described function, but this realization is it is not considered that exceed
The scope of the present invention.
In embodiment provided by the present invention, it should be understood that disclosed device/terminal device and method, it can be with
It realizes by another way.For example, device described above/terminal device embodiment is only schematical, for example, institute
The division of module or unit is stated, only a kind of logical function partition, there may be another division manner in actual implementation, such as
Multiple units or components can be combined or can be integrated into another system, or some features can be ignored or not executed.Separately
A bit, shown or discussed mutual coupling or direct-coupling or communication connection can be through some interfaces, device
Or the INDIRECT COUPLING or communication connection of unit, it can be electrical property, mechanical or other forms.
The unit as illustrated by the separation member may or may not be physically separated, aobvious as unit
The component shown may or may not be physical unit, it can and it is in one place, or may be distributed over multiple
In network unit.It can select some or all of unit therein according to the actual needs to realize the mesh of this embodiment scheme
's.
It, can also be in addition, the functional units in various embodiments of the present invention may be integrated into one processing unit
It is that each unit physically exists alone, can also be integrated in one unit with two or more units.Above-mentioned integrated list
Member both can take the form of hardware realization, can also realize in the form of software functional units.
If the integrated module/unit be realized in the form of SFU software functional unit and as independent product sale or
In use, can store in a computer readable storage medium.Based on this understanding, the present invention realizes above-mentioned implementation
All or part of the process in example method, can also instruct relevant hardware to complete, the meter by computer program
Calculation machine program can be stored in a computer readable storage medium, the computer program when being executed by processor, it can be achieved that on
The step of stating each embodiment of the method.Wherein, the computer program includes computer program code, the computer program generation
Code can be source code form, object identification code form, executable file or certain intermediate forms etc..The computer-readable medium
It may include: any entity or device, recording medium, USB flash disk, mobile hard disk, magnetic that can carry the computer program code
Dish, CD, computer storage, read-only memory (ROM, Read-Only Memory), random access memory (RAM,
Random Access Memory), electric carrier signal, telecommunication signal and software distribution medium etc..It should be noted that described
The content that computer-readable medium includes can carry out increasing appropriate according to the requirement made laws in jurisdiction with patent practice
Subtract, such as does not include electric carrier signal and electricity according to legislation and patent practice, computer-readable medium in certain jurisdictions
Believe signal.
Embodiment described above is merely illustrative of the technical solution of the present invention, rather than its limitations；Although referring to aforementioned reality
Applying example, invention is explained in detail, those skilled in the art should understand that: it still can be to aforementioned each
Technical solution documented by embodiment is modified or equivalent replacement of some of the technical features；And these are modified
Or replacement, the spirit and scope for technical solution of various embodiments of the present invention that it does not separate the essence of the corresponding technical solution should all
It is included within protection scope of the present invention.
Claims (10)
1. a kind of date storage method, which is characterized in that apply in super fusion cloud computing system, the super fusion cloud computing system
Including multiple super aggregators and switch, each super aggregators include memory module, multiple described super to melt
The memory module for closing node is connected to the network to form cloud resource pond, the data storage side by the switch
Method includes:
Receive the first data operation request of current super aggregators, first data operation request for write operation request or
Read operation request；
According to first data operation request, write operation or read operation are carried out to cloud resource pond.
2. date storage method as described in claim 1, which is characterized in that receive the first of current super aggregators described
Before data operation request, further includes:
Receive the second data operation request of current super aggregators；
When second data operation request is write operation request, provided according to second data operation request and the cloud
The directory information in source pond generates write-in planning information；Said write planning information includes the corresponding storage mould of each data to be stored
The information of super aggregators where block, the data to be stored are the execution object of said write operation；
Said write planning information is sent to the current super aggregators, so that it includes institute that the current super aggregators, which generate,
State first data operation request of write-in planning information.
3. date storage method as claimed in claim 2, which is characterized in that described when second data operation request is to write
When entering operation requests, write-in planning letter is generated according to the directory information in second data operation request and the cloud resource pond
Breath, comprising:
The pre-stored capacity of the data to be stored is obtained according to second data operation request；
According to the directory information in the cloud resource pond, obtain in the super fusion cloud computing system in addition to current super aggregators
The information and resources occupation rate of super aggregators, according to the resources occupation rate obtain the directory information involved in surpass melt
Close the idle capacity of node；
According to the pre-stored capacity and the free memory capacity, candidate super aggregators are filtered out；The candidate super fusion
Node is the super aggregators that free memory capacity is greater than pre-stored capacity；
The shortest super aggregators of candidate of migration path are selected from the super aggregators of candidate；
Planning information is written according to the shortest super aggregators of candidate of the migration path；Said write planning information includes
The target object of data to be stored and data to be stored write-in.
4. date storage method as claimed in claim 3, which is characterized in that obtained according to second data operation request
After the pre-stored capacity of the data to be stored, further includes:
When the free memory capacity low pre-stored capacity of the super aggregators involved in the directory information, to institute
It states the super aggregators in super fusion cloud computing system and carries out longitudinal capacity extension or lateral capacity extension；
The longitudinal direction capacity extension are as follows: in same super aggregators between multiple super fusion all-in-one machines the data backup that carries out and/
Or Data Migration；
The transverse direction capacity extension are as follows: when the quantity of the super aggregators is greater than one, between different super aggregators
The Data Migration carried out.
5. date storage method as described in claim 1, which is characterized in that it is described according to first data operation request,
Include: to the step of progress write operation of cloud resource pond or read operation
When first data operation request is read operation request, obtained according to first data operation request to be read
The resource information of object；The resource information includes the operating status of super aggregators and the path of the data to be read；
According to the resource information, the reading order of data to be read is determined；
The position of super aggregators where the reading order and the data to be read is obtained from the cloud resource pond
The data to be read, and the data to be read that will acquire return to the current super aggregators.
6. date storage method as described in claim 1, which is characterized in that it is described according to first data operation request,
Include: to the step of progress write operation of cloud resource pond or read operation
When first data operation request is write operation request, letter is planned in the write-in obtained in said write operation requests
Breath；
The super aggregators of target corresponding with write operation are obtained according to said write planning information；
The data to be stored is written in the memory module of the super aggregators of the target.
7. a kind of data storage device, which is characterized in that apply in super fusion cloud computing system, the super fusion cloud computing system
Including multiple super aggregators and switch, each super aggregators include memory module, multiple described super to melt
The memory module for closing node is connected to the network to form cloud resource pond, the data storage dress by the switch
It sets and includes:
First receiving unit, for receiving the first data operation request of current super aggregators, first data manipulation is asked
It asks as write operation request or read operation request；
Operating unit, for carrying out write operation or read operation to cloud resource pond according to first data operation request.
8. data storage device as claimed in claim 7, which is characterized in that further include:
Receiving unit, for receiving the second data operation request of current super aggregators；
Generation unit is used for when second data operation request is write operation request, according to second data manipulation
The directory information in request and the cloud resource pond generates write-in planning information；Said write planning information includes each number to be stored
According to the information of the super aggregators where corresponding memory module, the data to be stored is the execution pair of said write operation
As；
Transmission unit, for sending said write planning information to the current super aggregators, so that the current super fusion
Node generates first data operation request comprising said write planning information.
9. a kind of computer equipment, including memory, processor and storage are in the memory and can be in the processor
The computer program of upper operation, which is characterized in that the processor realized when executing the computer program as claim 1 to
The step of any one of 6 the method.
10. a kind of computer readable storage medium, the computer-readable recording medium storage has computer program, and feature exists
In when the computer program is executed by processor the step of any one of such as claim 1 to 6 of realization the method.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910145362.2A CN109933286A (en) | 2019-02-27 | 2019-02-27 | Date storage method, device, computer equipment and computer readable storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910145362.2A CN109933286A (en) | 2019-02-27 | 2019-02-27 | Date storage method, device, computer equipment and computer readable storage medium |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN109933286A true CN109933286A (en) | 2019-06-25 |
Family
ID=66986029
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201910145362.2A Pending CN109933286A (en) | 2019-02-27 | 2019-02-27 | Date storage method, device, computer equipment and computer readable storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN109933286A (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN115695457A (en) * | 2022-10-26 | 2023-02-03 | 北京博望华科科技有限公司 | Power information management method, management device, equipment and medium |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20120051667A1 (en) * | 2010-08-27 | 2012-03-01 | Korea University Research And Business Foundation | Method and system of reconstructing super-resolution image |
| CN106991121A (en) * | 2017-02-23 | 2017-07-28 | 深圳市中博睿存信息技术有限公司 | Super fused data storage method and system |
| CN107037985A (en) * | 2017-02-14 | 2017-08-11 | 中山大学 | The super fusion integrated machine system of one kind and its horizontal and vertical expansion method |
| CN107105003A (en) * | 2017-02-14 | 2017-08-29 | 广州云晫信息科技有限公司 | Cloud system is melted automatically in the super fusion thin cloud data center of one kind |
-
2019
- 2019-02-27 CN CN201910145362.2A patent/CN109933286A/en active Pending
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20120051667A1 (en) * | 2010-08-27 | 2012-03-01 | Korea University Research And Business Foundation | Method and system of reconstructing super-resolution image |
| CN107037985A (en) * | 2017-02-14 | 2017-08-11 | 中山大学 | The super fusion integrated machine system of one kind and its horizontal and vertical expansion method |
| CN107105003A (en) * | 2017-02-14 | 2017-08-29 | 广州云晫信息科技有限公司 | Cloud system is melted automatically in the super fusion thin cloud data center of one kind |
| CN106991121A (en) * | 2017-02-23 | 2017-07-28 | 深圳市中博睿存信息技术有限公司 | Super fused data storage method and system |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN115695457A (en) * | 2022-10-26 | 2023-02-03 | 北京博望华科科技有限公司 | Power information management method, management device, equipment and medium |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN107733855B (en) | A kind of block catenary system and application method that can support publicly-owned chain, alliance's chain and privately owned chain simultaneously | |
| CN109949157B (en) | Business data uplink method, device and system | |
| CN109960587A (en) | The storage resource distribution method and device of super fusion cloud computing system | |
| CN110297766A (en) | Method for testing software and software testing system based on distributed test node cluster | |
| CN112597153B (en) | Block chain-based data storage method, device and storage medium | |
| CN112612523B (en) | Embedded equipment driving system and method | |
| CN114827165A (en) | Method and block link point for grouping multiple transactions | |
| CN110517145A (en) | Data trade method and relevant device based on multi-tiling interchain | |
| CN111899011A (en) | Medical bill reconciliation system, computer equipment and storage medium | |
| CN109241357A (en) | Chain structure model and its construction method, system and terminal device | |
| CN109614263B (en) | Disaster tolerance data processing method, device and system | |
| CN114936256A (en) | Method for executing transaction in block chain and block chain link point | |
| CN109976875A (en) | A kind of data monitoring method and device of super fusion cloud computing system | |
| CN109947531A (en) | The expanding storage depth method, apparatus and storage medium of super fusion all-in-one machine | |
| CN109933286A (en) | Date storage method, device, computer equipment and computer readable storage medium | |
| CN113326026B (en) | Method and terminal for generating micro-service business process interface | |
| CN114022148A (en) | Transaction conflict detection method, device, equipment and storage medium based on block chain | |
| CN107223274B (en) | Processing method, device and the financial terminal of financial terminal business | |
| CN109542841A (en) | The method and terminal device of data snapshot are created in cluster | |
| CN111831868A (en) | Method and apparatus for financial product configuration | |
| CN117113900A (en) | TDM-based segmentation processing method and device | |
| CN116645061A (en) | Customs clearance data processing method based on block chain system and consensus node | |
| CN114844904B (en) | System and method for cross-blockchain interactions | |
| US20110246158A1 (en) | Method for simulating a complex system with construction of at least one model including at least one modelled router, corresponding computer software package and storage means | |
| CN113986923A (en) | Distributed transaction processing method, device and equipment based on only additional file storage |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20190625 |
|
| RJ01 | Rejection of invention patent application after publication |