CN109144770A - The data processing method and device of storage system - Google Patents
The data processing method and device of storage system Download PDFInfo
- Publication number
- CN109144770A CN109144770A CN201810874819.9A CN201810874819A CN109144770A CN 109144770 A CN109144770 A CN 109144770A CN 201810874819 A CN201810874819 A CN 201810874819A CN 109144770 A CN109144770 A CN 109144770A
- Authority
- CN
- China
- Prior art keywords
- data
- target data
- parts
- storage end
- user terminal
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/07—Responding to the occurrence of a fault, e.g. fault tolerance
- G06F11/08—Error detection or correction by redundancy in data representation, e.g. by using checking codes
- G06F11/10—Adding special bits or symbols to the coded information, e.g. parity check, casting out 9's or 11's
- G06F11/1008—Adding special bits or symbols to the coded information, e.g. parity check, casting out 9's or 11's in individual solid state devices
- G06F11/1048—Adding special bits or symbols to the coded information, e.g. parity check, casting out 9's or 11's in individual solid state devices using arrangements adapted for a specific error detection or correction feature
Abstract
Present disclose provides a kind of data processing methods of storage system, the storage system includes user terminal and storage end, user terminal is for receiving user's operation request, storage end is for storing data, this method is applied to user terminal, it include: to receive user's operation request, the operation requests include carrying out write operation to target data；In the case where the user terminal is stored with the target data, respond the operation requests, first processing is carried out to the target data, treated target data and the first flag data are sent to the storage end, wherein, first flag data is used to indicate the storage end and directly stores treated the target data；In the case where the user terminal does not store the target data, the operation requests and the second flag data are sent to the storage end, wherein, second flag data is used to indicate the storage end and carries out second processing to the target data, and target data stores by treated.
Description
Technical field
This disclosure relates to a kind of data processing method of storage system and a kind of data processing equipment of storage system.
Background technique
With the fast development of computer technology and the explosive growth of data volume, in order to guarantee the safety of data,
The mode for generalling use the more copies of data realizes the redundancy of data.However, with the constant growth of data volume, copy mode
The low problem of bring storage efficiency is more and more obvious.Then, there is the data redundancy strategy of correcting and eleting codes mode, counting on an equal basis
In the case where redundancy, correcting and eleting codes mode can bring greatly improving for storage efficiency.
In correcting and eleting codes mode, usually needs that a data are first divided into the original data of K block when calculating, be based on K
Block initial data obtains M block check data by correcting and eleting codes algorithm, and obtained K+M block number is empty according to storage is written according to rule
Between.
During realizing disclosure design, at least there are the following problems in the prior art for inventor's discovery, some are deposited
The function of the calculating verification data of storage system realizes that the function of the calculating verification data of some storage systems is being stored in user terminal
End is realized, very not flexible.
Summary of the invention
An aspect of this disclosure provides a kind of data processing method of storage system, and the storage system includes user
End and storage end, the user terminal for receive user's operation request, the storage end for storing data, the method application
In the user terminal, comprising: receive user's operation request, the operation requests include carrying out write operation to target data, in institute
It states in the case that user terminal is stored with the target data, responds the operation requests, the target data is carried out at first
Treated target data and the first flag data are sent to the storage end, wherein first flag data is used by reason
Target data that treated described in directly storing in the instruction storage end, does not store the target data in the user terminal
In the case where, the operation requests and the second flag data are sent to the storage end, wherein second flag data
It is used to indicate the storage end and second processing is carried out to the target data, and target data stores by treated.
Optionally, above-mentioned that first processing is carried out to the target data, comprising: to write behaviour to described in target data progress
Make, generate fresh target data, and the fresh target data are divided into K parts of target datas, is calculated by the K parts of target data
M parts of verification data out, wherein K is the integer more than or equal to 1, and M is the integer more than or equal to 1.
Optionally, above-mentioned that treated target data and the first flag data are sent to the storage end, comprising: will
The K parts of target data, M parts of check numbers are accordingly and the first flag data is sent to the storage end, wherein first label
Data are used to indicate the storage end and directly store the K parts of target data and M parts of verification data.
Optionally, above-mentioned that second processing is carried out to the target data, comprising: the target data to be restored, to the mesh
It marks data and carries out the write operation, generate fresh target data, the fresh target data are divided into K parts of target datas, pass through the K
Part target data calculates M parts of verification data, wherein K is the integer more than or equal to 1, and M is the integer more than or equal to 1.
Optionally, M parts of verification data are calculated above by the K parts of target data, comprising: logical using correcting and eleting codes algorithm
It crosses the K parts of target data and calculates M parts of verification data.
Another aspect of the disclosure provides a kind of data processing equipment of storage system, and the storage system includes using
Family end and storage end, the user terminal is for receiving user's operation request, and the storage end for storing data, answer by described device
For the user terminal, including receiving module, first processing module and Second processing module.Wherein, receiving module, which receives, uses
Family operation requests, the operation requests include carrying out write operation to target data.First processing module is stored in the user terminal
In the case where having the target data, the operation requests are responded, the first processing are carried out to the target data, by treated
Target data and the first flag data are sent to the storage end, wherein first flag data is used to indicate described deposit
Storage end directly store described in treated target data.Second processing module does not store the target data in the user terminal
In the case where, the operation requests and the second flag data are sent to the storage end, wherein second flag data
It is used to indicate the storage end and second processing is carried out to the target data, and target data stores by treated.
Optionally, above-mentioned that first processing is carried out to the target data, comprising: to write behaviour to described in target data progress
Make, generates fresh target data, the fresh target data are divided into K parts of target datas, M is calculated by the K parts of target data
Part verification data, wherein K is the integer more than or equal to 1, and M is the integer more than or equal to 1.
Optionally, above-mentioned that treated target data and the first flag data are sent to the storage end, comprising: will
The K parts of target data, M parts of check numbers are accordingly and the first flag data is sent to the storage end, wherein first label
Data are used to indicate the storage end and directly store the K parts of target data and M parts of verification data.
Optionally, above-mentioned that second processing is carried out to the target data, comprising: the target data to be restored, to the mesh
It marks data and carries out the write operation, generate fresh target data, the fresh target data are divided into K parts of target datas, pass through the K
Part target data calculates M parts of verification data, wherein K is the integer more than or equal to 1, and M is the integer more than or equal to 1.
Optionally, M parts of verification data are calculated above by the K parts of target data, comprising: logical using correcting and eleting codes algorithm
It crosses the K parts of target data and calculates M parts of verification data.
Another aspect of the present disclosure provides a kind of data processing system of storage system, comprising: one or more storage
Device is stored with executable instruction and one or more processors, executes the executable instruction, as described above to realize
Method.
Another aspect of the present disclosure provides a kind of non-volatile memory medium, is stored with computer executable instructions, institute
Instruction is stated when executed for realizing method as described above.
Another aspect of the present disclosure provides a kind of computer program, and the computer program, which includes that computer is executable, to be referred to
It enables, described instruction is when executed for realizing method as described above.
Detailed description of the invention
In order to which the disclosure and its advantage is more fully understood, referring now to being described below in conjunction with attached drawing, in which:
Fig. 1 diagrammatically illustrates the applied field of the data processing method and device of the storage system according to the embodiment of the present disclosure
Scape；
Fig. 2 diagrammatically illustrates the flow chart of the data processing method of the storage system according to the embodiment of the present disclosure；
Fig. 3 diagrammatically illustrates the block diagram of the data processing equipment of the storage system according to the embodiment of the present disclosure；And
Fig. 4 diagrammatically illustrates the block diagram of the computer system according to the embodiment of the present disclosure.
Specific embodiment
Hereinafter, will be described with reference to the accompanying drawings embodiment of the disclosure.However, it should be understood that these descriptions are only exemplary
, and it is not intended to limit the scope of the present disclosure.In the following detailed description, to elaborate many specific thin convenient for explaining
Section is to provide the comprehensive understanding to the embodiment of the present disclosure.It may be evident, however, that one or more embodiments are not having these specific thin
It can also be carried out in the case where section.In addition, in the following description, descriptions of well-known structures and technologies are omitted, to avoid
Unnecessarily obscure the concept of the disclosure.
Term as used herein is not intended to limit the disclosure just for the sake of description specific embodiment.It uses herein
The terms "include", "comprise" etc. show the presence of the feature, step, operation and/or component, but it is not excluded that in the presence of
Or add other one or more features, step, operation or component.
There are all terms (including technical and scientific term) as used herein those skilled in the art to be generally understood
Meaning, unless otherwise defined.It should be noted that term used herein should be interpreted that with consistent with the context of this specification
Meaning, without that should be explained with idealization or excessively mechanical mode.
It, in general should be according to this using statement as " at least one in A, B and C etc. " is similar to
Field technical staff is generally understood the meaning of the statement to make an explanation (for example, " system at least one in A, B and C "
Should include but is not limited to individually with A, individually with B, individually with C, with A and B, with A and C, have B and C, and/or
System etc. with A, B, C).Using statement as " at least one in A, B or C etc. " is similar to, generally come
Saying be generally understood the meaning of the statement according to those skilled in the art to make an explanation (for example, " having in A, B or C at least
One system " should include but is not limited to individually with A, individually with B, individually with C, with A and B, have A and C, have
B and C, and/or the system with A, B, C etc.).It should also be understood by those skilled in the art that substantially arbitrarily indicating two or more
The adversative conjunction and/or phrase of optional project shall be construed as either in specification, claims or attached drawing
A possibility that giving including one of these projects, either one or two projects of these projects.For example, phrase " A or B " should
A possibility that being understood to include " A " or " B " or " A and B ".
Shown in the drawings of some block diagrams and/or flow chart.It should be understood that some sides in block diagram and/or flow chart
Frame or combinations thereof can be realized by computer program instructions.These computer program instructions can be supplied to general purpose computer,
The processor of special purpose computer or other programmable data processing units, so that these instructions are when executed by this processor can be with
Creation is for realizing function/operation device illustrated in these block diagrams and/or flow chart.
Therefore, the technology of the disclosure can be realized in the form of hardware and/or software (including firmware, microcode etc.).Separately
Outside, the technology of the disclosure can take the form of the computer program product on the computer-readable medium for being stored with instruction, should
Computer program product uses for instruction execution system or instruction execution system is combined to use.In the context of the disclosure
In, computer-readable medium, which can be, can include, store, transmitting, propagating or transmitting the arbitrary medium of instruction.For example, calculating
Machine readable medium can include but is not limited to electricity, magnetic, optical, electromagnetic, infrared or semiconductor system, device, device or propagation medium.
The specific example of computer-readable medium includes: magnetic memory apparatus, such as tape or hard disk (HDD)；Light storage device, such as CD
(CD-ROM)；Memory, such as random access memory (RAM) or flash memory；And/or wire/wireless communication link.
Embodiment of the disclosure provides a kind of data processing method of storage system, the storage system include user terminal and
Storage end, user terminal is for receiving user's operation request, and for storing data, this method is applied to the user terminal to storage end,
It include: to receive user's operation request, which includes carrying out write operation to target data, is stored with number of targets in user terminal
In the case where, operation requests are responded, the first processing is carried out to target data, it will treated target data and the first label
Data are sent to storage end, in the case where user terminal does not store target data, by operation requests and the second flag data
It is sent to storage end.Wherein, the first flag data is used to indicate storage end directly store that treated target data, the second label
Data are used to indicate storage end and carry out second processing to target data, and target data stores by treated.
Fig. 1 diagrammatically illustrates the applied field of the data processing method and device of the storage system according to the embodiment of the present disclosure
Scape.
As shown in Figure 1, the application scenarios include storage system 100, storage system 100 includes user terminal 110 and storage end
120.User terminal 110 can be realized with storage end 120 and be communicated to connect, such as can be wired or wireless communication connection.
According to the embodiment of the present disclosure, user terminal 110 can be the various electronic equipments with input and display function, including
But be not limited to smart phone, tablet computer, pocket computer on knee and desktop computer etc..Storage end 120 can be distribution
Formula storage system can have multiple memory nodes.
In the embodiments of the present disclosure, user terminal 110 can be used for receiving the operation requests of user, and storage end 120 can be used
In storing data, user terminal 110 and storage end 120 can carry out data interaction.
According to the embodiment of the present disclosure, in the case where storage system 100 realizes the redundancy of data using correcting and eleting codes mode, such as
Fruit realizes the computing function of correcting and eleting codes verification data in user terminal 110, and the data that user is written can be divided into K by user terminal 110
Part, then correcting and eleting codes algorithm is called to calculate M parts of verification data, is finally sent out K parts of data and M parts of verification data by user terminal 110
Give storage end preservation.The benefit of this implementation is that data and verification data are only transmitted in the network of distributed system
Primary, not additional data network consumption.Disadvantage is that user terminal calculating can consume many CPU and memory source, can
The regular traffic of user can be will affect.Another drawback is that storage end needs to realize and a set of entangles with user terminal is about the same
A yard algorithm flow is deleted, for doing time data recovery mechanism when corrupted data in completion system.
If realizing the computing function of correcting and eleting codes verification data in storage end 120, monolith data are sent to by user terminal 110
Storage end 120 (for example, main memory unit of storage end), storage end 120 are responsible for the data received being cut into K parts, then
It calls correcting and eleting codes algorithm to calculate M parts of verification data, then saves the K parts of data and M parts of verification data.The advantages of this scheme, exists
In the CPU and memory source that will not consume client, the regular traffic of client will not influence, and the correcting and eleting codes that data are restored are calculated
Method is also completed in storage end, and only storage end is responsible for correcting and eleting codes algorithm in entire storage system 100.Disadvantage is that monolith data exist
It can be transferred into and lack twice in storage system 100, the data packet in network has one times of amplification, to a certain extent also can shadow
Ring the performance of entire storage system 100.
As it can be seen that either realizing that the computing function of correcting and eleting codes verification data is still realized in storage end 120 in user terminal 110
Correcting and eleting codes verify the computing function of data, and some disadvantages are all exposed in different application scenarios.
In view of this, present disclose provides a kind of data processing methods of storage system 100, comprising: receive user's operation
Request, which includes carrying out write operation to target data, in the case where user terminal 110 is stored with target data, is rung
Operation requests are answered, the computing function of correcting and eleting codes verification data is realized by user terminal 110, does not store number of targets in user terminal 110
In the case where, operation requests are sent to storage end 120, the computing function of correcting and eleting codes verification data is realized by storage end 120.
It should be understood that the number of user terminal and storage end in Fig. 1 is only schematical.It, can be with according to needs are realized
With any number of user terminal and storage end.
It should be noted that being only the example that can apply the scene of the embodiment of the present disclosure shown in Fig. 1, to help this field
Technical staff understands the technology contents of the disclosure, but be not meant to the embodiment of the present disclosure may not be usable for other equipment, system,
Environment or scene.
Fig. 2 diagrammatically illustrates the flow chart of the data processing method of the storage system according to the embodiment of the present disclosure.
According to the embodiment of the present disclosure, storage system may include user terminal and storage end, and user terminal can be used for receiving use
Family operation requests, storage end can be used for storing data, and user terminal and storage end are able to carry out data interaction.Storage end can wrap
Include multiple storage units.
As shown in Fig. 2, this method can be applied to user terminal, including operation S201~S203.
In operation S201, user's operation request is received, which includes carrying out write operation to target data.
In operation S202, in the case where user terminal is stored with target data, operation requests are responded, target data is carried out
Treated target data and the first flag data are sent to storage end, wherein the first flag data is used for by the first processing
Target data that instruction storage end directly stores that treated.
In operation S203, in the case where user terminal does not store target data, by operation requests and the second reference numerals
According to being sent to storage end, wherein the second flag data is used to indicate storage end and carries out second processing to target data, and will processing
Target data afterwards is stored.
According to the embodiment of the present disclosure, user terminal can receive the write request of user, and determine the corresponding number of targets of write request
According to whether user terminal is stored in, for example, determining whether target data is stored in the caching of user terminal.
In the embodiments of the present disclosure, target data can be entire file, be also possible to a part of some file, ability
Field technique personnel can be determined according to actual storage or read-write rule.
According to the embodiment of the present disclosure, in the case where user terminal is stored with target data, user's operation is responded by user terminal
Request carries out the first processing to target data.Specifically, user terminal can carry out the write operation to target data, generate new mesh
Data are marked, fresh target data are then divided into K parts of target datas, calculate M parts of verification data by K parts of target datas, wherein
K is the integer more than or equal to 1, and M is the integer more than or equal to 1.
It, can be by K parts of target datas, M parts of check numbers accordingly after user terminal is completed to the first processing of target data
And first flag data be sent to storage end, wherein the first flag data is used to indicate storage end and directly stores the K parts of number of targets
Accordingly and M parts of verification data.
According to the embodiment of the present disclosure, user terminal can be by K parts of target datas, M parts of check numbers accordingly and the first flag data
It is sent to the main memory unit of storage end, K parts of target datas, M parts of verification data are then issued to other by main memory unit
It is stored in storage unit.Alternatively, K parts of target datas, M parts of verification data directly can also be write corresponding deposit by user terminal respectively
In storage unit.
In the embodiments of the present disclosure, M parts of verification data are calculated by K parts of target datas, can be and is calculated using correcting and eleting codes
Method calculates M parts of verification data by K parts of target datas.
According to the embodiment of the present disclosure, in the case where user terminal does not store target data, user terminal can be by user's
Operation requests and the second flag data are sent to storage end, respond the operation requests by storage end, carry out the to target data
Two processing, and target data stores by treated.
For example, storage end can be according to the corresponding partial data of the target data stored in different storage units or verification
Data restore the target data, then carry out the write operation to target data, generate fresh target data, by fresh target data point
At K parts of target datas, M parts of verification data are calculated by K parts of target datas, wherein K is the integer more than or equal to 1, and M is big
In the integer for being equal to 1, then K parts of target datas and M parts of verification data are write in respective memory unit.
According to the embodiment of the present disclosure, storage end first determines the label in data when receiving the data from user terminal
Data are the first flag data or the second flag data.In the case where flag data is the first flag data, do not need again
Data are handled, are directly stored.In the case where flag data is the second flag data, need to carry out phase to data
The processing (for example, carrying out write operation, progress correcting and eleting codes calculating etc.) answered, then by treated, data are stored.
The present disclosure proposes a kind of data processing method of storage system, for target data storage position selection with
Family end, which carries out calculating checking treatment, still carries out calculating checking treatment in storage end, so as to reduce the operations of extra reading data with
The consumption of network bandwidth.Straight when being written or modifying target data that is, if target data is stored in user terminal
It connects and carries out calculating checking treatment in user terminal, then data are sent in storage end by treated.If user terminal is not deposited
Target data is stored up, then user's operation request data is issued to storage end, is responsible for responding user's operation by storage end, and counted
Checking treatment is calculated, then data distributing is saved into corresponding storage unit by treated.
For example, for data such as matchmaker's money, video monitorings, these data are repeatedly read after write-once, are seldom had
Modification.User terminal does not have the caching of this document when being written first time, so user terminal would not be calculated locally
Checking treatment, but monolith data are directly sent to storage end, calculating checking treatment is carried out to data by storage end, is then write
Into corresponding storage unit.
But for some data for needing to modify, data will be in the caching of user terminal after being written or being read
Retain a data buffer storage, at this time if the data in these cachings are modified, with phase in the data cover client of modification
The caching answered can directly carry out calculating checking treatment according to data cached, be then written in corresponding storage unit.Such as
Fruit is still issued to storage end in this case and carries out calculating checking treatment, then not having the slow of related data in storage end
It deposits, which needs first to read data from other storage units, then modifies corresponding data and re-starts calculating verification
Processing, then modified data and verification are write in storage unit.This in storage end is realized and more can once read data
Operation, both waste bandwidth and computing resource, can also reduce the performance of data modification.Target data caching is remained in user terminal
In the case where by user terminal realize that correcting and eleting codes calculate, and when user terminal does not have caching of target data, realized by storage end
Correcting and eleting codes calculate, and caused extra data block read operation, it is whole to improve storage system when reduction correcting and eleting codes mechanism is modified as far as possible
Body performance.
The embodiment of the present disclosure is by judging whether target data is stored in user terminal, to determine to be by user terminal to target
Data carry out correcting and eleting codes processing, or carry out correcting and eleting codes processing to target data by storage end, neatly cope with different applications
Scene improves the overall performance of storage system.
Fig. 3 diagrammatically illustrates the block diagram of the data processing equipment 300 according to the storage system of the embodiment of the present disclosure.
According to the embodiment of the present disclosure, storage system may include user terminal and storage end, and user terminal can be used for receiving use
Family operation requests, storage end can be used for storing data, and user terminal and storage end are able to carry out data interaction.Storage end can wrap
Include multiple storage units.
As shown in figure 3, data processing equipment 300 can be applied to user terminal, including receiving module 310, first handles mould
Block 320 and Second processing module 330.
Receiving module 310 receives user's operation request, which includes carrying out write operation to target data.
First processing module 320 responds operation requests, to target data in the case where user terminal is stored with target data
The first processing is carried out, treated target data and the first flag data are sent to storage end, wherein the first flag data
It is used to indicate the storage end target data that directly stores that treated.
Second processing module 330 marks operation requests and second in the case where user terminal does not store target data
Numeration evidence is sent to storage end, wherein the second flag data is used to indicate storage end and carries out second processing to target data, and will
Treated, and target data is stored.
According to the embodiment of the present disclosure, it is above-mentioned to state target data carry out first processing, comprising: target data is carried out to write behaviour
Make, generates fresh target data, and fresh target data are divided into K parts of target datas, calculate M parts of schools by K parts of target datas
Test data, wherein K is the integer more than or equal to 1, and M is the integer more than or equal to 1.
It is above-mentioned that treated target data and the first flag data are sent to storage end according to the embodiment of the present disclosure,
Include: by K parts of target datas, M parts of check numbers accordingly and the first flag data is sent to storage end, wherein the first flag data
It is used to indicate storage end and directly stores K parts of target datas and M parts of verification data.
It is above-mentioned that second processing is carried out to target data according to the embodiment of the present disclosure, comprising: rejuvenation target data, to target
Data carry out write operation, generate fresh target data, fresh target data are divided into K parts of target datas, are calculated by K parts of target datas
M parts of verification data out, wherein K is the integer more than or equal to 1, and M is the integer more than or equal to 1.
According to the embodiment of the present disclosure, M parts of verification data are calculated above by K parts of target datas, comprising: use correcting and eleting codes
Algorithm calculates M parts of verification data by K parts of target datas.
According to the embodiment of the present disclosure, data processing equipment 300 can for example execute the method above with reference to Fig. 2 description,
This is repeated no more.
It is module according to an embodiment of the present disclosure, submodule, unit, any number of or in which any more in subelement
A at least partly function can be realized in a module.It is single according to the module of the embodiment of the present disclosure, submodule, unit, son
Any one or more in member can be split into multiple modules to realize.According to the module of the embodiment of the present disclosure, submodule,
Any one or more in unit, subelement can at least be implemented partly as hardware circuit, such as field programmable gate
Array (FPGA), programmable logic array (PLA), system on chip, the system on substrate, the system in encapsulation, dedicated integrated electricity
Road (ASIC), or can be by the hardware or firmware for any other rational method for integrate or encapsulate to circuit come real
Show, or with any one in three kinds of software, hardware and firmware implementations or with wherein any several appropriately combined next reality
It is existing.Alternatively, can be at least by part according to one or more of the module of the embodiment of the present disclosure, submodule, unit, subelement
Ground is embodied as computer program module, when the computer program module is run, can execute corresponding function.
For example, any number of in receiving module 310, first processing module 320 and Second processing module 330 can close
And it is realized in a module or any one module therein can be split into multiple modules.Alternatively, in these modules
At least partly functions of one or more modules can be combined at least partly function of other modules, and in a module
Middle realization.In accordance with an embodiment of the present disclosure, in receiving module 310, first processing module 320 and Second processing module 330
At least one can at least be implemented partly as hardware circuit, such as field programmable gate array (FPGA), programmable logic
Array (PLA), system on chip, the system on substrate, the system in encapsulation, specific integrated circuit (ASIC), or can be by right
Circuit carries out the hardware such as any other rational method that is integrated or encapsulating or firmware to realize, or with software, hardware and consolidates
Any one in three kinds of implementations of part several appropriately combined is realized with wherein any.Alternatively, receiving module 310,
At least one of one processing module 320 and Second processing module 330 can at least be implemented partly as computer program
Module can execute corresponding function when the computer program module is run.
Fig. 4 is diagrammatically illustrated according to the computer system for being adapted for carrying out method as described above of the embodiment of the present disclosure
Block diagram.Computer system shown in Fig. 4 is only an example, should not function and use scope band to the embodiment of the present disclosure
Carry out any restrictions.
As shown in figure 4, data processing system system 400 includes processor 410, computer readable storage medium 420.The number
The method according to the embodiment of the present disclosure can be executed according to processing system 400.
Specifically, processor 410 for example may include general purpose microprocessor, instruction set processor and/or related chip group
And/or special microprocessor (for example, specific integrated circuit (ASIC)), etc..Processor 410 can also include using for caching
The onboard storage device on way.Processor 410 can be the different movements for executing the method flow according to the embodiment of the present disclosure
Single treatment unit either multiple processing units.
Computer readable storage medium 420, such as can be times can include, store, transmitting, propagating or transmitting instruction
Meaning medium.For example, readable storage medium storing program for executing can include but is not limited to electricity, magnetic, optical, electromagnetic, infrared or semiconductor system, device,
Device or propagation medium.The specific example of readable storage medium storing program for executing includes: magnetic memory apparatus, such as tape or hard disk (HDD)；Optical storage
Device, such as CD (CD-ROM)；Memory, such as random access memory (RAM) or flash memory；And/or wire/wireless communication chain
Road.
Computer readable storage medium 420 may include computer program 421, which may include generation
Code/computer executable instructions execute processor 410 according to the embodiment of the present disclosure
Method or its any deformation.
Computer program 421 can be configured to have the computer program code for example including computer program module.Example
Such as, in the exemplary embodiment, the code in computer program 421 may include one or more program modules, for example including
421A, module 421B ....It should be noted that the division mode and number of module are not fixation, those skilled in the art can
To be combined according to the actual situation using suitable program module or program module, when these program modules are combined by processor 410
When execution, processor 410 is executed according to the method for the embodiment of the present disclosure or its any deformation.
According to an embodiment of the invention, in receiving module 310, first processing module 320 and Second processing module 330
At least one can be implemented as the computer program module with reference to Fig. 4 description may be implemented when being executed by processor 410
Corresponding operating described above.
The disclosure additionally provides a kind of computer-readable medium, which, which can be in above-described embodiment, retouches
Included in the equipment/device/system stated；It is also possible to individualism, and without in the supplying equipment/device/system.On
It states computer-readable medium and carries one or more program, when said one or multiple programs are performed, realize root
According to the method for the embodiment of the present disclosure.
In accordance with an embodiment of the present disclosure, computer-readable medium can be computer-readable signal media or computer can
Read storage medium either the two any combination.Computer readable storage medium for example can be --- but it is unlimited
In system, device or the device of --- electricity, magnetic, optical, electromagnetic, infrared ray or semiconductor, or any above combination.It calculates
The more specific example of machine readable storage medium storing program for executing can include but is not limited to: have the electrical connection, portable of one or more conducting wires
Formula computer disk, hard disk, random access storage device (RAM), read-only memory (ROM), erasable programmable read only memory
(EPROM or flash memory), optical fiber, portable compact disc read-only memory (CD-ROM), light storage device, magnetic memory device or
The above-mentioned any appropriate combination of person.In the disclosure, computer readable storage medium can be it is any include or storage program
Tangible medium, which can be commanded execution system, device or device use or in connection.And in this public affairs
In opening, computer-readable signal media may include in a base band or as carrier wave a part propagate data-signal,
In carry computer-readable program code.The data-signal of this propagation can take various forms, including but not limited to
Electromagnetic signal, optical signal or above-mentioned any appropriate combination.Computer-readable signal media can also be computer-readable
Any computer-readable medium other than storage medium, the computer-readable medium can send, propagate or transmit for by
Instruction execution system, device or device use or program in connection.The journey for including on computer-readable medium
Sequence code can transmit with any suitable medium, including but not limited to: wireless, wired, optical cable, radiofrequency signal etc., or
Above-mentioned any appropriate combination.
Flow chart and block diagram in attached drawing are illustrated according to the system of the various embodiments of the disclosure, method and computer journey
The architecture, function and operation in the cards of sequence product.In this regard, each box in flowchart or block diagram can generation
A part of one module, program segment or code of table, a part of above-mentioned module, program segment or code include one or more
Executable instruction for implementing the specified logical function.It should also be noted that in some implementations as replacements, institute in box
The function of mark can also occur in a different order than that indicated in the drawings.For example, two boxes succeedingly indicated are practical
On can be basically executed in parallel, they can also be executed in the opposite order sometimes, and this depends on the function involved.Also it wants
It is noted that the combination of each box in block diagram or flow chart and the box in block diagram or flow chart, can use and execute rule
The dedicated hardware based systems of fixed functions or operations is realized, or can use the group of specialized hardware and computer instruction
It closes to realize.
It will be understood by those skilled in the art that the feature recorded in each embodiment and/or claim of the disclosure can
To carry out multiple combinations or/or combination, even if such combination or combination are not expressly recited in the disclosure.Particularly, exist
In the case where not departing from disclosure spirit or teaching, the feature recorded in each embodiment and/or claim of the disclosure can
To carry out multiple combinations and/or combination.All these combinations and/or combination each fall within the scope of the present disclosure.
Although the disclosure, art technology has shown and described referring to the certain exemplary embodiments of the disclosure
Personnel it should be understood that in the case where the spirit and scope of the present disclosure limited without departing substantially from the following claims and their equivalents,
A variety of changes in form and details can be carried out to the disclosure.Therefore, the scope of the present disclosure should not necessarily be limited by above-described embodiment,
But should be not only determined by appended claims, also it is defined by the equivalent of appended claims.
Claims (10)
1. a kind of data processing method of storage system, the storage system includes user terminal and storage end, and the user terminal is used
In receiving user's operation request, for storing data, the method is applied to the user terminal to the storage end, comprising:
User's operation request is received, the operation requests include carrying out write operation to target data；
In the case where the user terminal is stored with the target data, respond the operation requests, to the target data into
Treated target data and the first flag data are sent to the storage end, wherein first mark by the processing of row first
Numeration according to be used to indicate the storage end directly store described in treated target data；
In the case where the user terminal does not store the target data, the operation requests and the second flag data are sent out
It send to the storage end, wherein second flag data is used to indicate the storage end and carries out second to the target data
Processing, and target data stores by treated.
2. described to carry out the first processing to the target data according to the method described in claim 1, wherein, comprising:
The write operation is carried out to the target data, generates fresh target data；
The fresh target data are divided into K parts of target datas, M parts of verification data are calculated by the K parts of target data,
In, K is the integer more than or equal to 1, and M is the integer more than or equal to 1.
It is described to send treated target data and the first flag data 3. according to the method described in claim 2, wherein
To the storage end, comprising:
Accordingly and the first flag data is sent to the storage end by the K parts of target data, M parts of check numbers, wherein described
One flag data is used to indicate the storage end and directly stores the K parts of target data and M parts of verification data.
4. described to carry out second processing to the target data according to the method described in claim 1, wherein, comprising:
Restore the target data；
The write operation is carried out to the target data, generates fresh target data；
The fresh target data are divided into K parts of target datas, M parts of verification data are calculated by the K parts of target data,
In, K is the integer more than or equal to 1, and M is the integer more than or equal to 1.
5. method according to claim 2 or 4, wherein described to calculate M parts of check numbers by the K parts of target data
According to, comprising:
M parts of verification data are calculated by the K parts of target data using correcting and eleting codes algorithm.
6. a kind of data processing equipment of storage system, the storage system includes user terminal and storage end, and the user terminal is used
In receiving user's operation request, for storing data, described device is applied to the user terminal to the storage end, comprising:
Receiving module, receives user's operation request, and the operation requests include carrying out write operation to target data；
First processing module responds the operation requests in the case where the user terminal is stored with the target data, to institute
It states target data and carries out the first processing, treated target data and the first flag data are sent to the storage end,
In, first flag data is used to indicate the storage end and directly stores treated the target data；
Second processing module, in the case where the user terminal does not store the target data, by the operation requests and
Second flag data is sent to the storage end, wherein second flag data is used to indicate the storage end to the mesh
It marks data and carries out second processing, and target data stores by treated.
7. device according to claim 6, wherein described to carry out the first processing to the target data, comprising:
The write operation is carried out to the target data, generates fresh target data；
The fresh target data are divided into K parts of target datas, M parts of verification data are calculated by the K parts of target data,
In, K is the integer more than or equal to 1, and M is the integer more than or equal to 1.
8. device according to claim 7, wherein described to send treated target data and the first flag data
To the storage end, comprising:
Accordingly and the first flag data is sent to the storage end by the K parts of target data, M parts of check numbers, wherein described
One flag data is used to indicate the storage end and directly stores the K parts of target data and M parts of verification data.
9. device according to claim 6, wherein described to carry out second processing to the target data, comprising:
Restore the target data；
The write operation is carried out to the target data, generates fresh target data；
The fresh target data are divided into K parts of target datas, M parts of verification data are calculated by the K parts of target data,
In, K is the integer more than or equal to 1, and M is the integer more than or equal to 1.
10. the device according to claim 7 or 9, wherein described to calculate M parts of check numbers by the K parts of target data
According to, comprising:
M parts of verification data are calculated by the K parts of target data using correcting and eleting codes algorithm.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810874819.9A CN109144770B (en) | 2018-08-02 | 2018-08-02 | Data processing method and device of storage system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810874819.9A CN109144770B (en) | 2018-08-02 | 2018-08-02 | Data processing method and device of storage system |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN109144770A true CN109144770A (en) | 2019-01-04 |
| CN109144770B CN109144770B (en) | 2020-11-20 |
Family
ID=64791415
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201810874819.9A Active CN109144770B (en) | 2018-08-02 | 2018-08-02 | Data processing method and device of storage system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN109144770B (en) |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102214127A (en) * | 2010-11-15 | 2011-10-12 | 上海安纵信息科技有限公司 | Method for intensively storing and backing up data based on operating system virtualization theory |
| US20150178150A1 (en) * | 2013-12-20 | 2015-06-25 | Netapp, Inc. | Techniques for Assessing Pass/Fail Status of Non-Volatile Memory |
| CN106201346A (en) * | 2016-06-30 | 2016-12-07 | 联想(北京)有限公司 | A kind of data processing method and storage device |
| CN106657356A (en) * | 2016-12-29 | 2017-05-10 | 郑州云海信息技术有限公司 | Data writing method and device for cloud storage system, and cloud storage system |
| CN106909470A (en) * | 2017-01-20 | 2017-06-30 | 深圳市中博科创信息技术有限公司 | Distributed file system storage method and device based on correcting and eleting codes |
| CN106911782A (en) * | 2017-02-28 | 2017-06-30 | 北京微影时代科技有限公司 | A kind of method for reading data and device |
-
2018
- 2018-08-02 CN CN201810874819.9A patent/CN109144770B/en active Active
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102214127A (en) * | 2010-11-15 | 2011-10-12 | 上海安纵信息科技有限公司 | Method for intensively storing and backing up data based on operating system virtualization theory |
| US20150178150A1 (en) * | 2013-12-20 | 2015-06-25 | Netapp, Inc. | Techniques for Assessing Pass/Fail Status of Non-Volatile Memory |
| CN106201346A (en) * | 2016-06-30 | 2016-12-07 | 联想(北京)有限公司 | A kind of data processing method and storage device |
| CN106657356A (en) * | 2016-12-29 | 2017-05-10 | 郑州云海信息技术有限公司 | Data writing method and device for cloud storage system, and cloud storage system |
| CN106909470A (en) * | 2017-01-20 | 2017-06-30 | 深圳市中博科创信息技术有限公司 | Distributed file system storage method and device based on correcting and eleting codes |
| CN106911782A (en) * | 2017-02-28 | 2017-06-30 | 北京微影时代科技有限公司 | A kind of method for reading data and device |
Also Published As
| Publication number | Publication date |
|---|---|
| CN109144770B (en) | 2020-11-20 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US10055216B2 (en) | Minimizing image copying during partition updates | |
| CN109359222B (en) | Data storage method and system, equipment and storage medium | |
| CN105518611B (en) | A kind of remote direct data access method, equipment and system | |
| CN107395665A (en) | A kind of block chain service handling and business common recognition method and device | |
| US8947431B2 (en) | Method and system for providing scene data of virtual world | |
| CN109284185A (en) | The device, method and system accelerated for the transaction of block chain | |
| CN109739770A (en) | The adjustment method and device of small routine | |
| CN110413676A (en) | The access method and its device of database, electronic equipment and medium | |
| CN110058953A (en) | For changing the method, equipment and computer program product of the type of storage system | |
| CN104246693B (en) | Information processing unit for protecting the data in call stack and method | |
| CN110427304A (en) | O&M method, apparatus, electronic equipment and medium for banking system | |
| CN109241357A (en) | Chain structure model and its construction method, system and terminal device | |
| CN113505520A (en) | Method, device and system for supporting heterogeneous federated learning | |
| CN108334340A (en) | A kind of Cross-environment data communications method, device and system | |
| CN110442344A (en) | Method, apparatus, system and medium for cross-platform conversion application | |
| US20180218650A1 (en) | Secret computation apparatus, method for the same, and program | |
| CN112394938A (en) | Method and device for configuring heterogeneous components in accelerator | |
| CN103593485B (en) | The method and apparatus for realizing database real-time operation | |
| CN111507694A (en) | Block chain cross-chain interaction method and system | |
| CN110795143A (en) | Method, apparatus, computing device, and medium for processing functional module | |
| CN109918381A (en) | Method and apparatus for storing data | |
| US20210144394A1 (en) | Method and system for hybrid video coding | |
| US9747448B2 (en) | Cryptographic mechanisms to provide information privacy and integrity | |
| CN109144770A (en) | The data processing method and device of storage system | |
| CN114331745B (en) | Data processing method, system, readable storage medium and electronic device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |