CN109445712A - Instruction processing method, system, equipment and computer readable storage medium - Google Patents
Instruction processing method, system, equipment and computer readable storage medium Download PDFInfo
- Publication number
- CN109445712A CN109445712A CN201811332434.6A CN201811332434A CN109445712A CN 109445712 A CN109445712 A CN 109445712A CN 201811332434 A CN201811332434 A CN 201811332434A CN 109445712 A CN109445712 A CN 109445712A
- Authority
- CN
- China
- Prior art keywords
- distributed
- instruction
- disk
- disk block
- described instruction
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000003860 storage Methods 0.000 title claims abstract description 77
- 238000003672 processing method Methods 0.000 title claims abstract description 25
- 238000000034 method Methods 0.000 claims abstract description 39
- 230000008569 process Effects 0.000 claims description 26
- 238000009826 distribution Methods 0.000 claims description 20
- 238000004422 calculation algorithm Methods 0.000 claims description 16
- 230000004044 response Effects 0.000 claims description 16
- 238000004590 computer program Methods 0.000 claims description 10
- 238000005516 engineering process Methods 0.000 description 11
- 238000004891 communication Methods 0.000 description 7
- 239000004744 fabric Substances 0.000 description 6
- 230000000712 assembly Effects 0.000 description 4
- 238000000429 assembly Methods 0.000 description 4
- 238000010586 diagram Methods 0.000 description 4
- 230000000694 effects Effects 0.000 description 2
- 230000007246 mechanism Effects 0.000 description 2
- 230000005540 biological transmission Effects 0.000 description 1
- 230000000903 blocking effect Effects 0.000 description 1
- 230000003139 buffering effect Effects 0.000 description 1
- 238000004364 calculation method Methods 0.000 description 1
- 230000008859 change Effects 0.000 description 1
- 239000006185 dispersion Substances 0.000 description 1
- 235000013399 edible fruits Nutrition 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 238000002360 preparation method Methods 0.000 description 1
- 238000003825 pressing Methods 0.000 description 1
- 238000004148 unit process Methods 0.000 description 1
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
- G06F3/0601—Interfaces specially adapted for storage systems
- G06F3/0628—Interfaces specially adapted for storage systems making use of a particular technique
- G06F3/0638—Organizing or formatting or addressing of data
- G06F3/064—Management of blocks
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
- G06F3/0601—Interfaces specially adapted for storage systems
- G06F3/0668—Interfaces specially adapted for storage systems adopting a particular infrastructure
- G06F3/067—Distributed or networked storage systems, e.g. storage area networks [SAN], network attached storage [NAS]
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
The application discloses an instruction processing method, a system, equipment and a computer readable storage medium, which are applied to distributed storage, wherein the method comprises the following steps: acquiring a group of instructions; for each instruction, positioning and distributing the instruction to a pre-divided distributed disk block; responding to the instruction, and executing the operation corresponding to the instruction in the distributed disk block; the distributed disk blocks comprise disk blocks obtained by dividing the distributed disk in advance. According to the instruction processing method, the originally integrated distributed disk is divided into the plurality of disk blocks, then when the instruction is responded, and the operation corresponding to the instruction is executed in the distributed disk blocks, the instructions of the plurality of distributed disk blocks can be responded at the same time, and the plurality of instructions are responded at the same time. The instruction processing system, the instruction processing device and the computer readable storage medium disclosed by the application also solve the corresponding technical problems.
Description
Technical field
This application involves technical field of distributed memory, more specifically to a kind of request processing method, system, set
Standby and computer readable storage medium.
Background technique
With the arrival of big data era, the data volume that internet generates is increasing, for the ease of the storage of data, produces
Distributed type assemblies technology has been given birth to, by distributed type assemblies technology, the service on more nodes can have been made externally while clothes being provided
Business.Correspondingly, can send instructions down one by one in instruction, after distributed storage has handled previous instruction, can just handle next
Instruction ensures that instruction responds successfully with this.
However, needing to wait for previous instruction when distributed storage instruction per treatment and having handled, can just handle next
Instruction, so that the efficiency of distributed storage process instruction is lower.
In conclusion the efficiency for how improving distributed storage process instruction is that current those skilled in the art are urgently to be resolved
The problem of.
Summary of the invention
The purpose of the application is to provide a kind of command processing method, can solve how to improve distribution to a certain extent
The technical issues of storing the efficiency of process instruction.Present invention also provides a kind of instruction process systems, equipment and computer-readable
Storage medium.
To achieve the goals above, the application provides the following technical solutions:
A kind of command processing method is applied in distributed storage, comprising:
Obtain one group of instruction；
For each described instruction, described instruction is positioned and is distributed to the distributed disk block divided in advance；Response
Described instruction executes operation corresponding with described instruction in the distributed disk block；
Wherein, the distributed disk block includes the disk block divided in advance to distributed disk.
It is preferably, described that described instruction is positioned and is distributed to the distributed disk block divided in advance, comprising:
Described instruction is positioned using consistency hash algorithm and is distributed to the distributed disk block divided in advance.
It is preferably, described that described instruction is positioned and is distributed to before the distributed disk block divided in advance, further includes:
The distributed disk is divided into distributed disk block according to default division rule.
Preferably, it is described the distributed disk is divided into distributed disk block according to default division rule after, institute
It states and described instruction is positioned and is distributed to before the distributed disk block divided in advance, further includes:
The distributed disk block that division obtains is grouped, distributed disk block grouping is obtained；
Determine the master disk and sub- disk in the distributed disk block grouping；
It is described that described instruction is positioned and is distributed to the distributed disk block divided in advance, comprising:
Described instruction is positioned and is distributed to corresponding distributed disk block and is grouped；
The response described instruction executes operation corresponding with described instruction in the distributed disk block, comprising:
The thread for calling the corresponding master disk of described instruction and the sub- disk to bind in advance respectively, it is described to respond
Instruction executes operation corresponding with described instruction in the corresponding master disk of described instruction and the sub- disk.
Preferably, the distributed disk block that described pair of division obtains is grouped, and obtains distributed disk block grouping,
Include:
It deletes algorithm using entangling the distributed disk block that division obtains is grouped, obtain the distributed disk block
Grouping.
Preferably, described instruction includes read request instruction；
The thread for calling the corresponding master disk of described instruction and the sub- disk to bind in advance respectively, to respond
Described instruction executes operation corresponding with described instruction, packet in the corresponding master disk of described instruction and the sub- disk
It includes:
The thread for calling the read request that the corresponding master disk and the sub- disk is instructed to bind in advance respectively, to ring
Described instruction is answered, instructs and is searched in the corresponding master disk and the sub- disk and read request instruction in the read request
Corresponding data in magnetic disk；
The data in magnetic disk found is integrated into the read request and instructs corresponding data.
It is preferably, described that described instruction is positioned and is distributed into corresponding distributed disk block grouping, comprising:
Described instruction is positioned to corresponding distributed disk block and is grouped；
The distributed disk block grouping is locked, distribution described instruction is appointed to the distributed disk block grouping
It is engaged in queue；
Discharge the lock of the distributed disk block grouping.
A kind of instruction process system is applied in distributed storage, comprising:
First obtains module, for obtaining one group of instruction；
Described instruction is positioned and is distributed to dividing in advance for for each described instruction by first processing module
In distributed disk block；Described instruction is responded, executes operation corresponding with described instruction in the distributed disk block；
Wherein, the distributed disk block includes the disk block divided in advance to distributed disk.
A kind of instruction processing apparatus is applied in distributed storage, comprising:
Memory, for storing computer program；
Processor, the step of as above any described command processing method is realized when for executing the computer program.
A kind of computer readable storage medium is stored with computer program in the computer readable storage medium, described
The step of as above any described command processing method is realized when computer program is executed by processor.
A kind of command processing method provided by the present application is applied in distributed storage, obtains one group of instruction；For each
Instruction is positioned and is distributed to the distributed disk block divided in advance by a instruction；Response instruction, executes in distributed disk block
Operation corresponding with instruction；Wherein, distributed disk block includes the disk block divided in advance to distributed disk.This
A kind of command processing method provided is provided, when each of one group of instruction to acquisition is instructed and handled, will be instructed
It positions and distributes to the distributed disk block divided in advance, since distributed disk block includes drawing in advance to distributed disk
The disk block got is instructed in response later so that the distributed disk of one is divided into multiple disk blocks originally,
When executing in distributed disk block with corresponding operation is instructed, the instruction of multiple distributed disk blocks can be responded simultaneously, together
When multiple instruction is responded, have to wait for ability after the completion of previous instruction processing with existing integrated distributed storage
The technology of processing next instruction is compared, and the efficiency of distributed storage process instruction is improved.A kind of instruction provided by the present application
Processing system, equipment and computer readable storage medium also solve the problems, such as relevant art.
Detailed description of the invention
In order to illustrate the technical solutions in the embodiments of the present application or in the prior art more clearly, to embodiment or will show below
There is attached drawing needed in technical description to be briefly described, it should be apparent that, the accompanying drawings in the following description is only this
The embodiment of application for those of ordinary skill in the art without creative efforts, can also basis
The attached drawing of offer obtains other attached drawings.
Fig. 1 is a kind of first pass figure of command processing method provided by the embodiments of the present application；
Fig. 2 is a kind of second flow chart of command processing method provided by the embodiments of the present application；
Fig. 3 is a kind of structural schematic diagram of instruction process system provided by the embodiments of the present application；
Fig. 4 is a kind of structural schematic diagram of instruction processing apparatus provided by the embodiments of the present application；
Fig. 5 is a kind of another structural schematic diagram of instruction processing apparatus provided by the embodiments of the present application.
Specific embodiment
Below in conjunction with the attached drawing in the embodiment of the present application, technical solutions in the embodiments of the present application carries out clear, complete
Site preparation description, it is clear that described embodiments are only a part of embodiments of the present application, instead of all the embodiments.It is based on
Embodiment in the application, it is obtained by those of ordinary skill in the art without making creative efforts every other
Embodiment shall fall in the protection scope of this application.
With the arrival of big data era, the data volume that internet generates is increasing, for the ease of the storage of data, produces
Distributed type assemblies technology has been given birth to, by distributed type assemblies technology, the service on more nodes can have been made externally while clothes being provided
Business.Correspondingly, can send instructions down one by one in instruction, after distributed storage has handled previous instruction, can just handle next
Instruction ensures that instruction responds successfully with this.However, being needed to wait at previous instruction when distributed storage instruction per treatment
It has been managed that, can just handle next instruction, so that the efficiency of distributed storage process instruction is lower.A kind of instruction provided by the present application
The efficiency of distributed storage process instruction can be improved in processing method.
Referring to Fig. 1, Fig. 1 is a kind of first pass figure of command processing method provided by the embodiments of the present application.
A kind of command processing method provided by the embodiments of the present application is applied in distributed storage, may include following step
It is rapid:
Step S101: one group of instruction is obtained.
In practical application, distributed storage can first obtain one group of instruction, and the type and quantity of instruction can be according to reality
It needs to be determined that such as one group of instruction can be one group of continuous reading instruction, or the mixing of one group of reading instruction and write command
Deng；The type of instruction can also instruct to modify, delete instruction, duplicate instructions, paste instruction etc..
Step S102: for each instruction, instruction is positioned and is distributed to the distributed disk block divided in advance；Response
Instruction executes operation corresponding with instruction in distributed disk block；
Wherein, distributed disk block includes the disk block divided in advance to distributed disk.
In practical application, after obtaining one group of instruction, each group of instruction in one group of instruction can be handled.?
When processing, for each instruction, can first instruction be positioned and be distributed to the distributed disk block divided in advance, such as can be with
According to the storage content of operation object and distributed disk block in instruction, instruction is positioned and is distributed to corresponding distribution
In disk block；Later, the instruction is responded, executes operation corresponding with instruction in corresponding distributed disk block, for example instruct
When for reading instruction, then data in magnetic disk corresponding with reading instruction etc. is read in distributed disk block.It should be pointed out that fixed that will instruct
When position and distribution to the distributed disk block divided in advance, multithreading can be used, while will be each in one group of instruction
A instruction is positioned and is distributed to corresponding distributed disk block, is saved with this and is positioned each instruction and distribute to corresponding point
The time of cloth disk block；Correspondingly, when responding instruction multithreading can also be used, while responding each distribution
The instruction of formula disk executes operation corresponding with instruction in distributed disk, and the time of each instruction of response is saved with this,
It improves efficiency.
It, can be using consistent in order to quickly position and distribute by instruction to corresponding distributed disk block in practical application
Property hash algorithm will instruction position and distribute to the distributed disk block divided in advance；Correspondingly, consistency Hash can be used
Distributed disk is divided into distributed disk block by algorithm.Consistency hash algorithm is suitable for the calculation of the Hash in distributed storage
Method, by being reduced the mode that object element Hash navigates in target container to the maximum extent with the sequence along (inverse) hour hands
Influence when target container generation dynamic change to whole system；It meets four characteristics: harmonious, i.e. the result of Hash can
It is distributed in all bufferings as far as possible, all cushion spaces can be made all to be utilized in this way；Monotonicity, i.e., when one
A little contents are assigned to by Hash to be buffered accordingly, and when having new buffer area to be added in system, then the result of Hash
It should ensure that original allocated content can be mapped to new buffer area, without being mapped to old buffer area；Dispersion
Property, that is, define the severity that identical content is mapped in different buffer areas by different terminals；Load, i.e., one specific
Buffer area the degree of different contents is mapped as by different users.
A kind of command processing method provided by the present application is applied in distributed storage, obtains one group of instruction；For each
Instruction is positioned and is distributed to the distributed disk block divided in advance by a instruction；Response instruction, executes in distributed disk block
Operation corresponding with instruction；Wherein, distributed disk block includes the disk block divided in advance to distributed disk.This
A kind of command processing method provided is provided, when each of one group of instruction to acquisition is instructed and handled, will be instructed
It positions and distributes to the distributed disk block divided in advance, since distributed disk block includes drawing in advance to distributed disk
The disk block got is instructed in response later so that the distributed disk of one is divided into multiple disk blocks originally,
When executing in distributed disk block with corresponding operation is instructed, the instruction of multiple distributed disk blocks can be responded simultaneously, together
When multiple instruction is responded, have to wait for ability after the completion of previous instruction processing with existing integrated distributed storage
The technology of processing next instruction is compared, and the efficiency of distributed storage process instruction is improved.
Referring to Fig. 2, Fig. 2 is a kind of second flow chart of command processing method provided by the embodiments of the present application.
In practical application, a kind of command processing method provided by the embodiments of the present application be may comprise steps of:
Step S201: one group of instruction is obtained.
Step S202: distributed disk is divided into distributed disk block according to default division rule.
In practical application, default division rule can be determined according to concrete application scene, such as can be according to principle of equipartition
Distributed disk is divided into distributed disk block, is divided into distributed disk according to the data in magnetic disk type of distributed disk
Distributed disk block etc..
Step S203: the distributed disk block obtained to division is grouped, and obtains distributed disk block grouping.
It, can also be to point that division obtains after distributed disk is divided into distributed disk block in practical application
Cloth disk block is grouped, and obtains the grouping of distributed disk block, for disk block is A, B, C, D in a distributed manner, then distributed
Disk block grouping can be A and B is one group, and C and D are one group etc.；Specific rule of classification can be true according to concrete application scene
It is fixed；Since the distributed disk block obtained to division is grouped, distributed disk block grouping is obtained, it also can be by a fixed number
The distributed disk block of amount is integrated into distributed disk block grouping, and disk block is grouped into processed in units instruction in a distributed manner later,
Compared with disk block in a distributed manner is unit process instruction, it is possible to reduce number of processes improves overall treatment efficiency.Such as it can be with
It deletes algorithm using entangling the obtained distributed disk block of division is grouped, obtain distributed disk block grouping, still in a distributed manner
For disk block is A, B, C, D, and assume to entangle that delete algorithm be that 2+1 is entangled and deleted, then when being grouped, a distribution can be set
Disk block is master disk, and corresponding distributed disk stripping is obtained based on the master disk, then the knot of distributed disk block grouping
Fruit can be A, B, C be one group, A, B, D are one group, A, C, D are one group.
Step S204: the master disk and sub- disk in distributed disk block grouping are determined.
In practical application, after obtaining distributed disk block grouping, the master in distributed disk block grouping can be determined
Disk and sub- disk, it is specific to determine that rule be determine according to actual needs.Determine the master in distributed disk block grouping
The meaning of disk and sub- disk is, can be realized according to the classification of master disk and sub- disk rule to distributed disk block
Grouping carries out instruction processing, such as in process instruction, instruction can be first responded in master disk, then respond and refer in sub- disk
Enable etc..
Step S205: each instruction positioning to corresponding distributed disk block is grouped using consistency hash algorithm.
Step S206: the grouping of distributed disk block is locked, the task that distribution instruction is grouped to distributed disk block
In queue.
In practical application, when distribution will be instructed into corresponding distributed disk block, in order to avoid distributed disk block
It is grouped while receiving multiple instruction, cause the blocking of instruction, can distribute execution corresponding distribution instruction using locking mechanisms
The grouping of formula disk block.
Step S207: the lock of release profile formula disk block grouping.
Step S208: the thread that the corresponding master disk of call instruction and sub- disk are bound in advance respectively, to respond instruction,
It instructs and executes operation corresponding with instruction in corresponding master disk and sub- disk.
Type in practical application, according to instruction, it is understood that there may be instruct and execute and refer in corresponding master disk and sub- disk
After enabling corresponding operation, the feelings for the processing result for needing the processing result by master disk and sub- disk to combine as instruction
Condition includes the thread that then the corresponding master disk of call instruction and sub- disk are bound in advance respectively for read request instructs to instruct,
Respond instruction, executed in instructing corresponding master disk and sub- disk with can be with the step of instruction corresponding operation specifically:
The thread for calling read request that corresponding master disk and sub- disk is instructed to bind in advance respectively instructs to respond instruction in read request
Data in magnetic disk corresponding with read request instruction is searched in corresponding master disk and sub- disk；The data in magnetic disk found is integrated into
Read request instructs corresponding data.Specifically, in the thread that the corresponding master disk of call instruction and sub- disk are bound in advance
Lock mechanism can be used, for example the task queue of distributed disk block grouping is locked, the corresponding master disk of call instruction
Instruction is taken out from the task queue that distributed disk block is grouped in turn with the thread of sub- disk, later release profile formula disk block
The task queue of grouping.
Present invention also provides a kind of instruction process systems, with a kind of instruction processing side provided by the embodiments of the present application
The correspondence effect that method has.Referring to Fig. 3, Fig. 3 is a kind of structural representation of instruction process system provided by the embodiments of the present application
Figure.
A kind of instruction process system provided by the embodiments of the present application is applied in distributed storage, comprising:
First obtains module 101, for obtaining one group of instruction；
First processing module 102, for instruction being positioned and is distributed to the distribution divided in advance for each instruction
In disk block；Response instruction, executes operation corresponding with instruction in distributed disk block；
Wherein, distributed disk block includes the disk block divided in advance to distributed disk.
A kind of instruction process system provided by the embodiments of the present application is applied in distributed storage, and first processing module can
To include:
First positioning unit, for being positioned and being distributed to the distribution divided in advance by instruction using consistency hash algorithm
Disk block.
A kind of instruction process system provided by the embodiments of the present application is applied in distributed storage, can also include:
Instruction is positioned for the first locating module and is distributed to the distributed disk block divided in advance by the first division module
Before, distributed disk is divided into distributed disk block according to default division rule.
A kind of instruction process system provided by the embodiments of the present application is applied in distributed storage, can also include:
Distributed disk is divided into distribution according to default division rule for the first division module by the first grouping module
After disk block, instruction is positioned and is distributed to before the distributed disk block divided in advance by first processing module, to dividing
To distributed disk block be grouped, obtain the grouping of distributed disk block；
First determining module, for determining master disk and sub- disk in distributed disk block grouping；
First processing module may include:
Second positioning unit is grouped for that will instruct to position and distribute to corresponding distributed disk block；
First response unit, the thread bound in advance for distinguishing the corresponding master disk of call instruction and sub- disk, to ring
It should instruct, operation corresponding with instruction is executed in instructing corresponding master disk and sub- disk.
A kind of instruction process system provided by the embodiments of the present application is applied in distributed storage, and the first grouping module can
With include:
First grouped element is divided for deleting algorithm and being grouped to the obtained distributed disk block of division using entangling
The grouping of cloth disk block.
A kind of instruction process system provided by the embodiments of the present application is applied in distributed storage, and instruction includes read request
Instruction；
First response unit may include:
First response subelement, the line for calling read request that corresponding master disk and sub- disk is instructed to bind in advance respectively
Journey instructs in read request to respond instruction and searches disk number corresponding with read request instruction in corresponding master disk and sub- disk
According to；
First integrates subelement, instructs corresponding data for the data in magnetic disk found to be integrated into read request.
A kind of instruction process system provided by the embodiments of the present application is applied in distributed storage, and first processing module can
With include:
Third positioning unit, for positioning to corresponding distributed disk block will to be instructed to be grouped；
First locks unit, for the grouping of distributed disk block to be locked, distribution instruction to distributed disk block point
In the task queue of group；
First releasing unit, the lock for the grouping of release profile formula disk block.
Present invention also provides a kind of instruction processing apparatus and computer readable storage mediums, all have the application implementation
The correspondence effect that a kind of command processing method that example provides has.Referring to Fig. 4, Fig. 4 is one kind provided by the embodiments of the present application
The structural schematic diagram of instruction processing apparatus.
A kind of instruction processing apparatus provided by the embodiments of the present application, be applied to distributed storage in, including memory 201 and
Processor 202, computer program is stored in memory 201, and processor 202 executes the computer journey stored in memory 201
Following steps are realized when sequence:
Obtain one group of instruction；
For each instruction, instruction is positioned and is distributed to the distributed disk block divided in advance；Response instruction is dividing
Operation corresponding with instruction is executed in cloth disk block；
Wherein, distributed disk block includes the disk block divided in advance to distributed disk.
A kind of instruction processing apparatus provided by the embodiments of the present application, be applied to distributed storage in, including memory 201 and
Processor 202, computer subprogram is stored in memory 201, and processor 202 executes the computer stored in memory 201
It is implemented as follows step when subprogram: instruction being positioned using consistency hash algorithm and is distributed to the distribution divided in advance
Disk block.
A kind of instruction processing apparatus provided by the embodiments of the present application, be applied to distributed storage in, including memory 201 and
Processor 202, computer subprogram is stored in memory 201, and processor 202 executes the computer stored in memory 201
It is implemented as follows step when subprogram: instruction being positioned and is distributed to before the distributed disk block divided in advance, according to pre-
If distributed disk is divided into distributed disk block by division rule.
A kind of instruction processing apparatus provided by the embodiments of the present application, be applied to distributed storage in, including memory 201 and
Processor 202, computer subprogram is stored in memory 201, and processor 202 executes the computer stored in memory 201
Step is implemented as follows when subprogram: after distributed disk is divided into distributed disk block according to default division rule,
Instruction is positioned and is distributed to before the distributed disk block divided in advance, the distributed disk block obtained to division divides
Group obtains distributed disk block grouping；Determine the master disk and sub- disk in distributed disk block grouping；Correspondingly, will refer to
It enables positioning and distributing to corresponding distributed disk block and be grouped；The corresponding master disk of call instruction and sub- disk are bound in advance respectively
Thread operation corresponding with instruction is executed in instructing corresponding master disk and sub- disk to respond instruction.
A kind of instruction processing apparatus provided by the embodiments of the present application, be applied to distributed storage in, including memory 201 and
Processor 202, computer subprogram is stored in memory 201, and processor 202 executes the computer stored in memory 201
It is implemented as follows step when subprogram: deleting the distributed disk block that algorithm obtains division using entangling and be grouped, divided
The grouping of cloth disk block.
A kind of instruction processing apparatus provided by the embodiments of the present application, be applied to distributed storage in, including memory 201 and
Processor 202, computer subprogram is stored in memory 201, and processor 202 executes the computer stored in memory 201
Step is implemented as follows when subprogram: instruction includes that read request instructs；Call respectively read request instruct corresponding master disk and
The thread that sub- disk is bound in advance is instructed to search in corresponding master disk and sub- disk and be asked with reading to respond instruction in read request
Seek the corresponding data in magnetic disk of instruction；The data in magnetic disk found is integrated into read request and instructs corresponding data.
A kind of instruction processing apparatus provided by the embodiments of the present application, be applied to distributed storage in, including memory 201 and
Processor 202, computer subprogram is stored in memory 201, and processor 202 executes the computer stored in memory 201
It is implemented as follows step when subprogram: instruction positioning to corresponding distributed disk block is grouped；By distributed disk block point
Group is locked, in the task queue that distribution instruction is grouped to distributed disk block；The lock of release profile formula disk block grouping.
Referring to Fig. 5, can also include: and processor in another kind instruction processing apparatus provided by the embodiments of the present application
The input port 203 of 202 connections is used for transmission the extraneous order inputted to processor 202；The display being connect with processor 202
Unit 204, the processing result for video-stream processor 202 is to the external world；The communication module 205 being connect with processor 202, for real
Existing instruction processing apparatus and extraneous communication.Display unit 204 can make display etc. for display panel, laser scanning；Communication
Communication mode used by module 205 include but is not limited to mobile high definition chained technology (HML), universal serial bus (USB),
High-definition media interface (HDMI) is wirelessly connected: adopting wireless fidelity technology (WiFi), Bluetooth Communication Technology, low-power consumption bluetooth communication
Technology, the communication technology based on IEEE802.11s.
A kind of computer readable storage medium provided by the embodiments of the present application is applied in distributed storage, and computer can
It reads to be stored with computer program in storage medium, following steps is realized when computer program is executed by processor:
Obtain one group of instruction；
For each instruction, instruction is positioned and is distributed to the distributed disk block divided in advance；Response instruction is dividing
Operation corresponding with instruction is executed in cloth disk block；
Wherein, distributed disk block includes the disk block divided in advance to distributed disk.
A kind of computer readable storage medium provided by the embodiments of the present application is applied in distributed storage, and computer can
It reads to be stored with computer subprogram in storage medium, computer subprogram is implemented as follows step when being executed by processor: adopting
Instruction is positioned with consistency hash algorithm and is distributed to the distributed disk block divided in advance.
A kind of computer readable storage medium provided by the embodiments of the present application is applied in distributed storage, and computer can
It reads to be stored with computer subprogram in storage medium, computer subprogram is implemented as follows step when being executed by processor: will
Instruction is positioned and is distributed to before the distributed disk block divided in advance, is divided into distributed disk according to default division rule
Distributed disk block.
A kind of computer readable storage medium provided by the embodiments of the present application is applied in distributed storage, and computer can
It reads to be stored with computer subprogram in storage medium, computer subprogram is implemented as follows step when being executed by processor: pressing
After distributed disk is divided into distributed disk block according to default division rule, instruction is positioned and is distributed to dividing in advance
Before distributed disk block, the distributed disk block obtained to division is grouped, and obtains distributed disk block grouping；It determines
Master disk and sub- disk in distributed disk block grouping；Correspondingly, instruction is positioned and is distributed to corresponding distributed disk
Block grouping；The thread that the corresponding master disk of call instruction and sub- disk are bound in advance respectively, it is corresponding instructing to respond instruction
Operation corresponding with instruction is executed in master disk and sub- disk.
A kind of computer readable storage medium provided by the embodiments of the present application is applied in distributed storage, and computer can
It reads to be stored with computer subprogram in storage medium, computer subprogram is implemented as follows step when being executed by processor: adopting
It is deleted algorithm with entangling the obtained distributed disk block of division is grouped, obtain distributed disk block grouping.
A kind of computer readable storage medium provided by the embodiments of the present application is applied in distributed storage, and computer can
It reads to be stored with computer subprogram in storage medium, computer subprogram is implemented as follows step when being executed by processor: referring to
Enable includes that read request instructs；The thread for calling read request that corresponding master disk and sub- disk is instructed to bind in advance respectively, to respond
Instruction instructs in read request and searches data in magnetic disk corresponding with read request instruction in corresponding master disk and sub- disk；It will search
To data in magnetic disk be integrated into read request and instruct corresponding data.
A kind of computer readable storage medium provided by the embodiments of the present application is applied in distributed storage, and computer can
It reads to be stored with computer subprogram in storage medium, computer subprogram is implemented as follows step when being executed by processor: will
Instruction positioning to corresponding distributed disk block is grouped；The grouping of distributed disk block is locked, distribution instruction to distribution
In the task queue of disk block grouping；The lock of release profile formula disk block grouping.
Computer readable storage medium involved in the application includes random access memory (RAM), memory, read-only memory
(ROM), electrically programmable ROM, electrically erasable ROM, register, hard disk, moveable magnetic disc, CD-ROM or technical field
Any other form of storage medium well known to interior.
Relevant portion in a kind of instruction process system provided by the embodiments of the present application, equipment and computer readable storage medium
Explanation refer to the detailed description of corresponding part in a kind of command processing method provided by the embodiments of the present application, it is no longer superfluous herein
It states.In addition, in above-mentioned technical proposal provided by the embodiments of the present application with to correspond to technical solution realization principle in the prior art consistent
Part and unspecified, in order to avoid excessively repeat.
It should also be noted that, herein, relational terms such as first and second and the like are used merely to one
Entity or operation are distinguished with another entity or operation, without necessarily requiring or implying between these entities or operation
There are any actual relationship or orders.Moreover, the terms "include", "comprise" or its any other variant are intended to contain
Lid non-exclusive inclusion, so that the process, method, article or equipment including a series of elements is not only wanted including those
Element, but also including other elements that are not explicitly listed, or further include for this process, method, article or equipment
Intrinsic element.In the absence of more restrictions, the element limited by sentence "including a ...", it is not excluded that
There is also other identical elements in process, method, article or equipment including the element.
The foregoing description of the disclosed embodiments makes those skilled in the art can be realized or use the application.To this
A variety of modifications of a little embodiments will be apparent for a person skilled in the art, and the general principles defined herein can
Without departing from the spirit or scope of the application, to realize in other embodiments.Therefore, the application will not be limited
It is formed on the embodiments shown herein, and is to fit to consistent with the principles and novel features disclosed in this article widest
Range.
Claims (10)
1. a kind of command processing method, which is characterized in that be applied in distributed storage, comprising:
Obtain one group of instruction；
For each described instruction, described instruction is positioned and is distributed to the distributed disk block divided in advance；Described in response
Instruction executes operation corresponding with described instruction in the distributed disk block；
Wherein, the distributed disk block includes the disk block divided in advance to distributed disk.
2. the method according to claim 1, wherein described position described instruction and distribute to dividing in advance
Distributed disk block, comprising:
Described instruction is positioned using consistency hash algorithm and is distributed to the distributed disk block divided in advance.
3. method according to claim 1 or 2, which is characterized in that described to position described instruction and distribute to preparatory stroke
Before the distributed disk block divided, further includes:
The distributed disk is divided into distributed disk block according to default division rule.
4. according to the method described in claim 3, it is characterized in that, it is described according to default division rule by the distributed disk
It is divided into after distributed disk block, it is described that described instruction is positioned and is distributed to before the distributed disk block divided in advance,
Further include:
The distributed disk block that division obtains is grouped, distributed disk block grouping is obtained；
Determine the master disk and sub- disk in the distributed disk block grouping；
It is described that described instruction is positioned and is distributed to the distributed disk block divided in advance, comprising:
Described instruction is positioned and is distributed to corresponding distributed disk block and is grouped；
The response described instruction executes operation corresponding with described instruction in the distributed disk block, comprising:
The thread for calling the corresponding master disk of described instruction and the sub- disk to bind in advance respectively, to respond the finger
It enables, operation corresponding with described instruction is executed in the corresponding master disk of described instruction and the sub- disk.
5. according to the method described in claim 4, it is characterized in that, described pair divides the obtained distributed disk block and carries out
Grouping obtains distributed disk block grouping, comprising:
It deletes algorithm using entangling the distributed disk block that division obtains is grouped, obtain the distributed disk block point
Group.
6. according to the method described in claim 5, it is characterized in that, described instruction includes read request instruction；
The thread for calling the corresponding master disk of described instruction and the sub- disk to bind in advance respectively, it is described to respond
Instruction executes operation corresponding with described instruction in the corresponding master disk of described instruction and the sub- disk, comprising:
The thread for calling the read request that the corresponding master disk and the sub- disk is instructed to bind in advance respectively, to respond
Instruction is stated, instructs lookup in the corresponding master disk and the sub- disk corresponding with read request instruction in the read request
Data in magnetic disk；
The data in magnetic disk found is integrated into the read request and instructs corresponding data.
7. according to the method described in claim 4, it is characterized in that, described position described instruction and distribute to corresponding distribution
In the grouping of formula disk block, comprising:
Described instruction is positioned to corresponding distributed disk block and is grouped；
The distributed disk block grouping is locked, the task team of distribution described instruction to the distributed disk block grouping
In column；
Discharge the lock of the distributed disk block grouping.
8. a kind of instruction process system, which is characterized in that be applied in distributed storage, comprising:
First obtains module, for obtaining one group of instruction；
First processing module, for described instruction being positioned and is distributed to the distribution divided in advance for each described instruction
In formula disk block；Described instruction is responded, executes operation corresponding with described instruction in the distributed disk block；
Wherein, the distributed disk block includes the disk block divided in advance to distributed disk.
9. a kind of instruction processing apparatus, which is characterized in that be applied in distributed storage, comprising:
Memory, for storing computer program；
Processor realizes command processing method as described in any one of claim 1 to 7 when for executing the computer program
The step of.
10. a kind of computer readable storage medium, which is characterized in that be stored with computer in the computer readable storage medium
Program, the computer program realize command processing method as described in any one of claim 1 to 7 when being executed by processor
Step.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201811332434.6A CN109445712A (en) | 2018-11-09 | 2018-11-09 | Instruction processing method, system, equipment and computer readable storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201811332434.6A CN109445712A (en) | 2018-11-09 | 2018-11-09 | Instruction processing method, system, equipment and computer readable storage medium |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN109445712A true CN109445712A (en) | 2019-03-08 |
Family
ID=65551583
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201811332434.6A Pending CN109445712A (en) | 2018-11-09 | 2018-11-09 | Instruction processing method, system, equipment and computer readable storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN109445712A (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111488127A (en) * | 2020-04-16 | 2020-08-04 | 苏州浪潮智能科技有限公司 | Data parallel storage method and device based on disk cluster and data reading method |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105739913A (en) * | 2014-12-12 | 2016-07-06 | 华为技术有限公司 | Disk partition arrangement method and device |
| CN105893188A (en) * | 2014-09-30 | 2016-08-24 | 伊姆西公司 | Method and device for speeding up data reconstruction of disk array |
| CN106293492A (en) * | 2015-05-14 | 2017-01-04 | 中兴通讯股份有限公司 | A kind of memory management method and distributed file system |
| CN106339181A (en) * | 2016-08-19 | 2017-01-18 | 华为技术有限公司 | Method and system for processing data in storage system |
| CN107544760A (en) * | 2017-09-20 | 2018-01-05 | 郑州云海信息技术有限公司 | A kind of delivery method, device, equipment and the storage medium of distributed storage request |
| CN108170375A (en) * | 2017-12-21 | 2018-06-15 | 创新科存储技术有限公司 | Transfinite guard method and device in a kind of distributed memory system |
-
2018
- 2018-11-09 CN CN201811332434.6A patent/CN109445712A/en active Pending
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105893188A (en) * | 2014-09-30 | 2016-08-24 | 伊姆西公司 | Method and device for speeding up data reconstruction of disk array |
| CN105739913A (en) * | 2014-12-12 | 2016-07-06 | 华为技术有限公司 | Disk partition arrangement method and device |
| CN106293492A (en) * | 2015-05-14 | 2017-01-04 | 中兴通讯股份有限公司 | A kind of memory management method and distributed file system |
| CN106339181A (en) * | 2016-08-19 | 2017-01-18 | 华为技术有限公司 | Method and system for processing data in storage system |
| CN107544760A (en) * | 2017-09-20 | 2018-01-05 | 郑州云海信息技术有限公司 | A kind of delivery method, device, equipment and the storage medium of distributed storage request |
| CN108170375A (en) * | 2017-12-21 | 2018-06-15 | 创新科存储技术有限公司 | Transfinite guard method and device in a kind of distributed memory system |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111488127A (en) * | 2020-04-16 | 2020-08-04 | 苏州浪潮智能科技有限公司 | Data parallel storage method and device based on disk cluster and data reading method |
| CN111488127B (en) * | 2020-04-16 | 2023-01-10 | 苏州浪潮智能科技有限公司 | Data parallel storage method and device based on disk cluster and data reading method |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US10560511B2 (en) | Adaptive tile framework | |
| KR101502896B1 (en) | Distributed memory cluster control apparatus and method using map reduce | |
| CN113641457B (en) | Container creation method, device, apparatus, medium, and program product | |
| CN104750690B (en) | A kind of inquiry processing method, apparatus and system | |
| US11061857B2 (en) | Data processing method and device | |
| KR20220058844A (en) | Resource scheduling method and apparatus, electronic device, storage medium and program product | |
| JP5329388B2 (en) | Dynamic shape management of virtual frame buffer for addable logical display | |
| WO2020119029A1 (en) | Distributed task scheduling method and system, and storage medium | |
| JP2018518733A (en) | File operation method and apparatus | |
| US9405922B2 (en) | Computer-implemented method for role discovery and simplification in access control systems | |
| WO2022057420A1 (en) | Data processing method and apparatus, electronic device, and storage medium | |
| CN102023843B (en) | Function calling method and device as well as smart card | |
| US20200125115A1 (en) | Methods and systems of distributing task regions for a plurality of cleaning devices | |
| CN109213699A (en) | A kind of metadata management method, system, equipment and computer readable storage medium | |
| JP2017117204A (en) | Processor, reconfigurable circuit control method, and program | |
| CN106529408A (en) | Human face detection method and device | |
| US9996391B2 (en) | Parallel computer system, method of controlling parallel computer system, and recording medium | |
| CN104571956A (en) | Data writing method and splitting device | |
| WO2021120952A1 (en) | Column-oriented storage method, apparatus and device, and computer-readable storage medium | |
| CN105700821A (en) | semiconductor device and compressing/decompressing method thereof | |
| KR101915311B1 (en) | method for assigning identifier in the multivision | |
| CN108920105B (en) | Community structure-based graph data distributed storage method and device | |
| CN108153454B (en) | Multi-touch switching method and device, storage medium and terminal equipment | |
| CN109361625A (en) | Verify the method, apparatus and controller of forwarding-table item | |
| CN109445712A (en) | Instruction processing method, system, equipment and computer readable storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20190308 |
|
| RJ01 | Rejection of invention patent application after publication |