CN106648959A - Data storage method and storage system - Google Patents
Data storage method and storage system Download PDFInfo
- Publication number
- CN106648959A CN106648959A CN201610811110.5A CN201610811110A CN106648959A CN 106648959 A CN106648959 A CN 106648959A CN 201610811110 A CN201610811110 A CN 201610811110A CN 106648959 A CN106648959 A CN 106648959A
- Authority
- CN
- China
- Prior art keywords
- storage device
- storage
- target
- resource space
- target journaling
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/07—Responding to the occurrence of a fault, e.g. fault tolerance
- G06F11/14—Error detection or correction of the data by redundancy in operation
- G06F11/1402—Saving, restoring, recovering or retrying
- G06F11/1446—Point-in-time backing up or restoration of persistent data
- G06F11/1456—Hardware arrangements for backup
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F9/00—Arrangements for program control, e.g. control units
- G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
- G06F9/46—Multiprogramming arrangements
- G06F9/50—Allocation of resources, e.g. of the central processing unit [CPU]
- G06F9/5005—Allocation of resources, e.g. of the central processing unit [CPU] to service a request
- G06F9/5027—Allocation of resources, e.g. of the central processing unit [CPU] to service a request the resource being a machine, e.g. CPUs, Servers, Terminals
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Software Systems (AREA)
- Quality & Reliability (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
The embodiment of the invention provides a data storage method and a storage system. The method is applied to the storage system comprising a first storage device and at least one second storage device, wherein the second storage devices are image storage devices of the first storage device. The method comprises the steps that the first storage device receives a writing request message, wherein the writing request message carries target data; the first storage device generates a target log according to the target data, wherein the target log comprises the target data and identification information used for identifying the target data; the first storage device sends the target log to the second storage devices; the second storage devices store the target log without the need for configuring a memory index. As a result, through the data storage method and the storage system in the embodiment, the target log can be directly stored under the situation that the second storage devices do not configure the memory index, and therefore CPU usage by the second storage devices is reduced.
Description
Technical field
The application is related to Computer Storage field, and more particularly, to the method and storage system of data storage.
Background technology
Mirror image is a type of redundancy, the data on a disk exist on another disk one it is identical
Copy is mirror image.It is to set up RAID (Redundant Array Of to commonly use mirror image operation on the server
Independent Disks, RAID) 1, RAID1 is the RAID disk array for being constituted two pieces of hard disks, its capacity is only etc.
In the capacity of a hard disk, because another piece simply as data " mirror image ".
In distributed memory system, in order to reach the requirement of reliability, select to use mirror image mechanism between node.To this
Ground data, replicate a in mirror nodes preservation, in case of a fault, fast quick-recovery business.
In the prior art, to mirror nodes, mirror nodes need in data configuration to be stored data is activation to be stored
Index is deposited, internal memory indexes the data for conveniently reading the mirror nodes storage；Afterwards mirror nodes need application resource space,
And the mapping relations of the storage address of resource space and internal memory index are set；Finally by data Cun Chudao storage address pair to be stored
In the resource space answered.Prior art mirror nodes store central processing unit of the aforesaid operations of data to be stored to mirror nodes
The occupancy of (Central Processing Unit, CPU) is higher.
The content of the invention
The embodiment of the present application provides a kind of method and storage system of data storage, can reduce mirror storage device storage
Occupancy of the data to CPU.
In a first aspect, the embodiment of the present application provides a kind of method of data storage, the method is applied to include that first deposits
The storage system of storage equipment and at least one second storage devices, wherein, second storage device is first storage device
Mirror storage device, the method includes：First storage device receives write request message, and the write request message carries target data；
First storage device generates target journaling according to the target data, and the target journaling includes the target data and for identifying
The identification information of the target data；First storage device to second storage device sends the target journaling；Second storage
Equipment stores the target journaling, and the storage target journaling need not configure internal memory index.
The embodiment of the present application is applied in the storage system for including the first storage device and at least one second storage devices,
And second storage device be first storage device of class mirror storage device.First storage device receives write request message, writes
Data (being expressed as target data) to be written are carried in request message, according to the target data, corresponding target journaling is generated, and
The target journaling is sent to the second storage device the target journaling is directly stored in the second storage device, due to the target day
Will includes the identification information for representing the target data, when such second storage device stores the target journaling and need not create
Build internal memory index, compared to existing technology in, the second storage device need configure internal memory index for, the application can be stored directly
The target journaling, so as to save occupancy when the second storage device configurations internal memory is indexed to CPU.
In some possible implementations, the method also includes：Second storage device completes to store the target day
During will, to first storage device storage completion message is sent；First storage device stores the target journaling；First storage
Equipment sends write request response message after the storage for completing the target journaling and receiving the storage completion message.
First storage device complete write target journaling, and receive the second storage device transmission storage completion message it
Afterwards, write request response message is sent to I/O device, thus being avoided that in prior art needs to wait target data storage to internal memory
Index and could return write request response message to I/O device after corresponding resource space, write request is sent to receipts so as to reduce
To the time delay of write request response message.
In some possible implementations, second storage device includes multiple resource spaces；Wherein, second storage
Equipment stores the target journaling to be included：Second storage device is according to the identification information, it is determined that storing the first of the target journaling
Resource space, the first resource space be second storage device multiple resource spaces in meet the resource need of the target journaling
The arbitrary resource space asked；Second storage device stores the target journaling in the first resource space.
Second storage device selects suitable resource space (being expressed as first resource space) according to the identification information, by this
Target journaling is stored in the first resource space of the second storage device.Additionally, the second storage device can be according to identification information
Identification target data, target data can carry out in order regular storage in the form of target journaling, and such second
Storage device can be target data configuration internal memory index, so that the CPU for saving the second storage device takes.
In some possible implementations, second storage device includes multiple resource spaces；The method also includes：Should
First storage device obtains the storage address in Secondary resource space and the memory capacity in the Secondary resource space, and the Secondary resource is empty
Between for second storage device multiple resource spaces in arbitrary resource space；First storage device is empty according to the Secondary resource
Between memory capacity and the identification information, determine whether the Secondary resource space meets the resource requirement of the target journaling；This
One storage device when the Secondary resource space meets the resource requirement of the target journaling, according to RDMA coded systems, the target
Daily record and the storage address in the Secondary resource space, generate RDMA Message, and the RDMA Message includes depositing for the Secondary resource space
Storage address and the target journaling；Wherein, first storage device sends the target journaling and includes to second storage device：This
One storage device to the Secondary resource space of second storage device sends the RDMA Message；Wherein, second storage device is deposited
Storing up the target journaling includes：The Secondary resource space of second storage device stores the target journaling according to the RDMA Message.
Second storage device is after target journaling storage to be arrived Secondary resource space, it is possible to return to the first storage device
Restore storage completion message.The embodiment of the present application compares the second storage device and receives target journaling, and needs for target journaling selection
Suitable resource space, can further save the occupancy of the CPU of the second storage device.
In some possible implementations, first storage device obtain the storage address in Secondary resource space and this
The memory capacity of two resource spaces includes：First storage device to second storage device sends resource request message, the money
Source request message is used for the Secondary resource space that request stores the target journaling；First storage device receives second storage
The resource request response message that equipment sends according to the resource request message, the resource request response message carries the Secondary resource
The storage address in space and the memory capacity in the Secondary resource space.
First storage device can send resource request message to the second storage device, and the second storage device is in multiple resources
Any one resource space (being expressed as Secondary resource space) is selected in space, and resource request sound is sent to the first storage device
Message is answered, and the storage address in the Secondary resource space and remaining for the Secondary resource space are carried in resource request response message
Covolume amount, so that the first storage device can select suitable resource space for target journaling.First storage device can be with
Address and the memory capacity of the resource space of second storage device are only obtained, until the resource space does not have surplus resources,
Or surplus resources can not meet the size of current data to be written, and the second storage device is then just obtained next time
The address of resource space and memory capacity.
In some possible implementations, the method also includes：First storage device is in the target data configuration
Deposit index；First storage device is indexed according to the internal memory, it is determined that storing the resource of first storage device of the target data
Space, wherein, the storage address of the resource space of first storage device is corresponding to the internal memory index；First storage device will
The target data is write in the resource space of first storage device.
First storage device is target data configuration internal memory index, and (is expressed as target data application storage resource
The resource space of the first storage device), and configure the storage address of the storage resource applied and the mapping pass of internal memory index
System, the mapping relations are used for follow-up first storage device can read what is stored in corresponding storage address according to internal memory index
Data, in finally writing target data into the corresponding resource space of storage address.Such first storage device is by target data
Internal memory is stored to index in corresponding resource space, the time for affecting to return write request response message can't have been extended.
Second aspect, the embodiment of the present application provides a kind of storage system, and the storage system can realize above-mentioned aspect institute
It is related to the function performed by the first storage device and the second storage device in method, the function can be realized by hardware,
Corresponding software can be performed by hardware to realize.The hardware or software include the corresponding unit of one or more above-mentioned functions
Or module.
The third aspect, there is provided a kind of storage system, the structure of the storage system includes memorizer, the processor is matched somebody with somebody
It is set to the function of supporting in method involved by above-mentioned aspect performed by the first storage device and the second storage device.The communication interface
For supporting first storage device, the communication between the second storage device and other network elements.The memorizer is used for and processor
Coupling, it preserves first storage device, the necessary programmed instruction of the second storage device and data.
A kind of fourth aspect, there is provided computer-readable storage medium, have program stored therein code in the computer-readable storage medium, should
Program code is used to indicate to perform the computer software instructions used by above-mentioned storage system, and it is included for performing above-mentioned aspect institute
The program of design.
Based on above-mentioned technical proposal, the first storage device carries the write request message of target data by receiving, according to this
Target data in write request message is generated includes the target data and the target for identifying the identification information of the target data
Daily record, and the target journaling is sent to second storage device, the second storage device stores the target journaling, and stores the target
Daily record need not configure internal memory index, and such first storage device generates the target day of the identification information for including identifying target data
Will, the second storage device can store target journaling and need not configure internal memory index, so as to reduce to the second storage device
The occupancy of CPU.
Description of the drawings
In order to be illustrated more clearly that the technical scheme of the embodiment of the present application, below will be in embodiment or description of the prior art
The required accompanying drawing for using is briefly described, it should be apparent that, drawings in the following description are only some realities of the application
Example is applied, for those of ordinary skill in the art, on the premise of not paying creative work, can be with according to these accompanying drawings
Obtain other accompanying drawings.
Fig. 1 is the configuration diagram of the storage system of the embodiment of the present application；
Fig. 2 is the structural representation of the memory node of the embodiment of the present application and management node；
Fig. 3 is the workflow diagram of the embodiment of the present application Cache module；
Fig. 4 a, Fig. 4 b and Fig. 4 c are the schematic diagrams of the journal format of the embodiment of the present application；
Fig. 5 is the structural representation of the resource space of the embodiment of the present application；
Fig. 6 is the indicative flowchart of the method for prior art data storage；
Fig. 7 is the indicative flowchart of the method for the data storage of the application one embodiment；
Fig. 8 is the indicative flowchart of the method for the data storage of the application another embodiment；
Fig. 9 is the schematic block diagram of the storage system of the embodiment of the present application；
Figure 10 is the structural representation of the storage system of the embodiment of the present application.
Specific embodiment
Below in conjunction with the accompanying drawing in the embodiment of the present application, the technical scheme in the embodiment of the present application is carried out clear, complete
Site preparation is described.Obviously, described embodiment is some embodiments of the present application, rather than the embodiment of whole.Based on this Shen
Please in embodiment, the every other enforcement that those of ordinary skill in the art are obtained under the premise of creative work is not made
Example, belongs to the scope of the application protection.
Fig. 1 shows the configuration diagram of the storage system of the embodiment of the present application.As shown in figure 1, the storage system includes
Node and network.Wherein, node is divided into user node (can have multiple user nodes：User node 200a, user node
200b, user node 200c and user node 200d), memory node (can have multiple memory nodes：Memory node 100a, deposit
Storage node 100b, memory node 100c and memory node 100d) and management node 300.Network is divided into for carrying user input
The front network 400 and the back-end network 500 for carrying business datum of output (Input/Output, IO) data.The application
Business datum in embodiment may refer to support the mirror image data of RDMA.
User node is used in front end receiver user's I/O data, and by front network memory node is transmitted to.Memory node
For storing user service data, while cache memory (Cache) function is also on memory node.Management node is used for
It is responsible for safeguarding the mirror image relationship between memory node.
Fig. 2 shows the structural representation of memory node and management node.Wherein, memory node can distinguish the main memory of IO
Storage node (by taking the 100a in Fig. 1 as an example) and the mirrored storage node (by taking the 100b in Fig. 1 as an example) of IO.The host node 100a of IO
Mainly include front end I/O module 110a, rear end disk module 120a and Cache module 130a.Front end I/O module 110a is used to be responsible for
User IO is received, the control of IO streams and I O error are processed.Rear end disk module 120a is used to provide user service data by disk
Read-write capability.Cache modules 130a point are daily record layer 131a, resource layer 132a and locally stored 133a.Management node 300 includes
Mirror image management module 310, mirror image management module 310 is used to be responsible for safeguarding mirror image relationship between node in management node, and notifies
Cache modules 130.The structure of mirrored storage node 100b is identical with the structure of primary storage node 100a, will not be described here.
Fig. 3 shows the internal work flow process of Cache modules 130a.Daily record layer 131a receiving front-end I/O modules 110a sends
I/O data, and I/O data is converted to into daily record form (for example, write-ahead log (Write-ahead logging, WAL log)
The data of form) it is sent to resource layer 132a；Resource layer 132a is responsible for resource (for example, non-volatile biserial memory modules
(Non-Volatile Dual In-line Memory Module, NVDIMM) resource) space distribution, and daily record is sent
Stored to mirror nodes 110b.Primary storage node 100a receives storage completion message, and locally stored 133a is locally being deposited
Storage daily record.
The embodiment of the present application is understood for convenience, and here first is introduced and introduce before the embodiment of the present application following wanting
Element.
Remote direct data access (Remote Direct Memory Access, RDMA) is direct by data by network
The memory block of incoming mirror nodes, and not having any impact to operating system, the CPU that can thus reduce mirror image end is opened
Pin.Concrete RDMA realize being held consultation for the position of purpose buffer area by sender and recipient, is connected with traditional TCP
Will be to conventional transmission control protocol (Transmission Control Protocol, TCP) header data structure unlike connecing
Carry out some to change to support rdma protocol, be mainly to increase the field (generating RDMA Message) of an expression destination address.
RDMA read-write operations require that source and destination both know about position and the size of purpose buffer area, if passed through from the internal memory of main frame
RDMA to another host memory writes a block number evidence, then must provide for the address of purpose buffer area, and guarantees this buffer area foot
Reach greatly to receive this block number evidence.
WAL log journal formats are divided into three types：Simple type daily record, compound daily record and command type daily record.
Simple type daily record (is the information of description data attribute, is used to refer to storage location, history number just for metadata
According to, the function such as resource lookup, file record) an object daily record, or the daily record of a file of data.IO is write at one
Only during the data comprising Cache module, simple type journal format is usually used.Simple type journal format as shown in fig. 4 a,
Including magic character segment, data division, daily record head point and daily record portion.Magic character segment stores one group of Magic number and represents day
Will starts, and metadata is deposited in daily record head, and CRC (the Cyclic Redundancy of daily record are deposited in daily record tail
Check, CRC) check information.
Compound journal format as shown in Figure 4 b, when data of the IO comprising multiple Cache modules are write for one, needs conversion
For a plurality of simple daily record, then to one composite log head of a plurality of simple log package, it is combined into a compound daily record to ensure
The concordance of this plurality of log.The data division of this compound daily record deposits a plurality of simple daily record, concrete daily record number and number
Preserve in daily record head according to length.
Command type journal format as illustrated in fig. 4 c, when a write order or other order IO issue data, this part
The data that IO is carried need not be preserved in Cache, in order to mirror nodes can be perceived, it is also desirable to write a daily record,
Position and the size of data is realized in description.Wherein, failure range information described in command type daily record head.
The resource allocation of resource layer refers to that the space of mirror image is divided into into multiple sections (Segment) (is usually used 8M NVDIMM
Space) managing.Each Segment can deposit a plurality of WAL log (as shown in Figure 5), and WAL log are using continuous storage side
Formula, every WAL log joins end to end.Magic character segment stores the beginning that one group of Magic number represents a Segment, daily record head note
The record Segmnet states whether description information such as available and Segment sequence numbers.
The method that Fig. 6 shows prior art data storage, idiographic flow is as follows：
101st, IO front-end modules send write request message to local cache module, and the write request message carries target to be written
Data.
102nd, local cache module receives the target data, and the target data is sent to into mirror cache module so that
The mirror cache module stores target datas.
103rd, mirror cache module receives the target data, and indexes for the target data configuration internal memory, internal memory index
For conveniently reading the target data, specifically, mirror cache module first can whether there is in the inquiry of existing concordance list should
The corresponding internal memory index of target data, is that the target data creates corresponding internal memory index if not existing；
104th, mirror cache module (configures suitable for depositing according to internal memory index for target data application storage resource
The resource space of storage target data), and the internal memory index of target data and reflecting for the storage address of the resource space of application are set
Penetrate relation so that can read data in memory space according to indexing and indexing corresponding storage address.
105th, mirrored storage module stores target data in the resource space of application.
106th, mirror cache module is completed after the storage of target data, and to local cache module storage completion message is sent.
107th, local cache module is received after the storage completion message of mirror cache module transmission, can be started local
Storage target data is carried out in caching, is first target data configuration internal memory index.Idiographic flow and mirror nodes data storage
Flow process (such as above-mentioned step 103 and step 104) it is identical, here is not repeated.
108th, local cache module is target data application storage resource.
109th, local cache module stores target data in the resource space of application.
110th, local cache module is completed after the storage of target data, and to IO front-end modules write request response message is sent.
Therefore, in prior art, need during mirror cache module stores mirror image data through configuring internal memory for target data
(mirror cache module needs to be found suitably according to each attribute such as size, the types of target data for index, application storage resource
Resource space, and configure the storage address of resource space and the mapping relations of internal memory index) and and mirror is arrived in target data storage
As these steps of cache module are required for CPU to participate in, so that the CPU occupancy of mirrored storage node is higher.
In the case that the embodiment of the present application is applied to the first storage device normal work, the first storage device data storage with
And second storage device data storage scene.
It should be understood that primary storage node 100a of first storage device of the embodiment of the present application corresponding to above-mentioned Fig. 2, second deposits
Mirrored storage node 100b of the storage equipment corresponding to above-mentioned Fig. 2；On in other words first storage device of the embodiment of the present application is exactly
The primary storage node 100a of Fig. 2 is stated, the second storage device is exactly the mirrored storage node 100b of above-mentioned Fig. 2；Or this first is deposited
Storage equipment and the second storage device respectively equipment with above-mentioned Cache modules 130a function and above-mentioned Cache modules 130b
The equipment of function, the application is not defined to this.
Fig. 7 shows the indicative flowchart of the method for the data storage according to the application one embodiment.The application reality
It can be any one storage in memory node 100a, 100b, 100c and 100d in Fig. 1 to apply the first storage device in example
Node, the second storage device can be the mirrored storage node of the primary storage node determined by management node 300.
701st, the first storage device receives write request message, and the write request message carries target data.
The embodiment of the present application is applied in the storage system for including the first storage device and at least one second storage devices,
And second storage device be first storage device of class mirror storage device.Additionally, the first storage device can also be second
The mirror storage device of storage device, that is to say, that the first storage device and the second storage device can deposit equipment by mirror image each other,
The application is not defined to this.
First storage device can be Cache modules 130a in Fig. 2, and Cache modules 130a receive IO front-end modules
The write request message that 110a sends, but the application is not limited to this.First storage device receives write request message, write request message
Middle to carry data (being expressed as target data) to be written, the target data can be the data for needing same caching process,
Can be the data for needing multiple buffer units to process；Or the target data need not be preserved in the buffer.
It should be noted that first storage device can include being transported on multiple region of memorys, processor, controller and controller
Go operating system etc., the second storage device can be identical with the first storage device, it is also possible to different, the application is not carried out to this
Limit.
702nd, the first storage device generates corresponding target journaling according to the target data.
The target journaling includes target data and the identification information for identifying target data, and the identification information is instruction mesh
The various information of mark data attribute.For example, journal format is as shown in Fig. 4 a, Fig. 4 b and Fig. 4 c, by taking simple type daily record as an example, simply
Type daily record includes that magic character segment, data division and daily record head divide and daily record portion.Storage device can be according to magic
Character segment recognizes the beginning of daily record；And metadata is stored in daily record head, metadata is used to indicate data storage location, history number
According to, the function such as resource lookup, file record；Daily record portion deposits the CRC check information of daily record, it is ensured that the reliability of data
Property.Therefore, the identification information that the target journaling in the embodiment of the present application includes can be daily record head, daily record tail and Magic number
The all information stored in part.
Journal format includes simple type daily record, compound daily record and command type daily record.If target data needs a caching
Process, then the target data is converted to simple type daily record by the first memory storage devices；If target data is to need multiple cachings
Process, then target data is converted to compound daily record by the first storage device.If target data need not be preserved in the buffer,
Target data is converted to command type daily record by the first storage device, to describe the data failure, and the position of fail data and
Size.Such first storage device can need caching process, a multiple caching process still need not according to target data
Caching process, is that target data selects to generate suitable target journaling.
It should be understood that not making a distinction to " caching " and " internal memory " in the embodiment of the present application, that is to say, that caching and internal memory are all
Demand of the embodiment of the present application to data storage can be realized, therefore the application is not defined to this.
For example, target data is the block data storage for needing a caching process, and block data storage mainly includes volume identification
(volume Identity, volume ID), block initial address (Logical block address, LBA), block number
(lengh), user data (buff).Because target data needs a caching process, therefore, the first storage device deposits the block
Storage data are converted to simple type daily record, and LBA is converted into into the numbering of memory management unit, such as LBA is rounded divided by 64k and obtained
Element number (chunk ID), remainder obtain the skew (offset) in unit, and volume ID, chunk ID, offset are write
In entering daily record head, by buff write daily record datas part, the CRC of the reliability for ensureing data will be used for
(Cyclic Redundancy Check, CRC) writes on daily record tail.
It should be understood that not making a distinction to " caching " and " internal memory " in the embodiment of the present application, that is to say, that caching and internal memory are all
Demand of the embodiment of the present application to data storage can be realized.
703rd, the first storage device sends the target journaling to second storage device.
Second storage device receives the target journaling that first storage device sends, and target journaling is stored to second
In the internal memory of storage device.
704th, second storage device mirrored storage target journaling.
Second storage device receives the target that the first storage device is generated according to the target data carried in write request message
Daily record, and the target journaling is directly stored in the second storage device, because the target journaling is included for representing the target
The identification information of data, when such second storage device stores the target journaling and need not create internal memory index, compare existing
In technology, the second storage device needs to configure for internal memory index, and the application can directly store the target journaling, so as to save
Occupancy when the second storage device configurations internal memory is indexed to CPU.
Alternatively, as one embodiment, the first storage device receives the second storage device and completes mirrored storage target
The storage completion message of daily record, it is ensured that the second storage device is successfully completed after write target journaling, the first storage device
Just start to write target journaling in the caching of oneself, can so avoid the second storage device from failing, waste the first storage
The CPU of equipment takes.First storage device complete write target journaling, and receive the second storage device transmission storage complete
After message, write request response message is sent to I/O device, thus being avoided that in prior art needs wait to store target data
Index to internal memory and could return write request response message to I/O device after corresponding resource space, ask so as to reduce to send to write
Seek the time delay for receiving write request response message.
It should be understood that it can also be it that the equipment of transmission write request message and reception write request response message can be I/O device
His equipment, illustrates for convenience of description by taking I/O device as an example, but the application is not limited to this.
Alternatively, the first storage device is not received by storing before completion message, and the first storage device begins to write
The target journaling, completes to write target journaling, and receives the storage of the second storage device transmission completing in the first storage device
After message, write request response message is sent to I/O device, so can further save to I/O device and return write request sound
Answer the time of message.
Alternatively, as one embodiment, second storage device includes multiple resource spaces；Wherein, second storage
The equipment mirrored storage target journaling includes：Second storage device according to the identification information, it is determined that storing the target journaling
First resource space, the first resource space be second storage device multiple resource spaces in meet the money of the target journaling
Arbitrary resource space of source demand；Second storage device is by the target journaling mirrored storage to the first resource space.
Specifically, the second storage device receives target journaling, and the target journaling includes the mark for identifying target data
Knowledge information, the second storage device selects suitable resource space (being expressed as first resource space) according to the identification information, by this
Target journaling is stored in the first resource space of the second storage device.Additionally, the second storage device can be according to identification information
Identification target data, target data can carry out in order regular storage in the form of target journaling, and such second
Storage device can be target data configuration internal memory index, so that the CPU for saving the second storage device takes.
It should be understood that first resource space is the resource space in units of Segment mentioned above, each
Segment can deposit a plurality of daily record.
Alternatively, second storage device includes multiple resource spaces；The method also includes：First storage device is obtained
The storage address in Secondary resource space and the memory capacity in the Secondary resource space, the Secondary resource space sets for second storage
Arbitrary resource space in standby multiple resource spaces；First storage device is according to the memory capacity in the Secondary resource space and should
Identification information, determines whether the Secondary resource space meets the resource requirement of the target journaling；First storage device this
When two resource spaces meet the resource requirement of the target journaling, according to RDMA coded systems, the target journaling and the Secondary resource
The storage address in space, generates RDMA Message, and the RDMA Message includes the storage address in the Secondary resource space and the target day
Will；Wherein, first storage device sends the target journaling and includes to second storage device：First storage device to this
Two storage devices send the RDMA Message；Wherein, the second storage device mirrored storage target journaling includes：Second storage
Equipment stores the target journaling in the Secondary resource space according to the RDMA Message.
Specifically, the second storage device includes multiple resource spaces, and the second storage device can arbitrarily send any one
The memory capacity and storage address of individual resource space.First storage device is got in the second storage device in multiple resource spaces
The storage address and memory capacity of any one resource space (being expressed as Secondary resource space), and according to the Secondary resource space
Memory capacity and the identification information of target journaling determine whether Secondary resource space meets the resource requirement of target journaling, accordingly
Ground, Secondary resource space is also Segment resource spaces mentioned above.Because the identification information of target journaling includes number of targets
According to resource size (storing the resource needed for target journaling), therefore during the first storage device can be by comparing identification information
The resource size of target data determines whether Secondary resource space disclosure satisfy that target day with the memory capacity in Secondary resource space
The resource requirement of will.
First storage device is encoded when the Secondary resource space meets the resource requirement of the target journaling according to RDMA
The storage address of mode, the target journaling and the Secondary resource space, generates RDMA Message, and the RDMA Message includes second money
The storage address of source space and the target journaling, the first storage device to the second storage device sends the RDMA Message, and second deposits
The Secondary resource space of storage equipment is received after RDMA Message, and parsing obtains target journaling, and target journaling is directly stored in
In Secondary resource space.Second storage device is after by target journaling mirrored storage to Secondary resource space, it is possible to
One storage device returns mirrored storage completion message.The embodiment of the present application compares the second storage device and receives target journaling, and needs
Suitable resource space is selected for target journaling, can further save the occupancy of the CPU of the second storage device.
For example, as shown in Fig. 2 the first storage device is by RDMA technologies, can be straight from resource layer 132a by target journaling
Sending and receiving are sent to resource layer 132b.
Alternatively, as one embodiment, first storage device obtain the storage address in Secondary resource space and this
The memory capacity of two resource spaces includes：First storage device to second storage device sends resource request message, the money
Source request message is used for the Secondary resource space that request stores the target journaling；First storage device receives second storage
The resource request response message that equipment sends according to the resource request message, the resource request response message carries the Secondary resource
The storage address in space and the memory capacity in the Secondary resource space.
Specifically, the first storage device can send resource request to the second storage device, be set with obtaining the second storage
The storage address of standby resource space and the surplus resources size of the resource space (can also write many in the resource space
Big data).First storage device can send resource request message to the second storage device, and the second storage device is in multiple moneys
Any one resource space (being expressed as Secondary resource space) is selected in source space, and resource request is sent to the first storage device
Response message, and storage address and the Secondary resource space in the Secondary resource space are carried in resource request response message
Residual capacity, so that the first storage device can select suitable resource space for target journaling.
It should be understood that in the embodiment of the present application, the first storage device can only obtain the resource space of second storage device
Between address and memory capacity, until the resource space does not have a surplus resources, or surplus resources can not meet current to be written
Enter the size of data, address and the memory capacity of the resource space of the second storage device are then just obtained next time.
Alternatively, as one embodiment, the method also includes：First storage device is the target data configuration internal memory
Index；First storage device is indexed according to the internal memory, it is determined that storing the resource space of first storage device of the target data
Between, wherein, the storage address of the resource space of first storage device is corresponding to the internal memory index；First storage device should
Target data is write in the resource space of first storage device.
First storage device complete store target journaling, and receive the second storage device return storage complete to disappear
After breath, to I/O device write request response message is sent.Due to reading target data ratio comparatively fast according to internal memory index, therefore, here
Afterwards, the first storage device can also be indexed for identifying target data (example for target data configuration internal memory index, the internal memory
Such as, the size of target data, type etc.), and (be expressed as first to deposit for target data application storage resource according to the internal memory index
The resource space of storage equipment, first storage device can also include multiple memory spaces), and the storage money that configuration has been applied
The mapping relations that the storage address in source is indexed with internal memory, the mapping relations can be according to internal memory rope for follow-up first storage device
Draw and read the data stored in corresponding storage address, finally write target data into the corresponding resource space of storage address
In, such first storage device stores target data to there is internal memory to index in corresponding resource space, can't extend impact
Return the time of write request response message.
It should be understood that the target data can be that the target data of carrying, or parsing target journaling are obtained in write request
The target data for obtaining, the application is not defined to this.
It should also be understood that the first storage device can not also store target journaling, but directly target data is write into internal memory
In indexing corresponding resource space；Or, after the first storage device write target journaling, then enter to be about to target data write internal memory
After indexing in corresponding resource space, write request response message is just sent.The application is not defined to this.
Second storage device storage target journaling is used in the first storage device failure, and the second storage device can take over
The data storage of the first storage device current service, concrete phenomenon of the failure has following several：
In the first storage device failure, the second storage device is detected after the failure, the second storage device adapter data
Storage.At this moment, the second storage device needs to carry out target journaling playback, and daily record playback refers to parsing target journaling to obtain effectively
Target data (will target data read one by one), be target data configuration internal memory index, and by target data storage to right
(represent that daily record playback terminates) in the resource space answered, the resource space is that internal memory indexes corresponding storage address, the storage
The corresponding resource space in address；Hereafter, the second storage device can processing data storage service.
The fast quick-recovery after the first storage device failure, the first storage device can directly restart playback daily record, afterwards, the
One storage device can processing data storage service.
In the case of the first storage device and the second storage device all failures, after restarting, the first storage device can be with
Second storage device competition main storage device (i.e. adapter current data storage), competes after main storage device, to play back daily record.This
Afterwards, the second storage device can processing data storage service, do not result in the loss of internal storage data, there is provided data storage
Reliability..
It should be understood that in the various embodiments of the application, the size of the sequence number of above-mentioned each process is not meant to that execution is suitable
The priority of sequence, the execution sequence of each process should determine with its function and internal logic, and should not be to the enforcement of the embodiment of the present application
Process constitutes any restriction.
Therefore, the method for the data storage of the embodiment of the present application, the first storage device carries target data by receiving
Write request message, the target data in the write request message is generated includes the target data and for identifying the target data
Identification information target journaling, and send the target journaling to second storage device, the second storage device mirrored storage should
Target journaling, and the mirrored storage target journaling need not configure internal memory index, such first storage device is generated to be included identifying
The target journaling of the identification information of target data, the second storage device can store target journaling and need not configure internal memory index,
So as to reduce the occupancy of the CPU to the second storage device.
Fig. 8 shows the interaction diagrams of the method for the data storage according to the application one embodiment.The application is implemented
The implication of the various terms in example is identical with foregoing embodiments.
It should be noted that this is intended merely to help those skilled in the art to more fully understand the embodiment of the present application, and unrestricted
The scope of application embodiment.
801st, the first storage device receives write request message, and the write request message carries target data.
802nd, the first storage device generates corresponding target journaling according to target data, target journaling include target data and
For identifying the identification information of target data.
803rd, the first storage device obtains the storage of the resource space (being expressed as Secondary resource space) of the second storage device
Address and the memory capacity of resource space.
804th, the first storage device is according to the memory capacity and identification information in Secondary resource space, it is determined that the second money for obtaining
Whether the memory capacity of source space disclosure satisfy that the resource requirement of target journaling.
805th, the first storage device is it is determined that the memory capacity in the Secondary resource space for obtaining disclosure satisfy that target journaling
Resource requirement, according to the storage address in target journaling, RDMA coded systems, Secondary resource space RDMA Message is generated.
806th, the first storage device sends RDMA Message to the second storage device.
807th, target journaling is directly stored in corresponding second money of storage address by the second storage device according to RDMA Message
In source space.
Alternatively, the first storage device directly can send target journaling to the second storage device, by the second storage device
To be determined to store the resource space of target journaling, step 803 can not so be needed to 807.
808th, the second storage device sends storage and completes after the mirrored storage for completing target journaling to the first storage device
Message.
809th, the first storage device is in locally stored target journaling.
Step 808 and step 809 can not be defined without precedence relationship, the application to this.
810th, the first storage device locally complete store target journaling, and receive storage completion message after, to IO
Equipment returns write request response message.
811st, the first storage device is being locally the corresponding internal memory index of target data configuration, and the internal memory is indexed for identifying
Target data.
812nd, the first storage device is indexed according to the internal memory, it is determined that the resource space of the first storage device of storage target data
Between.
813rd, the first storage device stores target data in the resource space of the first storage device for determining.
It should be understood that the concrete indicating mode of above-mentioned corresponding information refers to foregoing embodiments, for sake of simplicity, here is no longer
Repeat.
Therefore, the method for the data storage of the embodiment of the present application, the first storage device carries target data by receiving
Write request message, the target data in the write request message is generated includes the target data and for identifying the target data
Identification information target journaling, obtain the second storage device Secondary resource space, meet target day in Secondary resource space
During the resource requirement of will, RDMA Message is generated according to the storage address of target journaling, RDMA coded systems and Secondary resource space,
And the target journaling is sent to second storage device, the second storage device is directly stored in target journaling according to RDMA Message
In Secondary resource space, and store the target journaling and need not configure internal memory index, such first storage device is generated to be included marking
Know the target journaling of the identification information of target data, and meet resource by sending RDMA Message and being directly stored in target journaling
In the memory space of demand, the second storage device storage target journaling can configure internal memory index, right so as to reduce
The occupancy of the CPU of the second storage device.
It should be understood that in the various embodiments of the application, the size of the sequence number of above-mentioned each process is not meant to that execution is suitable
The priority of sequence, the execution sequence of each process should determine with its function and internal logic, and should not be to the enforcement of the embodiment of the present application
Process constitutes any restriction.
The method of the data storage according to the embodiment of the present application is described in detail above, has been described below according to the application
The storage device of embodiment.
Fig. 9 shows the schematic block diagram of the storage system 900 according to the embodiment of the present application, and the storage system includes first
The storage device 920 of storage device 910 and at least one second, wherein, second storage device 920 is first storage device
910 mirror storage device, the storage system 900 is used for the method for performing the data storage described in Fig. 7, the storage system 900
Including：
First storage device 910, for receiving write request message, the write request message carries target data, according to this
Target data generates target journaling, and sends the target journaling to second storage device 920, and the target journaling includes the target
Data and the identification information for identifying the target data；
Second storage device 920, for storing the target journaling, and the storage target journaling need not configure internal memory
Index.
Therefore, the storage system of the embodiment of the present application, the first storage device carries the write request of target data by receiving
Message, the target data in the write request message is generated includes the target data and the mark for identifying the target data
The target journaling of information, and send the target journaling, the second storage device mirrored storage target day to second storage device
Will, and the mirrored storage target journaling need not configure internal memory index, such first storage device is generated includes mark number of targets
According to identification information target journaling, the second storage device can store target journaling need not configure internal memory index, so as to subtract
The occupancy of the CPU to the second storage device is lacked.
Alternatively, in the application one embodiment, second storage device 920 is additionally operable to complete to store the target day
During will, to first storage device 910 storage completion message is sent；
First storage device 910 is additionally operable to store the target journaling, and completes the storage and reception of the target journaling
To after the storage completion message, write request response message is sent.
Alternatively, in the application one embodiment, second storage device 920 includes multiple resource spaces；
Second storage device 920 specifically for：
According to the identification information, it is determined that store the first resource space of the target journaling, the first resource space for this
Arbitrary resource space of the resource requirement of the target journaling is met in multiple resource spaces of two storage devices 920；
The target journaling is stored in the first resource space.
Alternatively, in the application one embodiment, second storage device 920 includes multiple resource spaces；
First storage device 910, is additionally operable to obtain the storage address in Secondary resource space and the Secondary resource space
Memory capacity, determines whether the Secondary resource space meets this according to the memory capacity and the identification information in the Secondary resource space
The resource requirement of target journaling, and when the Secondary resource space meets the resource requirement of the target journaling according to long-range directly number
RDMA Message is generated according to the storage address in access RDMA coded systems, the target journaling and the Secondary resource space, and to this
The Secondary resource space of the second storage device 920 sends the RDMA Message, and the Secondary resource space is second storage device 920
Multiple resource spaces in arbitrary resource space, the storage address of the RDMA Message including the Secondary resource space and the target day
Will；
Second storage device 920, is additionally operable to by the Secondary resource space according to the RDMA Message, stores target day
Will.
Alternatively, in the application one embodiment, first storage device 910 is additionally operable to second storage device
920 send resource request message, and receive the resource request sound that second storage device 920 sends according to the resource request message
Message is answered, the resource request message is used for the Secondary resource space that request stores the target journaling, the resource request response disappears
Breath carries the storage address in the Secondary resource space and the memory capacity in the Secondary resource space.
Alternatively, in the application one embodiment, first storage device 910 is additionally operable to as the target data configuration
Internal memory is indexed, and determines the resource space of first storage device for storing the target data according to the internal memory index, and will
The target data is write in the resource space of first storage device, wherein, the storage of the resource space of first storage device
Address is corresponding to the internal memory index.
Therefore, the storage system of the embodiment of the present application, the first storage device carries the write request of target data by receiving
Message, the target data in the write request message is generated includes the target data and the mark for identifying the target data
The target journaling of information, and send the target journaling, the second storage device mirrored storage target day to second storage device
Will, and the mirrored storage target journaling need not configure internal memory index, such first storage device is generated includes mark number of targets
According to identification information target journaling, the second storage device can store target journaling need not configure internal memory index, so as to subtract
The occupancy of the CPU to the second storage device is lacked.
May correspond to be deposited according to the data of the embodiment of the present application Fig. 7 or Fig. 8 according to the storage system 900 of the embodiment of the present application
Above and other operation of the modules in the storage system of the method for storage, and storage system 900 and/or function are respectively
The corresponding flow process of aforementioned each method is realized, for sake of simplicity, will not be described here.
Figure 10 shows the structure of the storage system that embodiments herein is provided, including at least one processor 1002
(such as CPU), at least one network interface 1005 or other communication interfaces, at least one memorizer 1006, and at least one
Communication bus 1003, for realizing the connection communication between these devices.Processor 1002 is used to perform to deposit in memorizer 1006
The executable module of storage, such as computer program.Memorizer 1006 may include high-speed random access memory (Random
Access Memory, RAM), it is also possible to also including non-labile memorizer (non-volatile memory), for example, at least
One disk memory.By at least one network interface 1005 (can be wired or wireless) realize with it is at least one other
Communication connection between network element.
In some embodiments, memorizer 1006 stores program 10061, and the configuration processor 10061 of processor 1002 is used
Operate below performing：
Write request message is received by network interface 1005, the write request message carries target data；
According to the target data, target journaling is generated, the target journaling includes the target data and for identifying the target
The identification information of data；
The target journaling is sent to the second storage device by network interface 1005；
The target journaling is stored, and the storage target journaling need not configure internal memory index.
It should be noted that the storage system can be used for performing it is each in the embodiment of the method shown in above-mentioned Fig. 7 or Fig. 8
Individual step and/or flow process.
The above technical scheme provided from the embodiment of the present application can be seen that the first storage device and carry target by receiving
The write request message of data, the target data in the write request message is generated includes the target data and for identifying the mesh
The target journaling of the identification information of mark data, and send the target journaling, the second storage device mirror image to second storage device
Store the target journaling, and the mirrored storage target journaling need not configure internal memory index, such first storage device generates bag
The target journaling of the identification information of mark target data is included, the second storage device can store target journaling and need not configure internal memory
Index, so as to reduce the occupancy of the CPU to the second storage device.
The embodiment of the present application also provides a kind of computer-readable storage medium, and the computer-readable storage medium can be stored for indicating
The programmed instruction of any of the above-described kind of method.
Alternatively, the storage medium is specifically as follows memorizer 1106.
It should be understood that the specific example in the application is intended merely to help those skilled in the art to more fully understand the application
Embodiment, and the scope of unrestricted the embodiment of the present application.
It should be understood that the terms "and/or", a kind of only incidence relation of description affiliated partner, expression can be deposited
In three kinds of relations, for example, A and/or B can be represented：Individualism A, while there is A and B, individualism B these three situations.
In addition, character "/" herein, typicallys represent forward-backward correlation pair as if a kind of relation of "or".
It should be understood that in the various embodiments of the application, the size of the sequence number of above-mentioned each process is not meant to that execution is suitable
The priority of sequence, the execution sequence of each process should determine with its function and internal logic, and should not be to the enforcement of the embodiment of the present application
Process constitutes any restriction.
Those of ordinary skill in the art are it is to be appreciated that the list of each example with reference to the embodiments described herein description
Unit and algorithm steps, being capable of being implemented in combination in electronic hardware or computer software and electronic hardware.These functions are actually
Performed with hardware or software mode, depending on the application-specific and design constraint of technical scheme.Professional and technical personnel
Each specific application can be used different methods to realize described function, but this realization it is not considered that exceeding
Scope of the present application.
Those skilled in the art can be understood that, for convenience and simplicity of description, the system of foregoing description,
The specific work process of device and unit, may be referred to the corresponding process in preceding method embodiment, will not be described here.
In several embodiments provided herein, it should be understood that disclosed system, apparatus and method, can be with
Realize by another way.For example, device embodiment described above is only schematic, and for example, the unit is drawn
Point, only a kind of division of logic function can have other dividing mode when actually realizing, such as multiple units or component can
To combine or be desirably integrated into another system, or some features can be ignored, or not perform.It is another, it is shown or beg for
By coupling each other or direct-coupling or communication connection can be INDIRECT COUPLING by some interfaces, device or unit
Or communication connection, can be electrical, mechanical or other forms.
The unit as separating component explanation can be or may not be it is physically separate, it is aobvious as unit
The part for showing can be or may not be physical location, you can with positioned at a place, or can also be distributed to multiple
On NE.Some or all of unit therein can according to the actual needs be selected to realize the mesh of this embodiment scheme
's.
In addition, each functional unit in the application each embodiment can be integrated in a processing unit, it is also possible to
It is that unit is individually physically present, it is also possible to which two or more units are integrated in a unit.Above-mentioned integrated list
Unit both can be realized in the form of hardware, it would however also be possible to employ the form of SFU software functional unit is realized.
If the integrated unit is realized using in the form of SFU software functional unit and as independent production marketing or used
When, during a computer read/write memory medium can be stored in.Based on such understanding, the technical scheme of the application is substantially
The part for contributing to prior art in other words or the part of the technical scheme can be embodied in the form of software product
Come, the computer software product is stored in a storage medium, including some instructions are used so that a computer equipment (can
Being personal computer, server, or network equipment etc.) perform all or part of each embodiment methods described of the application
Step.And aforesaid storage medium includes：It is USB flash disk, portable hard drive, read only memory (ROM, Read-Only Memory), random
Access memorizer (RAM, Random Access Memory), magnetic disc or CD etc. are various can be with Jie of store program codes
Matter.
The above, the protection domain of the only specific embodiment of the application, but the application is not limited thereto, any
Those familiar with the art can readily occur in change or replacement in the technical scope that the application is disclosed, and all should contain
Cover within the protection domain of the application.Therefore, the protection domain of the application should be defined by the scope of the claims.
Claims (12)
1. a kind of method of data storage, it is characterised in that be applied to include the first storage device and at least one second storages
The storage system of equipment, wherein, second storage device is the mirror storage device of first storage device, methods described
Including：
First storage device receives write request message, and the write request message carries target data；
First storage device generates target journaling according to the target data, and the target journaling includes the number of targets
According to for identifying the identification information of the target data；
First storage device to second storage device sends the target journaling；
Second storage device stores the target journaling, and the storage target journaling need not configure internal memory rope
Draw.
2. method according to claim 1, it is characterised in that methods described also includes：
Second storage device sends storage and completes to disappear when completing to store the target journaling to first storage device
Breath；
First storage device stores the target journaling；
First storage device sends after the storage for completing the target journaling and receiving the storage completion message
Write request response message.
3. method according to claim 1 and 2, it is characterised in that second storage device includes multiple resource spaces；
Wherein, second storage device stores the target journaling and includes：
Second storage device is according to the identification information, it is determined that the first resource space of the target journaling is stored, it is described
First resource space be second storage device multiple resource spaces in meet the target journaling resource requirement appoint
One resource space；
Second storage device stores the target journaling in the first resource space.
4. method according to claim 1 and 2, it is characterised in that second storage device includes multiple resource spaces；
Methods described also includes：
First storage device obtains the storage address in Secondary resource space and the memory capacity in the Secondary resource space, institute
State arbitrary resource space in multiple resource spaces that Secondary resource space is second storage device；
First storage device determines described second according to the memory capacity and the identification information in the Secondary resource space
Whether resource space meets the resource requirement of the target journaling；
First storage device when the Secondary resource space meets the resource requirement of the target journaling, according to long-range straight
The storage address of data access RDMA coded system, the target journaling and the Secondary resource space is connect, RDMA Message is generated,
The RDMA Message includes the storage address and the target journaling in the Secondary resource space；
Wherein, first storage device sends the target journaling and includes to second storage device：
First storage device to the Secondary resource space of second storage device sends the RDMA Message；
Wherein, second storage device stores the target journaling and includes：
The Secondary resource space of second storage device stores the target journaling according to the RDMA Message.
5. method according to claim 4, it is characterised in that first storage device obtains depositing for Secondary resource space
The memory capacity in storage address and the Secondary resource space includes：
First storage device to second storage device sends resource request message, and the resource request message is used for please
Seek survival and store up the Secondary resource space of the target journaling；
First storage device receives second storage device and is rung according to the resource request that the resource request message sends
Answer message, the resource request response message carries the storage address in the Secondary resource space and the Secondary resource space
Memory capacity.
6. method according to any one of claim 1 to 5, it is characterised in that methods described also includes：
First storage device is target data configuration internal memory index；
First storage device is indexed according to the internal memory, it is determined that storing first storage device of the target data
Resource space, wherein, the storage address of the resource space of first storage device is indexed corresponding to the internal memory；
First storage device writes the target data in the resource space of first storage device.
7. a kind of storage system, it is characterised in that including the first storage device and at least one second storage devices, described second
Storage device is the mirror storage device of first storage device；
First storage device, for receiving write request message, the write request message carries target data, according to the mesh
Mark data genaration target journaling, and the target journaling is sent to second storage device, the target journaling includes described
Target data and the identification information for identifying the target data；
Second storage device, for storing the target journaling, and the storage target journaling need not configure interior
Deposit index.
8. storage system according to claim 7, it is characterised in that second storage device is additionally operable to complete storage
During the target journaling, to first storage device storage completion message is sent；
First storage device is additionally operable to store the target journaling, and in the storage for completing the target journaling and receives
After the storage completion message, write request response message is sent.
9. the storage system according to claim 7 or 8, it is characterised in that second storage device includes multiple resources
Space；
Second storage device specifically for：
According to the identification information, it is determined that storing the first resource space of the target journaling, the first resource space is institute
Arbitrary resource space of the resource requirement of the target journaling is met in the multiple resource spaces for stating the second storage device；
The target journaling is stored in the first resource space.
10. the storage system according to claim 7 or 8, it is characterised in that second storage device includes multiple resources
Space；
First storage device, is additionally operable to obtain the storage address in Secondary resource space and the storage in the Secondary resource space
Capacity, determines whether the Secondary resource space meets according to the memory capacity and the identification information in the Secondary resource space
The resource requirement of the target journaling, and when the Secondary resource space meets the resource requirement of the target journaling according to remote
The storage address in journey immediate data access RDMA coded systems, the target journaling and the Secondary resource space generates RDMA and disappears
Breath, and the RDMA Message is sent to the Secondary resource space of second storage device, the Secondary resource space is institute
Arbitrary resource space in multiple resource spaces of the second storage device is stated, the RDMA Message includes the Secondary resource space
Storage address and the target journaling；
Second storage device, is additionally operable to by the Secondary resource space according to the RDMA Message, stores the target
Daily record.
11. storage systems according to claim 10, it is characterised in that first storage device, are additionally operable to described
Second storage device sends resource request message, and receives what second storage device sent according to the resource request message
Resource request response message, the resource request message is used for the Secondary resource space of the request storage target journaling,
The resource request response message carries the storage address in the Secondary resource space and the storage in the Secondary resource space is held
Amount.
12. storage systems according to any one of claim 7 to 11, it is characterised in that first storage device, also
For for target data configuration internal memory index, and indexed according to the internal memory and determine described the of the storage target data
The resource space of one storage device, and the target data is write in the resource space of first storage device, wherein,
The storage address of the resource space of first storage device is indexed corresponding to the internal memory.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610811110.5A CN106648959B (en) | 2016-09-07 | 2016-09-07 | Data storage method and storage system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610811110.5A CN106648959B (en) | 2016-09-07 | 2016-09-07 | Data storage method and storage system |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN106648959A true CN106648959A (en) | 2017-05-10 |
| CN106648959B CN106648959B (en) | 2020-03-10 |
Family
ID=58851593
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201610811110.5A Active CN106648959B (en) | 2016-09-07 | 2016-09-07 | Data storage method and storage system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN106648959B (en) |
Cited By (11)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107329708A (en) * | 2017-07-04 | 2017-11-07 | 郑州云海信息技术有限公司 | A kind of distributed memory system realizes data cached method and system |
| CN108959465A (en) * | 2018-06-19 | 2018-12-07 | 阿里巴巴集团控股有限公司 | Storage, read method, device and the server of business datum |
| CN110737716A (en) * | 2018-07-02 | 2020-01-31 | 华为技术有限公司 | data writing method and device |
| CN111092817A (en) * | 2019-12-23 | 2020-05-01 | 中国联合网络通信集团有限公司 | Data transmission method and device |
| CN111274176A (en) * | 2020-01-15 | 2020-06-12 | 联想(北京)有限公司 | Information processing method, electronic equipment, system and storage medium |
| CN112099997A (en) * | 2020-09-23 | 2020-12-18 | 维沃移动通信有限公司 | File storage method and electronic equipment |
| CN112256657A (en) * | 2019-07-22 | 2021-01-22 | 华为技术有限公司 | Log mirroring method and system |
| CN112632129A (en) * | 2020-12-31 | 2021-04-09 | 联想未来通信科技(重庆)有限公司 | Code stream data management method, device and storage medium |
| CN112817967A (en) * | 2020-12-30 | 2021-05-18 | 北京天融信网络安全技术有限公司 | Flow data storage method and device, electronic equipment and storage medium |
| CN115202588A (en) * | 2022-09-14 | 2022-10-18 | 云和恩墨(北京)信息技术有限公司 | Data storage method and device and data recovery method and device |
| WO2023151545A1 (en) * | 2022-02-08 | 2023-08-17 | 华为技术有限公司 | Data storage system, data storage method and apparatus, and related device |
Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20070214330A1 (en) * | 2006-03-10 | 2007-09-13 | Seiko Epson Corporation | Method for processing backup, backup processing device, and storage medium storing program |
| CN100476747C (en) * | 2006-04-12 | 2009-04-08 | 株式会社日立制作所 | Storage system and data management method |
| CN101819543A (en) * | 2010-02-01 | 2010-09-01 | 成都市华为赛门铁克科技有限公司 | Snapshot data processing method, system and storage device |
| EP2042979A3 (en) * | 2007-09-26 | 2012-01-25 | Hitachi, Ltd. | Power efficient data storage with data de-duplication |
| CN101727366B (en) * | 2008-10-23 | 2013-01-02 | 株式会社日立制作所 | Computer system for performing remote copy using journal |
| CN103645969A (en) * | 2013-12-13 | 2014-03-19 | 华为技术有限公司 | Data replication method and data storage system |
| CN104641650A (en) * | 2012-07-16 | 2015-05-20 | 康佩伦特科技公司 | Source reference replication in a data storage subsystem |
-
2016
- 2016-09-07 CN CN201610811110.5A patent/CN106648959B/en active Active
Patent Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20070214330A1 (en) * | 2006-03-10 | 2007-09-13 | Seiko Epson Corporation | Method for processing backup, backup processing device, and storage medium storing program |
| CN100476747C (en) * | 2006-04-12 | 2009-04-08 | 株式会社日立制作所 | Storage system and data management method |
| EP2042979A3 (en) * | 2007-09-26 | 2012-01-25 | Hitachi, Ltd. | Power efficient data storage with data de-duplication |
| CN101727366B (en) * | 2008-10-23 | 2013-01-02 | 株式会社日立制作所 | Computer system for performing remote copy using journal |
| CN101819543A (en) * | 2010-02-01 | 2010-09-01 | 成都市华为赛门铁克科技有限公司 | Snapshot data processing method, system and storage device |
| CN104641650A (en) * | 2012-07-16 | 2015-05-20 | 康佩伦特科技公司 | Source reference replication in a data storage subsystem |
| CN103645969A (en) * | 2013-12-13 | 2014-03-19 | 华为技术有限公司 | Data replication method and data storage system |
Cited By (16)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107329708A (en) * | 2017-07-04 | 2017-11-07 | 郑州云海信息技术有限公司 | A kind of distributed memory system realizes data cached method and system |
| CN108959465A (en) * | 2018-06-19 | 2018-12-07 | 阿里巴巴集团控股有限公司 | Storage, read method, device and the server of business datum |
| CN110737716A (en) * | 2018-07-02 | 2020-01-31 | 华为技术有限公司 | data writing method and device |
| CN110737716B (en) * | 2018-07-02 | 2022-09-23 | 华为技术有限公司 | Data writing method and device |
| CN112256657A (en) * | 2019-07-22 | 2021-01-22 | 华为技术有限公司 | Log mirroring method and system |
| CN111092817A (en) * | 2019-12-23 | 2020-05-01 | 中国联合网络通信集团有限公司 | Data transmission method and device |
| CN111274176B (en) * | 2020-01-15 | 2022-04-22 | 联想(北京)有限公司 | Information processing method, electronic equipment, system and storage medium |
| CN111274176A (en) * | 2020-01-15 | 2020-06-12 | 联想(北京)有限公司 | Information processing method, electronic equipment, system and storage medium |
| CN112099997A (en) * | 2020-09-23 | 2020-12-18 | 维沃移动通信有限公司 | File storage method and electronic equipment |
| CN112817967A (en) * | 2020-12-30 | 2021-05-18 | 北京天融信网络安全技术有限公司 | Flow data storage method and device, electronic equipment and storage medium |
| CN112817967B (en) * | 2020-12-30 | 2023-09-29 | 北京天融信网络安全技术有限公司 | Flow data storage method and device, electronic equipment and storage medium |
| CN112632129A (en) * | 2020-12-31 | 2021-04-09 | 联想未来通信科技(重庆)有限公司 | Code stream data management method, device and storage medium |
| CN112632129B (en) * | 2020-12-31 | 2023-11-21 | 联想未来通信科技(重庆)有限公司 | Code stream data management method, device and storage medium |
| WO2023151545A1 (en) * | 2022-02-08 | 2023-08-17 | 华为技术有限公司 | Data storage system, data storage method and apparatus, and related device |
| CN115202588A (en) * | 2022-09-14 | 2022-10-18 | 云和恩墨(北京)信息技术有限公司 | Data storage method and device and data recovery method and device |
| CN115202588B (en) * | 2022-09-14 | 2022-12-27 | 本原数据(北京)信息技术有限公司 | Data storage method and device and data recovery method and device |
Also Published As
| Publication number | Publication date |
|---|---|
| CN106648959B (en) | 2020-03-10 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN106648959A (en) | Data storage method and storage system | |
| CN106407040B (en) | A kind of duplicating remote data method and system | |
| US9384099B2 (en) | Virtual tape library device and data recovery method | |
| CN101571815B (en) | Information system and i/o processing method | |
| CN103885895A (en) | Write Performance in Fault-Tolerant Clustered Storage Systems | |
| US7707375B2 (en) | Storage system and controller for controlling remote copying | |
| US7647449B1 (en) | Method, system, and computer readable medium for maintaining the order of write-commands issued to a data storage | |
| US8438332B2 (en) | Apparatus and method to maintain write operation atomicity where a data transfer operation crosses a data storage medium track boundary | |
| CN109542980A (en) | A kind of data processing method, device, equipment and the medium of block chain | |
| CN102460439A (en) | Data distribution through capacity leveling in a striped file system | |
| CN102024044A (en) | Distributed file system | |
| CN109086388A (en) | Block chain date storage method, device, equipment and medium | |
| US20060190550A1 (en) | Storage system and controlling method thereof, and device and recording medium in storage system | |
| CN101310250A (en) | Selecting a path comprising ports on primary and secondary clusters to use to transmit data at a primary volume to a secondary volume | |
| CN109522154A (en) | Data reconstruction method and relevant device and system | |
| CN109144406A (en) | Metadata storing method, system and storage medium in distributed memory system | |
| CN109582213A (en) | Data reconstruction method and device, data-storage system | |
| CN110389710A (en) | The method and apparatus for distributing storage resource | |
| WO2015062113A1 (en) | Affair processing method and device | |
| US9268493B2 (en) | Systems and methods for smart storage interconnection in a heterogeneous storage environment | |
| CN103119567B (en) | For the system and method in managing virtual tape pool territory | |
| US7386694B1 (en) | System and method for reading mirrored data | |
| JP2011510414A (en) | Method and system for improving replica server performance | |
| US20160073315A1 (en) | Information processing apparatus, storage control apparatus, and information processing method | |
| US7487319B2 (en) | Resource allocation unit queue |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |