CN103838521A - Data processing method and data processing device - Google Patents

Data processing method and data processing device Download PDF

Info

Publication number
CN103838521A
CN103838521A CN201410073208.6A CN201410073208A CN103838521A CN 103838521 A CN103838521 A CN 103838521A CN 201410073208 A CN201410073208 A CN 201410073208A CN 103838521 A CN103838521 A CN 103838521A
Authority
CN
China
Prior art keywords
data
hard disk
disk groups
log area
write
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN201410073208.6A
Other languages
Chinese (zh)
Other versions
CN103838521B (en
Inventor
金添福
李明君
任努努
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Huawei Cloud Computing Technologies Co Ltd
Original Assignee
Huawei Technologies Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Huawei Technologies Co Ltd filed Critical Huawei Technologies Co Ltd
Priority to CN201410073208.6A priority Critical patent/CN103838521B/en
Publication of CN103838521A publication Critical patent/CN103838521A/en
Priority to PCT/CN2014/089623 priority patent/WO2015127791A1/en
Application granted granted Critical
Publication of CN103838521B publication Critical patent/CN103838521B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
    • G06F3/0601—Interfaces specially adapted for storage systems
    • G06F3/0668—Interfaces specially adapted for storage systems adopting a particular infrastructure
    • G06F3/0671—In-line storage system
    • G06F3/0683—Plurality of storage devices
    • G06F3/0689—Disk arrays, e.g. RAID, JBOD
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
    • G06F3/0601—Interfaces specially adapted for storage systems
    • G06F3/0602—Interfaces specially adapted for storage systems specifically adapted to achieve a particular effect
    • G06F3/061—Improving I/O performance
    • G06F3/0613—Improving I/O performance in relation to throughput
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
    • G06F3/0601—Interfaces specially adapted for storage systems
    • G06F3/0628—Interfaces specially adapted for storage systems making use of a particular technique
    • G06F3/0638—Organizing or formatting or addressing of data
    • G06F3/064—Management of blocks

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Human Computer Interaction (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
  • Debugging And Monitoring (AREA)

Abstract

An embodiment of the invention discloses a data processing method and a data processing device, and relates to the technical field of storage. By the data processing method and the data processing device, data writing speed and data arrangement speed can be increased simultaneously, IOPS (input/output operation per second) performance of the data processing process is improved, and further, rapidness and persistence of data can be realized. The data processing method specifically includes if the occupied quantity of a log space of a log area of a first hard-disk pack is higher than a preset threshold value, writing first data and feature values thereof both read from an internal storage into a log area of a second hard-disk pack, and pausing arranging data written in the log area of the second hard-disk pack into a first data area; according to the data feature values written in the log area of the first hard-disk pack, arranging the data written in the log area of the first hard-disk pack to a second data area. The data processing method and the data processing device are applied to data read-write processes.

Description

A kind of data processing method and device
Technical field
The present invention relates to technical field of memory, relate in particular to a kind of data processing method and device.
Background technology
Along with the fast development of processor technique, existing storage system is not enough to coupling through fast-developing processor system, causes the bottleneck of storage technology to become increasingly conspicuous.Wherein, the bottleneck of storage technology development is mainly reflected in two aspects: in storage system data write with reading speed lower.
In prior art, improve writing and reading speed of data in storage system, can adopt the mode of full internal memory to carry out writing and reading of data.Concrete, write after order receiving data, data to be written are write to dynamic RAM (Dynamic Random Access Memory, DRAM), so that can directly read corresponding data from DRAM after receiving data to read middle order; And by data write non-volatile memory (Non-Volatile Memory to be written, NVM), then in the log area that the data that write NVM is write one by one to hard disk, and in writing data to the log area of hard disk, arrange the data of the log area of hard disk, then reduced data is write to the data field of hard disk.In said process, can realize from hard disk read data and write separating of data to hard disk, improve the read or write speed of data.
Write in the process of data in hard disk in prior art, often carry out for a hard disk: in the log area of this hard disk, write the data that read from NVM simultaneously, and arrange the data that write in the log area of this hard disk, and disposal data is write to the data field of this hard disk.To take into account the speed that log area from from NVM to this hard disk is write the speed of data and arranged written data the log area of this hard disk and adopt the above-mentioned method of writing data simultaneously.
Concrete, if ensure to write to the log area of this hard disk the speed of data, may sacrifice the arrangement speed of data, if ensure the arrangement speed of data, may sacrifice speed from data to the log area of this hard disk that write, number of times (Input/Output Operations Per Second, the IOPS) poor-performing that carries out read-write operation per second in data handling procedure.
Summary of the invention
Embodiments of the invention provide a kind of data processing method and device, can improve writing speed and data preparation speed simultaneously, improve the IOPS performance of data handling procedure.
For achieving the above object, embodiments of the invention adopt following technical scheme:
The first aspect of the embodiment of the present invention, provides a kind of data processing method, comprising:
If the log space of the log area of the first hard disk groups consumption higher than predetermined threshold value, the eigenwert of the first data that read and described the first data is write to the log area of the second hard disk groups from internal memory, and suspend data preparation to the first data field writing in the log area of described the second hard disk groups, data in the described log area that has write described the second hard disk groups comprise described the first data, and the eigenwert of described the first data comprises the write address information of described the first data and the size information of described the first data;
According to the eigenwert that writes the data in the log area of described the first hard disk groups, by data preparation to the second data field in the described log area that has write described the first hard disk groups, the data in the described log area that has write described the first hard disk groups are the data that read from described internal memory.
In conjunction with first aspect, in a kind of possible implementation, described the first data field is the data field of described the second hard disk groups; Described the second data field is the data field of described the first hard disk groups.
In conjunction with first aspect and above-mentioned possible implementation, in the possible implementation of another kind, described the first data field is the data field of the 3rd hard disk groups; Described the second data field is the data field of described the 3rd hard disk groups.
In conjunction with first aspect and above-mentioned any one possible implementation, in the possible implementation of another kind, described the first hard disk groups comprises log area and data field;
Wherein, the log area of described the first hard disk groups is for storing the data that read from described internal memory and the eigenwert of the described data that read from described internal memory; The data field of described the first hard disk groups is for storing the data that arrange from the log area of described the first hard disk groups;
Described the second hard disk groups comprises log area and data field;
Wherein, the log area of described the second hard disk groups is for storing the data that read from described internal memory and the eigenwert of the described data that read from described internal memory; The data field of described the second hard disk groups is for storing the data that arrange from the log area of described the second hard disk groups.
In conjunction with first aspect and above-mentioned any one possible implementation, in the possible implementation of another kind, described the first hard disk groups only comprises log area; Described the second hard disk groups only comprises log area; Described the 3rd hard disk groups only comprises data field;
Wherein, the log area of described the first hard disk groups is for storing the data that read from described internal memory and the eigenwert of the described data that read from described internal memory; The log area of described the second hard disk groups is for storing the data that read from described internal memory and the eigenwert of the described data that read from described internal memory; The data field of described the 3rd hard disk groups is for storing the data that arrange from the log area of described the first hard disk groups and the data that arrange from the log area of described the second hard disk groups.
The second aspect of the embodiment of the present invention, also provides a kind of data processing equipment, comprising:
The first judging unit, for judge the first hard disk groups log area log space consumption whether higher than predetermined threshold value;
The first writing unit, if for described the first judging unit determine described the first hard disk groups log area log space consumption higher than described predetermined threshold value, the eigenwert of the first data that read and described the first data is write to the log area of the second hard disk groups from internal memory, and suspend data preparation to the first data field writing in the log area of described the second hard disk groups, data in the described log area that has write described the second hard disk groups comprise described the first data, the eigenwert of described the first data comprises the write address information of described the first data and the size information of described the first data,
First arranges unit, if for described the first judging unit determine described the first hard disk groups log area log space consumption higher than described predetermined threshold value, according to the eigenwert that has write the data in the log area of described the first hard disk groups, by data preparation to the second data field in the described log area that has write described the first hard disk groups, the data in the described log area that has write described the first hard disk groups are the data that read from described internal memory.
In conjunction with second aspect, in a kind of possible implementation, described the first data field is the data field of described the second hard disk groups; Described the second data field is the data field of described the first hard disk groups.
In conjunction with second aspect and above-mentioned any one possible implementation, in the possible implementation of another kind, described the first data field is the data field of the 3rd hard disk groups; Described the second data field is the data field of described the 3rd hard disk groups.
In conjunction with second aspect and above-mentioned any one possible implementation, in the possible implementation of another kind, described the first hard disk groups comprises log area and data field;
Wherein, the log area of described the first hard disk groups is for storing the data that read from described internal memory and the eigenwert of the described data that read from described internal memory; The data field of described the first hard disk groups is for storing the data that arrange from the log area of described the first hard disk groups;
Described the second hard disk groups comprises log area and data field;
Wherein, the log area of described the second hard disk groups is for storing the data that read from described internal memory and the eigenwert of the described data that read from described internal memory; The data field of described the second hard disk groups is for storing the data that arrange from the log area of described the second hard disk groups.
In conjunction with second aspect and above-mentioned any one possible implementation, in the possible implementation of another kind, described the first hard disk groups only comprises log area; Described the second hard disk groups only comprises log area; Described the 3rd hard disk groups only comprises data field;
Wherein, the log area of described the first hard disk groups is for storing the data that read from described internal memory and the eigenwert of the described data that read from described internal memory; The log area of described the second hard disk groups is for storing the data that read from described internal memory and the eigenwert of the described data that read from described internal memory; The data field of described the 3rd hard disk groups is for storing the data that arrange from the log area of described the first hard disk groups and the data that arrange from the log area of described the second hard disk groups.
The third aspect of the embodiment of the present invention, also provides a kind of data processing equipment, comprising:
Processor, if for the log space of the log area of described the first hard disk groups consumption higher than described predetermined threshold value, the eigenwert of the first data that read and described the first data is write to the log area of the second hard disk groups from internal memory, and suspend data preparation to the first data field writing in the log area of described the second hard disk groups, data in the described log area that has write described the second hard disk groups comprise described the first data, and the eigenwert of described the first data comprises the write address information of described the first data and the size information of described the first data; According to the eigenwert that writes the data in the log area of described the first hard disk groups, by data preparation to the second data field in the described log area that has write described the first hard disk groups, the data in the described log area that has write described the first hard disk groups are the data that read from described internal memory.
In conjunction with the third aspect, in a kind of possible implementation, described the first data field is the data field of described the second hard disk groups; Described the second data field is the data field of described the first hard disk groups.
In the third aspect and above-mentioned possible implementation, in the possible implementation of another kind, described the first data field is the data field of the 3rd hard disk groups; Described the second data field is the data field of described the 3rd hard disk groups.
In the third aspect and above-mentioned possible implementation, in the possible implementation of another kind, described the first hard disk groups comprises log area and data field;
Wherein, the log area of described the first hard disk groups is for storing the data that read from described internal memory and the eigenwert of the described data that read from described internal memory; The data field of described the first hard disk groups is for storing the data that arrange from the log area of described the first hard disk groups;
Described the second hard disk groups comprises log area and data field;
Wherein, the log area of described the second hard disk groups is for storing the data that read from described internal memory and the eigenwert of the described data that read from described internal memory; The data field of described the second hard disk groups is for storing the data that arrange from the log area of described the second hard disk groups.
In the third aspect and above-mentioned possible implementation, in the possible implementation of another kind, described the first hard disk groups only comprises log area; Described the second hard disk groups only comprises log area; Described the 3rd hard disk groups only comprises data field;
Wherein, the log area of described the first hard disk groups is for storing the data that read from described internal memory and the eigenwert of the described data that read from described internal memory; The log area of described the second hard disk groups is for storing the data that read from described internal memory and the eigenwert of the described data that read from described internal memory; The data field of described the 3rd hard disk groups is for storing the data that arrange from the log area of described the first hard disk groups and the data that arrange from the log area of described the second hard disk groups.
The data processing method that the embodiment of the present invention provides and device, if the log space of the log area of the first hard disk groups consumption higher than predetermined threshold value, the eigenwert of the first data that read and the first data is write to the log area of the second hard disk groups from internal memory, and suspend data preparation to the first data field writing in the log area of the second hard disk groups; According to the eigenwert that writes the data in the log area of the first hard disk groups, by data preparation to the second data field writing in the log area of the first hard disk groups, the data that write in the log area of the first hard disk groups are the data that read from described internal memory.With in prior art for all hard disks simultaneously executing datas write with data preparation and compare, pass through this programme, hard disk can be divided into groups, and by different hard disk groups respectively only executing data write or data preparation operates, having realized the pure of data writes continuously, can improve writing speed and data preparation speed simultaneously, improve the IOPS performance of data handling procedure, and then can realize quick and durableization of data.
Brief description of the drawings
In order to be illustrated more clearly in the embodiment of the present invention or technical scheme of the prior art, to the accompanying drawing of required use in embodiment or description of the Prior Art be briefly described below, apparently, accompanying drawing in the following describes is only some embodiments of the present invention, for those of ordinary skill in the art, do not paying under the prerequisite of creative work, can also obtain according to these accompanying drawings other accompanying drawing.
Fig. 1 is a kind of data processing method process flow diagram in the embodiment of the present invention 1;
Fig. 2 is a kind of data processing method process flow diagram in the embodiment of the present invention 2;
Fig. 3 is a kind of data processing method process flow diagram in the embodiment of the present invention 3;
Fig. 4 is the composition schematic diagram of a kind of data processing equipment in the embodiment of the present invention 4;
Fig. 5 is the composition schematic diagram of the another kind of data processing equipment in the embodiment of the present invention 4;
Fig. 6 is the composition schematic diagram of a kind of data handling system in the embodiment of the present invention;
Fig. 7 is the composition schematic diagram of the another kind of data handling system in the embodiment of the present invention;
Fig. 8 is a kind of data processing method schematic diagram in the embodiment of the present invention 2;
Fig. 9 is a kind of data processing method schematic diagram in the embodiment of the present invention 3.
Embodiment
Below in conjunction with the accompanying drawing in the embodiment of the present invention, the technical scheme in the embodiment of the present invention is clearly and completely described, obviously, described embodiment is only the present invention's part embodiment, instead of whole embodiment.Based on the embodiment in the present invention, those of ordinary skill in the art, not making the every other embodiment obtaining under creative work prerequisite, belong to the scope of protection of the invention.
In addition, term " system " and " network " are often used interchangeably in this article herein.Term "and/or" herein, is only a kind of incidence relation of describing affiliated partner, and expression can exist three kinds of relations, and for example, A and/or B, can represent: individualism A exists A and B, these three kinds of situations of individualism B simultaneously.In addition, character "/" herein, generally represents that forward-backward correlation is to liking a kind of relation of "or".
Embodiment 1
The embodiment of the present invention provides a kind of data processing method, as shown in Figure 1, comprising:
If the log space of the log area of S101 the first hard disk groups consumption higher than predetermined threshold value, data processing equipment writes the eigenwert of the first data that read from internal memory and the first data the log area of the second hard disk groups, and suspends data preparation to the first data field writing in the log area of the second hard disk groups.
Wherein, the data that write in the log area of the second hard disk groups comprise the first data.
It should be noted that, the data processing equipment in the embodiment of the present invention can be data control module or the data processing module in database, writing and reading for the data of controlling database.For example, Data Control module can be the central processing unit (Central Processing Unit, CPU) of computing machine.
Concrete, the internal memory in the embodiment of the present invention can comprise the first internal storage location and the second internal storage location.Data processing equipment can read the eigenwert of the first data and the first data in the first internal storage location from internal memory, and the eigenwert of the first data that read from the first internal storage location and the first data is write to the log area of the second hard disk groups.
Exemplary, in a kind of application scenarios of the embodiment of the present invention, the first internal storage location can comprise at least one nonvolatile memory (Non-Volatile Memory, NVM); The second internal storage location can comprise at least one dynamic RAM (Dynamic Random Access Memory, DRAM).Wherein, the storage speed of NVM and the number of times (Input/Output Operations Per Second, IOPS) that carries out read-write operation per second are greater than common hard disc, support power-off protection.DRAM is a kind of volatile memory, is a kind of internal memory of not supporting power-off protection, and the storage speed of DRAM and IOPS are much larger than common hard disc, a little more than NVM).
It should be noted that, the first data in the first internal storage location are that data processing equipment writes order according to data and writes the first internal storage location.
Concrete, data processing equipment can write after order in the data that receive the eigenwert that comprises data to be written and described data to be written, performs step one and step 2 simultaneously.Wherein, step 1: data to be written are write to the second internal storage location (DRAM) according to the write address information of the data to be written that comprise in the eigenwert of data to be written; Step 2: the eigenwert of data to be written and data to be written is write to the first internal storage location (NVM).
Wherein, on the one hand because the storage speed of DRAM and IOPS are much larger than common hard disc, and a little more than NVM, and data processing equipment writes after order receiving data, data are write to the data that order comprises and write the second internal storage location, therefore, data processing equipment is receiving after data read command, can directly from the second internal storage location, read corresponding data, can improve data reading speed.On the other hand because NVM is a kind of internal memory of supporting power-off protection; and storage speed and the IOPS of NVM are greater than common hard disc; therefore; data processing equipment writes after order receiving data; data are write to the data that order comprises and write the first internal storage location; then the data that write the first internal storage location are write to hard drive space one by one, can improve the writing speed of data.The data in the first internal storage location are used for writing hard disk groups (the first hard disk groups and the second hard disk groups), and the data in the second internal storage location, for providing data read command to require the data that read, have realized the separation of reading and writing data.
Concrete, before data processing equipment reads the eigenwert of data to be written and data to be written from the first internal storage location, the method for the embodiment of the present invention can also comprise: data processing equipment will extremely at least two hard disk groups of at least two hard disk partition.
It should be noted that, described hard disk groups is divided and can be comprised that at least one writes data disks group (Disk Group for Write according to function, and read data dish group (Disk Group for Read DGW), DGR), described DGW is for receiving the data that write from described the first internal storage location, and described DGR is for accepting the arrangement of the hard disk groups data to writing described DGR function.
And, in order to prevent, because hard disk corruptions causes loss of data, can comprising at least two hard disks in each hard disk groups, every two hard disks mirror image hard disk each other.
Concrete, in the first application scenarios of the embodiment of the present invention, data processing equipment can be by least two hard disk partition to two hard disk groups in hard drive space: the first hard disk groups and the second hard disk groups.
Wherein, in this application scenarios, the first hard disk groups comprises log area and data field, and the first hard disk groups comprises at least one hard disk; The second hard disk groups comprises log area and data field, and the second hard disk groups comprises at least one hard disk.
Further alternative, in the first hard disk groups, can comprise at least two hard disks, every two hard disks mirror image hard disk each other; In the second hard disk groups, can comprise at least two hard disks, every two hard disks mirror image hard disk each other.
In the second application scenarios of the embodiment of the present invention, data processing equipment can be by least three hard disk partition to three hard disk groups in hard drive space: the first hard disk groups, the second hard disk groups and the 3rd hard disk groups.
Wherein, in the second application scenarios, the first hard disk groups only comprises log area, and the second hard disk groups only comprises log area, and the 3rd hard disk groups only comprises data field.The first hard disk groups comprises at least one hard disk, and the second hard disk groups comprises at least one hard disk, and the 3rd hard disk groups comprises at least one hard disk.
Further alternative, in the first hard disk groups, can comprise at least two hard disks, every two hard disks mirror image hard disk each other; In the second hard disk groups, can comprise at least two hard disks, every two hard disks mirror image hard disk each other; In the 3rd hard disk groups, can comprise at least two hard disks, every two hard disks mirror image hard disk each other.
It should be noted that, in the time that data processing equipment judgement obtains the log space of log area of the first hard disk groups consumption is higher than predetermined threshold value, can be by the eigenwert of the first data that read from the first internal storage location and the first data, write the log area of the second hard disk groups, and suspend data preparation to the first data field writing in the log area of the second hard disk groups.Now, data processing equipment does not arrange the data that write in the log area of the second hard disk groups, but only carry out for the first hard disk groups: according to the eigenwert that writes the data in the log area of the first hard disk groups, by data preparation to the second data field writing in the log area of the first hard disk groups.
Wherein, the first data are data or the one group of data in data to be written, and to be data processing equipment write after order receiving data data to be written, is written to the data in internal memory (being specially the first internal storage location in internal memory).
It should be noted that, in the first application scenarios of the embodiment of the present invention, the first data field is the data field of the second hard disk groups.
In the second application scenarios of the embodiment of the present invention, the first data field is the data field of the 3rd hard disk groups.
Concrete, the eigenwert of the first data comprises: the write address information of the first data and the size information of the first data.
S102, data processing equipment are according to the eigenwert that has write the data in the log area of the first hard disk groups, by data preparation to the second data field writing in the log area of the first hard disk groups, the data that write in the log area of the first hard disk groups are to state the data that read in internal memory.
Accordingly, in embodiments of the present invention, data processing equipment can be at the log space of the log area of the first hard disk groups consumption during higher than predetermined threshold value, according to the eigenwert that writes the data in the log area of the first hard disk groups, by data preparation to the second data field writing in the log area of the first hard disk groups.Now, data processing equipment is only carried out for the first hard disk groups: by data preparation to the second data field writing in the log area of the first hard disk groups.
It should be noted that, in the first application scenarios of the embodiment of the present invention, the second data field is the data field of the first hard disk groups.
In the second application scenarios of the embodiment of the present invention, the second data field is the data field of the 3rd hard disk groups.
The data processing method that the embodiment of the present invention provides, if the log space of the log area of the first hard disk groups consumption higher than predetermined threshold value, the eigenwert of the first data that read and the first data is write to the log area of the second hard disk groups from internal memory, and suspend data preparation to the first data field writing in the log area of the second hard disk groups; According to the eigenwert that writes the data in the log area of the first hard disk groups, by data preparation to the second data field writing in the log area of the first hard disk groups, the data that write in the log area of the first hard disk groups are the data that read from described internal memory.With in prior art for all hard disks simultaneously executing datas write with data preparation and compare, pass through this programme, hard disk can be divided into groups, and by different hard disk groups respectively only executing data write or data preparation operates, having realized the pure of data writes continuously, can improve writing speed and data preparation speed simultaneously, improve the IOPS performance of data handling procedure, and then can realize quick and durableization of data.
Embodiment 2
The embodiment of the present invention provides a kind of data processing method, carrying out respectively daily record taking two hard disk groups (data field of the first hard disk groups and the second hard disk groups) writes with data preparation as example, in the present embodiment, as shown in Figure 6, the first hard disk groups comprises log area and data field, and the second hard disk groups comprises log area and data field; The first data field is the data field of the second hard disk groups, and the second data field is the data field of the first hard disk groups; As shown in Figure 2, the method for the present embodiment can comprise:
S201, data processing equipment are by the flow process of data write memory to be written.
It should be noted that, the internal memory in the embodiment of the present invention can comprise: the first internal storage location and the second internal storage location.Wherein, the specific descriptions of the first internal storage location and the second internal storage location can be with reference to the related content in the embodiment of the present invention 1, and the present embodiment repeats no more here.
Exemplary, the first internal storage location in the embodiment of the present invention can be made up of at least one NVM, and the second internal storage location can be by least one DRAM.
Concrete, S201 can comprise: S201a-S201c:
S201a, data processing equipment receive data and write order.
Wherein, data write the eigenwert that comprises data to be written and data to be written in order, and the eigenwert of data to be written comprises: the size information of the write address information of data to be written and data to be written.
Data processing equipment can receive from read-write (Input/Ouput, I/O) data of interface write order, and data write order and are used to indicate data processing equipment: the indicated corresponding position of hard disk of write address information that these data is write to the data to be written that comprise in order and write these data to be written.
S201b, data processing equipment write after order receiving data, data are write to the data to be written that comprise in order and write the second internal storage location.
Wherein, the second internal storage location in the embodiment of the present invention is DRAM, and the first internal storage location is NVM.Because DRAM is a kind of volatile memory, be a kind of internal memory of not supporting power-off protection, the storage speed of DRAM and IOPS are much larger than common hard disc, a little more than NVM.Therefore, receiving after data read command in order to improve data processing equipment, the speed of reading out data, data processing equipment can write after order receiving data, according to the writing position information of data to be written, data are write to the data to be written that comprise in order and write the second internal storage location, so that data processing equipment is receiving after data read command, can directly from the second internal storage location, read corresponding data, improve data reading speed.
It should be noted that, the writing position information of data to be written is specifically as follows the piece number of data to be written.The writing position information that is the first data in the embodiment of the present invention can be the piece number of the first data; The writing position information of the second data can be the piece number of the second data.
The eigenwert of data to be written and data to be written is write the first internal storage location by S201c, data processing equipment.
Wherein, after the eigenwert of data to be written and data to be written is write the first internal storage location by data processing equipment, in the embodiment of the present invention, the data to be written that data processing equipment reads from the first internal storage location can be called the first data, the second data and the 3rd data etc., and the first data and the second data are data or the one group of data in data to be written.
Concrete, the data in the first internal storage location are used for writing hard disk groups, and the data in the second internal storage location, for providing data read command to require the data that read, have realized the separation of reading and writing data.
It should be noted that, the data that data processing equipment writes the second internal storage location only comprise data to be written, and data processing equipment writes the packet of the first internal storage location containing data to be written and the eigenwert (the write address information of the size information of data to be written and data to be written) of data to be written.
It should be noted that, after carrying out S201a, the embodiment of the present invention does not limit the sequencing of S201b and S201c execution.Can first carry out in embodiments of the present invention S201b, then carry out S201c; Also can first carry out S201c, then carry out S201b; Can also carry out S201b and S201c simultaneously.
S202, data processing equipment carry out hard disk grouping and the initialized flow process of hard disk groups function.
S202a, data processing equipment are by least two hard disk partition to the first hard disk groups in hard drive space and the second hard disk groups.
Wherein, in the first hard disk groups, comprise at least one hard disk; In the second hard disk groups, comprise at least one hard disk.
Hard disk groups is divided and can be comprised the hard disk groups of DGW function and the hard disk groups of described DGR function described at least one according to function, the hard disk groups of DGW function is for receiving the data that write from described the first internal storage location, and the hard disk groups of DGR function is used for the arrangement of the data of accepting the hard disk groups to writing described DGR function.
Further alternative, in order to prevent, because hard disk corruptions causes loss of data, can comprising at least two hard disks in each hard disk groups, every two hard disks mirror image hard disk each other.Concrete, the first hard disk groups comprises at least two hard disks, two hard disks mirror image hard disk each other in described the first hard disk groups; Described the second hard disk groups comprises at least two hard disks, two hard disks mirror image hard disk each other in described the second hard disk groups.
Wherein, in the time carrying out the initialization of hard disk groups function, data processing equipment can determine that the first hard disk groups is the hard disk groups of DGW function, determines that the second hard disk groups is the hard disk groups of DGR function.Concrete, S202 comprises S202b:
S202b, data processing equipment read the eigenwert of the 3rd data and the 3rd data from the first internal storage location.
Wherein, the first data in the 3rd data and the embodiment of the present invention and the second data class seemingly, are data or one group of data in the data to be written that write in the first internal storage location.Data processing equipment can write according to data to be written the sequencing of the first internal storage location, successively reading out data from the first internal storage location.
It should be noted that, in the embodiment of the present invention data processing equipment by multiple hard disk partition to different hard disk groups, and while determining the function of each hard disk groups, must ensure to comprise in above-mentioned at least two hard disk groups a DGW.
Exemplary, if comprise 4 hard disks in data processing equipment specified data disposal system, data processing equipment can be two hard disk groups by four hard disk partition of person, in each hard disk groups, comprise 2 hard disks, one of them hard disk groups can be used as the hard disk groups of DGW function, another hard disk groups can be used as the hard disk groups of DGR function, and (log space of the log area of the hard disk groups of current DGW function is when consumption is higher than predetermined threshold value, these two hard disk groups can be switched the function of its hard disk groups, it is the hard disk groups that the hard disk groups of current DGW function switches to DGR function, the hard disk groups of current DGR function switches to the hard disk groups of DGW function).Now, the first hard disk groups can be the hard disk groups of DGW function, and the second hard disk groups can be the hard disk groups R of DG function, and the first hard disk groups and the second hard disk groups can be respectively a hard disk groups.
Certainly, the hard disk comprising in the first hard disk groups and the second hard disk groups also can be different, if comprise 8 hard disks in data processing equipment specified data disposal system, can comprise 3 hard disks in the first hard disk groups, can comprise 5 hard disks in the second hard disk groups.
Wherein, data processing equipment can be write by Random data processing device the speed of data and data processing equipment and arrange the speed of the data of the log area that has write hard disk groups to the log area of hard disk groups, and the speed of the speed of writing data obtaining according to statistics and disposal data is determined respectively the number of hard disk in the hard disk groups of DGW function and the hard disk groups of DGR function.Data processing equipment determines that the concrete grammar of the number of hard disk in the hard disk groups of DGW function and the hard disk groups of DGR function can be with reference to associated description of the prior art, and the embodiment of the present invention repeats no more here.
Wherein, because the log area of the first hard disk groups and the log area of the second hard disk groups are in the time carrying out hard disk groups initialization, may also not write any data, therefore, tentation data treating apparatus determines that the first hard disk groups is the hard disk groups of DGW function, after the second hard disk groups is the hard disk groups of DGR function, can first the eigenwert of the second data that read and the second data be write to the log area of the first hard disk groups, S202 also comprises S202c:
S202c, data processing equipment write the eigenwert of the 3rd data and the 3rd data the log area of the first hard disk groups.
Concrete, because data processing equipment is in the time that function initialization arranges, hard disk groups using the first hard disk groups as DGW function, hard disk groups using the second hard disk groups as DGR function, therefore, data processing equipment, read the eigenwert of the second data and the second data from the first internal storage location after, can write the eigenwert of the 3rd data that read and the 3rd data the log area of the first hard disk groups.Now, data processing equipment does not arrange the data of the log area that has write the first hard disk groups, only writing of data is carried out in the log area of the first hard disk groups, the pure writing speed that can improve data that writes of data.
Below for data processing equipment, the data in internal memory (the first internal storage location) are write to the log area of hard disk groups, and arrange the flow process of the first data in the log area that has write hard disk groups.
S203, data processing equipment read the eigenwert of the first data and the first data from the first internal storage location.
Wherein, because the first data that write in the first internal storage location NVM are for being stored to hard disk groups, therefore, data processing equipment, after hard disk groups is carried out function initialization, can read the first data from the first internal storage location.
S204, data processing equipment judge the first hard disk groups log area log space consumption whether higher than predetermined threshold value.
Wherein, due to data processing equipment carry out: after the eigenwert of the 3rd data and the 3rd data is write to the log area of the first hard disk groups, the data volume of the first data that write in the log area of the first hard disk groups may exceed certain threshold value, and now in the log area of the second hard disk groups, also do not write any data, if now continue the data that read to write the log area of the first hard disk groups, may cause the memory space inadequate in the log area of the first hard disk groups, can not continue data writing, cause writing of data normally to carry out, therefore, data processing equipment can real-time judge the first hard disk groups log area log space consumption whether higher than predetermined threshold value, and at the log space of the log area of the first hard disk groups when consumption is higher than predetermined threshold value, the first hard disk groups and the second hard disk groups are carried out to function switching, determine that the first hard disk groups is the hard disk groups of DGR function, determine that the second hard disk groups is the hard disk groups of DGW function.Carry out S205-S206:
Concrete, if the log space of the log area of the first hard disk groups consumption higher than predetermined threshold value, carry out S205-S206; If the log space of the log area of the first hard disk groups consumption not higher than predetermined threshold value, data processing equipment can continue the eigenwert of the first data that read and the first data to write the log area of the first hard disk groups, carries out and the similar step of S202c: data processing equipment writes the eigenwert of the first data and the first data the log area of the first hard disk groups.
S205, data processing equipment write the eigenwert of the first data and the first data the log area of the second hard disk groups.
It should be noted that, owing to not comprising any other data in the log area of the second hard disk groups under current state except the eigenwert of the first data of just having write and the first data, therefore data processing equipment does not arrange writing data in the log area of the second hard disk groups.
S206, data processing equipment be according to the eigenwert that has write the data in the log area of the first hard disk groups, will write the data field of data preparation to the first hard disk groups in the log area of the first hard disk groups.
Wherein, the data that write in the log area of the first hard disk groups comprise the 3rd data.
It should be noted that, when the log space of the log area of the first hard disk groups consumption is higher than predetermined threshold value, after the first hard disk groups and the second hard disk groups are carried out to the switching of hard disk groups function, data processing equipment needs to suspend the data that read (as the first data) is write to the log area of the first hard disk groups, only the first hard disk groups is carried out: will write the data field of data preparation to the first hard disk groups in the log area of the first hard disk groups; And, owing to not comprising any other data in the log area of the second hard disk groups under current state except the eigenwert of the first data of just having write and the first data, data processing equipment does not arrange writing data in the log area of the second hard disk groups, only in the log area of the second hard disk groups, writes the first data.Therefore, can realize separating that data preparation writes with data, improve the speed that data preparation and data write simultaneously.
S207, data processing equipment read the eigenwert of the second data and the second data from the first internal storage location.
S208, data processing equipment judge the second hard disk groups log area log space consumption whether higher than predetermined threshold value.
Concrete, if the log space of the log area of the second hard disk groups consumption, higher than predetermined threshold value, is carried out S209-S210, the first hard disk groups and the second hard disk groups are carried out to function switching, determine that the first hard disk groups is the hard disk groups of DGW function, determine that the second hard disk groups is the hard disk groups of DGR function; If the log space of the log area of the first hard disk groups consumption not higher than predetermined threshold value, data processing equipment can continue the eigenwert of the second data that read and the second data to write the log area of the second hard disk groups, carries out and the similar step of S205: data processing equipment writes the eigenwert of the second data and the second data the log area of the second hard disk groups.
S209, data processing equipment write the eigenwert of the second data and the second data the log area of the first hard disk groups, and suspend and will write the data field of data preparation to the first hard disk groups in the log area of the first hard disk groups, the data that write in the log area of the first hard disk groups comprise the second data and unfinished the 3rd data.
S210, data processing equipment be according to the eigenwert that has write the data in the log area of the second hard disk groups, will write the data field of data preparation to the second hard disk groups in the log area of the second hard disk groups.
Wherein, the data that write in the log area of the second hard disk groups are the data that read in the first internal storage location, have write the first data of the second hard disk groups.
S211, data processing equipment read the eigenwert of the 4th data and the 4th data from the first internal storage location.
S212, data processing equipment judge the first hard disk groups log area log space consumption whether higher than predetermined threshold value.
Concrete, if the log space of the log area of the first hard disk groups consumption, higher than predetermined threshold value, is carried out S213-S214, the first hard disk groups and the second hard disk groups are carried out to function switching, determine that the second hard disk groups is the hard disk groups of DGW function, determine that the first hard disk groups is the hard disk groups of DGR function; If the log space of the log area of the first hard disk groups consumption not higher than predetermined threshold value, data processing equipment can continue the eigenwert of the 4th data that read and the 4th data to write the log area of the first hard disk groups, carries out and the similar step of S209: data processing equipment writes the eigenwert of the 4th data and the 4th data the log area of the first hard disk groups.
S213, data processing equipment write the eigenwert of the 4th data and the 4th data the log area of the second hard disk groups, and suspend and will write the data field of data preparation to the second hard disk groups in the log area of the second hard disk groups.
S214, data processing equipment be according to the eigenwert that has write the data in the log area of the first hard disk groups, will write the data field of data preparation to the first hard disk groups in the log area of the first hard disk groups.
Further alternative, in order to reduce after system cut-off, in the first internal storage location, do not write the loss of the data in hard disk groups, data processing equipment can detect after cut-offing instruction, and all the first data in the first internal storage location are write to DGW(the first hard disk groups or the second hard disk groups) log area.The method of the embodiment of the present invention can also comprise S215:
S215, data processing equipment are carried out before power-off, the first data in the first internal storage location are write to the flow process of the hard disk groups log area of DGW function.
Concrete, data processing equipment is carried out before power-off, and the flow process that the first data in the first internal storage location is write to the hard disk groups log area of DGW function can comprise: S215a and S215b or S215a and S215c:
S215a, data processing equipment detect cut-offing instruction.
Wherein, data processing equipment is detecting after cut-offing instruction, in order to prevent the loss of the data in the first internal storage location after power-off, can from the first internal storage location, read successively all the first data in the first internal storage location, and the first data that read be write to the hard disk groups log area of DGW function.
When the first hard disk groups is the hard disk groups of DGW function, when the second hard disk groups is the hard disk groups of DGR function, data processing equipment is carried out before power-off, and the flow process that the first data in the first internal storage location is write to the hard disk groups log area of DGW function can comprise: S215a and S215b:
S215b, data processing equipment are detecting after cut-offing instruction, according to the sequencing that writes of the first data in the first internal storage location, from the first internal storage location, read successively all data in the first internal storage location, and the data that read are write to the log area of the first hard disk groups.
When the second hard disk groups is the hard disk groups of DGW function, when the first hard disk groups is the hard disk groups of DGR function, data processing equipment is carried out before power-off, and the flow process that the first data in the first internal storage location is write to the hard disk groups log area of DGW function can comprise S215a and S215c:
S215c, data processing equipment are detecting after cut-offing instruction, according to the sequencing that writes of the first data in the first internal storage location, from the first internal storage location, read successively all data in the first internal storage location, and the data that read are write to the log area of the second hard disk groups.
Further, because the second internal storage location is that DRAM is the random memory device of volatibility, DRAM is the internal memory of not supporting power-off protection.Therefore, after system cut-off, if power on load instructions described in detecting, and re-powering after loading data, is to store any data in the second internal storage location.Now, if receive after described data read command, data processing equipment need to read corresponding data and then return to the data that read from hard disk groups, the reading speed of data is lower, therefore, in order to improve the reading speed of data, data processing equipment is detecting that the load instructions that powers on can write the second internal storage location by the data that comprise in the data field of the data that comprise in the data field of the first hard disk groups and the second hard disk groups.Concrete, the method for the embodiment of the present invention can also comprise:
S216, data processing equipment are carried out the Data Recovery Process after powering on.
Wherein, S216 specifically can comprise S216a, S216b, S216c and S216d:
S216a, data processing equipment detect the load instructions that powers on.
S216b, data processing equipment power on after load instructions detecting, according to the eigenwert that writes the data in the log area of the second hard disk groups, will write the data field of data preparation to the second hard disk groups in the log area of the second hard disk groups.
S216c, data processing equipment power on after load instructions detecting, according to the eigenwert that writes the data in the log area of the first hard disk groups, will write the data field of data preparation to the first hard disk groups in the log area of the first hard disk groups.
The data that comprise in the data field of the data that comprise in the data field of the first hard disk groups and the second hard disk groups are write the second internal storage location by S216d, data processing equipment.
Further alternative, if described in the load instructions that powers on be specially the load instructions that powers on after abnormal power-down, after the load instructions that powers on being detected, before the data that arrange in the log area that has write the data in the log area of the first hard disk groups and write the second hard disk groups, the method of the embodiment of the present invention can also comprise: according to the sequencing that writes of the first data described in described the first internal storage location, from the first internal storage location, read successively all data in the first internal storage location, and the first data that read are write to the log area of the first hard disk groups and the log area of the second hard disk groups.
Further, because data processing equipment in S202 writes after order receiving data, data can be write to the data to be written that comprise in order and write the second internal storage location; Therefore, data processing equipment is receiving after described data read command, can directly read described data to be read from the second internal storage location, and need to be from hard disk groups not reading out data, the reading speed of data is very fast, and can reduce the access times to hard disk groups.The method of the embodiment of the present invention can also comprise S217:
S217, data processing equipment read the flow process of data to be read from the second internal storage location.
Wherein, S217 specifically can comprise S217a and S217b:
S217a, data processing equipment receive data read command, and described data write the mark that comprises data to be read in order.
S217b, data processing equipment, receiving after described data read command, read data to be read according to the mark of data to be read from the second internal storage location.
It should be noted that, because data processing equipment is in two flow processs that hocket: 1) to the log area data writing of the first hard disk groups; Arrange the data that write in the log area of the second hard disk groups, and reduced data is write to the data field of the second hard disk groups; 2) to the log area data writing of the second hard disk groups; Arrange the data that write in the log area of the first hard disk groups, and reduced data is write to the data field of the first hard disk groups.Then detecting while powering on load instructions, data processing equipment can write the second internal storage location by the data of storing in the data field of the data of storing in the data field of the first hard disk groups and the second hard disk groups, so that data processing equipment can directly read corresponding data from the second internal storage location according to data reading command, realize the separation of reading and writing data, improve data reading speed.
But, the problem existing is: respectively the data of storing in the data field of the data of storing in the data field of the first hard disk groups and the second hard disk groups are write to the second internal storage location, may there is the repetition of the data of storing in the data field of the data of storing in the data field of the first hard disk groups and the second hard disk groups, and data processing equipment can not judge that the data of storing in the data field of which hard disk groups are up-to-date data, therefore, data processing equipment can be in the time writing the log area of the first hard disk groups by the data that read, the version information of specified data, then when writing the data field of data preparation to the first hard disk groups in the log area of the first hard disk groups, upgrade the version information arranging to the data in the data field of the first hard disk groups, in the time that the data that read are write to the log area of the second hard disk groups, the version information of specified data, then when writing the data field of data preparation to the second hard disk groups in the log area of the second hard disk groups, upgrade the version information arranging to the data in the data field of the second hard disk groups.Wherein, data processing equipment can be according to the version information of the write address information specified data of data.
Exemplary, if the version information of the current data that write in the corresponding hard disk of write address information a address of data a to be written is version 2, the version information of the current data that write in the corresponding hard disk of data b write address information b address to be written is version 8; In the time comprising the write address information b of the write address information a of data a to be written, data a to be written and data b to be written, data b to be written in the first data that data processing equipment receives, data processing equipment can be determined and will write the data of write address information a (data to be written version information a) is version 3; Determine and will write the data of write address information b (data to be written version information b) is version 9.
For example, in the embodiment of the present invention, carry out taking data processing equipment: step a and step b are example, illustrate that data processing equipment is concrete to carry out pure data and write and the process of data preparation.Wherein step a is: the eigenwert of the data that read and data is write to the log area of the second hard disk groups from internal memory (the first internal storage location), and suspend and will write the data field of data preparation to the second hard disk groups in the log area of the second hard disk groups; Step b is: according to the eigenwert that writes the data in the log area of the first hard disk groups, will write the data field of data preparation to the first hard disk groups in the log area of the first hard disk groups.
As shown in Figure 8, adopt in this example lowercase alphabet registration according to itself, adopt the write address information (as, the piece number of data) of common Arabic data representation data, adopt the version information of the Arabic data representation data of runic.For example, the piece of the data d of the write request in processing number is 9, the piece number of data b be 2 and the piece number of data c be 8 etc.; The piece of data h in the data field of the second hard disk groups number is 11, and version information is 7, and this version information represents that data h writes hard disk the 7th time.Wherein.The version information of data is used for representing that these data write the hard drive space total degree of (comprising the second hard disk groups and the first hard disk groups).
As shown in Figure 8, data processing equipment can be according to the piece number that writes the data in the log area of the first hard disk groups, these data is write in the data field of the first hard disk groups in relevant block number corresponding address.As, the piece number that has write the data r in the log area of the first hard disk groups is 4, and determine that its version information is 3, data processing equipment can be 4 address space by writing data r in the log area of the first hard disk groups and write piece number in the data field of the first hard disk groups, and its version information is updated to 3; The piece number that has write the data p in the log area of the first hard disk groups is 2, and determine that its version information is 8, data processing equipment can be 2 address space by writing data p in the log area of the first hard disk groups and write piece number in the data field of the first hard disk groups, and its version information is updated to 8.Wherein, in the time that the version information of data is greater than 1, in the piece of these data number corresponding address space, be not data writing for the first time, data processing equipment can adopt the data of having stored in the piece number corresponding address space of these data in the data field of this data replacement the first hard disk groups.
The data processing method that the embodiment of the present invention provides, if the log space of the log area of the first hard disk groups consumption higher than predetermined threshold value, data processing equipment writes the eigenwert of the first data that read from internal memory and the first data the log area of the second hard disk groups, and suspends data preparation to the first data field writing in the log area of the second hard disk groups; According to the eigenwert that writes the data in the log area of the first hard disk groups, by data preparation to the second data field writing in the log area of the first hard disk groups, the data that write in the log area of the first hard disk groups are the data that read from described internal memory.With in prior art for all hard disks simultaneously executing datas write with data preparation and compare, pass through this programme, hard disk can be divided into groups, and by different hard disk groups respectively only executing data write or data preparation operates, having realized the pure of data writes continuously, can improve writing speed and data preparation speed simultaneously, improve the IOPS performance of data handling procedure, and then can realize quick and durableization of data.
Embodiment 3
The embodiment of the present invention provides a kind of data processing method, carry out respectively with two hard disk groups (the first hard disk groups and the second hard disk groups) that daily record is write and data preparation, another hard disk groups (the 3rd hard disk groups) storage arranges from above-mentioned two hard disk groups the data instance obtaining, in embodiments of the present invention, as shown in Figure 7, the first hard disk groups only comprises log area, and the second hard disk groups only comprises log area; The first data field and the second data field are the data field of the 3rd hard disk groups; As shown in Figure 3, the method for the present embodiment can comprise:
S301, data processing equipment are by the flow process of data write memory to be written.
It should be noted that, the internal memory in the embodiment of the present invention can comprise: the first internal storage location (as NVM) and the second internal storage location (as DRAM).Wherein, the specific descriptions of the first internal storage location and the second internal storage location can be with reference to the related content in the embodiment of the present invention 1, and the present embodiment repeats no more here.
Concrete, S301 can comprise: S301a-S301c:
S301a, data processing equipment receive data and write order.
Wherein, data write the eigenwert that comprises data to be written and data to be written in order, and the eigenwert of data to be written comprises: the size information of the write address information of data to be written and data to be written.
Data processing equipment can receive from the data of I/O interface and write order, and data write order and be used to indicate data processing equipment these data are write to the data to be written that comprise in order and write the indicated corresponding position of hard disk of write address information of the data to be written in the eigenwert that these data write the data to be written that comprise in order.
S301b, data processing equipment write after order receiving data, data are write to the data to be written that comprise in order and write the second internal storage location.
Wherein, the second internal storage location in the embodiment of the present invention is DRAM, and the first internal storage location is NVM.Because DRAM is a kind of volatile memory, be a kind of internal memory of not supporting power-off protection, the storage speed of DRAM and IOPS are much larger than common hard disc, a little more than NVM.Therefore, receiving after data read command in order to improve data processing equipment, the speed of reading out data, data processing equipment can write after order receiving data, according to the writing position information of data to be written, data are write to the data to be written that comprise in order and write the second internal storage location, so that data processing equipment is receiving after data read command, can directly from the second internal storage location, read corresponding data, improve data reading speed.
It should be noted that, the writing position information of data to be written is specifically as follows the piece number of data to be written.The writing position information that is the first data in the embodiment of the present invention can be the piece number of the first data; The writing position information of the second data can be the piece number of the second data.
The eigenwert of data to be written and data to be written is write the first internal storage location by S301c, data processing equipment.
Wherein, after the eigenwert of data to be written and data to be written is write the first internal storage location by data processing equipment, in the embodiment of the present invention, the data to be written that data processing equipment reads from the first internal storage location can be called the first data, the second data and the 3rd data etc., and the first data and the second data are data or the one group of data in data to be written.
Concrete, the data in the first internal storage location are used for writing hard disk groups, and the data in the second internal storage location, for providing data read command to require the data that read, have realized the separation of reading and writing data.
It should be noted that, the data that data processing equipment writes the second internal storage location only comprise data to be written, and data processing equipment writes the packet of the first internal storage location containing data to be written and the eigenwert (the write address information of the size information of data to be written and data to be written) of data to be written.
It should be noted that, after carrying out S301a, the embodiment of the present invention does not limit the sequencing of S301b and S301c execution.Can first carry out in embodiments of the present invention S301b, then carry out S301c; Also can first carry out S301c, then carry out S301b; Can also carry out S301b and S301c simultaneously.
S302, data processing equipment carry out hard disk grouping and the initialized flow process of hard disk groups function.
Concrete, S302 specifically can comprise S303a-S303b:
S302a, data processing equipment are by least three hard disk partition to the first hard disk groups in hard drive space, the second hard disk groups and the 3rd hard disk groups.
Wherein, in the first hard disk groups, comprise at least one hard disk; In the second hard disk groups, comprise at least one hard disk; In the 3rd hard disk groups, comprise at least one hard disk.
Hard disk groups is divided and can be comprised that the hard disk groups of the hard disk groups of a DGW function, a DGR function and one are for storing the hard disk groups that arranges the data that obtain from above-mentioned two hard disk groups according to function, described DGW is for receiving the data that write from described the first internal storage location, and described DGR is for accepting the arrangement of the hard disk groups data to writing DGR function.
Further alternative, in order to prevent, because hard disk corruptions causes loss of data, can comprising at least two hard disks in each hard disk groups, every two hard disks mirror image hard disk each other.Concrete, the first hard disk groups comprises at least two hard disks, two hard disks mirror image hard disk each other in described the first hard disk groups; Described the second hard disk groups comprises at least two hard disks, two hard disks mirror image hard disk each other in described the second hard disk groups; Described the 3rd hard disk groups comprises at least two hard disks, two hard disks mirror image hard disk each other in described the 3rd hard disk groups.
S302b, data processing equipment read the eigenwert of the 3rd data and the 3rd data from the first internal storage location.
Wherein, the first data in the 3rd data and the embodiment of the present invention and the second data class seemingly, are data or one group of data in the data to be written that write in the first internal storage location.Data processing equipment can write according to data to be written the sequencing of the first internal storage location, successively reading out data from the first internal storage location.
Wherein, described log area is for storing described the first data that read from described the first internal storage location.
Exemplary, if comprise 6 hard disks in data processing equipment specified data disposal system, data processing equipment can be 3 hard disk groups by 6 hard disk partition of person, in each hard disk groups, comprise 2 hard disks, one of them hard disk groups can be used as DGW, another hard disk groups can be used as the hard disk groups of DGR function, and (log space of the log area of the hard disk groups of current DGW function is when consumption is higher than predetermined threshold value, these two hard disk groups can be switched the function of its hard disk groups, it is the hard disk groups that the hard disk groups of current DGW function switches to DGR function, the hard disk groups of current DGR function switches to the hard disk groups of DGW function), the 3rd hard disk groups can be used as the hard disk groups that comprises data field.Now, the first hard disk groups can be the hard disk groups of DGW function, and the second hard disk groups can be the hard disk groups of DGR function, and the 3rd hard disk groups can comprise the hard disk groups of data field.
Certainly, the hard disk comprising in the first hard disk groups, the second hard disk groups and the 3rd hard disk groups also can be different, if comprise 9 hard disks in data processing equipment specified data disposal system, in the first hard disk groups, can comprise 2 hard disks, in the second hard disk groups, can comprise 3 hard disks, and can comprise 4 hard disks in the 3rd hard disk groups.
Wherein, data processing equipment can be write by Random data processing device the speed of data and data processing equipment and arrange the speed of the data of the log area that has write hard disk groups to the log area of hard disk groups, and the speed of the speed of writing data obtaining according to statistics and disposal data is determined respectively the number of hard disk in the hard disk groups of DGW function and the hard disk groups of DGR function.Data processing equipment determines that the concrete grammar of the number of hard disk in the hard disk groups of DGW function and the hard disk groups of DGR function can be with reference to associated description of the prior art, and the embodiment of the present invention repeats no more here.
Wherein, because the log area of the first hard disk groups and the log area of the second hard disk groups are in the time carrying out hard disk groups initialization, may also not write any data, therefore, tentation data treating apparatus determines that the first hard disk groups is the hard disk groups of DGW function, after the second hard disk groups is the hard disk groups of DGR function, can first the eigenwert of the second data that read and the second data be write to the log area of the first hard disk groups, S302 also comprises S302c:
S302c, data processing equipment write the eigenwert of the 3rd data and the 3rd data the log area of the first hard disk groups.
Concrete, because data processing equipment is in the time that function initialization arranges, hard disk groups using the first hard disk groups as DGW function, hard disk groups using the second hard disk groups as DGR function, therefore, data processing equipment, read the eigenwert of the second data and the second data from the first internal storage location after, can write the eigenwert of the 3rd data that read and the 3rd data the log area of the first hard disk groups.Now, data processing equipment does not arrange the data of the log area that has write the first hard disk groups, only writing of data is carried out in the log area of the first hard disk groups, the pure writing speed that can improve data that writes of data.
Below for data processing equipment, the data in internal memory (the first internal storage location) are write to the log area of hard disk groups, and arrange the flow process of the first data in the log area that has write hard disk groups.
S303, data processing equipment read the eigenwert of the first data and the first data from the first internal storage location.
Wherein, because the first data that write in the first internal storage location NVM are for being stored to hard disk groups, therefore, data processing equipment, after hard disk groups is carried out function initialization, can read the first data from the first internal storage location.
S304, data processing equipment judge the first hard disk groups log area log space consumption whether higher than predetermined threshold value.
Wherein, due to data processing equipment carry out: after the eigenwert of the 3rd data and the 3rd data is write to the log area of the first hard disk groups, the data volume of the first data that write in the log area of the first hard disk groups may exceed certain threshold value, and now in the log area of the second hard disk groups, also do not write any data, if now continue the data that read to write the log area of the first hard disk groups, may cause the memory space inadequate in the log area of the first hard disk groups, can not continue data writing, cause writing of data normally to carry out, therefore, data processing equipment can real-time judge the first hard disk groups log area log space consumption whether higher than predetermined threshold value, and at the log space of the log area of the first hard disk groups when consumption is higher than predetermined threshold value, the first hard disk groups and the second hard disk groups are carried out to function switching, determine that the first hard disk groups is the hard disk groups of DGR function, determine that the second hard disk groups is the hard disk groups of DGW function.Carry out S305-S306:
Concrete, if the log space of the log area of the first hard disk groups consumption higher than predetermined threshold value, carry out S305-S306; If the log space of the log area of the first hard disk groups consumption not higher than predetermined threshold value, data processing equipment can continue the eigenwert of the first data that read and the first data to write the log area of the first hard disk groups, carries out and the similar step of S302c: data processing equipment writes the eigenwert of the first data and the first data the log area of the first hard disk groups.
S305, data processing equipment write the eigenwert of the first data and the first data the log area of the second hard disk groups.
It should be noted that, owing to not comprising any other data in the log area of the second hard disk groups under current state except the eigenwert of the first data of just having write and the first data, therefore data processing equipment does not arrange writing data in the log area of the second hard disk groups.
S306, data processing equipment be according to the eigenwert that has write the data in the log area of the first hard disk groups, will write the data field of data preparation to the three hard disk groups in the log area of the first hard disk groups.
Wherein, the data that write in the log area of the first hard disk groups comprise the 3rd data.
It should be noted that, when the log space of the log area of the first hard disk groups consumption is higher than predetermined threshold value, after the first hard disk groups and the second hard disk groups are carried out to the switching of hard disk groups function, data processing equipment needs to suspend the data that read (as the first data) is write to the log area of the first hard disk groups, only the first hard disk groups is carried out: will write the data field of data preparation to the three hard disk groups in the log area of the first hard disk groups; And, owing to not comprising any other data in the log area of the second hard disk groups under current state except the eigenwert of the first data of just having write and the first data, data processing equipment does not arrange writing data in the log area of the second hard disk groups, only in the log area of the second hard disk groups, writes the first data.Therefore, can realize separating that data preparation writes with data, improve the speed that data preparation and data write simultaneously.
S307, data processing equipment read the eigenwert of the second data and the second data from the first internal storage location.
S308, data processing equipment judge the second hard disk groups log area log space consumption whether higher than predetermined threshold value.
Concrete, if the log space of the log area of the second hard disk groups consumption, higher than predetermined threshold value, is carried out S309-S310, the first hard disk groups and the second hard disk groups are carried out to function switching, determine that the first hard disk groups is the hard disk groups of DGW function, determine that the second hard disk groups is the hard disk groups of DGR function; If the log space of the log area of the first hard disk groups consumption not higher than predetermined threshold value, data processing equipment can continue the eigenwert of the second data that read and the second data to write the log area of the second hard disk groups, carries out and the similar step of S305: data processing equipment writes the eigenwert of the second data and the second data the log area of the second hard disk groups.
S309, data processing equipment write the eigenwert of the second data and the second data the log area of the first hard disk groups, and suspend and will write the data field of data preparation to the three hard disk groups in the log area of the first hard disk groups.
Wherein, the data that write in the log area of the first hard disk groups comprise the second data and unfinished the 3rd data.
S310, data processing equipment be according to the eigenwert that has write the data in the log area of the second hard disk groups, will write the data field of data preparation to the three hard disk groups in the log area of the second hard disk groups.
Wherein, the data that write in the log area of the second hard disk groups are the data that read in the first internal storage location, have write the first data of the second hard disk groups.
S311, data processing equipment read the eigenwert of the 4th data and the 4th data from the first internal storage location.
S312, data processing equipment judge the first hard disk groups log area log space consumption whether higher than predetermined threshold value.
Concrete, if the log space of the log area of the first hard disk groups consumption, higher than predetermined threshold value, is carried out S313-S314, the first hard disk groups and the second hard disk groups are carried out to function switching, determine that the second hard disk groups is the hard disk groups of DGW function, determine that the first hard disk groups is the hard disk groups of DGR function; If the log space of the log area of the first hard disk groups consumption not higher than predetermined threshold value, data processing equipment can continue the eigenwert of the 4th data that read and the 4th data to write the log area of the first hard disk groups, carries out and the similar step of S309: data processing equipment writes the eigenwert of the 4th data and the 4th data the log area of the first hard disk groups.
S313, data processing equipment write the eigenwert of the 4th data and the 4th data the log area of the second hard disk groups, and suspend and will write the data field of data preparation to the three hard disk groups in the log area of the second hard disk groups.
S314, data processing equipment be according to the eigenwert that has write the data in the log area of the first hard disk groups, will write the data field of data preparation to the three hard disk groups in the log area of the first hard disk groups.
Exemplary, in the embodiment of the present invention, carry out taking data processing equipment: step c and steps d are example, illustrate that data processing equipment is concrete to carry out pure data and write and the process of data preparation.Wherein step c is: the eigenwert of the data that read and data is write to the log area of the second hard disk groups from internal memory (the first internal storage location), and suspend and will write the data field of data preparation to the three hard disk groups in the log area of the second hard disk groups; Steps d is: according to the eigenwert that writes the data in the log area of the first hard disk groups, will write the data field of data preparation to the three hard disk groups in the log area of the first hard disk groups.
As shown in Figure 9, adopt in this example lowercase alphabet registration according to itself, adopt the write address information (as, the piece number of data) of Arabic data representation data.For example, the piece of the data d of the write request in processing number is 9, the piece number of data b be 2 and the piece number of data c be 8 etc.; The piece of data h in the data field of the 3rd hard disk groups number is 11.
As shown in Figure 9, data processing equipment can be according to the piece number that writes the data in the log area of the first hard disk groups, these data is write in the data field of the 3rd hard disk groups in relevant block number corresponding address.As, the piece number that has write the data r in the log area of the first hard disk groups is 4, data processing equipment can be 4 address space by writing data r in the log area of the first hard disk groups and write piece number in the data field of the 3rd hard disk groups; The piece number that has write the data p in the log area of the first hard disk groups is 2, and data processing equipment can be 2 address space by writing data p in the log area of the first hard disk groups and write piece number in the data field of the 3rd hard disk groups.Wherein, when not being for the first time when data writing in the piece number corresponding address space of data, data processing equipment can adopt the data of having stored in the piece number corresponding address space of these data in the data field of this data replacement the 3rd hard disk groups.
Further alternative, in order to reduce after system cut-off, in the first internal storage location, do not write the loss of the data in hard disk groups, data processing equipment can detect after cut-offing instruction, and all the first data in the first internal storage location are write to DGW(the first hard disk groups or the second hard disk groups) log area.The method of the embodiment of the present invention can also comprise S315:
S315, data processing equipment are carried out before power-off, the first data in the first internal storage location are write to the flow process of the hard disk groups log area of DGW function.
Concrete, data processing equipment is carried out before power-off, and the flow process that the first data in the first internal storage location is write to the hard disk groups log area of DGW function can comprise: S315a and S315b or S315a and S315c:
S315a, data processing equipment detect cut-offing instruction.
Wherein, data processing equipment is detecting after cut-offing instruction, in order to prevent the loss of the data in the first internal storage location after power-off, can from the first internal storage location, read successively all the first data in the first internal storage location, and the first data that read be write to the hard disk groups log area of DGW function.
When the first hard disk groups is the hard disk groups of DGW function, when the second hard disk groups is the hard disk groups of DGR function, data processing equipment is carried out before power-off, and the flow process that the first data in the first internal storage location is write to the hard disk groups log area of DGW function can comprise: S315a and S315b:
S315b, data processing equipment are detecting after cut-offing instruction, according to the sequencing that writes of the first data in the first internal storage location, from the first internal storage location, read successively all data in the first internal storage location, and the data that read are write to the log area of the first hard disk groups.
When the second hard disk groups is the hard disk groups of DGW function, when the first hard disk groups is the hard disk groups of DGR function, data processing equipment is carried out before power-off, and the flow process that the first data in the first internal storage location is write to the hard disk groups log area of DGW function can comprise S315a and S315c:
S315c, data processing equipment are detecting after cut-offing instruction, according to the sequencing that writes of the first data in the first internal storage location, from the first internal storage location, read successively all data in the first internal storage location, and the data that read are write to the log area of the second hard disk groups.
Further, because the second internal storage location is that DRAM is the random memory device of volatibility, DRAM is the internal memory of not supporting power-off protection.Therefore, after system cut-off, if power on load instructions described in detecting, and re-powering after loading data, is to store any data in the second internal storage location.Now, if receive after described data read command, data processing equipment need to read corresponding data and then return to the data that read from hard disk groups, the reading speed of data is lower, therefore, in order to improve the reading speed of data, data processing equipment is detecting that the load instructions that powers on can write the second internal storage location by the data that comprise in the data field of the data that comprise in the data field of the 3rd hard disk groups and the 3rd hard disk groups.Concrete, the method for the embodiment of the present invention can also comprise:
S316, data processing equipment are carried out the Data Recovery Process after powering on.
Wherein, S316 specifically can comprise S316a, S316b, S316c and S316d:
S316a, data processing equipment detect the load instructions that powers on.
S316b, data processing equipment power on after load instructions detecting, according to the eigenwert that writes the data in the log area of the second hard disk groups, will write the data field of data preparation to the three hard disk groups in the log area of the second hard disk groups.
S316c, data processing equipment power on after load instructions detecting, according to the eigenwert that writes the data in the log area of the first hard disk groups, will write the data field of data preparation to the three hard disk groups in the log area of the first hard disk groups.
The data that comprise in the data field of the data that comprise in the data field of the 3rd hard disk groups and the 3rd hard disk groups are write the second internal storage location by S316d, data processing equipment.
Further alternative, if described in the load instructions that powers on be specially the load instructions that powers on after abnormal power-down, after the load instructions that powers on being detected, before the data that arrange in the log area that has write the data in the log area of the first hard disk groups and write the second hard disk groups, the method of the embodiment of the present invention can also comprise: according to the sequencing that writes of the first data described in described the first internal storage location, from the first internal storage location, read successively all data in the first internal storage location, and the first data that read are write to the log area of the first hard disk groups and the log area of the second hard disk groups.
Further, because data processing equipment in S202 writes after order receiving data, data can be write to the data to be written that comprise in order and write the second internal storage location; Therefore, data processing equipment is receiving after described data read command, can directly read described data to be read from the second internal storage location, and need to be from hard disk groups not reading out data, the reading speed of data is very fast, and can reduce the access times to hard disk groups.The method of the embodiment of the present invention can also comprise S317:
S317, data processing equipment read the flow process of data to be read from the second internal storage location.
Wherein, S317 specifically can comprise S317a and S317b:
S317a, data processing equipment receive data read command, and described data write the mark that comprises data to be read in order.
S317b, data processing equipment, receiving after described data read command, read data to be read according to the mark of data to be read from the second internal storage location.
The data processing method that the embodiment of the present invention provides, if the log space of the log area of the first hard disk groups consumption higher than predetermined threshold value, data processing equipment writes the eigenwert of the first data that read from internal memory and the first data the log area of the second hard disk groups, and suspends data preparation to the first data field writing in the log area of the second hard disk groups; According to the eigenwert that writes the data in the log area of the first hard disk groups, by data preparation to the second data field writing in the log area of the first hard disk groups, the data that write in the log area of the first hard disk groups are the data that read from described internal memory.With in prior art for all hard disks simultaneously executing datas write with data preparation and compare, pass through this programme, hard disk can be divided into groups, and by different hard disk groups respectively only executing data write or data preparation operates, having realized the pure of data writes continuously, can improve writing speed and data preparation speed simultaneously, improve the IOPS performance of data handling procedure, and then can realize quick and durableization of data.
Embodiment 4
The embodiment of the present invention provides a kind of data processing equipment, as shown in Figure 4, comprising: the first judging unit 41, the first r/w cell 42 and first arrange unit 43.
The first judging unit 41, for judge the first hard disk groups log area log space consumption whether higher than predetermined threshold value.
The first writing unit 42, if determine for described the first judging unit 41 described the first hard disk groups log area log space consumption higher than described predetermined threshold value, the eigenwert of the first data that read and described the first data is write to the log area of the second hard disk groups from internal memory, and suspend data preparation to the first data field writing in the log area of described the second hard disk groups, data in the described log area that has write described the second hard disk groups comprise described the first data, the eigenwert of described the first data comprises the write address information of described the first data and the size information of described the first data.
First arranges unit 43, if determine for described the first judging unit 41 described the first hard disk groups log area log space consumption higher than described predetermined threshold value, according to the eigenwert that has write the data in the log area of described the first hard disk groups, by data preparation to the second data field in the described log area that has write described the first hard disk groups, the data in the described log area that has write described the first hard disk groups are the data that read from described internal memory.
Further, as shown in Figure 5, described data processing equipment, also comprises: the second judging unit 44, the second writing unit 45 and second arrange unit 46.
The second judging unit 44, for after the eigenwert of the first data that read from internal memory and described the first data is write the log area of the second hard disk groups by described the first writing unit 42, judge described the second hard disk groups log area log space consumption whether higher than described predetermined threshold value.
The second writing unit 45, if determine for described the second judging unit 44 described the second hard disk groups log area log space consumption higher than described predetermined threshold value, the eigenwert of the second data that read and described the second data is write to the log area of described the first hard disk groups from described internal memory, and suspend the data preparation in the described log area that has write described the first hard disk groups to described the second data field, data in the described log area that has write described the first hard disk groups comprise described the second data, the eigenwert of described the second data comprises the write address information of described the second data and the size information of described the second data.
Second arranges unit 46, if determine for described the second judging unit 44 described the second hard disk groups log area log space consumption higher than described predetermined threshold value, according to the eigenwert that has write the data in the log area of described the second hard disk groups, by the data preparation in the described log area that has write described the second hard disk groups, to described the first data field, the data in the described log area that has write described the second hard disk groups are the data that read from described internal memory.
It should be noted that, as shown in Figure 5, in embodiments of the present invention, the data that described the first arrangement unit 43 arranges are the data that the second writing unit 45 writes the log area of described the first hard disk groups; The data that described the second arrangement unit 46 arranges are the data that the first writing unit 42 writes the log area of described the second hard disk groups.
Further alternative, in the first application scenarios of the embodiment of the present invention, described the first data field is the data field of described the second hard disk groups; Described the second data field is the data field of described the first hard disk groups.
Further alternative, in the second application scenarios of the embodiment of the present invention, described the first data field is the data field of the 3rd hard disk groups; Described the second data field is the data field of described the 3rd hard disk groups.
Further, in the first application scenarios of the embodiment of the present invention, described the first hard disk groups comprises log area and data field.
Wherein, the log area of described the first hard disk groups is for storing the data that read from described internal memory and the eigenwert of the described data that read from described internal memory; The data field of described the first hard disk groups is for storing the data that arrange from the log area of described the first hard disk groups.
Described the second hard disk groups comprises log area and data field.
Wherein, the log area of described the second hard disk groups is for storing the data that read from described internal memory and the eigenwert of the described data that read from described internal memory; The data field of described the second hard disk groups is for storing the data that arrange from the log area of described the second hard disk groups.
Further, in the second application scenarios of the embodiment of the present invention, described the first hard disk groups only comprises log area; Described the second hard disk groups only comprises log area; Described the 3rd hard disk groups only comprises data field.
Wherein, the log area of described the first hard disk groups is for storing the data that read from described internal memory and the eigenwert of the described data that read from described internal memory; The log area of described the second hard disk groups is for storing the data that read from described internal memory and the eigenwert of the described data that read from described internal memory; The data field of described the 3rd hard disk groups is for storing the data that arrange from the log area of described the first hard disk groups and the data that arrange from the log area of described the second hard disk groups.
Further, in the first application scenarios, described the first hard disk groups and described the second hard disk groups are the hard disk grouping in hard drive space; In described hard drive space, comprise at least two hard disks.
Described data processing equipment also comprises: grouped element.
Grouped element, for judge at described the first judging unit the first hard disk groups log area log space consumption whether higher than predetermined threshold value before, by least two hard disk partition in described hard drive space to described the first hard disk groups and described the second hard disk groups.
Wherein, described the first hard disk groups comprises hard disk described at least one, and described the second hard disk groups comprises hard disk described at least one.
Further alternative, in the first application scenarios, in described the first hard disk groups, can comprise at least two hard disks, every two hard disks mirror image hard disk each other; In described the second hard disk groups, can comprise at least two hard disks, every two hard disks mirror image hard disk each other.
Further, in the second application scenarios, described the first hard disk groups, described the second hard disk groups and described the 3rd hard disk groups are the hard disk grouping in hard drive space; In described hard drive space, comprise at least three hard disks.
Described data processing equipment also comprises: grouped element.
Grouped element, for judge at described the first judging unit the first hard disk groups log area log space consumption whether higher than predetermined threshold value before, by least three hard disk partition in described hard drive space to described the first hard disk groups, described the second hard disk groups and described the 3rd hard disk groups.
Wherein, described the first hard disk groups comprises hard disk described at least one, and described the second hard disk groups comprises hard disk described at least one, and described the 3rd hard disk groups comprises hard disk described at least one.
Further alternative, in the second application scenarios, in the first hard disk groups, can comprise at least two hard disks, every two hard disks mirror image hard disk each other; In the second hard disk groups, can comprise at least two hard disks, every two hard disks mirror image hard disk each other; In the 3rd hard disk groups, can comprise at least two hard disks, every two hard disks mirror image hard disk each other.
It should be noted that, the corresponding content of the specific descriptions of part functional module in can reference method embodiment in the data processing equipment that the embodiment of the present invention provides, the present embodiment is no longer described in detail here.
The data processing equipment that the embodiment of the present invention provides, if the log space of the log area of the first hard disk groups consumption higher than predetermined threshold value, the eigenwert of the first data that read and the first data is write to the log area of the second hard disk groups from internal memory, and suspend data preparation to the first data field writing in the log area of the second hard disk groups; According to the eigenwert that writes the data in the log area of the first hard disk groups, by data preparation to the second data field writing in the log area of the first hard disk groups, the data that write in the log area of the first hard disk groups are the data that read from described internal memory.With in prior art for all hard disks simultaneously executing datas write with data preparation and compare, pass through this programme, hard disk can be divided into groups, and by different hard disk groups respectively only executing data write or data preparation operates, having realized the pure of data writes continuously, can improve writing speed and data preparation speed simultaneously, improve the IOPS performance of data handling procedure, and then can realize quick and durableization of data.
Embodiment 5
The embodiment of the present invention also provides a kind of data processing equipment, comprising: processor.
Processor, if for the log space of the log area of described the first hard disk groups consumption higher than described predetermined threshold value, the eigenwert of the first data that read and described the first data is write to the log area of the second hard disk groups from internal memory, and suspend data preparation to the first data field writing in the log area of described the second hard disk groups, data in the described log area that has write described the second hard disk groups comprise described the first data, and the eigenwert of described the first data comprises the write address information of described the first data and the size information of described the first data; According to the eigenwert that writes the data in the log area of described the first hard disk groups, by data preparation to the second data field in the described log area that has write described the first hard disk groups, the data in the described log area that has write described the first hard disk groups are the data that read from described internal memory.
Further, described processor, also for after the eigenwert of the first data that read from internal memory and described the first data is write to the log area of the second hard disk groups, judge described the second hard disk groups log area log space consumption whether higher than described predetermined threshold value; If determine described the second hard disk groups log area log space consumption higher than described predetermined threshold value, the eigenwert of the second data that read and described the second data is write to the log area of described the first hard disk groups from described internal memory, and suspend the data preparation in the described log area that has write described the first hard disk groups to described the second data field, data in the described log area that has write described the first hard disk groups comprise described the second data, and the eigenwert of described the second data comprises the write address information of described the second data and the size information of described the second data; According to the eigenwert that writes the data in the log area of described the second hard disk groups, by the data preparation in the described log area that has write described the second hard disk groups, to described the first data field, the data in the described log area that has write described the second hard disk groups are the data that read from described internal memory.
Further alternative, in the first application scenarios of the embodiment of the present invention, described the first data field is the data field of described the second hard disk groups; Described the second data field is the data field of described the first hard disk groups.
Further alternative, in the second application scenarios of the embodiment of the present invention, described the first data field is the data field of the 3rd hard disk groups; Described the second data field is the data field of described the 3rd hard disk groups.
Further, in the first application scenarios of the embodiment of the present invention, described the first hard disk groups comprises log area and data field.
Wherein, the log area of described the first hard disk groups is for storing the data that read from described internal memory and the eigenwert of the described data that read from described internal memory; The data field of described the first hard disk groups is for storing the data that arrange from the log area of described the first hard disk groups.
Described the second hard disk groups comprises log area and data field.
Wherein, the log area of described the second hard disk groups is for storing the data that read from described internal memory and the eigenwert of the described data that read from described internal memory; The data field of described the second hard disk groups is for storing the data that arrange from the log area of described the second hard disk groups.
Further, in the second application scenarios of the embodiment of the present invention, described the first hard disk groups only comprises log area; Described the second hard disk groups only comprises log area; Described the 3rd hard disk groups only comprises data field.
Wherein, the log area of described the first hard disk groups is for storing the data that read from described internal memory and the eigenwert of the described data that read from described internal memory; The log area of described the second hard disk groups is for storing the data that read from described internal memory and the eigenwert of the described data that read from described internal memory; The data field of described the 3rd hard disk groups is for storing the data that arrange from the log area of described the first hard disk groups and the data that arrange from the log area of described the second hard disk groups.
Further, in the first application scenarios, described the first hard disk groups and described the second hard disk groups are the hard disk grouping in hard drive space; In described hard drive space, comprise at least two hard disks.
Described processor, also for judge the first hard disk groups log area log space consumption whether higher than predetermined threshold value before, by least two hard disk partition in described hard drive space to described the first hard disk groups and described the second hard disk groups.
Wherein, described the first hard disk groups comprises hard disk described at least one, and described the second hard disk groups comprises hard disk described at least one.
Further alternative, in the first application scenarios, in described the first hard disk groups, can comprise at least two hard disks, every two hard disks mirror image hard disk each other; In described the second hard disk groups, can comprise at least two hard disks, every two hard disks mirror image hard disk each other.
Further, in the second application scenarios, described the first hard disk groups, described the second hard disk groups and described the 3rd hard disk groups are the hard disk grouping in hard drive space; In described hard drive space, comprise at least three hard disks.
Described processor, also for judge the first hard disk groups log area log space consumption whether higher than predetermined threshold value before, by least three hard disk partition in described hard drive space to described the first hard disk groups, described the second hard disk groups and described the 3rd hard disk groups.
Wherein, described the first hard disk groups comprises hard disk described at least one, and described the second hard disk groups comprises hard disk described at least one, and described the 3rd hard disk groups comprises hard disk described at least one.
Further alternative, in the second application scenarios, in the first hard disk groups, can comprise at least two hard disks, every two hard disks mirror image hard disk each other; In the second hard disk groups, can comprise at least two hard disks, every two hard disks mirror image hard disk each other; In the 3rd hard disk groups, can comprise at least two hard disks, every two hard disks mirror image hard disk each other.
It should be noted that, the corresponding content of the specific descriptions of part functional module in can reference method embodiment in the data processing equipment that the embodiment of the present invention provides, the present embodiment is no longer described in detail here.
The data processing equipment that the embodiment of the present invention provides, if the log space of the log area of the first hard disk groups consumption higher than predetermined threshold value, the eigenwert of the first data that read and the first data is write to the log area of the second hard disk groups from internal memory, and suspend data preparation to the first data field writing in the log area of the second hard disk groups; According to the eigenwert that writes the data in the log area of the first hard disk groups, by data preparation to the second data field writing in the log area of the first hard disk groups, the data that write in the log area of the first hard disk groups are the data that read from described internal memory.With in prior art for all hard disks simultaneously executing datas write with data preparation and compare, pass through this programme, hard disk can be divided into groups, and by different hard disk groups respectively only executing data write or data preparation operates, having realized the pure of data writes continuously, can improve writing speed and data preparation speed simultaneously, improve the IOPS performance of data handling procedure, and then can realize quick and durableization of data.
Embodiment 6
The embodiment of the present invention provides a kind of data handling system, and in the first application scenarios of the embodiment of the present invention, as shown in Figure 6, described data handling system comprises: the first hard disk groups, the second hard disk groups and data processing equipment.
Wherein, in the first application scenarios, described the first hard disk groups comprises log area and data field; The log area of described the first hard disk groups is for storing the data that read from described internal memory and the eigenwert of the described data that read from described internal memory; The data field of described the first hard disk groups is for storing the data that arrange from the log area of described the first hard disk groups.
Described the second hard disk groups comprises log area and data field.
Wherein, the log area of described the second hard disk groups is for storing the data that read from described internal memory and the eigenwert of the described data that read from described internal memory; The data field of described the second hard disk groups is for storing the data that arrange from the log area of described the second hard disk groups.
Concrete, in the first application scenarios, described data processing equipment, if for the log space of the log area of the first hard disk groups consumption higher than predetermined threshold value, the eigenwert of the first data that read and described the first data is write to the log area of the second hard disk groups from internal memory (the first internal storage location internal memory), and suspend and will write the data field of data preparation to the second hard disk groups in the log area of described the second hard disk groups, data in the described log area that has write described the second hard disk groups comprise described the first data, the eigenwert of described the first data comprises the write address information of described the first data and the size information of described the first data, according to the eigenwert that writes the data in the log area of described the first hard disk groups, by the data field of data preparation to the first hard disk groups in the described log area that has write described the first hard disk groups, the data in the described log area that has write described the first hard disk groups are the data that read from described internal memory.
Further, described data processing equipment, also for determine described the first hard disk groups log area log space consumption higher than described predetermined threshold value after, judge described the second hard disk groups log area log space consumption whether higher than described predetermined threshold value; If the log space of the log area of described the second hard disk groups consumption higher than described predetermined threshold value, the eigenwert of the second data that read and described the second data is write to the log area of described the first hard disk groups from described internal memory, and suspend the extremely data field of described the first hard disk groups of the data preparation in the described log area that has write described the first hard disk groups, data in the described log area that has write described the first hard disk groups comprise described the second data, and the eigenwert of described the second data comprises the write address information of described the second data and the size information of described the second data; According to the eigenwert that writes the data in the log area of described the second hard disk groups, data field by the data preparation in the described log area that has write described the second hard disk groups to described the second hard disk groups, the data in the described log area that has write described the second hard disk groups are the data that read from described internal memory.
In the second application scenarios of the embodiment of the present invention, as shown in Figure 7, described data handling system comprises: the first hard disk groups, the second hard disk groups, the 3rd hard disk groups, data processing equipment and internal memory (described internal memory comprises the first internal storage location and the second internal storage location).
Wherein, in the second application scenarios, described the first hard disk groups only comprises log area; Described the second hard disk groups only comprises log area; Described the 3rd hard disk groups only comprises data field.
Wherein, the log area of described the first hard disk groups is for storing the data that read from described internal memory and the eigenwert of the described data that read from described internal memory; The log area of described the second hard disk groups is for storing the data that read from described internal memory and the eigenwert of the described data that read from described internal memory; The data field of described the 3rd hard disk groups is for storing the data that arrange from the log area of described the first hard disk groups and the data that arrange from the log area of described the second hard disk groups.
Concrete, in the second application scenarios, described data processing equipment, if for the log space of the log area of the first hard disk groups consumption higher than predetermined threshold value, the eigenwert of the first data that read and described the first data is write to the log area of the second hard disk groups from internal memory (the first internal storage location internal memory), and suspend and will write the data field of data preparation to the three hard disk groups in the log area of described the second hard disk groups, data in the described log area that has write described the second hard disk groups comprise described the first data, the eigenwert of described the first data comprises the write address information of described the first data and the size information of described the first data, according to the eigenwert that writes the data in the log area of described the first hard disk groups, by the data field of data preparation to the three hard disk groups in the described log area that has write described the first hard disk groups, the data in the described log area that has write described the first hard disk groups are the data that read from described internal memory.
Further, described data processing equipment, also for determine described the first hard disk groups log area log space consumption higher than described predetermined threshold value after, judge described the second hard disk groups log area log space consumption whether higher than described predetermined threshold value; If the log space of the log area of described the second hard disk groups consumption higher than described predetermined threshold value, the eigenwert of the second data that read and described the second data is write to the log area of described the first hard disk groups from described internal memory, and suspend the extremely data field of described the 3rd hard disk groups of the data preparation in the described log area that has write described the first hard disk groups, data in the described log area that has write described the first hard disk groups comprise described the second data, and the eigenwert of described the second data comprises the write address information of described the second data and the size information of described the second data; According to the eigenwert that writes the data in the log area of described the second hard disk groups, data field by the data preparation in the described log area that has write described the second hard disk groups to described the 3rd hard disk groups, the data in the described log area that has write described the second hard disk groups are the data that read from described internal memory.
Further, the internal memory in the embodiment of the present invention comprises the first internal storage location and the second internal storage location.
The second internal storage location, being used for storing described data processing equipment writes after order receiving data, write the data to be written of described the second internal storage location, described data write the eigenwert that comprises described data to be written and described data to be written in order, and the eigenwert of described data to be written comprises: the write address information of described data to be written and the size information of described data to be written.
The first internal storage location, being used for storing described data processing equipment writes after order receiving data, write the first data of described the first internal storage location, to be described data processing equipment write according to described data the data message that the eigenwert of the data described to be written that comprise in order and described data to be written generates to described the first data.
Further, described the first internal storage location is nonvolatile memory NVM, and described the second internal storage location is dynamic RAM DRAM.
It should be noted that, the corresponding content of the specific descriptions of part functional module in can reference method embodiment in the data handling system that the embodiment of the present invention provides, the present embodiment is no longer described in detail here.
The data handling system that the embodiment of the present invention provides, if the log space of the log area of the first hard disk groups consumption higher than predetermined threshold value, data processing equipment writes the eigenwert of the first data that read from internal memory and the first data the log area of the second hard disk groups, and suspends data preparation to the first data field writing in the log area of the second hard disk groups; According to the eigenwert that writes the data in the log area of the first hard disk groups, by data preparation to the second data field writing in the log area of the first hard disk groups, the data that write in the log area of the first hard disk groups are the data that read from described internal memory.With in prior art for all hard disks simultaneously executing datas write with data preparation and compare, pass through this programme, hard disk can be divided into groups, and by different hard disk groups respectively only executing data write or data preparation operates, having realized the pure of data writes continuously, can improve writing speed and data preparation speed simultaneously, improve the IOPS performance of data handling procedure, and then can realize quick and durableization of data.
Through the above description of the embodiments, those skilled in the art can be well understood to, for convenience and simplicity of description, only be illustrated with the division of above-mentioned each functional module, in practical application, can above-mentioned functions be distributed and completed by different functional modules as required, be divided into different functional modules by the inner structure of device, to complete all or part of function described above.The system of foregoing description, the specific works process of device and unit, can, with reference to the corresponding process in preceding method embodiment, not repeat them here.
In the several embodiment that provide in the application, should be understood that, disclosed system, apparatus and method, can realize by another way.For example, device embodiment described above is only schematic, for example, the division of described module or unit, be only that a kind of logic function is divided, when actual realization, can have other dividing mode, for example multiple unit or assembly can in conjunction with or can be integrated into another system, or some features can ignore, or do not carry out.Another point, shown or discussed coupling each other or direct-coupling or communication connection can be by some interfaces, indirect coupling or the communication connection of device or unit can be electrically, machinery or other form.
The described unit as separating component explanation can or can not be also physically to separate, and the parts that show as unit can be or can not be also physical locations, can be positioned at a place, or also can be distributed in multiple network element.Can select according to the actual needs some or all of unit wherein to realize the object of the present embodiment scheme.
In addition, the each functional unit in each embodiment of the present invention can be integrated in a processing unit, can be also that the independent physics of unit exists, and also can be integrated in a unit two or more unit.Above-mentioned integrated unit both can adopt the form of hardware to realize, and also can adopt the form of SFU software functional unit to realize.
If described integrated unit is realized and during as production marketing independently or use, can be stored in a computer read/write memory medium using the form of SFU software functional unit.Based on such understanding, the all or part of of the part that technical scheme of the present invention contributes to prior art in essence in other words or this technical scheme can embody with the form of software product, this computer software product is stored in a storage medium, comprise that some instructions (can be personal computers in order to make a computer equipment, server, or the network equipment etc.) or processor (processor) carry out all or part of step of method described in each embodiment of the present invention.And aforesaid storage medium comprises: various media that can be program code stored such as USB flash disk, portable hard drive, ROM (read-only memory) (ROM, Read-Only Memory), random access memory (RAM, Random Access Memory), magnetic disc or CDs.
The above; be only the specific embodiment of the present invention, but protection scope of the present invention is not limited to this, any be familiar with those skilled in the art the present invention disclose technical scope in; can expect easily changing or replacing, within all should being encompassed in protection scope of the present invention.Therefore, protection scope of the present invention should be as the criterion with the protection domain of described claim.

Claims (10)

1. a data processing method, is characterized in that, comprising:
If the log space of the log area of the first hard disk groups consumption higher than predetermined threshold value, the eigenwert of the first data that read and described the first data is write to the log area of the second hard disk groups from internal memory, and suspend data preparation to the first data field writing in the log area of described the second hard disk groups, data in the described log area that has write described the second hard disk groups comprise described the first data, and the eigenwert of described the first data comprises the write address information of described the first data and the size information of described the first data;
According to the eigenwert that writes the data in the log area of described the first hard disk groups, by data preparation to the second data field in the described log area that has write described the first hard disk groups, the data in the described log area that has write described the first hard disk groups are the data that read from described internal memory.
2. data processing method according to claim 1, is characterized in that, described the first data field is the data field of described the second hard disk groups; Described the second data field is the data field of described the first hard disk groups.
3. data processing method according to claim 1, is characterized in that, described the first data field is the data field of the 3rd hard disk groups; Described the second data field is the data field of described the 3rd hard disk groups.
4. data processing method according to claim 2, is characterized in that,
Described the first hard disk groups comprises log area and data field;
Wherein, the log area of described the first hard disk groups is for storing the data that read from described internal memory and the eigenwert of the described data that read from described internal memory; The data field of described the first hard disk groups is for storing the data that arrange from the log area of described the first hard disk groups;
Described the second hard disk groups comprises log area and data field;
Wherein, the log area of described the second hard disk groups is for storing the data that read from described internal memory and the eigenwert of the described data that read from described internal memory; The data field of described the second hard disk groups is for storing the data that arrange from the log area of described the second hard disk groups.
5. data processing method according to claim 3, is characterized in that, described the first hard disk groups only comprises log area; Described the second hard disk groups only comprises log area; Described the 3rd hard disk groups only comprises data field;
Wherein, the log area of described the first hard disk groups is for storing the data that read from described internal memory and the eigenwert of the described data that read from described internal memory; The log area of described the second hard disk groups is for storing the data that read from described internal memory and the eigenwert of the described data that read from described internal memory; The data field of described the 3rd hard disk groups is for storing the data that arrange from the log area of described the first hard disk groups and the data that arrange from the log area of described the second hard disk groups.
6. a data processing equipment, is characterized in that, comprising:
The first judging unit, for judge the first hard disk groups log area log space consumption whether higher than predetermined threshold value;
The first writing unit, if for described the first judging unit determine described the first hard disk groups log area log space consumption higher than described predetermined threshold value, the eigenwert of the first data that read and described the first data is write to the log area of the second hard disk groups from internal memory, and suspend data preparation to the first data field writing in the log area of described the second hard disk groups, data in the described log area that has write described the second hard disk groups comprise described the first data, the eigenwert of described the first data comprises the write address information of described the first data and the size information of described the first data,
First arranges unit, if for described the first judging unit determine described the first hard disk groups log area log space consumption higher than described predetermined threshold value, according to the eigenwert that has write the data in the log area of described the first hard disk groups, by data preparation to the second data field in the described log area that has write described the first hard disk groups, the data in the described log area that has write described the first hard disk groups are the data that read from described internal memory.
7. data processing equipment according to claim 6, is characterized in that, described the first data field is the data field of described the second hard disk groups; Described the second data field is the data field of described the first hard disk groups.
8. data processing equipment according to claim 6, is characterized in that, described the first data field is the data field of the 3rd hard disk groups; Described the second data field is the data field of described the 3rd hard disk groups.
9. data processing equipment according to claim 7, is characterized in that, described the first hard disk groups comprises log area and data field;
Wherein, the log area of described the first hard disk groups is for storing the data that read from described internal memory and the eigenwert of the described data that read from described internal memory; The data field of described the first hard disk groups is for storing the data that arrange from the log area of described the first hard disk groups;
Described the second hard disk groups comprises log area and data field;
Wherein, the log area of described the second hard disk groups is for storing the data that read from described internal memory and the eigenwert of the described data that read from described internal memory; The data field of described the second hard disk groups is for storing the data that arrange from the log area of described the second hard disk groups.
10. data processing equipment according to claim 8, is characterized in that, described the first hard disk groups only comprises log area; Described the second hard disk groups only comprises log area; Described the 3rd hard disk groups only comprises data field;
Wherein, the log area of described the first hard disk groups is for storing the data that read from described internal memory and the eigenwert of the described data that read from described internal memory; The log area of described the second hard disk groups is for storing the data that read from described internal memory and the eigenwert of the described data that read from described internal memory; The data field of described the 3rd hard disk groups is for storing the data that arrange from the log area of described the first hard disk groups and the data that arrange from the log area of described the second hard disk groups.
CN201410073208.6A 2014-02-28 2014-02-28 Data processing method and data processing device Active CN103838521B (en)

Priority Applications (2)

Application Number Priority Date Filing Date Title
CN201410073208.6A CN103838521B (en) 2014-02-28 2014-02-28 Data processing method and data processing device
PCT/CN2014/089623 WO2015127791A1 (en) 2014-02-28 2014-10-28 Data processing method and device

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201410073208.6A CN103838521B (en) 2014-02-28 2014-02-28 Data processing method and data processing device

Publications (2)

Publication Number Publication Date
CN103838521A true CN103838521A (en) 2014-06-04
CN103838521B CN103838521B (en) 2017-02-08

Family

ID=50802075

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201410073208.6A Active CN103838521B (en) 2014-02-28 2014-02-28 Data processing method and data processing device

Country Status (2)

Country Link
CN (1) CN103838521B (en)
WO (1) WO2015127791A1 (en)

Cited By (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2015127791A1 (en) * 2014-02-28 2015-09-03 华为技术有限公司 Data processing method and device
CN105138280A (en) * 2015-07-31 2015-12-09 成都华为技术有限公司 Data write-in method, apparatus and system
CN106598768A (en) * 2016-11-28 2017-04-26 华为技术有限公司 Write request processing method, device and data center
CN106648444A (en) * 2015-10-30 2017-05-10 大唐移动通信设备有限公司 Message processing method and device
CN108334277A (en) * 2017-05-10 2018-07-27 中兴通讯股份有限公司 A kind of daily record write-in and synchronous method, device, system, computer storage media
CN108763454A (en) * 2018-05-28 2018-11-06 郑州云海信息技术有限公司 Distributed file system daily record update method, system, device and storage medium
CN110908828A (en) * 2018-09-18 2020-03-24 杭州海康威视数字技术股份有限公司 Data storage method and device, electronic equipment and storage medium
WO2021184996A1 (en) * 2020-03-20 2021-09-23 华为技术有限公司 Data storage method and apparatus for database

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20020083281A1 (en) * 2000-12-22 2002-06-27 Bull Hn Information Systems Inc. Write logging in mirrored disk subsystems
CN102542054A (en) * 2011-12-29 2012-07-04 厦门雅迅网络股份有限公司 Method utilizing cache tables to improve insertion performance of data in database
CN103500077A (en) * 2013-10-16 2014-01-08 北京国双科技有限公司 File storage method and device
CN103559145A (en) * 2013-10-22 2014-02-05 华为技术有限公司 Data reading and writing method and electronic equipment

Family Cites Families (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR100849221B1 (en) * 2006-10-19 2008-07-31 삼성전자주식회사 Method for managing non-volatile memory, and memory-based apparatus including the non-volatile memory
CN102750196A (en) * 2011-04-20 2012-10-24 大连兆阳软件科技有限公司 Data storage and backup system and method
CN102810050A (en) * 2011-05-31 2012-12-05 深圳市金蝶友商电子商务服务有限公司 Log data writing method and log system
US9368130B2 (en) * 2012-07-16 2016-06-14 Marvell International Ltd. Data storage system, method of writing to storage in the data storage system, hard disk and method of forming the hard disk
CN103049355B (en) * 2012-12-25 2015-06-17 华为技术有限公司 Method and equipment for database system recovery
CN103678149B (en) * 2013-12-19 2017-01-18 华为技术有限公司 Data processing method and device
CN103838521B (en) * 2014-02-28 2017-02-08 华为技术有限公司 Data processing method and data processing device

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20020083281A1 (en) * 2000-12-22 2002-06-27 Bull Hn Information Systems Inc. Write logging in mirrored disk subsystems
CN102542054A (en) * 2011-12-29 2012-07-04 厦门雅迅网络股份有限公司 Method utilizing cache tables to improve insertion performance of data in database
CN103500077A (en) * 2013-10-16 2014-01-08 北京国双科技有限公司 File storage method and device
CN103559145A (en) * 2013-10-22 2014-02-05 华为技术有限公司 Data reading and writing method and electronic equipment

Cited By (12)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2015127791A1 (en) * 2014-02-28 2015-09-03 华为技术有限公司 Data processing method and device
CN105138280A (en) * 2015-07-31 2015-12-09 成都华为技术有限公司 Data write-in method, apparatus and system
CN106648444A (en) * 2015-10-30 2017-05-10 大唐移动通信设备有限公司 Message processing method and device
CN106648444B (en) * 2015-10-30 2019-06-28 大唐移动通信设备有限公司 A kind of message treatment method and equipment
CN106598768A (en) * 2016-11-28 2017-04-26 华为技术有限公司 Write request processing method, device and data center
WO2018094961A1 (en) * 2016-11-28 2018-05-31 华为技术有限公司 Write request processing method, device, and data center
CN106598768B (en) * 2016-11-28 2020-02-14 华为技术有限公司 Method and device for processing write request and data center
CN108334277A (en) * 2017-05-10 2018-07-27 中兴通讯股份有限公司 A kind of daily record write-in and synchronous method, device, system, computer storage media
CN108334277B (en) * 2017-05-10 2019-06-28 中兴通讯股份有限公司 A kind of log write-in and synchronous method, device, system, computer storage medium
CN108763454A (en) * 2018-05-28 2018-11-06 郑州云海信息技术有限公司 Distributed file system daily record update method, system, device and storage medium
CN110908828A (en) * 2018-09-18 2020-03-24 杭州海康威视数字技术股份有限公司 Data storage method and device, electronic equipment and storage medium
WO2021184996A1 (en) * 2020-03-20 2021-09-23 华为技术有限公司 Data storage method and apparatus for database

Also Published As

Publication number Publication date
CN103838521B (en) 2017-02-08
WO2015127791A1 (en) 2015-09-03

Similar Documents

Publication Publication Date Title
CN103838521A (en) Data processing method and data processing device
CN103064795B (en) A kind of control method of memory device and relevant apparatus
CN101699413B (en) Hard disk data read-write control method, device and data storage system
CN101131671A (en) Controlling access to non-volatile memory
CN109785882B (en) SRAM with virtual-body architecture, and system and method including the same
CN104303167A (en) Computer system and method of memory management
CN108733324B (en) Data reading and writing method, device and equipment of solid state disk and storage medium
CN102063943A (en) Nand flash memory parameter automatic detecting system
CN103955433A (en) Shingled magnetic recording hard disk, and method and device for writing data in shingled magnetic recording hard disk
CN103458086A (en) Smart phone and fault detection method thereof
CN102326141A (en) Processing method and apparatus for raid configuration information and raid controller
US7861074B2 (en) Electronic systems using flash memory modules as main storage and related system booting methods
CN110941395A (en) Dynamic random access memory, memory management method, system and storage medium
CN102959548A (en) Data storage method, search method and device
KR101996641B1 (en) Apparatus and method for memory overlay
CN104063284B (en) The method and apparatus running application program
CN101606136A (en) Be embodied as light storage device or/and the computer peripheral equipment of moveable magnetic disc and its implementation by software emulation
CN103927215A (en) kvm virtual machine scheduling optimization method and system based on memory disk and SSD disk
CN103543901A (en) Method and device for generating menus
CN111562882A (en) Data writing method, intelligent terminal and storage medium
EP2527973B1 (en) Computer system with multiple operation modes and method of switching modes thereof
US20090216946A1 (en) Raid1 system and reading method for enhancing read performance
CN104063234A (en) Compatible method and device
CN104765626B (en) A kind of firmware program programming method and device
WO2007032830A2 (en) Methods and apparatus for providing a virtual flash device

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
C14 Grant of patent or utility model
GR01 Patent grant
TR01 Transfer of patent right
TR01 Transfer of patent right

Effective date of registration: 20220214

Address after: 550025 Huawei cloud data center, jiaoxinggong Road, Qianzhong Avenue, Gui'an New District, Guiyang City, Guizhou Province

Patentee after: Huawei Cloud Computing Technology Co.,Ltd.

Address before: 518129 Bantian HUAWEI headquarters office building, Longgang District, Guangdong, Shenzhen

Patentee before: HUAWEI TECHNOLOGIES Co.,Ltd.