CN108614746A - A kind of data processing method and its system, server - Google Patents
A kind of data processing method and its system, server Download PDFInfo
- Publication number
- CN108614746A CN108614746A CN201611130544.5A CN201611130544A CN108614746A CN 108614746 A CN108614746 A CN 108614746A CN 201611130544 A CN201611130544 A CN 201611130544A CN 108614746 A CN108614746 A CN 108614746A
- Authority
- CN
- China
- Prior art keywords
- data
- target
- strategy
- server
- hard disk
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/07—Responding to the occurrence of a fault, e.g. fault tolerance
- G06F11/14—Error detection or correction of the data by redundancy in operation
- G06F11/1402—Saving, restoring, recovering or retrying
- G06F11/1446—Point-in-time backing up or restoration of persistent data
- G06F11/1448—Management of the data involved in backup or backup restore
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/07—Responding to the occurrence of a fault, e.g. fault tolerance
- G06F11/14—Error detection or correction of the data by redundancy in operation
- G06F11/1402—Saving, restoring, recovering or retrying
- G06F11/1446—Point-in-time backing up or restoration of persistent data
- G06F11/1456—Hardware arrangements for backup
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
- G06F3/0601—Interfaces specially adapted for storage systems
- G06F3/0628—Interfaces specially adapted for storage systems making use of a particular technique
- G06F3/0629—Configuration or reconfiguration of storage systems
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
- G06F3/0601—Interfaces specially adapted for storage systems
- G06F3/0628—Interfaces specially adapted for storage systems making use of a particular technique
- G06F3/0655—Vertical data movement, i.e. input-output transfer; data movement between one or more hosts and one or more storage devices
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
- G06F3/0601—Interfaces specially adapted for storage systems
- G06F3/0668—Interfaces specially adapted for storage systems adopting a particular infrastructure
- G06F3/0671—In-line storage system
- G06F3/0673—Single storage device
Abstract
The embodiment of the invention discloses a kind of data processing methods, including：Server receives the request of data for target data；It is provided at least one local hard drive in the server, and is connected with External memory equipment；Determine the response policy for responding the request of data；The response policy includes at least the first strategy and the second strategy；Wherein, under first strategy, the target hard disk at least one local hard drive of the server by utilizing itself setting responds the request of data and handles the target data；Under second strategy, External memory equipment described in the server by utilizing responds the request of data and handles the target data.The embodiment of the invention also discloses a kind of server and data processing systems.
Description
Technical field
The present invention relates to data processing technique more particularly to a kind of data processing method and its system, servers.
Background technology
With the rise of big data, the demand to cluster scale and single machine memory capacity is higher and higher, in order to limited
Realize that capacity big as possible, the hard disk quantity in cabinet constantly increase in chassis space, but in order to realize the safety of data, also
It is to need to form different disk array (Raid, Redundant Arrays of Independent Disks) by hard disk
Rank, the Raid schemes used at present are realized on hard disk in a physical server, although ensure that number in this way
According to reliability, but have lost originally limited hard-disc storage space inside physical server.
Invention content
To solve existing technical problem, an embodiment of the present invention provides a kind of data processing method and its system,
Server can at least solve the above-mentioned problems in the prior art.
What the technical solution of the embodiment of the present invention was realized in：
First aspect of the embodiment of the present invention provides a kind of data processing method, the method includes：
Server receives the request of data for target data；Wherein, it is provided at least one in the server
Ground hard disk, and be connected with External memory equipment, in order to the server can be based at least one local hard drive with
And the External memory equipment extends the server in the case where realizing data redundancy by the External memory equipment
Memory space；
Determine the response policy for responding the request of data；The response policy includes at least the first strategy and the second plan
Slightly；Wherein, under first strategy, the target at least one local hard drive of the server by utilizing itself setting is hard
Disk responds the request of data and handles the target data；Under second strategy, described in the server by utilizing
External memory equipment responds the request of data and handles the target data.
In said program, the read operation of target data described in the request of data characterization acquisition request；Accordingly, described true
The response policy of request of data described in provisioning response, including：
Characterized read operation is asked based on the data, and storage has been selected from least one local hard drive
The target hard disk of target data is stated, and judges whether the target hard disk is in malfunction；
The response policy for responding the request of data is determined based on judging result.
In said program, the response policy that the response request of data is determined based on judging result, including：
When the target hard disk is in the malfunction, the server chooses second strategy, and is based on institute
It states the second strategy to go to obtain the target data from the External memory equipment for being stored with the target data, and sends institute
State target data；
When the target hard disk is not in the malfunction, the server chooses first strategy, and is based on
First strategy obtains the target data from the target hard disk, and sends the target data.
In said program, the response policy further includes third strategy；Accordingly, described determined based on judging result is responded
The response policy of the request of data, including：
When the target hard disk is in the malfunction, the server chooses the third strategy, and is based on institute
It states other from least one local hard drive in addition to the target hard disk of third strategy and is stored with the target data
Hard disk in go to obtain the target data, and send the target data；
When the target hard disk is not in the malfunction, the server chooses first strategy, and is based on
First strategy obtains the target data from the target hard disk, and sends the target data.
In said program, the request of data characterization request stores the write operation of the target data；Accordingly, the side
Method further includes：
The server asks characterized write operation based on the data, chooses first strategy and the second strategy,
And stored the target data to the target hard disk based on first strategy, it is tactful by the target based on described second
Data are stored to the External memory equipment, to carry out back-up processing to the target data.
In said program, the request of data characterization request stores the write operation of the target data；The response policy
It further include the 4th strategy；Accordingly, the method further includes：
The server asks characterized write operation based on the data, chooses first strategy and the 4th strategy,
And stored the target data to the target hard disk based on first strategy, it is tactful by the target based on the described 4th
In other hard disks in data storage at least one local hard drive in addition to the target hard disk, with to the number of targets
According to progress back-up processing.
Second aspect of the embodiment of the present invention provides a kind of server, and the server includes：
Receiving unit, for receiving the request of data for being directed to target data；Wherein, it is provided at least in the server
One local hard drive, and it is connected with External memory equipment, in order to which the server can be based at least one local
Hard disk and the External memory equipment extend the clothes in the case where realizing data redundancy by the External memory equipment
The memory space of business device；
Processing unit, for determining the response policy for responding the request of data；The response policy includes at least first
Strategy and the second strategy；Wherein, under first strategy, at least one local of the server by utilizing itself setting is hard
Target hard disk in disk responds the request of data and handles the target data；Under second strategy, the clothes
Business device responds the request of data using the External memory equipment and handles the target data.
In said program, the read operation of target data described in the request of data characterization acquisition request；Accordingly, the place
Unit is managed, is additionally operable to ask characterized read operation based on the data, selects and deposit from least one local hard drive
The target hard disk of the target data is contained, and judges whether the target hard disk is in malfunction；It is true based on judging result
The response policy of request of data described in provisioning response.
In said program, the processing unit is additionally operable to when the target hard disk is in the malfunction, chooses institute
The second strategy is stated, and goes to obtain institute from the External memory equipment for being stored with the target data based on second strategy
Target data is stated, the target data is sent；It is additionally operable to when the target hard disk is not in the malfunction, described in selection
First strategy, and the target data is obtained from the target hard disk based on first strategy, send the target data.
In said program, the response policy further includes third strategy；Accordingly, the processing unit is additionally operable to work as institute
When stating target hard disk and being in the malfunction, the third strategy is chosen, and based on the third strategy from described at least one
Other in a local hard drive in addition to the target hard disk, which are stored in the hard disk of the target data, to be gone to obtain the target
Data send the target data；It is additionally operable to when the target hard disk is not in the malfunction, chooses first plan
Slightly, and based on first strategy target data is obtained from the target hard disk, send the target data.
In said program, the request of data characterization request stores the write operation of the target data；Accordingly, the place
Unit is managed, is additionally operable to ask characterized write operation based on the data, chooses first strategy and the second strategy, and be based on
First strategy stores the target data to the target hard disk, is deposited the target data based on second strategy
Storage is to the External memory equipment, to carry out back-up processing to the target data.
In said program, the request of data characterization request stores the write operation of the target data；The response policy
It further include the 4th strategy；Accordingly, the processing unit is additionally operable to ask characterized write operation based on the data, chooses
First strategy and the 4th strategy, and stored the target data to the target hard disk, base based on first strategy
The target data is stored at least one local hard drive in addition to the target hard disk in the 4th strategy
In other hard disks, to carry out back-up processing to the target data.
The third aspect of the embodiment of the present invention provides a kind of data processing system, and the system comprises at least one services
Device and External memory equipment；Wherein,
The server, for receiving the request of data for being directed to target data；Wherein, be provided in the server to
A few local hard drive, and it is connected with External memory equipment, in order to which the server can be based on described at least one
Ground hard disk and the External memory equipment are in the case where realizing data redundancy by described in External memory equipment extension
The memory space of server；Determine the response policy for responding the request of data；The response policy includes at least the first strategy
With the second strategy；Wherein, under first strategy, at least one local hard drive of the server by utilizing itself setting
Target hard disk respond the request of data and the target data handled；Under second strategy, the server
The request of data is responded using the External memory equipment and the target data is handled；
The External memory equipment, for responding the request of data and handling the target data.
Data processing method and its system described in the embodiment of the present invention, server connect external storage by server
Equipment, and realize using External memory equipment the response policy of data, in this way, passing through institute in the case where realizing data redundancy
The memory space that External memory equipment extends the server is stated, therefore, the method described in the embodiment of the present invention solves existing
Have due to storing redundant data in server and the problem of cause hard-disk capacity to be lost；Meanwhile the embodiment of the present invention realizes Raid
When scheme, can jointly it be realized on the External memory equipment that server internal hard disk is connected with server, therefore, this numb reality
Apply example causes physical server hard disk to be deposited to solve to realize on the existing hard disk due to Raid schemes only in physical server
The problem of storing up space loss is laid a good foundation.
Description of the drawings
Fig. 1 is the implementation process schematic diagram of one data processing method of the embodiment of the present invention；
Fig. 2 is the composed structure schematic diagram of two server of the embodiment of the present invention；
Fig. 3 is composed structure schematic diagram of the data processing system of the embodiment of the present invention in a concrete application.
Specific implementation mode
In order to more fully hereinafter understand the features of the present invention and technology contents, below in conjunction with the accompanying drawings to the reality of the present invention
It is now described in detail, appended attached drawing purposes of discussion only for reference, is not used for limiting the present invention.
Embodiment one
A kind of data processing method is present embodiments provided, the method is applied in server；Specifically, such as Fig. 1 institutes
Show, the method includes：
Step 101：Server receives the request of data for target data；Wherein, be provided in the server to
A few local hard drive, and it is connected with External memory equipment, in order to which the server can be based on described at least one
Ground hard disk and the External memory equipment are in the case where realizing data redundancy by described in External memory equipment extension
The memory space of server；
That is, not being provided only with local hard drive for storing data in the present embodiment, in the server, also connect
It is connected to External memory equipment, and then the server can realize data by local hard drive and the External memory equipment
Storage, in this way, extending the memory space of the server by the External memory equipment, solve it is existing due to service
The problem of redundant data being stored in device and hard-disk capacity is caused to be lost.
In practical applications, the External memory equipment is not only used for storage redundant data, but can be used as described
The hard-disc storage arbitrary data of server, for example, it is assumed that the External memory equipment is equivalent to one piece of hard disk, in the server
Two pieces of local hard drives are provided with, in this way, the server for being connected with the External memory equipment is then equivalent to and is provided with three pieces
Hard disk, in this way, having increased the memory space of the server.That is, the present embodiment is when realizing Raid schemes, it is not one
It is realized on hard disk in platform server, but it is common real on the External memory equipment that server internal hard disk is connected with server
It is existing, therefore, solves being realized on the existing hard disk due to Raid schemes only in physical server and lead to physical server
The problem of hard-disc storage space loss.
Step 102：Determine the response policy for responding the request of data；The response policy include at least first strategy and
Second strategy；Wherein, under first strategy, at least one local hard drive of the server by utilizing itself setting
Target hard disk responds the request of data and handles the target data；Under second strategy, the server profit
The request of data is responded with the External memory equipment and the target data is handled.
Here, since server is connected with External memory equipment, so, current embodiment require that setting mechanism of data access；
Specifically, the first access mechanism, the server directly access local hard drive, are asked come response data by local hard drive；
Second of access mechanism, the server does not access local hard drive, but accesses the External memory equipment of connection, and then by outer
Portion's storage device carrys out response data request.
In one embodiment, when the request of data characterization acquisition request described in target data read operation, at this point,
The server first has to ask characterized read operation based on the data, is selected from least one local hard drive
It is stored with the target hard disk of the target data, and judges whether the target hard disk is in malfunction；And then based on judgement
As a result the response policy for responding the request of data is determined.Specifically, when the target hard disk is in the malfunction, institute
It states server and chooses second strategy, and is tactful from the external storage for being stored with the target data based on described second
It goes to obtain the target data in equipment, and sends the target data；Otherwise, the server chooses first strategy,
And the target data is directly obtained from the target hard disk based on first strategy, and send the target data.
Here, in practical applications, the target data, which can also be stored in the local hard drive of the server, removes institute
It states in other hard disks other than target hard disk；At this point, the response policy further includes third strategy；When the target hard disk is in
When the malfunction, the server chooses the third strategy, and based on the third strategy from described at least one
Other in ground hard disk in addition to the target hard disk, which are stored in the hard disk of the target data, to be gone to obtain the target data,
And send the target data；Otherwise, the server still chooses first strategy, and tactful from institute based on described first
It states and obtains the target data in target hard disk, and send the target data.
In this way, realizing data using the local hard drive and the External memory equipment that is connect with the server of server
Read operation.Moreover, in method described in the present embodiment, when target hard disk is in normal condition, i.e. non-failure, the service
Device preferentially reads local hard drive, this way it is ensured that access efficiency；And when local hard drive is in failure, it can just go to read external
Storage device, therefore, the present embodiment improve the memory space of server under the premise of ensuring not reduce access efficiency.
In another specific embodiment, when the request of data characterizes the write operation that request stores the target data；This
When, the server asks characterized write operation based on the data, chooses first strategy and the second strategy, and be based on
First strategy stores the target data to the target hard disk, is deposited the target data based on second strategy
Storage is to the External memory equipment, to carry out back-up processing to the target data.
Here, in practical applications, the target data, which can also be stored in the local hard drive of the server, removes institute
It states in other hard disks other than target hard disk；At this point, the response policy further includes the 4th strategy；The server is based on described
The write operation that request of data is characterized chooses first strategy and the 4th strategy, and is based on first strategy by the mesh
Mark data are stored to the target hard disk, are stored the target data at least one local based on the 4th strategy
In other hard disks in hard disk in addition to the target hard disk, to carry out back-up processing to the target data.
In this way, the method described in the embodiment of the present invention, connects External memory equipment, and utilize external storage by server
Equipment realizes the response policy of data, in this way, extended by the External memory equipment in the case where realizing data redundancy
The memory space of the server, therefore, the method described in the embodiment of the present invention solves existing due to being stored in server
Redundant data and the problem of cause hard-disk capacity to be lost；It, can be in server meanwhile when realization Raid schemes of the embodiment of the present invention
Realized jointly on the External memory equipment that internal hard drive is connected with server, therefore, this numb embodiment be solve it is existing due to
The problem of Raid schemes are realized on the hard disk only in physical server and lead to physical server hard-disc storage space loss is established
Basis is determined.
Embodiment two
A kind of server is present embodiments provided, as shown in Fig. 2, the server includes：
Receiving unit 21, for receiving the request of data for being directed to target data；Wherein, be provided in the server to
A few local hard drive, and it is connected with External memory equipment, in order to which the server can be based on described at least one
Ground hard disk and the External memory equipment are in the case where realizing data redundancy by described in External memory equipment extension
The memory space of server；
Processing unit 22, for determining the response policy for responding the request of data；The response policy includes at least the
One strategy and the second strategy；Wherein, under first strategy, at least one local of the server by utilizing itself setting
Target hard disk in hard disk responds the request of data and handles the target data；It is described under second strategy
External memory equipment described in server by utilizing responds the request of data and handles the target data.
In one embodiment, the read operation of target data described in the request of data characterization acquisition request；Accordingly, described
Processing unit 22 is additionally operable to ask characterized read operation based on the data, is chosen from least one local hard drive
Go out the target hard disk for being stored with the target data, and judges whether the target hard disk is in malfunction；It is tied based on judgement
Fruit determines the response policy for responding the request of data.
In one embodiment, the processing unit 22 is additionally operable to when the target hard disk is in the malfunction, choosing
Second strategy is taken, and goes to obtain from the External memory equipment for being stored with the target data based on second strategy
The target data is taken, the target data is sent；It is additionally operable to when the target hard disk is not in the malfunction, chooses
First strategy, and the target data is obtained from the target hard disk based on first strategy, send the target
Data.
In another embodiment, the response policy further includes third strategy；Accordingly, the processing unit 22, is also used
In when the target hard disk is in the malfunction, choosing the third strategy, and based on the third strategy from described
Other at least one local hard drive in addition to the target hard disk, which are stored in the hard disk of the target data, to be gone to obtain institute
Target data is stated, the target data is sent；It is additionally operable to when the target hard disk is not in the malfunction, described in selection
First strategy, and the target data is obtained from the target hard disk based on first strategy, send the target data.
In another embodiment, the request of data characterization request stores the write operation of the target data；Accordingly, institute
Processing unit 22 is stated, is additionally operable to ask characterized write operation based on the data, chooses first strategy and the second strategy,
And stored the target data to the target hard disk based on first strategy, it is tactful by the target based on described second
Data are stored to the External memory equipment, to carry out back-up processing to the target data.
In another embodiment, the request of data characterization request stores the write operation of the target data；The response
Strategy further includes the 4th strategy；Accordingly, the processing unit 22, be additionally operable to ask to be characterized based on the data writes behaviour
Make, chooses first strategy and the 4th strategy, and store the target data to the target based on first strategy
The target data is stored at least one local hard drive based on the 4th strategy and removes the target hard disk by hard disk
In other hard disks in addition, to carry out back-up processing to the target data.
It need to be noted that be：The description of the above server implementation item is similar with above method description, has
The identical advantageous effect with embodiment of the method, therefore do not repeat.For undisclosed technology in server example of the present invention
Details, those skilled in the art please refer to the description of the method for the present invention embodiment and understand, no longer superfluous here to save length
It states.
Embodiment three
Present embodiments provide a kind of data processing system；Here, traditional Raid cards generally can be with the machine cabinet inside
Hard disk connection, or by external SAS (Statistical Analysis System) interface realize with disk cluster (JBOD,
Just a Bunch Of Disks) connection, and provide Raid functions.Raid is configured in the machine or on JBOD, is generally needed
Want hard disk on a physical equipment (or all hard disks are all hung under the same mainboard).Moreover, to guarantee data security,
Need to make Raid1, Raid10, Raid5, Raid6 etc., these Raid patterns can make one piece of server total capacity " loss " or
The capacity of polylith hard disk, so, to solve the above problems, a kind of data processing system is present embodiments provided, to realize across clothes
The Raid schemes of business device, moreover, the system described in the present embodiment does not lose single server while assuring data security
Interior hard-disk capacity.Specifically, the system comprises at least one server and External memory equipments；Wherein,
The server, for receiving the request of data for being directed to target data；Wherein, be provided in the server to
A few local hard drive, and it is connected with External memory equipment, in order to which the server can be based on described at least one
Ground hard disk and the External memory equipment are in the case where realizing data redundancy by described in External memory equipment extension
The memory space of server；Determine the response policy for responding the request of data；The response policy includes at least the first strategy
With the second strategy；Wherein, under first strategy, at least one local hard drive of the server by utilizing itself setting
Target hard disk respond the request of data and the target data handled；Under second strategy, the server
The request of data is responded using the External memory equipment and the target data is handled；
The External memory equipment, for responding the request of data and handling the target data.
The description of server and External memory equipment item described in the present embodiment, it is similar with embodiment of the method, here no longer
It repeats.
The system described in the embodiment of the present invention is described in further details below in conjunction with specific implementation；Specifically,
As shown in figure 3, the system comprises：Server, SAS switch and JBOD (namely External memory equipment)；Wherein, the clothes
It is provided with polylith hard disk in business device, polylith hard disk is also equipped in the JBOD；The server passes through Raid cards and the SAS
Interchanger connects, and the JBOD is connect by SAS connector with the SAS switch；Specifically, the present embodiment cross-server
The specific implementation processes of Raid schemes include：
First, the Raid cards and traditional Raid card different froms that the server described in the present embodiment uses, the present embodiment
The Raid cards altogether there are two (kind) interface, (kind) interface in server hard disk or SAS expansion cards be connected, separately
One (kind) interface is connected with the SAS switch outside server.Here, the SAS switch can be to different SAS connectors
And its hard disk connected behind is addressed.
Second, the JBOD described in the present embodiment are connected by its internal SAS connector with SAS switch.The SAS
Connector can be configured as fixed number, the SAS connector of other JBOD for being connect with this SAS switch is distinguished,
For example, it is A1 to fix tentatively the number of SAS connector in the JBOD, at this point, the number for the hard disk being connect with SAS connector then can be with
Respectively A1.1, A1.2, A1.3, A1.4 etc..In one embodiment, the hard disk in the JBOD can as with SAS
The backup hard disk of the connected multiple servers of interchanger.
Third, the server described in the present embodiment can be by the SAS switch come to SAS connections in different JBOD
The different hard disks (A1.1, A1.2, A1.3 ... ..) connected on device (such as A1, A2 etc.) are addressed, thus in server
Local hard drive forms Raid groups, realizes the Raid schemes of cross-server.Here, in practical applications, Raid5 is if desired realized,
Then need to provide one piece of hard disk in JBOD, if realizing Raid6, need to provide two pieces of hard disks in JBOD, and Raid other
It is required that also to meet.That is, the number for the hard disk being arranged in the JBOD can be arbitrarily arranged according to actual demand.
4th, when there are multiple Raid groups on a server, can select that JBOD is allowed to you can well imagine confession for these Raid components
Different hard disks, and make Raid groups by distinguishing different hard disks.Certainly, the same Raid groups of same server and
Different Raid groups can also select the hard disk in different JBOD to realize.
Below by a server, a SAS switch and a JBOD and by taking Raid5 as an example, the present invention is implemented
The whole flow process of example elaborates：
First, clothes are configured by the interface (such as interfaces WebBIOS of the Raid cards use of current LSI) on server
Be engaged in the Raid5 that the upper hard disk of hard disk and JBOD on device forms.Here, since the Raid cards of server pass through SAS switch and JBOD
On SAS connector, and the SAS connector is connected with the hard disk in JBOD, therefore can select the local hard drive of server
It is configured to Raid5 with certain block hard disk on JBOD, such as A1.1 hard disks.
Secondly, configuration forms hard disk groups after completing Raid5, you can is written and read operation to hard disk groups, hard disk groups can here
To be formatted by operating system, further, upper layer application is mainly divided to two kinds to the operation of hard disk groups：It reads and writes；
Specifically,
When upper layer application reads data, if the local hard drive of server does not break down, only access in local hard drive
Data, in this way, speed；If the local hard drive of server breaks down, upper layer application will not access local hard drive, but
It accesses corresponding one piece of redundant hard disk on JBOD and reads data.Here, after replacing the faulty hard disk on server, Raid
The data of Raid groups will be reconstructed in card.
And when data are written in upper layer application, then write data into the local hard of server simultaneously according to the mechanism of Raid5
Correspondence redundant hard disk on disk and JBOD, realizes the backup of data.
In this way, the embodiment of the present invention makes full use of clothes by the way that the backup disk of Raid to be placed on a JBOD to realize
The purpose of the local storage space of business device, while the safety of data has also been effectively ensured.
It should be understood by those skilled in the art that, the embodiment of the present invention can be provided as method, system or computer program
Product.Therefore, the shape of hardware embodiment, software implementation or embodiment combining software and hardware aspects can be used in the present invention
Formula.Moreover, the present invention can be used can use storage in the computer that one or more wherein includes computer usable program code
The form for the computer program product implemented on medium (including but not limited to magnetic disk storage and optical memory etc.).
The present invention be with reference to according to the method for the embodiment of the present invention, the flow of equipment (system) and computer program product
Figure and/or block diagram describe.It should be understood that can be realized by computer program instructions every first-class in flowchart and/or the block diagram
The combination of flow and/or box in journey and/or box and flowchart and/or the block diagram.These computer programs can be provided
Instruct the processor of all-purpose computer, special purpose computer, Embedded Processor or other programmable data processing devices to produce
A raw machine so that the instruction executed by computer or the processor of other programmable data processing devices is generated for real
The device for the function of being specified in present one flow of flow chart or one box of multiple flows and/or block diagram or multiple boxes.
These computer program instructions, which may also be stored in, can guide computer or other programmable data processing devices with spy
Determine in the computer-readable memory that mode works so that instruction generation stored in the computer readable memory includes referring to
Enable the manufacture of device, the command device realize in one flow of flow chart or multiple flows and/or one box of block diagram or
The function of being specified in multiple boxes.
These computer program instructions also can be loaded onto a computer or other programmable data processing device so that count
Series of operation steps are executed on calculation machine or other programmable devices to generate computer implemented processing, in computer or
The instruction executed on other programmable devices is provided for realizing in one flow of flow chart or multiple flows and/or block diagram one
The step of function of being specified in a box or multiple boxes.
The above is only the embodiment of the embodiment of the present invention, it is noted that for the ordinary skill of the art
For personnel, under the premise of not departing from principle of the embodiment of the present invention, can also make several improvements and retouch, these improve and
Retouching also should be regarded as the protection domain of the embodiment of the present invention.
Claims (13)
1. a kind of data processing method, which is characterized in that the method includes：
Server receives the request of data for target data；Wherein, to be provided at least one local in the server hard
Disk, and it is connected with External memory equipment, in order to which the server can be based at least one local hard drive and institute
State the storage that External memory equipment extends the server in the case where realizing data redundancy by the External memory equipment
Space；
Determine the response policy for responding the request of data；The response policy includes at least the first strategy and the second strategy；Its
In, under first strategy, the target hard disk at least one local hard drive of the server by utilizing itself setting is rung
It answers the request of data and the target data is handled；It is external described in the server by utilizing under second strategy
Storage device responds the request of data and handles the target data.
2. according to the method described in claim 1, it is characterized in that, target data described in request of data characterization acquisition request
Read operation；Accordingly, the determining response policy for responding the request of data, including：
Characterized read operation is asked based on the data, is selected from least one local hard drive and is stored with the mesh
The target hard disk of data is marked, and judges whether the target hard disk is in malfunction；
The response policy for responding the request of data is determined based on judging result.
3. according to the method described in claim 2, it is characterized in that, described determined based on judging result responds the request of data
Response policy, including：
When the target hard disk is in the malfunction, the server chooses second strategy, and based on described the
Two strategies go to obtain the target data from the External memory equipment for being stored with the target data, and send the mesh
Mark data；
When the target hard disk is not in the malfunction, the server chooses first strategy, and based on described
First strategy obtains the target data from the target hard disk, and sends the target data.
4. according to the method described in claim 2, it is characterized in that, the response policy further includes third strategy；Accordingly, institute
The response policy for being determined based on judging result and responding the request of data is stated, including：
When the target hard disk is in the malfunction, the server chooses the third strategy, and based on described the
Three other from least one local hard drive in addition to the target hard disk of strategy are stored with the hard of the target data
It goes to obtain the target data in disk, and sends the target data；
When the target hard disk is not in the malfunction, the server chooses first strategy, and based on described
First strategy obtains the target data from the target hard disk, and sends the target data.
5. according to the method described in claim 1, it is characterized in that, request of data characterization request stores the target data
Write operation；Accordingly, the method further includes：
The server asks characterized write operation based on the data, chooses first strategy and the second strategy, and base
The target data is stored to the target hard disk in first strategy, it is tactful by the target data based on described second
It stores to the External memory equipment, to carry out back-up processing to the target data.
6. according to the method described in claim 1, it is characterized in that, request of data characterization request stores the target data
Write operation；The response policy further includes the 4th strategy；Accordingly, the method further includes：
The server asks characterized write operation based on the data, chooses first strategy and the 4th strategy, and base
The target data is stored to the target hard disk in first strategy, it is tactful by the target data based on the described 4th
Store into other hard disks at least one local hard drive in addition to the target hard disk, with to the target data into
Row back-up processing.
7. a kind of server, which is characterized in that the server includes：
Receiving unit, for receiving the request of data for being directed to target data；Wherein, it is provided in the server at least one
Local hard drive, and it is connected with External memory equipment, in order to which the server can be based at least one local hard drive
And the External memory equipment extends the server in the case where realizing data redundancy by the External memory equipment
Memory space；
Processing unit, for determining the response policy for responding the request of data；The response policy includes at least the first strategy
With the second strategy；Wherein, under first strategy, at least one local hard drive of the server by utilizing itself setting
Target hard disk respond the request of data and the target data handled；Under second strategy, the server
The request of data is responded using the External memory equipment and the target data is handled.
8. server according to claim 7, which is characterized in that number of targets described in the request of data characterization acquisition request
According to read operation；Accordingly, the processing unit is additionally operable to ask characterized read operation based on the data, from it is described to
The target hard disk for being stored with the target data is selected in a few local hard drive, and judges whether the target hard disk is in
Malfunction；The response policy for responding the request of data is determined based on judging result.
9. server according to claim 8, which is characterized in that the processing unit is additionally operable to work as the target hard disk
When in the malfunction, second strategy is chosen, and based on second strategy from being stored with the target data
It goes to obtain the target data in the External memory equipment, sends the target data；It is additionally operable to work as the target hard disk not
When in the malfunction, first strategy is chosen, and institute is obtained from the target hard disk based on first strategy
Target data is stated, the target data is sent.
10. server according to claim 8, which is characterized in that the response policy further includes third strategy；It is corresponding
Ground, the processing unit are additionally operable to, when the target hard disk is in the malfunction, choose the third strategy, and base
It is stored with the target in other from least one local hard drive in addition to the target hard disk of the third strategy
It goes to obtain the target data in the hard disk of data, sends the target data；It is additionally operable to be not in institute when the target hard disk
When stating malfunction, first strategy is chosen, and the target is obtained from the target hard disk based on first strategy
Data send the target data.
11. server according to claim 7, which is characterized in that the request of data characterization request stores the target
The write operation of data；Accordingly, the processing unit is additionally operable to ask characterized write operation based on the data, chooses institute
The first strategy and the second strategy are stated, and is stored the target data to the target hard disk based on first strategy, is based on
Second strategy stores the target data to the External memory equipment, to be carried out at backup to the target data
Reason.
12. server according to claim 7, which is characterized in that the request of data characterization request stores the target
The write operation of data；The response policy further includes the 4th strategy；Accordingly, the processing unit is additionally operable to be based on the number
According to characterized write operation is asked, selection described first is tactful and the 4th is tactful, and tactful by the target based on described first
Data are stored to the target hard disk, are stored the target data based on the 4th strategy hard at least one local
In other hard disks in disk in addition to the target hard disk, to carry out back-up processing to the target data.
13. a kind of data processing system, which is characterized in that the system comprises at least one servers and external storage to set
It is standby；Wherein,
The server, for receiving the request of data for being directed to target data；Wherein, it is provided at least one in the server
A local hard drive, and it is connected with External memory equipment, in order to which the server can be hard based at least one local
Disk and the External memory equipment extend the service in the case where realizing data redundancy by the External memory equipment
The memory space of device；Determine the response policy for responding the request of data；The response policy includes at least the first strategy and the
Two strategies；Wherein, under first strategy, the mesh at least one local hard drive of the server by utilizing itself setting
Mark hard disk responds the request of data and handles the target data；Under second strategy, the server by utilizing
The External memory equipment responds the request of data and handles the target data；
The External memory equipment, for responding the request of data and handling the target data.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201611130544.5A CN108614746A (en) | 2016-12-09 | 2016-12-09 | A kind of data processing method and its system, server |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201611130544.5A CN108614746A (en) | 2016-12-09 | 2016-12-09 | A kind of data processing method and its system, server |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN108614746A true CN108614746A (en) | 2018-10-02 |
Family
ID=63643343
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201611130544.5A Pending CN108614746A (en) | 2016-12-09 | 2016-12-09 | A kind of data processing method and its system, server |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN108614746A (en) |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109144433A (en) * | 2018-10-09 | 2019-01-04 | 郑州云海信息技术有限公司 | A kind of capacity expansion method, system, device and computer readable storage medium |
| CN109660604A (en) * | 2018-11-29 | 2019-04-19 | 上海碳蓝网络科技有限公司 | Data access method and equipment |
Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1892619A (en) * | 2005-07-06 | 2007-01-10 | 美国亿科三友公司 | System and method for adaptive operation of storage capacities of RAID systems |
| CN101118508A (en) * | 2007-08-24 | 2008-02-06 | 成都索贝数码科技股份有限公司 | Safety storage method for data |
| CN102103468A (en) * | 2010-12-31 | 2011-06-22 | 中国电子科技集团公司第十五研究所 | Multi-disk-cabin hard disk array system consisting of double-layer controller |
| CN102541689A (en) * | 2010-12-21 | 2012-07-04 | 微软公司 | Protecting data during different connectivity states |
| US20130073589A1 (en) * | 2011-09-18 | 2013-03-21 | Microsoft Corporation | Dynamic query for external data connections |
| CN103929609A (en) * | 2014-04-22 | 2014-07-16 | 浙江宇视科技有限公司 | Video replaying method and device |
| CN104166441A (en) * | 2010-06-18 | 2014-11-26 | Lsi公司 | Scalable storage devices |
-
2016
- 2016-12-09 CN CN201611130544.5A patent/CN108614746A/en active Pending
Patent Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1892619A (en) * | 2005-07-06 | 2007-01-10 | 美国亿科三友公司 | System and method for adaptive operation of storage capacities of RAID systems |
| CN101118508A (en) * | 2007-08-24 | 2008-02-06 | 成都索贝数码科技股份有限公司 | Safety storage method for data |
| CN104166441A (en) * | 2010-06-18 | 2014-11-26 | Lsi公司 | Scalable storage devices |
| CN102541689A (en) * | 2010-12-21 | 2012-07-04 | 微软公司 | Protecting data during different connectivity states |
| CN102103468A (en) * | 2010-12-31 | 2011-06-22 | 中国电子科技集团公司第十五研究所 | Multi-disk-cabin hard disk array system consisting of double-layer controller |
| US20130073589A1 (en) * | 2011-09-18 | 2013-03-21 | Microsoft Corporation | Dynamic query for external data connections |
| CN103929609A (en) * | 2014-04-22 | 2014-07-16 | 浙江宇视科技有限公司 | Video replaying method and device |
Non-Patent Citations (1)
| Title |
|---|
| 步凯: "基于RAID技术的固态存储阵列系统的研究与设计", 《中国优秀硕士学位论文全文数据库信息科技辑》 * |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109144433A (en) * | 2018-10-09 | 2019-01-04 | 郑州云海信息技术有限公司 | A kind of capacity expansion method, system, device and computer readable storage medium |
| CN109660604A (en) * | 2018-11-29 | 2019-04-19 | 上海碳蓝网络科技有限公司 | Data access method and equipment |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN108052655B (en) | Data writing and reading method | |
| CN105472047B (en) | Storage system | |
| US9465756B2 (en) | Configurable interconnection system | |
| CN105657066A (en) | Load rebalance method and device used for storage system | |
| CN105843557B (en) | Redundant storage system, redundant storage method and redundant storage device | |
| CN103534688B (en) | Data reconstruction method, memory device and storage system | |
| CN108153622A (en) | The method, apparatus and equipment of a kind of troubleshooting | |
| CN102567227B (en) | Double-controller memory system and method for sharing cache equipment | |
| US11157356B2 (en) | System and method for supporting data protection across FPGA SSDs | |
| CN105872031B (en) | Storage system | |
| CN105786414A (en) | Memory system as well as access method and access device thereof | |
| US10365845B1 (en) | Mapped raid restripe for improved drive utilization | |
| CN102164165B (en) | Management method and device for network storage system | |
| CN108121510A (en) | OSD choosing methods, method for writing data, device and storage system | |
| WO2012073287A1 (en) | Storage control apparatus and storage control method | |
| CN109783280A (en) | Shared memory systems and shared storage method | |
| CN103530206B (en) | A kind of method and apparatus of date restoring | |
| US6954825B2 (en) | Disk subsystem | |
| CN108614746A (en) | A kind of data processing method and its system, server | |
| CN105119765B (en) | A kind of Intelligent treatment fault system framework | |
| CN104484135A (en) | Method and device for quickly reading data | |
| US8996805B2 (en) | Shared cache module and method thereof | |
| CN209343320U (en) | Shared memory systems | |
| CN102158538B (en) | Management method and device of network storage system | |
| US11860746B2 (en) | Resilient data storage system with efficient space management |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20181002 |
|
| RJ01 | Rejection of invention patent application after publication |