CN106445411A - Data reading method and device and distributed storage system - Google Patents
Data reading method and device and distributed storage system Download PDFInfo
- Publication number
- CN106445411A CN106445411A CN201610822923.4A CN201610822923A CN106445411A CN 106445411 A CN106445411 A CN 106445411A CN 201610822923 A CN201610822923 A CN 201610822923A CN 106445411 A CN106445411 A CN 106445411A
- Authority
- CN
- China
- Prior art keywords
- copy
- server
- load
- minimum
- place server
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
- G06F3/0601—Interfaces specially adapted for storage systems
- G06F3/0602—Interfaces specially adapted for storage systems specifically adapted to achieve a particular effect
- G06F3/0604—Improving or facilitating administration, e.g. storage management
- G06F3/0607—Improving or facilitating administration, e.g. storage management by facilitating the process of upgrading existing storage systems, e.g. for improving compatibility between host and storage device
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
- G06F3/0601—Interfaces specially adapted for storage systems
- G06F3/0628—Interfaces specially adapted for storage systems making use of a particular technique
- G06F3/0629—Configuration or reconfiguration of storage systems
- G06F3/0635—Configuration or reconfiguration of storage systems by changing the path, e.g. traffic rerouting, path reconfiguration
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
- G06F3/0601—Interfaces specially adapted for storage systems
- G06F3/0668—Interfaces specially adapted for storage systems adopting a particular infrastructure
- G06F3/067—Distributed or networked storage systems, e.g. storage area networks [SAN], network attached storage [NAS]
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Computer Networks & Wireless Communication (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
The embodiment of the invention provides a data reading method and device and a distributed storage system. The data reading method comprises the steps that a server where a primary copy is located receives a data reading request of a user; the server where a copy with the smallest load is located is selected according to load information of servers where all copies are located; if the server where the primary copy is located is not the server with the smallest load, the data reading request is sent to a server where a standby copy with the smallest load is located, so that data reading operation is carried out; data read by the server where the standby copy with the smallest load is located is received and shown to the user. According to the technical scheme, the server where the copy with the smallest load is located is selected for data reading operation, data reading operation is not all carried out by the server where the primary copy is located, therefore, load balance of the servers where the copies are located can be achieved, data reading efficiency is improved, and the problems of resource waste of the server where the standby copy is located and too heavy loads of the server where the primary copy is located in the prior art are solved.
Description
Technical field
The present embodiments relate to microcomputer data processing field, more particularly, to a kind of method for reading data, device
And distributed memory system.
Background technology
Distributed memory system is that according to the cutting breaing up of certain rule, data is stored in multiple stage independence common store clothes
On business device.In distributed memory system, in order to allow data as far as possible uniformly, generally all can say a big file be cut into multiple relatively
Little file is stored, and the file of a such as 512MB is cut into the subfile of 128 4MB, and this 128 subfiles are then pressed
Write on different disks according to File Mapping rule, this mode is obviously write all of 512MB on identical disk than writing
It is eager to excel, because it can be avoided that some disks become the bottleneck of focus and cluster performance in reading and writing data.
Traditional network store system is then to deposit all data using the storage server concentrated, so storage server
Become the bottleneck of systematic function, be also the focus of reliability and safety it is impossible to meet the needs of Mass storage application, and divide
Cloth storage system adopts extendible system structure, shares storage load using multiple stage storage server, using location-based service
Device positions storage information, not only increases reliability, availability and the access efficiency of system, is also easy to extend.Storage cluster
Thousands of servers can be substantially redundant by data, such that it is able to significantly improve the safety of data.
Distributed memory system has primary copy and dividing for copy, is writing in data tissue, multiple copies of data
Enter on path, first primary copy is write a storage server, more multiple standby copies are respectively written into multiple storage services thereafter
Device, responds primary copy place server after standby copy write success, and primary copy place server is collecting all standby copies
Respond user again after the receiveing the response of place server to write successfully.And in terms of reading, request arrives first at primary copy institute
In server, data read from disk after again by data response to user.
During realizing the embodiment of the present invention, inventor find due to the reading of data need committed memory, network,
CPU, disk resource, if to be all responsible for reading by primary copy place server, then server described in multiple copies will
Unbalanced situation occurs, primary copy place server will become the bottleneck of digital independent, now newly write if there are data
To primary copy institute in the server, then this primary copy place server will face more read-write requests, now standby secondary
This place server does not but undertake the task of any digital independent, has ultimately caused the waste of standby copy place server resource
Overload with primary copy place server.
Content of the invention
A kind of method for reading data provided in an embodiment of the present invention, can solve existing all by server that primary copy is located
Ask to be responsible for the waste of standby copy place server resource that digital independent causes and the overload of primary copy place server
Topic.
For this purpose it is proposed, embodiments providing a kind of method for reading data, described data includes multiple copies, described
Multiple copies are divided into primary copy and standby copy, and the plurality of copy is respectively stored in different servers, and methods described includes：
The data read request of primary copy place server receive user；
According to the load information of all copy places server, choose the minimum copy place server of load；
If described primary copy place server is not the minimum server of load, by described data read request send to
The minimum standby copy place server of load, so that it carries out data read operation；
Receive the data that the minimum standby copy place server of described load reads, show to user.
Preferably, methods described also includes：If described primary copy place server is the minimum server of load, described
Primary copy place server carries out data read operation, and the data reading is shown to user.
Preferably, the described load information according to all copy places server, chooses clothes that the minimum copy of load is located
Business device, specifically includes：
Gather the load information of all copy places server, wherein, described all copy places server is according to default
Time interval report the load information of book server；
According to described load information, according to default transformational relation, choose the minimum copy place server of load.
Preferably, described load information includes：Cpu load in Preset Time, free memory, network traffics and disk profit
With rate.
Preferably, described transformational relation is weight relationship；Wherein, the cpu load in described Preset Time and free memory
Weight be all higher than described network traffics and the weight of disk utilization.
From the foregoing, it will be observed that method for reading data provided in an embodiment of the present invention, according to the load of all copy places server
Information, carries out the read operation of data by choosing the minimum copy place server of load, and not all is located by primary copy
Server carries out data read operation, it is thereby achieved that the load balancing of multiple copy places server, improves digital independent
Efficiency, solves the problems, such as the wasting of resources of existing standby copy place server and the overload of primary copy place server.
On the other hand, the embodiment of the present invention additionally provides a kind of digital independent device, and described data includes multiple copies, institute
State multiple copies and be divided into primary copy and standby copy, the plurality of copy is respectively stored in different servers, described device bag
Include：
Request receiving module, for the data read request of receive user；
Module chosen by copy, for the load information according to all copy places server, chooses the minimum copy of load
Place server；
Request sending module, for when primary copy place server is not the minimum server of load, by described data
Read requests send to the minimum standby copy place server of load, so that it carries out data read operation；
Data returns module, for receiving the data that the minimum standby copy place server of described load reads, to user
Show.
Preferably, described device also includes：Data read module, for being to load in described primary copy place server
During little server, carry out data read operation, and the data reading is shown to user.
Preferably, described copy is chosen module and is included：
Load information collector unit, for gathering the load information of all copy places server, wherein, described all pairs
This place server all include load reporting module, for report book server according to default time interval load information extremely
Described responsible information collection unit；
Subelement chosen by copy, for according to described load information, according to default transformational relation, choosing load minimum
Copy place server.
Preferably, described load information includes：Cpu load in Preset Time, free memory, network traffics and disk profit
With rate.
Preferably, described transformational relation is weight relationship；Wherein, the cpu load in described Preset Time and free memory
Weight be all higher than described network traffics and the weight of disk utilization.
Another further aspect, the embodiment of the present invention additionally provides a kind of distributed memory system, including above-mentioned described in any one
Digital independent device.
From the foregoing, it will be observed that digital independent device provided in an embodiment of the present invention and distributed memory system, according to all copies
The load information of place server, carries out the read operation of data by choosing the minimum copy place server of load, rather than
All data read operation is carried out by primary copy place server, it is thereby achieved that the load of multiple copy places server
Equilibrium, raising data reading performance using redundancy, the wasting of resources of solution existing standby copy place server and primary copy place server
Overload problem.
Brief description
In order to be illustrated more clearly that the embodiment of the present invention or technical scheme of the prior art, below will be to embodiment or existing
Have technology description in required use accompanying drawing be briefly described it should be apparent that, drawings in the following description are these
Some bright embodiments, for those of ordinary skill in the art, on the premise of not paying creative work, can also root
Obtain other accompanying drawings according to these accompanying drawings.
Fig. 1 is the schematic flow sheet of method for reading data provided in an embodiment of the present invention；
The schematic flow sheet of the method for reading data that Fig. 2 provides for another embodiment of the present invention；
Fig. 3 is the schematic flow sheet of the another method for reading data applying example offer of the present invention；
Fig. 4 is the block schematic illustration of digital independent device provided in an embodiment of the present invention；
The structural representation of the digital independent device that Fig. 5 provides for another embodiment of the present invention.
Specific embodiment
Purpose, technical scheme and advantage for making the embodiment of the present invention are clearer, below in conjunction with the embodiment of the present invention
In accompanying drawing, the technical scheme in the embodiment of the present invention is clearly and completely described it is clear that described embodiment is
The a part of embodiment of the present invention, rather than whole embodiments.Based on the embodiment in the present invention, those of ordinary skill in the art
The every other embodiment being obtained under the premise of not making creative work, broadly falls into the scope of protection of the invention.
It should be noted that in the data tissue of distributed memory system, multiple copies of data have primary copy and
Dividing for copy, the reading due to data in prior art is all carried out by primary copy place server, and service that standby copy is located
Device does not undertake the task of any digital independent, thus causing the wasting of resources and the primary copy place of standby copy place server
The overload of server, based on this, method for reading data provided in an embodiment of the present invention, make digital independent task no longer whole
Carried out by primary copy place server, but select an optimal copy place server of load to carry out digital independent, thus
The wasting of resources of standby copy place server and the overload of primary copy place server can be avoided.
Embodiment 1
As shown in figure 1, embodiments providing a kind of method for reading data, wherein, described data includes multiple pairs
This, the plurality of copy is divided into primary copy and standby copy, and the plurality of copy is respectively stored in different servers, described side
Method comprises the following steps：
S1：The data read request of primary copy place server receive user；
Wherein, primary copy place server is responsible for receive user request, after receiving user's request, it is first determined whether
For read request, if read request, then carry out follow-up step.
S2：According to the load information of all copy places server, choose the minimum copy place server of load；
It should be noted that primary copy place server is provided with load collection module, the server that each copy is located is (main
Copy place server and standby copy place server) it is equipped with load reporting module, responsible every five seconds for example reports the negative of book server
Information carrying ceases to the load collection module of primary copy place server, is collected according to load collection module by primary copy place server
Each copy place server load information, choose the relatively small copy place server of load, for follow-up number
According to read operation.
S3：If described primary copy place server is not the minimum server of load, described data read request is sent out
Deliver to the minimum standby copy place server of load, so that it carries out data read operation；
Specifically, the judgement according to above-mentioned steps S2, learns that primary copy place server is not the minimum server of load
When, primary copy place server sends the data read request that step S1 receives to service that the minimum standby copy of load is located
Device, allows standby copy place server carry out data read operation.
S4：Receive the data that the minimum standby copy place server of described load reads, show to user.
Specifically, after the minimum standby copy place server of load carries out data read operation, service that primary copy is located
Device receives the data of this reading that standby copy place server sends, and the data that this is read returns to user.
From the foregoing, it will be observed that method for reading data provided in an embodiment of the present invention, according to the load of all copy places server
Information, carries out the read operation of data by choosing the minimum copy place server of load, and not all is located by primary copy
Server carries out data read operation, it is thereby achieved that the load balancing of multiple copy places server, improves digital independent
Efficiency, solves the problems, such as the wasting of resources of existing standby copy place server and the overload of primary copy place server.
Embodiment 2
As shown in Fig. 2 another embodiment of the present invention provides a kind of method for reading data, the method comprises the following steps:
S1：The data read request of primary copy place server receive user；
Wherein, primary copy place server is responsible for receive user request, after receiving user's request, it is first determined whether
For read request, if read request, then carry out follow-up step.
S2：According to the load information of all copy places server, choose the minimum copy place server of load；
It should be noted that primary copy place server is provided with load collection module, the server that each copy is located is (main
Copy place server and standby copy place server) it is equipped with load reporting module, responsible every five seconds for example reports the negative of book server
Information carrying ceases to the load collection module of primary copy place server, is collected according to load collection module by primary copy place server
Each copy place server load information, choose the relatively small copy place server of load, for follow-up number
According to read operation.
S3’：If described primary copy place server is the minimum server of load, described primary copy place server enters
Row data read operation, and the data reading is shown to user.
Specifically, when the judgement according to above-mentioned steps S2, learn that primary copy place server is exactly the minimum service of load
During device, data read request is no longer sent to other copy places server by primary copy place server, still by primary copy
Place server carries out data read operation, and the data of reading is returned to user.
From the foregoing, when primary copy place server is the minimum server of load, still being entered by major-minor book server
Row data read operation, thereby may be ensured that the load balancing of all replica servers, improves data reading performance using redundancy.
Embodiment 3
As shown in figure 3, further embodiment of this invention provides a kind of method for reading data, the method comprises the following steps：
S1：The data read request of primary copy place server receive user；
Wherein, primary copy place server is responsible for receive user request, after receiving user's request, it is first determined whether
For read request, if read request, then carry out follow-up step.
S201：Gather the load information of all copy places server, wherein, described all copy places server according to
Default time interval reports the load information of book server；
Wherein, described load information includes the cpu load in Preset Time, and free memory, network traffics and disk utilize
Rate.
It should be noted that primary copy place server is provided with load collection module, the server that each copy is located is (main
Copy place server and standby copy place server) it is equipped with load reporting module, load reporting module is responsible for every five seconds for example and is reported
The load information of book server to primary copy place server load collection module.Wherein, the cpu load in Preset Time can
To refer to the cpu load in copy place server 15 minutes.
S202：According to described load information, according to default transformational relation, choose service that the minimum copy of load is located
Device.
Specifically, the load collection module of primary copy place server collects the load letter of each copy place server
It is contemplated that it is disk and CPU that read operation consumes highest, less is internal memory and network traffics, therefore disk utilization rate to breath
Higher with the weight of cpu load, the weight of internal memory and network traffics is relatively low, and primary copy place server is according to cpu load, residue
The weight relationship of internal memory, network traffics and disk utilization, can calculate the relatively small copy place server of load, use
In follow-up data read operation.
S3：If described primary copy place server is not the minimum server of load, described data read request is sent out
Deliver to the minimum standby copy place server of load, so that it carries out data read operation；
S4：Primary copy place server receives the data that the minimum standby copy place server of described load reads, Xiang Yong
Family is shown.
Contrary, if described primary copy place server is the minimum server of load, service that described primary copy is located
Device carries out data read operation, and the data reading is shown to user.
Specifically, the judgement according to above-mentioned steps S2, learns that primary copy place server is not the minimum server of load
When, primary copy place server sends the data read request that step S1 receives to service that the minimum standby copy of load is located
Device, allows standby copy place server carry out data read operation, carries out data reading in the minimum standby copy place server of load
After extract operation, the data of this reading that primary copy place server reception standby copy place server sends, and this is read
Data returns to user.Contrary, when the judgement according to above-mentioned steps S2, learn that primary copy place server is exactly to load minimum
Server when, data read request is no longer sent to other copy places server by primary copy place server, still by
Primary copy place server carries out data read operation, and the data of reading is returned to user.
From the foregoing, determined negative according to the weight relationship of cpu load, free memory, network traffics and disk utilization
Carry minimum copy place server and carry out digital independent, can accurately find the optimal copy place server of load, thus
Ensure the load balancing of all replica servers, and further increase data reading performance using redundancy.
On the other hand, as shown in figure 4, the embodiment of the present invention also provides a kind of digital independent device, this device is above-mentioned reality
Apply the primary copy place server described in a 1-3, wherein, described data includes multiple copies, and the plurality of copy is divided into master
Copy and standby copy, the plurality of copy is respectively stored in different servers, and specifically, described device includes：Connect successively
Module 42 chosen by the request receiving module 41 connecing, copy, request sending module 43 data returns module 44；
Wherein, request receiving module 41 is used for the data read request of receive user；
Copy chooses module 42 for the load information according to all copy places server, chooses the minimum copy of load
Place server；
Request sending module 43 is used for when primary copy place server is not the minimum server of load, by described data
Read requests send to the minimum standby copy place server of load, so that it carries out data read operation；
Data returns module 44 and is used for receiving the data that the minimum standby copy place server of described load reads, to user
Show.
The data read request of request receiving module 41 receive user, copy chooses module 42 according to clothes that all copies are located
The load information of business device, chooses the minimum copy place server of load, request sending module 43 is in primary copy place server
When not being the minimum server of load, described data read request is sent to the minimum standby copy place server of load, with
It is made to carry out data read operation, data returns module 44 and receives the number that the minimum standby copy place server of described load reads
According to user's displaying.
Digital independent device provided in an embodiment of the present invention, according to the load information of all copy places server, passes through
Choose the read operation that the minimum copy place server of load carries out data, and not all carried out by primary copy place server
Data read operation, it is thereby achieved that the load balancing of multiple copy places server, improves data reading performance using redundancy, solves
The wasting of resources of existing standby copy place server and the overload problem of primary copy place server.
It is preferred that described device also includes on the basis of above-described embodiment：Data read module, in described master
When copy place server is load minimum server, carries out data read operation, and the data reading is shown to user.
It is preferred that described copy selection module 42 includes on the basis of above-described embodiment：
Load information collector unit, for gathering the load information of all copy places server, wherein, described all pairs
This place server all include load reporting module, for report book server according to default time interval load information extremely
Described responsible information collection unit；
Subelement chosen by copy, for according to described load information, according to default transformational relation, choosing load minimum
Copy place server.
It is preferred that described load information includes on the basis of above-described embodiment：Cpu load in Preset Time, remaining
Internal memory, network traffics and disk utilization.
It is preferred that described transformational relation is weight relationship on the basis of above-described embodiment；Wherein, described Preset Time
The weight of interior cpu load and free memory is all higher than described network traffics and the weight of disk utilization.
Another aspect, present invention also offers a kind of distributed memory system, including any one described in above-described embodiment
Plant digital independent device.
For digital independent device embodiment corresponding with method, due to itself and embodiment of the method basic simlarity, reach
To technique effect also identical with the effect that embodiment of the method plays, so description fairly simple, correlation in place of referring to method
The part of embodiment illustrates.
Another further aspect, as shown in figure 5, the embodiment of the present invention additionally provides a kind of digital independent device, this device can be
Storage server, this device includes processor (processor) 51, communication interface (Communications Interface)
52nd, memorizer (memory) 53 and bus 54, wherein, processor 51, communication interface 52, memorizer 53 is completed by bus 354
Mutual communication.Communication interface 52 can be used for the information transfer between mobile terminal and external equipment.Processor 51 is permissible
Call the logical order in memorizer 53, to execute following method：The data read request of receive user；According to all copy institutes
In the load information of server, choose the minimum copy place server of load；If described primary copy place server is not negative
Carry minimum server, then send described data read request to the minimum standby copy place server of load, so that it enters
Row data read operation；Receive the data that the minimum standby copy place server of described load reads, show to user.
Additionally, the logical order in above-mentioned memorizer 53 can be realized by the form of SFU software functional unit and be used as solely
When vertical production marketing or use, can be stored in a computer read/write memory medium.Based on such understanding, this
Part that bright technical scheme substantially contributes to prior art in other words or this technical scheme partly can be with soft
The form of part product embodies, and this computer software product is stored in a storage medium, including some instructions in order to make
Obtain a computer equipment (can be personal computer, server, or network equipment etc.) and execute each embodiment of the present invention
The all or part of step of methods described.And aforesaid storage medium includes：USB flash disk, portable hard drive, read only memory (ROM,
Read-Only Memory), random access memory (RAM, Random Access Memory), magnetic disc or CD etc. various
Can be with the medium of store program codes.
Above-described embodiment provide digital independent device, processor according to the load information of all copy places server,
Carry out the read operation of data by choosing the minimum copy place server of load, and not all by server that primary copy is located
Carry out data read operation, it is thereby achieved that the load balancing of multiple copy places server, improve data reading performance using redundancy,
Solve the problems, such as the wasting of resources of existing standby copy place server and the overload of primary copy place server.
Device embodiment described above is only that schematically the wherein said unit illustrating as separating component can
To be or to may not be physically separate, as the part that unit shows can be or may not be physics list
Unit, you can with positioned at a place, or can also be distributed on multiple NEs.Can be selected it according to the actual needs
In the purpose to realize this embodiment scheme for some or all of module.Those of ordinary skill in the art are not paying creativeness
Work in the case of, you can to understand and to implement.
Through the above description of the embodiments, those skilled in the art can be understood that each embodiment can
Mode by software plus necessary general hardware platform to be realized naturally it is also possible to pass through hardware.Based on such understanding, on
That states that technical scheme substantially contributes to prior art in other words partly can be embodied in the form of software product, should
Computer software product can store in a computer-readable storage medium, such as ROM/RAM, magnetic disc, CD etc., including some fingers
Order is with so that a computer equipment (can be personal computer, server, or network equipment etc.) executes each enforcement
Example or some partly described methods of embodiment.
Finally it should be noted that：Above example only in order to technical scheme to be described, is not intended to limit；Although
With reference to the foregoing embodiments the present invention is described in detail, it will be understood by those within the art that：It still may be used
To modify to the technical scheme described in foregoing embodiments, or equivalent is carried out to wherein some technical characteristics；
And these modification or replace, do not make appropriate technical solution essence depart from various embodiments of the present invention technical scheme spirit and
Scope.
Claims (11)
1. it is characterised in that described data includes multiple copies, the plurality of copy is divided into primary copy to a kind of method for reading data
With for copy, the plurality of copy is respectively stored in different servers, and methods described includes：
The data read request of primary copy place server receive user；
According to the load information of all copy places server, choose the minimum copy place server of load；
If described primary copy place server is not the minimum server of load, described data read request is sent to load
Minimum standby copy place server, so that it carries out data read operation；
Receive the data that the minimum standby copy place server of described load reads, show to user.
2. method according to claim 1 is it is characterised in that also include：If described primary copy place server is load
Minimum server, then described primary copy place server carry out data read operation, and the data reading is shown to user.
3. method according to claim 1 is it is characterised in that the described load according to all copy places server is believed
Breath, chooses the minimum copy place server of load, specifically includes：
Gather the load information of all copy places server, wherein, described all copy places server according to default when
Between interval report the load information of book server；
According to described load information, according to default transformational relation, choose the minimum copy place server of load.
4. method according to claim 3 is it is characterised in that described load information includes：CPU in Preset Time bears
Carry, free memory, network traffics and disk utilization.
5. method according to claim 4 is it is characterised in that described transformational relation is weight relationship；Wherein, described default
The weight of the cpu load in the time and free memory is all higher than described network traffics and the weight of disk utilization.
6. it is characterised in that described data includes multiple copies, the plurality of copy is divided into primary copy to a kind of digital independent device
With for copy, the plurality of copy is respectively stored in different servers, and described device includes：
Request receiving module, for the data read request of receive user；
Module chosen by copy, for the load information according to all copy places server, chooses the minimum copy of load and is located
Server；
Request sending module, for when primary copy place server is not the minimum server of load, by described digital independent
Request sends to loading minimum standby copy place server, so that it carries out data read operation；
Data returns module, for receiving the data that the minimum standby copy place server of described load reads, shows to user.
7. device according to claim 6 is it is characterised in that described device also includes：Data read module, in institute
When stating the server that primary copy place server is load minimum, carry out data read operation, and by the data reading to user
Show.
8. device according to claim 6 is it is characterised in that described copy selection module includes：
Load information collector unit, for gathering the load information of all copy places server, wherein, described all copy institutes
All include loading reporting module in server, the load information for reporting book server according to default time interval is extremely described
Responsible information collection unit；
Subelement chosen by copy, for according to described load information, according to default transformational relation, chooses the minimum copy of load
Place server.
9. device according to claim 8 is it is characterised in that described load information includes：CPU in Preset Time bears
Carry, free memory, network traffics and disk utilization.
10. device according to claim 9 is it is characterised in that described transformational relation is weight relationship；Wherein, described pre-
If the weight of the cpu load in the time and free memory is all higher than described network traffics and the weight of disk utilization.
A kind of 11. distributed memory systems are it is characterised in that include the digital independent dress described in claim 6-10 any one
Put.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610822923.4A CN106445411A (en) | 2016-09-13 | 2016-09-13 | Data reading method and device and distributed storage system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610822923.4A CN106445411A (en) | 2016-09-13 | 2016-09-13 | Data reading method and device and distributed storage system |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN106445411A true CN106445411A (en) | 2017-02-22 |
Family
ID=58168206
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201610822923.4A Pending CN106445411A (en) | 2016-09-13 | 2016-09-13 | Data reading method and device and distributed storage system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN106445411A (en) |
Cited By (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107273187A (en) * | 2017-06-29 | 2017-10-20 | 深信服科技股份有限公司 | Reading position acquisition methods and device, computer installation, readable storage medium storing program for executing |
| CN108255417A (en) * | 2017-11-30 | 2018-07-06 | 平安科技（深圳）有限公司 | Data access method, electronic device and readable storage medium storing program for executing |
| CN110113414A (en) * | 2019-05-05 | 2019-08-09 | 深圳市腾讯网域计算机网络有限公司 | A kind of method, apparatus, server and storage medium managing copy |
| CN111064808A (en) * | 2019-12-30 | 2020-04-24 | 北京天融信网络安全技术有限公司 | Load balancing method and device based on distributed storage system |
| CN112346667A (en) * | 2021-01-07 | 2021-02-09 | 广东睿江云计算股份有限公司 | Ceph storage osd reading balancing method and system |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102904949A (en) * | 2012-10-08 | 2013-01-30 | 华中科技大学 | Replica-based dynamic metadata cluster system |
| US20150248253A1 (en) * | 2012-09-13 | 2015-09-03 | Hyosung Itx Co., Ltd | Intelligent Distributed Storage Service System and Method |
| CN105550229A (en) * | 2015-12-07 | 2016-05-04 | 北京奇虎科技有限公司 | Method and device for repairing data of distributed storage system |
-
2016
- 2016-09-13 CN CN201610822923.4A patent/CN106445411A/en active Pending
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20150248253A1 (en) * | 2012-09-13 | 2015-09-03 | Hyosung Itx Co., Ltd | Intelligent Distributed Storage Service System and Method |
| CN102904949A (en) * | 2012-10-08 | 2013-01-30 | 华中科技大学 | Replica-based dynamic metadata cluster system |
| CN105550229A (en) * | 2015-12-07 | 2016-05-04 | 北京奇虎科技有限公司 | Method and device for repairing data of distributed storage system |
Cited By (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107273187A (en) * | 2017-06-29 | 2017-10-20 | 深信服科技股份有限公司 | Reading position acquisition methods and device, computer installation, readable storage medium storing program for executing |
| CN108255417A (en) * | 2017-11-30 | 2018-07-06 | 平安科技（深圳）有限公司 | Data access method, electronic device and readable storage medium storing program for executing |
| WO2019104981A1 (en) * | 2017-11-30 | 2019-06-06 | 平安科技（深圳）有限公司 | Data access method, electronic device and readable storage medium |
| CN108255417B (en) * | 2017-11-30 | 2020-11-24 | 平安科技（深圳）有限公司 | Data access method, electronic device and readable storage medium |
| CN110113414A (en) * | 2019-05-05 | 2019-08-09 | 深圳市腾讯网域计算机网络有限公司 | A kind of method, apparatus, server and storage medium managing copy |
| CN110113414B (en) * | 2019-05-05 | 2022-05-31 | 深圳市腾讯网域计算机网络有限公司 | Method, device, server and storage medium for managing copies |
| CN111064808A (en) * | 2019-12-30 | 2020-04-24 | 北京天融信网络安全技术有限公司 | Load balancing method and device based on distributed storage system |
| CN112346667A (en) * | 2021-01-07 | 2021-02-09 | 广东睿江云计算股份有限公司 | Ceph storage osd reading balancing method and system |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN106445411A (en) | Data reading method and device and distributed storage system | |
| US20210149737A1 (en) | Method for fast scheduling for balanced resource allocation in distributed and collaborative container platform environment | |
| CN104050045B (en) | Virtual resource allocation method and device based on disk I/O | |
| CN110795203B (en) | Resource scheduling method, device, system and computing equipment | |
| CN108712464A (en) | A kind of implementation method towards cluster micro services High Availabitity | |
| CN100382031C (en) | Apparatus, system, and method connecting channel group | |
| CN106844108B (en) | A kind of date storage method, server and storage system | |
| CN102088490B (en) | Data storage method, device and system | |
| CN111966453B (en) | Load balancing method, system, equipment and storage medium | |
| CN101025674A (en) | Storage system | |
| CN104092756A (en) | Cloud storage system resource dynamic allocation method based on DHT mechanism | |
| CN107506145B (en) | Physical storage scheduling method and cloud host creation method | |
| CN102521073B (en) | Increasing database availability during fault recovery | |
| CN108572970A (en) | A kind of processing method and distributed processing system(DPS) of structural data | |
| WO2022048357A1 (en) | Transaction endorsement method and apparatus, and storage medium | |
| CN106406821A (en) | Data processing request sorting method and device | |
| CN105872053A (en) | Data migration method and system | |
| CN112395269B (en) | MySQL high availability group building method and device | |
| CN109189578A (en) | Storage server distribution method, device, management server and storage system | |
| CN101853185B (en) | Blade server and service dispatching method thereof | |
| CN103258389B (en) | The method of self-aided terminal upload file, system and self-aided terminal | |
| CN106293509A (en) | Date storage method and system | |
| CN104461779B (en) | A kind of storage method of distributed data, apparatus and system | |
| CN113347238A (en) | Message partitioning method, system, device and storage medium based on block chain | |
| CN117149372A (en) | Task scheduling method, device, equipment and storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| WD01 | Invention patent application deemed withdrawn after publication | ||
| WD01 | Invention patent application deemed withdrawn after publication |
Application publication date: 20170222 |