CN104125303A

CN104125303A - Data read-and-write requesting method, client end and data read-and-write requesting system

Info

Publication number: CN104125303A
Application number: CN201410397365.2A
Authority: CN
Inventors: 董亭亭; 赵健博
Original assignee: Beijing Qihoo Technology Co Ltd; Qizhi Software Beijing Co Ltd
Current assignee: Beijing Qihoo Technology Co Ltd
Priority date: 2014-08-12
Filing date: 2014-08-12
Publication date: 2014-10-29
Anticipated expiration: 2034-08-12
Also published as: CN104125303B

Abstract

The invention relates to a data storage technology and discloses a data read-and-write requesting method, a client end and a data read-and-write requesting system. The data read-and-write requesting method, the client end and the data read-and-write requesting system solve the problem of bottleneck in reading and writing processes and improve data transmission throughput of a data server to a certain degree. The data read-and-write requesting method is applied to a distributed storage system which comprises a main server and a data server, and the data server is provided with at least two network cards. The data read-and-write requesting method mainly includes: by the aid of the client end, acquiring data server information, corresponding to a data read-and-write request, from the main server; acquiring a selected network card which is selected from the network cards of the data server corresponding to the data read-and-write request and is used for establishing network connection between the data server and the client end; transmitting the data read-and-write request to the selected network card. The data read-and-write requesting method, the client end and the system in the embodiments are applied to data reading and writing processes.

Description

Reading and writing data requesting method, client and system

Technical field

The present invention relates to a kind of data storage technology, particularly relate to a kind of reading and writing data requesting method, client and system.

Background technology

The distributed architecture of increasing income (Hadoop) is a distributed system architecture of apache foundation exploitation, its three main sub-projects are respectively Hadoop distributed file system (Hadoop Distributed Filesystem, HDFS), MapReduce, Hbase.At this distributed storing framework, there is a host node and multiple from node.Send heartbeat from node timing to host node, and between host node, maintain communication.Client machine can be to from set of node pocket transmission read-write requests.The existing scheme that realizes read-write operation is: when client is initiated read-write operation request, first to host node request, host node inform read-write operation that client is asked corresponding from node, client is again with corresponding connecting from node, and then completes the read-write requests process of data.Whole mutual process with all walk a certain specific network interface card from all operations of node, be generally outer net network interface card.

In actual storage scenarios, be generally multiple clients concurrent read-writes simultaneously, to from the request of set of node pocket transmission reading and writing data.If the concurrent data read-write requests of multiple clients drops on same from node from node cluster, multiple like this concurrent data read-write requests can only be set up network by this same network interface card from node and connect.Because the network of the network interface card transmission speed of reaching the standard grade is fixed, transmitted data amount as per second in PCI-Express is reached the standard grade as 1000Mb.So under many concurrent datas read-write requests, network interface card may become the bottleneck of read-write flow process.

Summary of the invention

In view of the above problems, the present invention has been proposed to a kind of reading and writing data requesting method, client and system that overcomes the problems referred to above or address the above problem is at least in part provided.

According to one aspect of the invention, a kind of reading and writing data requesting method is provided, be applied to distributed memory system, described distributed memory system comprises master server and data server, described data server is provided with at least two network interface cards, comprising:

Client is obtained data server information corresponding to reading and writing data request from described master server;

Obtain selected network interface card, described selected network interface card be at least two network interface cards of the data server corresponding from described reading and writing data request, choose set up for data server and client the network interface card that network is connected;

Send reading and writing data request to described selected network interface card.

Another aspect of the present invention, provides a kind of client, is applied to distributed memory system, and described distributed memory system comprises master server and data server, and described data server is provided with at least two network interface cards, comprising:

Acquiring unit, for obtaining data server information corresponding to reading and writing data request from described master server; And obtain selected network interface card, described selected network interface card be at least two network interface cards of the data server corresponding from described reading and writing data request, choose set up for data server and client the network interface card that network is connected;

Transmitting element, sends reading and writing data request for the selected network interface card obtaining to described acquiring unit.

Another aspect of the present invention, provides a kind of reading and writing data Request System, comprises master server, data server and client as above;

Described data server timing sends heartbeat to described master server, keeps the communication connection with described master server;

Described master server receives the request of data server information corresponding to the reading and writing data request of obtaining that described client sends, and obtain the information of data server corresponding to described reading and writing data request according to described request, the information of described data server is sent to described client.

Another aspect of the present invention, provides a kind of reading and writing data requesting method, is applied to distributed memory system, and described distributed memory system comprises master server and data server, and described data server is provided with at least two network interface cards, comprising:

Described data server sends the network interface card information of himself at least two network interface card to described master server;

Described master server receives and stores described network interface card information;

Client is obtained the network interface card information of data server information corresponding to reading and writing data request and at least two network interface cards of described data, services from described master server;

Described client selects a network interface card to set up as data server and described client the selected network interface card that network is connected from described at least two network interface cards according to described network interface card information;

Client sends to obtain in data server corresponding to reading and writing data request and data server to described master server sets up with described client the request that network is connected network interface card;

Described master server receives described request, and obtains the network interface card information of data server information corresponding to reading and writing data request and at least two network interface cards of described data server according to described request; From described at least two network interface cards, select a network interface card to set up as data server and described client the selected network interface card that network is connected according to described network interface card information, the network interface card information of the described data server information of obtaining and selected network interface card is sent to described client;

The data server information that described in described client, master server sends and the network interface card information of selected network interface card; And send reading and writing data request according to the network interface card information of described data server information and selected network interface card to described selected network interface card.

Described client sends the request of obtaining network interface card information to corresponding data server according to described data server information;

Described data server receives after this request, obtains the network interface card information of himself at least two network interface card, and described network interface card information is sent to described client;

Network interface card information described in described client selects a network interface card to set up as data server and described client the selected network interface card that network is connected from described at least two network interface cards according to described network interface card information, and sends reading and writing data request to described selected network interface card.

By technique scheme, the technical scheme that the embodiment of the present invention provides at least has following advantages:

Reading and writing data requesting method of the present invention, client and system, in the time sending reading and writing data request to data server, make full use of at least two network interface cards of data server in distributed memory system, from described at least two network interface cards, select a network interface card as setting up with described client the network interface card that network is connected, when multiple concurrent reading and writing requests are during for a data server, can make read-write requests be undertaken by different network interface cards, avoid multiple concurrent data read-write requests all to connect by same network interface card, solve network interface card and become the problem of reading and writing flow process bottleneck, promote to a certain extent the throughput of the transmission data of data server, and at least two network interface cards of data server in distributed memory system are fully used, have promoted the utilance of resource.

Above-mentioned explanation is only the general introduction of technical solution of the present invention, in order to better understand technological means of the present invention, and can be implemented according to the content of specification, and for above and other objects of the present invention, feature and advantage can be become apparent, below especially exemplified by the specific embodiment of the present invention.

Brief description of the drawings

By reading below detailed description of the preferred embodiment, various other advantage and benefits will become cheer and bright for those of ordinary skill in the art.Accompanying drawing is only for the object of preferred implementation is shown, and do not think limitation of the present invention.And in whole accompanying drawing, represent identical parts by identical reference symbol.In the accompanying drawings:

Fig. 1 shows a kind of reading and writing data requesting method flow chart that the embodiment of the present invention provides;

Fig. 2 shows a kind of method flow diagram that obtains network interface card information that the embodiment of the present invention provides;

The another kind that Fig. 3 shows the embodiment of the present invention to be provided obtains the method flow diagram of network interface card information;

The another kind that Fig. 4 shows the embodiment of the present invention to be provided obtains the method flow diagram of network interface card information;

Fig. 5 shows a kind of reading and writing data requesting method interactive operation flow chart that the embodiment of the present invention provides;

Fig. 6 shows the another kind of reading and writing data requesting method interactive operation flow chart that the embodiment of the present invention provides;

Fig. 7 shows the another kind of reading and writing data requesting method interactive operation flow chart that the embodiment of the present invention provides;

Fig. 8 shows the write operation schematic diagram under the Hdfs framework that the embodiment of the present invention provides;

Fig. 9 shows the read operation schematic diagram under the Hdfs framework that the embodiment of the present invention provides;

Figure 10 shows reading and writing data requesting method flow chart under the Hdfs framework that the embodiment of the present invention provides;

Figure 11 shows the read-write operation schematic diagram under the Hbase framework that the embodiment of the present invention provides;

Figure 12 shows reading and writing data requesting method flow chart under the Hbase framework that the embodiment of the present invention provides;

Figure 13 shows the composition frame chart of the another kind of client that the embodiment of the present invention provides;

Figure 14 shows the composition frame chart of the another kind of client that the embodiment of the present invention provides;

Figure 15 shows the composition frame chart of the another kind of client that the embodiment of the present invention provides;

Figure 16 shows the composition frame chart of the another kind of client that the embodiment of the present invention provides;

Figure 17 shows the composition frame chart of the another kind of client that the embodiment of the present invention provides;

Figure 18 shows the composition frame chart of the another kind of client that the embodiment of the present invention provides;

Figure 19 shows the composition frame chart of the reading and writing data Request System that the embodiment of the present invention provides.

Embodiment

Exemplary embodiment of the present disclosure is described below with reference to accompanying drawings in more detail.Although shown exemplary embodiment of the present disclosure in accompanying drawing, but should be appreciated that and can realize the disclosure and the embodiment that should do not set forth limits here with various forms.On the contrary, it is in order more thoroughly to understand the disclosure that these embodiment are provided, and can be by the those skilled in the art that conveys to complete the scope of the present disclosure.

Embodiments of the invention provide a kind of reading and writing data requesting method, be applied to distributed memory system, described distributed memory system comprises master server and data server, and described data server is provided with at least two network interface cards, as shown in Figure 1, the method comprises: comprising:

101, client is obtained data server information corresponding to reading and writing data request from described master server.

Wherein, client is obtained data server information corresponding to reading and writing data request from described master server and can be adopted but be not limited to following method realization, and the method comprises:

Client sends the request of obtaining data server information corresponding to reading and writing data request to this master server, described master server receives the request of described client and obtains the information of data server corresponding to described reading and writing data request according to described request, and the information of described data server is sent to described client; Data server information corresponding to described reading and writing data request that described in client, master server sends.

102, obtain selected network interface card, described selected network interface card be at least two network interface cards of the data server corresponding from described reading and writing data request, choose set up for data server and client the network interface card that network is connected.

It should be noted that, client, in the time obtaining selected network interface card, based on the difference of its network architecture of living in, can adopt but be not limited to three kinds of following methods:

The first, obtains selected network interface card from described master server.

The second, obtains the network interface card information of at least two network interface cards of data server corresponding to reading and writing data request from described master server, and from described at least two network interface cards, selects a network interface card as selected network interface card according to this network interface card information.

The third, obtain the network interface card information of at least two network interface cards of data server from data server corresponding to described reading and writing data request, and from described at least two network interface cards, select a network interface card as selected network interface card according to this network interface card information.

In the time that the residing network architecture of client is following this kind of situation, adopt the first or second method to obtain selected network interface card: data server obtains the network interface card information of at least two network interface cards of self, and regularly report to master server, master server is according to the network interface card information of data server of reporting, set up a new data structure store each data server with and the mapping of the network interface card information of at least two corresponding network interface cards separately.

In the time that the residing network architecture of client is following this kind of situation, adopt the third method to obtain selected network interface card: data server obtains the network interface card information of at least two network interface cards of self, and is stored in this locality.

103, send reading and writing data request to described selected network interface card.

In the time adopting first method, embodiments of the invention provide a kind of method of obtaining selected network interface card, and the method can be but be not limited to following methods, specifically comprise:

Send the request of obtaining selected network interface card to described master server, so that described master server receives after described request, the network interface card information of at least two network interface cards that report according to the described server that reads and writes data, from described at least two network interface cards, select a network interface card as selected network interface card, and the network interface card information of described selected network interface card is sent to described client.Wherein, it should be noted that, this request of obtaining selected network interface card to described master server transmission can be the request sending to master server separately, also can be to be carried to described master server to send the request in the request of obtaining data server corresponding to reading and writing data request, the concrete embodiment of the present invention limit this.

Receive the network interface card information of the selected network interface card of described master server transmission, according to selected network interface card described in the described network interface card acquisition of information of institute.

In the time adopting second method, embodiments of the invention provide a kind of method of obtaining selected network interface card, and as shown in Figure 2, the method comprises:

201, client sends the request of obtaining data server corresponding to reading and writing data request to described master server.

It should be noted that, under this kind of pattern, data server obtains the network interface card information of at least two network interface cards of self, and regularly report to master server, master server is according to the network interface card information of data server of reporting, set up a new data structure store each data server with and the mapping of the network interface card information of at least two corresponding network interface cards separately.Receiving after the described request that client sends, master server is determined the data server of this request correspondence, and to the network interface card information of inquiring about at least two network interface cards that this data server is corresponding in this form; After obtaining the network interface card information of this data server, the network interface card information of the data server of this request correspondence and at least two network interface cards of this data server is sent in the lump to the client of request.

202, described in described in client, master server sends, read and write data server information and described in the read and write data network interface card information of at least two network interface cards corresponding to server.

203, client selects a network interface card as selected network interface card from described at least two network interface cards according to described network interface card information.

Certainly, when obtain the network interface card information of at least two network interface cards of data server corresponding to reading and writing data request from described master server, except said method, client can also be after having obtained corresponding data server from master server, send separately again the request of the network interface card information of obtaining corresponding data service to master server, thereby obtain the network interface card information of at least two network interface cards of data server.The embodiment of the present invention does not limit this, and any method may be used in the invention process.

In the time adopting the third method to obtain selected network interface card, embodiments of the invention provide a kind of method of obtaining selected network interface card, and as shown in Figure 3, the method comprises:

301, client sends the request of obtaining network interface card information to data server corresponding to described reading and writing data request, so that data server corresponding to described reading and writing data request receiving the network interface card information of obtaining himself at least two network interface card after this request, and described network interface card information is fed back to described client;

The network interface card information of 302, described in client, data server corresponding to reading and writing data request sends himself at least two network interface card.

303, client selects a network interface card as selected network interface card from described at least two network interface cards according to described network interface card information.

Further, by after network interface card acquisition of information, client by network interface card information cache at client terminal local, while waiting until next read-write requests, if this network interface card information is also effective, without connecting and obtain network interface card information to corresponding data server again.

Based on the storage of this network interface card information, the embodiment of the present invention provides a kind of method of obtaining selected network interface card, and as shown in Figure 4, the method comprises:

401, check whether described client terminal local stores the network interface card information of data server corresponding to described reading and writing data request; If exist, carry out 402; If do not exist, carry out 403.

402, determine that whether the network interface card information of described client terminal local storage is effective; If invalid, carry out 403; If effectively, carry out 405.

Wherein, the network interface card information of determining described client terminal local storage whether effectively can by but be not limited to following method and realize, the method is: client sends reading and writing data request to described network interface card, to connect with data server; If connect unsuccessfully, determine that the network interface card information of client terminal local storage lost efficacy; If connect successfully, determine that the network interface card information of client terminal local storage is effective.

Except said method, the effective time limit of network interface card information can also be set, while determining validity, check the whether mistake of valid expiration date of its setting, if valid expiration date mistake, determine the network interface card information inefficacy of client terminal local storage; If valid expiration date did not have, determine that the network interface card of client terminal local storage is effective.

403, send the request of obtaining network interface card information to data server corresponding to described reading and writing data request.

The network interface card information of himself at least two network interface card that 404, receives that data server corresponding to described reading and writing data request send.Afterwards, carry out 406.

405, obtain the network interface card information of at least two network interface cards of data server corresponding to described reading and writing data request from described client terminal local.Afterwards, carry out 406.

406, from described at least two network interface cards, select a network interface card as selected network interface card according to described network interface card information.

Further, when select a network interface card as selected network interface card from described at least two network interface cards according to described network interface card information, can adopt but be not limited to following method, the method comprises:

From described at least two network interface cards, select network interface card that load capacity is low as selected network interface card according to described network interface card information.Wherein, the utilance of described network interface card packets of information purse rope card, when select network interface card that load capacity is low as selected network interface card from described at least two network interface cards according to described network interface card information, can be according to the utilance of network interface card, from described at least two network interface cards, select network interface card that load capacity is low as selected network interface card.

Or select a network interface card as selected network interface card according to described network interface card information is random from described at least two network interface cards.

Further, writing process, because set up the pipeline of many data servers, in order to improve the utilance of network interface card, and then the throughput of lifting data server, the embodiment of the present invention also provides a kind of method, and the method comprises: described network interface card type comprises Intranet network interface card and outer net network interface card, in the process of write operation requests, between described multiple data servers, all use the network interface card identical with selected network interface card type to communicate connection.For example, in the time that the network interface card of selecting is Intranet, whole pipeline all uses Intranet network interface card to connect, and in the time that the network interface card of selecting is outer net, whole pipeline all uses outer net network interface card to connect.

Based on foregoing description, the embodiment of the present invention, taking system as example, is specifically set forth reading and writing data requesting method.

The embodiment of the present invention provides a kind of reading and writing data requesting method, and as shown in Figure 5, the method is applied to distributed memory system, and described distributed memory system comprises master server and data server, and described data server is provided with at least two network interface cards, comprising:

501, described data server sends the network interface card information of himself at least two network interface card to described master server.

502, described master server receives and stores described network interface card information.

503, client is obtained the network interface card information of data server information corresponding to reading and writing data request and at least two network interface cards of described data, services from described master server.

504, described client selects a network interface card to set up as data server and described client the selected network interface card that network is connected from described at least two network interface cards according to described network interface card information.

505, send reading and writing data request to described selected network interface card.

The embodiment of the present invention also provides a kind of reading and writing data requesting method, as shown in Figure 6, the method is applied to distributed memory system, and described distributed memory system comprises master server and data server, described data server is provided with at least two network interface cards, comprising:

601, described data server sends the network interface card information of himself at least two network interface card to described master server.

602, described master server receives and stores described network interface card information.

603, client sends to obtain in data server corresponding to reading and writing data request and data server to described master server and sets up with described client the request that network is connected network interface card.

604, described master server receives described request, and obtains the network interface card information of data server information corresponding to reading and writing data request and at least two network interface cards of described data server according to described request.

605, from described at least two network interface cards, select a network interface card to set up as data server and described client the selected network interface card that network is connected according to described network interface card information.

606, the network interface card information of the described data server information of obtaining and selected network interface card is sent to described client.

607, the data server information that described in described client, master server sends and the network interface card information of selected network interface card; And send reading and writing data request according to the network interface card information of described data server information and selected network interface card to described selected network interface card.

The embodiment of the present invention also provides a kind of reading and writing data requesting method, as shown in Figure 7, the method is applied to distributed memory system, and described distributed memory system comprises master server and data server, described data server is provided with at least two network interface cards, comprising:

701, client is obtained data server information corresponding to reading and writing data request from described master server.

702, described client sends the request of obtaining network interface card information to corresponding data server according to described data server information.

703, described data server receives after this request, obtains the network interface card information of himself at least two network interface card.

704, described network interface card information is sent to described client.

705, network interface card information described in described client selects a network interface card to set up as data server and described client the selected network interface card that network is connected from described at least two network interface cards according to described network interface card information.

706, send reading and writing data request to described selected network interface card.

It should be noted that, this distributed memory system can for but be not limited to Hadoop system, the embodiment of the present invention will be carried out the elaboration of specific embodiment as an example of Hadoop system example.

Wherein, as shown in Figure 8 and Figure 9, under Hdfs framework, Datanode is is data server from node to the Hdfs framework of Hadoop system; Namenode is that host node is master server, and client is client.Datanode machine can get by java api polylith (at least two) the network interface card information of this machine, i.e. multiple ip.Datanode in cluster can regularly all report the multiple network interface card information that get to NameNode, sets up a new data structure and store the mapping of each Datanode and multiple network interface card information thereof in NameNode.Based on above-mentioned mode of operation, Hdfs is applicable to the first and obtains the method for network interface card information.In Hdfs, realize the method for reading and writing data request, as shown in figure 10, comprising:

801, client sends out to NameNode Datanode information corresponding to piece that acquisition request need to be read and write.

802, Datanode and its multiple network interface card information are all informed client by NameNode.

803, client acquires multiple network interface card information of the Datanode of the request of next will setting up, by an algorithm, selects the network interface card that this time request is used.

804, client sends reading and writing data request to the network interface card of selecting.

Be otherwise noted that and writing process, because will set up the pipeline of many datanode, client choice for use outer net network interface card or Intranet network interface card, once selected, whole pipeline all uses the network interface card of same type to connect.Use Intranet network interface card as selected, whole pipeline all uses Intranet network interface card to connect; Use outer net network interface card as selected, whole pipeline all uses outer net network interface card to connect.

Wherein, the Hbase framework of Hadoop system as shown in figure 11, its composition and working principle is as follows: in the framework of Hbase, the memory cell of Hbase is region, when client will be read and write, to carry out to Hmaster the server machine at the corresponding region of acquisition request place, become RegionServer. then client connect and read and write to RegionServer.Under this framework, RegionServer is from node, i.e. data server, and Hmaster is host node, i.e. master server, client is client.Based on above-mentioned mode of operation, Hbase is applicable to the second and obtains the method for network interface card information.In Hdfs, realize the method for reading and writing data request, as shown in figure 12, comprising:

901, client is obtained the regionserver machine that will ask to Hmaster.

902, the regionserver machine of request is sent to client by Hmaster.

903, client sends the request of the network interface card information of obtaining this regionserver to regionserver by outer net.

904, the multiple network interface card information of oneself are sent to client by Regionserver.

905, the network interface card information that client Regionserver sends, and this network interface card information cache is arrived local.

906, the network interface card for connecting according to one of multiple network interface card Information Selection of getting.

907, send reading and writing data request to the network interface card of selecting.

Embodiments of the invention also provide a kind of client, this client application is in distributed memory system, and described distributed memory system comprises master server and data server, and described data server is provided with at least two network interface cards, as shown in figure 13, this client comprises:

The first acquiring unit 1001, for obtaining data server information corresponding to reading and writing data request from described master server; And obtain selected network interface card, described selected network interface card be at least two network interface cards of the data server corresponding from described reading and writing data request, choose set up for data server and client the network interface card that network is connected.

Transmitting element 1002, sends reading and writing data request for the selected network interface card obtaining to described acquiring unit.

Further, as shown in figure 14, described acquiring unit 1001 comprises in the time obtaining selected network interface card:

The first acquisition module 10011, for obtaining the network interface card information of at least two network interface cards of data server corresponding to reading and writing data request from described master server; Wherein, the first acquisition module 10011 comprises: send submodule, for sending the request of obtaining data server network interface card information corresponding to reading and writing data request to described master server, so that receiving the network interface card information of at least two network interface cards that after described request, the described server that reads and writes data reported, described master server feeds back to described client.First receives submodule, for the network interface card information of at least two network interface cards corresponding to server that read and write data described in receiving that described master server sends.

First selects module 10012, uses and from described at least two network interface cards, selects a network interface card as selected network interface card according to described network interface card information

Further, when select a network interface card as the selected network interface card of number from described at least two network interface cards according to described network interface card information, can adopt but be not limited to following mode, which comprises:

Further, as shown in figure 15, described acquiring unit 1001 comprises in the time obtaining selected network interface card:

The first sending module 10013, for send the request of obtaining selected network interface card to described master server, so that described master server receives after described request, the network interface card information of at least two network interface cards that report according to the described server that reads and writes data, from described at least two network interface cards, select a network interface card as selected network interface card, and the network interface card information of described selected network interface card is sent to described client.

The first receiver module 10014, for receiving the network interface card information of the selected network interface card that described master server sends, according to selected network interface card described in the described network interface card acquisition of information of institute.

Further, as shown in figure 16, described acquiring unit 1001 comprises in the time obtaining selected network interface card:

The second sending module 10015, for sending the request of obtaining network interface card information to data server corresponding to described reading and writing data request, so that data server corresponding to described reading and writing data request receiving the network interface card information of obtaining himself at least two network interface card after this request, and described network interface card information is fed back to described client.

The second receiver module 10016, for the network interface card information of himself at least two network interface card of receiving that data server corresponding to described reading and writing data request send.

Second selects module 10017, for selecting a network interface card as selected network interface card according to described network interface card information from described at least two network interface cards.

Further, as shown in figure 17, this client also comprises:

Memory cell 1003, for by the network interface card information cache of at least two network interface cards of the data server corresponding described reading and writing data request of obtaining at described client terminal local.

Further, as shown in figure 18, described acquisition module 1001 also comprises:

Checking module 10018, for checking whether described client terminal local stores the network interface card information of data server corresponding to described reading and writing data request.

Determination module 10019, in the time being checked through described client terminal local and storing the network interface card information of data server corresponding to described reading and writing data request, determines that whether the network interface card information of described client terminal local storage is effective.

The second sending module 10015 also for, in the time determining that the network interface card information of described client terminal local storage is invalid, the data server corresponding to described reading and writing data request sends the request of obtaining network interface card information.

The second acquisition module 10020, in the time that the network interface card information of determining described client terminal local storage is effective, obtains the network interface card information of at least two network interface cards of data server corresponding to described reading and writing data request from described client terminal local.

It should be noted that, relate to the associated description of all modules of client in the invention process, correspondence that can reference method part is described, and the embodiment of the present invention will repeat no more herein.

Embodiments of the invention also provide a kind of reading and writing data Request System, and as shown in figure 19, this reading and writing data Request System comprises master server 1101, data server 1102 and client as above 1103.

Described data server 1102 timings send heartbeat to described master server, keep the communication connection with described master server 1101.

Described master server 1101 receive the request of data server information corresponding to the reading and writing data request of obtaining that described client 1103 sends and obtain according to described request described in obtain the information of data server corresponding to reading and writing data request, the information of described data server is sent to described client 1103.

It should be noted that, the associated description of the each part of reading and writing data Request System relating in the invention process, can reference method part and the correspondence of client part describe, the embodiment of the present invention will repeat no more herein.

Reading and writing data requesting method of the present invention, client and system, in the time sending reading and writing data request to data server, make full use of at least two network interface cards of data server in distributed memory system, from described at least two network interface cards, select network interface card that load capacity is low as setting up with described client the network interface card that network is connected according to network interface card information, when multiple concurrent reading and writing requests are during for a data server, can make read-write requests be undertaken by different network interface cards, avoid multiple concurrent data read-write requests all to connect by same network interface card, solve network interface card and become the problem of reading and writing flow process bottleneck, promote to a certain extent the throughput of the transmission data of data server, and at least two network interface cards of data server in distributed memory system are fully used, have promoted the utilance of resource.

In the above-described embodiments, the description of each embodiment is all emphasized particularly on different fields, in certain embodiment, there is no the part of detailed description, can be referring to the associated description of other embodiment.

Be understandable that the correlated characteristic reference mutually in said method and device.In addition, " first ", " second " etc. in above-described embodiment are for distinguishing each embodiment, and do not represent the quality of each embodiment.

Those skilled in the art can be well understood to, for convenience and simplicity of description, the system of foregoing description, the specific works process of device and unit, can, with reference to the corresponding process in preceding method embodiment, not repeat them here.

The algorithm providing at this is intrinsic not relevant to any certain computer, virtual system or miscellaneous equipment with demonstration.Various general-purpose systems also can with based on using together with this teaching.According to description above, it is apparent constructing the desired structure of this type systematic.In addition, the present invention is not also for any certain programmed language.It should be understood that and can utilize various programming languages to realize content of the present invention described here, and the description of above language-specific being done is in order to disclose preferred forms of the present invention.

In the specification that provided herein, a large amount of details are described.But, can understand, embodiments of the invention can be put into practice in the situation that there is no these details.In some instances, be not shown specifically known method, structure and technology, so that not fuzzy understanding of this description.

Similarly, be to be understood that, in order to simplify the disclosure and to help to understand one or more in each inventive aspect, in the above in the description of exemplary embodiment of the present invention, each feature of the present invention is grouped together into single embodiment, figure or sometimes in its description.But, the method for the disclosure should be construed to the following intention of reflection: the present invention for required protection requires than the more feature of feature of clearly recording in each claim.Or rather, as reflected in claims below, inventive aspect is to be less than all features of disclosed single embodiment above.Therefore, claims of following embodiment are incorporated to this embodiment thus clearly, and wherein each claim itself is as independent embodiment of the present invention.

Those skilled in the art are appreciated that and can the module in the equipment in embodiment are adaptively changed and they are arranged in one or more equipment different from this embodiment.Module in embodiment or unit or assembly can be combined into a module or unit or assembly, and can put them in addition multiple submodules or subelement or sub-component.At least some in such feature and/or process or unit are mutually repelling, and can adopt any combination to combine all processes or the unit of disclosed all features in this specification (comprising claim, summary and the accompanying drawing followed) and disclosed any method like this or equipment.Unless clearly statement in addition, in this specification (comprising claim, summary and the accompanying drawing followed) disclosed each feature can be by providing identical, be equal to or the alternative features of similar object replaces.

In addition, those skilled in the art can understand, although embodiment more described herein comprise some feature instead of further feature included in other embodiment, the combination of the feature of different embodiment means within scope of the present invention and forms different embodiment.For example, in the following claims, the one of any of embodiment required for protection can be used with compound mode arbitrarily.

All parts embodiment of the present invention can realize with hardware, or realizes with the software module of moving on one or more processor, or realizes with their combination.It will be understood by those of skill in the art that and can use in practice microprocessor or digital signal processor (DSP) to realize according to the some or all functions of the some or all parts in reading and writing data requesting method, client and the system of the embodiment of the present invention.The present invention can also be embodied as part or all equipment or the device program (for example, computer program and computer program) for carrying out method as described herein.Realizing program of the present invention and can be stored on computer-readable medium like this, or can there is the form of one or more signal.Such signal can be downloaded and obtain from internet website, or provides on carrier signal, or provides with any other form.

It should be noted above-described embodiment the present invention will be described instead of limit the invention, and those skilled in the art can design alternative embodiment in the case of not departing from the scope of claims.In the claims, any reference symbol between bracket should be configured to limitations on claims.Word " comprises " not to be got rid of existence and is not listed as element or step in the claims.Being positioned at word " " before element or " one " does not get rid of and has multiple such elements.The present invention can be by means of including the hardware of some different elements and realizing by means of the computer of suitably programming.In the unit claim of having enumerated some clients, several in these clients can be to carry out imbody by same hardware branch.The use of word first, second and C grade does not represent any order.Can be title by these word explanations.

The invention discloses A1, a kind of reading and writing data requesting method, be applied to distributed memory system, described distributed memory system comprises master server and data server, and described data server is provided with at least two network interface cards, comprising:

A2, according to the method described in A1, described in obtain selected network interface card and comprise:

Obtain the network interface card information of at least two network interface cards of data server corresponding to reading and writing data request from described master server;

From described at least two network interface cards, select a network interface card as selected network interface card according to described network interface card information.

A3, according to the method described in A2, the network interface card information of obtaining at least two network interface cards of data server corresponding to reading and writing data request from described master server specifically comprises:

Send the request of obtaining data server network interface card information corresponding to reading and writing data request to described master server, so that described master server receives after described request, the network interface card information of at least two network interface cards that the described server that reads and writes data is reported feeds back to described client;

The network interface card information of at least two network interface cards corresponding to server reads and writes data described in receiving that described master server sends.

A4, according to the method described in A1, described in obtain selected network interface card and comprise:

Send the request of obtaining selected network interface card to described master server, so that described master server receives after described request, the network interface card information of at least two network interface cards that report according to the described server that reads and writes data, from described at least two network interface cards, select a network interface card as selected network interface card, and the network interface card information of described selected network interface card is sent to described client;

A5, according to the method described in A1, described in obtain selected network interface card and comprise:

The data server corresponding to described reading and writing data request sends the request of obtaining network interface card information, so that data server corresponding to described reading and writing data request receiving the network interface card information of obtaining himself at least two network interface card after this request, and described network interface card information is fed back to described client;

The network interface card information of himself at least two network interface card that receives that data server corresponding to described reading and writing data request send;

A6, according to the method described in A5, after the network interface card information of himself at least two network interface card that receives that data server corresponding to described reading and writing data request send, also comprise:

By the network interface card information cache of at least two network interface cards of the data server corresponding described reading and writing data request of obtaining at described client terminal local.

A7, according to the method described in A6, before the data server corresponding to described reading and writing data request sends and obtain the request of network interface card information, also comprise:

Check whether described client terminal local stores the network interface card information of data server corresponding to described reading and writing data request;

If exist, determine that whether the network interface card information of described client terminal local storage is effective;

If invalid, carry out to data server corresponding to described reading and writing data request and send the request of obtaining network interface card information;

If effectively, obtain the network interface card information of at least two network interface cards of data server corresponding to described reading and writing data request from described client terminal local.

A8, according to the method described in A2, A4, A5 any one, from described at least two network interface cards, select a network interface card specifically to comprise as selected network interface card according to described network interface card information:

From described at least two network interface cards, select network interface card that load capacity is low as selected network interface card according to described network interface card information;

A9, according to the method described in A8, the utilance of described network interface card packets of information purse rope card, from described at least two network interface cards, select a low network interface card of load capacity to be specially as selected network interface card according to described network interface card information:

According to the utilance of network interface card, from described at least two network interface cards, select network interface card that load capacity is low as selected network interface card.

A10, according to the method described in A9, described network interface card information also comprises network interface card type, described network interface card type comprises Intranet network interface card and outer net network interface card, in the process of write operation requests, all uses the network interface card identical with selected network interface card type to communicate connection between described multiple data servers.

The open B1 of the present invention, a kind of client, be applied to distributed memory system, and described distributed memory system comprises master server and data server, and described data server is provided with at least two network interface cards, comprising:

B2, according to the client described in B1, described acquiring unit comprises in the time obtaining the selected network interface card of number:

The first acquisition module, for obtaining the network interface card information of at least two network interface cards of data server corresponding to reading and writing data request from described master server;

First selects module, uses and from described at least two network interface cards, selects a network interface card as selected network interface card according to described network interface card information.

B3, according to the client described in B2, the first acquisition module comprises:

Send submodule, for sending the request of obtaining data server network interface card information corresponding to reading and writing data request to described master server, so that described master server receives after described request, the network interface card information of at least two network interface cards that the described server that reads and writes data is reported feeds back to described client;

Receive submodule, for the network interface card information of at least two network interface cards corresponding to server that read and write data described in receiving that described master server sends.

B4, according to the client described in B1, described acquiring unit comprises in the time obtaining the selected network interface card of number:

The first sending module, for send the request of obtaining selected network interface card to described master server, so that described master server receives after described request, the network interface card information of at least two network interface cards that report according to the described server that reads and writes data, from described at least two network interface cards, select a network interface card as selected network interface card, and the network interface card information of described selected network interface card is sent to described client;

The first receiver module, for receiving the network interface card information of the selected network interface card that described master server sends, according to selected network interface card described in the described network interface card acquisition of information of institute.

B5, according to the client described in B1, described acquiring unit comprises in the time obtaining the selected network interface card of number:

The second sending module, for sending the request of obtaining network interface card information to data server corresponding to described reading and writing data request, so that data server corresponding to described reading and writing data request receiving the network interface card information of obtaining himself at least two network interface card after this request, and described network interface card information is fed back to described client;

The second receiver module, for the network interface card information of himself at least two network interface card of receiving that data server corresponding to described reading and writing data request send;

Second selects module, for selecting a network interface card as selected network interface card according to described network interface card information from described at least two network interface cards.

B6, according to the client described in B5, also comprise:

Memory cell, for by the network interface card information cache of at least two network interface cards of the data server corresponding described reading and writing data request of obtaining at described client terminal local.

B7, according to the client described in B6, described acquiring unit also comprises:

Checking module, for checking whether described client terminal local stores the network interface card information of data server corresponding to described reading and writing data request;

Determination module, in the time being checked through described client terminal local and storing the network interface card information of data server corresponding to described reading and writing data request, determines that whether the network interface card information of described client terminal local storage is effective;

Described the second sending module also for, in the time determining that the network interface card information of described client terminal local storage is invalid, the data server corresponding to described reading and writing data request sends the request of obtaining network interface card information;

The second acquisition module, in the time that the network interface card information of determining described client terminal local storage is effective, obtains the network interface card information of at least two network interface cards of data server corresponding to described reading and writing data request from described client terminal local.

B8, according to the client described in B2, B4, B5 any one, from described at least two network interface cards, select a network interface card specifically to comprise as selected network interface card according to described network interface card information:

B9, according to the client described in B8, when the utilance of described network interface card packets of information purse rope card, according to the utilance of network interface card, from described at least two network interface cards, select the low network interface card of load as selected network interface card.

The invention discloses C1, a kind of reading and writing data Request System, comprise master server, data server and the client as described in B1-B9 any one;

Described master server receives the request of obtaining server info corresponding to reading and writing data request that described client sends, and obtain the information of data server corresponding to described reading and writing data request according to described request, the information of described data server is sent to described client.

The invention discloses D1, a kind of reading and writing data requesting method, be applied to distributed memory system, described distributed memory system comprises master server and data server, and described data server is provided with at least two network interface cards, comprising:

The invention discloses E1, a kind of reading and writing data requesting method, be applied to distributed memory system, described distributed memory system comprises master server and data server, and described data server is provided with at least two network interface cards, comprising:

The invention discloses F1, a kind of reading and writing data requesting method, be applied to distributed memory system, described distributed memory system comprises master server and data server, and described data server is provided with at least two network interface cards, comprising:

Claims

1. a reading and writing data requesting method, is applied to distributed memory system, and described distributed memory system comprises master server and data server, and described data server is provided with at least two network interface cards, it is characterized in that, comprising:

2. method according to claim 1, is characterized in that, described in obtain selected network interface card and comprise:

3. method according to claim 2, is characterized in that, the network interface card information of obtaining at least two network interface cards of data server corresponding to reading and writing data request from described master server specifically comprises:

4. a client, is applied to distributed memory system, and described distributed memory system comprises master server and data server, and described data server is provided with at least two network interface cards, it is characterized in that, comprising:

5. client according to claim 4, is characterized in that, described acquiring unit comprises in the time obtaining the selected network interface card of number:

6. client according to claim 5, is characterized in that, the first acquisition module comprises:

7. a reading and writing data Request System, is characterized in that, comprises master server, data server and the client as described in claim 4-6 any one;

8. a reading and writing data requesting method, is applied to distributed memory system, and described distributed memory system comprises master server and data server, and described data server is provided with at least two network interface cards, it is characterized in that, comprising:

9. a reading and writing data requesting method, is applied to distributed memory system, and described distributed memory system comprises master server and data server, and described data server is provided with at least two network interface cards, it is characterized in that, comprising:

10. a reading and writing data requesting method, is applied to distributed memory system, and described distributed memory system comprises master server and data server, and described data server is provided with at least two network interface cards, it is characterized in that, comprising: