CN104125303B - Reading and writing data requesting method, client and system - Google Patents
Reading and writing data requesting method, client and system Download PDFInfo
- Publication number
- CN104125303B CN104125303B CN201410397365.2A CN201410397365A CN104125303B CN 104125303 B CN104125303 B CN 104125303B CN 201410397365 A CN201410397365 A CN 201410397365A CN 104125303 B CN104125303 B CN 104125303B
- Authority
- CN
- China
- Prior art keywords
- network interface
- interface card
- client
- data server
- information
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000000034 method Methods 0.000 title claims abstract description 103
- 230000005540 biological transmission Effects 0.000 claims abstract description 38
- 238000003860 storage Methods 0.000 claims description 17
- 238000004891 communication Methods 0.000 claims description 5
- 238000005516 engineering process Methods 0.000 abstract description 4
- 238000013500 data storage Methods 0.000 abstract description 2
- 230000000875 corresponding effect Effects 0.000 description 99
- 238000009826 distribution Methods 0.000 description 9
- 238000010586 diagram Methods 0.000 description 6
- 230000008901 benefit Effects 0.000 description 5
- 230000002452 interceptive effect Effects 0.000 description 4
- 238000013507 mapping Methods 0.000 description 3
- 238000004590 computer program Methods 0.000 description 2
- 230000002596 correlated effect Effects 0.000 description 1
- 238000013461 design Methods 0.000 description 1
- 230000006870 function Effects 0.000 description 1
- 238000007430 reference method Methods 0.000 description 1
Landscapes
- Computer And Data Communications (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
The invention discloses a kind of reading and writing data requesting method, client and systems, are related to a kind of data storage technology, solve the problems, such as that network interface card becomes read-write flow bottlenecks, improve the handling capacity of the transmission data of data server to a certain extent.The method of the present invention is applied to distributed memory system, and the distributed memory system includes master server and data server, and the data server is provided at least two network interface cards, includes mainly：Client obtains reading and writing data from master server and asks corresponding data server information；It obtains and selectes network interface card, the selected network interface card is that the network interface card chosen from least two network interface cards that the reading and writing data asks corresponding data server establishes the network interface card of network connection for data server with client；To the selected network interface card transmission data read-write requests.The embodiment of the present invention is mainly used for during reading and writing data.
Description
Technical field
The present invention relates to a kind of data storage technologies, more particularly to a kind of reading and writing data requesting method, client and are
System.
Background technology
Distributed basis framework (Hadoop) of increasing income is a distributed system architecture of apache foundations exploitation, thirdly
A main sub-project is respectively Hadoop distributed file systems (Hadoop Distributed Filesystem, HDFS),
MapReduce, Hbase.In the distributed storing framework, there are a host nodes and multiple from node.From node timing to
Host node, which is sent, maintains communication between heartbeat, with host node.Client machine can be to from set of node pocket transmission read-write requests.It is existing
Some realizes that the scheme of read-write operation is：It when client initiates read-write operation request, is first asked to host node, host node informs visitor
The asked read-write operation in family end is corresponding from node, and client is connected with corresponding established from node again, and then completes data
Read-write requests process.Entirely interactive process walks a certain specific network interface card, generally outer net network interface card with all operations from node.
In actual storage scene, generally it is multiple client while is concurrently written and read, mass-sended to from set of node
Reading and writing data is sent to ask.If the concurrent data read-write requests of multiple client are fallen from same from node in node cluster
On, concurrent data read-write requests multiple in this way can only establish network connection by this same network interface card from node.By
It is fixed in the network of network interface card transmission speed of reaching the standard grade, as Gigabit Ethernet transmitted data amount per second is reached the standard grade as 1000Mb.So
Under more concurrent data read-write requests, network interface card is likely to become the bottleneck of read-write flow.
Invention content
In view of the above problems, it is proposed that the present invention overcoming the above problem in order to provide one kind or solves at least partly
State reading and writing data requesting method, client and the system of problem.
According to the present invention on one side, a kind of reading and writing data requesting method is provided, is applied to distributed memory system, institute
It includes master server and data server to state distributed memory system, and the data server is provided at least two network interface cards, packet
It includes：
Client obtains reading and writing data from the master server and asks corresponding data server information；
It obtains and selectes network interface card, the selected network interface card is to ask at least the two of corresponding data server from the reading and writing data
That is chosen in a network interface card establishes the network interface card of network connection for data server with client；
To the selected network interface card transmission data read-write requests.
Another aspect of the invention provides a kind of client, is applied to distributed memory system, the distributed storage
System includes master server and data server, and the data server is provided at least two network interface cards, including：
Acquiring unit asks corresponding data server information for obtaining reading and writing data from the master server；And it obtains
It is to be selected from least two network interface cards that the reading and writing data asks corresponding data server to take selected network interface card, the selected network interface card
What is taken establishes the network interface card of network connection for data server with client；
Transmission unit, the selected network interface card transmission data read-write requests for being obtained to the acquiring unit.
Another aspect of the invention, provides a kind of reading and writing data Request System, including master server, data server and
Client as described above；
The data server timing sends heartbeat to the master server, keeps the communication link with the master server
It connects；
The master server receives the acquisition reading and writing data that the client is sent and asks corresponding data server information
Request, and ask according to reading and writing data described in the acquisition request information of corresponding data server, the data taken
The information of business device is sent to the client.
Another aspect of the invention provides a kind of reading and writing data requesting method, is applied to distributed memory system, described
Distributed memory system includes master server and data server, and the data server is provided at least two network interface cards, including：
The data server sends the network interface card information of its own at least two network interface card to the master server；
The master server receives and stores the network interface card information；
Client obtains reading and writing data from the master server and asks corresponding data server information and the data
Service the network interface card information of at least two network interface cards；
The client selects a network interface card to be taken as data according to the network interface card information from least two network interface card
Business device establishes the selected network interface card of network connection with the client；
To the selected network interface card transmission data read-write requests.
Another aspect of the invention provides a kind of reading and writing data requesting method, is applied to distributed memory system, described
Distributed memory system includes master server and data server, and the data server is provided at least two network interface cards, including：
The data server sends the network interface card information of its own at least two network interface card to the master server；
The master server receives and stores the network interface card information；
Client is sent to the master server obtains the corresponding data server of reading and writing data request and data service
The request of network connection network interface card is established in device with the client；
The master server receives the request, and asks corresponding data service according to the acquisition request reading and writing data
The network interface card information of at least two network interface card of device information and the data server；According to the network interface card information from described at least two
A network interface card is selected to establish the selected network interface card of network connection as data server and the client in network interface card, by the institute of acquisition
The network interface card information for stating data server information and selected network interface card is sent to the client；
The client receives the network interface card information of data server information and selected network interface card that the master server is sent；And
According to the data server information and the network interface card information of selected network interface card to the selected network interface card transmission data read-write requests.
Another aspect of the invention provides a kind of reading and writing data requesting method, is applied to distributed memory system, described
Distributed memory system includes master server and data server, and the data server is provided at least two network interface cards, including：
Client obtains reading and writing data from the master server and asks corresponding data server information；
The client sends to corresponding data server according to the data server information and obtains network interface card information
Request；
After the data server receives the request, the network interface card information of its own at least two network interface card is obtained, and by institute
It states network interface card information and is sent to the client；
The client receives the network interface card information, and one is selected from least two network interface card according to the network interface card information
A network interface card establishes the selected network interface card of network connection as data server and the client, and sends number to the selected network interface card
According to read-write requests.
By above-mentioned technical proposal, technical solution provided in an embodiment of the present invention at least has following advantages：
Reading and writing data requesting method, client and the system of the present invention, to data server transmission data read-write requests
When, at least two network interface cards of data server in distributed memory system are made full use of, are selected from least two network interface card
One network interface card is as the network interface card for establishing network connection with the client, when the request of multiple concurrent reading and writings is directed to a data service
When device, read-write requests can be made to be carried out by different network interface cards, avoid multiple concurrent data read-write requests all by same
Network interface card establishes connection, solves the problems, such as that network interface card becomes read-write flow bottlenecks, improves data server to a certain extent
The handling capacity of transmission data；And at least two network interface cards of data server in distributed memory system is made to obtain abundant profit
With improving the utilization rate of resource.
Above description is only the general introduction of technical solution of the present invention, in order to better understand the technical means of the present invention,
And can be implemented in accordance with the contents of the specification, and in order to allow above and other objects of the present invention, feature and advantage can
It is clearer and more comprehensible, below the special specific implementation mode for lifting the present invention.
Description of the drawings
By reading the detailed description of hereafter preferred embodiment, various other advantages and benefit are common for this field
Technical staff will become clear.Attached drawing only for the purpose of illustrating preferred embodiments, and is not considered as to the present invention
Limitation.And throughout the drawings, the same reference numbers will be used to refer to the same parts.In the accompanying drawings：
Fig. 1 shows a kind of reading and writing data requesting method flow chart provided in an embodiment of the present invention；
Fig. 2 shows a kind of method flow diagrams obtaining network interface card information provided in an embodiment of the present invention；
Fig. 3 shows another method flow diagram for obtaining network interface card information provided in an embodiment of the present invention；
Fig. 4 shows another method flow diagram for obtaining network interface card information provided in an embodiment of the present invention；
Fig. 5 shows a kind of reading and writing data requesting method interactive operation flow chart provided in an embodiment of the present invention；
Fig. 6 shows another reading and writing data requesting method interactive operation flow chart provided in an embodiment of the present invention；
Fig. 7 shows another reading and writing data requesting method interactive operation flow chart provided in an embodiment of the present invention；
Fig. 8 shows the write operation schematic diagram under Hdfs frames provided in an embodiment of the present invention；
Fig. 9 shows the read operation schematic diagram under Hdfs frames provided in an embodiment of the present invention；
Figure 10 shows reading and writing data requesting method flow chart under Hdfs frames provided in an embodiment of the present invention；
Figure 11 shows the read-write operation schematic diagram under Hbase frames provided in an embodiment of the present invention；
Figure 12 shows reading and writing data requesting method flow chart under Hbase frames provided in an embodiment of the present invention；
Figure 13 shows the composition frame chart of another client provided in an embodiment of the present invention；
Figure 14 shows the composition frame chart of another client provided in an embodiment of the present invention；
Figure 15 shows the composition frame chart of another client provided in an embodiment of the present invention；
Figure 16 shows the composition frame chart of another client provided in an embodiment of the present invention；
Figure 17 shows the composition frame charts of another client provided in an embodiment of the present invention；
Figure 18 shows the composition frame chart of another client provided in an embodiment of the present invention；
Figure 19 shows the composition frame chart of reading and writing data Request System provided in an embodiment of the present invention.
Specific implementation mode
The exemplary embodiment of the disclosure is more fully described below with reference to accompanying drawings.Although showing the disclosure in attached drawing
Exemplary embodiment, it being understood, however, that may be realized in various forms the disclosure without should be by embodiments set forth here
It is limited.On the contrary, these embodiments are provided to facilitate a more thoroughly understanding of the present invention, and can be by the scope of the present disclosure
Completely it is communicated to those skilled in the art.
The embodiment of the present invention provides a kind of reading and writing data requesting method, is applied to distributed memory system, the distribution
Formula storage system includes master server and data server, and the data server is provided at least two network interface cards, such as Fig. 1 institutes
Show, this method includes：Including：
101, client obtains reading and writing data from the master server and asks corresponding data server information.
Wherein, client obtains the corresponding data server information of reading and writing data request from the master server and may be used
But it is not limited to the following method realization, this method includes：
Client sends the request for obtaining reading and writing data and asking corresponding data server information to the master server, described
Master server receives the request of the client and asks corresponding data service according to reading and writing data described in the acquisition request
The information of the data server is sent to the client by the information of device；Client receives what the master server was sent
The reading and writing data asks corresponding data server information.
102, obtain select network interface card, the selected network interface card be from the reading and writing data ask corresponding data server to
That is chosen in few two network interface cards establishes the network interface card of network connection for data server with client.
It should be noted that client, based on the difference of its residing network architecture, may be used when obtaining selected network interface card
But it is not limited to three kinds of methods below：
The first, obtains from the master server and selectes network interface card.
Second, at least two network interface cards of corresponding data server are asked from master server acquisition reading and writing data
Network interface card information, and select a network interface card as selected network interface card from least two network interface card according to the network interface card information.
The third, asks corresponding data server to obtain at least two network interface card of data server from the reading and writing data
Network interface card information, and select a network interface card as selected network interface card from least two network interface card according to the network interface card information.
When network architecture residing for the client is following this kind of situation, obtained using the first or second method selected
Network interface card：Data server obtains the network interface card information of at least two network interface cards of itself, and is periodically reported to master server, master server
According to the network interface card information of the data server of report, establish a new data structure store each data server and its
The mapping of the network interface card information of corresponding at least two pieces network interface cards.
When network architecture residing for the client is following this kind of situation, is obtained using the third method and select network interface card：Number
The network interface card information of at least two network interface cards of itself is obtained according to server, and is stored in local.
103, to the selected network interface card transmission data read-write requests.
When using first method, the embodiment of the present invention provides a kind of method for obtaining and selecting network interface card, and this method can
Think but be not limited to following methods, specifically includes：
It is sent to the master server and obtains the request for selecting network interface card, so that the master server receives the request
Afterwards, the network interface card information of at least two network interface cards reported according to the read-write data server, is selected from least two network interface card
A network interface card is selected as selected network interface card, and the network interface card information of the selected network interface card is sent to the client.Wherein, it needs
Bright, it can be the request individually sent to master server that this, which sends to the master server and obtains the request of selected network interface card,
Can also be to carry asking in sending acquisition reading and writing data to the master server and asking the request of corresponding data server
It asks, specific it is not limited by the embodiments of the present invention.
The network interface card information for receiving the selected network interface card that the master server is sent obtains the choosing according to institute's network interface card information
Determine network interface card.
When using second method, the embodiment of the present invention provides a kind of method for obtaining and selecting network interface card, such as Fig. 2 institutes
Show, this method includes：
201, client sends the request for obtaining reading and writing data and asking corresponding data server to the master server.
It should be noted that under this kind of pattern, data server obtains the network interface card information of at least two pieces network interface cards of itself,
And periodically reported to master server, master server establishes a new data according to the network interface card information of the data server of report
Structure stores the mapping of the network interface card information of each data server and its corresponding at least two pieces network interface card.It is receiving
After the request that client is sent, master server determines the corresponding data server of the request, and should to inquiry in the table
The network interface card information of corresponding at least two network interface card of data server；After the network interface card information for obtaining the data server, by this
The network interface card information of corresponding data server and at least two network interface card of data server is asked to be sent to the visitor of request together
Family end.
202, client receives the information for the read-write data server that the master server is sent and the read-write number
According to the network interface card information of corresponding at least two network interface card of server.
203, client selects a network interface card as selected net according to the network interface card information from least two network interface card
Card.
Certainly, the net that reading and writing data asks at least two network interface card of corresponding data server is being obtained from the master server
When card information, in addition to the method described above, client can also after obtaining corresponding data server from master server,
The request for individually sending the network interface card information for obtaining corresponding data service to master server again, to obtain data server at least two
The network interface card information of a network interface card.For the embodiment of the present invention to this without limiting, any type method may be used to implementation of the present invention
In.
When obtaining selected network interface card using the third method, the embodiment of the present invention provides a kind of side for obtaining and selecting network interface card
Method, as shown in figure 3, this method includes：
301, client asks the request of corresponding data server transmission acquisition network interface card information to the reading and writing data, with
Toilet states the net that reading and writing data asks corresponding data server to obtain its own at least two network interface card upon receiving the request
Card information, and the network interface card information is fed back into the client；
302, client receives its own at least two net that the reading and writing data asks corresponding data server to send
The network interface card information of card.
303, client selects a network interface card as selected net according to the network interface card information from least two network interface card
Card.
Further, after obtaining network interface card information, network interface card information is buffered in client local by client, until next time
When read-write requests, if the network interface card information is also effective, no longer need to establish connection acquisition network interface card information to corresponding data server.
Storage based on the network interface card information, the embodiment of the present invention provides a kind of method for obtaining and selecting network interface card, such as Fig. 4 institutes
Show, this method includes：
401, check whether the client is locally stored with the net that the reading and writing data asks corresponding data server
Card information；If in the presence of executing 402；If being not present, 403 are executed.
402, determine whether the network interface card information that the client is locally stored is effective；If invalid, 403 are executed；If effectively,
Then execute 405.
Wherein it is determined that the network interface card information that is locally stored of the client whether effectively can by but be not limited to below
Method realizes that this method is：Client is connected to the network interface card transmission data read-write requests with being established with data server；If
Establish connection failure, it is determined that the network interface card information failure that client is locally stored；If establishing successful connection, it is determined that client sheet
The network interface card information of ground storage is effective.
In addition to the method described above, the network interface card information effective time limit can also be set, when determining validity, check its setting
Term of validity whether be already expired, if term of validity is already expired, it is determined that the failure of network interface card information that client is locally stored；If the term of validity
Limit no mistake, it is determined that the network interface card that client is locally stored is effective.
403, the request of corresponding data server transmission acquisition network interface card information is asked to the reading and writing data.
404, the net for its own at least two network interface card that the reading and writing data asks corresponding data server to send is received
Card information.Later, 406 are executed.
405, the reading and writing data is locally obtained from the client ask corresponding at least two network interface card of data server
Network interface card information.Later, 406 are executed.
406, select a network interface card as selected network interface card from least two network interface card according to the network interface card information.
Further, selecting a network interface card as selected net from least two network interface card according to the network interface card information
When card, the following method, this method may be employed without limitation of to include：
The network interface card for selecting a load capacity low from least two network interface card according to the network interface card information is as selected net
Card.Wherein, the network interface card information includes the utilization rate of network interface card, is selected from least two network interface card according to the network interface card information
It, can be according to the utilization rate of network interface card, from least two network interface card when selecting the low network interface card of a load capacity as network interface card is selected
The network interface card for selecting a load capacity low is as selected network interface card.
Or a network interface card is randomly choosed as selected network interface card from least two network interface card according to the network interface card information.
Further, process is being write, because to establish the pipeline of more data servers, in order to improve the utilization of network interface card
Rate, and then the handling capacity of data server is promoted, the embodiment of the present invention also provides a kind of method, and this method includes：The network interface card
Type includes Intranet network interface card and outer net network interface card, during write operation requests, is used between the multiple data server
Network interface card identical with selected network interface card type is communicatively coupled.For example, when the network interface card of selection is Intranet, entire pipeline is equal
It is established and is connected using Intranet network interface card, when the network interface card of selection is outer net, entire pipeline uses outer net network interface card to establish connection.
Based on foregoing description, the embodiment of the present invention is specifically described reading and writing data requesting method by taking system as an example.
An embodiment of the present invention provides a kind of reading and writing data requesting methods, as shown in figure 5, this method is deposited applied to distribution
Storage system, the distributed memory system include master server and data server, and the data server is provided at least two
A network interface card, including：
501, the data server sends the network interface card information of its own at least two network interface card to the master server.
502, the master server receives and stores the network interface card information.
503, client obtains reading and writing data from the master server and asks corresponding data server information and described
The network interface card information of at least two network interface card of data service.
504, the client selects a network interface card as number according to the network interface card information from least two network interface card
The selected network interface card of network connection is established according to server and the client.
505, to the selected network interface card transmission data read-write requests.
The embodiment of the present invention additionally provides a kind of reading and writing data requesting method, as shown in fig. 6, this method is applied to distribution
Storage system, the distributed memory system include master server and data server, and the data server is provided at least
Two network interface cards, including：
601, the data server sends the network interface card information of its own at least two network interface card to the master server.
602, the master server receives and stores the network interface card information.
603, client is sent to the master server obtains the corresponding data server of reading and writing data request and data
The request of network connection network interface card is established in server with the client.
604, the master server receives the request, and asks corresponding data according to the acquisition request reading and writing data
The network interface card information of at least two network interface card of server info and the data server.
605, selected from least two network interface card according to the network interface card information network interface card as data server with
The client establishes the selected network interface card of network connection.
606, the network interface card information of the data server information of acquisition and selected network interface card is sent to the client.
607, the client receives the network interface card letter of data server information and selected network interface card that the master server is sent
Breath；And it is asked to the selected network interface card transmission data read-write according to the data server information and the network interface card information of selected network interface card
It asks.
The embodiment of the present invention additionally provides a kind of reading and writing data requesting method, as shown in fig. 7, this method is applied to distribution
Storage system, the distributed memory system include master server and data server, and the data server is provided at least
Two network interface cards, including：
701, client obtains reading and writing data from the master server and asks corresponding data server information.
702, the client sends to corresponding data server according to the data server information and obtains network interface card letter
The request of breath.
703, after the data server receives the request, the network interface card information of its own at least two network interface card is obtained.
704, the network interface card information is sent to the client.
705, the client receives the network interface card information, is selected from least two network interface card according to the network interface card information
Select the selected network interface card that a network interface card establishes network connection as data server and the client.
706, to the selected network interface card transmission data read-write requests.
It should be noted that the distributed memory system can be but be not limited to Hadoop system, the embodiment of the present invention
The elaboration of specific embodiment will be carried out by taking Hadoop system as an example.
Wherein, the Hdfs frames of Hadoop system are as shown in Figure 8 and Figure 9, and under Hdfs frames, Datanode is from node
That is data server；Namenode is host node, that is, master server, and client is client.Datanode machines can pass through
Java api get polylith (at least two pieces) network interface card information of machine, i.e., multiple ip.Datanode in cluster can be regular
The multiple network interface card informations got are reported to NameNode, a new data structure is established in NameNode to store
The mapping of each Datanode and its multiple network interface card informations.Based on above-mentioned operating mode, Hdfs is suitable for the first acquisition network interface card
The method of information.The method that reading and writing data request is realized in Hdfs, as shown in Figure 10, including：
801, client needs the corresponding Datanode information of block read and write to NameNode hair acquisition requests.
802, Datanode and its multiple network interface card information are informed client by NameNode.
803, client acquires the multiple network interface card informations for the Datanode that next establish request, is calculated by one
Used network interface card is this time asked in method, selection.
804, network interface card transmission data read-write requests of the client to selection.
It is otherwise noted that and is writing process, because to establish the pipeline of more datanode, client selection uses outer net
Network interface card or Intranet network interface card, once selected, then entire pipeline establishes connection using same type of network interface card.Make as selected
With Intranet network interface card, then entire pipeline is using the foundation connection of Intranet network interface card；It is such as selected to use outer net network interface card, then entirely
Pipeline uses outer net network interface card to establish connection.
Wherein, the Hbase frames of Hadoop system are as shown in figure 11, and composition and working principle is as follows：In the frame of Hbase
In frame, the storage unit of Hbase is region, when client will be written and read, acquisition is made requests on to Hmaster and is corresponded to
Server machines where region, becoming RegionServer., then client establishes connection progress to RegionServer
Read-write.Under the frame, RegionServer is from node, i.e. data server, and Hmaster is host node, i.e. master server,
Client is client.Based on above-mentioned operating mode, Hbase is suitable for second of method for obtaining network interface card information.In Hdfs
The method for realizing reading and writing data request, as shown in figure 12, including：
901, client obtains the regionserver machines to be asked to Hmaster.
902, the regionserver machines of request are sent to client by Hmaster.
903, client sends asking for the network interface card information for obtaining the regionserver by outer net to regionserver
It asks.
904, the multiple network interface card informations of oneself are sent to client by Regionserver.
905, client receives the network interface card information that Regionserver is sent, and the network interface card information is cached to local.
906, one piece of network interface card for establishing connection is selected according to the multiple network interface card informations got.
907, to the network interface card transmission data read-write requests of selection.
The embodiment of the present invention also provides a kind of client, and the client application is in distributed memory system, the distribution
Formula storage system includes master server and data server, and the data server is provided at least two network interface cards, such as Figure 13 institutes
Show, which includes：
First acquisition unit 1001 asks corresponding data server letter for obtaining reading and writing data from the master server
Breath；And obtain and select network interface card, the selected network interface card is that at least two of corresponding data server is asked from the reading and writing data
That is chosen in network interface card establishes the network interface card of network connection for data server with client.
Transmission unit 1002, the selected network interface card transmission data read-write requests for being obtained to the acquiring unit.
Further, as shown in figure 14, the acquiring unit 1001 includes when obtaining selected network interface card：
First acquisition module 10011 asks corresponding data server for obtaining reading and writing data from the master server
The network interface card information of at least two network interface cards；Wherein, the first acquisition module 10011 includes：Sending submodule is used for the main service
Device, which is sent, obtains the request that reading and writing data asks corresponding data server network interface card information, so that the master server receives institute
It states and the network interface card information at least two network interface cards that the read-write data server reports is fed back into the client after asking.First
Receiving submodule, the net for receiving corresponding at least two network interface card of the read-write data server that the master server is sent
Card information.
First choice module 10012 selects a network interface card with according to the network interface card information from least two network interface card
As selected network interface card
Further, selected a network interface card selected as number from least two network interface card according to the network interface card information
When network interface card, the mode below, which may be employed without limitation of to include：
The network interface card for selecting a load capacity low from least two network interface card according to the network interface card information is as selected net
Card.Wherein, the network interface card information includes the utilization rate of network interface card, is selected from least two network interface card according to the network interface card information
It, can be according to the utilization rate of network interface card, from least two network interface card when selecting the low network interface card of a load capacity as network interface card is selected
The network interface card for selecting a load capacity low is as selected network interface card.
Or a network interface card is randomly choosed as selected network interface card from least two network interface card according to the network interface card information.
Further, as shown in figure 15, the acquiring unit 1001 includes when obtaining selected network interface card：
First sending module 10013 obtains the request for selecting network interface card, so as to the master for being sent to the master server
After server receives the request, according to the network interface card information of at least two network interface cards that the read-write data server reports, from
It selects a network interface card as selected network interface card at least two network interface card, and the network interface card information of the selected network interface card is sent to institute
State client.
First receiving module 10014, the network interface card information for receiving the selected network interface card that the master server is sent, according to institute
The network interface card information obtains the selected network interface card.
Further, as shown in figure 16, the acquiring unit 1001 includes when obtaining selected network interface card：
Second sending module 10015 obtains network interface card for asking corresponding data server to send to the reading and writing data
The request of information, so that the reading and writing data asks corresponding data server to obtain its own upon receiving the request at least
The network interface card information of two network interface cards, and the network interface card information is fed back into the client.
Second receiving module 10016, for receiving that the reading and writing data asks that corresponding data server sends its from
The network interface card information of at least two network interface card of body.
Second selecting module 10017, for selecting a net from least two network interface card according to the network interface card information
Card is as selected network interface card.
Further, as shown in figure 17, which further includes：
Storage unit 1003, at least two nets for the reading and writing data obtained to be asked to corresponding data server
It is local that the network interface card information of card is buffered in the client.
Further, as shown in figure 18, the acquisition module 1001 further includes：
Module 10018 is checked, for checking it is corresponding whether the client is locally stored with the reading and writing data request
The network interface card information of data server.
Determining module 10019, for that reading and writing data request has been locally stored to be corresponding checking the client
When the network interface card information of data server, determine whether the network interface card information that the client is locally stored is effective.
Second sending module 10015 is additionally operable to, when the network interface card information for determining that the client is locally stored is invalid, to institute
Stating reading and writing data asks corresponding data server to send the request for obtaining network interface card information.
Second acquisition module 10020, for when the network interface card information for determining that the client is locally stored is effective, from described
Client locally obtains the network interface card information that the reading and writing data asks at least two network interface card of corresponding data server.
It should be noted that the associated description of all modules of client involved in present invention implementation, can refer to
The corresponding description of method part, the embodiment of the present invention will not be described in great detail herein.
The embodiment of the present invention also provides a kind of reading and writing data Request System, as shown in figure 19, reading and writing data request system
System includes master server 1101, data server 1102 and client 1103 as described above.
1102 timing of the data server sends heartbeat to the master server, keeps and the master server 1101
Communication connection.
The acquisition reading and writing data that the master server 1101 receives the transmission of the client 1103 asks corresponding data clothes
The request for device information of being engaged in and the information for asking corresponding data server according to reading and writing data is obtained described in the acquisition request, will
The information of the data server is sent to the client 1103.
It should be noted that the associated description of each component part of reading and writing data Request System involved in present invention implementation,
It can be described with reference method part and the corresponding of client part, the embodiment of the present invention will not be described in great detail herein.
By above-mentioned technical proposal, technical solution provided in an embodiment of the present invention at least has following advantages：
Reading and writing data requesting method, client and the system of the present invention, to data server transmission data read-write requests
When, at least two network interface cards of data server in distributed memory system are made full use of, according to network interface card information from described at least two
The network interface card for selecting a load capacity low in a network interface card is concurrently read as the network interface card for establishing network connection with the client when multiple
When write request is directed to a data server, read-write requests can be made to be carried out by different network interface cards, avoid multiple number of concurrent
It is all established and is connected by the same network interface card according to read-write requests, solve the problems, such as that network interface card becomes read-write flow bottlenecks, in certain journey
The handling capacity of the transmission data of data server is improved on degree；And so that data server is extremely in distributed memory system
Few two network interface cards are fully used, and the utilization rate of resource is improved.
In the above-described embodiments, it all emphasizes particularly on different fields to the description of each embodiment, there is no the portion being described in detail in some embodiment
Point, it may refer to the associated description of other embodiment.
It is understood that the correlated characteristic in the above method and device can be referred to mutually.In addition, in above-described embodiment
" first ", " second " etc. be and not represent the quality of each embodiment for distinguishing each embodiment.
It is apparent to those skilled in the art that for convenience and simplicity of description, the system of foregoing description,
The specific work process of device and unit, can refer to corresponding processes in the foregoing method embodiment, and details are not described herein.
Algorithm and display be not inherently related to any certain computer, virtual system or miscellaneous equipment provided herein.
Various general-purpose systems can also be used together with teaching based on this.As described above, it constructs required by this kind of system
Structure be obvious.In addition, the present invention is not also directed to any certain programmed language.It should be understood that can utilize various
Programming language realizes the content of invention described herein, and the description done above to language-specific is to disclose this hair
Bright preferred forms.
In the instructions provided here, numerous specific details are set forth.It is to be appreciated, however, that the implementation of the present invention
Example can be put into practice without these specific details.In some instances, well known method, structure is not been shown in detail
And technology, so as not to obscure the understanding of this description.
Similarly, it should be understood that in order to simplify the disclosure and help to understand one or more of each inventive aspect,
Above in the description of exemplary embodiment of the present invention, each feature of the invention is grouped together into single implementation sometimes
In example, figure or descriptions thereof.However, the method for the disclosure should be construed to reflect following intention：It is i.e. required to protect
Shield the present invention claims the more features of feature than being expressly recited in each claim.More precisely, as following
Claims reflect as, inventive aspect is all features less than single embodiment disclosed above.Therefore,
Thus the claims for following specific implementation mode are expressly incorporated in the specific implementation mode, wherein each claim itself
All as a separate embodiment of the present invention.
Those skilled in the art, which are appreciated that, to carry out adaptively the module in the equipment in embodiment
Change and they are arranged in the one or more equipment different from the embodiment.It can be the module or list in embodiment
Member or component be combined into a module or unit or component, and can be divided into addition multiple submodule or subelement or
Sub-component.Other than such feature and/or at least some of process or unit exclude each other, it may be used any
Combination is disclosed to all features disclosed in this specification (including adjoint claim, abstract and attached drawing) and so to appoint
Where all processes or unit of method or equipment are combined.Unless expressly stated otherwise, this specification (including adjoint power
Profit requires, abstract and attached drawing) disclosed in each feature can be by providing the alternative features of identical, equivalent or similar purpose come generation
It replaces.
In addition, it will be appreciated by those of skill in the art that although some embodiments described herein include other embodiments
In included certain features rather than other feature, but the combination of the feature of different embodiments means in of the invention
Within the scope of and form different embodiments.For example, in the following claims, embodiment claimed is appointed
One of meaning mode can use in any combination.
The all parts embodiment of the present invention can be with hardware realization, or to run on one or more processors
Software module realize, or realized with combination thereof.It will be understood by those of skill in the art that can use in practice
Microprocessor or digital signal processor (DSP) realize reading and writing data requesting method according to the ... of the embodiment of the present invention, client
The some or all functions of end and some or all components in system.The present invention is also implemented as executing here
Some or all equipment or program of device of described method are (for example, computer program and computer program production
Product).It is such to realize that the program of the present invention may be stored on the computer-readable medium, or can have one or more
The form of signal.Such signal can be downloaded from internet website and be obtained, and either be provided on carrier signal or to appoint
What other forms provides.
It should be noted that the present invention will be described rather than limits the invention for above-described embodiment, and ability
Field technique personnel can design alternative embodiment without departing from the scope of the appended claims.In the claims,
Any reference mark between bracket should not be configured to limitations on claims.Word "comprising" does not exclude the presence of not
Element or step listed in the claims.Word "a" or "an" before element does not exclude the presence of multiple such
Element.The present invention can be by means of including the hardware of several different elements and being come by means of properly programmed computer real
It is existing.In the unit claim for listing several clients, several in these clients can be by same hard
Part item embodies.The use of word first, second, and third does not indicate that any sequence.These words can be explained
For title.
The invention discloses A1, a kind of reading and writing data requesting methods, are applied to distributed memory system, and the distribution is deposited
Storage system includes master server and data server, and the data server is provided at least two network interface cards, including：
Client obtains reading and writing data from the master server and asks corresponding data server information；
It obtains and selectes network interface card, the selected network interface card is to ask at least the two of corresponding data server from the reading and writing data
That is chosen in a network interface card establishes the network interface card of network connection for data server with client；
To the selected network interface card transmission data read-write requests.
A2, the method according to A1, the acquisition select network interface card and include：
The network interface card information that reading and writing data asks at least two network interface card of corresponding data server is obtained from the master server；
Select a network interface card as selected network interface card from least two network interface card according to the network interface card information.
A3, the method according to A2, from the master server obtain reading and writing data ask corresponding data server to
The network interface card information of few two network interface cards specifically includes：
The request for obtaining reading and writing data and asking corresponding data server network interface card information is sent to the master server, so as to
After the master server receives the request, the network interface card information at least two network interface cards that the read-write data server is reported
Feed back to the client；
Receive the network interface card information for corresponding at least two network interface card of the read-write data server that the master server is sent.
A4, the method according to A1, the acquisition select network interface card and include：
It is sent to the master server and obtains the request for selecting network interface card, so that the master server receives the request
Afterwards, the network interface card information of at least two network interface cards reported according to the read-write data server, is selected from least two network interface card
A network interface card is selected as selected network interface card, and the network interface card information of the selected network interface card is sent to the client；
The network interface card information for receiving the selected network interface card that the master server is sent obtains the choosing according to institute's network interface card information
Determine network interface card.
A5, the method according to A1, the acquisition select network interface card and include：
The request that corresponding data server transmission acquisition network interface card information is asked to the reading and writing data, so as to the data
The corresponding data server of read-write requests obtains the network interface card information of its own at least two network interface card upon receiving the request, and will
The network interface card information feeds back to the client；
Receive the network interface card letter for its own at least two network interface card that the reading and writing data asks corresponding data server to send
Breath；
Select a network interface card as selected network interface card from least two network interface card according to the network interface card information.
A6, the method according to A5, receive that the reading and writing data asks that corresponding data server sends its from
After the network interface card information of at least two network interface card of body, further include：
The network interface card information of at least two network interface card of corresponding data server is asked to be buffered in the reading and writing data of acquisition
The client is local.
A7, the method according to A6 obtain network interface card asking corresponding data server to send to the reading and writing data
Before the request of information, further include：
Check whether the client is locally stored with the reading and writing data and the network interface card of corresponding data server is asked to be believed
Breath；
If in the presence of, it is determined that whether the network interface card information that the client is locally stored is effective；
If invalid, execute to the reading and writing data and corresponding data server is asked to send asking for acquisition network interface card information
It asks；
If the reading and writing data locally effectively, is obtained from the client asks corresponding data server at least two
The network interface card information of network interface card.
A8, according to A2, A4, A5 any one of them method, according to the network interface card information from least two network interface card
A network interface card is selected to be specifically included as selected network interface card：
The network interface card for selecting a load capacity low from least two network interface card according to the network interface card information is as selected net
Card；
Or a network interface card is randomly choosed as selected network interface card from least two network interface card according to the network interface card information.
A9, the method according to A8, the network interface card information include the utilization rate of network interface card, according to the network interface card information from institute
State the network interface card for selecting a load capacity low at least two network interface cards is specially as selected network interface card：
According to the utilization rate of network interface card, the network interface card for selecting a load capacity low from least two network interface card is as selected net
Card.
A10, the method according to A9, the network interface card information further include network interface card type, and the network interface card type includes Intranet
Network interface card and outer net network interface card use and selected network interface card class during write operation requests, between the multiple data server
The identical network interface card of type is communicatively coupled.
The present invention discloses B1, a kind of client, is applied to distributed memory system, and the distributed memory system includes master
Server and data server, the data server are provided at least two network interface cards, including：
Acquiring unit asks corresponding data server information for obtaining reading and writing data from the master server；And it obtains
It is to be selected from least two network interface cards that the reading and writing data asks corresponding data server to take selected network interface card, the selected network interface card
What is taken establishes the network interface card of network connection for data server with client；
Transmission unit, the selected network interface card transmission data read-write requests for being obtained to the acquiring unit.
B2, the client according to B1, the acquiring unit include when obtaining number and selecting network interface card：
First acquisition module asks corresponding data server at least two for obtaining reading and writing data from the master server
The network interface card information of a network interface card；
First choice module is used and is selected a network interface card as choosing from least two network interface card according to the network interface card information
Determine network interface card.
B3, the client according to B2, the first acquisition module include：
Sending submodule obtains the corresponding data server network interface card of reading and writing data request for being sent to the master server
The request of information, after receiving the request so as to the master server, by least two for reading and writing data server and reporting
The network interface card information of a network interface card feeds back to the client；
Receiving submodule, the read-write data server corresponding at least two sent for receiving the master server
The network interface card information of network interface card.
B4, the client according to B1, the acquiring unit include when obtaining number and selecting network interface card：
First sending module obtains the request for selecting network interface card, so as to the main service for being sent to the master server
After device receives the request, according to the network interface card information of at least two network interface cards that the read-write data server reports, from described
It selects a network interface card as selected network interface card at least two network interface cards, and the network interface card information of the selected network interface card is sent to the visitor
Family end；
First receiving module, the network interface card information for receiving the selected network interface card that the master server is sent, according to institute
Network interface card information obtains the selected network interface card.
B5, the client according to B1, the acquiring unit include when obtaining number and selecting network interface card：
Second sending module obtains network interface card information for asking corresponding data server to send to the reading and writing data
Request, so that the reading and writing data asks corresponding data server to obtain its own at least two net upon receiving the request
The network interface card information of card, and the network interface card information is fed back into the client；
Second receiving module, for receiving that the reading and writing data asks that corresponding data server sends its own at least
The network interface card information of two network interface cards；
Second selecting module, for selected from least two network interface card according to the network interface card information network interface card as
Selected network interface card.
B6, the client according to B5 further include：
Storage unit, at least two network interface cards for the reading and writing data obtained to be asked to corresponding data server
It is local that network interface card information is buffered in the client.
B7, the client according to B6, the acquiring unit further include：
It checks module, corresponding data clothes is asked for checking whether the client is locally stored with the reading and writing data
The network interface card information of business device；
Determining module, for asking corresponding data clothes checking the client reading and writing data has been locally stored
When the network interface card information of business device, determine whether the network interface card information that the client is locally stored is effective；
Second sending module is additionally operable to, when the network interface card information for determining that the client is locally stored is invalid, to institute
Stating reading and writing data asks corresponding data server to send the request for obtaining network interface card information；
Second acquisition module, for when the network interface card information for determining that the client is locally stored is effective, from the client
The local network interface card information for obtaining the reading and writing data and asking at least two network interface card of corresponding data server in end.
B8, according to B2, B4, B5 any one of them client, according to the network interface card information from least two network interface card
It is middle that a network interface card is selected to be specifically included as selected network interface card：
The network interface card for selecting a load capacity low from least two network interface card according to the network interface card information is as selected net
Card；
Or a network interface card is randomly choosed as selected network interface card from least two network interface card according to the network interface card information.
B9, the client according to B8, when the network interface card information includes the utilization rate of network interface card, according to the utilization of network interface card
Rate, the network interface card for selecting a load low from least two network interface card is as selected network interface card.
The invention discloses C1, a kind of reading and writing data Request Systems, including master server, data server and such as B1-B9
Any one of them client；
The data server timing sends heartbeat to the master server, keeps the communication link with the master server
It connects；
The master server receives the acquisition reading and writing data that the client is sent and asks asking for corresponding server info
It asks, and asks the information of corresponding data server according to reading and writing data described in the acquisition request, by the data server
Information be sent to the client.
The invention discloses D1, a kind of reading and writing data requesting methods, are applied to distributed memory system, and the distribution is deposited
Storage system includes master server and data server, and the data server is provided at least two network interface cards, including：
The data server sends the network interface card information of its own at least two network interface card to the master server；
The master server receives and stores the network interface card information；
Client obtains reading and writing data from the master server and asks corresponding data server information and the data
Service the network interface card information of at least two network interface cards；
The client selects a network interface card to be taken as data according to the network interface card information from least two network interface card
Business device establishes the selected network interface card of network connection with the client；
To the selected network interface card transmission data read-write requests.
The invention discloses E1, a kind of reading and writing data requesting methods, are applied to distributed memory system, and the distribution is deposited
Storage system includes master server and data server, and the data server is provided at least two network interface cards, including：
The data server sends the network interface card information of its own at least two network interface card to the master server；
The master server receives and stores the network interface card information；
Client is sent to the master server obtains the corresponding data server of reading and writing data request and data service
The request of network connection network interface card is established in device with the client；
The master server receives the request, and asks corresponding data service according to the acquisition request reading and writing data
The network interface card information of at least two network interface card of device information and the data server；According to the network interface card information from described at least two
A network interface card is selected to establish the selected network interface card of network connection as data server and the client in network interface card, by the institute of acquisition
The network interface card information for stating data server information and selected network interface card is sent to the client；
The client receives the network interface card information of data server information and selected network interface card that the master server is sent；And
According to the data server information and the network interface card information of selected network interface card to the selected network interface card transmission data read-write requests.
The invention discloses F1, a kind of reading and writing data requesting methods, are applied to distributed memory system, and the distribution is deposited
Storage system includes master server and data server, and the data server is provided at least two network interface cards, including：
Client obtains reading and writing data from the master server and asks corresponding data server information；
The client sends to corresponding data server according to the data server information and obtains network interface card information
Request；
After the data server receives the request, the network interface card information of its own at least two network interface card is obtained, and by institute
It states network interface card information and is sent to the client；
The client receives the network interface card information, and one is selected from least two network interface card according to the network interface card information
A network interface card establishes the selected network interface card of network connection as data server and the client, and sends number to the selected network interface card
According to read-write requests.
Claims (21)
1. a kind of reading and writing data requesting method is applied to distributed memory system, the distributed memory system includes main service
Device and data server, the data server are provided at least two network interface cards, which is characterized in that including：
Client obtains reading and writing data from the master server and asks corresponding data server information；
It obtains and selectes network interface card, the selected network interface card is at least two nets for asking corresponding data server from the reading and writing data
That is chosen in card establish for the data server and client network interface card of network connection, and the selected network interface card be according to extremely
The low network interface card of a load capacity that the network interface card information of few two network interface cards is selected from least two network interface card, the network interface card information
Periodically reported from the data server be stored in the information of the master server or the data server it is local
Information；
To the selected network interface card transmission data read-write requests.
2. according to the method described in claim 1, it is characterized in that, the selected network interface card of the acquisition includes：
The network interface card information that reading and writing data asks at least two network interface card of corresponding data server is obtained from the master server；
Select a network interface card as selected network interface card from least two network interface card according to the network interface card information.
3. according to the method described in claim 2, it is characterized in that, corresponding from master server acquisition reading and writing data request
The network interface card information of at least two network interface card of data server specifically includes：
The request for obtaining reading and writing data and asking corresponding data server network interface card information is sent to the master server, so as to described
After master server receives the request, the network interface card information at least two network interface cards that the read-write data server reports is fed back
To the client；
Receive the network interface card information for corresponding at least two network interface card of the read-write data server that the master server is sent.
4. according to the method described in claim 1, it is characterized in that, the selected network interface card of the acquisition includes：
It is sent to the master server and obtains the request for selecting network interface card, after receiving the request so as to the master server, root
According to the network interface card information at least two network interface cards that the read-write data server reports, one is selected from least two network interface card
The network interface card information of the selected network interface card is sent to the client by network interface card as selected network interface card；
The network interface card information for receiving the selected network interface card that the master server is sent obtains the selected net according to institute's network interface card information
Card.
5. according to the method described in claim 1, it is characterized in that, the selected network interface card of the acquisition includes：
The request that corresponding data server transmission acquisition network interface card information is asked to the reading and writing data, so as to the reading and writing data
Corresponding data server is asked to obtain the network interface card information of its own at least two network interface card upon receiving the request, and will be described
Network interface card information feeds back to the client；
Receive the network interface card information for its own at least two network interface card that the reading and writing data asks corresponding data server to send；
Select a network interface card as selected network interface card from least two network interface card according to the network interface card information.
6. according to the method described in claim 5, it is characterized in that, asking corresponding data service receiving the reading and writing data
After the network interface card information for its own at least two network interface card that device is sent, further include：
The network interface card information of at least two network interface card of corresponding data server is asked to be buffered in the reading and writing data of acquisition described
Client is local.
7. according to the method described in claim 6, it is characterized in that, asking corresponding data server to the reading and writing data
Before sending the request for obtaining network interface card information, further include：
Check whether the client is locally stored with the network interface card information that the reading and writing data asks corresponding data server；
If in the presence of, it is determined that whether the network interface card information that the client is locally stored is effective；
If invalid, the request for asking corresponding data server to send acquisition network interface card information to the reading and writing data is executed；
If the reading and writing data locally effectively, is obtained from the client asks corresponding at least two network interface card of data server
Network interface card information.
8. according to the method described in claim 1, it is characterized in that, the network interface card information includes the utilization rate of network interface card, the choosing
It is specially the low network interface card of a load capacity being selected from least two network interface card according to the utilization rate of network interface card to determine network interface card.
9. according to the method described in claim 8, it is characterized in that, the network interface card information further includes network interface card type, the network interface card
Type includes Intranet network interface card and outer net network interface card, during write operation requests, is used and choosing between multiple data servers
Determine the identical network interface card of network interface card type to be communicatively coupled.
10. a kind of client, is applied to distributed memory system, the distributed memory system includes master server and data clothes
Business device, the data server are provided at least two network interface cards, which is characterized in that including：
Acquiring unit asks corresponding data server information for obtaining reading and writing data from the master server；And obtain choosing
Determine network interface card, the selected network interface card is to be chosen from least two network interface cards that the reading and writing data asks corresponding data server
The network interface card of network connection is established for data server and client, and the selected network interface card is according at least two network interface card
The low network interface card of a load capacity being selected from least two network interface card of network interface card information, the network interface card information is from described
Data server is periodically reported to the information of the master server or the data server and is stored in local information；
Transmission unit, the selected network interface card transmission data read-write requests for being obtained to the acquiring unit.
11. client according to claim 10, which is characterized in that the acquiring unit is wrapped when obtaining number and selecting network interface card
It includes：
First acquisition module asks corresponding at least two net of data server for obtaining reading and writing data from the master server
The network interface card information of card；
First choice module is used and selects a network interface card as selected net from least two network interface card according to the network interface card information
Card.
12. client according to claim 11, which is characterized in that the first acquisition module includes：
Sending submodule obtains the corresponding data server network interface card information of reading and writing data request for being sent to the master server
Request, after receiving the request so as to the master server, by least two nets that report of read-write data server
The network interface card information of card feeds back to the client；
Receiving submodule, corresponding at least two network interface card of the read-write data server sent for receiving the master server
Network interface card information.
13. client according to claim 10, which is characterized in that the acquiring unit is wrapped when obtaining number and selecting network interface card
It includes：
First sending module obtains the request for selecting network interface card, so that the master server connects for being sent to the master server
After receiving the request, according to the network interface card information of at least two network interface cards that the read-write data server reports, from it is described at least
It selects a network interface card as selected network interface card in two network interface cards, and the network interface card information of the selected network interface card is sent to the client
End；
First receiving module, the network interface card information for receiving the selected network interface card that the master server is sent, according to institute's network interface card
Network interface card is selected described in acquisition of information.
14. client according to claim 10, which is characterized in that the acquiring unit is wrapped when obtaining number and selecting network interface card
It includes：
Second sending module obtains asking for network interface card information for asking corresponding data server to send to the reading and writing data
It asks, so that the reading and writing data asks corresponding data server to obtain its own at least two network interface card upon receiving the request
Network interface card information, and the network interface card information is fed back into the client；
Second receiving module, for receiving that the reading and writing data asks that corresponding data server sends its own at least two
The network interface card information of network interface card；
Second selecting module, for selecting a network interface card as selected from least two network interface card according to the network interface card information
Network interface card.
15. client according to claim 14, which is characterized in that further include：
Storage unit, the network interface card of at least two network interface cards for the reading and writing data obtained to be asked to corresponding data server
Information cache is in client local.
16. client according to claim 15, which is characterized in that the acquiring unit further includes：
It checks module, corresponding data server is asked for checking whether the client is locally stored with the reading and writing data
Network interface card information；
Determining module, for asking corresponding data server checking the client reading and writing data has been locally stored
Network interface card information when, determine whether the network interface card information that the client is locally stored effective；
Second sending module is additionally operable to, when the network interface card information for determining that the client is locally stored is invalid, to the number
The request for obtaining network interface card information is sent according to the corresponding data server of read-write requests；
Second acquisition module, for when the network interface card information for determining that the client is locally stored is effective, from the client sheet
Ground obtains the network interface card information that the reading and writing data asks at least two network interface card of corresponding data server.
17. client according to claim 10, which is characterized in that when the network interface card information includes the utilization rate of network interface card,
The selected network interface card is specially to load low network interface card according to one that the utilization rate of network interface card is selected from least two network interface card.
18. a kind of reading and writing data Request System, which is characterized in that including master server, data server and such as claim 10-
17 any one of them clients；
The data server timing sends heartbeat to the master server, keeps the communication connection with the master server；
The master server receives the request that the acquisition reading and writing data that the client is sent asks corresponding server info, and
The information that corresponding data server is asked according to reading and writing data described in the acquisition request, by the information of the data server
It is sent to the client.
19. a kind of reading and writing data requesting method is applied to distributed memory system, the distributed memory system includes main service
Device and data server, the data server are provided at least two network interface cards, which is characterized in that including：
The data server sends the network interface card information of its own at least two network interface card to the master server；
The master server receives and stores the network interface card information；
Client obtains reading and writing data from the master server and asks corresponding data server information and the data service
The network interface card information of at least two network interface cards；
The client selects a network interface card as data server according to the network interface card information from least two network interface card
The selected network interface card of network connection is established with the client；
To the selected network interface card transmission data read-write requests；
The client selects a network interface card as data server according to the network interface card information from least two network interface card
The selected network interface card that network connection is established with the client includes：
The network interface card that the client selects a load capacity low according to the network interface card information from least two network interface card as
The selected network interface card.
20. a kind of reading and writing data requesting method is applied to distributed memory system, the distributed memory system includes main service
Device and data server, the data server are provided at least two network interface cards, which is characterized in that including：
The data server sends the network interface card information of its own at least two network interface card to the master server；
The master server receives and stores the network interface card information；
Client is sent to the master server to be obtained in the corresponding data server of reading and writing data request and data server
The request of network connection network interface card is established with the client；
The master server receives the request, and asks corresponding data server to be believed according to the acquisition request reading and writing data
The network interface card information of breath and at least two network interface card of the data server；According to the network interface card information from least two network interface card
The middle selected network interface card for selecting a network interface card to establish network connection as data server and the client, by the number of acquisition
It is sent to the client according to the network interface card information of server info and selected network interface card；Wherein, according to the network interface card information from described
A network interface card is selected to establish the selected network interface card packet of network connection as data server and the client at least two network interface cards
It includes：The network interface card for selecting a load capacity low from least two network interface card according to the network interface card information is as the selected net
Card；
The client receives the network interface card information of data server information and selected network interface card that the master server is sent；And according to
The data server information and the network interface card information of selected network interface card are to the selected network interface card transmission data read-write requests.
21. a kind of reading and writing data requesting method is applied to distributed memory system, the distributed memory system includes main service
Device and data server, the data server are provided at least two network interface cards, which is characterized in that including：
Client obtains reading and writing data from the master server and asks corresponding data server information；
The client sends the request for obtaining network interface card information according to the data server information to corresponding data server；
After the data server receives the request, the network interface card information of its own at least two network interface card is obtained, and by the net
Card information is sent to the client；
The client receives the network interface card information, and a net is selected from least two network interface card according to the network interface card information
Block the selected network interface card for establishing network connection as data server and the client, and is read to the selected network interface card transmission data
Write request；Wherein, selected from least two network interface card according to the network interface card information network interface card as data server with
The selected network interface card that the client establishes network connection includes：It is selected from least two network interface card according to the network interface card information
The low network interface card of one load capacity is as the selected network interface card.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201410397365.2A CN104125303B (en) | 2014-08-12 | 2014-08-12 | Reading and writing data requesting method, client and system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201410397365.2A CN104125303B (en) | 2014-08-12 | 2014-08-12 | Reading and writing data requesting method, client and system |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN104125303A CN104125303A (en) | 2014-10-29 |
| CN104125303B true CN104125303B (en) | 2018-09-04 |
Family
ID=51770567
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201410397365.2A Active CN104125303B (en) | 2014-08-12 | 2014-08-12 | Reading and writing data requesting method, client and system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN104125303B (en) |
Families Citing this family (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106569729A (en) * | 2015-10-09 | 2017-04-19 | 阿里巴巴集团控股有限公司 | Method and device for writing in data in distributed system |
| CN106991029A (en) * | 2016-01-21 | 2017-07-28 | 阿里巴巴集团控股有限公司 | A kind of acquisition methods and device of sequence data |
| CN106790420B (en) * | 2016-11-30 | 2019-11-26 | 华为技术有限公司 | A kind of more session channel method for building up and system |
| CN110337633A (en) * | 2017-06-30 | 2019-10-15 | 华为技术有限公司 | A kind of date storage method and equipment |
| CN107395709A (en) * | 2017-07-14 | 2017-11-24 | 郑州云海信息技术有限公司 | The communication means and device of a kind of storage cluster |
| CN112596669A (en) * | 2020-11-25 | 2021-04-02 | 新华三云计算技术有限公司 | Data processing method and device based on distributed storage |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101079036A (en) * | 2006-06-23 | 2007-11-28 | 腾讯科技（深圳）有限公司 | Storage method and system for mass file |
| CN101488918A (en) * | 2009-01-09 | 2009-07-22 | 杭州华三通信技术有限公司 | Multi-network card server access method and system |
| CN102045396A (en) * | 2010-12-20 | 2011-05-04 | 福建星网视易信息系统有限公司 | Load balancing method of server document |
| CN103716251A (en) * | 2014-01-14 | 2014-04-09 | 三星电子（中国）研发中心 | Load balancing method and equipment for content distribution network |
Family Cites Families (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US6512774B1 (en) * | 1999-03-18 | 2003-01-28 | 3Com Corporation | Fail over with multiple network interface cards |
| CN100414936C (en) * | 2006-06-30 | 2008-08-27 | 中国科学院计算技术研究所 | Method for balancing load between multi network cards of network file system server |
| CN101166099B (en) * | 2007-09-21 | 2010-06-23 | 杭州华三通信技术有限公司 | Distributed multi-core network device and cable card board |
| CN102891868B (en) * | 2011-07-19 | 2016-09-28 | 上海可鲁系统软件有限公司 | The load-balancing method of a kind of distributed system and device |
| CN102546813B (en) * | 2012-03-15 | 2016-03-16 | 北京思特奇信息技术股份有限公司 | A kind of High-Performance Computing Cluster computing system based on x86 PC framework |
| CN103210379B (en) * | 2012-08-17 | 2016-05-25 | 华为技术有限公司 | Server system, management method and equipment |
| CN103067976B (en) * | 2013-02-07 | 2015-08-05 | 深圳市磊科实业有限公司 | A kind of load-balancing method and implement device with the WAP (wireless access point) of multiplex roles |
| CN103596290A (en) * | 2013-10-24 | 2014-02-19 | 西南交通大学 | Wireless multi-network integration method |
-
2014
- 2014-08-12 CN CN201410397365.2A patent/CN104125303B/en active Active
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101079036A (en) * | 2006-06-23 | 2007-11-28 | 腾讯科技（深圳）有限公司 | Storage method and system for mass file |
| CN101488918A (en) * | 2009-01-09 | 2009-07-22 | 杭州华三通信技术有限公司 | Multi-network card server access method and system |
| CN102045396A (en) * | 2010-12-20 | 2011-05-04 | 福建星网视易信息系统有限公司 | Load balancing method of server document |
| CN103716251A (en) * | 2014-01-14 | 2014-04-09 | 三星电子（中国）研发中心 | Load balancing method and equipment for content distribution network |
Also Published As
| Publication number | Publication date |
|---|---|
| CN104125303A (en) | 2014-10-29 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN104125303B (en) | Reading and writing data requesting method, client and system | |
| CN104823170B (en) | Distributed caching cluster management | |
| CN105515872B (en) | The update method of configuration information, apparatus and system | |
| CN106484383B (en) | Page rendering method, device and equipment | |
| CN104011701B (en) | Content transmission network system and the method that can be operated in content distribution network | |
| CN103209223B (en) | distributed application session information sharing method, system and application server | |
| CN104283933B (en) | Method, client and the system of downloading data | |
| CN108712488B (en) | Data processing method and device based on block chain and block chain system | |
| CN105119973B (en) | User information processing method and server | |
| CN108737534B (en) | Block chain-based data transmission method and device and block chain system | |
| CN103607424B (en) | Server connection method and server system | |
| CN109451088A (en) | A kind of data access method and device | |
| CN109818934A (en) | A kind of method, apparatus and calculating equipment of automation daily record processing | |
| CN107911470A (en) | Distributed dynamic load-balancing method, computing device and computer-readable storage medium | |
| CN104052792B (en) | Enhance the method and system of middleware communication service | |
| CN106713391A (en) | Session information sharing method and sharing system | |
| CN109981745A (en) | A kind of journal file processing method and server | |
| CN104301439B (en) | Load-balancing method, apparatus and system | |
| CN109271367A (en) | Distributed file system multinode snapshot rollback method and system | |
| CN104408086B (en) | Data Global treatment system and method | |
| CN104580435B (en) | A kind of caching method and device of network connection | |
| US10817512B2 (en) | Standing queries in memory | |
| CN105574008A (en) | Task scheduling method and equipment applied to distributed file system | |
| CN109150844A (en) | Determine the methods, devices and systems of digital certificate | |
| CN106933569A (en) | A kind of webpage method for refreshing and device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant | ||
| TR01 | Transfer of patent right | ||
| TR01 | Transfer of patent right |
Effective date of registration: 20220715 Address after: Room 801, 8th floor, No. 104, floors 1-19, building 2, yard 6, Jiuxianqiao Road, Chaoyang District, Beijing 100015 Patentee after: BEIJING QIHOO TECHNOLOGY Co.,Ltd. Address before: 100088 room 112, block D, 28 new street, new street, Xicheng District, Beijing (Desheng Park) Patentee before: BEIJING QIHOO TECHNOLOGY Co.,Ltd. Patentee before: Qizhi software (Beijing) Co.,Ltd. |