CN105025042A - Method of determining data information, system and proxy servers - Google Patents

Method of determining data information, system and proxy servers Download PDF

Info

Publication number
CN105025042A
CN105025042A CN201410153208.7A CN201410153208A CN105025042A CN 105025042 A CN105025042 A CN 105025042A CN 201410153208 A CN201410153208 A CN 201410153208A CN 105025042 A CN105025042 A CN 105025042A
Authority
CN
China
Prior art keywords
server
agent
request information
business request
data
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN201410153208.7A
Other languages
Chinese (zh)
Other versions
CN105025042B (en
Inventor
路征
王海通
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
China Mobile Group Hebei Co Ltd
Original Assignee
China Mobile Group Hebei Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by China Mobile Group Hebei Co Ltd filed Critical China Mobile Group Hebei Co Ltd
Priority to CN201410153208.7A priority Critical patent/CN105025042B/en
Publication of CN105025042A publication Critical patent/CN105025042A/en
Application granted granted Critical
Publication of CN105025042B publication Critical patent/CN105025042B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Abstract

The invention discloses a method of determining data information. The method is used in a first proxy server. The first proxy server can be communicated with N-1 second proxy servers, wherein the N is greater than or equal to 2 and is a positive integer. The method comprises the following steps of receiving a service request message; when a data volume generated by the service request message determines that a load of the first proxy server is greater than a preset threshold, sending a part of the service request message in the service request message to at least one second proxy server in the N-1 second proxy servers till that the data volume generated by the service request message determines that the load of the first proxy server is less than or equal to the preset threshold. The invention also discloses a system of determining data information and the proxy servers.

Description

A kind of method and system, proxy server determining data message
Technical field
The present invention relates to business support technology, particularly relate to a kind of method and system, the proxy server of determining data message.
Background technology
Online business hall, as the important component part of electronic channel, all will accept the miscellaneous a large amount of Concurrency Access from client all the time.Therefore, the customer experience promoting online business hall becomes and is even more important.Statistics according to the Internet authority research institution shows: the page of online business hall often postpones one second, and client's conversion ratio can be caused to reduce by 7%, and page browsing amount declines 11%, and customer satisfaction declines 16%.
Therefore, in order to reduce the business handling time, improving customer experience, proposing Memcache caching technology, described Memcache is a high performance distributed memory object caching system, being caching solution under cluster environment.But there are the following problems for existing Memcache dispositions method:
In existing Memcache dispositions method, only be provided with a memcache server, when user's visit capacity is large, user accesses pressure and is all transmitted on a memcache server, owing to being limited to the network bandwidth restriction of described memcache server, make buffer efficiency lower, therefore, during the application of process big data quantity, the poor-performing of existing Memcache dispositions method;
When certain or some memecached in described Memcache server can not normally run, the user's access corresponding to the memecached that can not normally run directly will be sent to database, when user's visit capacity is larger, easily user is accessed pressure passes to database, cause described database pressure excessive, visit to end user efficiency reduces.
Summary of the invention
For solving the technical problem of existing existence, embodiments providing a kind of method and system, the proxy server of determining data message, can traffic pressure be disperseed, promote Consumer's Experience.
Technical scheme of the present invention is achieved in that the embodiment of the present invention provides a kind of method determining data message, and described method is used in first agent's server; Described first agent's server can with N-1 second agent's server communication, described N be more than or equal to 2 positive integer; Described method comprises:
Receive business request information;
When determining that the load of described first agent's server is greater than predetermined threshold value according to the data volume of business request information generation, partial service request message in business request information is sent, till the data volume produced according to business request information determines that the load of described first agent's server is less than or equal to predetermined threshold value at least one the second agent's server in described N-1 second agent's server.
Preferably, described method also comprises:
The routing information corresponding with business request information and Data Identification is searched according to business request information;
Obtain according to routing information and Data Identification and send the data message corresponding with business request information.
Preferably, described first agent's server can communicate with caching server; Accordingly, describedly obtain according to routing information and Data Identification and send the data message corresponding with business request information, comprising:
According to the routing information corresponding with business request information, the Data Identification corresponding with business request information is sent in caching server;
Obtain and send the data message corresponding with business request information that caching server determines according to Data Identification.
Preferably, described method also comprises:
Receive the business request information that the arbitrary second agent's server in described N-1 second agent's server sends, search the routing information corresponding with business request information and Data Identification according to business request information, and obtain according to routing information and Data Identification and send the data message corresponding with business request information.
The embodiment of the present invention also provides a kind of method determining data message, and described method relates to N number of first agent's server, is respectively first agent's server A 1 to first agent server A N; M caching server, is respectively the first caching server to M caching server; Wherein, can communicate between described N number of first agent's server; The data message corresponding with business request information is all stored in a described M caching server; Wherein, the data message stored in the first caching server to M-1 caching server is different, stores all data messages stored in the first caching server to M-1 caching server in M caching server; Described N be more than or equal to 2 positive integer, described M be more than or equal to 3 positive integer; Described method comprises:
Arbitrary first agent's server in described N number of first agent's server receives business request information, and searches the routing information of the caching server residing for the data message corresponding with business request information and the Data Identification corresponding in first agent serves of the data message corresponding with business request information according to business request information;
First agent's server to obtain to the caching server corresponding with routing information according to routing information and Data Identification and sends the data message corresponding with business request information.
Preferably, described method also comprises:
When the load that the data volume that arbitrary first agent's server in described N number of first agent's server produces according to the business request information received is determined is greater than predetermined threshold value, partial service request message in business request information is sent at least one the first agent's server in other first agent's servers except self, till the load determined until the data volume produced according to business request information is less than or equal to predetermined threshold value.
Preferably, described first agent's server to obtain to the caching server corresponding with routing information according to routing information and Data Identification and sends the data message corresponding with business request information, comprising:
The Data Identification corresponding with business request information, according to the routing information corresponding with business request information, is sent in caching server by first agent's server;
Caching server determines the data message corresponding with business request information according to the Data Identification corresponding with business request information;
The data message corresponding with business request information is sent to client by first agent's server by caching server.
Preferably, described method also comprises:
When the arbitrary first agent server A i determining in described N number of first agent's server fails normally to run, obtain the current service data information of described first agent server A i and service configuration information;
Determine the first agent server A j that can normally run, described service data information and service configuration information are sent to described first agent server A j, make described first agent server A j utilize described service configuration information to carry out business configuration, and perform according to described service data information the current business that described first agent server A i fails when normally running;
Wherein, described i and j is more than or equal to the positive integer that 1 is less than or equal to N, and the value of i with j is not identical.
Preferably, described method also comprises:
When determining that in the first caching server to M-1 caching server, any one caching server fails normally to run, obtain and fail the current service data information of the normal caching server run and service configuration information;
Service data information and service configuration information are sent in M caching server, described M caching server is made to utilize described service configuration information to carry out business configuration, and according to the current business that the caching server that normal operation is failed in described service data information execution is failed when running.
The embodiment of the present invention also provides a kind of first agent's server, described first agent's server can with N-1 second agent's server communication, described N be more than or equal to 2 positive integer; Described first agent's server comprises:
Message reception units, for receiving business request information;
Load determination unit, when data volume for producing according to business request information determines that the load of described first agent's server is greater than predetermined threshold value, partial service request message in business request information is sent at least one the second agent's server in described N-1 second agent's server, till the load of the described first agent's server determined until the data volume produced according to business request information is less than or equal to predetermined threshold value.
Preferably, described first agent's server also comprises:
First searches unit, for searching the routing information corresponding with business request information and Data Identification according to business request information;
First obtains and transmitting element, for obtaining according to routing information and Data Identification and sending the data message corresponding with business request information.
Preferably, described first agent's server can communicate with caching server; Accordingly, described first acquisition and transmitting element also comprise:
First sends subelement, for according to the routing information corresponding with business request information, is sent in caching server by the Data Identification corresponding with business request information;
Obtain and send subelement, for obtaining and sending the data message corresponding with business request information that caching server determines according to Data Identification.
Preferably, described message reception units, also for receiving the business request information that second agent's server sends; Accordingly, described first agent's server also comprises:
Second searches unit, searches the routing information corresponding with business request information and Data Identification for the business request information sent according to second agent's server;
Second obtains and transmitting element, for obtaining according to routing information and Data Identification and sending the data message corresponding with the business request information that described second agent's server sends; Wherein, described routing information and Data Identification are the routing information corresponding with the business request information that second agent's server sends and Data Identification.
The embodiment of the present invention also provides a kind of system determining data message, and described system comprises: N number of first agent's server and M caching server; Can communicate between described N number of first agent's server; The data message corresponding with business request information is all stored in a described M caching server; A described M caching server be respectively the first caching server, the second caching server ... M caching server, the data message stored in described first caching server to M-1 caching server is different, stores all data messages stored in the first caching server to M-1 caching server in M caching server; Described N be more than or equal to 2 positive integer, described M be more than or equal to 3 positive integer; Wherein,
Described first agent's server, for receiving business request information, and search the routing information of the caching server residing for the data message corresponding with business request information and the Data Identification corresponding in described agency service of the data message corresponding with business request information according to business request information;
Also for obtain to the caching server corresponding with routing information according to routing information and Data Identification and send the data message corresponding with business request information;
Described caching server, for determining according to Data Identification and sending the data message corresponding with business request information.
Preferably, described first agent's server, when the load also determined for the data volume produced according to the business request information received is greater than predetermined threshold value, partial service request message in business request information is sent at least one the first agent's server in other first agent's servers except self, till the load determined until the data volume produced according to business request information is less than or equal to predetermined threshold value.
The embodiment of the present invention method and system, the proxy server of given data information are really provided, compensate for the shortcoming that existing service node disposes single caching server, improve the caching performance of caching server layer, and disperseed traffic pressure; In addition, the present invention adopts pressure indication to judge the payload of the proxy server in proxy server layer, the partial service request message exceeding the load of proxy server is sent in the less proxy server of other loads, so, improve the processing speed of proxy server, achieve the double-layer balance clustered deploy(ment) of proxy server layer and buffer memory server layer.
Accompanying drawing explanation
Fig. 1 is the realization flow schematic diagram one of the method for embodiment of the present invention determination data message;
Fig. 2 is the structural representation of embodiment of the present invention first agent server;
Fig. 3 is the structural representation of embodiment of the present invention acquisition and transmitting element;
Fig. 4 is the realization flow schematic diagram two of the method for embodiment of the present invention determination data message;
Fig. 5 is the structural representation of embodiment of the present invention caching server;
Fig. 6 is the realization flow schematic diagram three of the method for embodiment of the present invention determination data message;
Fig. 7 is the structural representation of the correspondence embodiment illustrated in fig. 6 system of given data information really.
Embodiment
In order to more at large understand feature of the present invention and technology contents, below in conjunction with accompanying drawing, realization of the present invention is described in detail, the use of appended accompanying drawing explanation only for reference, is not used for limiting the present invention.
Embodiment one
Fig. 1 is the realization flow schematic diagram one of the method for embodiment of the present invention determination data message; Described method is used in first agent's server; Described first agent's server can with N-1 second agent's server communication, described N be more than or equal to 2 positive integer; As shown in Figure 1, described method comprises:
Step 101: receive business request information;
Here, the business request information that sent by business platform of first agent's server receives client.
Step 102: when determining that the load of described first agent's server is greater than predetermined threshold value according to the data volume of business request information generation, partial service request message in business request information is sent, till the data volume produced according to business request information determines that the load of described first agent's server is less than or equal to predetermined threshold value at least one the second agent's server in described N-1 second agent's server.
Particularly, when the load of described first agent's server that described first agent's server is determined according to the data volume that the business request information in process self produces is greater than q, partial service request message in the business request information of self is sent at least one the second agent's server in described N-1 second agent's server by described first agent's server, till the load of the described first agent's server determined according to the data volume that the business request information of self residual produces until described first agent's server is less than or equal to q;
Here, described q is 1.2 times of the data volume that the business request information of described first agent's server in the process self of business busy produces; And described q according to the business request information of described first agent's server number and the size dynamic conditioning of data volume that produces of business request information.
When determining the number of the business request information being sent to second agent's server, introduce pressure indication P concept, described pressure indication P is the standard of the payload judging first agent's server; Wherein, data volume/q that the business request information in described P=first agent server process self produces; When P is greater than 1, represents that the load of described first agent's server is large, need the partial service request message in the business request information in described first agent's server to send, to alleviate the pressure of described first agent's server; When P is less than or equal to 1, represent that the load of first agent's server is little.
Particularly, described first agent's server is sent to the number X of all business request information of described N-1 second agent's server for being less than or equal to basis the maximum integer of the numerical value calculated;
Wherein, described C is the number of all business request information that first agent's server receives.
Particularly, when the load of described first agent's server that the data volume that the business request information in described first agent's server process self produces is determined is greater than q, the number that described first agent's server is sent to the business request information of each second agent's server is respectively:
Described first agent's server is sent to the number of the business request information of first second agent's server for being less than or equal to basis X × { ( P 2 - 1 ) | P 1 - 1 | / P 1 + | P 2 - 1 | / P 2 + · · · · · · + | P N - 1 | / P N } The maximum integer of the numerical value calculated;
Described first agent's server is sent to the number of the business request information of second second agent's server for being less than or equal to basis X × { ( P 3 - 1 ) | P 1 - 1 | / P 1 + | P 2 - 1 | / P 2 + · · · · · · + | P N - 1 | / P N } The maximum integer of the numerical value calculated;
By that analogy, described first agent's server is sent to the number of the business request information of N-1 second agent's server for being less than or equal to basis X × { ( P N - 1 ) | P 1 - 1 | / P 1 + | P 2 - 1 | / P 2 + · · · · · · + | P N - 1 | / P N } The maximum integer of the numerical value calculated;
Wherein, described P 1for data volume/q that the business request information in first agent's server process self produces 1, described q 1for 1.2 times of the data volume that the business request information of first agent's server in the process self of business busy produces; P 2be data volume/q that the business request information in first second agent's server process self produces 2, described q 2it is 1.2 times of the data volume that the business request information of first second agent's server in the process self of business busy produces; By that analogy, P nbe data volume/q that the business request information in N-1 second agent's server process self produces n, described q nit is 1.2 times of the data volume that the business request information of N-1 second agent's server in the process self of business busy produces.
Further, described method also comprises:
The routing information corresponding with business request information and Data Identification is searched according to business request information;
Obtain according to routing information and Data Identification and send the data message corresponding with business request information.
Here, described first agent's server searches the routing information of the caching server residing for the data message corresponding with business request information and the Data Identification corresponding in described first agent's server of the data message corresponding with business request information according to business request information;
Particularly, adopt Consistent Hashing principle, first described first agent's server determines the cryptographic Hash of the service node residing for each caching server, the cryptographic Hash of the service node residing for each caching server is stored in the storage area in described first agent's server, determine the cryptographic Hash of the key of the data message corresponding with each business request information in each caching server subsequently, be stored in the storage area in described first agent's server, so, the positional information of the data message corresponding with business request information and the service node information residing for caching server is just stored in described first agent's server, and the Data Identification of the data message corresponding with business request information and cryptographic Hash.
Further, described first agent's server can communicate with caching server; Accordingly, describedly obtain according to routing information and Data Identification and send the data message corresponding with business request information, comprising:
According to the routing information corresponding with business request information, the Data Identification corresponding with business request information is sent in caching server;
Obtain and send the data message corresponding with business request information that caching server determines according to Data Identification.
Particularly, described first agent's server is according to the routing information corresponding with business request information, the Data Identification corresponding with business request information is sent in caching server, caching server determines corresponding with described Data Identification and corresponding with business request information data message according to described Data Identification, and is sent in first agent's server by described data message; Described first agent's server obtains the data message corresponding with business request information, and the data message corresponding with business request information is sent to client, for user's inquiry and use.
Here, the routing information of the data message corresponding with business request information and the Data Identification of the data message corresponding with business request information is stored in first agent's server; And in caching server, store the data message corresponding with business request information, therefore, business request information is sent in first agent's server by user, obtains the data message corresponding with the business request information that user sends by first agent's server to caching server.
Further, described method comprises:
Receive the business request information that the arbitrary second agent's server in described N-1 second agent's server sends, search the routing information corresponding with business request information and Data Identification according to business request information, and obtain according to routing information and Data Identification and send the data message corresponding with business request information.
The embodiment of the present invention additionally provides a kind of first agent's server of method corresponding to embodiment one, described first agent's server can with N-1 second agent's server communication, as shown in Figure 2, described first agent's server comprises:
Message reception units 21, for receiving business request information;
Load determination unit 22, when the load of the described first agent's server determined for the data volume produced according to business request information is greater than predetermined threshold value, partial service request message in business request information is sent at least one the second agent's server in described N-1 second agent's server, till the load of the described first agent's server determined until the data volume produced according to business request information is less than or equal to predetermined threshold value.
Further, described first agent's server also comprises:
First searches unit 23, for searching the routing information corresponding with business request information and Data Identification according to business request information;
First obtains and transmitting element 24, for obtaining according to routing information and Data Identification and sending the data message corresponding with business request information.
Further, described first agent's server can communicate with caching server; Accordingly,
As shown in Figure 3, described first acquisition and transmitting element 24 also comprise:
First sends subelement 241, for according to the routing information corresponding with business request information, is sent in caching server by the Data Identification corresponding with business request information;
Obtain and send subelement 242, for obtaining and sending the data message corresponding with business request information that caching server determines according to Data Identification.
Further, described message reception units 21, also for receiving the business request information that second agent's server sends; Accordingly, described first agent's server also comprises:
Second searches unit 25, searches the routing information corresponding with business request information and Data Identification for the business request information sent according to second agent's server;
Second obtains and transmitting element 26, for obtaining according to routing information and Data Identification and sending the data message corresponding with the business request information that described second agent's server sends; Wherein, described routing information and Data Identification are the routing information corresponding with the business request information that second agent's server sends and Data Identification.
Embodiment two
Fig. 4 is the realization flow schematic diagram two of the method for embodiment of the present invention determination data message, and described method is used in caching server, and as described in Figure 2, described method comprises:
Step 401: receive the Data Identification corresponding with business request information;
Step 402: determine according to the Data Identification corresponding with business request information and send the data message corresponding with business request information.
Particularly, described caching server receives the Data Identification corresponding with business request information that first agent's server sends, and determine the data message corresponding with business request information according to the Data Identification corresponding with business request information, the data message corresponding with business request information is sent to client by first agent's server, for user's inquiry and use.
Here, described Data Identification is the Data Identification of that store in first agent's server, corresponding with business request information data message; Described Data Identification can be the cryptographic Hash of the key of the data message corresponding with business request information.
The embodiment of the present invention additionally provides a kind of caching server of method corresponding to embodiment two, described caching server can with first agent's server communication; As shown in Figure 5, described caching server comprises:
Data Identification receiving element 51, for receiving the Data Identification corresponding with business request information;
Determine and transmitting element 52, for determining according to the Data Identification corresponding with business request information and send the data message corresponding with business request information.
Embodiment three
The method of embodiment of the present invention determination data message relates to N number of first agent's server, is respectively first agent's server A 1to first agent's server A n; M caching server, is respectively the first caching server to M caching server; Wherein, can communicate between described N number of first agent's server; The data message corresponding with business request information is all stored in a described M caching server; Wherein, the data message stored in the first caching server to M-1 caching server is different, stores all data messages stored in the first caching server to M-1 caching server in M caching server; Described N be more than or equal to 2 positive integer, described M be more than or equal to 3 positive integer; Fig. 6 is the realization flow schematic diagram three of the method for embodiment of the present invention determination data message, and as shown in Figure 6, described method comprises:
Step 601: the arbitrary first agent's server in described N number of first agent's server receives business request information, and search and the routing information of the caching server residing for the data message of business request information and the Data Identification corresponding in first agent serves of the data message corresponding with business request information according to business request information;
Particularly, the business request information that the arbitrary first agent's server receives client in described N number of first agent's server is sent by business platform.
Step 602: first agent's server to obtain to the caching server corresponding with routing information according to routing information and Data Identification and sends the data message corresponding with business request information.
Particularly, first agent's server according to routing information and Data Identification in M-1 caching server, the caching server corresponding with routing information obtain and send the data message corresponding with business request information; Wherein, a described M-1 caching server is that the first caching server is to M-1 caching server.
Further, described method also comprises:
When the load that the data volume that arbitrary first agent's server in described N number of first agent's server produces according to the business request information received is determined is greater than predetermined threshold value, partial service request message in business request information is sent at least one the first agent's server in other first agent's servers except self, till the load determined until the data volume produced according to business request information is less than or equal to predetermined threshold value.
Particularly, the embodiment of the present invention introduces pressure indication p concept, and described pressure indication p is the standard of the payload of the arbitrary first agent server A m judged in N number of first agent's server; Wherein, data volume/q that the business request information in p=first agent server A m process self produces; Described q is 1.2 times of the data volume that the business request information of first agent server A m in the process self of business busy produces; When first agent server A m is greater than q according to the load that the data volume that the business request information in process self produces is determined, partial service request message in the business request information of self is sent in other first agent's servers except self by first agent server A m, till the load of the first agent server A m determined until the data volume produced according to business request information is less than or equal to predetermined threshold value; Wherein, described m is more than or equal to the positive integer that 1 is less than or equal to N;
Particularly, described first agent server A m is sent to the number X of all business request information of other N-1 first agent's servers except self for being less than or equal to basis the maximum integer of the numerical value calculated;
Wherein, described C is the number of all business request information that described first agent server A m receives.
Particularly, when the load of the described first agent server A m that the data volume that the business request information in described first agent server A m process self produces is determined is greater than q, the number that described first agent server A m is sent to the business request information of each other first agent's servers each except described first agent server A m is respectively:
Described first agent server A m is sent to the number of the business request information of first first agent's server in other first agent's servers except described first agent server A m for being less than or equal to basis X × { ( P 2 - 1 ) | P 1 - 1 | / P 1 + | P 2 - 1 | / P 2 + · · · · · · + | P N - 1 | / P N } The maximum integer of the numerical value calculated;
Described first agent server A m is sent to the number of the business request information of second first agent's server in other first agent's servers except described first agent server A m for being less than or equal to basis X × { ( P 3 - 1 ) | P 1 - 1 | / P 1 + | P 2 - 1 | / P 2 + · · · · · · + | P N - 1 | / P N } The maximum integer of the numerical value calculated;
By that analogy, the number of the business request information of N-1 first agent's server during described first agent server A m is sent to except described first agent server A m other first agent's servers is for being less than or equal to basis X × { ( P N - 1 ) | P 1 - 1 | / P 1 + | P 2 - 1 | / P 2 + · · · · · · + | P N - 1 | / P N } The maximum integer of the numerical value calculated;
Wherein, described P 1for data volume/q that the business request information in described first agent server A m process self produces 1, described q 1for 1.2 times of the data volume that the business request information of described first agent server A m in the process self of business busy produces; Described P 2for data volume/q that the business request information in first the first agent's server process self in other first agent's servers except described first agent server A m produces 2, described q 2for 1.2 times of the data volume that the business request information of first first agent's server in other first agent's servers except described first agent server A m in the process self of business busy produces; By that analogy, P nfor data volume/q that the business request information in N-1 the first agent's server process self in other first agent's servers except described first agent server A m produces n, described q nfor 1.2 times of the data volume that the business request information of N-1 first agent's server in other first agent's servers except described first agent server A m in the process self of business busy produces.
Further, described first agent's server to obtain to the caching server corresponding with business request information according to routing information and Data Identification and sends the data message corresponding with business request information, comprising:
The Data Identification corresponding with business request information, according to the routing information corresponding with business request information, is sent in caching server by first agent's server;
Caching server determines the data message corresponding with business request information according to the Data Identification corresponding with business request information;
The data message corresponding with business request information is sent to client by first agent's server by caching server.
Further, described method also comprises:
Determine the arbitrary first agent's server A in described N number of first agent's server iwhen failing normally to run, obtain described first agent's server A icurrent service data information and service configuration information;
Determine the first agent's server A that can normally run j, described service data information and service configuration information are sent to described first agent's server A j, make described first agent's server A jutilize described service configuration information to carry out business configuration, and perform described first agent's server A according to described service data information jthe current business of failing when normally running;
Wherein, described i and j is more than or equal to the positive integer that 1 is less than or equal to N, and the value of i with j is not identical.
Further, described method also comprises:
When determining that in the first caching server to M-1 caching server, any one caching server fails normally to run, obtain and fail the current service data information of the normal caching server run and service configuration information;
Service data information and service configuration information are sent in M caching server, described M caching server is made to utilize described service configuration information to carry out business configuration, and according to the current business that the caching server that normal operation is failed in described service data information execution is failed when running.
The embodiment of the present invention additionally provides the system corresponding to given data information really described in embodiment three, and as shown in Figure 7, described system comprises: N number of first agent's server 71 and M caching server 72; Can communicate between described N number of first agent's server; The data message corresponding with business request information is all stored in a described M caching server; A described M caching server be respectively the first caching server, the second caching server ... M caching server, the data message stored in described first caching server to M-1 caching server is different, stores all data messages stored in the first caching server to M-1 caching server in M caching server; Described N be more than or equal to 2 positive integer, described M be more than or equal to 3 positive integer; Wherein,
Described first agent's server, for receiving business request information, and search the routing information of the caching server residing for the data message corresponding with business request information and the Data Identification corresponding in described agency service of the data message corresponding with business request information according to business request information;
Also for obtain to the caching server corresponding with routing information according to routing information and Data Identification and send the data message corresponding with business request information;
Described caching server, for determining according to Data Identification and sending the data message corresponding with business request information.
Further, described first agent's server, when the load also determined for the data volume produced according to the business request information received is greater than predetermined threshold value, partial service request message in business request information is sent at least one the first agent's server in other first agent's servers except self, till the load determined until the data volume produced according to business request information is less than or equal to predetermined threshold value.
Here, the system that the method for embodiment of the present invention given data information is corresponding comprises client tier, proxy server layer, caching server layer and database layer, and wherein said client tier can be communicated with proxy server layer by business platform, described proxy server layer comprises N number of first agent's server, and the function of N number of first agent's server is identical, all energy complete independently task, described caching server layer comprises M caching server, be respectively the first caching server to M caching server, wherein, data message in database layer is evenly stored in the first caching server in M-1 caching server, and the data message stored in the first caching server to M-1 caching server is different, the all data messages in database layer are stored in M caching server, so that when other caching servers can not normally run, M caching server can be called in time, ensure the normal operation of whole system, therefore, described M caching server is also called standby server.
Particularly, described proxy server layer adopts Consistent Hashing principle, first described proxy server layer determines the cryptographic Hash of the service node residing for each caching server in caching server layer, the cryptographic Hash of the service node residing for each caching server is evenly stored in the storage area of each first agent's server in described proxy server layer, determine the cryptographic Hash of the key of the data message corresponding with each business request information in each caching server in described caching server layer subsequently, and corresponding stored is in the storage area of each first agent's server in described proxy server layer, first agent's server residing for the cryptographic Hash of the service node wherein residing for caching server, be same first agent's server with the first agent's server residing for the cryptographic Hash of the key of the data message corresponding with each business request information in described caching server, so, each first agent's server in described proxy server layer just stores the positional information of the data message corresponding with business request information and the service node information residing for caching server, and the Data Identification of the data message corresponding with business request information and cryptographic Hash.
Here, the routing information of the caching server residing for the data message corresponding with business request information and the Data Identification of the data message corresponding with business request information is stored in each first agent's server in described proxy server layer, the data message corresponding with business request information is stored in each caching server in caching server layer, and, the routing information of the caching server residing for the data message corresponding with business request information stored in first agent's server and the particular location one_to_one corresponding of caching server, the Data Identification stored in first agent's server also with the data message one_to_one corresponding that stores in caching server, therefore, business request information is sent to after in the arbitrary first agent's server in described proxy server layer by user, first agent's server determines the routing information of the caching server residing for the data message corresponding with described business request information, and determine to store in self, the Data Identification that the data message corresponding with described business request information is corresponding, the data message corresponding with business request information is obtained to caching server according to described routing information and Data Identification.
Such as, user is by the data of logging in network business hall inquiry red rice contract machine, now, the business request information corresponding with red rice contract machine to be sent in first agent's server in proxy server layer by user by client, first agent's server receives business request information, the routing information of the caching server residing for the business request information inquiry data message corresponding with business request information and the Data Identification corresponding in described first agent's server of the data message corresponding with business request information; The Data Identification corresponding with business request information is sent in the caching server corresponding with routing information by first agent's server, caching server determines the data message corresponding with business request information according to the Data Identification corresponding with business request information, and the data message corresponding with business request information is sent to client by first agent's server, for user's inquiry and use.
The above, be only preferred embodiment of the present invention, be not intended to limit protection scope of the present invention.

Claims (15)

1. determine a method for data message, it is characterized in that, described method is used in first agent's server; Described first agent's server can with N-1 second agent's server communication, described N be more than or equal to 2 positive integer; Described method comprises:
Receive business request information;
When determining that the load of described first agent's server is greater than predetermined threshold value according to the data volume of business request information generation, partial service request message in business request information is sent, till the data volume produced according to business request information determines that the load of described first agent's server is less than or equal to predetermined threshold value at least one the second agent's server in described N-1 second agent's server.
2. method according to claim 1, is characterized in that, described method also comprises:
The routing information corresponding with business request information and Data Identification is searched according to business request information;
Obtain according to routing information and Data Identification and send the data message corresponding with business request information.
3. method according to claim 2, is characterized in that, described first agent's server can communicate with caching server; Accordingly, describedly obtain according to routing information and Data Identification and send the data message corresponding with business request information, comprising:
According to the routing information corresponding with business request information, the Data Identification corresponding with business request information is sent in caching server;
Obtain and send the data message corresponding with business request information that caching server determines according to Data Identification.
4. the method according to any one of claims 1 to 3, is characterized in that, described method also comprises:
Receive the business request information that the arbitrary second agent's server in described N-1 second agent's server sends, search the routing information corresponding with business request information and Data Identification according to business request information, and obtain according to routing information and Data Identification and send the data message corresponding with business request information.
5. determine a method for data message, it is characterized in that, described method relates to N number of first agent's server, is respectively first agent's server A 1to first agent's server A n; M caching server, is respectively the first caching server to M caching server; Wherein, can communicate between described N number of first agent's server; The data message corresponding with business request information is all stored in a described M caching server; Wherein, the data message stored in the first caching server to M-1 caching server is different, stores all data messages stored in the first caching server to M-1 caching server in M caching server; Described N be more than or equal to 2 positive integer, described M be more than or equal to 3 positive integer; Described method comprises:
Arbitrary first agent's server in described N number of first agent's server receives business request information, and searches the routing information of the caching server residing for the data message corresponding with business request information and the Data Identification corresponding in first agent serves of the data message corresponding with business request information according to business request information;
First agent's server to obtain to the caching server corresponding with routing information according to routing information and Data Identification and sends the data message corresponding with business request information.
6. method according to claim 5, is characterized in that, described method also comprises:
When the load that the data volume that arbitrary first agent's server in described N number of first agent's server produces according to the business request information received is determined is greater than predetermined threshold value, partial service request message in business request information is sent at least one the first agent's server in other first agent's servers except self, till the load determined until the data volume produced according to business request information is less than or equal to predetermined threshold value.
7. method according to claim 5, is characterized in that, described first agent's server to obtain to the caching server corresponding with routing information according to routing information and Data Identification and sends the data message corresponding with business request information, comprising:
The Data Identification corresponding with business request information, according to the routing information corresponding with business request information, is sent in caching server by first agent's server;
Caching server determines the data message corresponding with business request information according to the Data Identification corresponding with business request information;
The data message corresponding with business request information is sent to client by first agent's server by caching server.
8. the method according to any one of claim 5 to 7, is characterized in that, described method also comprises:
Determine the arbitrary first agent's server A in described N number of first agent's server iwhen failing normally to run, obtain described first agent's server A icurrent service data information and service configuration information;
Determine the first agent's server A that can normally run j, described service data information and service configuration information are sent to described first agent's server A j, make described first agent's server A jutilize described service configuration information to carry out business configuration, and perform described first agent's server A according to described service data information ithe current business of failing when normally running;
Wherein, described i and j is more than or equal to the positive integer that 1 is less than or equal to N, and the value of i with j is not identical.
9. the method according to any one of claim 5 to 7, is characterized in that, described method also comprises:
When determining that in the first caching server to M-1 caching server, any one caching server fails normally to run, obtain and fail the current service data information of the normal caching server run and service configuration information;
Service data information and service configuration information are sent in M caching server, described M caching server is made to utilize described service configuration information to carry out business configuration, and according to the current business that the caching server that normal operation is failed in described service data information execution is failed when running.
10. first agent's server, is characterized in that, described first agent's server can with N-1 second agent's server communication, described N be more than or equal to 2 positive integer; Described first agent's server comprises:
Message reception units, for receiving business request information;
Load determination unit, when data volume for producing according to business request information determines that the load of described first agent's server is greater than predetermined threshold value, partial service request message in business request information is sent at least one the second agent's server in described N-1 second agent's server, till the load of the described first agent's server determined until the data volume produced according to business request information is less than or equal to predetermined threshold value.
11. first agent's servers according to claim 10, is characterized in that, described first agent's server also comprises:
First searches unit, for searching the routing information corresponding with business request information and Data Identification according to business request information;
First obtains and transmitting element, for obtaining according to routing information and Data Identification and sending the data message corresponding with business request information.
12. first agent's servers according to claim 11, is characterized in that, described first agent's server can communicate with caching server; Accordingly, described first acquisition and transmitting element also comprise:
First sends subelement, for according to the routing information corresponding with business request information, is sent in caching server by the Data Identification corresponding with business request information;
Obtain and send subelement, for obtaining and sending the data message corresponding with business request information that caching server determines according to Data Identification.
13., according to claim 10 to the first agent's server described in 12 any one, is characterized in that, described message reception units, also for receiving the business request information that second agent's server sends; Accordingly, described first agent's server also comprises:
Second searches unit, searches the routing information corresponding with business request information and Data Identification for the business request information sent according to second agent's server;
Second obtains and transmitting element, for obtaining according to routing information and Data Identification and sending the data message corresponding with the business request information that described second agent's server sends; Wherein, described routing information and Data Identification are the routing information corresponding with the business request information that second agent's server sends and Data Identification.
14. 1 kinds of systems determining data message, it is characterized in that, described system comprises: N number of first agent's server and M caching server; Can communicate between described N number of first agent's server; The data message corresponding with business request information is all stored in a described M caching server; A described M caching server be respectively the first caching server, the second caching server ... M caching server, the data message stored in described first caching server to M-1 caching server is different, stores all data messages stored in the first caching server to M-1 caching server in M caching server; Described N be more than or equal to 2 positive integer, described M be more than or equal to 3 positive integer; Wherein,
Described first agent's server, for receiving business request information, and search the routing information of the caching server residing for the data message corresponding with business request information and the Data Identification corresponding in described agency service of the data message corresponding with business request information according to business request information;
Also for obtain to the caching server corresponding with routing information according to routing information and Data Identification and send the data message corresponding with business request information;
Described caching server, for determining according to Data Identification and sending the data message corresponding with business request information.
15. systems according to claim 14, it is characterized in that, described first agent's server, when the load also determined for the data volume produced according to the business request information received is greater than predetermined threshold value, partial service request message in business request information is sent at least one the first agent's server in other first agent's servers except self, till the load determined until the data volume produced according to business request information is less than or equal to predetermined threshold value.
CN201410153208.7A 2014-04-16 2014-04-16 A kind of method and system of determining data information, proxy server Active CN105025042B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201410153208.7A CN105025042B (en) 2014-04-16 2014-04-16 A kind of method and system of determining data information, proxy server

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201410153208.7A CN105025042B (en) 2014-04-16 2014-04-16 A kind of method and system of determining data information, proxy server

Publications (2)

Publication Number Publication Date
CN105025042A true CN105025042A (en) 2015-11-04
CN105025042B CN105025042B (en) 2019-06-28

Family

ID=54414746

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201410153208.7A Active CN105025042B (en) 2014-04-16 2014-04-16 A kind of method and system of determining data information, proxy server

Country Status (1)

Country Link
CN (1) CN105025042B (en)

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105550523A (en) * 2015-12-28 2016-05-04 上海携程商务有限公司 Data processing method
CN106060004A (en) * 2016-05-09 2016-10-26 深圳市永兴元科技有限公司 Database access method and database agent node
CN110855786A (en) * 2019-11-18 2020-02-28 天津联想协同科技有限公司 Processing method and device for network data request and computer storage medium

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20020026560A1 (en) * 1998-10-09 2002-02-28 Kevin Michael Jordan Load balancing cooperating cache servers by shifting forwarded request
CN103036994A (en) * 2012-12-18 2013-04-10 曙光信息产业(北京)有限公司 Cloud storage system capable of achieving load balance
CN103516744A (en) * 2012-06-20 2014-01-15 阿里巴巴集团控股有限公司 A data processing method, an application server and an application server cluster

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20020026560A1 (en) * 1998-10-09 2002-02-28 Kevin Michael Jordan Load balancing cooperating cache servers by shifting forwarded request
CN103516744A (en) * 2012-06-20 2014-01-15 阿里巴巴集团控股有限公司 A data processing method, an application server and an application server cluster
CN103036994A (en) * 2012-12-18 2013-04-10 曙光信息产业(北京)有限公司 Cloud storage system capable of achieving load balance

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105550523A (en) * 2015-12-28 2016-05-04 上海携程商务有限公司 Data processing method
CN106060004A (en) * 2016-05-09 2016-10-26 深圳市永兴元科技有限公司 Database access method and database agent node
CN110855786A (en) * 2019-11-18 2020-02-28 天津联想协同科技有限公司 Processing method and device for network data request and computer storage medium
CN110855786B (en) * 2019-11-18 2022-07-29 天津联想协同科技有限公司 Processing method and device for network data request and computer storage medium

Also Published As

Publication number Publication date
CN105025042B (en) 2019-06-28

Similar Documents

Publication Publication Date Title
JP6716727B2 (en) Streaming data distributed processing method and apparatus
CN104090897B (en) Method, server and the system of accesses meta-data
CN105812351A (en) Method and system for sharing session
CN103067297B (en) A kind of dynamic load balancing method based on resource consumption prediction and device
CN105025053A (en) Distributed file upload method based on cloud storage technology and system
CN104572727A (en) Data querying method and device
CN102523234A (en) Implementation method and system for clustering of application servers
CN110413845B (en) Resource storage method and device based on Internet of things operating system
US10425273B2 (en) Data processing system and data processing method
CN104298541A (en) Data distribution algorithm and data distribution device for cloud storage system
CN102438278A (en) Load allocation method and device for mobile communication network
CN109753244A (en) A kind of application method of Redis cluster
CN104346345A (en) Data storage method and device
CN105045762A (en) Management method and apparatus for configuration file
CN102571936B (en) Method, device and system for searching data
CN113900810A (en) Distributed graph processing method, system and storage medium
CN103823807A (en) Data de-duplication method, device and system
CN103986783A (en) Cloud computing system
CN110727738A (en) Global routing system based on data fragmentation, electronic equipment and storage medium
CN105025042A (en) Method of determining data information, system and proxy servers
CN112732756B (en) Data query method, device, equipment and storage medium
CN106250440B (en) Document management method and device
CN105472029A (en) Single sign-on method and system based on cache
US10193965B2 (en) Management server and operation method thereof and server system
US11416517B2 (en) Partitioning data in a clustered database environment

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant