CN1400535A - System for raising speed of response of server in application layer exchange and its method - Google Patents
System for raising speed of response of server in application layer exchange and its method Download PDFInfo
- Publication number
- CN1400535A CN1400535A CN 01123733 CN01123733A CN1400535A CN 1400535 A CN1400535 A CN 1400535A CN 01123733 CN01123733 CN 01123733 CN 01123733 A CN01123733 A CN 01123733A CN 1400535 A CN1400535 A CN 1400535A
- Authority
- CN
- China
- Prior art keywords
- server
- module
- connection
- client
- response
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Images
Abstract
The invention opens a system which advances the response speed of server in the application layer, it at least includes URL identification module which is used in content identifying and message exchanging; the testing module is used in testing health condition and load of the server; TCR cheating module is used in that the exchange board imitates the server to receive the sign from client; where the show pinches is that it incldues a server connectino store module, which connects with server in advance, and test the health and load of server through the prepared connection; the server connects with the store module, and at least same time, it connects with the testing module, TCP cheating module and the port processing module of the server. The invention also open a method for advancing the speed of server in application layer exchange.
Description
Technical field
The present invention relates to a kind of technology of network server response speed, be meant a kind of system and its implementation of in the application layer exchange, quickening speed of response of server especially.
Background of invention
Increase along with the Internet user, visit capacity to various servers on the network is also increasing rapidly, the simple performance that improves server can not satisfy the requirement of visit, thereby industry has proposed to realize four layer-switching technologies of load balancing between a plurality of servers, wherein, four layers of the 4th layer of being meant in the OSI(Open Systems Interconnection) model--transport layer.According to this technology, many the servers that have identical content link to each other with wide area network by four layer switchs, each server can have the IP address of oneself, and be provided with their externally unified addresses on four layer switchs--i.e. virtual IP address, when the user initiates visit to virtual address, by four layer switchs flow is distributed to different servers according to the loading condition of server, and guarantees that the message of same stream is fed to same server all the time.
As shown in Figure 1, its principle of work is according to first message of a data stream and set real server of load balancing policy selection, subsequent packet for this stream is then transmitted according to its five-tuple (source destination address, source destination slogan and protocol number), makes the message of same stream be handled by same server all the time.Owing to adopt the load balancing strategy, switch can be considered the assign direction of this data stream according to factors such as the busy idle condition of server or operation processing speed speeds comprehensively.So this technology can be finished the traffic sharing between the different server effectively, make that the expansion of server is very easy.
But under this mode of operation, require every station server that the user can both be provided all contents that will visit, caused a large amount of redundancies; Simultaneously, also the needing synchronously of the content that Servers-all is stored additionally considered, the application layer switching technology therefore occurred.
The application layer switching technology is exactly according to the application layer message in connecting, exchange such as information such as unified resource location (URL), Cookie, can realize the request of different content is directed on the different servers, thus the independent maintenance of realization different content.For example: it is slow but on the server capacious, dynamically CGI (CGI) page that generates is then handled by fireballing server that static HTML (HTML) page can be stored in speed.As shown in Figure 2, comprise three group of server at least, file data can be classified and be handled by different group of server, such as: jpg class file and gif class graphic file can be handled by group of server 1; Bin class file, cgi class graphic interface file and exe class execute file can be handled by group of server 2; Html class file data are then handled by group of server 3.
Owing to connect in the message of setting up in the process and do not include application layer message, so when server and client connect, switch must pretend to be server and client to connect earlier, after layer information that is applied, could determine which real server this connection request is sent to, then, switch more therewith real server connect, transmit client's request.Therefore, the actual treatment flow process of this course of work is as shown in Figure 3:
1) at first, pretend to be server to receive the TCP synchronizing signal TCPSYN that client is sent out by switch, this signal indication client requests is set up a TCP and is connected; Then, the switch alternative server is confirmed to connect and is set up to client loopback syn ack signal SYN ACK; Client is received after the SYNACK, again to pretending to be server--and switch send a signal ACK who receives affirmation; Through after the above-mentioned three-way handshake, connect and set up, client promptly sends application-level request to pretending to be server--switch.
2) after switch is received the application-level request that the client sends out, from request, application layer message is proposed, should issue which real server so that this request of determining the client is actual, switch is sent out TCP synchronizing signal TCP SYN to destination server then, and request is set up a TCP and connected; This server is confirmed to connect and is set up to switch loopback syn ack signal SYN ACK; Switch is received after the SYN ACK, send a signal ACK who receives affirmation to destination server again; Through after shaking hands, connect and set up, switch is about to the application-level request that client sends and is transmitted to destination server, then, client can with real destination server direct communication, send data.
The advantage of this method is: different contents can be placed on the different servers, improve the utilization factor of server, and to specific content as long as between several station servers, carry out synchronous refresh, be convenient to carry out the maintenance of content.But from the figure as can be seen, owing at every turn choose needs after the real server to initiate in real time and being connected of real server according to application layer message, like this, client is sent after the application-level request, need the wait switch to pretend to be client and server to connect, and replying of responding of forwarding server, thereby the time that obtains the server response increase greatly, can not satisfy the requirement that improves user capture speed.
Summary of the invention
In view of this, fundamental purpose of the present invention is to provide a kind of system that improves speed of response of server in the application layer exchange, make it can support quick between client and the server to be connected and the forwarding of application-level request, make the response time of server reduce greatly.
Another object of the present invention is to provide a kind of method that in the application layer exchange, improves speed of response of server, it can be shortened greatly be connected the time of setting up between client and the server, transmit application-level request apace, thereby make the response time of server obviously shorten, and then improve quality of services for users.
Technical scheme of the present invention specifically is achieved in that
A kind of system that improves speed of response of server in the application layer exchange comprises the URL identification module that is used for content recognition and MESSAGE EXCHANGE at least; Be used to detect the health status of institute's Connection Service device and the server health detection module of loading level; Be used to realize that the TCP that switch pretends to be server reception client to signal cheats module; Key is:
Comprise that also server end connects reserves module, be used for connecting with server in advance, and detect by the connection of having set up health status and loading level to server;
Server end connects reserves module, and Connection Service device health detection module, TCP cheat module and server port processing module simultaneously; TCP cheats module and also links to each other with URL identification module and client port processing module simultaneously.
Described connecting with server is to set up more than one the connection with each station server.This server end connects reserves module sets in advance this server connection deposit number according to the testing result of every station server health status threshold value.Described server health status detects and is meant whether the testing goal server is available.
A kind of method that improves speed of response of server in the application layer exchange, this method comprises the steps: at least
A. connect by the connection reserves module of the server in the application layer exchange system and every station server;
B. when client is initiated request, switch at first connects with client, after receiving the application-level request that client sends, from application-level request, extract application layer message, determine the destination server that this client is selected, utilize then with the forwarding client-side information that is connected that this destination server has been set up and give server, and replying of server is transmitted to the client.
Described server connection reserves module and server connect and further may further comprise the steps:
A. set up more than one the connection with each station server, afterwards the triggering of waiting timer incident;
B. each station server is carried out health and detect, set the threshold value that each station server connects the deposit number according to the testing result of health status;
C. detect the current connection deposit number of every station server in real time and whether be lower than pre-set threshold, if the connection of the server of current detection deposit number is lower than the threshold value that sets, then server connection reserves module is set up more than one new the connection with this server, returns step c then; Otherwise the waiting timer Event triggered enters step b.
Described timer event is meant the connection reserve status between the quantitative check switch-to-server.Described connection deposit number threshold value is less than the linking number of being set up.Described server health status is meant whether the testing goal server is available.When the destination server that is detected is unavailable, connects deposit number threshold value and be made as zero; But the destination server time spent of being detected, connect the linking number decision that deposit number threshold value can be supported according to this server.
By technique scheme as can be seen, key of the present invention is: add a server and connect reserves module in existing realization system, thereby set up the connection deposit mechanism between a kind of switch-to-server, make switch in advance and the deposit that connects between each server, connect deposit by these, switch can be promptly be transmitted to specific server with client's application-level request to be handled, thereby has shortened server response time.
By method of the present invention, not only can obtain server response faster, and the detection of easier realization server health status and loading condition, improved QoS of customer.
Description of drawings
Fig. 1 is four layer switch structural representations in the prior art;
Fig. 2 is an application layer switch architecture synoptic diagram in the prior art;
Fig. 3 is an application layer switch workflow synoptic diagram in the prior art;
Fig. 4 is a system architecture synoptic diagram of the present invention;
Fig. 5 connects the workflow diagram of reserves module for server among the present invention;
Fig. 6 is the process flow diagram of connection processing among the present invention.
Embodiment
The present invention is further described in more detail below in conjunction with drawings and the specific embodiments.
The present invention is mainly used in the application layer exchange system, and as shown in Figure 4, this system comprises at least: the URL identification module that is used for content recognition and MESSAGE EXCHANGE; Be used to detect the health status of institute's Connection Service device and the server health detection module of loading level; Be used for realizing that the TCP that switch pretends to be server reception client to signal cheats module; Importantly, this system comprises that also server end connects reserves module, is used for connecting with server in advance, and detects by these connections health status and loading conditions to server.Wherein, TCP cheats module and links to each other with the client port processing module, is used for receiving customer information; And server end connection reserves module links to each other with the Service-Port processing module, be used for setting up with server between be connected, TCP cheats module and also is connected reserves module with server end and links to each other with the URL identification module, and server end connects reserves module and also links to each other with server health detection module.The message that is transmitted enters from the client port processing module, cheat after module, server health detection module and server end connect identification, affirmation, processing that the deposit mould determines, determine guiding through above-mentioned URL identification module, TCP, export the corresponding target server to from the Service-Port processing module.This system had both comprised the implementation of software, also comprised in hard-wired mode, such as adopting the FPGA (Field Programmable Gate Array) process chip.
Server connects the concrete work realization flow of reserves module as shown in Figure 5 among the present invention, comprises the steps: at least
A. server connects reserves module and sets up several with each station server and be connected, the number that connects can be decided the ratio of different resource demand according to practical operation situation or client, connect and set up the back as reserved resources, when switch need connect with certain station server, then provide the connection of a respective server.Connect to set up good after, connect the triggering of reserves module waiting timer incident, this timed events is to be used for connection reserve status between the quantitative check switch-to-server.
B. each station server is carried out health and detect in real time, and determine that according to the testing result of health status each station server connects the threshold value of deposit number.Wherein, this threshold value is meant whether decision needs to set up the judgment standard value of a collection of new connection, and being lower than this value then needs to set up a collection of new connection, otherwise does not need at once; Health status detects to be meant whether the every station server of detection is available, if available, then the linking number that can support according to this server is determined threshold value, if unavailable, then threshold value is set to zero; This deposit number is meant the current number of having set up operational connection.
C. judge according to the timed events testing result whether the connection deposit number of each station server has been lower than the threshold value that sets, if, then set up a collection of new the connection with this server, in order to using, get back to step c then; Otherwise the still triggering of waiting timer incident enters step b.
By above-mentioned modular structure and workflow thereof, the a series of connection that switch can be set up in advance with server, switch can in time be known the health status and the loading level of server, thereby can determine the most suitable processing requested service device, the more important thing is: because switch has been laid in and being connected of server, so after determining real server, client's application-level request just can send to real server immediately by the connection of having set up, and need not long wait.Its treatment scheme is referring to shown in Figure 6:
1) at first, switch is sent out TCP SYN signal and is given server, receives the ack signal of replying behind the SYN ACK through the SYNACK signal and the switch of server response, makes switch set up a plurality of the connection with each station server;
2) then, when the client proposes connection request and application-level request, only need through and switch between shaking hands, confirming that switch just can be immediately be transmitted to server with user's application-level request by existing connection.
As seen, switch obtains after client's the application-level request, can by the connection of setting up in advance request be forwarded to selected server at once, and replying of server be transmitted to the client, the process that connects with the server three-way handshake has been saved in the centre, thereby has improved greatly the response time of server to the client.And, switch can be by being connected health status and the loading level that detects server in advance with server is set up in advance, if the server health status of required connection has problem, can when filing a request, the client inform at once, or other have the server of same function will to ask guiding, thereby the client's that avoids waste time is client's service of offering the best with the assurance.
In addition, switch can also carry out all horizontal distribution to client's request according to the loading condition that detects current server in real time, is that the client provides the fastest best service to guarantee.
Claims (10)
1, a kind of system that improves speed of response of server in the application layer exchange comprises the URL identification module that is used for content recognition and MESSAGE EXCHANGE at least; Be used to detect the health status of institute's Connection Service device and the server health detection module of loading level; Be used to realize that the TCP that switch pretends to be server reception client to signal cheats module; It is characterized in that:
Comprise that also server end connects reserves module, be used for connecting with server in advance, and detect by the connection of having set up health status and loading level to server;
Server end connects reserves module, and Connection Service device health detection module, TCP cheat module and server port processing module simultaneously; TCP cheats module and also links to each other with URL identification module and client port processing module simultaneously.
2, the system of raising speed of response of server according to claim 1 is characterized in that: described connecting with server is to set up more than one the connection with each station server.
3, the system of raising speed of response of server according to claim 1 is characterized in that: described server end connects reserves module sets in advance this server connection deposit number according to the testing result of every station server health status threshold value.
4, the system of raising speed of response of server according to claim 1 is characterized in that: described server health status detects and is meant whether the testing goal server is available.
5, a kind of method that improves speed of response of server in the application layer exchange is characterized in that this method comprises the steps: at least
A. connect by the connection reserves module of the server in the application layer exchange system and every station server;
When client is initiated request, switch at first connects with client, after receiving the application-level request that client sends, from application-level request, extract application layer message, determine the destination server that this client is selected, utilize then with the forwarding client-side information that is connected that this destination server has been set up and give server, and replying of server is transmitted to the client.
6, the method for raising speed of response of server according to claim 5 is characterized in that described server connects reserves module and server and connects and further may further comprise the steps:
A. set up more than one the connection with each station server, afterwards the triggering of waiting timer incident;
B. each station server is carried out health and detect, set the threshold value that each station server connects the deposit number according to the testing result of health status;
C. detect the current connection deposit number of every station server in real time and whether be lower than pre-set threshold, if the connection of the server of current detection deposit number is lower than the threshold value that sets, then server connection reserves module is set up more than one new the connection with this server, returns step c then; Otherwise the waiting timer Event triggered enters step b.
7, the method for raising speed of response of server according to claim 6 is characterized in that: described connection deposit number threshold value is less than the linking number of being set up.
8, the method for raising speed of response of server according to claim 6 is characterized in that: described server health status is meant whether the testing goal server is available.
9, according to the method for claim 6 or 8 described raising speed of response of server, it is characterized in that: when the destination server that is detected is unavailable, connects deposit number threshold value and be made as zero; But the destination server time spent of being detected, connect the linking number decision that deposit number threshold value can be supported according to this server.
10, the method for raising speed of response of server according to claim 6 is characterized in that: described timer event is meant the connection reserve status between the quantitative check switch-to-server.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CNB011237333A CN1150464C (en) | 2001-07-26 | 2001-07-26 | System for raising speed of response of server in application layer exchange and its method |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CNB011237333A CN1150464C (en) | 2001-07-26 | 2001-07-26 | System for raising speed of response of server in application layer exchange and its method |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN1400535A true CN1400535A (en) | 2003-03-05 |
| CN1150464C CN1150464C (en) | 2004-05-19 |
Family
ID=4665251
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CNB011237333A Expired - Fee Related CN1150464C (en) | 2001-07-26 | 2001-07-26 | System for raising speed of response of server in application layer exchange and its method |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN1150464C (en) |
Cited By (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1300986C (en) * | 2003-04-14 | 2007-02-14 | 华为技术有限公司 | Method of realizing quick five seven layer exchange |
| CN100369420C (en) * | 2004-09-14 | 2008-02-13 | 国际商业机器公司 | System and method for determining required movable connection |
| WO2012163262A1 (en) * | 2011-06-03 | 2012-12-06 | 华为技术有限公司 | Method and gateway for forwarding data |
| CN103368872A (en) * | 2013-07-24 | 2013-10-23 | 广东睿江科技有限公司 | Data packet forwarding system and method |
| CN106161580A (en) * | 2015-04-28 | 2016-11-23 | 中兴通讯股份有限公司 | A kind of connection status control method, Apparatus and system |
| CN110166568A (en) * | 2013-04-16 | 2019-08-23 | 亚马逊科技公司 | Distributed load balancer |
| CN112187575A (en) * | 2020-09-25 | 2021-01-05 | 杭州迪普科技股份有限公司 | Method and device for monitoring health state of server |
-
2001
- 2001-07-26 CN CNB011237333A patent/CN1150464C/en not_active Expired - Fee Related
Cited By (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1300986C (en) * | 2003-04-14 | 2007-02-14 | 华为技术有限公司 | Method of realizing quick five seven layer exchange |
| CN100369420C (en) * | 2004-09-14 | 2008-02-13 | 国际商业机器公司 | System and method for determining required movable connection |
| WO2012163262A1 (en) * | 2011-06-03 | 2012-12-06 | 华为技术有限公司 | Method and gateway for forwarding data |
| CN110166568A (en) * | 2013-04-16 | 2019-08-23 | 亚马逊科技公司 | Distributed load balancer |
| CN110166568B (en) * | 2013-04-16 | 2022-04-15 | 亚马逊科技公司 | Distributed load balancer |
| US11843657B2 (en) | 2013-04-16 | 2023-12-12 | Amazon Technologies, Inc. | Distributed load balancer |
| CN103368872A (en) * | 2013-07-24 | 2013-10-23 | 广东睿江科技有限公司 | Data packet forwarding system and method |
| CN106161580A (en) * | 2015-04-28 | 2016-11-23 | 中兴通讯股份有限公司 | A kind of connection status control method, Apparatus and system |
| CN112187575A (en) * | 2020-09-25 | 2021-01-05 | 杭州迪普科技股份有限公司 | Method and device for monitoring health state of server |
Also Published As
| Publication number | Publication date |
|---|---|
| CN1150464C (en) | 2004-05-19 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| Partridge et al. | A faster UDP (user datagram protocol) | |
| Hunt et al. | Network dispatcher: A connection router for scalable internet services | |
| Yang et al. | EFFICIENTSUPPORTFORCO NTENT-BASED ROUTINGINWEBSERVERCLU STERS | |
| US6243360B1 (en) | Network server having dynamic load balancing of messages in both inbound and outbound directions | |
| EP0865180B1 (en) | Load distribution among servers in a TCP/IP network | |
| US6934875B2 (en) | Connection cache for highly available TCP systems with fail over connections | |
| CN1206600C (en) | Full distribution type aggregation network servicer system | |
| US20040073683A1 (en) | Method and apparatus for providing an integrated cluster alias address | |
| US20020199000A1 (en) | Method and system for managing parallel data transfer through multiple sockets to provide scalability to a computer network | |
| US20020052931A1 (en) | HTTP multiplexor/demultiplexor | |
| CN1372405A (en) | Go-on sustained connection | |
| WO2002017034A2 (en) | System and method for highly scalable high-speed content-based filtering and load balancing in interconnected fabrics | |
| CN102668467A (en) | Computer system and monitoring method for computer system | |
| AU2007320794B2 (en) | Selective session interception method | |
| CN111355658B (en) | SDN cross-domain cooperation method based on distributed service framework | |
| CN112202940B (en) | Pod service mode for external exposure of kubernets | |
| CN1150464C (en) | System for raising speed of response of server in application layer exchange and its method | |
| Kokku et al. | Half-pipe anchoring: An efficient technique for multiple connection handoff | |
| CN1152517C (en) | Method of guarding network attack | |
| US8145746B1 (en) | Using the TCP window size for identifying packets and debugging | |
| CN1487706A (en) | Method, system and control process for enterprise to communicate timely | |
| CN1510872A (en) | Method for opposing refuse service attack with DNS and applied agency combination | |
| CN100345419C (en) | Data accession process | |
| CN1172493C (en) | Method for optimazed configuration of third layer exchange chip of network exchange apparatus | |
| CN110601989A (en) | Network traffic balancing method and device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C14 | Grant of patent or utility model | ||
| GR01 | Patent grant | ||
| CF01 | Termination of patent right due to non-payment of annual fee | ||
| CF01 | Termination of patent right due to non-payment of annual fee |
Granted publication date: 20040519 Termination date: 20190726 |