WO2017107795A1

WO2017107795A1 - Method and device for accelerating access to website

Info

Publication number: WO2017107795A1
Application number: PCT/CN2016/109428
Authority: WO
Inventors: 贺三元
Original assignee: 阿里巴巴集团控股有限公司; 贺三元
Priority date: 2015-12-22
Filing date: 2016-12-12
Publication date: 2017-06-29
Also published as: CN106911732A

Abstract

The present application discloses a method and device for accelerating access to a website. The method for accelerating access to a website comprises: acquiring an access request sent from a user device for a target website resource; determining that a socket connection has been established between the user device and a proxy server; acquiring, according to the access request, the target website resource; and sending, in response to the access request and by using the socket connection, the acquired target website resource back to the user device. By establishing a socket connection between a proxy server and a user device, the solution for accelerating access to a website provided in the present application enables multiple instances of resource transmission after establishing the connection for one single time, thus preventing a connection latency due to the need to establish an HTTP connection each time a resource is to be transmitted.

Description

Website access acceleration method and device

Technical field

The present application relates to the field of Internet technologies, and in particular, to a website access acceleration method and apparatus.

Background technique

In the Internet age, how to improve the website access rate is the primary problem to improve the user's online experience. From the user's request for access to the website to return the content resources to the user, this process is affected by many factors, including the user-side and website-side factors, as well as the communication links between the two sides. In addition, a variety of website access acceleration technologies have also been produced.

The interconnection bottleneck between different logical networks is an important factor affecting the network connection rate. Taking the domestic network environment as an example, there are multiple logical networks such as Telecom, China Unicom, China Railcom, and Education Network, which are affected by objective conditions. The internal communication is very smooth, but when it comes to the interconnection between the networks, there will be various situations such as excessive delay, packet loss and even failure to connect. To solve this problem, the solution of the existing technology is to build a proxy server with multi-line bandwidth. As shown in FIG. 1, the user equipment and the website server are located in different logical networks A and B. If the user directly accesses the website, the rate is affected. The impact of A and B network interconnection bottlenecks. After the proxy server is set up, the interaction between the user equipment and the web server can be forwarded through the proxy server. Since the proxy server has the dual-line bandwidth of the network A and the network B at the same time, the user can access the website to accelerate the process.

The problem with the above solution is that the versatility is poor, and the scenario where the network interconnection bottleneck exists in the user equipment and the website server has an acceleration effect. The connection bottleneck does not lie in the case of the network interconnection, and may not accelerate, and may even cause additional The forwarding delay, the hardware resources of the proxy server are not fully utilized.

Summary of the invention

In response to the above technical problem, the present application provides a website access acceleration method and apparatus, and the technical solution is as follows:

According to a first aspect of the present application, a website access acceleration method is provided, which is applied to a proxy server, wherein the proxy server is in communication with a user equipment and a website server, and the method includes:

Obtaining an access request from the user equipment for the target website resource;

Confirming that a Socket connection has been established between the user equipment and the proxy server;

Obtaining the target website resource according to the access request;

Using the Socket connection, the obtained target website resource is fed back to the user equipment in response to the access request.

According to a second aspect of the present application, a website access acceleration apparatus is provided, which is applied to a proxy server, wherein the proxy server is in communication with a user equipment and a website server, and the apparatus includes:

An access request obtaining module, configured to obtain an access request issued by the user equipment for the target website resource;

a connection confirmation module, configured to confirm that a Socket connection is established between the user equipment and the proxy server;

a resource obtaining module, configured to acquire the target website resource according to the access request;

The access request response module is configured to use the Socket connection to feed back the obtained target website resource to the user equipment in response to the access request.

The website access acceleration scheme provided by the present application can realize the multiple transmission of resources after establishing a connection by establishing a Socket connection between the proxy server and the user equipment, thereby avoiding the need to establish an HTTP connection every time the resource is transmitted. Connection delay. Based on the foregoing solution, the application further provides an improved solution for pre-storing website resources, pre-stored website domain name resolution results, and compressing and transmitting website resources in the proxy server to improve the acceleration effect. Compared with the prior art, the solution of the present application can obtain more obvious acceleration effects in more application scenarios, and also enables the proxy server to be more effectively applied to website access acceleration.

It should be understood that any of the products or methods that implement the aspects of the present application do not necessarily need to have all of the advantages described above. The above general description and the following detailed description are merely exemplary and explanatory and are not intended to be limiting.

DRAWINGS

In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings to be used in the embodiments or the prior art description will be briefly described below. Obviously, the drawings in the following description are only These are some of the embodiments described in this application, and other figures can be obtained from those of ordinary skill in the art in view of these drawings.

1 is a schematic diagram of a prior art website access acceleration principle;

2 is a schematic diagram of a system architecture of website access acceleration according to the present application;

3 is a schematic diagram of a first process of the website access acceleration method of the present application;

4 is a second schematic flowchart of a website access acceleration method of the present application;

5 is a schematic diagram of a third process of the website access acceleration method of the present application;

6 is a first schematic structural diagram of a website access acceleration device of the present application;

FIG. 7 is a second schematic structural diagram of a website access acceleration apparatus of the present application.

detailed description

In order to make those skilled in the art better understand the technical solutions in the present application, the technical solutions in the embodiments of the present application will be described in detail below with reference to the accompanying drawings in the embodiments of the present application, it is obvious that the described embodiments are only It is a part of the embodiments of the present application, and not all of the embodiments. All other embodiments obtained by those skilled in the art based on the embodiments in the present application should fall within the scope of the present application.

The existing proxy server acceleration technology realizes the Internet acceleration effect from the perspective of improving the network connection bandwidth or the connection quality. If the Internet access rate bottleneck is not in the network connection, for example, the user equipment and the website server are located in the same logical network, or are at The speed at which different logical networks are connected smoothly, or the user equipment and the website accelerator itself access the network are limited. Under these circumstances, the prior art cannot effectively accelerate the effect.

In view of the problems existing in the prior art, the present application achieves an Internet acceleration effect from the perspective of improving communication efficiency. Through research, it is found that the delay cost of this process is mainly reflected in the following aspects: from the user's request to the website to the website to return the content resources to the user:

1) User equipment and website server need to establish HTTP connection multiple times to get different HTTP resources;

2) The delay caused by domain name resolution when the user side accesses the website based on the domain name;

3) downlink transmission of website resources;

This application gives the corresponding Internet acceleration solution for the above aspects, and the corresponding system architecture is shown in Figure 2:

The website server 30 is the owner of the resource;

The user equipment 10 is a demand side of the resource, and initiates a resource access request to the website server 30 by using the website domain name;

The proxy server 20 is logically located between the user device 10 and the website server 30. The proxy server 20 and the user device 10, the proxy server 20 and the website server 30 can implement a communication connection through various forms of networks, and the proxy server 20 can Communicate with multiple different user devices and multiple different web servers.

According to the solution of the present application, the proxy server 20 can intercept the resource access request initiated by any user equipment 10 to any of the website servers 30, and accelerate the subsequent access process based on the request.

When the network communication adopts the TCP protocol, the connection modes of the communication parties can be divided into two types: a long connection and a short connection. The so-called long connection means that multiple data packets can be continuously transmitted on one TCP connection. During the TCP connection hold period, if no data packet is sent, both parties need to send a detection packet to maintain the connection. A short connection means that when there is data interaction between the two parties, a TCP connection is established. After the data is sent, the TCP connection is disconnected.

The HTTP protocol is a typical application of the TCP protocol and one of the most widely used protocols on the Internet. Many websites use HTTP connections when providing services to users. The HTTP connection is a short connection. Each request sent by the user equipment requires a response from the server. After the request ends, the connection is actively released. The purpose of this is to avoid a large number of concurrent connections caused by a large number of users accessing the website, thereby reducing the server server resource consumption. However, from another perspective, since various resources on the website page, such as pictures, audio, video, etc., are provided in the form of HTTP links, each time the user equipment requests to acquire a resource, an HTTP connection needs to be established with the website server. , the server needs to wait until the connection is successfully established before the resource can be Feedback to the user equipment, this way of establishing an HTTP connection frequently will inevitably increase the interaction delay between the user equipment and the website server.

From the perspective of third-party acceleration, it is impossible to change the connection policy of the website itself. However, under the proxy server acceleration mechanism, the user equipment actually establishes a connection with the proxy server and acquires resources from the proxy server, so the user equipment and the proxy can be changed. Connection between servers to reduce connection overhead.

FIG. 3 is a flowchart of a website access acceleration method provided by the present application. The method is based on a proxy server and may include the following steps:

S101. Obtain an access request for a target website resource sent by the user equipment.

S102. Confirm that a Socket connection is established between the user equipment and the proxy server.

S103. Acquire, according to the access request, the target website resource.

S104. The obtained target website resource is fed back to the user equipment by using a Socket connection.

Compared with the existing proxy acceleration scheme, the present application replaces the default HTTP connection mode between the user equipment and the proxy server with the Socket connection mode. Compared with the HTTP connection, the Socket connection is a long connection, that is, unless both parties take the initiative. Required, otherwise it will not be automatically disconnected after the connection is established. With this feature, the proxy server can complete the content that needs to be transmitted using multiple HTTP connections through a Socket connection, thus avoiding the extra delay caused by frequent HTTP connection establishment.

The application premise of the application scheme is that the proxy server needs to be able to intercept the resource access request initiated by the user equipment to the website server. At the practical application level, many products have such conditions, such as a browser, a search engine, a website navigation, a public platform, As a comprehensive network service provider, these application products can provide users with convenient website access portals on the one hand, and bring more users to the website on the other hand. On this basis, if Further providing website access acceleration is of great significance to both users and websites. Of course, this application does not need to limit the specific implementation of the application level.

According to S101, the proxy server can be used as the bearer device of the application, and directly obtain the resource access request initiated by the user equipment to the website server, and can also be forwarded by other application servers. User access request.

According to S102, the proxy server needs to confirm that the user equipment has established a Socket connection with itself, and there may be two cases here:

In one case, the Socket connection is currently established. For example, when the proxy server itself is used as an application bearer device, even if there is no need to access the website, a Socket connection between the user device and the proxy server may be established in advance in order to implement other functions. In this case, the established Socket connection can be maintained and the connection can be further utilized to implement subsequent website access acceleration functions;

In another case, the Socket connection between the user equipment and the proxy server has not been established yet. In this case, the proxy server needs to perform the establishment operation of the Socket connection.

For a specific manner of establishing a Socket connection, refer to the description of the prior art, which is not described in detail in this application.

According to S103, the proxy server obtains the corresponding target website resource according to the access request of the user side; the application provides two ways for the proxy server to obtain the target website resource:

1) The proxy server is obtained locally.

Referring to FIG. 4, the proxy server can obtain resource caches from other websites in advance and localize them in a specific manner. According to S103a, after obtaining the resource access request of the user side, the corresponding resource is retrieved from the local cache and fed back to the user side according to the content of the required access. Since there is no need for the proxy server to interact with the website side in real time, this method can significantly reduce the response time to the user side.

In practical applications, for websites that provide relatively fixed website portals for public platforms and integrated business service windows, the website resources corresponding to these fixed entries may be pre-stored in advance, and for products such as browsers, Define information such as configuration or user usage habits to select several websites and pre-store their resources.

In addition, in order to ensure the timeliness of the pre-stored resources of the proxy server, the website resources stored in the proxy server may be updated according to a certain policy. For example, periodically update, or actively monitor the website side, and find that the website resource content changes after updating. If there is a close cooperation relationship with the website side, it can also be based on the reminder sent by the website side. Update. Of course, this application does not need to limit the specific update mechanism.

2) Get it from the web server in real time.

Referring to S103b in FIG. 5, after obtaining the access request of the user side for the target website, the proxy server establishes a connection with the target website server in real time, and acquires resources from the target website server;

Compared with mode 1), this resource acquisition method takes longer to respond to the user side's request, but can better guarantee the timeliness of resources. Moreover, for some real-time interaction needs, such as verification, authorization, etc., it is also necessary to adopt a way of acquiring resources in real time.

In a specific implementation provided by the application, the manner in which the proxy server prestores the domain name resolution result may be adopted to further reduce the time overhead caused by the real-time interaction between the proxy server and the website server.

According to the usage habits of the general users, the website domain name is used to access the website resources. Even if the third-party application provides the user with a website shortcut access portal, the URL corresponding to the background is mostly based on the information stored in the website domain name. Therefore, in the process of establishing a connection between the proxy server and the target web server according to the user's request, the operation of resolving the website domain name into an IP address takes a certain time. To solve this problem, the solution provided by the present application is: pre-store the domain name resolution result of the website (ie, the website IP address) in the proxy server local, and directly use the website IP address and website when the proxy server needs to establish a connection with the web server. The server establishes a connection to avoid the interaction delay caused by domain name resolution.

In a practical application, the proxy server may obtain the domain name resolution result of the website from the dedicated domain name resolution server, or implement the domain name resolution operation locally on the proxy server. In the portal application, the URL corresponding to the website shortcut access portal provided for the user can be directly saved as an IP address.

Similar to pre-stored website resources, the proxy server can selectively save some IP addresses corresponding to website URLs according to actual application requirements. At the same time, in order to ensure the correctness of the domain name resolution result, the domain name resolution result stored locally on the proxy server may be updated according to a certain policy.

The above provides two ways for the proxy server to obtain the target website resources, which is 1) It is more suitable for obtaining relatively static resources such as pictures, audio and video files, and mode 2) is more suitable for scenarios such as verification, authorization, etc. that require dynamic interaction. In practical applications, the two methods can be used in combination, that is, for one user's access request, according to actual needs, some of the resources are obtained by the proxy server locally, and another part of the resources are obtained by the real-time web server. . In fact, in the process of data transmission, resources such as pictures, audio and video files need to occupy most of the transmission bandwidth. Therefore, this combination of resource acquisition methods cannot completely avoid the delay caused by the interaction between the proxy server and the web server. At the same time, the amount of data transmitted between the proxy server and the web server can still be effectively reduced, thereby increasing the response rate of the proxy server to the user side.

At S104, the proxy server uses the established Socket connection to feed back the obtained target website resource to the user equipment in response to the user side access request.

In a preferred embodiment of the present application, the proxy server may compress the resources obtained from the website server and then provide the resources to the user side. In practical applications, the resources provided by many websites can be compressed without affecting the actual use of the user to reduce the amount of data transmission between the proxy server and the user equipment, thereby further reducing the transmission delay. This method has great significance for accessing user equipment with limited bandwidth (for example, a mobile phone that uses the wireless mobile mode to access the Internet), and can also reduce the data traffic of the user equipment. The compression processing operation may be pre-completed for the resources pre-stored by the proxy server. If the benefit of the compression processing operation is greater than the consumed time, it may also be completed before being fed back to the user equipment. The specific compression object and compression algorithm need not be limited in this application, and those skilled in the art can flexibly select according to actual needs.

It can be seen that the website access acceleration scheme provided by the application improves the speed of the user accessing the website by establishing a Socket connection, pre-storing the website resources in the proxy server, pre-storing the website domain name resolution result, and compressing and transmitting the website resources. Compared with the existing acceleration scheme, the proxy server in this application does not simply play the role of resource forwarding and network interconnection, so it can obtain more obvious acceleration effects in more application scenarios. Of course, the acceleration scheme of the present application does not conflict with the existing acceleration scheme itself. Those skilled in the art can combine the scheme of the present application with the prior art scheme according to actual needs.

Corresponding to the foregoing method embodiment, the application further provides a website access acceleration device. As shown in FIG. 6, the device may include:

The access request obtaining module 110 is configured to obtain an access request issued by the user equipment for the target website resource;

The connection confirmation module 120 is configured to confirm that a Socket connection has been established between the user equipment and the proxy server;

The resource obtaining module 130 is configured to obtain a target website resource according to the access request;

The access request response module 140 is configured to use the Socket connection to feed back the obtained target website resource to the user equipment in response to the access request.

As shown in FIG. 7, in a specific implementation manner of the present application, the website access acceleration apparatus may further include a resource management module 150, configured to acquire a website resource from a website server in advance and store it locally in the proxy server; correspondingly, the resource The obtaining module 130 is specifically configured to acquire, according to the access request, a target website resource that is pre-stored locally in the proxy server.

In addition, the resource management module 150 can also be used to update website resources stored locally on the proxy server.

In a specific implementation manner of the present application, the resource obtaining module 130 may be specifically configured to establish a connection with a server of the target website according to the access request, and obtain the target website resource from the server of the target website.

As shown in FIG. 7 , the website access acceleration device may further include a domain name resolution management module 160, configured to obtain a domain name resolution result of the website in advance and store it locally in the proxy server; correspondingly, the resource obtaining module 130 is specifically configured to be pre-stored according to The local domain name resolution result of the proxy server establishes a connection with the server of the target website.

In addition, the domain name resolution management module can also be used to update the domain name resolution result stored locally on the proxy server.

In a specific implementation manner of the present application, the access request response module 140 may be specifically configured to feed back the compressed target website resource to the user equipment.

It can be understood that the resource management module 150 and the domain name resolution management module 160 are two independent modules, which can be configured in the device as shown in FIG. 7 or separately. The configuration shown in FIG. 7 is not to be construed as limiting the scope of the present application.

For details of the implementation process of the functions and functions of the modules in the foregoing devices, refer to the implementation process of the corresponding steps in the foregoing methods, and details are not described herein again.

It will be apparent to those skilled in the art from the above description of the embodiments that the present application can be implemented by means of software plus a necessary general hardware platform. Based on such understanding, the technical solution of the present application may be embodied in the form of a software product in essence or in the form of a software product, which may be stored in a storage medium such as a ROM/RAM or a disk. , an optical disk, etc., includes instructions for causing a computer device (which may be a personal computer, server, or network device, etc.) to perform the methods described in various embodiments of the present application or portions of the embodiments.

The various embodiments in the specification are described in a progressive manner, and the same or similar parts between the various embodiments may be referred to each other, and each embodiment focuses on the differences from the other embodiments. In particular, for the device embodiment, since it is basically similar to the method embodiment, the description is relatively simple, and the relevant parts can be referred to the description of the method embodiment. The device embodiments described above are merely illustrative, and the modules described as separate components may or may not be physically separated. In the implementation of the present application, the functions of the modules may be the same or more. Implemented in software and / or hardware. It is also possible to select some or all of the modules according to actual needs to achieve the purpose of the solution of the embodiment. Those of ordinary skill in the art can understand and implement without any creative effort.

The above description is only a specific embodiment of the present application, and it should be noted that those skilled in the art can also make several improvements and retouchings without departing from the principles of the present application. It should be considered as the scope of protection of this application.

Claims

A website access acceleration method is applied to a proxy server, wherein the proxy server is in communication with a user equipment and a website server, respectively, wherein the method comprises:

Obtaining an access request from the user equipment for the target website resource;

Confirming that a Socket connection has been established between the user equipment and the proxy server;

Obtaining the target website resource according to the access request;

Using the Socket connection, the obtained target website resource is fed back to the user equipment in response to the access request.
The method according to claim 1, wherein the method further comprises: acquiring the website resource from the website server in advance and storing it locally at the proxy server;

The obtaining the target website resource according to the access request includes: acquiring, according to the access request, a target website resource that is pre-stored locally in the proxy server.
The method of claim 2, wherein the method further comprises: updating a website resource stored locally at the proxy server.
The method according to claim 1, wherein the obtaining the target website resource according to the access request comprises:

According to the access request, a connection is established with the server of the target website, and the target website resource is obtained from the server of the target website.
The method according to claim 4, wherein the method further comprises: obtaining a domain name resolution result of the website in advance and storing the result in the proxy server;

The establishing a connection with the server of the target website includes: establishing a connection with the server of the target website according to the domain name resolution result stored in advance on the proxy server.
The method according to claim 5, wherein the method further comprises: updating the domain name resolution result stored locally at the proxy server.
The method according to claim 1, wherein the feeding back the obtained target website resource to the user equipment comprises:

The compressed target website resource is fed back to the user equipment.
A website access acceleration device is applied to a proxy server, wherein the proxy server is in communication with a user equipment and a website server, respectively, wherein the device comprises:

An access request obtaining module, configured to obtain an access request issued by the user equipment for the target website resource;

a connection confirmation module, configured to confirm that a Socket connection is established between the user equipment and the proxy server;

a resource obtaining module, configured to acquire the target website resource according to the access request;

The access request response module is configured to use the Socket connection to feed back the obtained target website resource to the user equipment in response to the access request.
The device according to claim 8, wherein the device further comprises a resource management module, configured to acquire a website resource from a website server in advance and store it locally at the proxy server;

The resource obtaining module is specifically configured to acquire, according to the access request, a target website resource that is pre-stored locally in the proxy server.
The device according to claim 9, wherein the resource management module is further configured to:

Update the website resources stored locally on the proxy server.
The device according to claim 8, wherein the resource obtaining module is configured to establish a connection with a server of the target website according to the access request, and obtain a target website resource from a server of the target website.
The device according to claim 11, wherein the device further comprises a domain name resolution management module, configured to obtain a domain name resolution result of the website in advance and store it locally at the proxy server;

The resource obtaining module is specifically configured to establish a connection with a server of the target website according to a domain name parsing result stored in advance on the proxy server.
The apparatus according to claim 12, wherein the domain name resolution management module is further configured to:

Update the domain name resolution results stored locally on the proxy server.
The device according to claim 8, wherein the access request response module is specifically configured to:

The compressed target website resource is fed back to the user equipment.