CN112364274A - WEB site access acceleration method and device - Google Patents
WEB site access acceleration method and device Download PDFInfo
- Publication number
- CN112364274A CN112364274A CN202011174951.2A CN202011174951A CN112364274A CN 112364274 A CN112364274 A CN 112364274A CN 202011174951 A CN202011174951 A CN 202011174951A CN 112364274 A CN112364274 A CN 112364274A
- Authority
- CN
- China
- Prior art keywords
- proxy
- request
- content
- url
- local
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 67
- 230000001133 acceleration Effects 0.000 title claims description 29
- 238000001914 filtration Methods 0.000 claims description 14
- 238000004590 computer program Methods 0.000 claims description 12
- 230000003068 static effect Effects 0.000 claims description 9
- 238000012795 verification Methods 0.000 claims description 8
- 230000000903 blocking effect Effects 0.000 abstract description 4
- 230000005540 biological transmission Effects 0.000 description 6
- 238000004891 communication Methods 0.000 description 6
- 238000010586 diagram Methods 0.000 description 6
- 238000004458 analytical method Methods 0.000 description 2
- 238000005516 engineering process Methods 0.000 description 2
- 230000003287 optical effect Effects 0.000 description 2
- 230000004044 response Effects 0.000 description 2
- 230000009286 beneficial effect Effects 0.000 description 1
- 238000010276 construction Methods 0.000 description 1
- 238000013523 data management Methods 0.000 description 1
- 230000007547 defect Effects 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 238000007726 management method Methods 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 239000000523 sample Substances 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
- 238000012360 testing method Methods 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/90—Details of database functions independent of the retrieved data types
- G06F16/95—Retrieval from the web
- G06F16/957—Browsing optimisation, e.g. caching or content distillation
- G06F16/9574—Browsing optimisation, e.g. caching or content distillation of access to content, e.g. by caching
Abstract
The embodiment of the invention provides a method and a device for accelerating WEB site access, wherein the method comprises the following steps: if the URL request is detected, judging whether the URL request passes the proxy or not according to a preset URL proxy rule; if the request content needs to pass through the proxy, judging whether the request content exists in a local resource cache; and if so, acquiring the requested content from the local resource cache. The method judges whether the URL agent passes through the agent according to the preset URL agent rule, and does not need to accelerate the agent of all contents, thereby avoiding the phenomenon that the flow which does not need the agent is sent to the agent server, and increasing the resource consumption of the agent server. If the request content exists in the local resource cache, the request content is obtained from the local resource cache, and the request content does not need to be requested from the proxy server, so that the load overhead of the proxy server is further reduced, the request blocking is avoided, the user experience of proxy access can be obviously improved, the times of obtaining data from the proxy are reduced, and the data security and privacy are improved.
Description
Technical Field
The invention relates to the technical field of internet, in particular to a method and a device for accelerating WEB site access.
Background
In browsing most websites, from the perspective of loading resources by a browser, a webpage is completely displayed, a main document resource needs to be loaded first, then the browser analyzes a main document resource request, and then a resource file continues to be loaded according to an analysis result. In this process, except for the initial main document loading, most of the other is the loading of the resource files, which takes most of the time of website loading.
Tests show that the complete loading time (including the CDN acceleration of an operator) of the current mainstream website is between 0.3S and 7.3S, the number of connection requests is more variable from 52 to 228, most of the requests are static resource files, and the access speed of the website is lower.
At present, the method for accelerating network access is mainly to transmit the HTTP request of the client to the proxy server through the proxy program by the proxy server, and then the proxy server requests real data and returns the real data to the client, thereby achieving the purpose of network acceleration. However, no matter how fast and efficient the network configured by the proxy server is, unnecessary network transmission cannot be solved, and finally, network delay is generated. If the proxy server is overloaded and requests are blocked, the user experience of all connected servers can be seriously affected. Proxy servers generally cannot achieve fine-grained proxy control, which causes much traffic that actually does not need proxy to be sent to the proxy server, and the consumption is increased unnecessarily. If the HTTPS traffic is not based on the tunnel proxy technology, other basic data passes through the proxy server, and the proxy server can theoretically probe request data and response data.
Disclosure of Invention
The embodiment of the invention provides a method and a device for accelerating WEB site access, which are used for overcoming the defects in the prior art.
The embodiment of the invention provides a WEB site access accelerating method, which comprises the following steps: if the URL request is detected, judging whether the URL request passes the proxy or not according to a preset URL proxy rule; if the request content needs to pass through the proxy, judging whether the request content exists in a local resource cache; and if so, acquiring the requested content from the local resource cache.
According to the method for accelerating access to the WEB site, provided by the embodiment of the invention, if the requested content does not exist in the local resource cache, the requested content is obtained through the network proxy server.
According to an embodiment of the present invention, the method for accelerating WEB site access, where the method for obtaining requested content through a network proxy server includes: sending the HTTPS request to a local proxy client, receiving a digital certificate sent by the local proxy client, and verifying the digital certificate sent by the local proxy client according to a trusted certificate list prestored by an operating system; if the verification is passed, encrypting the HTTPS request flow according to the digital certificate, and sending the encrypted HTTPS request flow to a local agent client; the local proxy client decrypts according to the digital certificate, judges the content needing to pass through the network proxy server according to the obtained HTTPS request content, encrypts the content needing to pass through the network proxy and sends the encrypted content to the network proxy server; and acquiring and decrypting request content returned by the network proxy server, encrypting the request content by using the digital certificate and sending the encrypted request content to the browser client.
According to an embodiment of the present invention, after obtaining the requested content through the network proxy server, the method further includes: and loading the request content acquired by the network proxy server to a local resource cache.
According to the WEB site access acceleration method of an embodiment of the present invention, before loading the content requested by the WEB proxy server to the local resource cache, the method further includes: and filtering the requested content through a static resource filter so as to load the static resource meeting the filtering condition to the local resource cache.
According to the WEB site access accelerating method provided by the embodiment of the invention, if the condition that the proxy is not needed is judged, the Internet is directly accessed, and the loading duration of the webpage in the URL request is recorded; and if the loading duration is greater than a preset threshold value, marking the network address in the URL request as a proxy address, and adding the proxy address into a preset URL proxy rule.
According to the WEB site access acceleration method of an embodiment of the present invention, before determining whether the requested content exists in the local resource cache, the method further includes: and verifying the network address in the URL request according to the configuration information issued by the configuration server, and if the network address does not pass the verification, stopping accessing through the proxy.
An embodiment of the present invention further provides a WEB site access acceleration apparatus, including: the rule filtering module is used for judging whether the URL request passes the proxy or not according to a preset URL proxy rule if the URL request is detected; the cache judging module is used for judging whether the request content exists in the local resource cache if the request content needs to pass through the proxy; and the data acquisition module is used for acquiring the requested content from the local resource cache if the requested content exists in the local resource cache.
The embodiment of the present invention further provides an electronic device, which includes a memory, a processor, and a computer program stored in the memory and capable of running on the processor, where the processor implements the steps of any of the above described WEB site access acceleration methods when executing the program.
An embodiment of the present invention further provides a non-transitory computer readable storage medium, on which a computer program is stored, where the computer program, when executed by a processor, implements the steps of any of the above described WEB site access acceleration methods.
According to the WEB site access acceleration method and device provided by the embodiment of the invention, whether the proxy is passed or not is judged according to the preset URL proxy rule, proxy acceleration on all contents is not needed, and the phenomenon that the flow which does not need to be proxied is sent to a proxy server, so that the resource consumption of the proxy server is increased is avoided. If the request content exists in the local resource cache, the request content is obtained from the local resource cache, and the request content does not need to be requested from the proxy server, so that the load overhead of the proxy server is further reduced, the request blocking is avoided, the user experience of proxy access can be obviously improved, the times of obtaining data from the proxy are reduced, and the data security and privacy are improved.
Drawings
In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings used in the description of the embodiments or the prior art will be briefly described below, and it is obvious that the drawings in the following description are some embodiments of the present invention, and those skilled in the art can also obtain other drawings according to the drawings without creative efforts.
FIG. 1 is a flowchart illustrating a method for accelerating access to a WEB site according to an embodiment of the present invention;
FIG. 2 is a flowchart illustrating a method for accelerating WEB site access according to another embodiment of the present invention;
FIG. 3 is a flowchart illustrating a method for accelerating WEB site access according to another embodiment of the present invention;
fig. 4 is a schematic structural diagram of a WEB site access accelerating device according to an embodiment of the present invention;
fig. 5 is a schematic structural diagram of an electronic device according to an embodiment of the present invention.
Detailed Description
In order to make the objects, technical solutions and advantages of the embodiments of the present invention clearer, the technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are some, but not all, embodiments of the present invention. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
The following describes a WEB site access acceleration method and apparatus according to an embodiment of the present invention with reference to fig. 1 to 5. Fig. 1 is a schematic flow diagram of a method for accelerating access to a WEB site according to an embodiment of the present invention, and as shown in fig. 1, an embodiment of the present invention provides a method for accelerating access to a WEB site, including:
101. if the URL request is detected, judging whether the URL request passes the proxy or not according to a preset URL proxy rule.
Firstly, a URL proxy rule filter is locally arranged, and preset URL proxy rules are stored in the URL proxy rule filter. When the browser accesses a certain URL, whether proxy is needed or not is judged through a URL proxy rule filter, and if proxy is needed, the related operation of proxy is carried out. The URL proxy rule can be preset, for example, the URL proxy rule is set to be a foreign website or a website with slow access needs to be accessed through a proxy. In addition, corresponding filtering rules may be configured through Proxy Automatic Configuration (PAC) techniques of the browser.
102. And if the request content needs to pass through the proxy, judging whether the request content exists in the local resource cache.
And the local resource cache is used for storing historical contents requested by the browser to the Internet through the proxy. After the proxy accesses the web site, the corresponding content is cached in the local resource cache. When the URL request in 101 needs to pass through the proxy, the local resource cache is first searched to determine whether the requested content is already stored in the local resource cache.
103. And if so, acquiring the requested content from the local resource cache.
And if the requested content is stored in the local resource cache, the requested content is obtained from the local resource cache without accessing through an agent.
The method of the embodiment of the invention judges whether to pass the proxy according to the preset URL proxy rule without proxy acceleration of all contents, thereby avoiding the increase of resource consumption of the proxy server caused by sending the flow without proxy to the proxy server. If the request content exists in the local resource cache, the request content is obtained from the local resource cache, and the request content does not need to be requested from the proxy server, so that the load overhead of the proxy server is further reduced, the request blocking is avoided, the user experience of proxy access can be obviously improved, the times of obtaining data from the proxy are reduced, and the data security and privacy are improved.
Based on the content of the foregoing embodiment, as an optional embodiment, before detecting the URL request, the method further includes: and receiving the URL address of the proxy or the non-proxy input by the user, and generating the URL proxy rule.
The URL agent rule can be configured according to the user requirement, and a common user or a network administrator can set an agent white list or an agent black list according to the attribution, the visit amount and the like of the website. And storing the configured URL address in a URL proxy rule for performing preliminary filtering when a user initiates a URL request.
Based on the content of the foregoing embodiment, as an optional embodiment, if the requested content does not exist in the local resource cache, the requested content is obtained through the network proxy server. That is, if the relevant request content is not found in the local resource, the request content needs to be acquired through the proxy server.
Based on the content of the foregoing embodiment, as an optional embodiment, the obtaining, by the network proxy server, the requested content includes: sending the HTTPS request to a local proxy client, receiving a digital certificate sent by the local proxy client, and verifying the digital certificate sent by the local proxy client according to a trusted certificate list prestored by an operating system; if the verification is passed, encrypting the HTTPS request flow according to the digital certificate, and sending the encrypted HTTPS request flow to a local agent client; the local proxy client decrypts according to the digital certificate, judges the content needing to pass through the network proxy server according to the obtained HTTPS request content, encrypts the content needing to pass through the network proxy and sends the encrypted content to the network proxy server; acquiring request content returned by the network proxy server and decrypting the request content; and sending the encrypted digital certificate to the browser client.
Fig. 2 is a flowchart illustrating a WEB site access acceleration method according to another embodiment of the present invention, as shown in fig. 2. The existing HTTPS protocol transmission is encryption and decryption communication between a client and a network server. For the network proxy server, it is a tunnel transmission, and cannot know the data content therein, and cannot decide which content needs to pass through the proxy and which content does not need to pass through the proxy. On one hand, the method is not beneficial to data management and control, on the other hand, not all HTTPS contents need to pass through the agent, and some contents with low timeliness requirements do not need to pass through the agent.
In the embodiment of the invention, the HTTPS request content of the browser is analyzed by setting the local agent client, and the content needing to pass through the network agent is judged. Unlike the network proxy server, the local proxy client may run on the same host computer as the browser, and may be a functional module on the same electronic device. In the embodiment of the invention, the HTTPS request flow initiated by the browser is not directly encrypted and is sent to the WEB server through the network proxy server, but is encrypted firstly and then sent to the local proxy client. And after decrypting the HTTPS request content according to the same digital certificate, the local agent client judges which HTTPS request content needs to pass through the agent. After the content needing to pass the proxy is determined, the local proxy client serves as the original client role and then performs encryption and decryption data transmission with the WEB server, and the transmitted content is the part needing to pass the proxy. Correspondingly, proxy transmission is carried out between the local proxy client and the WEB server at the moment through the network proxy server, and the encryption and decryption processes between the local proxy client and the WEB server can be consistent with the encryption and decryption processes of the client and the server in the current HTTPS protocol.
It should be noted that before the HTTPS requests traffic for encryption by the browser, the digital certificate needs to be verified, for example, the operating system obtains a pre-stored trusted certificate list to determine the validity of the digital certificate. And after the requested data is obtained, the data is encrypted by using the digital certificate and then sent to the browser client, and the browser client decrypts the data by using the same digital certificate.
By the method, the management and control of the HTTPS request flow agent can be realized, the flow which does not need to be acted is further prevented from being sent to the proxy server, the resource consumption of the proxy server is increased, and the corresponding speed of the proxy server can be improved. Meanwhile, the judgment is executed at the local proxy client, so that the data security and the privacy can be improved.
Based on the content of the foregoing embodiment, as an optional embodiment, after obtaining the requested content through the network proxy server, the method further includes: and loading the request content acquired by the network proxy server to a local resource cache.
When the URL is judged to need to be accessed by the proxy, the local resource cache is searched. And if the local resource cache does not exist, acquiring the requested content through the network proxy server. After the request content is returned, in order to facilitate subsequent re-access, the request content returned by the proxy server is loaded into the local resource cache, the same URL request is detected subsequently, and the proxy access is needed, and the same content in the local resource cache is directly loaded, so that the access through the proxy server is not needed. According to the method, the request content is loaded to the local resource cache, the same content is prevented from passing through the proxy server, the load overhead of the proxy server is reduced, and meanwhile the response speed of the same content is improved.
Based on the content of the foregoing embodiment, as an optional embodiment, before loading the content requested by the network proxy server to the local resource cache, the method further includes: and filtering the requested content through a static resource filter so as to load the static resource meeting the filtering condition to the local resource cache.
It is contemplated that the requested content is changing in real-time, such as real-time data being requested. In the embodiment of the invention, the request content returned by the proxy server is filtered firstly. Static resources in the data are cached, and dynamic data are not cached any more due to the loss of timeliness. Static resources, which can be understood as front-end fixed pages, here pages that contain HTML, CSS, JS, pictures, etc. and can be displayed directly without looking up databases and without program processing.
Based on the content of the above embodiment, as an optional embodiment, if it is determined that proxy is not needed, directly accessing the internet; recording the loading time of the webpage in the URL request, if the loading time exceeds a preset threshold, marking the network address in the URL request as needing proxy, and adding the network address into a preset URL proxy rule.
In consideration of the fact that the pre-configured URL agent rule can not fully cover the website needing to be acted, the URL agent rule is dynamically updated in the embodiment of the invention. When filtering is performed according to proxy rules in the form of a URL proxy white list and the web address in the URL request is not in the white list, the network is accessed in a direct connection manner. And if the opposite-end server responds to the request and returns the request content, recording the loading duration of the request content, and when the loading duration is greater than a preset threshold value, indicating that the access effect is poor in a direct connection mode, loading the network address accessed this time into an agent white list and marking the network address as needing agent. The URL agent rule can judge the website as the website needing to pass the agent when the user accesses the same website next time. Then, the above embodiments of obtaining the request content after searching through the local resource and directly accessing and caching the request content through the proxy without searching can be combined, and details are not repeated here. By the method, dynamic updating of the URL filtering rule can be realized, and high efficiency of accessing the website by the user is ensured.
Based on the content of the foregoing embodiment, as an optional embodiment, before determining whether the requested content has a local resource cache, the method further includes: and verifying the network address in the URL request according to the configuration information issued by the configuration server, and if the network address does not pass the verification, stopping accessing through the proxy.
The configuration server is a server outside the local device, and the role of the configuration server can be regarded as supervision of the URL proxy rule, as the URL proxy rule is usually set for a user, some illegal websites and sensitive websites exist, the websites are configured through the configuration server, for example, a blacklist is set for carrying out verification again, if the verification is not passed, the access is not allowed, and the access through the proxy is stopped.
Fig. 3 is a schematic flow chart of a WEB site access acceleration method according to another embodiment of the present invention, and as shown in fig. 3, reference may be made to the above-mentioned method embodiment for parts in the diagram. The local proxy carrier is a specifically executed module, and after determining that proxy access is required, the URL proxy rule sends the website to the local proxy carrier, and the local proxy carrier searches for request contents from the local resource cache, directly accesses through the proxy, and also receives configuration information of the configuration server, where specific contents may refer to the above-mentioned embodiment, and details are not described here.
The method of the embodiment of the invention has the following advantages: and the network delay is realized, and the accelerated network resources are all obtained from the local, so that the network transmission delay of most resource files is saved. And the main body of the acceleration program runs on a client machine, so that the acceleration program is not interfered by a network server, and the accelerated flow is only the flow of the current client and does not occupy the actual network bandwidth. Flexibility, configuration granularity can be refined to each field of the HTTP protocol, performance pressure brought by analysis of the HTTP protocol is not considered too much, and HTTPS flow is supported. Security/privacy, since the program body runs on the client and the acceleration service is in principle also done on the local machine, there is no risk that the accelerated traffic is leaked to the third party server. The embodiment of the invention can not only be used for accelerating the resource access, but also or occupy the following use scenes: removing the webpage advertisements, wherein the principle is similar to AdBlock; safety control of Web content of a special intranet scene; decentralized internet construction combined with P2P technology.
The following describes the WEB site access accelerating device provided in the embodiment of the present invention, and the WEB site access accelerating device described below and the WEB site access accelerating method described above may be referred to in correspondence with each other.
Fig. 4 is a schematic structural diagram of a WEB site access accelerating device according to an embodiment of the present invention, and as shown in fig. 4, the WEB site access accelerating device includes: a rule filtering module 401, a cache judging module 402 and a data obtaining module 403. The rule filtering module 401 is configured to, if a URL request is detected, determine whether to pass proxy according to a preset URL proxy rule; the cache determining module 402 is configured to determine whether the request content exists in the local resource cache if the request content needs to pass through the proxy; the data obtaining module 403 is configured to, if the request exists in the local resource cache, obtain the requested content from the local resource cache.
The device embodiment provided in the embodiments of the present invention is for implementing the above method embodiments, and for details of the process and the details, reference is made to the above method embodiments, which are not described herein again.
According to the WEB site access accelerating device provided by the embodiment of the invention, whether the WEB site passes the proxy or not is judged according to the preset URL proxy rule, proxy acceleration on all contents is not needed, and the phenomenon that the flow which does not need to be proxied is sent to a proxy server, so that the resource consumption of the proxy server is increased is avoided. If the request content exists in the local resource cache, the request content is obtained from the local resource cache, and the request content does not need to be requested from the proxy server, so that the load overhead of the proxy server is further reduced, the request blocking is avoided, the user experience of proxy access can be obviously improved, the times of obtaining data from the proxy are reduced, and the data security and privacy are improved.
Fig. 5 is a schematic structural diagram of an electronic device according to an embodiment of the present invention, and as shown in fig. 5, the electronic device may include: a processor (processor)501, a communication Interface (Communications Interface)502, a memory (memory)503, and a communication bus 504, wherein the processor 501, the communication Interface 502, and the memory 503 are configured to communicate with each other via the communication bus 504. The processor 501 may call logic instructions in the memory 503 to perform a WEB site access acceleration method comprising: if the URL request is detected, judging whether the URL request passes the proxy or not according to a preset URL proxy rule; if the request content needs to pass through the proxy, judging whether the request content exists in a local resource cache; and if so, acquiring the requested content from the local resource cache.
In addition, the logic instructions in the memory 503 may be implemented in the form of software functional units and stored in a computer readable storage medium when the logic instructions are sold or used as independent products. Based on such understanding, the technical solution of the present invention may be embodied in the form of a software product, which is stored in a storage medium and includes instructions for causing a computer device (which may be a personal computer, a server, or a network device) to execute all or part of the steps of the method according to the embodiments of the present invention. And the aforementioned storage medium includes: a U-disk, a removable hard disk, a Read-Only Memory (ROM), a Random Access Memory (RAM), a magnetic disk or an optical disk, and other various media capable of storing program codes.
In another aspect, an embodiment of the present invention further provides a computer program product, where the computer program product includes a computer program stored on a non-transitory computer-readable storage medium, the computer program includes program instructions, and when the program instructions are executed by a computer, the computer can execute the method for accelerating WEB site access provided by the above-mentioned method embodiments, where the method includes: if the URL request is detected, judging whether the URL request passes the proxy or not according to a preset URL proxy rule; if the request content needs to pass through the proxy, judging whether the request content exists in a local resource cache; and if so, acquiring the requested content from the local resource cache.
In still another aspect, an embodiment of the present invention further provides a non-transitory computer-readable storage medium, on which a computer program is stored, where the computer program is implemented by a processor to perform the WEB site access acceleration method provided in the foregoing embodiments, and the method includes: if the URL request is detected, judging whether the URL request passes the proxy or not according to a preset URL proxy rule; if the request content needs to pass through the proxy, judging whether the request content exists in a local resource cache; and if so, acquiring the requested content from the local resource cache.
The above-described embodiments of the apparatus are merely illustrative, and the units described as separate parts may or may not be physically separate, and parts displayed as units may or may not be physical units, may be located in one place, or may be distributed on a plurality of network units. Some or all of the modules may be selected according to actual needs to achieve the purpose of the solution of the present embodiment. One of ordinary skill in the art can understand and implement it without inventive effort.
Through the above description of the embodiments, those skilled in the art will clearly understand that each embodiment can be implemented by software plus a necessary general hardware platform, and certainly can also be implemented by hardware. With this understanding in mind, the above-described technical solutions may be embodied in the form of a software product, which can be stored in a computer-readable storage medium such as ROM/RAM, magnetic disk, optical disk, etc., and includes instructions for causing a computer device (which may be a personal computer, a server, or a network device, etc.) to execute the methods described in the embodiments or some parts of the embodiments.
Finally, it should be noted that: the above examples are only intended to illustrate the technical solution of the present invention, but not to limit it; although the present invention has been described in detail with reference to the foregoing embodiments, it will be understood by those of ordinary skill in the art that: the technical solutions described in the foregoing embodiments may still be modified, or some technical features may be equivalently replaced; and such modifications or substitutions do not depart from the spirit and scope of the corresponding technical solutions of the embodiments of the present invention.
Claims (10)
1. A method for accelerating WEB site access is characterized by comprising the following steps:
if the URL request is detected, judging whether the URL request passes the proxy or not according to a preset URL proxy rule;
if the request content needs to pass through the proxy, judging whether the request content exists in a local resource cache;
and if so, acquiring the requested content from the local resource cache.
2. The WEB site access acceleration method according to claim 1, wherein if the requested content does not exist in the local resource cache, the requested content is obtained through the WEB proxy server.
3. The WEB site access acceleration method according to claim 2, wherein the acquiring the requested content via the WEB proxy server includes:
sending the HTTPS request to a local proxy client, receiving a digital certificate sent by the local proxy client, and verifying the digital certificate sent by the local proxy client according to a trusted certificate list prestored by an operating system;
if the verification is passed, encrypting the HTTPS request flow according to the digital certificate, and sending the encrypted HTTPS request flow to a local agent client;
the local proxy client decrypts according to the digital certificate, judges the content needing to pass through the network proxy server according to the obtained HTTPS request content, encrypts the content needing to pass through the network proxy and sends the encrypted content to the network proxy server;
and the local proxy client acquires and decrypts the request content returned by the network proxy server, encrypts the request content by using the digital certificate and then sends the encrypted request content to the browser client.
4. The WEB site access acceleration method according to claim 2, wherein after the obtaining of the requested content via the WEB proxy server, further comprising:
and loading the request content acquired by the network proxy server to a local resource cache.
5. The WEB site access acceleration method according to claim 4, wherein before loading the content requested by the WEB proxy server into the local resource cache, the method further comprises:
and filtering the requested content through a static resource filter so as to load the static resource meeting the filtering condition to the local resource cache.
6. The WEB site access acceleration method according to claim 1, wherein if it is determined that proxy is not required, directly accessing the internet and recording the loading duration of the WEB page in the URL request;
and if the loading duration is greater than a preset threshold value, marking the network address in the URL request as a proxy address, and adding the proxy address into a preset URL proxy rule.
7. The WEB site access acceleration method according to claim 1, wherein before determining whether the requested content is stored in the local resource cache, the method further comprises:
and verifying the network address in the URL request according to the configuration information issued by the configuration server, and if the network address does not pass the verification, stopping accessing through the proxy.
8. A WEB site access accelerating apparatus, comprising:
the rule filtering module is used for judging whether the URL request passes the proxy or not according to a preset URL proxy rule if the URL request is detected;
the cache judging module is used for judging whether the request content exists in the local resource cache if the request content needs to pass through the proxy;
and the data acquisition module is used for acquiring the requested content from the local resource cache if the requested content exists in the local resource cache.
9. An electronic device comprising a memory, a processor, and a computer program stored on the memory and executable on the processor, wherein the processor implements the steps of the WEB site access acceleration method according to any one of claims 1 to 7 when executing the program.
10. A non-transitory computer readable storage medium having a computer program stored thereon, wherein the computer program when executed by a processor implements the steps of the WEB site access acceleration method according to any one of claims 1 to 7.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202011174951.2A CN112364274A (en) | 2020-10-28 | 2020-10-28 | WEB site access acceleration method and device |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202011174951.2A CN112364274A (en) | 2020-10-28 | 2020-10-28 | WEB site access acceleration method and device |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN112364274A true CN112364274A (en) | 2021-02-12 |
Family
ID=74511256
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202011174951.2A Pending CN112364274A (en) | 2020-10-28 | 2020-10-28 | WEB site access acceleration method and device |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN112364274A (en) |
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110999260A (en) * | 2017-07-24 | 2020-04-10 | 脸谱公司 | Transmission of control data in proxy-based network communications |
| CN113515458A (en) * | 2021-07-23 | 2021-10-19 | 浩鲸云计算科技股份有限公司 | Method and system for reducing resource consumption of test environment based on Envoy plug-in |
| CN114222301A (en) * | 2021-12-13 | 2022-03-22 | 奇安盘古(上海)信息技术有限公司 | Fraud site processing method, device and storage medium |
| CN115134356A (en) * | 2022-09-01 | 2022-09-30 | 深圳市华曦达科技股份有限公司 | Method, system and medium for distributing monitoring node downloads for central node |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101257485A (en) * | 2007-03-02 | 2008-09-03 | 华为技术有限公司 | Web applied system and method |
| CN103001964A (en) * | 2012-12-04 | 2013-03-27 | 杭州顺网科技股份有限公司 | Cache acceleration method under local area network environment |
| CN104065749A (en) * | 2014-07-10 | 2014-09-24 | 上海斐讯数据通信技术有限公司 | Method and device for accessing web through proxy |
| CN105610909A (en) * | 2015-12-21 | 2016-05-25 | 北京大学 | Mobile browser resource loading optimization method based on cloud-side cooperation |
| CN107025234A (en) * | 2016-02-01 | 2017-08-08 | 中国移动通信集团公司 | A kind of information-pushing method and caching server |
-
2020
- 2020-10-28 CN CN202011174951.2A patent/CN112364274A/en active Pending
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101257485A (en) * | 2007-03-02 | 2008-09-03 | 华为技术有限公司 | Web applied system and method |
| CN103001964A (en) * | 2012-12-04 | 2013-03-27 | 杭州顺网科技股份有限公司 | Cache acceleration method under local area network environment |
| CN104065749A (en) * | 2014-07-10 | 2014-09-24 | 上海斐讯数据通信技术有限公司 | Method and device for accessing web through proxy |
| CN105610909A (en) * | 2015-12-21 | 2016-05-25 | 北京大学 | Mobile browser resource loading optimization method based on cloud-side cooperation |
| CN107025234A (en) * | 2016-02-01 | 2017-08-08 | 中国移动通信集团公司 | A kind of information-pushing method and caching server |
Cited By (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110999260A (en) * | 2017-07-24 | 2020-04-10 | 脸谱公司 | Transmission of control data in proxy-based network communications |
| CN113515458A (en) * | 2021-07-23 | 2021-10-19 | 浩鲸云计算科技股份有限公司 | Method and system for reducing resource consumption of test environment based on Envoy plug-in |
| CN113515458B (en) * | 2021-07-23 | 2024-04-16 | 浩鲸云计算科技股份有限公司 | Method and system for reducing test environment resource consumption based on Envoy plug-in |
| CN114222301A (en) * | 2021-12-13 | 2022-03-22 | 奇安盘古(上海)信息技术有限公司 | Fraud site processing method, device and storage medium |
| CN114222301B (en) * | 2021-12-13 | 2024-04-12 | 奇安盘古(上海)信息技术有限公司 | Fraud site processing method, fraud site processing device and storage medium |
| CN115134356A (en) * | 2022-09-01 | 2022-09-30 | 深圳市华曦达科技股份有限公司 | Method, system and medium for distributing monitoring node downloads for central node |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN112364274A (en) | WEB site access acceleration method and device | |
| CN107341160B (en) | Crawler intercepting method and device | |
| US11122067B2 (en) | Methods for detecting and mitigating malicious network behavior and devices thereof | |
| US8161538B2 (en) | Stateful application firewall | |
| US20180041530A1 (en) | Method and system for detecting malicious web addresses | |
| CN105100294B (en) | Obtain method, system, the webserver, browser and the GSLB of webpage | |
| CN107341395B (en) | Method for intercepting reptiles | |
| CN107046544B (en) | Method and device for identifying illegal access request to website | |
| EP3175365B1 (en) | Web redirection for content filtering | |
| US11451583B2 (en) | System and method to detect and block bot traffic | |
| US11044268B2 (en) | Systems and methods for identifying internet attacks | |
| US9147067B2 (en) | Security method and apparatus | |
| CN108667799B (en) | Defense method and system for browser cache poisoning | |
| CN110636068B (en) | Method and device for identifying unknown CDN node in CC attack protection | |
| EP3633948B1 (en) | Anti-attack method and device for server | |
| CN108429785A (en) | A kind of generation method, reptile recognition methods and the device of reptile identification encryption string | |
| CN106686151A (en) | IP address obtaining method and device | |
| CN106411978B (en) | Resource caching method and device | |
| CN112243013A (en) | Method, system, server and storage medium for realizing cross-domain resource caching | |
| CN111988644B (en) | Anti-stealing-link method, device, equipment and storage medium for network video | |
| CN109698832B (en) | Method for rapidly providing Portal authentication and rapidly popping Portal authentication page and related equipment | |
| CN105490993B (en) | Method and device for preventing Cookie tracking in browser | |
| US20180316697A1 (en) | Method of aiding the detection of infection of a terminal by malware | |
| CN113742631B (en) | CDN-based website picture anti-theft chain method | |
| US9191392B2 (en) | Security configuration |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |