CN109635203A - Webpage capture request processing method, device, server and storage medium - Google Patents

Webpage capture request processing method, device, server and storage medium Download PDF

Info

Publication number
CN109635203A
CN109635203A CN201811566906.4A CN201811566906A CN109635203A CN 109635203 A CN109635203 A CN 109635203A CN 201811566906 A CN201811566906 A CN 201811566906A CN 109635203 A CN109635203 A CN 109635203A
Authority
CN
China
Prior art keywords
data
webpage
server
search engine
characteristic information
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN201811566906.4A
Other languages
Chinese (zh)
Other versions
CN109635203B (en
Inventor
刘明
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Beijing Dajia Internet Information Technology Co Ltd
Original Assignee
Beijing Dajia Internet Information Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Beijing Dajia Internet Information Technology Co Ltd filed Critical Beijing Dajia Internet Information Technology Co Ltd
Priority to CN201811566906.4A priority Critical patent/CN109635203B/en
Publication of CN109635203A publication Critical patent/CN109635203A/en
Application granted granted Critical
Publication of CN109635203B publication Critical patent/CN109635203B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Landscapes

  • Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
  • Information Transfer Between Computers (AREA)

Abstract

The disclosure is directed to a kind of webpage capture request processing method, device, server and storage mediums, belong to network technique field.This method comprises: obtaining the webpage capture request that search engine server is sent;According to the characteristic information that the webpage capture is requested, target webpage data are obtained;The target webpage data are sent to described search engine server.The characteristic information that this method is requested by webpage capture, come be targetedly search engine server obtain target webpage data, since characteristic information can distinguish each search engine server, therefore, acquisition based on this feature information, it can satisfy the different data demand of different search engine servers, namely can be realized and the web data customized is returned to different search engine servers.

Description

Webpage capture request processing method, device, server and storage medium
Technical field
This disclosure relates to network technique field more particularly to a kind of webpage capture request processing method, device, server and Storage medium.
Background technique
In the related technology, when user is scanned for using search engine, search engine server can searching based on user Rope word returns to the redirected link of corresponding web data.
In above process, search engine server meeting not timing issues webpage capture request to each Website server, To obtain the current web data in each website, thus in case calling in storage to search engine server, wherein the webpage is grabbed Take request for grabbing web data.And for each Website server, for the net of each search engine server transmission Page crawl request, can return to identical web data, it is impossible to meet the different data demand of different search engine servers, It cannot achieve the customized search of search engine server.
Summary of the invention
The disclosure provides a kind of webpage capture request processing method, device, server and storage medium, can satisfy difference The different data demand of search engine server, realizes the customized search of search engine server.
According to the first aspect of the embodiments of the present disclosure, a kind of webpage capture request processing method is provided, this method comprises:
The webpage capture request that search engine server is sent is obtained, webpage capture request returns to webpage number for requesting According to;
According to the characteristic information that the webpage capture is requested, target webpage data, the target webpage data and this feature are obtained Information is corresponding, and this feature information is used to indicate to issue the data requirements of the search engine server of webpage capture request;
The target webpage data are sent to the search engine server.
In a kind of possible embodiment, according to the characteristic information that the webpage capture is requested, target webpage data packet is obtained It includes:
According to this feature information, inquire corresponding with this feature information data cached;
When inquire this it is data cached when, this data cached is retrieved as the target webpage data.
In a kind of possible embodiment, according to the characteristic information that the webpage capture is requested, target webpage data packet is obtained It includes:
According to this feature information, inquire corresponding with this feature information data cached;
When inquiring data cached less than this, the target webpage data, the configuration server are obtained by configuration server For configuring corresponding web data for each characteristic information.
In a kind of possible embodiment, when inquiring data cached less than this, which is obtained by configuration server After web data, this method further include:
It is object key name by this feature information cache, which is used to indicate obtains the target webpage data next time Index;
It is object key assignments by the target webpage data buffer storage, which is used to indicate next time according to the object key name The index content inquired.
In a kind of possible embodiment, when inquiring data cached less than this, which is obtained by configuration server Web data includes:
It is obtained from the configuration server corresponding with this feature information at interval of the first preset duration according to this feature information Web data.
In a kind of possible embodiment, according to the characteristic information that the webpage capture is requested, target webpage data packet is obtained It includes:
According to this feature information, inquire corresponding with this feature information data cached;
When inquiry is data cached less than this, and receives the configuration failure information of configuration server transmission, pass through website Server obtains the target webpage data, which is used to configure corresponding web data for each characteristic information, should It is that this feature information configuration corresponds to web data that configuration failure information, which is used to indicate the configuration server not,.
In a kind of possible embodiment, this method further include:
At interval of the second preset duration, empty data cached corresponding to each characteristic information.
In a kind of possible embodiment, this feature information is to extract from the aiming field that the webpage capture is requested Search engine identification information;Or,
This feature information is the key-strings extracted from the aiming field that the webpage capture is requested.
In a kind of possible embodiment, obtaining the webpage capture request that search engine server is sent includes:
The target webpage that Receiving Agent server is sent grabs request, and target webpage crawl request is that the search engine takes It is engaged in the webpage capture request that device is sent, meets the webpage capture request of default white list;
The target webpage data, which are sent to the search engine server, includes:
By the proxy server, which is sent to the search engine server.
According to the second aspect of an embodiment of the present disclosure, a kind of webpage capture request processing unit is provided, which includes:
First acquisition unit is configured as executing the webpage capture request for obtaining search engine server transmission, the webpage Crawl request returns to web data for requesting;
Second acquisition unit is configured as executing the characteristic information requested according to the webpage capture, obtains target network number of pages According to the target webpage data are corresponding with this feature information, and this feature information is used for the search for indicating to issue webpage capture request The data requirements of engine server;
Transmission unit is configured as execution for the target webpage data and is sent to the search engine server.
In a kind of possible embodiment, which includes:
Subelement is inquired, is configured as executing according to this feature information, inquire corresponding with this feature information data cached;
Obtain subelement, be configured as executing when inquire this it is data cached when, this data cached is retrieved as the target Web data.
In a kind of possible embodiment, which includes:
Subelement is inquired, is configured as executing according to this feature information, inquire corresponding with this feature information data cached;
Subelement is obtained, is configured as executing when inquiring data cached less than this, which is obtained by configuration server Web data is marked, which is used to configure corresponding web data for each characteristic information.
In a kind of possible embodiment, the device further include:
Cache unit, being configured as executing by this feature information cache is object key name, which is used to indicate down Once obtain the index of the target webpage data;
The cache unit, being additionally configured to execute by the target webpage data buffer storage is object key assignments, which uses In the index content that instruction is inquired according to the object key name next time.
In a kind of possible embodiment, which is additionally configured to execute:
It is obtained from the configuration server corresponding with this feature information at interval of the first preset duration according to this feature information Web data.
In a kind of possible embodiment, which includes:
Subelement is inquired, is configured as executing according to this feature information, inquire corresponding with this feature information data cached;
Subelement is obtained, it is data cached less than this when inquiring to be configured as execution, and receives what configuration server was sent When configuration failure information, which is obtained by Website server, which is used to believe for each feature Breath configures corresponding web data, and it is this feature information configuration pair which, which is used to indicate the configuration server not, Answer web data.
In a kind of possible embodiment, which is characterized in that the device further include:
Unit is emptied, is configured as executing emptying caching corresponding to each characteristic information at interval of the second preset duration Data.
In a kind of possible embodiment, this feature information is to extract from the aiming field that the webpage capture is requested Search engine identification information;Or,
This feature information is the key-strings extracted from the aiming field that the webpage capture is requested.
In a kind of possible embodiment, which is additionally configured to execute:
The target webpage that Receiving Agent server is sent grabs request, and target webpage crawl request is that the search engine takes It is engaged in the webpage capture request that device is sent, meets the webpage capture request of default white list;
The transmission unit is additionally configured to execute:
By the proxy server, which is sent to the search engine server.
According to the third aspect of an embodiment of the present disclosure, a kind of server is provided, which includes:
Processor;
For storing the memory of the processor-executable instruction;
Wherein, which is configured as:
The webpage capture request that search engine server is sent is obtained, webpage capture request returns to webpage number for requesting According to;
According to the characteristic information that the webpage capture is requested, target webpage data, the target webpage data and this feature are obtained Information is corresponding, and this feature information is used to indicate to issue the data requirements of the search engine server of webpage capture request;
The target webpage data are sent to the search engine server.
According to a fourth aspect of embodiments of the present disclosure, a kind of non-transitorycomputer readable storage medium is provided, when this is deposited When instruction in storage media is executed by the processor of server, enable the server to execute a kind of webpage capture request processing side Method, this method comprises:
The webpage capture request that search engine server is sent is obtained, webpage capture request returns to webpage number for requesting According to;
According to the characteristic information that the webpage capture is requested, target webpage data, the target webpage data and this feature are obtained Information is corresponding, and this feature information is used to indicate to issue the data requirements of the search engine server of webpage capture request;
The target webpage data are sent to the search engine server.
According to a fifth aspect of the embodiments of the present disclosure, a kind of application program is provided, including one or more instructs, this Or a plurality of instruction enables the server to execute a kind of webpage capture request processing side when can be executed by the processor of server Method, this method comprises:
The webpage capture request that search engine server is sent is obtained, webpage capture request returns to webpage number for requesting According to;
According to the characteristic information that the webpage capture is requested, target webpage data, the target webpage data and this feature are obtained Information is corresponding, and this feature information is used to indicate to issue the data requirements of the search engine server of webpage capture request;
The target webpage data are sent to the search engine server.
The technical scheme provided by this disclosed embodiment can include the following benefits:
By obtaining webpage capture request, thus according to the characteristic information that the webpage capture is requested, it is next to be targetedly Search engine server obtains target webpage data, and the target webpage data are sent to search engine server, due to spy Reference breath can distinguish each search engine server, therefore, based on the acquisition of this feature information, can satisfy different search and draw The different data demand of server is held up, namely can be realized and the webpage number customized is returned to different search engine servers According to.
It should be understood that above general description and following detailed description be only it is exemplary and explanatory, not The disclosure can be limited.
Detailed description of the invention
The drawings herein are incorporated into the specification and forms part of this specification, and shows the implementation for meeting the disclosure Example, and together with specification for explaining the principles of this disclosure.
Fig. 1 is a kind of flow chart of webpage capture request processing method shown according to an exemplary embodiment.
Fig. 2 is a kind of implementation environment signal of webpage capture request processing method shown according to an exemplary embodiment Figure.
Fig. 3 is a kind of interaction diagrams of webpage capture request processing method shown according to an exemplary embodiment.
Fig. 4 is a kind of schematic diagram of webpage capture request processing method shown according to an exemplary embodiment.
Fig. 5 is a kind of interaction diagrams of webpage capture request processing method shown according to an exemplary embodiment.
Fig. 6 is a kind of interaction diagrams of webpage capture request processing method shown according to an exemplary embodiment.
Fig. 7 is a kind of logical construction block diagram of webpage capture request processing unit shown according to an exemplary embodiment.
Fig. 8 is a kind of logical construction block diagram of server shown according to an exemplary embodiment.
Specific embodiment
Example embodiments are described in detail here, and the example is illustrated in the accompanying drawings.Following description is related to When attached drawing, unless otherwise indicated, the same numbers in different drawings indicate the same or similar elements.Following exemplary embodiment Described in embodiment do not represent all implementations consistent with this disclosure.On the contrary, they be only with it is such as appended The example of the consistent device and method of some aspects be described in detail in claims, the disclosure.
Fig. 1 is a kind of flow chart of webpage capture request processing method shown according to an exemplary embodiment, such as Fig. 1 institute Show, webpage capture request processing method is in server, comprising the following steps:
In a step 101, the webpage capture request that search engine server is sent is obtained, which requests for asking Seek return web data.
In a step 102, the characteristic information requested according to the webpage capture obtains target webpage data, the target webpage Data are corresponding with this feature information, and this feature information is used to indicate to issue the number of the search engine server of webpage capture request According to demand.
In step 103, which is sent to the search engine server.
The method that the embodiment of the present disclosure provides, by obtaining webpage capture request, thus according to webpage capture request Characteristic information, to be targetedly that search engine server obtains target webpage data, and the target webpage data are sent To search engine server, since characteristic information can distinguish each search engine server, based on this feature information It obtains, can satisfy the different data demand of different search engine servers, namely can be realized to different search engine clothes Business device returns to the web data customized.
In a kind of possible embodiment, according to the characteristic information that the webpage capture is requested, target webpage data packet is obtained It includes:
According to this feature information, inquire corresponding with this feature information data cached;
When inquire this it is data cached when, this data cached is retrieved as the target webpage data.
In a kind of possible embodiment, according to the characteristic information that the webpage capture is requested, target webpage data packet is obtained It includes:
According to this feature information, inquire corresponding with this feature information data cached;
When inquiring data cached less than this, the target webpage data, the configuration server are obtained by configuration server For configuring corresponding web data for each characteristic information.
In a kind of possible embodiment, when inquiring data cached less than this, which is obtained by configuration server After web data, this method further include:
It is object key name by this feature information cache, which is used to indicate obtains the target webpage data next time Index;
It is object key assignments by the target webpage data buffer storage, which is used to indicate next time according to the object key name The index content inquired.
In a kind of possible embodiment, when inquiring data cached less than this, which is obtained by configuration server Web data includes:
It is obtained from the configuration server corresponding with this feature information at interval of the first preset duration according to this feature information Web data.
In a kind of possible embodiment, according to the characteristic information that the webpage capture is requested, target webpage data packet is obtained It includes:
According to this feature information, inquire corresponding with this feature information data cached;
When inquiry is data cached less than this, and receives the configuration failure information of configuration server transmission, pass through website Server obtains the target webpage data, which is used to configure corresponding web data for each characteristic information, should It is that this feature information configuration corresponds to web data that configuration failure information, which is used to indicate the configuration server not,.
In a kind of possible embodiment, this method further include:
At interval of the second preset duration, empty data cached corresponding to each characteristic information.
In a kind of possible embodiment, this feature information is to extract from the aiming field that the webpage capture is requested Search engine identification information;Or,
This feature information is the key-strings extracted from the aiming field that the webpage capture is requested.
In a kind of possible embodiment, obtaining the webpage capture request that search engine server is sent includes:
The target webpage that Receiving Agent server is sent grabs request, and target webpage crawl request is that the search engine takes It is engaged in the webpage capture request that device is sent, meets the webpage capture request of default white list;
The target webpage data, which are sent to the search engine server, includes:
By the proxy server, which is sent to the search engine server.
All the above alternatives can form the alternative embodiment of the disclosure, herein no longer using any combination It repeats one by one.
Fig. 2 is a kind of implementation environment signal of webpage capture request processing method shown according to an exemplary embodiment Figure, referring to fig. 2, the embodiment of the present disclosure are applied to interaction scenarios between search engine and website, search engine server 201 to Each website sends webpage capture request, and stores the web data that each website returns, so as to based on each of storage Web data provides function of search for visitor.And the server for being used for maintaining web includes proxy server 202, SEO (Search Engine Optimization, search engine optimization) server 203, configuration server 204 and Website server 205。
Wherein, which grabs request hair for target webpage for screening to received data It send to SEO server 203, the data other than target webpage crawl request is sent to Website server 205, wherein should Target webpage crawl request is to meet the webpage capture request of default white list, the data other than target webpage crawl request It can be the webpage capture request for not meeting default white list, or the access request etc. sent for terminal, for example, the agency takes Business device 202 can be nginx proxy server, to reduce the memory of occupancy, increase the concurrent energy of proxy server 202 Power.
Wherein, which is used to handle webpage capture request, shares the data of Website server 205 Processing pressure;The configuration server 204, which is used to configure corresponding web data for each search engine, optionally also configures clothes Business device 204 can be also used for being managed SEO server 203 and proxy server 202, can in the configuration server 204 To be equipped with client, allow users to realize the behaviour for carrying out each search engine configuration webpage data based on the client Make, it is of course also possible to be managed based on parameter setting of the client to proxy server 202 and SEO server 203; The Website server 205 is used for the normal operation of maintaining web, provides webpage information displaying service to access the terminal of the website Deng.
Optionally, in the proxy server 202, SEO server 203, configuration server 204 and Website server 205, Any two or more than server can also be located at same physical entity, the embodiment of the present disclosure not limit this specifically.
Based on above-mentioned application scenarios, Fig. 3 is a kind of webpage capture request processing side shown according to an exemplary embodiment The interaction diagrams of method, Fig. 4 are a kind of schematic diagrames of webpage capture request processing method shown according to an exemplary embodiment, As shown in Figure 3 and Figure 4, which is used for the interactive process of above-mentioned each server, including following step It is rapid:
In step 301, when proxy server 202 receives any data, the aiming field of the data is read.
In above-mentioned steps 301, which can be the webpage capture request that each search engine server 201 issues, Certainly, which is also possible to the access request of terminal sending, and the embodiment of the present disclosure does not limit the type of the data specifically Fixed, for example, the data can be the form of http agreement request, webpage capture request can be crawler data.
Optionally, which can be the request head file of the data, should when the data are that webpage capture is requested Request head file can carry search engine identification information, resource type information and language type information etc., when the data are When access request, which does not carry the search engine identification information then, but can carry and be used to indicate terminal shape The terminal identification information etc. of condition.In above process, by taking webpage capture request is http agreement request as an example, by the request header word UA (User-Agent, user agent) type information of section is retrieved as the search engine identification information, which can be with It is Baiduspider or googlebot etc., for different search engine servers 201, can have different UA type letters Breath, the embodiment of the present disclosure do not limit the content of the UA type information specifically.
In step 302, after the search engine identification information is read from the aiming field when proxy server 202, The data are determined as webpage capture request, extract resource type information and language type information from the aiming field.
Wherein, which is used to indicate the resource type of 201 request of search engine server, for example, When the resource type information indicates web page resources, requesting the Accept type information in head file can be text/html, can Selection of land, the resource type information also can indicate that pictorial information, video information etc., the embodiment of the present disclosure are not believed the resource type The content of breath is specifically limited.
Wherein, which is used to indicate the language form that search engine server 201 is supported, for example, working as When the language type information indicates simplified form of Chinese Character, requesting the Accept-Language type information in head file can be zh- Cn, optionally, the language type information also can indicate that Chinese-traditional, English, Japanese etc., and the embodiment of the present disclosure is not to the language The content of type information is specifically limited.
Above-mentioned steps 302 are the processing methods that the progress of a kind of pair of webpage capture request further parses, and in some realities It applies in example, when the data are not webpage capture requests, also execute and use following step: when proxy server 202 does not extract To after the search engine identification information, Website server 205 is sent the data to, that is to say, will requested in addition to webpage capture Except data be sent to Website server 205, to realize the preliminary mistake to the data of magnanimity by proxy server 202 Filter, reduces the processing pressure of Website server 205.
In step 303, when the search engine identification information, the resource type information and the language type information meet it is pre- If when white list, webpage capture request is sent to SEO server 203 by proxy server 202.
Wherein, the default white list can be the proxy server 202 default with the matched information in website, be also possible to The information that technical staff resets on the proxy server 202, the embodiment of the present disclosure do not preset the source of white list to this It is specifically limited, for example, technical staff can preset this on proxy server 202 when the website is Chinese website White list setting are as follows: search engine identification information is designated as any search engine, and resource type information is designated as web page resources, and The language type information is designated as simplified form of Chinese Character or Chinese-traditional, that is to say, is not defined to search engine, when any search In the webpage capture request of engine, request returns to web page resources, and the search language that the search engine is supported is simplified When Chinese or Chinese-traditional, it is considered as webpage capture request and meets the default white list, it should be noted that only when webpage is grabbed When search engine identification information, resource type information and the language type information of request being taken to meet the default white list, It is determined as webpage capture request to meet default white list, the embodiment of the present disclosure does not have the content for presetting white list Body limits.
In some embodiments, multiple search engines and corresponding search engine can have been safeguarded on the default white list Identification information, resource type information and language type information can will be more according to preset rules in a kind of possible embodiment A search engine is indexed on the default white list, for example, the preset rules, which can be, includes the high search engine of flowing of access, It can be and include the good search engine of credit rating, can also be and include between Website server 205 that there are cooperative relationship Search engine etc., the preset rules can also regularly update, and the embodiment of the present disclosure does not carry out the content of the preset rules specific It limits.
Above-mentioned steps 303 are a kind of processing modes that proxy server 202 requests webpage capture, be that is to say target network Page crawl request is sent to server, wherein the net that target webpage crawl request is issued by each search engine server In page crawl request, meet the webpage capture request of default white list.And optionally, when the search engine identification information, the language When speech type information and the resource type information do not meet default white list, following step can also be performed: proxy server 202 The webpage capture for not meeting default white list request is sent to Website server 205.
In a kind of possible embodiment, for example, when the default white list has included before flowing of access 10 search engine, The webpage that the search engine server 201 that proxy server 202 receives any search engine in the default white list issues is grabbed When taking request, webpage capture request is sent to SEO server 203, any search engine outside the default white list of reception Search engine server 201 issue webpage capture request when, by the webpage capture request be sent to Website server 205.
It is processing method of the proxy server 202 to any data received, by target in above-mentioned steps 301-303 Webpage capture request is sent to SEO server 203, and the data other than target webpage crawl request are sent to website service Device 205 screens all data, by presetting white list to obtain target webpage crawl request, to reduce website The processing pressure of server 205, reduces the maintenance cost of Website server 205, to ensure that Website server 205 to each The response speed of the access request of a terminal.Certainly, in some embodiments, it can also be not provided with default white list, that is to say, All webpage capture requests are sent to SEO server 203 by proxy server 202, will be other than webpage capture is requested Data are sent to Website server 205, so that accelerating proxy server 202 carries out the speed of Screening Treatment to data, and make Obtaining web data can be retrieved in more search engines.
In step 304, after SEO server 203 receives webpage capture request, from the target of webpage capture request Search engine identification information is extracted in field, which is retrieved as characteristic information.
In above-mentioned steps 304, SEO server 203 can using the search engine identification information as characteristic information so that This feature information can indicate to issue the data requirements of the search engine of webpage capture request, to draw for different search Server 201 is held up, different web datas can be returned, realizes the return web data of customization.
In some embodiments, can also using the key-strings extracted in the aiming field as this feature information, For example, the key-strings can be the resource type information, it is based on above-mentioned example, resource type information acquisition is characterized Information, so as to realize that the search engine for being directed to request video information, and the search engine of request pictorial information return to difference Web data, realize the return web data of customization.Optionally, which can also be the language type information Deng so that for the search engine of different language search service is provided different web datas can be returned to, the embodiment of the present disclosure The type of the key-strings is not limited specifically.
In step 305, the inquiry of SEO server 203 is corresponding with this feature information data cached.
In above process, SEO server 203 can safeguard that multiple characteristic informations are corresponding multiple data cached, In some embodiments, target webpage crawl is asked in the target webpage crawl request that SEO server 203 responded each The characteristic information asked is stored as indexing, and the web data of transmission is stored as the index content under the index, to realize pair Multiple data cached maintenance and update.
It is alternatively possible to which it is data cached to store this by the way of key assignments, it that is to say, using the index as object key Name, using the web data of the transmission as object key assignments, so that different characteristic information corresponds to different object key names, thus logical The key value crossed in registration table realizes data cached maintenance, and the embodiment of the present disclosure does not carry out the data cached storage form It is specific to limit.For example, when stored in a manner of key assignments this it is data cached when, SEO server 203 is by retrieval with the presence or absence of in this The object key name that characteristic information matches executes following step 306 when there are matched object key name, to realize to slow The inquiry operation of deposit data.
Within step 306, when SEO server 203 inquire this it is data cached when, this data cached is retrieved as the target The target webpage data are sent to proxy server 202 by web data.
In the above process, the target webpage data are corresponding with this feature information, and SEO server 203 passes through will be data cached Target webpage data are retrieved as, Website server 205 is sent to so as to avoid by webpage capture request, alleviates website clothes Be engaged in the data processing pressure of device 205, further, due to it is each it is data cached can correspond to different characteristic informations, namely It is that SEO server 203 can send different target webpage data to different search engine servers 201, for example, to Japanese The website of search engine, the target webpage data can be the translator of Japanese that existing web data adds website keyword, from And exposure rate of the website on Japanese search engine is increased, optimize the processing mode to webpage capture request.
In above-mentioned steps 307, SEO server 203 is by the proxy server 202, to different search engine services Device 201 returns to different target webpage data, so as to form the closed loop in process, in some embodiments, SEO server 203 can not also be by the proxy server 202, to directly return to the target network number of pages to the search engine server 201 According to, simplify webpage capture request processing flow, saved webpage capture request processing time.
In step 307, when the reception of the proxy server 202 target webpage data, which is sent to Search engine server 201.
In step 308, SEO server 203 empties and delays corresponding to each characteristic information at interval of the second preset duration Deposit data.
Wherein, which can be default, is also possible to user and carries out personal settings, the disclosure is real It applies example not limit the acquisition modes of second preset duration specifically, for example, second preset duration can be 1 day.? In the above process, when the data that empty the cache, corresponding index content can be only deleted under each index, without deleting the rope Draw, when so as to avoid loading data cached next time, it is also necessary to which addition index again that is to say, be based on above-mentioned example, only will Object key assignments corresponding to each object key name is set to sky, without deleting each object key name.
The method that the embodiment of the present disclosure provides, by obtaining webpage capture request, thus according to webpage capture request Characteristic information, to be targetedly that search engine server 201 obtains target webpage data, and the target webpage data are sent out It send to search engine server 201, since characteristic information can distinguish each search engine server 201, it is based on the spy The acquisition of reference breath, can satisfy the different data demand of different search engine servers 201, namely can be implemented as different Search engine server 201 returns to the web data customized and further grabs due to introducing SEO server 203 to webpage Request is taken to be handled, the webpage capture request frequently sent for avoiding magnanimity causes stress Website server 205, shares The processing pressure of webpage capture request has also been to ensure that each to reduce the maintenance cost of Website server 205 The corresponding speed of the access request of a terminal;In addition, being safeguarded in SEO server 203 multiple data cached, can quickly search To corresponding with characteristic information data cached, thus by this it is data cached be retrieved as target webpage data, further decrease website The processing pressure of server 205;In addition, emptying the cache data at interval of the second preset duration, so as in time to webpage number According to being updated, the web data that failure is returned to search engine server 201 is avoided.
In the above-described embodiments, SEO server 203 can inquire corresponding with this feature information data cached, thus By this it is data cached be retrieved as target webpage data, and search engine server 201 is sent to, and optionally, when SEO server 203 when cannot inquire corresponding with this feature information data cached, can execute step performed by following embodiments, Fig. 5 It is a kind of interaction diagrams of webpage capture request processing method shown according to an exemplary embodiment, referring to Fig. 5, the implementation Example include:
In step 501, when proxy server 202 receives any data, the aiming field of the data is read.
In step 502, after the search engine identification information is read from the aiming field when proxy server 202, The data are determined as webpage capture request, extract resource type information and language type information from the aiming field.
In step 503, when the search engine identification information, the resource type information and the language type information meet it is pre- If when white list, webpage capture request is sent to SEO server 203 by proxy server 202.
In step 504, after SEO server 203 receives webpage capture request, from the target of webpage capture request Search engine identification information is extracted in field, which is retrieved as characteristic information.
In step 505, the inquiry of SEO server 203 is corresponding with this feature information data cached.
In step 506, when the inquiry of SEO server 203 is data cached less than this, net is sent to configuration server 204 Page data acquisition request, the web data acquisition request at least carry this feature information, which is used to be each Characteristic information configures corresponding web data.
Above-mentioned steps 506 are a kind of methods that SEO server 203 obtains target webpage data from configuration server 204, In a kind of possible embodiment, which can also be replaced using following step: SEO server 203 is at interval of first Preset duration sends the web data acquisition request to configuration server 204.That is to say, when SEO server 203 inquiry less than When this is data cached, the web data acquisition request will not be sent to configuration server 204 at once, but wait until next interval The first preset duration when, then the web data acquisition request is sent to configuration server 204, so as to first default to this Web data acquisition request in duration is summarized, and is avoided frequent data and is transferred to configuration server 204 and brings processing Pressure.Wherein, which can be default, is also possible to user and carries out personal settings, the disclosure is implemented Example does not limit the acquisition modes of first preset duration specifically, for example, first preset duration can be 1 minute.
In step 507, when configuration server 204 receives the web data acquisition request, inquiry and this feature information The web data is sent to SEO server 203 when inquiring the web data by the web data matched.
In above process, it can be configuration server 204 and search for the spy in configured multiple web datas The web data is sent to SEO server 203 to obtain the web data with this feature information matches by reference breath.
In step 508, when the reception of SEO server 203 web data, which is retrieved as target network number of pages According to the target webpage data are sent to proxy server 202.
In step 509, when the reception of the proxy server 202 target webpage data, which is sent to Search engine server 201.
In step 510, this feature information cache is object key name by SEO server 203, which is used to indicate The index of the target webpage data is obtained next time.
Wherein, the possible embodiment of the data cached index of the entitled one kind of the object key, that is to say the key in registration table Name.
In step 511, which is object key assignments by SEO server 203, which is used for Indicate the index content inquired next time according to the object key name.
Wherein, which is a kind of possibility implementation for storing index content, that is to say the key in registration table Value, in above-mentioned steps 510-511, provide it is a kind of add data cached method, that is to say, when SEO server 203 inquire When fall short characteristic information is corresponding data cached, got by configuration server 204 corresponding with the target signature information Web data, so that the target signature information and corresponding web data are added to the data cached of SEO server 203 In, so that can directly execute a reality when receiving the webpage capture for carrying target signature information request next time Operation performed by example is applied, to optimize the process of webpage capture request processing.
In step 512, SEO server 203 empties and delays corresponding to each characteristic information at interval of the second preset duration Deposit data.
The method that the embodiment of the present disclosure provides, by obtaining webpage capture request, thus according to webpage capture request Characteristic information, to be targetedly that search engine server 201 obtains target webpage data, and the target webpage data are sent out It send to search engine server 201, since characteristic information can distinguish each search engine server 201, it is based on the spy The acquisition of reference breath, can satisfy the different data demand of different search engine servers 201, namely can be implemented as different Search engine server 201 returns to the web data customized and further grabs due to introducing SEO server 203 to webpage Request is taken to be handled, the webpage capture request frequently sent for avoiding magnanimity causes stress Website server 205, shares The processing pressure of webpage capture request has also been to ensure that each to reduce the maintenance cost of Website server 205 The corresponding speed of the access request of a terminal;Safeguarded in SEO server 203 it is multiple data cached, can quickly find with Characteristic information is corresponding data cached, and by this it is data cached as target webpage data issue, in addition, when inquiry less than with spy When reference breath is corresponding data cached, target webpage data are obtained from configuration server 204, to pass through configuration server 204 share the processing pressure of Website server 205;Further, the target network number of pages that will be got from configuration server 204 According to being added in data cached, data cached update is realized, simplifies the process for handling webpage capture request next time; In addition, avoiding to search at interval of the second preset duration data that empty the cache so as to be updated in time to web data Engine server 201 returns to the web data of failure.
In the above-described embodiments, SEO server 203 can be got corresponding with characteristic information from configuration server 204 Target webpage data, thus by proxy server 202 send the target webpage data, to share Website server 205 data processing pressure, and optionally, if configuration server 204 does not configure corresponding target for some characteristic information Web data, then step performed by following embodiments can be executed, Fig. 6 is one kind shown according to an exemplary embodiment The interaction diagrams of webpage capture request processing method, referring to Fig. 6, which includes:
In step 601, when proxy server 202 receives any data, the aiming field of the data is read.
In step 602, after the search engine identification information is read from the aiming field when proxy server 202, The data are determined as webpage capture request, extract resource type information and language type information from the aiming field.
In step 603, when the search engine identification information, the resource type information and the language type information meet it is pre- If when white list, webpage capture request is sent to SEO server 203 by proxy server 202.
In step 604, after SEO server 203 receives webpage capture request, from the target of webpage capture request Search engine identification information is extracted in field, which is retrieved as characteristic information.
In step 605, the inquiry of SEO server 203 is corresponding with this feature information data cached.
In step 606, when the inquiry of SEO server 203 is data cached less than this, net is sent to configuration server 204 Page data acquisition request, the web data acquisition request at least carry this feature information, which is used to be each Characteristic information configures corresponding web data.
In step 607, when configuration server 204 receives the web data acquisition request, inquiry and this feature information The web data matched, when inquiry is less than the web data, to the transmission configuration failure information of SEO server 203.
In above-mentioned steps 607, if configuration server 204 does not configure corresponding feature letter for some characteristic information Breath, then following step 608 can also be performed in SEO server 203.
In step 608, when SEO server 203 receives the configuration failure information, to the transmission of Website server 205 net Page crawl request.
In above process, SEO server 203 is by sending webpage capture request to Website server 205, thus should The current web data of Website server 205 is retrieved as the target webpage data.
In step 609, requests when Website server 205 receives the webpage capture, sent currently to SEO server 203 Web data.
In step 610, when SEO server 203 receives the current web data, by current web data acquisition For target webpage data, which is sent to proxy server 202.
In step 611, when the reception of the proxy server 202 target webpage data, which is sent to Search engine server 201.
In step 612, SEO server 203 empties and delays corresponding to each characteristic information at interval of the second preset duration Deposit data.
The method that the embodiment of the present disclosure provides, by obtaining webpage capture request, thus according to webpage capture request Characteristic information, to be targetedly that search engine server 201 obtains target webpage data, and the target webpage data are sent out It send to search engine server 201, since characteristic information can distinguish each search engine server 201, it is based on the spy The acquisition of reference breath, can satisfy the different data demand of different search engine servers 201, namely can be implemented as different Search engine server 201 returns to the web data customized and further grabs due to introducing SEO server 203 to webpage Request is taken to be handled, the webpage capture request frequently sent for avoiding magnanimity causes stress Website server 205, shares The processing pressure of webpage capture request has also been to ensure that each to reduce the maintenance cost of Website server 205 The corresponding speed of the access request of a terminal;Safeguarded in SEO server 203 it is multiple data cached, can quickly find with Characteristic information is corresponding data cached, and by this it is data cached as target webpage data issue, in addition, when inquiry less than with spy When reference breath is corresponding data cached, target webpage data are obtained from configuration server 204, to pass through configuration server 204 share the processing pressure of Website server 205;Further, when configuration server 204 cannot provide and this feature information pair When the web data answered, current web data is obtained as the target webpage data to Website server 205;In addition, every It avoids to search engine service every the second preset duration data that empty the cache so as to be updated in time to web data Device 201 returns to the web data of failure.
Fig. 7 is a kind of logical construction block diagram of webpage capture request processing unit shown according to an exemplary embodiment. Referring to Fig. 7, which includes first acquisition unit 701, second acquisition unit 702 and transmission unit 703.
First acquisition unit 701 is configured as executing the webpage capture request for obtaining search engine server transmission, the net Page crawl request returns to web data for requesting;
Second acquisition unit 702 is configured as executing the characteristic information requested according to the webpage capture, obtains target webpage Data, the target webpage data are corresponding with this feature information, and this feature information is used to indicate to issue searching for webpage capture request The data requirements of rope engine server;
Transmission unit 703 is configured as execution for the target webpage data and is sent to the search engine server.
The device that the embodiment of the present disclosure provides, by obtaining webpage capture request, further according to the spy of webpage capture request Reference ceases to obtain target webpage data, then sends the target webpage data to search engine server, so as to webpage capture Request is handled, and the webpage capture request frequently sent for avoiding magnanimity causes stress Website server, has shared net The processing pressure of page crawl request has also been to ensure that reduce the maintenance cost of Website server to each terminal Access request corresponding speed.
In a kind of possible embodiment, the device based on Fig. 7 is formed, which includes:
Subelement is inquired, is configured as executing according to this feature information, inquire corresponding with this feature information data cached;
Obtain subelement, be configured as executing when inquire this it is data cached when, this data cached is retrieved as the target Web data.
In a kind of possible embodiment, the device based on Fig. 7 is formed, which includes:
Subelement is inquired, is configured as executing according to this feature information, inquire corresponding with this feature information data cached;
Subelement is obtained, is configured as executing when inquiring data cached less than this, which is obtained by configuration server Web data is marked, which is used to configure corresponding web data for each characteristic information.
In a kind of possible embodiment, the device composition based on Fig. 7, the device further include:
Cache unit, being configured as executing by this feature information cache is object key name, which is used to indicate down Once obtain the index of the target webpage data;
The cache unit, being additionally configured to execute by the target webpage data buffer storage is object key assignments, which uses In the index content that instruction is inquired according to the object key name next time.
In a kind of possible embodiment, which is additionally configured to execute:
It is obtained from the configuration server corresponding with this feature information at interval of the first preset duration according to this feature information Web data.
In a kind of possible embodiment, the device based on Fig. 7 is formed, which includes:
Subelement is inquired, is configured as executing according to this feature information, inquire corresponding with this feature information data cached;
Subelement is obtained, it is data cached less than this when inquiring to be configured as execution, and receives what configuration server was sent When configuration failure information, which is obtained by Website server, which is used to believe for each feature Breath configures corresponding web data, and it is this feature information configuration pair which, which is used to indicate the configuration server not, Answer web data.
In a kind of possible embodiment, which is characterized in that the device composition based on Fig. 7, the device further include:
Unit is emptied, is configured as executing emptying caching corresponding to each characteristic information at interval of the second preset duration Data.
In a kind of possible embodiment, this feature information is to extract from the aiming field that the webpage capture is requested Search engine identification information;Or,
This feature information is the key-strings extracted from the aiming field that the webpage capture is requested.
In a kind of possible embodiment, which is additionally configured to execute:
The target webpage that Receiving Agent server is sent grabs request, and target webpage crawl request is that the search engine takes It is engaged in the webpage capture request that device is sent, meets the webpage capture request of default white list;
The transmission unit 703 is additionally configured to execute:
By the proxy server, which is sent to the search engine server.
All the above alternatives can form the alternative embodiment of the disclosure, herein no longer using any combination It repeats one by one.
About the device in above-described embodiment, wherein each unit executes the concrete mode of operation in the related webpage It grabs and is described in detail in the embodiment of request processing method, no detailed explanation will be given here.
Fig. 8 is a kind of logical construction block diagram of server shown according to an exemplary embodiment, which can be because Configuration or performance are different and generate bigger difference, may include one or more processors (central Processing units, CPU) 801 and one or more memory 802, wherein it is stored in the memory 802 At least one instruction, at least one instruction are loaded by the processor 801 and are executed to realize above-mentioned each exemplary embodiment The webpage capture request processing method of offer.Certainly, which can also have wired or wireless network interface, keyboard And the components such as input/output interface, to carry out input and output, which can also include other for realizing equipment The component of function, this will not be repeated here.
In the exemplary embodiment, a kind of non-transitorycomputer readable storage medium including instruction, example are additionally provided It such as include the memory 802 of instruction, above-metioned instruction can be executed by the processor 801 of server 800 to complete above-mentioned webpage capture Request processing method, this method comprises: obtaining the webpage capture request that search engine server is sent, webpage capture request is used Web data is returned in request;According to the characteristic information that the webpage capture is requested, target webpage data, the target network number of pages are obtained According to, the data of this feature information search engine server for indicate issue webpage capture request corresponding with this feature information Demand;The target webpage data are sent to the search engine server.Optionally, above-metioned instruction can also be by server 800 Processor 801 execute to complete other steps involved in the above exemplary embodiments.For example, the non-transitory calculates Machine readable storage medium storing program for executing can be ROM, random access memory (RAM), CD-ROM, tape, floppy disk and optical data storage devices Deng.
In the exemplary embodiment, a kind of application program, including one or more instruction are additionally provided, this one or more Instruction can be executed by the processor 801 of server 800, to complete above-mentioned webpage capture request processing method, this method comprises: The webpage capture request that search engine server is sent is obtained, webpage capture request returns to web data for requesting;According to The characteristic information of webpage capture request, obtains target webpage data, the target webpage data are corresponding with this feature information, the spy The data requirements of search engine server of the reference breath for indicating to issue webpage capture request;The target webpage data are sent out It send to the search engine server.Optionally, above-metioned instruction can also be executed by the processor 801 of server 800 on to complete State other steps involved in exemplary embodiment.
Those skilled in the art after considering the specification and implementing the invention disclosed here, will readily occur to its of the disclosure Its embodiment.This application is intended to cover any variations, uses, or adaptations of the disclosure, these modifications, purposes or Person's adaptive change follows the general principles of this disclosure and including the undocumented common knowledge in the art of the disclosure Or conventional techniques.The description and examples are only to be considered as illustrative, and the true scope and spirit of the disclosure are by following Claim is pointed out.
It should be understood that the present disclosure is not limited to the precise structures that have been described above and shown in the drawings, and And various modifications and changes may be made without departing from the scope thereof.The scope of the present disclosure is only limited by the accompanying claims.

Claims (10)

1. a kind of webpage capture request processing method, which is characterized in that the described method includes:
The webpage capture request that search engine server is sent is obtained, the webpage capture request returns to webpage number for requesting According to;
According to the characteristic information that the webpage capture is requested, target webpage data, the target webpage data and the spy are obtained Reference breath corresponds to, and the data that the characteristic information is used to indicate to issue the search engine server of the webpage capture request need It asks;
The target webpage data are sent to described search engine server.
2. webpage capture request processing method according to claim 1, which is characterized in that described according to the webpage capture The characteristic information of request, obtaining target webpage data includes:
According to the characteristic information, inquire corresponding with the characteristic information data cached;
When inquiring described data cached, data cached the target webpage data are retrieved as described.
3. webpage capture request processing method according to claim 1, which is characterized in that described according to the webpage capture The characteristic information of request, obtaining target webpage data includes:
According to the characteristic information, inquire corresponding with the characteristic information data cached;
When inquiry less than it is described data cached when, the target webpage data are obtained by configuration server, the configuration services Device is used to configure corresponding web data for each characteristic information.
4. webpage capture request processing method according to claim 3, which is characterized in that described slow less than described when inquiry When deposit data, after obtaining the target webpage data by configuration server, the method also includes:
The characteristic information is cached as object key name, the object key name is used to indicate obtains the target network number of pages next time According to index;
It is object key assignments by the target webpage data buffer storage, the object key assignments is used to indicate next time according to the object key The index content that name inquires.
5. webpage capture request processing method according to claim 1, which is characterized in that described according to the webpage capture The characteristic information of request, obtaining target webpage data includes:
According to the characteristic information, inquire corresponding with the characteristic information data cached;
When inquiry is data cached less than described, and receives the configuration failure information of configuration server transmission, taken by website Business device obtains the target webpage data, and the configuration server is used to configure corresponding web data for each characteristic information, It is that the characteristic information configures corresponding web data that the configuration failure information, which is used to indicate the configuration server not,.
6. webpage capture request processing method according to claim 1, which is characterized in that the characteristic information is from described The search engine identification information extracted in the aiming field of webpage capture request;Or,
The characteristic information is the key-strings extracted from the aiming field that the webpage capture is requested.
7. webpage capture request processing method according to claim 1, which is characterized in that the acquisition search engine service The webpage capture that device is sent is requested
The target webpage that Receiving Agent server is sent grabs request, and the target webpage crawl request is that described search engine takes It is engaged in the webpage capture request that device is sent, meets the webpage capture request of default white list;
It is described the target webpage data are sent to described search engine server to include:
By the proxy server, the target webpage data are sent to described search engine server.
8. a kind of webpage capture requests processing unit, which is characterized in that described device includes:
First acquisition unit is configured as executing the webpage capture request for obtaining search engine server transmission, and the webpage is grabbed Request is taken to return to web data for requesting;
Second acquisition unit is configured as executing the characteristic information requested according to the webpage capture, obtains target webpage data, The target webpage data are corresponding with the characteristic information, and the characteristic information is used to indicate to issue the webpage capture request The data requirements of search engine server;
Transmission unit is configured as execution for the target webpage data and is sent to described search engine server.
9. a kind of server characterized by comprising
Processor;
Memory for storage processor executable instruction;
Wherein, the processor is configured to executing to realize that claim 1 to the described in any item webpages of claim 7 such as is grabbed Take operation performed by request processing method.
10. a kind of non-transitorycomputer readable storage medium, when the instruction in the storage medium is by the processor of server When execution, enable the server to execute one kind to realize such as claim 1 to the described in any item webpage captures of claim 7 Operation performed by request processing method.
CN201811566906.4A 2018-12-19 2018-12-19 Webpage crawling request processing method and device, server and storage medium Active CN109635203B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201811566906.4A CN109635203B (en) 2018-12-19 2018-12-19 Webpage crawling request processing method and device, server and storage medium

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201811566906.4A CN109635203B (en) 2018-12-19 2018-12-19 Webpage crawling request processing method and device, server and storage medium

Publications (2)

Publication Number Publication Date
CN109635203A true CN109635203A (en) 2019-04-16
CN109635203B CN109635203B (en) 2020-12-25

Family

ID=66076069

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201811566906.4A Active CN109635203B (en) 2018-12-19 2018-12-19 Webpage crawling request processing method and device, server and storage medium

Country Status (1)

Country Link
CN (1) CN109635203B (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110929257A (en) * 2019-10-30 2020-03-27 武汉绿色网络信息服务有限责任公司 Method and device for detecting malicious codes carried in webpage

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7136851B2 (en) * 2004-05-14 2006-11-14 Microsoft Corporation Method and system for indexing and searching databases
CN101055587A (en) * 2007-05-25 2007-10-17 清华大学 Search engine retrieving result reordering method based on user behavior information
CN101127043A (en) * 2007-08-03 2008-02-20 哈尔滨工程大学 Lightweight individualized search engine and its searching method
CN102651022A (en) * 2012-03-31 2012-08-29 奇智软件(北京)有限公司 Searching method and device
CN102982174A (en) * 2012-12-17 2013-03-20 北京奇虎科技有限公司 Method and device for performing web search in browser
CN103020239A (en) * 2012-12-17 2013-04-03 北京奇虎科技有限公司 Web searching method and device

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7136851B2 (en) * 2004-05-14 2006-11-14 Microsoft Corporation Method and system for indexing and searching databases
CN101055587A (en) * 2007-05-25 2007-10-17 清华大学 Search engine retrieving result reordering method based on user behavior information
CN101127043A (en) * 2007-08-03 2008-02-20 哈尔滨工程大学 Lightweight individualized search engine and its searching method
CN102651022A (en) * 2012-03-31 2012-08-29 奇智软件(北京)有限公司 Searching method and device
CN102982174A (en) * 2012-12-17 2013-03-20 北京奇虎科技有限公司 Method and device for performing web search in browser
CN103020239A (en) * 2012-12-17 2013-04-03 北京奇虎科技有限公司 Web searching method and device

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110929257A (en) * 2019-10-30 2020-03-27 武汉绿色网络信息服务有限责任公司 Method and device for detecting malicious codes carried in webpage
CN110929257B (en) * 2019-10-30 2022-02-01 武汉绿色网络信息服务有限责任公司 Method and device for detecting malicious codes carried in webpage

Also Published As

Publication number Publication date
CN109635203B (en) 2020-12-25

Similar Documents

Publication Publication Date Title
CN107241344B (en) Client is intercepted to the method, apparatus and system of the access of hostile network server
US10063618B2 (en) Remote browsing session management
US10839038B2 (en) Generating configuration information for obtaining web resources
EP3049960B1 (en) Key resource prefetching using front-end optimization (feo) configuration
US10630758B2 (en) Method and system for fulfilling server push directives on an edge proxy
CN104426985B (en) Show the method, apparatus and system of webpage
CN104468807B (en) Carry out processing method, high in the clouds device, local device and the system of web cache
US9152970B1 (en) Remote co-browsing session management
CN103383687B (en) A kind of page processing method and device
CN106055603B (en) Browser access network address recommended method, client and system based on VPN
CN110535961A (en) Resource acquiring method, device, electronic equipment and storage medium
CN109600385B (en) Access control method and device
US20180302489A1 (en) Architecture for proactively providing bundled content items to client devices
CN110266661A (en) A kind of authorization method, device and equipment
CN104618388B (en) Fast registration login method and corresponding resetting server, information server
EP3851980A1 (en) Resource query method and apparatus, device, and storage medium
CN107491470A (en) Data management system, control method and storage medium
CN109522501A (en) Content of pages management method and its device
CN104615597B (en) The methods, devices and systems of cache file are removed in browser
CN106528563A (en) Content access method and apparatus
CN110413846A (en) For the data processing method of webpage mirror image, device and computer readable storage medium
CN109635203A (en) Webpage capture request processing method, device, server and storage medium
CN109089175A (en) A kind of method and device that video cache accelerates
CN107707373A (en) A kind of dynamic resource based on API request accesses accelerated method
CN104572945B (en) A kind of file search method and device based on cloud storage space

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant