CN106649719A - Page downloading method and client - Google Patents
Page downloading method and client Download PDFInfo
- Publication number
- CN106649719A CN106649719A CN201611196293.0A CN201611196293A CN106649719A CN 106649719 A CN106649719 A CN 106649719A CN 201611196293 A CN201611196293 A CN 201611196293A CN 106649719 A CN106649719 A CN 106649719A
- Authority
- CN
- China
- Prior art keywords
- cookie
- file
- page
- configuration file
- database
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/90—Details of database functions independent of the retrieved data types
- G06F16/95—Retrieval from the web
- G06F16/958—Organisation or management of web site content, e.g. publishing, maintaining pages or automatic linking
- G06F16/972—Access to data in other repository systems, e.g. legacy data or dynamic Web page generation
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/90—Details of database functions independent of the retrieved data types
- G06F16/95—Retrieval from the web
- G06F16/955—Retrieval from the web using information identifiers, e.g. uniform resource locators [URL]
- G06F16/9558—Details of hyperlinks; Management of linked annotations
Abstract
The invention discloses a page downloading method and a client. The method comprises the steps that page link data is obtained; on the basis of the link data, whether cookie information corresponding to the link data exists or not is inquired in a database; when it is inquired that the cookie information corresponding to the link data exists, and the cookie information is a cookie file, a page is downloaded by means of the cookie file; when it is inquired that the cookie information corresponding to the link data exists, and the cookie information is a cookie configuration file, the cookie file is downloaded by means of the configuration file, and the page is downloaded by means of the cookie file.
Description
Technical field
The present invention relates to page download technology, more particularly to a kind of method for down loading and client of page.
Background technology
In order to strengthen the speed of access web page, the mode access web page of multi-thread concurrent is generally used.Pass through
Session identification (session id) can be generated during the thread accesses page, and downloads the cookie file needed for the page.This page
Face access mode requires that relatively strictly on the previous page face is not downloaded before success, line to the sequence of pages of each thread accesses
Cheng Buneng continues follow-up download, otherwise because of cookie problems the page for returning may be caused not meet expection, be not easy to into
Row distributed deployment.
Further, since session is generated in thread accession page, higher to some portal pages requirements (ratio is if any checking
Code or using logic it is complicated render the page that mode generates cookie) access, be difficult reality with existing page access mode
It is existing.
The content of the invention
To solve above-mentioned technical problem, the method for down loading and client of a kind of page are embodiments provided.
The method for down loading of the page provided in an embodiment of the present invention, including：
Obtain the link data of the page；
Based on the link data, the inquiry in database links the corresponding cookie letters of data with the presence or absence of with described
Breath；
When inquire exist with it is described link data corresponding cookie information when,
The cookie information is recognized, if the cookie information is cookie file, using the cookie file
The page is downloaded, if the cookie information is the configuration file of cookie, using the configuration file cookie is obtained
File, and download the page using the cookie file for obtaining.
In the embodiment of the present invention, it is described when inquire presence link the corresponding cookie information of data, and institute with described
When stating the configuration file that cookie information is cookie, cookie file is downloaded using the configuration file, including：
Judge to whether there is the cookie file corresponding with the configuration file in the database；
If not existing, using the configuration file cookie file is downloaded；
If existing, the cookie file corresponding with the configuration file is obtained from the database.
In the embodiment of the present invention, methods described also includes：
After cookie file is downloaded using the configuration file, methods described also includes：
The cookie file of download is stored in the database, and it is literary to set up the cookie of download in the database
Corresponding relation between the configuration file of part and the cookie.
In the embodiment of the present invention, methods described also includes：
When inquire do not exist with it is described link data corresponding cookie information when, be directly based upon the link data
Download the page.
Client provided in an embodiment of the present invention, including：
Acquiring unit, for obtaining the link data of the page；
Query unit, data phase is linked for based on the link data, inquiring about whether there is in database with described
Corresponding cookie information；
First processing units, the corresponding cookie information of data is linked for working as to inquire to exist with described, and described
When cookie information is cookie file, using the cookie file page is downloaded；
Second processing unit, the corresponding cookie information of data is linked for working as to inquire to exist with described, and described
When cookie information is the configuration file of cookie, cookie file is downloaded using the configuration file, and using described
Cookie file downloads the page.
In the embodiment of the present invention, the second processing unit includes：
Judgment sub-unit, the corresponding cookie information of data is linked for working as to inquire to exist with described, and described
When cookie information is the configuration file of cookie, judge in the database with the presence or absence of corresponding with the configuration file
Cookie file；
, there is no the cookie file corresponding with the configuration file in the database for working as in lower subelements
When, download cookie file using the configuration file.
In the embodiment of the present invention, the lower subelements are additionally operable to when existing in the database and the configuration file
During corresponding cookie file, directly the page is downloaded using the cookie file.
In the embodiment of the present invention, the client also includes：
Memory cell, for being downloaded after cookie file using the configuration file, the cookie file of download is deposited
In entering the database, and the mapping relations set up between the configuration file of the cookie and the cookie file.
In the embodiment of the present invention, described device also includes：
3rd processing unit, for when inquire do not exist with it is described link data corresponding cookie information when, directly
Connect the download page.
In the technical scheme of the embodiment of the present invention, the link data of the page are obtained；Based on the link data, in database
Middle inquiry with described with the presence or absence of linking the corresponding cookie information of data；Exist with described to link data relative when inquiring
The cookie information answered, and the cookie information is when being cookie file, and using the cookie file page is downloaded；
The corresponding cookie information of data is linked with described when inquiring to exist, and the cookie information is the configuration text of cookie
During part, cookie file is downloaded using the configuration file, and the page is downloaded using the cookie file.Using this
The technical scheme of bright embodiment, by cookie file with link data storage in database, here it is possible to using such as rendering plus
The modes such as load, manual intervention, the prior acquisition of cookie file that will be not easy to obtain is present in database for downloading the page
Use.For each page to be downloaded, there is the acquiring way of corresponding cookie file, it is not necessary to strictly rely on the page
Order is downloaded, and is easy to distributed deployment client, while the session for also solving complicated portal page generates problem.
Description of the drawings
Fig. 1 is the schematic flow sheet one of the method for down loading of the page of the embodiment of the present invention；
Fig. 2 is the schematic flow sheet two of the method for down loading of the page of the embodiment of the present invention；
Fig. 3 is the structure composition schematic diagram one of the client of the embodiment of the present invention；
Fig. 4 is the structure composition schematic diagram two of the client of the embodiment of the present invention；
Fig. 5 is the structure composition schematic diagram three of the client of the embodiment of the present invention.
Specific embodiment
The characteristics of in order to more fully hereinafter understand the embodiment of the present invention and technology contents, below in conjunction with the accompanying drawings to this
The realization of bright embodiment is described in detail, appended accompanying drawing purposes of discussion only for reference, not for limiting the embodiment of the present invention.
Fig. 1 for the embodiment of the present invention the page method for down loading schematic flow sheet one, the download of the page in this example
Method is applied to client-side, as shown in figure 1, the method for down loading of the page is comprised the following steps：
Step 101：Obtain the link data of the page.
In the embodiment of the present invention, client espespecially webpage client, user can be input on webpage client want into
The network address of the webpage for entering, here, network address can be understood as the link data of the embodiment of the present invention, such as URL
(URL, Uniform Resoure Locator).
In the embodiment of the present invention, when certain webpage is accessed, the link data for obtaining the page first are needed, then, performed
Following steps.
Step 102：Based on the link data, the inquiry in database whether there is with described to link data corresponding
Cookie information.
In the embodiment of the present invention, database can be, but not limited to be stored in memory system or disk space.In data
The content of storage includes：Page address list, here, page address list includes a plurality of page address data, each page
Address date can include the one or more of following content：The link data of the page, the cookie file of the page, cookie
Configuration file.
In the first scenario, page address data includes：The link data of the page；
In the latter case, page address data includes：The link data of the page, the cookie file of the page；
In a third case, page address data includes：The link data of the page, the configuration file of cookie.
In the fourth case, page address data includes：The link data of the page, the cookie file of the page,
The configuration file of cookie.
Several situations based on more than, based on the link data of the page, the inquiry in database whether there is and be linked with described
The corresponding cookie information of data.
As described above in the case of the first, inquire about not existing linking the corresponding cookie letters of data with described in database
Breath.
As described above in the case of second, the inquiry in database exists and believes with the link corresponding cookie of data
Breath, and the cookie information is the cookie file of the page.
As described above in the case of the third, the inquiry in database exists and believes with the corresponding cookie of data that links
Breath, and the cookie information is the configuration file of cookie.Such case, can download to according to the configuration file of cookie
The cookie file of the page.
As described above in the case of the 4th kind, the inquiry in database exists and believes with the link corresponding cookie of data
Breath, and the cookie information is the configuration file of cookie file and cookie.
Step 103：The corresponding cookie information of data, and the cookie information are linked when inquiring to exist with described
For cookie file when, download the page using the cookie file.
In the embodiment of the present invention, when client downloads the page to site requests, need to be carried in request message
Cookie file, so, website just can return the normal page to client according to cookie file.Certainly, some are special
The page can also not need cookie file can be carried out download.
In the embodiment of the present invention, the corresponding cookie information of data is linked with described when inquiring to exist, and it is described
When cookie information is cookie file, using the cookie file page is downloaded.Here, because cookie file is pre-
In being first stored in database, therefore can not consider that sequence of pages is directly obtained cookie file, and then carry out under the page
Carry.
Step 104：The corresponding cookie information of data, and the cookie information are linked when inquiring to exist with described
For cookie configuration file when, using the configuration file download cookie file, and using the cookie file download
The page.
In the embodiment of the present invention, the corresponding cookie information of data is linked with described when inquiring to exist, and it is described
When cookie information is the configuration file of cookie, cookie file is downloaded using the configuration file, and using described
Cookie file downloads the page.Here, the configuration file of cookie at least includes the download address of cookie, such as URL,
Cookie file can be downloaded to according to the configuration file of cookie, then, recycles the cookie file to download described
The page.
Using the technical scheme of the embodiment of the present invention, dependence of the thread to page access order can be reduced, under making webpage
Loading system is easy to distributed deployment, and the session for solving complicated portal page generates problem.
Fig. 2 for the embodiment of the present invention the page method for down loading schematic flow sheet two, the download of the page in this example
Method is applied to client-side, as shown in Fig. 2 the method for down loading of the page is comprised the following steps：
Step 201：Obtain the link data of the page.
In the embodiment of the present invention, client espespecially webpage client, user can be input on webpage client want into
The network address of the webpage for entering, here, network address can be understood as the link data of the embodiment of the present invention, such as URL.
In the embodiment of the present invention, when certain webpage is accessed, the link data for obtaining the page first are needed, then, performed
Following steps.
Step 202：Based on the link data, the inquiry in database whether there is with described to link data corresponding
Cookie information.
In the embodiment of the present invention, database can be, but not limited to be stored in memory system or disk space.In data
The content of storage includes：Page address list, here, page address list includes a plurality of page address data, each page
Address date can include the one or more of following content：The link data of the page, the cookie file of the page, cookie
Configuration file.
In the first scenario, page address data includes：The link data of the page；
In the latter case, page address data includes：The link data of the page, the cookie file of the page；
In a third case, page address data includes：The link data of the page, the configuration file of cookie.
In the fourth case, page address data includes：The link data of the page, the cookie file of the page,
The configuration file of cookie.
Several situations based on more than, based on the link data of the page, the inquiry in database whether there is and be linked with described
The corresponding cookie information of data.
As described above in the case of the first, inquire about not existing linking the corresponding cookie letters of data with described in database
Breath.
As described above in the case of second, the inquiry in database exists and believes with the link corresponding cookie of data
Breath, and the cookie information is the cookie file of the page.
As described above in the case of the third, the inquiry in database exists and believes with the corresponding cookie of data that links
Breath, and the cookie information is the configuration file of cookie.Such case, can download to according to the configuration file of cookie
The cookie file of the page.
As described above in the case of the 4th kind, the inquiry in database exists and believes with the link corresponding cookie of data
Breath, and the cookie information is the configuration file of cookie file and cookie.
Step 203：The corresponding cookie information of data, and the cookie information are linked when inquiring to exist with described
For cookie file when, download the page using the cookie file.
In the embodiment of the present invention, when client downloads the page to site requests, need to be carried in request message
Cookie file, so, website just can return the normal page to client according to cookie file.Certainly, some are special
The page can also not need cookie file can be carried out download.
In the embodiment of the present invention, the corresponding cookie information of data is linked with described when inquiring to exist, and it is described
When cookie information is cookie file, using the cookie file page is downloaded.Here, because cookie file is pre-
In being first stored in database, therefore can not consider that sequence of pages is directly obtained cookie file, and then carry out under the page
Carry.
Step 204：The corresponding cookie information of data, and the cookie information are linked when inquiring to exist with described
For cookie configuration file when, judge in the database with the presence or absence of the cookie corresponding with the configuration file it is literary
Part；When no, execution step 205, when being, execution step 206.
Step 205：When there is no the cookie file corresponding with the configuration file in the database, using institute
State configuration file and download cookie file, and the page is downloaded using the cookie file, flow process terminates.
In the embodiment of the present invention, downloaded after cookie file using the configuration file, the cookie file that will be downloaded
In being stored in the database, and the mapping relations set up between the configuration file of the cookie and the cookie file.This
Sample, when needing to download cookie file according to the configuration file of cookie again, can directly lead to without re-starting download
Mapping relationship searching is crossed to the cookie file corresponding with the configuration file of cookie, page access speed is further improved.
Step 206：When there is the cookie file corresponding with the configuration file in the database, directly utilize
The cookie file downloads the page.
In the embodiment of the present invention, the corresponding cookie information of data is linked with described when inquiring to exist, and it is described
When cookie information is the configuration file of cookie, judge in the database with the presence or absence of corresponding with the configuration file
Cookie file；When there is no the cookie file corresponding with the configuration file in the database, matched somebody with somebody using described
File download cookie file is put, and the page is downloaded using the cookie file.When presence and institute in the database
When stating the corresponding cookie file of configuration file, directly the page is downloaded using the cookie file.Here, cookie
Configuration file at least include the download address of cookie, such as URL can be downloaded to according to the configuration file of cookie
Cookie file, then, then and downloads the page using the cookie file.
Step 207：When inquire do not exist with it is described link data corresponding cookie information when, directly download described
The page.
Using the technical scheme of the embodiment of the present invention, dependence of the thread to page access order can be reduced, under making webpage
Loading system is easy to distributed deployment, and the session for solving complicated portal page generates problem.
Fig. 3 is the structure composition schematic diagram one of the client of the embodiment of the present invention, as shown in figure 3, the client includes：
Acquiring unit 31, for obtaining the link data of the page；
Query unit 32, data are linked for based on the link data, inquiring about whether there is in database with described
Corresponding cookie information；
First processing units 33, the corresponding cookie information of data, and institute are linked for working as to inquire to exist with described
State cookie information for cookie file when, download the page using the cookie file；
Second processing unit 34, the corresponding cookie information of data, and institute are linked for working as to inquire to exist with described
When stating the configuration file that cookie information is cookie, cookie file is downloaded using the configuration file, and using described
Cookie file downloads the page.
It will be appreciated by those skilled in the art that each unit in the client shown in Fig. 3 to realize that function can refer to aforementioned
The associated description of the method for down loading of the page and understand.The function of each unit in client shown in Fig. 3 can be by running on place
Manage the program on device and realize, also can be realized by specific logic circuit.
Fig. 4 is the structure composition schematic diagram two of the client of the embodiment of the present invention, as shown in figure 4, the client includes：
Acquiring unit 41, for obtaining the link data of the page；
Query unit 42, data are linked for based on the link data, inquiring about whether there is in database with described
Corresponding cookie information；
First processing units 43, the corresponding cookie information of data, and institute are linked for working as to inquire to exist with described
State cookie information for cookie file when, download the page using the cookie file；
Second processing unit 44, the corresponding cookie information of data, and institute are linked for working as to inquire to exist with described
When stating the configuration file that cookie information is cookie, cookie file is downloaded using the configuration file, and using described
Cookie file downloads the page.
In an implementation, the second processing unit 44 includes：
Judgment sub-unit 441, the corresponding cookie information of data is linked for working as to inquire to exist with described, and described
When cookie information is the configuration file of cookie, judge in the database with the presence or absence of corresponding with the configuration file
Cookie file；
Lower subelements 442, for literary when there is no the cookie corresponding with the configuration file in the database
During part, using the configuration file cookie file is downloaded.
The lower subelements 442, are additionally operable to corresponding with the configuration file when existing in the database
During cookie file, directly the page is downloaded using the cookie file.
It will be appreciated by those skilled in the art that each unit in the client shown in Fig. 4 to realize that function can refer to aforementioned
The associated description of the method for down loading of the page and understand.The function of each unit in client shown in Fig. 4 can be by running on place
Manage the program on device and realize, also can be realized by specific logic circuit.
Fig. 5 is the structure composition schematic diagram three of the client of the embodiment of the present invention, as shown in figure 5, the client includes：
Acquiring unit 51, for obtaining the link data of the page；
Query unit 52, data are linked for based on the link data, inquiring about whether there is in database with described
Corresponding cookie information；
First processing units 53, the corresponding cookie information of data, and institute are linked for working as to inquire to exist with described
State cookie information for cookie file when, download the page using the cookie file；
Second processing unit 54, the corresponding cookie information of data, and institute are linked for working as to inquire to exist with described
When stating the configuration file that cookie information is cookie, cookie file is downloaded using the configuration file, and using described
Cookie file downloads the page.
In an implementation, the second processing unit 54 includes：
Judgment sub-unit 541, the corresponding cookie information of data is linked for working as to inquire to exist with described, and described
When cookie information is the configuration file of cookie, judge in the database with the presence or absence of corresponding with the configuration file
Cookie file；
Lower subelements 542, for literary when there is no the cookie corresponding with the configuration file in the database
During part, using the configuration file cookie file is downloaded.
The lower subelements 542, are additionally operable to corresponding with the configuration file when existing in the database
During cookie file, directly the page is downloaded using the cookie file.
In the embodiment of the present invention, the client also includes：
Memory cell 55, for being downloaded after cookie file using the configuration file, the cookie file that will be downloaded
In being stored in the database, and the mapping relations set up between the configuration file of the cookie and the cookie file.
In the embodiment of the present invention, described device also includes：
3rd processing unit 56, for when inquire do not exist with it is described link data corresponding cookie information when,
Directly download the page.
It will be appreciated by those skilled in the art that each unit in the client shown in Fig. 5 to realize that function can refer to aforementioned
The associated description of the method for down loading of the page and understand.The function of each unit in client shown in Fig. 5 can be by running on place
Manage the program on device and realize, also can be realized by specific logic circuit.
Between technical scheme described in the embodiment of the present invention, in the case where not conflicting, can be in any combination.
In several embodiments provided by the present invention, it should be understood that disclosed method and smart machine, Ke Yitong
Cross other modes to realize.Apparatus embodiments described above are only schematic, for example, the division of the unit, and only
Only a kind of division of logic function, can have other dividing mode, such as when actually realizing：Multiple units or component can be tied
Close, or be desirably integrated into another system, or some features can be ignored, or do not perform.In addition, shown or discussed each group
Can be by the indirect of some interfaces, equipment or unit into coupling partly each other or direct-coupling or communication connection
Coupling is communicated to connect, and can be electrical, machinery or other forms.
The above-mentioned unit as separating component explanation can be or may not be it is physically separate, it is aobvious as unit
The part for showing can be or may not be physical location, you can with positioned at a place, it is also possible to be distributed to multiple network lists
In unit；Part or all of unit therein can according to the actual needs be selected to realize the purpose of this embodiment scheme.
In addition, each functional unit in various embodiments of the present invention can be fully integrated in a second processing unit,
Can also be each unit individually as a unit, it is also possible to which two or more units are integrated in a unit；
Above-mentioned integrated unit both can be realized in the form of hardware, it would however also be possible to employ hardware adds the form reality of SFU software functional unit
It is existing.
The above, the only specific embodiment of the present invention, but protection scope of the present invention is not limited thereto, any
Those familiar with the art the invention discloses technical scope in, change or replacement can be readily occurred in, all should contain
Cover within protection scope of the present invention.
Claims (9)
1. a kind of method for down loading of the page, it is characterised in that methods described includes：
Obtain the link data of the page；
Based on the link data, inquire about whether there is linking the corresponding cookie information of data with described in database；
When inquire exist with it is described link data corresponding cookie information when,
The cookie information is recognized, if the cookie information is cookie file, is downloaded using the cookie file
The page, if the cookie information is the configuration file of cookie, using the configuration file cookie file is obtained,
And download the page using the cookie file for obtaining.
2. the method for down loading of the page according to claim 1, it is characterised in that the utilization configuration file obtains cookie
File, including：
Judge to whether there is the cookie file corresponding with the configuration file in the database；
If not existing, using the configuration file cookie file is downloaded；
If existing, the cookie file corresponding with the configuration file is obtained from the database.
3. the method for down loading of the page according to claim 2, it is characterised in that when being downloaded using the configuration file
After cookie file, methods described also includes：
The cookie file of download is stored in the database, and set up in the database the cookie file of download with
Corresponding relation between the configuration file of the cookie.
4. the method for down loading of the page according to any one of claims 1 to 3, it is characterised in that methods described also includes：
When inquire do not exist with it is described link data corresponding cookie information when, be directly based upon the link data and download
The page.
5. a kind of client, it is characterised in that the client includes：
Acquiring unit, for obtaining the link data of the page；
Query unit, for based on the link data, the inquiry in database whether there is with described to link data corresponding
Cookie information；
First processing units, the corresponding cookie information of data is linked for working as to inquire to exist with described, and described
When cookie information is cookie file, using the cookie file page is downloaded；
Second processing unit, the corresponding cookie information of data is linked for working as to inquire to exist with described, and described
When cookie information is the configuration file of cookie, cookie file is downloaded using the configuration file, and using described
Cookie file downloads the page.
6. client according to claim 5, it is characterised in that the second processing unit includes：
Judgment sub-unit, the corresponding cookie information of data, and the cookie are linked for working as to inquire to exist with described
When information is the configuration file of cookie, judge to whether there is the cookie corresponding with the configuration file in the database
File；
Lower subelements, it is sharp for when there is no the cookie file corresponding with the configuration file in the database
Cookie file is downloaded with the configuration file.
7. client according to claim 6, it is characterised in that the lower subelements, is additionally operable to when the database
It is middle when there is corresponding with configuration file cookie file, directly download the page using the cookie file.
8. client according to claim 5, it is characterised in that the client also includes：
Memory cell, for downloading after cookie file using the configuration file, by the cookie file of download institute is stored in
In stating database, and the mapping relations set up between the configuration file of the cookie and the cookie file.
9. the client according to any one of claim 5 to 8, it is characterised in that described device also includes：
3rd processing unit, for when inquire do not exist with it is described link data corresponding cookie information when, directly under
Carry the page.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201611196293.0A CN106649719A (en) | 2016-12-22 | 2016-12-22 | Page downloading method and client |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201611196293.0A CN106649719A (en) | 2016-12-22 | 2016-12-22 | Page downloading method and client |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN106649719A true CN106649719A (en) | 2017-05-10 |
Family
ID=58833821
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201611196293.0A Pending CN106649719A (en) | 2016-12-22 | 2016-12-22 | Page downloading method and client |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN106649719A (en) |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103368964A (en) * | 2013-07-18 | 2013-10-23 | 北京京东尚科信息技术有限公司 | Cookie dynamic loading method |
| CN105354337A (en) * | 2015-12-08 | 2016-02-24 | 北京奇虎科技有限公司 | Web crawler implementation method and web crawler system |
| CN105631030A (en) * | 2015-12-30 | 2016-06-01 | 福建亿榕信息技术有限公司 | Universal web crawler login simulation method and system |
| CN105812476A (en) * | 2016-04-05 | 2016-07-27 | 深圳市深信服电子科技有限公司 | Method and device for accessing rejected website |
| US20160277429A1 (en) * | 2014-03-28 | 2016-09-22 | Amazon Technologies, Inc. | Token based automated agent detection |
-
2016
- 2016-12-22 CN CN201611196293.0A patent/CN106649719A/en active Pending
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103368964A (en) * | 2013-07-18 | 2013-10-23 | 北京京东尚科信息技术有限公司 | Cookie dynamic loading method |
| US20160277429A1 (en) * | 2014-03-28 | 2016-09-22 | Amazon Technologies, Inc. | Token based automated agent detection |
| CN105354337A (en) * | 2015-12-08 | 2016-02-24 | 北京奇虎科技有限公司 | Web crawler implementation method and web crawler system |
| CN105631030A (en) * | 2015-12-30 | 2016-06-01 | 福建亿榕信息技术有限公司 | Universal web crawler login simulation method and system |
| CN105812476A (en) * | 2016-04-05 | 2016-07-27 | 深圳市深信服电子科技有限公司 | Method and device for accessing rejected website |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN104426925B (en) | Web page resources acquisition methods and device | |
| US10666758B2 (en) | Browser resource pre-pulling method, terminal and storage medium | |
| CN106933871A (en) | Short linking processing method, device and short linked server | |
| CN104881318B (en) | A kind of interface call method, device and terminal | |
| CN103997452A (en) | Information sharing method and apparatus among multiple platforms | |
| CN107291759A (en) | The treating method and apparatus of browser page resource | |
| CN101799821B (en) | Method and system for realizing webpage application by widget | |
| CN104462583A (en) | Browser device for advertisement blocking processing and mobile terminal | |
| CN105554085B (en) | A kind of dynamic timeout treatment method and apparatus based on server connection | |
| CN104980512A (en) | Method and equipment for providing target object based on mobile application | |
| CN107688529A (en) | Component adjustment method and device | |
| CN101997853A (en) | Data downloading method and terminal | |
| CN108932238A (en) | A kind of cross-domain communication method and device | |
| CN102510410A (en) | On-line advertisement delivering method and system as well as advertisement control equipment | |
| CN106020891A (en) | Page loading method and device | |
| CN105260421A (en) | Webpage loading method and apparatus | |
| CN103488508B (en) | Browser working method, browser and terminal equipment | |
| CN109325192B (en) | Advertisement anti-shielding method and device | |
| CN103440143A (en) | System and method for upgrading mobile web application | |
| CN102306184B (en) | Method, device and apparatus for obtaining compressed link address information and compressed webpage | |
| US20080172620A1 (en) | Web page control program, method, and server | |
| CN106027602A (en) | Cloud backup and restoration methods and terminal backup and restoration devices for applications | |
| CN102890687A (en) | Method, system and device for browsing webpage diagrams | |
| CN105354269B (en) | Web applicational language Localization methodologies and system based on reverse proxy and information filtering | |
| CN106649719A (en) | Page downloading method and client |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20170510 |
|
| RJ01 | Rejection of invention patent application after publication |