WO2017071189A1 - 网页的访问方法、装置、设备及非易失性计算机存储介质 - Google Patents
网页的访问方法、装置、设备及非易失性计算机存储介质 Download PDFInfo
- Publication number
- WO2017071189A1 WO2017071189A1 PCT/CN2016/082981 CN2016082981W WO2017071189A1 WO 2017071189 A1 WO2017071189 A1 WO 2017071189A1 CN 2016082981 W CN2016082981 W CN 2016082981W WO 2017071189 A1 WO2017071189 A1 WO 2017071189A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- proxy server
- webpage
- access
- information
- restricted
- Prior art date
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/90—Details of database functions independent of the retrieved data types
- G06F16/95—Retrieval from the web
- G06F16/957—Browsing optimisation, e.g. caching or content distillation
- G06F16/9574—Browsing optimisation, e.g. caching or content distillation of access to content, e.g. by caching
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/90—Details of database functions independent of the retrieved data types
- G06F16/95—Retrieval from the web
- G06F16/955—Retrieval from the web using information identifiers, e.g. uniform resource locators [URL]
- G06F16/9566—URL specific, e.g. using aliases, detecting broken or misspelled links
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/90—Details of database functions independent of the retrieved data types
- G06F16/95—Retrieval from the web
- G06F16/958—Organisation or management of web site content, e.g. publishing, maintaining pages or automatic linking
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/50—Network services
- H04L67/56—Provisioning of proxy services
- H04L67/563—Data redirection of data network streams
Definitions
- the present disclosure relates to Internet technologies, and in particular, to a method, an apparatus, a device, and a non-volatile computer storage medium for accessing a webpage.
- the user needs to use a related keyword, for example, a proxy server to publish a website, etc., to perform a search operation to obtain a website portal of the publishing proxy server.
- the user accesses the obtained website of the publishing proxy server, and uses the published proxy server to separately perform the access proxy setting to enable access to the webpages by using the available proxy servers.
- the operation is complicated, the operation time is long, and the success rate is not high, thereby reducing the efficiency and reliability of webpage access.
- aspects of the present disclosure provide a method, an apparatus, a device, and a non-volatile computer storage medium for accessing a webpage to improve efficiency and reliability of webpage access.
- An aspect of the present disclosure provides a method for accessing a webpage, including:
- the web page is accessed using information of the proxy server.
- the acquiring information of the proxy server includes:
- the method further includes:
- the proxy server set includes information of each of the at least one proxy server available for use according to the generation A collection of servers that obtain information about the proxy server.
- the method further includes:
- Another aspect of the present disclosure provides an access device for a webpage, including:
- An obtaining unit configured to obtain information of a proxy server
- the access unit is further configured to access the webpage by using information of the proxy server.
- any possible implementation manner further provide an implementation manner, where the acquiring unit is specifically configured to
- the device further comprising an acquisition unit
- a set of proxy servers is obtained, the proxy server set including information of each of the at least one proxy server available for obtaining information of the proxy server according to the set of proxy servers.
- an apparatus comprising:
- One or more processors are One or more processors;
- One or more programs the one or more programs being stored in the memory, when executed by the one or more processors:
- the web page is accessed using information of the proxy server.
- a non-volatile computer storage medium storing one or more programs when the one or more programs are executed by one device causes The device:
- the web page is accessed using information of the proxy server.
- the embodiment of the present disclosure determines that the access of the webpage is restricted, and further acquires the information of the proxy server, so that the information of the proxy server can be used to access the webpage, and since the information of the proxy server can be automatically acquired, Therefore, the user is not required to manually search the website of the publishing proxy server, the operation is simple, and the success rate is high, thereby improving the efficiency and reliability of the webpage access.
- the user does not need to manually search the website of the publishing proxy server, and is completely transparent to the user, and can effectively improve the user's access experience.
- FIG. 1 is a schematic flowchart of a method for accessing a webpage according to an embodiment of the present disclosure
- FIG. 2 is a schematic structural diagram of an apparatus for accessing a webpage according to another embodiment of the present disclosure
- FIG. 3 is a schematic structural diagram of an apparatus for accessing a webpage according to another embodiment of the present disclosure.
- webpage involved in the present disclosure may also be referred to as a webpage or a webpage, and may be a webpage (Webpage) written by HyperText Markup Language (HTML), that is, an HTML webpage, or may also be It is a web page written in the HTML and Java language, that is, a Java Server Page (JSP), or a web page that can also be written in other languages.
- HTML HyperText Markup Language
- JSP Java Server Page
- a web page may include a display block defined by one or more web page tags, such as HyperText Markup Language (HTML) tags, JSP tags, etc., called web page elements, such as text, images, hyperlinks. , buttons, input boxes, drop-down boxes, etc.
- the terminals involved in the embodiments of the present disclosure may include, but are not limited to, a mobile phone, a personal digital assistant (PDA), a wireless handheld device, a tablet computer, and a personal computer (Personal Computer, PC). ), MP3 players, MP4 players, wearable devices (for example, smart glasses, smart watches, Smart bracelets, etc.).
- PDA personal digital assistant
- PC Personal Computer
- MP3 players for example, MP3 players, MP4 players, wearable devices (for example, smart glasses, smart watches, Smart bracelets, etc.).
- FIG. 1 is a schematic flowchart of a method for accessing a webpage according to an embodiment of the present disclosure, as shown in FIG. 1.
- the execution body of 101 to 103 may be an application located in a local terminal, or may be a plug-in or a software development kit (SDK) functional unit located in an application of the local terminal, or may also be
- SDK software development kit
- the search engine in the server on the network side, or the distributed system on the network side, is not limited in this embodiment, and is not particularly limited in this embodiment.
- the application may be a local application installed on the terminal, such as a browser application, a mobile phone Baidu application, or the like, or may be a web application (webApp) of the browser on the terminal.
- the embodiment is not particularly limited thereto.
- the server's website is simple to operate and has a high success rate, which improves the efficiency and reliability of web page access.
- the webpage involved in the embodiment may be a webpage of the PC website, or may be a webpage of the mobile website, which is not specifically limited in this embodiment.
- an access request of the webpage may be specifically acquired, and according to the access request of the webpage, determining that the webpage is inaccessible, and according to the access
- the limit list determines that the website to which the webpage belongs is a restricted access website, and further, it can be determined that the access of the webpage is restricted.
- the access request is sent to the server of the website to which the web page belongs. If the site is a restricted access site, the access request will be blocked and cannot be sent to the server of the site. Next, a prompt message for indicating that the webpage is inaccessible is received. At this point, you can be sure that the page is inaccessible.
- the webpage that the user is going to visit cannot be accessed, and the webpage to which the webpage belongs is a restricted access website, it can be determined that the access of the webpage is restricted.
- the acquired information of the proxy server may include but is not limited to The Uniform Resource Locator (URL) or the Uniform Resource Name (URN), the IP address, or other access identifiers of the proxy server are not specifically limited in this embodiment.
- URL Uniform Resource Locator
- UPN Uniform Resource Name
- information of one proxy server may be specifically acquired, or information of multiple proxy servers may also be acquired.
- the information of a proxy server is obtained, then the information of the proxy server is used to perform the subsequent 103.
- a pre-set selection policy may be adopted, first selecting information of a proxy server, and then, using the information of the proxy server, performing subsequent 103. If the access to the web page is still restricted, continue to select the information of the next proxy server, and continue the previous operation until the access to the web page is no longer restricted.
- the information of the proxy server may be acquired according to the webpage identifier of the webpage.
- a mapping relationship between a web page and information of an available proxy server may be pre-stored to associate the web page with an available proxy server.
- the information of the proxy server corresponding to the webpage identifier can be obtained according to the webpage identifier of the webpage, and the mapping relationship can be utilized, and the availability of the obtained proxy server information can be ensured.
- the identifier of the webpage and the information of the proxy server may be correspondingly stored in a database or a file system.
- the identifier of the webpage and the information of the proxy server corresponding to the identifier of the webpage may be correspondingly stored in a database or a file system.
- the identifier of the webpage may include, but is not limited to, a parameter name and a network of the identifier of the webpage.
- the parameter value of the identifier of the page is not specifically limited in this embodiment;
- the information of the proxy server may include, but is not limited to, a parameter name of the information of the proxy server and a parameter value of the information of the proxy server, which is not performed in this embodiment. Specially limited.
- the database may use a relational database, for example, an Oracle database, a DB2 database, a Structured Query Language (SQL) server (Server) database, a MySQL database, etc., or may also adopt a key value (Key-Value).
- a relational database for example, an Oracle database, a DB2 database, a Structured Query Language (SQL) server (Server) database, a MySQL database, etc.
- SQL Structured Query Language
- MySQL MySQL database
- Key-Value Key-Value
- the type database for example, a non-SQL (Not Only SQL) NoSQL database, a Redis database, etc., is not particularly limited in this embodiment.
- the parameter name and the parameter value of the identifier of each webpage and the parameter value of the information of the proxy server corresponding to the identifier of the webpage may be correspondingly stored in a database or a file system.
- the parameter value of the information of the proxy server corresponding to the identifier of each webpage may be used as a key; the parameter name and the parameter value of the identifier of the webpage may be used as a Value, and the two are correspondingly stored in the Key-Value type database.
- the parameter name and the parameter value of the identifier of each webpage and the parameter name and parameter value of the information of the proxy server corresponding to the identifier of the webpage may be correspondingly stored in the database or in the file system.
- the parameter name and the parameter value of the information of the proxy server corresponding to the identifier of each webpage may be used as the Key; the parameter name and the parameter value of the identifier of the webpage may be used as the Value, and the two are correspondingly stored in the Key-Value database. in.
- the time of the first storage (Init_time) and the time of the subsequent update storage (update_time) are further required. At least one of the records is recorded to meet the general needs of subsequent management operations.
- the database or the file system may be specifically configured to be stored in a terminal. On the device.
- the storage device of the terminal may be a slow storage device, specifically a hard disk of the computer system, or may be a non-operating memory of the mobile phone, that is, physical memory, such as a read-only memory (ROM) and a memory.
- ROM read-only memory
- the card or the like is not particularly limited in this embodiment.
- the storage device of the terminal may also be a fast storage device, which may be a memory of the computer system, or may be a running memory of the mobile phone, that is, a system memory, such as a random access memory (RAM).
- a fast storage device which may be a memory of the computer system, or may be a running memory of the mobile phone, that is, a system memory, such as a random access memory (RAM).
- RAM random access memory
- the network crawler may further be utilized to obtain a proxy server set, where the proxy server set includes each of the at least one proxy server available. Information for obtaining information of the proxy server according to the set of proxy servers.
- the at least one proxy server may be further subjected to quality verification, and further, the information of the proxy server that has not passed the quality verification may be filtered. In this way, by performing quality verification on each of the at least one proxy servers included in the acquired proxy server set, and filtering the information of the proxy server that has not passed the quality verification, the obtained information can be effectively ensured.
- the quality of the proxy server by performing quality verification on each of the at least one proxy servers included in the acquired proxy server set, and filtering the information of the proxy server that has not passed the quality verification, the obtained information can be effectively ensured. The quality of the proxy server.
- the so-called quality verification refers to the stability, timeliness and other verification of the proxy server to ensure that the proxy server is available. It can be understood that the quality verification can be performed periodically, for example, once a day, once a week, so that the quality of the obtained proxy server can be further ensured.
- the information of the proxy server is obtained, so that the webpage can be accessed by using the information of the proxy server, and the information of the proxy server can be automatically acquired, thereby eliminating the need for the user to manually Searching the website that publishes the proxy server is simple and has a high success rate, which improves the efficiency and reliability of web page access.
- the user does not need to manually search the website of the publishing proxy server, and is completely transparent to the user, and can effectively improve the user's access experience.
- FIG. 2 is a schematic structural diagram of an apparatus for accessing a webpage according to another embodiment of the present disclosure, as shown in FIG. 2 .
- the access device of the web page of this embodiment may include an access unit 21 and an obtaining unit 22.
- the access unit 21 is configured to determine that the access of the webpage is restricted; the obtaining unit 22 is configured to acquire information of the proxy server; and the accessing unit 21 is further configured to use the generation Manage the information of the server and access the web page.
- the access device of the webpage provided in this embodiment may be an application located in a local terminal, or may be a plug-in or a software development kit (SDK) functional unit located in an application of the local terminal.
- SDK software development kit
- the search engine in the server on the network side, or the distributed system on the network side may not be specifically limited in this embodiment, and is not particularly limited in this embodiment.
- the application may be a local application (nativeApp) installed on the terminal, or may be a web application (webApp) of the browser on the terminal, which is not specifically limited in this embodiment.
- the accessing unit 21 may be further configured to obtain an access request of the webpage; and determining, according to the access request of the webpage, that the webpage is inaccessible; Determining, according to the access restricted list, that the website to which the web page belongs is a restricted access website; and determining that access to the web page is restricted.
- the acquiring unit 22 may be configured to acquire information about the proxy server according to the webpage identifier of the webpage.
- the access device of the webpage provided by the embodiment may further include an acquisition unit 31, which may be used to obtain a proxy server by using a web crawler.
- a set of the proxy server includes information of each of the at least one proxy server available for obtaining information of the proxy server according to the set of proxy servers.
- the collecting unit 31 may be further configured to perform quality verification on the at least one proxy server, and perform filtering processing on information of the proxy server that does not pass the quality verification.
- the access unit determines that the access of the webpage is restricted, and the information of the proxy server is obtained by the obtaining unit, so that the accessing unit can access the webpage by using the information of the proxy server, because the proxy server can be automatically acquired.
- the information therefore, makes it unnecessary to manually search the website of the publishing proxy server, and the operation is simple and the success rate is high, thereby improving the efficiency and reliability of webpage access.
- each of the at least one proxy servers included in the acquired proxy server set is subjected to quality verification by the collecting unit, and further, to the proxy server that does not pass the quality verification.
- the information is filtered and processed to ensure the quality of the obtained proxy server.
- the user does not need to manually search the website of the publishing proxy server, and is completely transparent to the user, and can effectively improve the user's access experience.
- the disclosed system, apparatus, and method may be implemented in other manners.
- the device embodiments described above are merely illustrative.
- the division of the unit is only a logical function division.
- there may be another division manner for example, multiple units or components may be combined or Can be integrated into another system, or some features can be ignored or not executed.
- the mutual coupling or direct coupling or communication connection shown or discussed may be through some connections.
- the indirect coupling or communication connection of the port, device or unit may be in electrical, mechanical or other form.
- the units described as separate components may or may not be physically separated, and the components displayed as units may or may not be physical units, that is, may be located in one place, or may be distributed to multiple network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution of the embodiment.
- each functional unit in various embodiments of the present disclosure may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit.
- the above integrated unit can be implemented in the form of hardware or in the form of hardware plus software functional units.
- the above-described integrated unit implemented in the form of a software functional unit can be stored in a computer readable storage medium.
- the above software functional unit is stored in a storage medium and includes instructions for causing a computer device (which may be a personal computer, a server, or a network device, etc.) or a processor to perform the methods of the various embodiments of the present disclosure. Part of the steps.
- the foregoing storage medium includes: a U disk, a mobile hard disk, a read-only memory (ROM), a random access memory (RAM), a magnetic disk, or an optical disk, and the like, which can store program codes. .
Landscapes
- Engineering & Computer Science (AREA)
- Databases & Information Systems (AREA)
- Theoretical Computer Science (AREA)
- Data Mining & Analysis (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Computer Networks & Wireless Communication (AREA)
- Signal Processing (AREA)
- Information Transfer Between Computers (AREA)
Abstract
Description
Claims (12)
- 一种网页的访问方法,其特征在于,包括:确定网页的访问受到限制;获取代理服务器的信息;利用所述代理服务器的信息,访问所述网页。
- 根据权利要求1所述的方法,其特征在于,所述确定网页的访问受到限制,包括:获取所述网页的访问请求;根据所述网页的访问请求,确定所述网页无法访问;根据访问受限列表,确定所述网页所属网站为访问受限网站;确定所述网页的访问受到限制。
- 根据权利要求1或2所述的方法,其特征在于,所述获取代理服务器的信息,包括:根据所述网页的网页标识,获取所述代理服务器的信息。
- 根据权利要求1~3任一权利要求所述的方法,其特征在于,所述获取代理服务器的信息之前,还包括:利用网络爬虫,获取代理服务器集合,所述代理服务器集合中包括可用的至少一个代理服务器中每个代理服务器的信息,以供根据所述代理服务器集合,获取所述代理服务器的信息。
- 根据权利要求4所述的方法,其特征在于,所述利用网络爬虫,获取代理服务器集合之后,还包括:对所述至少一个代理服务器进行质量验证;对没有通过质量验证的代理服务器的信息,进行过滤处理。
- 一种网页的访问装置,其特征在于,包括:访问单元,用于确定网页的访问受到限制;获取单元,用于获取代理服务器的信息;所述访问单元,还用于利用所述代理服务器的信息,访问所述网页。
- 根据权利要求6所述的装置,其特征在于,所述访问单元,还用于获取所述网页的访问请求;根据所述网页的访问请求,确定所述网页无法访问;根据访问受限列表,确定所述网页所属网站为访问受限网站;以及确定所述网页的访问受到限制。
- 根据权利要求6或7所述的装置,其特征在于,所述获取单元,具体用于根据所述网页的网页标识,获取所述代理服务器的信息。
- 根据权利要求6~8任一权利要求所述的装置,其特征在于,所述装置还包括采集单元,用于利用网络爬虫,获取代理服务器集合,所述代理服务器集合中包括可用的至少一个代理服务器中每个代理服务器的信息,以供根据所述代理服务器集合,获取所述代理服务器的信息。
- 根据权利要求9所述的装置,其特征在于,所述采集单元,还用于对所述至少一个代理服务器进行质量验证;以及对没有通过质量验证的代理服务器的信息,进行过滤处理。
- 一种设备,包括:一个或者多个处理器;存储器;一个或者多个程序,所述一个或者多个程序存储在所述存储器中,当被所述一个或者多个处理器执行时:确定网页的访问受到限制;获取代理服务器的信息;利用所述代理服务器的信息,访问所述网页。
- 一种非易失性计算机存储介质,所述非易失性计算机存储介质存储有一个或者多个程序,当所述一个或者多个程序被一个设备执行时,使得所述设备:确定网页的访问受到限制;获取代理服务器的信息;利用所述代理服务器的信息,访问所述网页。
Priority Applications (3)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
EP16858633.7A EP3273362A4 (en) | 2015-10-30 | 2016-05-23 | Webpage access method, apparatus, device and non-volatile computer storage medium |
JP2017548061A JP6488508B2 (ja) | 2015-10-30 | 2016-05-23 | ウェブページのアクセス方法、装置、デバイス及びプログラム |
US15/745,987 US20180225387A1 (en) | 2015-10-30 | 2016-05-23 | Method and apparatus for accessing webpage, apparatus and non-volatile computer storage medium |
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201510725908.3A CN105335511A (zh) | 2015-10-30 | 2015-10-30 | 网页的访问方法及装置 |
CN201510725908.3 | 2015-10-30 |
Publications (1)
Publication Number | Publication Date |
---|---|
WO2017071189A1 true WO2017071189A1 (zh) | 2017-05-04 |
Family
ID=55286038
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
PCT/CN2016/082981 WO2017071189A1 (zh) | 2015-10-30 | 2016-05-23 | 网页的访问方法、装置、设备及非易失性计算机存储介质 |
Country Status (5)
Country | Link |
---|---|
US (1) | US20180225387A1 (zh) |
EP (1) | EP3273362A4 (zh) |
JP (1) | JP6488508B2 (zh) |
CN (1) | CN105335511A (zh) |
WO (1) | WO2017071189A1 (zh) |
Families Citing this family (18)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US8560604B2 (en) | 2009-10-08 | 2013-10-15 | Hola Networks Ltd. | System and method for providing faster and more efficient data communication |
US9241044B2 (en) | 2013-08-28 | 2016-01-19 | Hola Networks, Ltd. | System and method for improving internet communication by using intermediate nodes |
US11057446B2 (en) | 2015-05-14 | 2021-07-06 | Bright Data Ltd. | System and method for streaming content from multiple servers |
CN105335511A (zh) * | 2015-10-30 | 2016-02-17 | 百度在线网络技术(北京)有限公司 | 网页的访问方法及装置 |
EP4002810A1 (en) | 2017-08-28 | 2022-05-25 | Bright Data Ltd. | Method for improving content fetching by selecting tunnel devices |
US11190374B2 (en) | 2017-08-28 | 2021-11-30 | Bright Data Ltd. | System and method for improving content fetching by selecting tunnel devices |
CN108769278B (zh) * | 2018-04-11 | 2021-08-10 | 北京中科闻歌科技股份有限公司 | 一种社交媒体账号管理方法及系统 |
LT3780557T (lt) | 2019-02-25 | 2023-03-10 | Bright Data Ltd. | Turinio parsisiuntimo, naudojant url bandymų mechanizmą, sistema ir būdas |
CN111641664B (zh) * | 2019-03-01 | 2023-12-05 | 北京京东尚科信息技术有限公司 | 一种爬虫设备业务请求方法、装置、系统和存储介质 |
EP4027618B1 (en) | 2019-04-02 | 2024-07-31 | Bright Data Ltd. | Managing a non-direct url fetching service |
CN110147271B (zh) * | 2019-05-15 | 2020-04-28 | 重庆八戒传媒有限公司 | 提升爬虫代理质量的方法、装置及计算机可读存储介质 |
CN112583780B (zh) * | 2019-09-30 | 2023-04-07 | 北京国双科技有限公司 | 使用代理ip访问网站数据的方法、装置、系统和设备 |
US10637956B1 (en) * | 2019-10-01 | 2020-04-28 | Metacluster It, Uab | Smart proxy rotator |
CN111428179B (zh) * | 2020-03-19 | 2023-09-19 | 新方正控股发展有限责任公司 | 图片监测方法、装置及电子设备 |
CN111488392B (zh) * | 2020-04-16 | 2023-07-07 | 北京思特奇信息技术股份有限公司 | 一种查询方法、系统及电子设备 |
CN111767450A (zh) * | 2020-07-27 | 2020-10-13 | 深圳快学教育科技有限公司 | 浏览器数据采集系统及方法 |
CN114595253A (zh) * | 2022-02-22 | 2022-06-07 | 深圳海域信息技术有限公司 | 品牌监测方法、装置、电子设备及介质 |
KR102681000B1 (ko) * | 2023-02-28 | 2024-07-04 | 쿠팡 주식회사 | 정보의 전송을 관리하는 전자 장치의 동작 방법 및 이를 지원하는 전자 장치 |
Citations (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN101102313A (zh) * | 2007-06-21 | 2008-01-09 | 潘晓梅 | 自动更换代理服务器的网络下载系统及方法 |
CN101800758A (zh) * | 2009-02-09 | 2010-08-11 | 华为终端有限公司 | 一种移动终端访问网络的方法、系统及网关 |
CN103973682A (zh) * | 2014-04-30 | 2014-08-06 | 北京奇虎科技有限公司 | 进行网页访问的方法及装置 |
CN105335511A (zh) * | 2015-10-30 | 2016-02-17 | 百度在线网络技术(北京)有限公司 | 网页的访问方法及装置 |
Family Cites Families (14)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US6829638B1 (en) * | 2000-08-03 | 2004-12-07 | International Business Machines Corporation | System and method for managing multiple proxy servers |
US7483910B2 (en) * | 2002-01-11 | 2009-01-27 | International Business Machines Corporation | Automated access to web content based on log analysis |
US20030145046A1 (en) * | 2002-01-31 | 2003-07-31 | Keller S. Brandon | Generating a list of addresses on a proxy server |
GB2446421B (en) * | 2007-02-09 | 2011-06-22 | Proctor & Stevenson Ltd | Tracking web server |
US20100205215A1 (en) * | 2009-02-11 | 2010-08-12 | Cook Robert W | Systems and methods for enforcing policies to block search engine queries for web-based proxy sites |
CN101931635B (zh) * | 2009-06-18 | 2014-05-28 | 北京搜狗科技发展有限公司 | 网络资源访问方法及代理装置 |
US9369437B2 (en) * | 2010-04-01 | 2016-06-14 | Cloudflare, Inc. | Internet-based proxy service to modify internet responses |
CN102694772B (zh) * | 2011-03-23 | 2014-12-10 | 腾讯科技(深圳)有限公司 | 一种访问互联网网页的装置、系统及方法 |
US9049244B2 (en) * | 2011-04-19 | 2015-06-02 | Cloudflare, Inc. | Registering for internet-based proxy services |
CN103024933B (zh) * | 2011-09-28 | 2016-01-20 | 腾讯科技(深圳)有限公司 | 一种移动互联网访问系统及访问移动互联网的方法 |
CN103678311B (zh) * | 2012-08-31 | 2018-11-13 | 腾讯科技(深圳)有限公司 | 基于中转模式的网页访问方法及系统、抓取路径服务器 |
US9241044B2 (en) * | 2013-08-28 | 2016-01-19 | Hola Networks, Ltd. | System and method for improving internet communication by using intermediate nodes |
CN104767837B (zh) * | 2014-01-08 | 2018-08-24 | 阿里巴巴集团控股有限公司 | 一种识别代理ip地址的方法及装置 |
CN104462570B (zh) * | 2014-12-26 | 2019-03-15 | 小米科技有限责任公司 | 网页内容获取方法及装置 |
-
2015
- 2015-10-30 CN CN201510725908.3A patent/CN105335511A/zh active Pending
-
2016
- 2016-05-23 JP JP2017548061A patent/JP6488508B2/ja active Active
- 2016-05-23 EP EP16858633.7A patent/EP3273362A4/en not_active Ceased
- 2016-05-23 WO PCT/CN2016/082981 patent/WO2017071189A1/zh active Application Filing
- 2016-05-23 US US15/745,987 patent/US20180225387A1/en not_active Abandoned
Patent Citations (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN101102313A (zh) * | 2007-06-21 | 2008-01-09 | 潘晓梅 | 自动更换代理服务器的网络下载系统及方法 |
CN101800758A (zh) * | 2009-02-09 | 2010-08-11 | 华为终端有限公司 | 一种移动终端访问网络的方法、系统及网关 |
CN103973682A (zh) * | 2014-04-30 | 2014-08-06 | 北京奇虎科技有限公司 | 进行网页访问的方法及装置 |
CN105335511A (zh) * | 2015-10-30 | 2016-02-17 | 百度在线网络技术(北京)有限公司 | 网页的访问方法及装置 |
Also Published As
Publication number | Publication date |
---|---|
EP3273362A4 (en) | 2018-04-25 |
EP3273362A1 (en) | 2018-01-24 |
JP6488508B2 (ja) | 2019-03-27 |
JP2018514846A (ja) | 2018-06-07 |
CN105335511A (zh) | 2016-02-17 |
US20180225387A1 (en) | 2018-08-09 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
WO2017071189A1 (zh) | 网页的访问方法、装置、设备及非易失性计算机存储介质 | |
JP6761112B2 (ja) | 提示するためのネイティブコンテンツをサーバ側でレンダリングするための方法およびシステム | |
US8452925B2 (en) | System, method and computer program product for automatically updating content in a cache | |
US9426200B2 (en) | Updating dynamic content in cached resources | |
US8468145B2 (en) | Indexing of URLs with fragments | |
US20180032491A1 (en) | Web page display systems and methods | |
US20200351175A1 (en) | Declarative and reactive data layer for component-based user interfaces | |
WO2020010702A1 (zh) | 日志搜索方法、系统、计算机设备和存储介质 | |
CN109033406B (zh) | 用于搜索区块链数据的方法、装置及存储介质 | |
CN105550206B (zh) | 结构化查询语句的版本控制方法及装置 | |
US9967370B2 (en) | OData enabled mobile software applications | |
US8930807B2 (en) | Web content management based on timeliness metadata | |
US9058392B1 (en) | Client state result de-duping | |
US11030384B2 (en) | Identification of sequential browsing operations | |
CN104598570B (zh) | 资源的抓取方法及装置 | |
US11361149B2 (en) | Techniques for web framework detection | |
US20150193832A1 (en) | Method, apparatus, and system for communicating and presenting product information | |
US20130332445A1 (en) | Methods and systems for providing custom crawl-time metadata | |
JP2015534692A (ja) | ウェブアプリケーションにデータベースの変更内容を取得させるための方法及びシステム | |
CN115017182A (zh) | 一种可视化的数据分析方法及设备 | |
US10051079B1 (en) | Session service aspect-oriented cache | |
US20230090108A1 (en) | Systematic identification and masking of private data for replaying user sessions | |
US20150193393A1 (en) | Dynamic Display of Web Content | |
CN107784054B (zh) | 一种页面发布方法和装置 | |
US11403315B2 (en) | Reporting and knowledge discovery for databases |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 16858633 Country of ref document: EP Kind code of ref document: A1 |
|
ENP | Entry into the national phase |
Ref document number: 2017548061 Country of ref document: JP Kind code of ref document: A |
|
REEP | Request for entry into the european phase |
Ref document number: 2016858633 Country of ref document: EP |
|
WWE | Wipo information: entry into national phase |
Ref document number: 15745987 Country of ref document: US |
|
NENP | Non-entry into the national phase |
Ref country code: DE |