CN104679798A - Webpage detection method and device - Google Patents

Webpage detection method and device Download PDF

Info

Publication number
CN104679798A
CN104679798A CN201310643263.XA CN201310643263A CN104679798A CN 104679798 A CN104679798 A CN 104679798A CN 201310643263 A CN201310643263 A CN 201310643263A CN 104679798 A CN104679798 A CN 104679798A
Authority
CN
China
Prior art keywords
network address
detected
page status
redirect
page
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN201310643263.XA
Other languages
Chinese (zh)
Other versions
CN104679798B (en
Inventor
刘健
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Tencent Technology Shenzhen Co Ltd
Original Assignee
Tencent Technology Shenzhen Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Tencent Technology Shenzhen Co Ltd filed Critical Tencent Technology Shenzhen Co Ltd
Priority to CN201310643263.XA priority Critical patent/CN104679798B/en
Publication of CN104679798A publication Critical patent/CN104679798A/en
Application granted granted Critical
Publication of CN104679798B publication Critical patent/CN104679798B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Abstract

The invention discloses a webpage detection method and a webpage detection device. The method comprises the steps of matching a skipping relation of a website to be detected when a detection instruction of some website triggered by a client is received, and looking for whether a target website is stored after the website to be detected is skipped; if the target website is stored, inquiring and obtaining the page state of the target website; if the target website is not stored, inquiring and acquiring the page state of the website to be detected. Compared with the prior art, the page state of the website to be detected can be directly detected. The webpage detection method provided by the invention has the beneficial effects of quickly detecting malicious websites which evade striking by using a redirection technology, the network bandwidth and CPU (Central Processing Unit) resources of the network can be saved.

Description

Page detection method and device
Technical field
The present invention relates to Internet technology, particularly relate to a kind of page detection method and device.
Background technology
Along with the fast development of Internet technology, network security problem is increasingly important.At present, when user accesses internet, service end usually adopt security service software (as Tengxun computer house keeper) detect user the security of webpage of accessing; If server detects certain web page address and the URL(Uniform Resource Locator of user's access, URL(uniform resource locator)) be malicious websites, then return this testing result to client, and point out user careful access.After a certain bar malice URL is admitted to cloud security service device database, hacker can adopt the mode that network address is redirected to propagate other malice URL be not yet blocked usually; Such as, by adding the mode of random number after a certain URL link, numerous different URL can be constructed, after one of them is by the interception of cloud security software, directly using another to propagate.
For the above-mentioned malice network address utilizing redirecting technique to evade Cloud Server strike, existing website safety detection mode remains and detects wall scroll URL respectively, jump address is to the URL of same network address, when server detects, need the content of pages that the above-mentioned URL of repeated downloads is corresponding, and carry out replicate analysis to carry out security detection, waste a large amount of bandwidth sum cpu resources, be unfavorable for fast and effeciently detection of malicious website.
Summary of the invention
Given this, be necessary to provide a kind of page detection method and device, to detect the malice network address utilizing redirecting technique to evade strike timely and effectively.
The embodiment of the invention discloses a kind of page detection method, comprise the following steps:
When receiving the detection instruction to a certain network address of client triggering, mate the redirect relation of this network address to be detected, search the object network address after whether storing described network address redirect to be detected;
If find described object network address, then inquire about and obtain the page status of described object network address;
If do not find described object network address, then inquire about and obtain the page status of described network address to be detected.
The embodiment of the present invention also discloses a kind of webpage pick-up unit, comprising:
Matching module, for receive client trigger the detection instruction to a certain network address time, mate the redirect relation of this network address to be detected, search the object network address after whether storing described network address redirect to be detected;
Enquiry module, for when finding described object network address, inquiring about and obtaining the page status of described object network address; When not finding described object network address, inquiring about and obtaining the page status of described network address to be detected.
When the embodiment of the present invention receives the detection instruction to a certain network address of client triggering, mate the redirect relation of this network address to be detected, search the object network address after whether storing described network address redirect to be detected; If store described object network address, then inquire about and obtain the page status of described object network address; If do not store described object network address, then inquire about and obtain the page status of described network address to be detected; Compared in prior art, the page status of each network address to be detected of direct-detection, the embodiment of the present invention has the beneficial effect detecting fast and utilize redirecting technique to evade the malice network address of strike, has saved the network bandwidth and cpu resource.
Accompanying drawing explanation
Fig. 1 is page detection method first embodiment schematic flow sheet of the present invention;
Fig. 2 is page detection method second embodiment schematic flow sheet of the present invention;
Fig. 3 is in page detection method of the present invention, inquires about and obtains the page status one embodiment schematic flow sheet of network address to be detected;
Fig. 4 is webpage pick-up unit first embodiment high-level schematic functional block diagram of the present invention;
Fig. 5 is webpage pick-up unit second embodiment high-level schematic functional block diagram of the present invention;
Fig. 6 is webpage pick-up unit the 3rd embodiment high-level schematic functional block diagram of the present invention.
The realization of embodiment of the present invention object, functional characteristics and advantage will in conjunction with the embodiments, are described further with reference to accompanying drawing.
Embodiment
Technical scheme of the present invention is further illustrated below in conjunction with Figure of description and specific embodiment.Should be appreciated that specific embodiment described herein only in order to explain the present invention, be not intended to limit the present invention.
Fig. 1 is page detection method first embodiment schematic flow sheet of the present invention; As shown in Figure 1, page detection method of the present invention comprises the following steps:
Step S01, receive client trigger the detection instruction to a certain network address time, mate the redirect relation of this network address to be detected, search the object network address after whether storing described network address redirect to be detected; If find described object network address, then perform step S02; If do not find described object network address, then perform step S03;
In the embodiment of the present invention, service end stores the URL security information database of magnanimity, stores state corresponding to URL address and this URL address in this database, and the above-mentioned information of this database purchase of service end real-time update; Such as, change state corresponding to certain URL address, add the URL, the page status adding redirect relation corresponding to certain URL and this URL object network address etc. of malice network address.
When client is based on the operation of user side, ask a certain network address as the safe condition of network address URL a to be detected; Or, when client triggers the trigger condition of service end detection URL state, service end receives the detection instruction to this URL a that client triggers, and mates the redirect relation of this URL a, searches in database the object network address after whether storing this URL a redirect as URL b.
In the embodiment of the present invention, the trigger condition that the service end that client triggers detects URL state can be: client based on this URL address, the page that this URL address of the access of triggering is corresponding; Or client clicks the word after interior chain or word etc., and the embodiment of the present invention does not limit above-mentioned trigger condition.
Step S02, inquiry obtain the page status of described object network address;
Step S03, inquiry obtain the page status of described network address to be detected.
If store the object network address URL b after this URL a redirect in server side searches to the database of this service end, then service end directly obtains the page status of the destination address URL b after this URL a redirect; If service end does not find the object network address URLb after this network address URL a to be detected redirect in its database, then service end is inquired about and is obtained the page status of this network address URL a to be detected.
Embodiment of the present invention page detection method for the Detection results of malice network address utilizing network address redirect technical construction, particularly significantly.Described network address redirect, also known as network address be redirected, refer to when user input network address A conduct interviews time, browser can jump to network address B automatically, shows the content of network address B to user.Such as link http://t.cn/hfwpF 111 and http://t.cn/hfwpF 222 and http://t.cn/hfwpF 333, all jump to http://qq.com; By adding the mode of random number after t.cn link, can construct numerous different URL, after one of them URL is positioned at the cloud security software interception of service end, hacker directly uses another URL to propagate.
Utilize the thought of embodiment of the present invention page detection method, when service end receives a network address URL a to be detected, first mate the redirect relation of this URL a, search in database the object network address URL b after whether storing this URL a redirect; If store the object network address URL b after this URL a redirect, then inquire about the page status of this URL b, and obtain the page status of this URL b stored, as the page status of this network address URL a to be detected.Such as, the network address to be detected that service end receives is above-mentioned network address http://t.cn/hfwpF 111, service end matches the redirect relation of this http://t.cn/hfwpF 111, find out in database the object network address http://qq.com after storing the redirect of this http://t.cn/hfwpF 111 network address, and to inquire about and the page status obtaining this object network address http://qq.com corresponding is safety, then service end gets the page status of network address http://t.cn/hfwpF 111 to be detected is safety; Similarly, when service end receives the detection to http://t.cn/hfwpF 222, according to above-mentioned thought, mate the redirect relation of this network address, get the object network address http://qq.com that this http://t.cn/hfwpF 222 address is corresponding, and to inquire about and the page status obtaining this object network address http://qq.com is safety.Further, in the embodiment of the present invention, mate the redirect relation of network address to be detected, identify this network address to be detected whether there is redirect after object network address be http(Hyper Text Transport Protocol by downloading this network address to be detected, HTML (Hypertext Markup Language)) head realizes.
When the embodiment of the present invention receives the detection instruction to a certain network address of client triggering, mate the redirect relation of this network address to be detected, search the object network address after whether storing described network address redirect to be detected; If store described object network address, then inquire about and obtain the page status of described object network address; If do not store described object network address, then inquire about and obtain the page status of described network address to be detected; Compared in prior art, the page status of each network address to be detected of direct-detection, the embodiment of the present invention has the beneficial effect detecting fast and utilize redirecting technique to evade the malice network address of strike, has saved the network bandwidth and cpu resource.
Fig. 2 is page detection method second embodiment schematic flow sheet of the present invention; The difference of embodiment described in the present embodiment and Fig. 1 is, the present embodiment describes after service end gets page status, returns the page status of acquisition to client.
Based on the specific descriptions of embodiment described in Fig. 1, as shown in Figure 2, page detection method of the present invention at " step S02, inquiry obtain the page status of described object network address " or, after " step S03, inquiry obtain the page status of described network address to be detected ", also comprise:
Step S04, the described object network address obtained or the page status of network address to be detected are back to client.
In the embodiment of the present invention, the object network address of acquisition or the page status of network address to be detected are back to client and comprise by service end: the object network address of acquisition or the various page status of network address to be detected are all back to client by service end, and no matter this page status is secure page table or the dangerous page.
In the preferred embodiment of the present invention, when the page status of the object network address that gets or network address to be detected is only the dangerous page by service end, just the above-mentioned page status of correspondence is back to client, reminds client to carry out careful access to this webpage simultaneously.
Consider the sensory experience of client user, the situation that the object network address of acquisition or the page status of network address to be detected can be only the dangerous page by service end is back to client, carries out careful access to remind client to this webpage; Page status for the object network address obtained or network address to be detected is the situation of secure page table, and service end directly can obtain the page corresponding to this network address, and the page of acquisition is directly pushed to client.
The object network address of acquisition or the page status of network address to be detected are back to client by embodiment of the present invention service end, have the beneficial effect of the page status reminding client to access; Especially when the page status obtained is the dangerous page, also there is the beneficial effect improving client-access internet security.
Fig. 3 is in page detection method of the present invention, inquires about and obtains the page status one embodiment schematic flow sheet of network address to be detected; The difference of the embodiment of the present invention and Fig. 1, Fig. 2 embodiment is that the embodiment of the present invention only describes: when service end does not find the object network address after network address redirect to be detected, inquires about and obtains the page status of network address to be detected.
Based on the description of embodiment described in Fig. 1, Fig. 2, as shown in Figure 3, in page detection method of the present invention, step S03, inquiry obtain the page status of network address to be detected, comprising:
Whether step S31, inquiry store the page status of described network address to be detected; If store the page status of described network address to be detected, then perform step S32; If do not store the page status of described network address to be detected, then perform step S33;
The page status of the network address described to be detected that step S32, acquisition store;
Step S33, detect the redirect relation of described network address to be detected; According to result of detection, detect and obtain the page status of described network address to be detected.
In the present embodiment, when service end receives the detection instruction to a certain network address of client triggering, first mate the redirect relation of this network address to be detected, search in database the object network address after whether storing this network address redirect to be detected.
During object network address after service end does not find network address redirect to be detected, search in database and whether store page status corresponding to this network address to be detected; If store the page status of described network address to be detected, service end obtains the page status of the network address described to be detected stored.If do not store the page status of described network address to be detected, the redirect relation of the described network address to be detected of service end detection; According to result of detection, detect and obtain the page status of described network address to be detected.
When detecting described network address to be detected and there is object network address, service end downloads content of pages corresponding to the object network address after this network address redirect to be detected, analyzes the content of pages of this object network address downloaded, obtains the page status of this object network address; Using the page status of the page status of the described object network address of acquisition as described network address to be detected.When detecting described network address to be detected and there is not object network address, service end directly downloads content of pages corresponding to this network address to be detected, and analyzes the content of pages of this network address to be detected downloaded, and obtains the page status of this network address to be detected.
Further, in the present embodiment, service end detects the redirect relation of network address to be detected, identify this network address to be detected whether there is redirect after object network address be that http head by downloading network address to be detected realizes; Service end according to the information in http head corresponding to network address to be detected downloaded, can identify this network address to be detected whether there is redirect after object network address; This is because, the information of the object network address after this network address redirect to be detected is included in the http head of network address to be detected, this information exists with form expressly, according to the information in http head, can draw obviously this network address to be detected whether have redirect after object network address.
Such as, the information that service end obtains the http head of a network address http://t.cn/hfwpF 111 to be detected comprises:
HTTP/1.1302Moved Temporarily
Location:http://qq.com
The http header corresponding according to this network address to be detected, the object network address that can obtain after this network address http://t.cn/hfwpF 111 to be detected redirect is http://qq.com.
For the ease of the convenience of subsequent detection network address, the embodiment of the present invention upgrades corresponding database further, is stored in database by the page status of the network address not yet stored detected; Meanwhile, during object network address after this network address exists redirect, service end stores the redirect relation of the object network address after this network address redirect and this network address, and the page status of object network address after this network address redirect.
When N number of different URL is redirected to same object URL, adopt existing network address detection method, need the pagefile corresponding to this object URL to download N time respectively, and this N time is downloaded owing to all carrying out for this object URL, is therefore repeated downloads this N time.And based on the above-mentioned thought of embodiment of the present invention network address detection method, service end then only needs to download N http head and an object URL correspondence pagefile.Compare the pagefile size of download, the expense that service end downloads http head is substantially negligible.
When the inquiry of embodiment of the present invention service end does not store the page status of network address to be detected, detect the redirect relation of network address to be detected; According to result of detection, detect and obtain the page status of network address to be detected; Reduce expense during service end detection network address, there is the beneficial effect saving the network bandwidth and cpu resource further.
Fig. 4 is webpage pick-up unit first embodiment high-level schematic functional block diagram of the present invention; As shown in Figure 4, webpage pick-up unit of the present invention comprises: matching module 01 and enquiry module 02.
Matching module 01, for receive client trigger the detection instruction to a certain network address time, mate the redirect relation of this network address to be detected, search the object network address after whether storing described network address redirect to be detected;
In the embodiment of the present invention, service end stores the URL security information database of magnanimity, stores state corresponding to URL address and this URL address in this database, and the above-mentioned information of this database purchase of service end real-time update; Such as, change state corresponding to certain URL address, add the URL, the page status adding redirect relation corresponding to certain URL and this URL object network address etc. of malice network address.
When client is based on the operation of user side, ask a certain network address as the safe condition of network address URL a to be detected; Or, when client triggers the trigger condition of service end detection URL state, matching module 01 receives the detection instruction to this URL a that client triggers, and mates the redirect relation of this URL a, searches in database the object network address after whether storing this URL a redirect as URL b.
In the embodiment of the present invention, the trigger condition that the service end that client triggers detects URL state can be: client based on this URL address, the page that this URL address of the access of triggering is corresponding; Or client clicks the word after interior chain or word etc., and the embodiment of the present invention does not limit above-mentioned trigger condition.
Enquiry module 02, for when finding described object network address, inquiring about and obtaining the page status of described object network address; When not finding described object network address, inquiring about and obtaining the page status of described network address to be detected.
If enquiry module 02 finds in the database of this service end the object network address URL b after storing this URL a redirect, then enquiry module 02 directly obtains the page status of the destination address URL b after this URL a redirect; If enquiry module 02 does not find the object network address URL b after this network address URL a to be detected redirect in its database, then enquiry module 02 is inquired about and is obtained the page status of this network address URL a to be detected.
Embodiment of the present invention webpage pick-up unit detects the beneficial effect utilizing the malice network address of network address redirect technical construction, particularly significantly.Described network address redirect, also known as network address be redirected, refer to when user input network address A conduct interviews time, browser can jump to network address B automatically, shows the content of network address B to user.Such as link http://t.cn/hfwpF 111 and http://t.cn/hfwpF 222 and http://t.cn/hfwpF 333, all jump to http://qq.com; By adding the mode of random number after t.cn link, can construct numerous different URL, after one of them URL is positioned at the cloud security software interception of service end, hacker directly uses another URL to propagate.
Utilize the thought of embodiment of the present invention webpage pick-up unit, when service end receives a network address URL a to be detected, first matching module 01 mates the redirect relation of this URL a, searches in database the object network address URL b after whether storing this URL a redirect; If store the object network address URL b after this URL a redirect, then enquiry module 02 inquires about the page status of this URL b, and obtains the page status of this URL b stored, as the page status of this network address URL a to be detected.Such as, the network address to be detected that service end receives is above-mentioned network address http://t.cn/hfwpF 111, matching module 01 mates the redirect relation of this http://t.cn/hfwpF 111, find out in database the object network address http://qq.com after storing the redirect of this http://t.cn/hfwpF 111 network address, enquiry module 02 is inquired about and the page status obtaining this object network address http://qq.com corresponding is safety, then enquiry module 02 gets the page status of network address http://t.cn/hfwpF 111 to be detected is safety; Similarly, when service end receives the detection to http://t.cn/hfwpF 222, according to above-mentioned thought, matching module 01 mates the redirect relation of this network address, get the object network address http://qq.com that this http://t.cn/hfwpF 222 address is corresponding, and enquiry module 02 inquires about and the page status obtaining this object network address http://qq.com is safety.Further, in the embodiment of the present invention, matching module 01 mates the redirect relation of network address to be detected, identify this network address to be detected whether there is redirect after object network address be that http head by downloading this network address to be detected realizes.
When the embodiment of the present invention receives the detection instruction to a certain network address of client triggering, mate the redirect relation of this network address to be detected, search the object network address after whether storing described network address redirect to be detected; If store described object network address, then inquire about and obtain the page status of described object network address; If do not store described object network address, then inquire about and obtain the page status of described network address to be detected; Compared in prior art, the page status of each network address to be detected of direct-detection, the embodiment of the present invention has the beneficial effect detecting fast and utilize redirecting technique to evade the malice network address of strike, has saved the network bandwidth and cpu resource.
Fig. 5 is webpage pick-up unit second embodiment high-level schematic functional block diagram of the present invention; Described in the present embodiment and Fig. 4, the difference of embodiment is that webpage pick-up unit of the present invention also comprises feedback module 03; The present embodiment is only described feedback module 03, and relevant other modules involved by page detection device of the present invention please refer to the specific descriptions of related embodiment, do not repeat them here.
Based on the description of embodiment described in Fig. 4, as shown in Figure 5, webpage pick-up unit of the present invention also comprises:
Feedback module 03, for being back to client by the page status of the described object network address obtained or network address to be detected.
In the embodiment of the present invention, the object network address of acquisition or the page status of network address to be detected are back to client and comprise by the feedback module 03 of service end: the object network address of acquisition or the various page status of network address to be detected are all back to client by feedback module 03, and no matter this page status is secure page table or the dangerous page.
In the preferred embodiment of the present invention, when the page status of the object network address that gets or network address to be detected is only the dangerous page by feedback module 03, just the above-mentioned page status of correspondence is back to client, reminds client to carry out careful access to this webpage simultaneously.
Consider the sensory experience of client user, the situation that the object network address of acquisition or the page status of network address to be detected can be only the dangerous page by feedback module 03 is back to client, carries out careful access to remind client to this webpage; Page status for the object network address obtained or network address to be detected is the situation of secure page table, and feedback module 03 directly can obtain the page corresponding to this network address, and the page of acquisition is directly pushed to client.
The object network address of acquisition or the page status of network address to be detected are back to client by embodiment of the present invention service end, have the beneficial effect of the page status reminding client to access; Especially when the page status obtained is the dangerous page, also there is the beneficial effect improving client-access internet security.
Fig. 6 is webpage pick-up unit the 3rd embodiment high-level schematic functional block diagram of the present invention; Described in the present embodiment and Fig. 5, the difference of embodiment is that embodiment of the present invention webpage pick-up unit also comprises memory module 04; The present embodiment is described memory module 04, is also described further enquiry module 02 meanwhile; And for other modules involved by webpage pick-up unit of the present invention, please refer to the specific descriptions of related embodiment, do not repeat them here.
Based on the description of embodiment described in Fig. 4 and Fig. 5, as shown in Figure 6, webpage pick-up unit of the present invention also comprises:
Memory module 04, for storing the page status of the network address described to be detected detected, stores the redirect relation of the object network address after described network address redirect to be detected and described network address to be detected simultaneously.
In the embodiment of the present invention, when matching module 01 receives the detection instruction to a certain network address of client triggering, first mate the redirect relation of this network address to be detected, search in database the object network address after whether storing this network address redirect to be detected.
During object network address after matching module 01 does not find network address redirect to be detected, enquiry module 02 searches in database whether store page status corresponding to this network address to be detected; If store the page status of described network address to be detected, enquiry module 02 obtains the page status of the network address described to be detected stored.If do not store the page status of described network address to be detected, enquiry module 02 detects the redirect relation of described network address to be detected; According to result of detection, detect and obtain the page status of described network address to be detected.
When detecting described network address to be detected and there is object network address, enquiry module 02 downloads content of pages corresponding to the object network address after this network address redirect to be detected, analyzes the content of pages of this object network address downloaded, obtains the page status of this object network address; Using the page status of the page status of the described object network address of acquisition as described network address to be detected.When detecting described network address to be detected and there is not object network address, enquiry module 02 directly downloads content of pages corresponding to this network address to be detected, and analyzes the content of pages of this network address to be detected downloaded, and obtains the page status of this network address to be detected.
Further, in the present embodiment, enquiry module 02 detects the redirect relation of network address to be detected, identify this network address to be detected whether there is redirect after object network address be that http head by downloading network address to be detected realizes; Enquiry module 02 according to the information in http head corresponding to network address to be detected downloaded, can identify this network address to be detected whether there is redirect after object network address; This is because, the information of the object network address after this network address redirect to be detected is included in the http head of network address to be detected, this information exists with form expressly, according to the information in http head, enquiry module 02 can draw obviously this network address to be detected whether have redirect after object network address.
Such as, the information that enquiry module 02 obtains the http head of a network address http://t.cn/hfwpF 111 to be detected comprises:
HTTP/1.1302Moved Temporarily
Location:http://qq.com
The http header corresponding according to this network address to be detected, the object network address that enquiry module 02 can obtain after this network address http://t.cn/hfwpF 111 to be detected redirect is http://qq.com.
For the ease of the convenience of subsequent detection network address, the embodiment of the present invention upgrades corresponding database further, and the page status of the network address not yet stored detected is stored in database by memory module 04; Meanwhile, during object network address after this network address exists redirect, memory module 04 stores the redirect relation of the object network address after this network address redirect and this network address, and the page status of object network address after this network address redirect.
When N number of different URL is redirected to same object URL, adopt existing network address detection method, need the pagefile corresponding to this object URL to download N time respectively, and this N time is downloaded owing to all carrying out for this object URL, is therefore repeated downloads this N time.And the above-mentioned thought of webpage is detected based on embodiment of the present invention network address pick-up unit, service end then only needs to download N http head and a corresponding pagefile of object URL.Compare the pagefile size of download, the expense that service end downloads http head is substantially negligible.
When the inquiry of embodiment of the present invention service end does not store the page status of network address to be detected, detect the redirect relation of network address to be detected; According to result of detection, detect and obtain the page status of network address to be detected; Reduce expense during service end detection network address, there is the beneficial effect saving the network bandwidth and cpu resource further.
It should be noted that, in this article, term " comprises ", " comprising " or its any other variant are intended to contain comprising of nonexcludability, thus make to comprise the process of a series of key element, method, article or device and not only comprise those key elements, but also comprise other key elements clearly do not listed, or also comprise by the intrinsic key element of this process, method, article or device.When not more restrictions, the key element limited by statement " comprising ... ", and be not precluded within process, method, article or the device comprising this key element and also there is other identical element.
The invention described above embodiment sequence number, just to describing, does not represent the quality of embodiment.
Through the above description of the embodiments, those skilled in the art can be well understood to the mode that above-described embodiment method can add required general hardware platform by software and realize, hardware can certainly be passed through, but in a lot of situation, the former is better embodiment.Based on such understanding, technical scheme of the present invention can embody the part that prior art contributes in essence in other words in form of a computer software product, this computer software product is stored in a storage medium (as ROM/RAM, magnetic disc, CD) of the webpage pick-up unit described in Fig. 4 to Fig. 6, it (can be mobile phone that this storage medium comprises some instructions in order to make a station terminal equipment, computing machine, server, or the network equipment, or the webpage pick-up unit etc. described in Fig. 4 to Fig. 6) perform method described in the present invention each embodiment.
The foregoing is only the preferred embodiments of the present invention; not thereby its scope of the claims is limited; every utilize instructions of the present invention and accompanying drawing content to do equivalent structure or equivalent flow process conversion; directly or indirectly be used in the technical field that other are relevant, be all in like manner included in scope of patent protection of the present invention.

Claims (12)

1. a page detection method, is characterized in that, comprises the following steps:
When receiving the detection instruction to a certain network address of client triggering, mate the redirect relation of this network address to be detected, search the object network address after whether storing described network address redirect to be detected;
If find described object network address, then inquire about and obtain the page status of described object network address;
If do not find described object network address, then inquire about and obtain the page status of described network address to be detected.
2. the method for claim 1, is characterized in that, also comprises:
The page status of the described object network address obtained or network address to be detected is back to client.
3. method as claimed in claim 1 or 2, is characterized in that, described inquiry also obtains the page status of described network address to be detected, comprising:
Whether inquiry stores the page status of described network address to be detected;
If store the page status of described network address to be detected, then obtain the page status of the network address described to be detected of storage;
If do not store the page status of described network address to be detected, then detect the redirect relation of described network address to be detected; According to result of detection, detect and obtain the page status of described network address to be detected.
4. method as claimed in claim 3, is characterized in that, described according to result of detection, detects and obtains the page status of described network address to be detected, comprising:
Detect described network address to be detected when there is object network address, download the content of pages that described object network address is corresponding, analyze the content of pages of the described object network address downloaded, obtain the page status of described object network address; Using the page status of the page status of the described object network address of acquisition as described network address to be detected;
Detect described network address to be detected when there is not object network address, download the content of pages that described network address to be detected is corresponding, analyze the content of pages of the network address described to be detected downloaded, obtain the page status of described network address to be detected.
5. method as claimed in claim 3, it is characterized in that, the redirect relation of the described network address to be detected of described detection, comprising:
Download the http head of described network address to be detected, according to the information in described http head, identify described network address to be detected whether have redirect after object network address.
6. method as claimed in claim 3, is characterized in that, described according to result of detection, detects and obtains the page status of described network address to be detected, also comprising afterwards:
Store the page status of the network address described to be detected detected, store the redirect relation of the object network address after described network address redirect to be detected and described network address to be detected simultaneously.
7. a webpage pick-up unit, is characterized in that, comprising:
Matching module, for receive client trigger the detection instruction to a certain network address time, mate the redirect relation of this network address to be detected, search the object network address after whether storing described network address redirect to be detected;
Enquiry module, for when finding described object network address, inquiring about and obtaining the page status of described object network address; When not finding described object network address, inquiring about and obtaining the page status of described network address to be detected.
8. device as claimed in claim 7, is characterized in that, also comprise:
Feedback module, for being back to client by the page status of the described object network address obtained or network address to be detected.
9. as claimed in claim 7 or 8 device, is characterized in that, described enquiry module also for:
Whether inquiry stores the page status of described network address to be detected;
If store the page status of described network address to be detected, then obtain the page status of the network address described to be detected of storage;
If do not store the page status of described network address to be detected, then detect the redirect relation of described network address to be detected; According to result of detection, detect and obtain the page status of described network address to be detected.
10. device as claimed in claim 9, is characterized in that, described enquiry module also for:
Detect described network address to be detected when there is object network address, download the content of pages that described object network address is corresponding, analyze the content of pages of the described object network address downloaded, obtain the page status of described object network address; Using the page status of the page status of the described object network address of acquisition as described network address to be detected;
Detect described network address to be detected when there is not object network address, download the content of pages that described network address to be detected is corresponding, analyze the content of pages of the network address described to be detected downloaded, obtain the page status of described network address to be detected.
11. devices as claimed in claim 9, is characterized in that, described enquiry module also for:
Download the http head of described network address to be detected, according to the information in described http head, identify described network address to be detected whether have redirect after object network address.
12. devices as claimed in claim 9, is characterized in that, also comprise:
Memory module, for storing the page status of the network address described to be detected detected, stores the redirect relation of the object network address after described network address redirect to be detected and described network address to be detected simultaneously.
CN201310643263.XA 2013-12-03 2013-12-03 Page detection method and device Active CN104679798B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201310643263.XA CN104679798B (en) 2013-12-03 2013-12-03 Page detection method and device

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201310643263.XA CN104679798B (en) 2013-12-03 2013-12-03 Page detection method and device

Publications (2)

Publication Number Publication Date
CN104679798A true CN104679798A (en) 2015-06-03
CN104679798B CN104679798B (en) 2018-04-27

Family

ID=53314850

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201310643263.XA Active CN104679798B (en) 2013-12-03 2013-12-03 Page detection method and device

Country Status (1)

Country Link
CN (1) CN104679798B (en)

Cited By (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106484720A (en) * 2015-08-28 2017-03-08 北京奇虎科技有限公司 The method and apparatus that the effectiveness of URL is promoted in a kind of detection
CN106992975A (en) * 2017-03-21 2017-07-28 腾讯科技(深圳)有限公司 The recognition methods of malice network address and device
CN107391517A (en) * 2016-05-17 2017-11-24 广州市动景计算机科技有限公司 The display methods and device of website and webpage
CN108259416A (en) * 2016-12-28 2018-07-06 华为技术有限公司 Detect the method and relevant device of malicious web pages
CN110688592A (en) * 2018-07-06 2020-01-14 武汉斗鱼网络科技有限公司 External link skipping method, storage medium, electronic device and system
CN111898046A (en) * 2020-07-16 2020-11-06 北京天空卫士网络安全技术有限公司 Redirection management method and device

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20060015722A1 (en) * 2004-07-16 2006-01-19 Geotrust Security systems and services to provide identity and uniform resource identifier verification
CN101360102A (en) * 2007-07-31 2009-02-04 赛门铁克公司 Method for detecting dns redirects or fraudulent local certificates for ssl sites in pharming/phishing schemes by remote validation and using a credential manager and recorded certificate attributes
CN102402620A (en) * 2011-12-26 2012-04-04 余姚市供电局 Method and system for defending malicious webpage
CN103179095A (en) * 2011-12-22 2013-06-26 阿里巴巴集团控股有限公司 Method and client device for detecting phishing websites
CN103338211A (en) * 2013-07-19 2013-10-02 腾讯科技(深圳)有限公司 Malicious URL (unified resource locator) authenticating method and device

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20060015722A1 (en) * 2004-07-16 2006-01-19 Geotrust Security systems and services to provide identity and uniform resource identifier verification
CN101360102A (en) * 2007-07-31 2009-02-04 赛门铁克公司 Method for detecting dns redirects or fraudulent local certificates for ssl sites in pharming/phishing schemes by remote validation and using a credential manager and recorded certificate attributes
CN103179095A (en) * 2011-12-22 2013-06-26 阿里巴巴集团控股有限公司 Method and client device for detecting phishing websites
CN102402620A (en) * 2011-12-26 2012-04-04 余姚市供电局 Method and system for defending malicious webpage
CN103338211A (en) * 2013-07-19 2013-10-02 腾讯科技(深圳)有限公司 Malicious URL (unified resource locator) authenticating method and device

Cited By (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106484720A (en) * 2015-08-28 2017-03-08 北京奇虎科技有限公司 The method and apparatus that the effectiveness of URL is promoted in a kind of detection
CN106484720B (en) * 2015-08-28 2019-07-23 北京奇虎科技有限公司 A kind of method and apparatus of the validity of detection popularization URL
CN107391517A (en) * 2016-05-17 2017-11-24 广州市动景计算机科技有限公司 The display methods and device of website and webpage
CN108259416A (en) * 2016-12-28 2018-07-06 华为技术有限公司 Detect the method and relevant device of malicious web pages
CN106992975A (en) * 2017-03-21 2017-07-28 腾讯科技(深圳)有限公司 The recognition methods of malice network address and device
CN110688592A (en) * 2018-07-06 2020-01-14 武汉斗鱼网络科技有限公司 External link skipping method, storage medium, electronic device and system
CN110688592B (en) * 2018-07-06 2022-06-21 武汉斗鱼网络科技有限公司 External link skipping method, storage medium, electronic device and system
CN111898046A (en) * 2020-07-16 2020-11-06 北京天空卫士网络安全技术有限公司 Redirection management method and device
CN111898046B (en) * 2020-07-16 2024-02-13 北京天空卫士网络安全技术有限公司 Method and device for redirection management

Also Published As

Publication number Publication date
CN104679798B (en) 2018-04-27

Similar Documents

Publication Publication Date Title
CN104679798A (en) Webpage detection method and device
US20180332453A1 (en) Contextual deep linking of applications
US9213832B2 (en) Dynamically scanning a web application through use of web traffic information
CN102739653B (en) Detection method and device aiming at webpage address
WO2015043428A1 (en) Method, system, browser and proxy server for loading webpage
US10380382B2 (en) Apparatus, method and computer-readable storage medium for securing javascript
CN105100260A (en) Method and device for carrying out access through proxy server
CN106250454B (en) Page script loading method and device
CN103440276A (en) Method and device for improving webpage display speed
CN102984161B (en) The recognition methods of a kind of reliable website and device
CN104657659B (en) A kind of storage cross-site attack script loophole detection method, apparatus and system
US20150120692A1 (en) Method, device, and system for acquiring user behavior
US8789177B1 (en) Method and system for automatically obtaining web page content in the presence of redirects
CN107547524A (en) A kind of page detection method, device and equipment
CN104219230A (en) Method and device for identifying malicious websites
CN103701779A (en) Method and device for accessing website for second time and firewall equipment
CN103118033B (en) A kind of defend user website to be tampered method and device
CN104158697B (en) A kind of dead chain detection method and device
CN106446068B (en) Directory database generation and query method and device
CN104717226A (en) Method and device for detecting website address
US10095791B2 (en) Information search method and apparatus
CN105930385A (en) Data crawling method and system
CN108664493A (en) Count the whether effective method, apparatus of URL, electronic equipment and storage medium
CN110633432A (en) Method, device, terminal equipment and medium for acquiring data
CN110955856B (en) Webpage loading method and device, server and storage medium

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant