CN102737119B - The lookup method of URL(uniform resource locator), filter method and relevant device and system - Google Patents

The lookup method of URL(uniform resource locator), filter method and relevant device and system Download PDF

Info

Publication number
CN102737119B
CN102737119B CN201210173813.1A CN201210173813A CN102737119B CN 102737119 B CN102737119 B CN 102737119B CN 201210173813 A CN201210173813 A CN 201210173813A CN 102737119 B CN102737119 B CN 102737119B
Authority
CN
China
Prior art keywords
url
url address
safety equipment
classification information
address
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201210173813.1A
Other languages
Chinese (zh)
Other versions
CN102737119A (en
Inventor
万荣飞
郑重
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Huawei Technologies Co Ltd
Original Assignee
Huawei Technologies Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Huawei Technologies Co Ltd filed Critical Huawei Technologies Co Ltd
Priority to CN201210173813.1A priority Critical patent/CN102737119B/en
Publication of CN102737119A publication Critical patent/CN102737119A/en
Application granted granted Critical
Publication of CN102737119B publication Critical patent/CN102737119B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Landscapes

  • Information Transfer Between Computers (AREA)

Abstract

The embodiment of the invention discloses a kind of lookup method of URL(uniform resource locator), filter method and relevant device and system, for improving the search efficiency of URL.The lookup method of the URL that the embodiment of the present invention provides comprises: URL classified service device receives the Query request of the URL address that safety equipment send; Classification information corresponding to the classification information that the URL address that safety equipment send by described URL classified service device is corresponding and at least one other URL address and other URL addresses each sends to described safety equipment, and other URL addresses that URL address refers to from described safety equipment send described belong to same website and the URL address different with the URL address that described safety equipment send.

Description

The lookup method of URL(uniform resource locator), filter method and relevant device and system
Technical field
The present invention relates to communication technical field, particularly relate to lookup method, filter method and relevant device and the system of a kind of URL(uniform resource locator) (URL, Uniform Resource Locator).
Background technology
Quantity of information on current internet site remains high growth speed, network changes the life of people gradually, the negative effect that network brings is from start to finish along with network Development, and such as information overflow, personal secrets etc., this adds increased blindness and potential safety hazard that user accesses internet.Each internet site and webpage have a unique mark, be termed URL(uniform resource locator) and (be called for short URL, Uniform Resource Locator), user realizes the object of accessing internet by the URL of website or webpage, carries the URL of website to be visited or webpage in the network message that namely user sends.Filtered by URL user being accessed to internet at present and just seem particularly important.
In prior art, between enterprises lan and Internet exportation, erection has safety equipment, the network message that the user of enterprise network inside accesses outside website needs to carry out url filtering through these safety equipment and determines its classification information, corresponding control strategy is performed according to classification information, such as block the internet behavior (namely blocking relevant network message) existing and threaten or alarm etc. is carried out to user, thus realizing security protection.Preserve a URL sorted table in safety equipment local cache, wherein preserve URL address and corresponding classification information.When the user of enterprise network inside accesses the page of a certain URL address, in prior art, safety equipment are taked as under type obtains classification information usually:
First safety equipment are searched local cache and whether be there is classification information for the page belonging to this URL address, wherein, the page belonging to URL address refers to Webpage pointed when user accesses this URL address, if there is no, to the classification information of the page belonging to this URL address of URL classified service device acquisition request, after URL classified service device finds the classification information of the page belonging to this URL address, the classification information of the page belonging to this URL address is replied to safety equipment, the control strategy that safety equipment are corresponding according to this classification information and executing.Then, safety equipment add the classification information of the page belonging to this URL address to local cache, and when there being user to access this URL address again, safety equipment can find the classification of its correspondence by local cache, do not need to inquire about to URL classified service device again.
But the present inventor is realizing finding in process of the present invention: what adopt for safety equipment carries out the mode of classifying for the page, because the page existed under website is a lot, such as hundreds of millions of, billions of pages, the limited amount of the page belonging to the URL address of safety equipment side buffer memory, the hit rate that the page belonging to a certain URL address searched by safety equipment in local cache is lower.
Summary of the invention
Embodiments provide a kind of lookup method of URL(uniform resource locator), filter method and relevant device and system, for improving the search efficiency of URL.
For solving the problems of the technologies described above, the embodiment of the present invention provides following technical scheme:
On the one hand, the embodiment of the present invention provides the lookup method of a kind of URL, comprising:
URL classified service device receives the Query request of the URL address that safety equipment send;
Classification information corresponding to the classification information that the URL address that described safety equipment send by described URL classified service device is corresponding and at least one other URL address and other URL addresses each sends to described safety equipment, and other URL addresses that URL address refers to from described safety equipment send described belong to same website and the URL address different with the URL address that described safety equipment send.
On the other hand, the embodiment of the present invention provides the filter method of a kind of URL, comprising:
Safety equipment receive classification information corresponding to classification information corresponding to the URL address inquired about that URL classified service device sends and at least one other URL address and other URL addresses each, and other URL addresses described refer to and belong to same website and the URL address different with the URL address that described safety equipment send from inquired about URL address;
Described safety equipment, according to classification information corresponding to described inquired about URL address and preset filtering policy, perform the response action that the classification information corresponding with described inquired about URL address is suitable;
Described safety equipment, by classification information corresponding to classification information corresponding to described inquired about URL address and described inquired about URL address and other URL addresses described and each other URL addresses described, are stored in local cache.
On the other hand, the embodiment of the present invention also provides a kind of URL classified service device, comprising:
Receiving element, for receiving the Query request of the URL address that safety equipment send;
Transmitting element, classification information corresponding to the classification information corresponding for the URL address sent by described safety equipment and at least one other URL address and other URL addresses each sends to described safety equipment, and other URL addresses that URL address refers to from described safety equipment send described belong to same website and the URL address different with the URL address that described safety equipment send.
On the other hand, the embodiment of the present invention also provides a kind of safety equipment, comprising:
Receiving element, for receiving classification information corresponding to classification information corresponding to the URL address inquired about and at least one other URL address that URL classified service device sends and other URL addresses each, other URL addresses described refer to and belong to same website and the URL address different with the URL address that described safety equipment send from inquired about URL address;
Filter element, the classification information that described the inquired about URL address for receiving according to described receiving element is corresponding and preset filtering policy, perform the response action that the classification information corresponding with described inquired about URL address is suitable;
Storage unit, for classification information corresponding to classification information corresponding to described inquired about URL address that described receiving element is received and described inquired about URL address and other URL addresses described and each other URL addresses described, be stored in local cache.
On the other hand, the embodiment of the present invention also provides a kind of url filtering system, comprising: foregoing URL classified service device and safety equipment.
As can be seen from the above technical solutions, the embodiment of the present invention has the following advantages:
In an embodiment provided by the invention, first URL classified service device receives the Query request of the URL address that safety equipment send, then the classification information that the URL address that sent by safety equipment of URL classified service device is corresponding and at least one other URL address, and classification information corresponding to other URL addresses each sends to safety equipment, then safety equipment have not only received only classification information corresponding to a URL address, also receive the classification information that at least one other URL address of belonging to same website with this URL address are corresponding, then can avoid safety equipment frequently to URL classified service device query categories information, because URL classified service device is classification information corresponding to multiple URL address to the classification information that safety equipment feed back, the search efficiency of URL can be improved.
Accompanying drawing explanation
In order to be illustrated more clearly in the technical scheme in the embodiment of the present invention, below the accompanying drawing used required in describing embodiment is briefly described, apparently, accompanying drawing in the following describes is only some embodiments of the present invention, to those skilled in the art, other accompanying drawing can also be obtained according to these accompanying drawings.
The process blocks schematic diagram of the lookup method of a kind of URL that Fig. 1 provides for the embodiment of the present invention;
The schematic diagram of the storage organization of URL address in Hash table that Fig. 2 provides for the embodiment of the present invention;
The process blocks schematic diagram of the filter method of a kind of URL that Fig. 3 provides for the embodiment of the present invention;
Interaction diagrams between a kind of URL classified service device that Fig. 4 provides for the embodiment of the present invention and safety equipment;
Interaction diagrams between the another kind of URL classified service device that Fig. 5 provides for the embodiment of the present invention and safety equipment;
The process blocks schematic diagram of the filter method of the another kind of URL that Fig. 6 provides for the embodiment of the present invention;
The composition structural representation of a kind of URL classified service device that Fig. 7 provides for the embodiment of the present invention;
The composition structural representation of a kind of safety equipment that Fig. 8 provides for the embodiment of the present invention;
The composition structural representation of a kind of url filtering system that Fig. 9 provides for the embodiment of the present invention.
Embodiment
Embodiments provide a kind of lookup method of URL(uniform resource locator), filter method and relevant device and system, for improving the search efficiency of URL.
For making goal of the invention of the present invention, feature, advantage can be more obvious and understandable, below in conjunction with the accompanying drawing in the embodiment of the present invention, technical scheme in the embodiment of the present invention is clearly and completely described, obviously, the embodiments described below are only the present invention's part embodiments, and not all embodiments.Based on the embodiment in the present invention, the every other embodiment that those skilled in the art obtains, all belongs to the scope of protection of the invention.
The lookup method of a kind of URL that the embodiment of the present invention provides, as shown in Figure 1, comprising:
101, URL classified service device receives the Query request of the URL address that safety equipment send.
Wherein, safety equipment in the embodiment of the present invention can be fire wall, router, UTM entity (UTM, Unified Threat Management) etc. the equipment in order to carry out security protection to computing machine or LAN (Local Area Network), the network message by this computing machine or LAN (Local Area Network) can be identified, block, the equipment of the process such as filtration.
In embodiments of the present invention, safety equipment resolve the network message of user's transmission according to protocol stack, then safety equipment can get the URL address that user needs to access from this network message, the Query request of this URL address initiated by safety equipment to URL classified service device according to this URL address, namely safety equipment inquire about classification information corresponding to this URL address to URL classified service device, with the classification information fed back according to URL classified service device, corresponding filtering policy is selected with preset filtering policy from the classification information inquired, the response action suitable with this classification information is performed according to filtering policy.Wherein, preset filtering policy refers to the whether addressable strategy in the URL address as belonged to certain classification arranged according to classification information, specifically can be arranged by safety equipment, such as, the page of the reality belonging to URL address can be divided into the classifications such as social activity, physical culture, game, news by URL classified service device, and which classification whether the classification information that safety equipment are corresponding according to URL address define respectively and may have access to.
In embodiments of the present invention, the Query request of this URL address initiated by safety equipment to URL classified service device according to URL address, and URL classified service device can receive the Query request of this URL address that safety equipment send.It should be noted that, that the Query request that URL classified service device receives the URL address that safety equipment send is specifically as follows as the attainable mode of one: URL classified service device receives the Query request message of the URL address that safety equipment send by internet; Or URL classified service device receives the Query request message of the URL address that safety equipment send by local area network.Namely, in embodiments of the present invention, connected mode between URL classified service device and safety equipment is specifically as follows and is coupled together by internet, or is coupled together by local area network, is described in detail in subsequent embodiment of the present invention by providing corresponding application scenarios respectively.It should be noted that, in embodiments of the present invention, if internet couples together between URL classified service device and safety equipment, then safety equipment first will by the certification of URL classified service device, authentication request is sent to URL classified service device by safety equipment, after URL classified service device passes through according to this authentication request certification, to safety equipment feedback authentication result.
Classification information corresponding to the classification information that 102, the URL address that sent by safety equipment of URL classified service device is corresponding and at least one other URL address and other URL addresses each sends to safety equipment, wherein, other URL addresses that URL address refers to from safety equipment send belong to same website and the URL address different with the URL address that safety equipment send.
Wherein, the page belonging to URL address refers to Webpage pointed when user accesses this URL address, the website belonging to Webpage pointed when website belonging to URL address refers to this URL address, belonging to URL address belonging to Webpage that same website refers to pointed by multiple URL address is same website.
In embodiments of the present invention, URL classified service device is after the Query request receiving the URL address that safety equipment send, URL classified service device is by classification information corresponding for this URL address, and at least one belonging to same website with URL address other URL addresses except this URL address, and classification information corresponding to other URL addresses each sends to safety equipment, that is, a URL sorted table is preserved in URL classified service device, wherein record each URL address and corresponding classification information, in the embodiment of the present invention, URL classified service device is except feeding back classification information corresponding to this URL address to safety equipment, at least one other URL address except this URL address that URL classified service device also will belong to same website (Host) with this URL address, and classification information corresponding to other URL addresses each sends to safety equipment, to enable safety equipment by each self-corresponding classification information in multiple URL addresses once obtained alternately under same website with URL classified service device, to avoid safety equipment frequently to URL classified service device query categories information, improve the search efficiency of URL, shortening user accesses response time during internet.
It should be noted that, in embodiments of the present invention, step 102 specifically can comprise the steps:
Whether each other URL address that the URL address that A1, URL classified service device judges and these safety equipment send belongs to same website meets prerequisite;
The classification information that the URL address that these safety equipment send by A2, URL classified service device is corresponding and belong to same website with the URL address that these safety equipment send and in the whole URL address meeting prerequisite and the whole URL addresses meeting prerequisite, each self-corresponding classification information in each URL address sends to safety equipment.
For steps A 1, URL classified service device filters out from belonging to each other URL addresses of same website with this URL address the URL address meeting prerequisite, steps A 2, URL classified service device is sent to safety equipment: classified information corresponding to this URL address, belong to same website with this URL address and each self-corresponding classification information in each URL address in the whole URL address meeting prerequisite and the whole URL addresses meeting prerequisite.Prerequisite can be set in advance by URL classified service device, also can be set in advance by safety equipment, by URL classified service device and safety equipment common setups in advance, can also not limit herein.Usually preserve in URL classified service device than more comprehensive URL address and corresponding classification information, prerequisite filters out classification information corresponding to which URL address for URL classified service device from various classification information can be sent to safety equipment, in actual applications, the setting of prerequisite can have multiple implementation, prerequisite can be at least one in following condition, or multiple combinations: different from the classification of the page belonging to the URL address inquired about that safety equipment send, greater than or equal to the priority of the URL address that these safety equipment send, there are mapping relations in the URL address sent with safety equipment.Next be described in detail respectively:
When prerequisite is for from when belonging to the URL address that these safety equipment send, the classification of the page is different, for step 102, as the attainable mode of one be, URL classified service device by classification information corresponding for URL address, and sends to safety equipment from each self-corresponding classification information in whole URL addresses that this URL address belongs to the classification of the page belonging to URL address that the different whole URL address of the classification meeting the page belonging to the URL address that sends with these safety equipment of same website and satisfied and these safety equipment send different.Wherein, prerequisite is for different from the classification of the page belonging to URL address, such as, the page of the reality belonging to URL address can be divided into social activity by URL classified service device, physical culture, game, several classification such as news, each URL address respectively corresponding classification information can represent with classification number, as classification information corresponding for URL address www.facebookkkk.com is defined as social class, classification number represents with 120, classification information corresponding for URL address www.facebookkkk.com/sports is defined as sport category, represent with classification number 130, classification information corresponding for URL address www.facebookkkk.com/games is defined as game class, represent with classification number 150, classification information corresponding for URL address www.facebookkkk.com/page.html is defined as news category, represent with classification number 160, then URL address www.facebookkkk.com, URL address www.facebookkkk.com/sports, URL address www.facebookkkk.com/games, URL address www.facebookkkk.com/page.html belongs to same website (website is called facebookkkk), then when the URL address that URL classified service device receives safety equipment transmission is www.facebookkkk.com/sports, URL classified service device is by classification information (i.e. sport category) corresponding for this URL address and belong to same website (website is all facebookkkk), the whole URL addresses different from the classification of the page belonging to this URL address, and each self-corresponding classification information in each URL address in these whole URL addresses (namely includes social class, game class, all URL of news category and the classification information that wherein each URL address is corresponding) send to safety equipment, then safety equipment are equivalent to the Query request having initiated a URL address to URL classified service device, just can obtain each self-corresponding classification information in multiple URL address, then in follow-up process, just do not need all to inquire about to URL classified service device when safety equipment need each self-corresponding classification information in multiple URL address at every turn, search efficiency can be improved, shortening user accesses response time during internet.
When prerequisite is the priority greater than or equal to the URL address of safety equipment transmission, for step 102, as the attainable mode of one be, the classification information that the URL address that safety equipment send by URL classified service device is corresponding, and belong to the whole URL addresses meeting the priority of the URL address sent greater than or equal to these safety equipment of same website with the URL address that these safety equipment send, and meet the URL address sent greater than or equal to these safety equipment priority whole URL addresses in each self-corresponding classification information in each URL address send to safety equipment.Wherein, identical or the priority of URL address that sends higher than safety equipment of the priority of the URL address that prerequisite is with safety equipment send, namely URL address can be divided into multiple priority, after URL classified service device receives the Query request of the URL address that safety equipment send, the URL address sent with safety equipment is belonged to same website by URL classified service device, whole URL addresses of the priority of the URL address sent greater than or equal to these safety equipment, and the classification information that in whole URL address, each URL address is corresponding sends to safety equipment.Such as, demand according to user will represent that the URL address of news category is divided into priority 1, to represent that the URL address of social class is divided into priority 2, to represent that the URL address of sport category is divided into priority 3, to represent that the URL address of game class is divided into priority 4 etc., priority is progressively successively decreased by 1 to 4, then when from safety equipment, to receive priority be the Query request of the URL address of 2 to URL classified service device, the URL address sent with these safety equipment is belonged to same website by URL classified service device, priority be 2 each self-corresponding classification information in whole URL addresses all send to safety equipment, or, the URL address sent with these safety equipment is belonged to same website by URL classified service device, priority is whole URL addresses of 1 and 2, and each priority be 1 or 2 each self-corresponding classification information in URL address send to safety equipment.
When prerequisite be the URL address sent with safety equipment there are mapping relations time, for step 102, as the attainable mode of one be, the classification information that the URL address that these safety equipment send by URL classified service device is corresponding and belong to same website with URL address that these safety equipment send, meet whole URL addresses that the URL address sent with these safety equipment exists mapping relations, and to meet and the URL address that sends of these safety equipment exists each self-corresponding classification information in each URL address in whole URL addresses of mapping relations and sends to safety equipment.Wherein, prerequisite is that the URL address sent with safety equipment exists mapping relations, namely the URL address for being associated between multiple URL address is defined, then URL classified service device is after the Query request receiving a URL address, and that the URL address sent with these safety equipment is belonged to same website by URL classified service device, there are mapping relations with the URL address in this classification inquiry request whole URL address and each each self-corresponding classification information in URL address that there are mapping relations with the URL address in this classification inquiry request send to safety equipment.The mapping relations of URL address refer to URL classified service device and/or safety equipment in advance to relevance relation set between multiple URL address, such as, can define between the URL address representing game class and the URL address representing sport category as there is the URL address of mapping relations, then these URL addresses are for user, all can be classified as " amusement " class, there is certain relevance, identical control strategy can be adopted to this.
It should be noted that, in embodiments of the present invention, step 102 is when specific implementation, and wherein a kind of implementation can comprise the steps:
Website belonging to the URL address acquisition URL address that B1, URL classified service device sends according to safety equipment;
B2, URL classified service device is from the Hash list be pre-created, find with the Hash table of this website record correspondence that is key assignments, wherein, Hash table comprises the classification information that in whole URL address under this website and these whole URL addresses, each URL address is corresponding;
In the classification information that the URL address that these safety equipment send by B3, URL classified service device is corresponding and this Hash table, classification information corresponding to other URL addresses and other URL addresses each sends to described safety equipment, wherein, other URL addresses that URL address refers to from safety equipment send belong to same website and the URL address different with the URL address that safety equipment send.
For step B1, after URL classified service device receives the Query request of the URL address that safety equipment send, URL classified service device can parse URL address from Query request, URL server obtains the website belonging to it based on this URL address, such as, it is www.facebookkkk.com/sports that URL classified service device parses URL address, then URL classified service device therefrom extract separator "/" before this website belonging to URL address be facebookkkk.
For step B2, URL classified service device creates Hash list using website as key assignments in advance, multiple record is preserved in this Hash list, the corresponding Hash table of each record wherein, the website different according to each sets up Hash (Hash) table, includes the whole URL address under a website and each self-corresponding classification information in a Hash table.Wherein a kind of implementation is, the Host in Hash table is with Chinese information-digest algorithm 5(MD5, Message-Digest Algorithm 5) mode preserves, and performs to Host the uniqueness that MD5 can ensure to store.It should be noted that, in embodiments of the present invention, node path representation node index in Hash table, the path data of the URL address of preserving in Hash table can be can be maybe expressly the enciphered data of deciphering, belonging to the lower URL address of preserving of each Hash table, the number of the page must not exceed predefined value number, in actual applications specifically can 256, select in the predefined values such as 512 or 1024, in order to reduce the transmission quantity of URL classified service device to safety equipment transmission data, the whole URL(s of large-scale website under this website are actually to the corresponding relation of whole URL and classification information) be no more than preset threshold value (can be such as 1024).Such as, as shown in Figure 2, Host data in Hash table represent by MD5 value, suppose that URL classified service device side includes N number of website altogether, be respectively Host1, Host2 HostN, N represents the number of website, N is natural number, URL classified service device is that key assignments establishes a Hash table with Host1, URL classified service device is that key assignments establishes a Hash table with Host2, URL classified service device is set up Hash table respectively and is constituted Hash list using each website as key assignments, the whole URL addresses under a website are included in the Hash table that each record in Hash list is corresponding, and each self-corresponding classification information in each URL address in whole URL address, as Host1 includes multiple classification as in the Hash table of key assignments, be respectively sport category, news category, mail class, in the Hash table of key assignments, multiple classification is also included using Host2, be respectively sport category, news category, mail class etc.
For step B3, the corresponding respectively classification information at least one other URL address except this URL address belonging to same website in Hash table and other URL addresses each is sent to safety equipment by URL classified service device, such as, for the Hash table shown in Fig. 2, the corresponding respectively classification information at least one of same website in the Hash table that is key assignments with this website other URL addresses except this URL address and other URL addresses each can be sent to safety equipment by URL classified service device.
In embodiment provided by the invention, first URL classified service device receives the Query request of the URL address that safety equipment send, then the classification information that the URL address that sent by safety equipment of URL classified service device is corresponding, and at least one other URL address, and classification information corresponding to other URL addresses each sends to safety equipment, then safety equipment have not only received only classification information corresponding to a URL address, also receive and to belong to same website with this URL address, the classification information that at least one other URL address except this URL address is corresponding respectively, then can avoid safety equipment frequently to URL classified service device query categories information, because URL classified service device is classification information corresponding to multiple URL address to the classification information that safety equipment feed back, the search efficiency of URL can be improved.
Above embodiment describes the lookup method of the URL realized based on URL classified service device, the filter method of the URL realized based on safety equipment side that following introduction is corresponding with this lookup method, as shown in Figure 3, the filter method of the URL that the embodiment of the present invention provides, comprising:
301, safety equipment receive classification information corresponding to classification information corresponding to the URL address inquired about that URL classified service device sends and at least one other URL address and other URL addresses each, wherein, other URL addresses refer to and belong to same website and the URL address different with the URL address that safety equipment send from inquired about URL address.
In embodiments of the present invention, safety equipment are to after URL classified service device sends the Query request of a URL address, the corresponding respectively classification information at least one other URL address except this URL address that URL classified service device sends classification information corresponding to this URL address to safety equipment and belongs to same website with this URL address and other URL addresses each, then first safety equipment receive these classification information of URL classified service device transmission.Namely in embodiments of the present invention, safety equipment can obtain each self-corresponding classification information in multiple URL addresses under same website by the Query request sending a URL address to URL classified service device, make safety equipment not need frequently to URL classified service device query categories information, improve the search efficiency of URL.
It should be noted that, in embodiments of the present invention, in the classification information that the URL address inquired about that safety equipment reception URL classified service device sends is corresponding, and belong to the corresponding respectively classification information at least one other URL address of same website and other URL addresses each with inquired about URL address, also comprise the steps: before
Safety equipment receive the network message that user sends; Safety equipment obtain URL address to be checked from this network message; Safety equipment search whether there is the classification information corresponding with this URL address according to this URL address to be checked in local cache; If classification information not corresponding with this URL address to be checked in local cache, safety equipment send the Query request of this URL address to be checked to URL classified service device.
For step 301, as wherein a kind of attainable mode be, safety equipment receive classification information corresponding to the URL address inquired about that URL classified service device sends by internet, and belong at least one other URL address of same website with inquire about URL address and corresponding classification information is distinguished in other URL addresses each, or, safety equipment receive classification information corresponding to the URL address inquired about that URL classified service device sends by local area network, and belong at least one other URL address of same website with inquired about URL address, and the classification information that other URL addresses each are corresponding respectively, that is, in embodiments of the present invention, connected mode between URL classified service device and safety equipment is specifically as follows and is coupled together by internet, or coupled together by local area network, be described in detail providing corresponding application scenarios respectively in subsequent embodiment of the present invention.It should be noted that, in embodiments of the present invention, if internet couples together between URL classified service device and safety equipment, then safety equipment first will by the certification of URL classified service device, authentication request is sent to URL classified service device by safety equipment, the identity information of described safety equipment is carried, after URL classified service device is verified according to the identity information of this authentication request, to safety equipment feedback authentication result in this authentication request.
It should be noted that, in embodiments of the present invention, safety equipment are specifically as follows url filtering safety equipment, in actual applications, the safety equipment that the embodiment of the present invention provides include but not limited to service security gateway, unified safety equipment such as threat gateway, fire wall etc., specifically can dispose according to the application scenarios of reality.
302, safety equipment are according to classification information corresponding to inquired about URL address and preset filtering policy, perform the response action that the classification information corresponding with the URL address that this is inquired about is suitable.
In embodiments of the present invention, safety equipment receive classification information corresponding to URL address that URL classified service device sends, and at least one belonging to same website with this URL address inquires about other URL addresses except URL address except this institute, and after the classification information of other URL addresses each difference correspondence, the classification information that the URL address that can inquire about according to this of safety equipment is corresponding, the response action suitable with this classification information is performed from preset filtering policy, the classification information that safety equipment are corresponding according to URL address, the filtering policy corresponding with this classification information is selected from preset filtering policy, judge whether this URL address may have access to according to the filtering policy selected, if the URL address inquired about is addressable, the URL address inquired about accessed by safety equipment network message to user is let pass, if the URL address inquired about is inaccessible, the URL address inquired about accessed by safety equipment network message to user blocks or alarm.Safety equipment perform the response action of this filtering policy requirement, just can realize the management to user's internet behavior, wherein, the preset filtering policy classification information referred to corresponding to URL address arranges this whether addressable strategy in URL address, specifically can be arranged by safety equipment, such as, the page of the reality belonging to URL address can be divided into social activity by safety equipment, physical culture, game, the classifications such as news, which classification whether the classification information that safety equipment are corresponding according to URL address define respectively and may have access to, if safety equipment are in order to forbid that user's work hours access the game class page, the page setup that then classification of the page belonging to URL address can be game class by filtering policy is inaccessible.Such as, the classification information that safety equipment are corresponding according to this URL address, the filtering policy corresponding with this classification information is selected from preset filtering policy, be forbid that user accesses to represent the URL address of game class according to the filtering policy selected, then judge that this URL address is inaccessible, safety equipment judge to represent social class according to classification information corresponding to this URL address and preset filtering policy, the URL address of news category is addressable, then when the classification information that the URL address of user's access is corresponding is game class, safety equipment block or alarm the network message that user accesses this URL address, when the classification information that the URL address of user's access is corresponding is news category, safety equipment are let pass to the network message that user accesses this URL address, realize the filtration to URL address.It should be noted that, in embodiments of the present invention, safety equipment can also for the classification information that URL address is corresponding preset multiple filtering policy, to perform the response action with this filtering policy requirement, just illustrate herein and do not limit.
303, safety equipment are by the corresponding respectively classification information in classification information corresponding to inquired about URL address and the URL address inquired about and at least one other URL address except inquired about URL address belonging to same website with inquired about URL address and other URL addresses each, are stored in local cache.
In embodiments of the present invention, at least one other URL address except the URL address inquired about described in this that safety equipment receive classification information corresponding to inquired about URL address from URL classified service device and belong to same website with inquired about URL address, after the classification information that other URL addresses each are corresponding respectively, these URL addresses and corresponding classification information are stored in local cache by safety equipment, then safety equipment just save each self-corresponding classification information in multiple URL addresses belonged to this URL address under same website in local cache, the local cache of safety equipment can keep consistent what preserve in classification information corresponding to URL address with URL classified service device.
In embodiments of the present invention, safety equipment by inquired about URL address and corresponding classification information, and after the corresponding respectively classification information in other URL addresses and other URL addresses each is stored in local cache, can also comprise the steps:
C1, safety equipment receive another network message that user sends;
C2, safety equipment obtain another URL address that user needs to access from this another network message;
Whether C3, safety equipment are searched in local cache exists the classification information corresponding with another URL address;
If C4 exists, safety equipment, according to classification information corresponding to this another URL address and preset filtering policy, perform the suitable response action of the classification information corresponding with another URL address to another network message.
For step C2, when user initiates another network message, safety equipment parse another URL address that user needs to access from another network message.For step C3, after safety equipment get another URL address, safety equipment are according to another URL address search local cache, for step C4, if preserve the classification information that another URL address is corresponding in local cache, the suitable response action of the classification information corresponding with another URL address is performed to another network message, its implementation procedure and abovementioned steps 302 similar, repeat no more herein.
For step C3, whether safety equipment are searched in local cache exists the classification information corresponding with another URL address, in actual applications, safety equipment can to another URL address segmentation, judge the record whether existed in local cache for another URL address, the foundation of segmentation can be separator "/".Such as, another URL address is www.facebookkkk.com/sports, safety equipment first can judge whether the www.facebookkkk.com before separator "/" has record in local cache, if there is no the record of www.facebookkkk.com, then there is not classification information corresponding to this another address in local cache, the Query request of URL address www.facebookkkk.com/sports is sent to URL classified service device, if there is the record of www.facebookkkk.com, judge again/whether sports have record in local cache, if there is /the record of sports, in local cache, then preserve classification information corresponding to this another URL address, if there is no/the record of sports, then using classification information that the classification information of the correspondence of website www.facebookkkk.com is corresponding as this another URL address.
It should be noted that, in embodiments of the present invention, for step 303, as the attainable mode of one be, corresponding classification information is distinguished in inquired about URL address and corresponding classification information and at least one other URL address except the URL address that this is inquired about except belonging to same website with inquired about URL address and other URL addresses each by safety equipment, be stored in local cache, specifically can comprise:
D1, safety equipment, in the Hash list created, set up the Hash table using website belonging to inquired about URL address as the record correspondence of key assignments; Or, safety equipment create Hash list in, set up using this website in the path of local cache the Hash table as the record correspondence of key assignments;
The corresponding respectively classification information in classification information corresponding to inquired about URL address and the URL address inquired about and at least one other URL address except the URL address that this is inquired about belonging to same website with inquired about URL address and other URL addresses each is stored in the Hash table of foundation by D2, safety equipment.
Two kinds of implementations are comprised for step D1, one is that safety equipment are using website as key assignments to set up Hash table, another kind be safety equipment using website in the path of local cache as key assignments to set up Hash table, next be described respectively: a kind of is that the safety equipment website different according to each sets up Hash (Hash) list, each record in Hash list is a Hash table, the whole URL addresses under a website are included in a Hash table, and the wherein each self-corresponding classification information in each URL address, this Hash table calculates cryptographic hash based on the plaintext character of website as key assignments, wherein attainable mode is, Host in Hash list preserves in middle MD5 mode, the uniqueness that MD5 can ensure storage is performed to Host.It should be noted that, in embodiments of the present invention, node path representation node index in Hash table, the path data of the URL address of preserving in Hash table can be can be maybe expressly the enciphered data of deciphering, belonging to the lower URL address of preserving of each Hash table, the number of the page must not exceed predefined value number, in actual applications specifically can 256, select in the predefined values such as 512 or 1024, in order to reduce the transmission quantity of URL classified service device to safety equipment transmission data, for the whole URLs of large-scale website under this website, and wherein each self-corresponding classification information of each URL is no more than preset threshold value (can be such as 1024), such as, as shown in Figure 2, Host data in Hash list represent with MD5, suppose that URL classified service device side includes N number of website altogether, be respectively Host1, Host2 HostN, N represents the number of website, N is natural number, URL classified service device is that key assignments establishes a Hash table with Host1, URL classified service device is that key assignments establishes a Hash table with Host2, URL classified service device sets up Hash table using each website as key assignments respectively, the whole URL addresses under a website are included in each Hash table, and the wherein each self-corresponding classification information in each URL address, as Host1 includes multiple classification as in the Hash table of key assignments, be respectively sport category, news category, mail class etc., another kind is that safety equipment are in order to improve the retrieval rate of path sections, safety equipment with website in the path of local cache for expressly, Hash table is set up in each path according to local cache, the whole URL addresses under each path are included in a Hash table, and the wherein each self-corresponding classification information in each URL address, this Hash table calculates cryptographic hash based on the plaintext character in path as key assignments, and it realizes with Fig. 2 similar, repeats no more herein.
It should be noted that, dividing of sequencing is not had in embodiments of the present invention between step 302 and step 303, step 303 is performed after first can performing step 302, also step 302 is performed after first can performing step 303, step 302 and step 303 can also be performed simultaneously, herein for illustrative purposes only, do not limit.
In the embodiment that the embodiment of the present invention provides, safety equipment receive classification information corresponding to a URL address from URL classified service device, and at least one belonging to same website with this URL address other URL addresses except this URL address, and the classification information that other URL each are corresponding respectively, that is safety equipment can the disposable multiple URL addresses received from URL classified service device same website, and the classification information that wherein each URL address is corresponding, then safety equipment can be avoided frequently to URL classified service device query categories information, improve the search efficiency of URL.
Above embodiment describes the URL lookup method realized based on URL classified service device side and the url filtering method realized based on safety equipment side respectively, next be described in detail for an actual application scenarios, refer to shown in Fig. 4, for the interaction diagrams between URL classified service device and safety equipment, shown in Fig. 4 is a kind of remote inquiry mode, connected mode between URL classified service device and safety equipment couples together according to internet (Internet), it is a kind of scene of remote deployment URL classified service device, mainly comprise following implementation procedure:
401, first safety equipment need to initiate user authentication request to URL classified service device, carry the identity information of described safety equipment in this authentication request;
402, URL classified service device according to described identity information after certification is passed through, to the result of safety equipment feedback user certification;
403, when safety equipment certification is passed through, safety equipment initiate to URL classified service device the Query request that a URL address is URLA;
404, after URL classified service device receives this classification inquiry request by classification information corresponding for URLA and with belong to the URL address URL B, URLC and URLB that meet prerequisite of same website, each self-corresponding classification information of URLC all sends to safety equipment;
405, safety equipment by the classification information of URLA and correspondence and with belong to URLB, URLC and URLB of meeting prerequisite of same website, each self-corresponding classification information of URLC is stored in local cache.
Visible, in the embodiment of the present invention, safety equipment have sent the Query request of URLA to URL classified service device, but safety equipment can receive each self-corresponding classification information of URLA, URLB, URLC under same website, then can avoid safety equipment frequently to URL classified service device query categories information, improve the search efficiency of URL.
Next be described in detail for the application scenarios of another reality, refer to shown in Fig. 5, for the interaction diagrams between URL classified service device and safety equipment, it is a kind of local search mode, connected mode between URL classified service device and safety equipment is according to local area network (LAN, Local AreaNetwork) couple together, be a kind of scene of local disposition URL classified service device, mainly comprise following implementation procedure:
501, safety equipment initiate to URL classified service device the Query request that a URL address is URLA;
502, after URL classified service device receives this classification inquiry request by classification information corresponding for URLA and with belong to the URL address URL B, URLC and URLB that meet prerequisite of same website, each self-corresponding classification information of URLC all sends to safety equipment;
503, safety equipment by classification information corresponding for URLA and with belong to URLB, URLC and URLB of meeting prerequisite of same website, each self-corresponding classification information of URLC is stored in local cache.
Visible, the key distinction of remote inquiry mode and local search mode is: remote inquiry mode needs the certification by URL classified service device when first time inquires about, remaining is basically identical with local search mode.In the embodiment of the present invention, safety equipment have sent the Query request of URLA to URL classified service device, but safety equipment can receive each self-corresponding classification information of URLA, URLB, URLC under same website, then can avoid safety equipment frequently to URL classified service device query categories information, improve the search efficiency of URL.
Next introduce the realization flow of the filter method of the URL that the embodiment of the present invention provides with an actual application examples, refer to shown in Fig. 6, the url filtering flow process that safety equipment side performs is as follows:
601, safety equipment receive user send network message, obtain from this network message user need access URL address be: nba.sports.abcdef.com.cn:8080/sub1/index.html.
602, safety equipment inquire about whether there is nba.sports.abcdef.com.cn:8080 in local cache, if existed in local cache, perform step 603; If do not existed in local cache, perform step 608.
603, safety equipment are according to node (nba.sports.abcdef.com.cn:8080) accessed path pointer in Hash table, then with this route pointer for root node retrieve in Hash table/whether sub1/index.html mate, if exact matching (exact matching refers to and mates completely with sub1/index.html), perform step 604, if can not exact matching, perform step 605.
If 604 route pointer exact matching/sub1/index.html, return the classification information that nba.sports.abcdef.com.cn:8080/sub1/index.html is corresponding, then perform step 609.
If 605 route pointers exact matching/sub1/index.html, general/sub1/index.html can not be truncated to/sub1, again with this route pointer for root node retrieve in Hash table/whether sub1 mate, if coupling, perform step 606, if can not mate, perform step 607.
If 606 match/sub1 completely, return/classification information that sub1 is corresponding, classification information corresponding to general/sub1, as classification information corresponding to nba.sports.abcdef.com.cn:8080/sub1/index.html, then performs step 609.Such as: if comprise/sub1 in route pointer, / sub1/index, these three records of/sub1/index.html1, according to the mode of the longest coupling, the record of coupling is /sub1/index.html1, but this record is not exact matching, needs rebound to be /sub1/index to last coupling place, but this record neither exact matching, need upwards to jump again once namely using classification information corresponding to/sub1 as classification information corresponding to sub1/index.html to be checked.
If 607 can not match/sub1 completely, return the classification information that website belonging to nba.sports.abcdef.com.cn:8080/sub1/index.html is corresponding, using classification information corresponding for this website as classification information corresponding to nba.sports.abcdef.com.cn:8080/sub1/index.html, then perform step 609.Such as: if only comprise/sub in route pointer, these two records of/sub1/index, according to the mode of the longest coupling, the record of coupling is /sub1/index, but this record is not exact matching, need rebound to last coupling place/sub, but/sub neither exact matching, need upwards to jump once again, namely using classification information corresponding to website as classification information corresponding to sub1/index.html to be checked.
608, safety equipment send the Query request of nba.sports.abcdef.com.cn:8080/sub1/index.html to URL classified service device, this poll-final of safety equipment side.
609, safety equipment are according to the classification information got and preset classification policy, perform and the suitable response action of this filtering policy, user needed to the network message of the URL address nba.sports.abcdef.com.cn:8080/sub1/index.html accessed blocks, the action such as alarm or prompting.
It should be noted that, in embodiments of the present invention, for classification information corresponding to step 606 general/sub1 as classification information corresponding to nba.sports.abcdef.com.cn:8080/sub1/index.html, for step 607 using classification information corresponding for website as classification information corresponding to nba.sports.abcdef.com.cn:8080/sub1/index.html, these can improve the probability that URL address finds the classification information of its correspondence in local cache, reduce safety equipment to URL classified service device query categories information, improve the search efficiency of URL.
Next introduce the URL classified service device that the embodiment of the present invention provides, as Fig. 7, URL classified service device 700, comprising:
Receiving element 701, for receiving the Query request of the URL address that safety equipment send;
Transmitting element 702, classification information corresponding to the classification information corresponding for the URL address sent by safety equipment and at least one other URL address and other URL addresses each sends to safety equipment, wherein, other URL addresses that URL address refers to from safety equipment send belong to same website and the URL address different with the URL address that safety equipment send.
It should be noted that, for receiving element 701, as the attainable mode of one be, receiving element 701, specifically for being received the Query request of the URL address that safety equipment send by internet; Or, the Query request of the URL address that safety equipment send is received by local area network.
It should be noted that, in embodiments of the present invention, receiving element 701, also for receiving the authentication request that safety equipment send; Transmitting element 702, also for feeding back authentication result to safety equipment.
It should be noted that the transmitting element 702 that the embodiment of the present invention provides as the attainable mode of one is, transmitting element 702 specifically can comprise (not shown in Figure 7):
Judgment sub-unit, for judging whether each other URL addresses that the URL address sent with these safety equipment belongs to same website meet prerequisite;
First sends subelement, the classification information that the URL for being sent by these safety equipment is corresponding and with the whole URL address meeting prerequisite that this URL address belongs to same website and meet prerequisite whole URL addresses in classification information corresponding to each URL address send to safety equipment.
The transmitting element 702 that the embodiment of the present invention provides, as the attainable mode of another kind is, transmitting element 702 specifically can comprise (not shown in Figure 7):
First obtains subelement, for the website belonging to the URL address acquisition URL address that sends according to safety equipment;
Second obtains subelement, for from the Hash list be pre-created, find with the Hash table of the first to obtain this website that subelement obtains be key assignments record correspondence, wherein, Hash table comprises classification information corresponding to whole URL address under this website and each URL address all in URL address;
Second sends subelement, the classification information corresponding for the URL address sent by safety equipment and second obtains classification information corresponding to other URL addresses and other URL addresses each in the Hash table that subelement obtains and sends to safety equipment, wherein, the URL address that other URL refer to from safety equipment send belongs to same website and the URL address different with the URL address that safety equipment send.
It should be noted that, the content such as information interaction, implementation between each unit/subelement of said apparatus, due to the inventive method embodiment based on same design, its technique effect brought is identical with the inventive method embodiment, particular content see describing in the aforesaid embodiment of the method for the present invention, can repeat no more herein.
In embodiment provided by the invention, first the receiving element of URL classified service device receives the Query request of the URL address that safety equipment send, then the classification information that the URL address that sent by these safety equipment of the transmitting element of URL classified service device is corresponding and at least one other URL address, and classification information corresponding to other URL addresses each sends to safety equipment, then safety equipment have not only received only classification information corresponding to a URL address, the classification information also receiving at least one other URL address except this URL address of belonging to same website with this URL address corresponding respectively sends to safety equipment, then can avoid safety equipment frequently to URL classified service device query categories information, because URL classified service device is classification information corresponding to multiple URL address to the classification information that safety equipment feed back, the search efficiency of URL can be improved.
Above embodiment describes the URL classified service device that the embodiment of the present invention provides, and next introduces a kind of safety equipment that the embodiment of the present invention provides, and as shown in Figure 8, the safety equipment 800 that the embodiment of the present invention provides, comprising:
Receiving element 801, for receiving classification information corresponding to classification information corresponding to the URL address inquired about and at least one other URL address that URL classified service device sends and other URL addresses each, wherein, other URL addresses refer to and belong to same website and the URL address different with the URL address that safety equipment send from inquired about URL address;
Filter element 802, the safety equipment received for receiving element 801, according to classification information corresponding to inquired about URL address and preset filtering policy, perform the response action that the classification information corresponding with the URL address that this is inquired about is suitable;
Storage unit 803, for classification information corresponding to classification information corresponding to the URL address inquired about that received by receiving element 801 and the URL address inquired about and other URL addresses and other URL addresses each, is stored in local cache.
It should be noted that, for storage unit 803, as the attainable mode of one be, storage unit 803 specifically can comprise following structure (not shown in Figure 8):
Create subelement, in the Hash list created, set up the Hash table using website belonging to inquired about URL address as the record correspondence of key assignments; Or, in the Hash list created, to set up using website belonging to inquired about URL address in the path of local cache as the Hash table of the record correspondence of key assignments;
Storing sub-units, for the classification information by classification information corresponding with the URL address inquired about for inquired about URL address and other URL addresses and other URL addresses each difference correspondence, is stored in the Hash table creating subelement foundation.
It should be noted that, the content such as information interaction, implementation between each unit/subelement of said apparatus, due to the inventive method embodiment based on same design, its technique effect brought is identical with the inventive method embodiment, particular content see the present invention as describing in preceding method embodiment, can repeat no more herein.
In the embodiment that the embodiment of the present invention provides, the receiving element of safety equipment receives classification information corresponding to classification information corresponding to URL address and at least one other URL address and other URL addresses each from URL classified service device, that is safety equipment can the disposable classification information corresponding from multiple URL addresses that URL classified service device receives same website, then safety equipment can be avoided frequently to URL classified service device query categories information, improve the search efficiency of URL.
Above embodiment describes the URL classified service device and safety equipment that the embodiment of the present invention provides, and next introduce a kind of url filtering system, refer to shown in Fig. 9, the url filtering system 900 that the embodiment of the present invention comprises, comprising:
URL classified service device 901 as shown in earlier figures 7 and the safety equipment 902 as shown in earlier figures 8.
It should be noted that, the contents such as the information interaction between said apparatus, implementation, due to the inventive method embodiment based on same design, its technique effect brought is identical with the inventive method embodiment, particular content see the present invention as describing in preceding method embodiment, can repeat no more herein.
In embodiment provided by the invention, first the receiving element of URL classified service device receives the Query request of the URL address that safety equipment send, then the transmitting element of URL classified service device is by classification information corresponding for this URL address, and at least one other URL address, and classification information corresponding to other URL addresses each sends to safety equipment, then safety equipment have not only received only classification information corresponding to a URL address, the classification information also receiving at least one other URL address except this URL address of belonging to same website with this URL address corresponding respectively sends to safety equipment, then can avoid safety equipment frequently to URL classified service device query categories information, improve the search efficiency of URL.
One of ordinary skill in the art will appreciate that all or part of step realized in above-described embodiment method is that the hardware that can carry out instruction relevant by program completes, described program can be stored in a kind of computer-readable recording medium, the above-mentioned storage medium mentioned can be ROM (read-only memory), disk or CD etc.
Above the lookup method of a kind of URL(uniform resource locator) provided by the present invention, filter method and relevant device and system are described in detail, for one of ordinary skill in the art, according to the thought of the embodiment of the present invention, all will change in specific embodiments and applications, in sum, this description should not be construed as limitation of the present invention.

Claims (12)

1. a lookup method for uniform resource position mark URL, is characterized in that, described method is used for the classification of URL classified service device to safety equipment feedback URL address, comprising:
Described URL classified service device receives the Query request of the URL address that described safety equipment send;
Classification information corresponding to the classification information that the URL address that described safety equipment send by described URL classified service device is corresponding and at least one other URL address and other URL addresses each sends to described safety equipment, other URL addresses that URL address refers to from described safety equipment send described belong to same website and the URL address different with the URL address that described safety equipment send, to enable described safety equipment by each self-corresponding classification information in multiple URL addresses once obtained alternately under same website with described URL classified service device.
2. method according to claim 1, it is characterized in that, classification information corresponding to the classification information that the URL address that described safety equipment send by described URL classified service device is corresponding and at least one other URL address and other URL addresses each sends to described safety equipment, comprising:
Whether each other URL addresses that the URL address that described URL classified service device judges and described safety equipment send belongs to same website meet prerequisite;
The classification information that the URL address that described safety equipment send by described URL classified service device is corresponding and belong to same website with described URL address and meet whole URL address of prerequisite and describedly meet each self-corresponding classification information in each URL address in whole URL addresses of prerequisite and send to described safety equipment.
3. method according to claim 2, it is characterized in that, described prerequisite is at least one in following condition or multiple combinations: the priority of URL address that is different from the classification of the page belonging to the URL address inquired about that described safety equipment send, that send greater than or equal to described safety equipment, the URL address sent with described safety equipment exist mapping relations.
4. method according to claim 1, it is characterized in that, classification information corresponding to the classification information that the URL address that described safety equipment send by described URL classified service device is corresponding and at least one other URL address and other URL addresses each sends to described safety equipment, comprising:
Website described in the URL address acquisition that described URL classified service device sends according to described safety equipment belonging to URL address;
Described URL classified service device is from the Hash list be pre-created, find with the Hash table of the described website record correspondence that is key assignments, described Hash table comprises the classification information that in the whole URL address under described website and the whole URL addresses under described website, each URL address is corresponding;
In the classification information that the URL address that described safety equipment send by described URL classified service device is corresponding and described Hash table, classification information corresponding to other URL addresses and other URL addresses each sends to described safety equipment, and other URL addresses that URL address refers to from described safety equipment send described belong to same website and the URL address different with the URL address that described safety equipment send.
5. a filter method of URL, is characterized in that, described method is used for safety equipment and conducts interviews control to network message, comprising:
Described safety equipment receive described network message and obtain URL address from described network messages;
Described safety equipment send the Query request of described URL address to URL classified service device;
Described safety equipment receive classification information corresponding to classification information corresponding to the URL address inquired about and at least one other URL address that described URL classified service device sends and other URL addresses each, and other URL addresses described refer to and belong to same website and the URL address different with the URL address that described safety equipment send from inquired about URL address;
Described safety equipment are according to classification information corresponding to described inquired about URL address and preset filtering policy, perform the response action that the classification information corresponding with described inquired about URL address is suitable, described response action comprises lets pass to described network message, blocks or alarm described network message;
Described safety equipment, by classification information corresponding to classification information corresponding to described inquired about URL address and described inquired about URL address and other URL addresses described and each other URL addresses described, are stored in local cache.
6. method according to claim 5, it is characterized in that, described safety equipment are by the corresponding respectively classification information in classification information corresponding to described inquired about URL address and described inquired about URL address and other URL addresses described and each other URL addresses described, be stored in local cache, comprise:
Described safety equipment, in the Hash list created, set up the Hash table using website belonging to described inquired about URL address as the record correspondence of key assignments; Or, in the Hash list created, to set up using website belonging to described inquired about URL address in the path of local cache as the Hash table of the record correspondence of key assignments;
Described safety equipment, by the corresponding respectively classification information in classification information corresponding to described inquired about URL address and described inquired about URL address and other URL addresses described and each other URL addresses described, are stored in the Hash table of foundation.
7. a URL classified service device, is characterized in that, described URL classified service device is used for, to the classification of safety equipment feedback URL address, comprising:
Receiving element, for receiving the Query request of the URL address that described safety equipment send;
Transmitting element, classification information corresponding to the classification information corresponding for the URL address sent by described safety equipment and at least one other URL address and other URL addresses each sends to described safety equipment, other URL addresses that URL address refers to from described safety equipment send described belong to same website and the URL address different with the URL address that described safety equipment send, to enable described safety equipment by each self-corresponding classification information in multiple URL addresses once obtained alternately under same website with described URL classified service device.
8. URL classified service device according to claim 7, it is characterized in that, described transmitting element comprises:
Judgment sub-unit, for judging whether each other URL addresses that the URL address sent with described safety equipment belongs to same website meet prerequisite;
First sends subelement, the classification information that the URL for being sent by described safety equipment is corresponding and with described URL address belong to same website and meet whole URL address of prerequisite and describedly meet each self-corresponding classification information in each URL address in whole URL addresses of prerequisite and send to described safety equipment.
9. URL classified service device according to claim 7, it is characterized in that, described transmitting element comprises:
First obtains subelement, for the website belonging to URL address described in the URL address acquisition that sends according to described safety equipment;
Second obtains subelement, for from the Hash list be pre-created, find with the Hash table of the described first to obtain described website that subelement obtains be key assignments record correspondence, described Hash table comprises classification information corresponding to the whole URL address under described website and each URL address in described whole URL address;
Second sends subelement, the classification information corresponding for the URL address sent by described safety equipment and described second obtains classification information corresponding to other URL addresses and other URL addresses each in the described Hash table that subelement obtains and sends to described safety equipment, and other URL addresses that URL address refers to from described safety equipment send described belong to same website and the URL address different with the URL address that described safety equipment send.
10. safety equipment, is characterized in that, described safety equipment are used for conducting interviews control to network message,
Described safety equipment, for receiving described network message and obtain URL address from described network message, send the Query request of described URL address to URL classified service device;
Described safety equipment comprise:
Receiving element, for receiving classification information corresponding to classification information corresponding to the URL address inquired about and at least one other URL address that URL classified service device sends and other URL addresses each, other URL addresses described refer to and belong to same website and the URL address different with the URL address that described safety equipment send from inquired about URL address;
Filter element, the classification information that described the inquired about URL address for receiving according to described receiving element is corresponding and preset filtering policy, perform the response action that the classification information corresponding with described inquired about URL address is suitable;
Storage unit, for classification information corresponding to classification information corresponding to described inquired about URL address that described receiving element is received and described inquired about URL address and other URL addresses described and each other URL addresses described, be stored in local cache.
11. safety equipment according to claim 10, is characterized in that, described storage unit comprises:
Create subelement, in the Hash list created, set up the Hash table using website belonging to described inquired about URL address as the record correspondence of key assignments; Or, in the Hash list created, to set up using website belonging to described inquired about URL address in the path of local cache as the Hash table of the record correspondence of key assignments;
Storing sub-units, for by the corresponding respectively classification information in classification information corresponding to described inquired about URL address and described inquired about URL address and other URL addresses described and each other URL addresses described, be stored in the Hash table that described establishment subelement sets up.
12. 1 kinds of url filtering systems, is characterized in that, comprising: the URL classified service device according to any one of claim 7 to 9, and the safety equipment as described in claim 10 or 11.
CN201210173813.1A 2012-05-30 2012-05-30 The lookup method of URL(uniform resource locator), filter method and relevant device and system Active CN102737119B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201210173813.1A CN102737119B (en) 2012-05-30 2012-05-30 The lookup method of URL(uniform resource locator), filter method and relevant device and system

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201210173813.1A CN102737119B (en) 2012-05-30 2012-05-30 The lookup method of URL(uniform resource locator), filter method and relevant device and system

Publications (2)

Publication Number Publication Date
CN102737119A CN102737119A (en) 2012-10-17
CN102737119B true CN102737119B (en) 2015-07-29

Family

ID=46992620

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201210173813.1A Active CN102737119B (en) 2012-05-30 2012-05-30 The lookup method of URL(uniform resource locator), filter method and relevant device and system

Country Status (1)

Country Link
CN (1) CN102737119B (en)

Families Citing this family (13)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103297523B (en) * 2013-05-31 2017-04-19 汉柏科技有限公司 Site-based security gateway linkage method and device
CN104243418A (en) * 2013-06-18 2014-12-24 富泰华工业(深圳)有限公司 Information intercepting system and method
EP3047405A4 (en) * 2014-05-30 2017-07-19 Beestripe LLC Method of redirecting search queries from an untrusted search engine to a trusted search engine
CN105591997B (en) * 2014-10-20 2019-04-09 杭州迪普科技股份有限公司 A kind of URL classification filter method and device
CN104298774B (en) * 2014-10-31 2018-04-03 北京思特奇信息技术股份有限公司 A kind of method and system using functional query Hash table
CN105119917B (en) * 2015-08-21 2018-03-06 福建天晴数码有限公司 Strengthen the method and system of Information Security
CN105786981B (en) * 2016-02-15 2019-05-17 南京贝伦思网络科技股份有限公司 Host and URL keyword strategy matching method based on Hash table
CN106599177B (en) * 2016-12-12 2020-02-14 国云科技股份有限公司 Advertisement page shielding processing method
CN107277105A (en) * 2017-05-08 2017-10-20 北京北信源软件股份有限公司 Game auditing method and device based on BlueDrama
CN108337259A (en) * 2018-02-01 2018-07-27 南京邮电大学 A kind of suspicious web page identification method based on HTTP request Host information
CN108536604B (en) * 2018-04-19 2021-05-25 北京奇安信科技有限公司 Method and terminal for testing response time of WEB page
CN111177719A (en) * 2019-08-13 2020-05-19 腾讯科技(深圳)有限公司 Address category determination method, device, computer-readable storage medium and equipment
CN116226260B (en) * 2022-12-21 2023-10-03 安徽大学江淮学院 Big data decision method, system and cloud service center

Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101241501A (en) * 2008-02-25 2008-08-13 浪潮电子信息产业股份有限公司 File system construction method suitable for high speed cache proxy server architecture
CN102402518A (en) * 2010-09-09 2012-04-04 中国移动通信有限公司 Method and device for accessing webpage

Family Cites Families (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20010044849A1 (en) * 2000-05-16 2001-11-22 Awele Ndili System for providing network content to wireless devices

Patent Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101241501A (en) * 2008-02-25 2008-08-13 浪潮电子信息产业股份有限公司 File system construction method suitable for high speed cache proxy server architecture
CN102402518A (en) * 2010-09-09 2012-04-04 中国移动通信有限公司 Method and device for accessing webpage

Also Published As

Publication number Publication date
CN102737119A (en) 2012-10-17

Similar Documents

Publication Publication Date Title
CN102737119B (en) The lookup method of URL(uniform resource locator), filter method and relevant device and system
CN104283843B (en) A kind of method, apparatus and system that user logs in
CN102857493B (en) Content filtering method and device
US9509752B2 (en) Method, device and system for controlling web page access
WO2018121331A1 (en) Attack request determination method, apparatus and server
CN112600868B (en) Domain name resolution method, domain name resolution device and electronic equipment
CN105208026A (en) Hostile attack preventing method and network system
CN105591997B (en) A kind of URL classification filter method and device
CN104125209A (en) Malicious website prompt method and router
CN102110132A (en) Uniform resource locator matching and searching method, device and network equipment
CN102971732A (en) System architecture for integrated hierarchical query processing for key/value stores
CN104243472A (en) Network with MAC table overflow protection
CN109729044B (en) Universal internet data acquisition reverse-crawling system and method
CN108881354A (en) A kind of pushed information storage method, device, server and computer storage medium
WO2012151843A1 (en) Ulr filtering system, method and gateway
CN104618388B (en) Fast registration login method and corresponding resetting server, information server
CN102006286A (en) Access management method, device and system as well as access device for information system
CN103916379A (en) CC attack identification method and system based on high frequency statistics
CN104113525A (en) Method and apparatus for defending resource consumption type Web attacks
CN102970391B (en) Inquiry of the domain name processing method, server and system
CN102754488A (en) User access control method, apparatus and system
CN106060006A (en) Access method and device
CN104009999B (en) Prevent method, device and network access server that ARP is cheated
CN103685318B (en) Data processing method and device for network safety prevention
CN104579939A (en) Protecting method and device for gateway

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
C14 Grant of patent or utility model
GR01 Patent grant