CN104144170A - URL filtering method, device and system - Google Patents
URL filtering method, device and system Download PDFInfo
- Publication number
- CN104144170A CN104144170A CN201410422953.7A CN201410422953A CN104144170A CN 104144170 A CN104144170 A CN 104144170A CN 201410422953 A CN201410422953 A CN 201410422953A CN 104144170 A CN104144170 A CN 104144170A
- Authority
- CN
- China
- Prior art keywords
- web page
- page address
- database
- local cache
- clouds
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Landscapes
- Information Transfer Between Computers (AREA)
- Computer And Data Communications (AREA)
Abstract
The invention discloses a URL filtering method, device and system. The URL filtering method comprises the steps that a URL request is received; the URL requested in the URL request is obtained; a local cache database is searched for, so that whether the URL is stored in the local cache database or not is judged; when it is determined that the URL is stored in the local cache database, a cloud database is searched for, so that the processing mode of the corresponding URL is obtained from the cloud database, wherein the processing modes of different URLs are stored in the cloud database; the URL is filtered according to the obtained processing mode. According to the URL filtering method, device and system, the problem that in the prior art, a URL filtering scheme is low in safety is solved, and thus the effect of improving filtering safety of the URLs is achieved; moreover, the cloud database can be searched for without occupying CPU resources of a gateway device, and the effect of avoiding influencing gateway data packet forwarding efficiency is achieved.
Description
Technical field
The present invention relates to network safety filed, in particular to a kind of filter method, device and system of web page address.
Background technology
In the transmitting procedure of network data, by carrying out the filtration of web page address, to realize green internet function, the mode of carrying out web page address filtration in prior art is normally utilized the URL of gateway local (Uniform/Universal Resource Locator, URL(uniform resource locator), be also referred to as web page address, be called for short URL) storehouse carries out, need to be at gateway memory URL class library, but the limited memory headroom of gateway cannot be stored the URL class library of magnanimity level, this has just limited the covering scope of URL class library, and cannot ensure that URL storehouse is up-to-date all the time, cause the fail safe of carrying out web page address filtration to reduce, and, URL class library is searched resources such as expending gateway CPU, checking affects the forward efficiency of gateway packet.
For the lower problem of fail safe of web page address filtering scheme in correlation technique, effective solution is not yet proposed at present.
Summary of the invention
Main purpose of the present invention is to provide a kind of filter method, device and system of web page address, to solve the lower problem of fail safe of web page address filtering scheme in prior art.
A kind of filter method of web page address is provided according to an aspect of the present invention.
Comprise according to the filter method of web page address of the present invention: receive web page address request; Obtain the web page address of asking in described web page address request; Inquiry local cache database, to judge whether described web page address is stored in described local cache database; Judging described web page address in being stored in described local cache database in the situation that, search high in the clouds database, to obtain the processing mode of corresponding described web page address from the database of described high in the clouds, wherein, in the database of described high in the clouds, store the processing mode of different web pages address; And according to the processing mode getting, described web page address is filtered.
Further, obtain the processing mode of corresponding described web page address from the database of described high in the clouds after, described filter method also comprises: the processing mode getting is sent to described local cache database; Upgrade described local cache database.
Further, after obtaining the web page address of asking in described web page address request, described filter method also comprises: the MD5 code that calculates described web page address, judge whether described web page address is stored in described local cache database and comprises: judge whether described MD5 code is stored in described local cache database, search high in the clouds database, comprise with the processing mode of obtaining corresponding described web page address from the database of described high in the clouds: search high in the clouds database, to obtain the processing mode of corresponding described MD5 code from the database of described high in the clouds.
Further, before receiving web page address request, or after receiving web page address request, described filter method also comprises: receive and set instruction; And set the memory space of described local cache database according to described setting instruction.
A kind of filter of web page address is provided according to a further aspect in the invention.
Comprise according to the filter of web page address of the present invention: the first receiving element, for receiving web page address request; The first acquiring unit, the web page address of asking for obtaining described web page address request; Judging unit, for inquiring about local cache database, to judge whether described web page address is stored in described local cache database; Second acquisition unit, for judging described web page address for be stored in described local cache database in the situation that, search high in the clouds database, to obtain the processing mode of corresponding described web page address from the database of described high in the clouds, wherein, in the database of described high in the clouds, store the processing mode of different web pages address; And filter element, for the processing mode according to getting, described web page address is filtered.
Further, described filter also comprises: transmitting element, for the processing mode getting being sent to described local cache database; Updating block, for upgrading described local cache database.
Further, described filter also comprises: computing unit, for calculating the MD5 code of described web page address, described judging unit comprises: judge module, be used for judging whether described MD5 code is stored in described local cache database, described second acquisition unit comprises: acquisition module, and for searching high in the clouds database, to obtain the processing mode of corresponding described MD5 code from the database of described high in the clouds.
Further, described filter also comprises: the second receiving element, for receiving setting instruction; And setup unit, for set the memory space of described local cache database according to described setting instruction.
A kind of filtration system of web page address is provided according to a further aspect in the invention.
Comprise that according to the filtration system of web page address of the present invention web page address inquiring client terminal, web page address upgrade client and web page address cloud server, wherein, described web page address inquiring client terminal has local cache database, described web page address cloud server has high in the clouds database: described web page address inquiring client terminal is used for receiving web page address request, from described web page address request, obtain asked web page address, and inquire about described local cache database, to judge whether described web page address is stored in described local cache database; Described web page address upgrades client for judging described web page address at described web page address inquiring client terminal for be stored in described local cache database in the situation that, search described high in the clouds database, to obtain the processing mode of corresponding described web page address from the database of described high in the clouds, and according to the processing mode getting, described web page address is filtered, wherein, in the database of described high in the clouds, store the processing mode of different web pages address.
In the present invention, adopt the web page address request that receives; Obtain the web page address of asking in described web page address request; Inquiry local cache database, to judge whether described web page address is stored in described local cache database; Judging described web page address in being stored in described local cache database in the situation that, search high in the clouds database, to obtain the processing mode of corresponding described web page address from the database of described high in the clouds, wherein, in the database of described high in the clouds, store the processing mode of different web pages address; And according to the processing mode getting, described web page address is filtered.By access high in the clouds database, realize in local cache database in a limited number of situations of URL, can be from high in the clouds data base querying to the processing mode to web page address, avoid causing because URL class library is limited the fail safe that web page address filters to reduce, solve the lower problem of fail safe of web page address filtering scheme in prior art, and then reach and improve web page address and filter the effect of fail safe, and, the inquiry of carrying out high in the clouds database does not need to take the cpu resource of gateway device, has reached the effect of avoiding affecting gateway package forward efficiency.
Brief description of the drawings
The accompanying drawing that forms the application's a part is used to provide a further understanding of the present invention, and schematic description and description of the present invention is used for explaining the present invention, does not form inappropriate limitation of the present invention.In the accompanying drawings:
Fig. 1 is according to the schematic diagram of the filtration system of the web page address of the embodiment of the present invention;
Fig. 2 is according to the flow chart of the filter method of the web page address of the embodiment of the present invention;
Fig. 3 is the flow chart of the filter method of web page address according to the preferred embodiment of the invention;
Fig. 4 is the interior tissue mode schematic diagram according to the applied MD5 code of the filter method of the web page address of the embodiment of the present invention; And
Fig. 5 is according to the schematic diagram of the filter of the web page address of the embodiment of the present invention.
Embodiment
In order to make those skilled in the art person understand better the present invention program, below in conjunction with the accompanying drawing in the embodiment of the present invention, technical scheme in the embodiment of the present invention is clearly and completely described, obviously, described embodiment is only the embodiment of a part of the present invention, instead of whole embodiment.Based on the embodiment in the present invention, those of ordinary skill in the art, not making the every other embodiment obtaining under creative work prerequisite, should belong to the scope of protection of the invention.
It should be noted that, term " first ", " second " etc. in specification of the present invention and claims and above-mentioned accompanying drawing are for distinguishing similar object, and needn't be used for describing specific order or precedence.The data that should be appreciated that such use suitably can exchanged in situation, so as embodiments of the invention described herein can with except diagram here or describe those order enforcement.In addition, term " comprises " and " having " and their any distortion, intention is to cover not exclusive comprising, for example, those steps or unit that process, method, system, product or the equipment that has comprised series of steps or unit is not necessarily limited to clearly list, but can comprise clearly do not list or for these processes, method, product or equipment intrinsic other step or unit.
In the situation that not conflicting, the feature in embodiment and embodiment in the application can combine mutually.Describe below with reference to the accompanying drawings and in conjunction with the embodiments the present invention in detail.
Embodiment 1
According to the embodiment of the present invention, provide a kind of for implementing the filtration system of web page address of filter method of the application's web page address, the filtration system of this web page address is mainly used in carrying out the filter method of the web page address that the embodiment of the present invention provides, below the filtration system of web page address that the embodiment of the present invention is provided do concrete introduction:
Fig. 1 is according to the schematic diagram of the filtration system of the web page address of the embodiment of the present invention, as shown in Figure 1, the filtration system of this web page address mainly comprises that web page address inquiring client terminal 100, web page address upgrade client 200 and web page address cloud server 300, wherein, web page address inquiring client terminal 100 has local cache database (URL CACHE), web page address cloud server has high in the clouds database (URL), and the principle of filtration that the filtration system of the web page address that the embodiment of the present invention provides is carried out web page address is as follows:
Web page address inquiring client terminal 100 is for receiving web page address request, from web page address request, obtain asked web page address, , get asked URL, and inquire about local cache database, to judge whether web page address is stored in local cache database, in embodiments of the present invention, local cache database stores multiple URL, and store the classified information one to one with each URL institute, and the configuration information corresponding with classified information, for certain URL, configuration information is corresponding thereto for representing whether load the webpage that this URL is corresponding, also be, configuration information represents the processing mode of URL, such as: be that buffer memory is waited for URL, denied access URL, or directly access URL.
Web page address upgrades client 200 for judging web page address at web page address inquiring client terminal 100 for be stored in local cache database in the situation that, search high in the clouds database, to obtain the processing mode of corresponding web page address from the database of high in the clouds, and according to the processing mode getting, web page address is filtered, wherein, in the database of high in the clouds, store the processing mode of different web pages address, the URL class library that high in the clouds database is stored for cloud server, the URL that the quantity of the URL that this database is stored is stored considerably beyond gateway local, equally, in database, also store beyond the clouds the classified information one to one with each URL institute, and the processing mode corresponding with classified information (, configuration information).According to the processing mode getting, web page address being filtered, is to determine whether according to the processing mode of obtaining the webpage that Web page loading address is corresponding
The filtration system of the web page address that the embodiment of the present invention provides, by access high in the clouds database, realize in local cache database in a limited number of situations of URL, can be from high in the clouds data base querying to the processing mode to web page address, avoid causing because URL class library is limited the fail safe that web page address filters to reduce, solve the lower problem of fail safe of web page address filtering scheme in prior art, and then reach and improve web page address and filter the effect of fail safe, and, the inquiry of carrying out high in the clouds database does not need to take the cpu resource of gateway device, reach the effect of avoiding affecting gateway package forward efficiency.
Further, web page address upgrades client 200 also for the processing mode getting is sent to local cache database, then, upgrade local cache database, carry out web page address inquiry during so that follow-up, can directly utilize local cache database to inquire about, wherein, utilize local cache database to inquire about, have advantages of that inquiry velocity is fast.
In embodiments of the present invention, can store conventional top10000 bar URL and inquire about recently the URL upgrading at local cache database, so both ensure the hit rate of local search, avoid again taking too many memory headroom.
Further, web page address inquiring client terminal 100 can also first calculate the MD5 code of web page address, accordingly, follow-uply carry out the inquiry of web page address and obtaining of processing mode according to MD5 code,, judge whether MD5 code is stored in local cache database, searches high in the clouds database, to obtain the processing mode of corresponding MD5 code from the database of high in the clouds.
Due to the length difference of different web page addresses, carrying out in query script, longer web page address will expend longer query time, and the length of the MD5 code calculating is fixed, and therefore, by utilizing MD5 code to inquire about, can improve comparison efficiency.
Can find out by above description, web page address inquiring client terminal 100 is responsible for according to the specific URL importing into, and inquiry CACHE storehouse, for called side is classified under returning to URL.For the URL can not find out, be responsible for being submitted to web page address and upgrade client 200, and the URL Cache item that web page address renewal client 200 is newly issued provides the renewal service of URL Cache.
Web page address upgrades client 200 provides the initial download in URL storehouse, the loading in local Cache storehouse.From dynamic response kernel URL inquiry request, and be submitted to web page address cloud server 300.The URL classified information that web page address cloud server 300 is returned, is handed down to web page address inquiring client terminal 100, completes the renewal to Cache storehouse.
Web page address cloud server 300 can carry out the inquiry of classifying under License checking, specific URL, the download in URL storehouse.
For strengthening network adaptability, in the filtration system of the network address providing in the embodiment of the present invention, web page address cloud server 300 can provide telecommunications, UNICOM, education three line supports, can meet most of user's demand, and user can select flexibly according to Virtual network operator.
Embodiment 2
According to the embodiment of the present invention, a kind of embodiment of the method that can be implemented or be carried out by the application's device embodiment can be provided, it should be noted that, can in the computer system such as one group of computer executable instructions, carry out in the step shown in the flow chart of accompanying drawing, and, although there is shown logical order in flow process, in some cases, can carry out shown or described step with the order being different from herein.
According to the embodiment of the present invention, a kind of filter method of web page address is provided, below the filter method of web page address that the embodiment of the present invention is provided do concrete introduction:
Fig. 2 is according to the flow chart of the filter method of the web page address of the embodiment of the present invention, and as shown in Figure 2, the method comprises that following step S201 is to step S209:
S201: receive web page address request, particularly, in the time that user wants to carry out web page access, can get by browser user's web page address request.
S203: obtain the web page address of asking in web page address request, that is, get asked URL.
S205: inquiry local cache database, to judge whether web page address is stored in local cache database, wherein, local cache database (cache) refers to the URL class library that gateway local is stored, in embodiments of the present invention, local cache database stores multiple URL, and store the classified information one to one with each URL institute, and the configuration information corresponding with classified information, for certain URL, configuration information is corresponding thereto for representing whether load the webpage that this URL is corresponding, also be, configuration information represents the processing mode of URL, such as: be that buffer memory is waited for URL, denied access URL, or directly access URL.
S207: judging web page address in being stored in local cache database in the situation that, search high in the clouds database, to obtain the processing mode of corresponding web page address from the database of high in the clouds, wherein, in the database of high in the clouds, store the processing mode of different web pages address, the URL class library that high in the clouds database is stored for cloud server, the URL that the quantity of the URL that this database is stored is stored considerably beyond gateway local, equally, in database, also store beyond the clouds the classified information one to one with each URL institute, and the processing mode corresponding with classified information (, configuration information).
S209: according to the processing mode getting, web page address is filtered, that is, determine whether according to the processing mode of obtaining the webpage that Web page loading address is corresponding.
The filter method of the web page address that the embodiment of the present invention provides, by access high in the clouds database, realize in local cache database in a limited number of situations of URL, can be from high in the clouds data base querying to the processing mode to web page address, avoid causing because URL class library is limited the fail safe that web page address filters to reduce, solve the lower problem of fail safe of web page address filtering scheme in prior art, and then reach and improve web page address and filter the effect of fail safe, and, the inquiry of carrying out high in the clouds database does not need to take the cpu resource of gateway device, reach the effect of avoiding affecting gateway package forward efficiency.
Fig. 3 is the flow chart of the filter method of web page address according to the preferred embodiment of the invention, as shown in Figure 3, obtain the processing mode of corresponding web page address from the database of high in the clouds after, the filter method of the web page address that the preferred embodiment provides comprises: the processing mode getting is sent to local cache database, then, upgrade local cache database.
For in local cache database inquiry less than web page address, obtain the processing mode of corresponding web page address from the database of high in the clouds after, the processing mode getting is sent to local cache database, then, upgrade local cache database, carry out web page address inquiry during so that follow-up, can directly utilize local cache database to inquire about, wherein, utilize local cache database to inquire about, have advantages of that inquiry velocity is fast.
In embodiments of the present invention, can store conventional top10000 bar URL and inquire about recently the URL upgrading at local cache database, so both ensure the hit rate of local search, avoid again taking too many memory headroom.
Further, the filter method of the web page address providing for the embodiment of the present invention, wherein, after obtaining the web page address of asking in web page address request, can also first calculate the MD5 code of web page address, accordingly, follow-uply carry out the inquiry of web page address and obtaining of processing mode according to MD5 code, , judge whether web page address is stored in local cache database and comprises: judge whether MD5 code is stored in local cache database, search high in the clouds database, comprise with the processing mode of obtaining corresponding web page address from the database of high in the clouds: search high in the clouds database, to obtain the processing mode of corresponding MD5 code from the database of high in the clouds.Wherein, MD5 code adopts hash table organization, and interior tissue mode as shown in Figure 4, in embodiments of the present invention, can be inquired about as key using latter 16 of MD5 code.
Due to the length difference of different web page addresses, carrying out in query script, longer web page address will expend longer query time, and the length of the MD5 code calculating is fixed, and therefore, by utilizing MD5 code to inquire about, can improve comparison efficiency.
Further, before receiving web page address request, or after receiving web page address request, filter method also comprises: receive the setting instruction from user, then according to the memory space of setting instruction setting local cache database.Wherein, the memory space of so-called local cache database, mainly refers to the quantity of the URL that local cache database can buffer memory.Because the difference of gateway system resource distribution, by set the memory space of local cache database according to user's setting instruction, has realized and has rationally utilized gateway device.
It should be noted that, for aforesaid each embodiment of the method, for simple description, therefore it is all expressed as to a series of combination of actions, but those skilled in the art should know, the present invention is not subject to the restriction of described sequence of movement, because according to the present invention, some step can adopt other orders or carry out simultaneously.Secondly, those skilled in the art also should know, the embodiment described in specification all belongs to preferred embodiment, and related action and module might not be that the present invention is necessary.
Through the above description of the embodiments, those skilled in the art can be well understood to the mode that can add essential general hardware platform by software according to the method for above-described embodiment and realize, can certainly pass through hardware, but in a lot of situation, the former is better execution mode.Based on such understanding, the part that technical scheme of the present invention contributes to prior art in essence in other words can embody with the form of software product, this computer software product is stored in a storage medium (as ROM/RAM, magnetic disc, CD), comprise that some instructions (can be mobile phones in order to make a station terminal equipment, computer, server, or the network equipment etc.) carry out the method described in each embodiment of the present invention.
Embodiment 3
According to the embodiment of the present invention, also provide a kind of for implementing the filter of web page address of filter method of above-mentioned web page address, the filter of this web page address is mainly used in carrying out the filter method of the web page address that embodiment of the present invention foregoing provides, below the filter of web page address that the embodiment of the present invention is provided do concrete introduction:
Fig. 5 is according to the schematic diagram of the filter of the web page address of the embodiment of the present invention, as shown in Figure 5, the filter of this web page address mainly comprises the first receiving element 10, the first acquiring unit 20, judging unit 30, second acquisition unit 40 and filter element 50, wherein:
The first receiving element 10, for receiving web page address request, particularly, in the time that user wants to carry out web page access, can get by browser user's web page address request.
The web page address that the first acquiring unit 20 is asked for obtaining web page address request, gets asked URL that is.
Judging unit 30 is for inquiring about local cache database, to judge whether web page address is stored in local cache database, wherein, local cache database (cache) refers to the URL class library that gateway local is stored, in embodiments of the present invention, local cache database stores multiple URL, and store the classified information one to one with each URL institute, and the configuration information corresponding with classified information, for certain URL, configuration information is corresponding thereto for representing whether load the webpage that this URL is corresponding, also be, configuration information represents the processing mode of URL, such as: be that buffer memory is waited for URL, denied access URL, or directly access URL.
Second acquisition unit 40 is for judging web page address for be stored in local cache database in the situation that, search high in the clouds database, to obtain the processing mode of corresponding web page address from the database of high in the clouds, wherein, in the database of high in the clouds, store the processing mode of different web pages address, the URL class library that high in the clouds database is stored for cloud server, the URL that the quantity of the URL that this database is stored is stored considerably beyond gateway local, equally, in database, also store beyond the clouds the classified information one to one with each URL institute, and the processing mode corresponding with classified information (, configuration information).
Filter element 50 for web page address being filtered according to the processing mode getting, that is, determines whether according to the processing mode of obtaining the webpage that Web page loading address is corresponding.
The filter of the web page address that the embodiment of the present invention provides, by access high in the clouds database, realize in local cache database in a limited number of situations of URL, can be from high in the clouds data base querying to the processing mode to web page address, avoid causing because URL class library is limited the fail safe that web page address filters to reduce, solve the lower problem of fail safe of web page address filtering scheme in prior art, and then reach and improve web page address and filter the effect of fail safe, and, the inquiry of carrying out high in the clouds database does not need to take the cpu resource of gateway device, reach the effect of avoiding affecting gateway package forward efficiency.
Preferably, the filter of the web page address that the embodiment of the present invention provides also comprises transmitting element and updating block, wherein, after second acquisition unit 40 obtains the processing mode of corresponding web page address from the database of high in the clouds, transmitting element is for being sent to local cache database by the processing mode getting, updating block is used for upgrading local cache database, carry out web page address inquiry during so that follow-up, can directly utilize local cache database to inquire about, wherein, utilize local cache database to inquire about, have advantages of that inquiry velocity is fast.
In embodiments of the present invention, can store conventional top10000 bar URL and inquire about recently the URL upgrading at local cache database, so both ensure the hit rate of local search, avoid again taking too many memory headroom.
Further, the filter of the web page address that the embodiment of the present invention provides also comprises computing unit, this computing unit is for calculating the MD5 code of web page address, correspondingly, judging unit 30 comprises judge module, and second acquisition unit 40 comprises acquisition module, and judge module is used for judging whether MD5 code is stored in local cache database, acquisition module is used for searching high in the clouds database, to obtain the processing mode of corresponding MD5 code from the database of high in the clouds.Wherein, MD5 code adopts hash table organization, and interior tissue mode as shown in Figure 4, in embodiments of the present invention, can be inquired about as key using latter 16 of MD5 code.
Due to the length difference of different web page addresses, carrying out in query script, longer web page address will expend longer query time, and the length of the MD5 code calculating is fixed, and therefore, by utilizing MD5 code to inquire about, can improve comparison efficiency.
Further, the filter of the web page address that the embodiment of the present invention provides also comprises the second receiving element and setup unit, wherein, the second receiving element is for receiving the setting instruction from user, and setup unit is for the memory space according to setting instruction setting local cache database.Wherein, the memory space of so-called local cache database, mainly refers to the quantity of the URL that local cache database can buffer memory.Because the difference of gateway system resource distribution, by set the memory space of local cache database according to user's setting instruction, has realized and has rationally utilized gateway device.
From above description, can find out, the present invention has realized and has avoided causing because URL class library is limited the fail safe that web page address filters to reduce, solve the lower problem of fail safe of web page address filtering scheme in prior art, and then reach and improve web page address and filter the effect of fail safe, and the inquiry of carrying out high in the clouds database does not need to take the cpu resource of gateway device, has reached the effect of avoiding affecting gateway package forward efficiency.
Obviously, those skilled in the art should be understood that, above-mentioned of the present invention each module or each step can realize with general calculation element, they can concentrate on single calculation element, or be distributed on the network that multiple calculation elements form, alternatively, they can be realized with the executable program code of calculation element, thereby, they can be stored in storage device and be carried out by calculation element, or they are made into respectively to each integrated circuit modules, or the multiple modules in them or step are made into single integrated circuit module to be realized.Like this, the present invention is not restricted to any specific hardware and software combination.
The foregoing is only the preferred embodiments of the present invention, be not limited to the present invention, for a person skilled in the art, the present invention can have various modifications and variations.Within the spirit and principles in the present invention all, any amendment of doing, be equal to replacement, improvement etc., within all should being included in protection scope of the present invention.
Claims (9)
1. a filter method for web page address, is characterized in that, comprising:
Receive web page address request;
Obtain the web page address of asking in described web page address request;
Inquiry local cache database, to judge whether described web page address is stored in described local cache database;
Judging described web page address in being stored in described local cache database in the situation that, search high in the clouds database, to obtain the processing mode of corresponding described web page address from the database of described high in the clouds, wherein, in the database of described high in the clouds, store the processing mode of different web pages address; And
According to the processing mode getting, described web page address is filtered.
2. filter method according to claim 1, is characterized in that, obtain the processing mode of corresponding described web page address from the database of described high in the clouds after, described filter method also comprises:
The processing mode getting is sent to described local cache database;
Upgrade described local cache database.
3. filter method according to claim 1, is characterized in that, after obtaining the web page address of asking in described web page address request, described filter method also comprises:
Calculate the MD5 code of described web page address,
Judge whether described web page address is stored in described local cache database and comprises: judge whether described MD5 code is stored in described local cache database,
Search high in the clouds database, comprise with the processing mode of obtaining corresponding described web page address from the database of described high in the clouds: search high in the clouds database, to obtain the processing mode of corresponding described MD5 code from the database of described high in the clouds.
4. according to the filter method described in any one in claims 1 to 3, it is characterized in that, before receiving web page address request, or after receiving web page address request, described filter method also comprises:
Receive and set instruction; And
Set the memory space of described local cache database according to described setting instruction.
5. a filter for web page address, is characterized in that, comprising:
The first receiving element, for receiving web page address request;
The first acquiring unit, the web page address of asking for obtaining described web page address request;
Judging unit, for inquiring about local cache database, to judge whether described web page address is stored in described local cache database;
Second acquisition unit, for judging described web page address for be stored in described local cache database in the situation that, search high in the clouds database, to obtain the processing mode of corresponding described web page address from the database of described high in the clouds, wherein, in the database of described high in the clouds, store the processing mode of different web pages address; And
Filter element, filters described web page address for the processing mode according to getting.
6. filter according to claim 5, is characterized in that, described filter also comprises:
Transmitting element, for being sent to the processing mode getting described local cache database;
Updating block, for upgrading described local cache database.
7. filter according to claim 5, is characterized in that, described filter also comprises:
Computing unit, for calculating the MD5 code of described web page address,
Described judging unit comprises: judge module, and for judging whether described MD5 code is stored in described local cache database,
Described second acquisition unit comprises: acquisition module, and for searching high in the clouds database, to obtain the processing mode of corresponding described MD5 code from the database of described high in the clouds.
8. according to the filter described in any one in claim 5 to 7, it is characterized in that, described filter also comprises:
The second receiving element, for receiving setting instruction; And
Setup unit, for setting the memory space of described local cache database according to described setting instruction.
9. the filtration system of a web page address, it is characterized in that, comprise that web page address inquiring client terminal, web page address upgrade client and web page address cloud server, wherein, described web page address inquiring client terminal has local cache database, and described web page address cloud server has high in the clouds database:
Described web page address inquiring client terminal is used for receiving web page address request, from described web page address request, obtains asked web page address, and inquires about described local cache database, to judge whether described web page address is stored in described local cache database;
Described web page address upgrades client for judging described web page address at described web page address inquiring client terminal for be stored in described local cache database in the situation that, search described high in the clouds database, to obtain the processing mode of corresponding described web page address from the database of described high in the clouds, and according to the processing mode getting, described web page address is filtered, wherein, in the database of described high in the clouds, store the processing mode of different web pages address.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201410422953.7A CN104144170A (en) | 2014-08-25 | 2014-08-25 | URL filtering method, device and system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201410422953.7A CN104144170A (en) | 2014-08-25 | 2014-08-25 | URL filtering method, device and system |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN104144170A true CN104144170A (en) | 2014-11-12 |
Family
ID=51853238
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201410422953.7A Pending CN104144170A (en) | 2014-08-25 | 2014-08-25 | URL filtering method, device and system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN104144170A (en) |
Cited By (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104683496A (en) * | 2015-02-13 | 2015-06-03 | 小米科技有限责任公司 | Address filtering method and device |
| CN105245601A (en) * | 2015-10-15 | 2016-01-13 | 桂林电子科技大学 | Data filtering method and data filtering system |
| CN106372155A (en) * | 2016-08-30 | 2017-02-01 | 福建中金在线信息科技有限公司 | Method and device for filtering webpage links |
| CN107222507A (en) * | 2017-07-13 | 2017-09-29 | 广州西麦科技股份有限公司 | A kind of home-network content access control method and device |
| CN109726340A (en) * | 2018-12-21 | 2019-05-07 | 武汉思普崚技术有限公司 | The querying method and device of uniform resource locator classification |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101854335A (en) * | 2009-03-30 | 2010-10-06 | 华为技术有限公司 | Method, system and network device for filtration |
| CN102946449A (en) * | 2012-11-28 | 2013-02-27 | 网神信息技术（北京）股份有限公司 | Uniform resource locator (URL) matching method, device and gateway |
| US20130339136A1 (en) * | 2012-06-18 | 2013-12-19 | Ebay Inc. | Detection of events from bursts of activity indicators |
| CN103532917A (en) * | 2012-07-06 | 2014-01-22 | 天讯天网(福建)网络科技有限公司 | Website-filtering method based on mobile Internet and cloud computing |
| CN103634317A (en) * | 2013-11-28 | 2014-03-12 | 北京奇虎科技有限公司 | Method and system of performing safety appraisal on malicious web site information on basis of cloud safety |
| CN103914651A (en) * | 2012-12-31 | 2014-07-09 | 腾讯科技（武汉）有限公司 | Malice webpage address detection method and device |
-
2014
- 2014-08-25 CN CN201410422953.7A patent/CN104144170A/en active Pending
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101854335A (en) * | 2009-03-30 | 2010-10-06 | 华为技术有限公司 | Method, system and network device for filtration |
| US20130339136A1 (en) * | 2012-06-18 | 2013-12-19 | Ebay Inc. | Detection of events from bursts of activity indicators |
| CN103532917A (en) * | 2012-07-06 | 2014-01-22 | 天讯天网(福建)网络科技有限公司 | Website-filtering method based on mobile Internet and cloud computing |
| CN102946449A (en) * | 2012-11-28 | 2013-02-27 | 网神信息技术（北京）股份有限公司 | Uniform resource locator (URL) matching method, device and gateway |
| CN103914651A (en) * | 2012-12-31 | 2014-07-09 | 腾讯科技（武汉）有限公司 | Malice webpage address detection method and device |
| CN103634317A (en) * | 2013-11-28 | 2014-03-12 | 北京奇虎科技有限公司 | Method and system of performing safety appraisal on malicious web site information on basis of cloud safety |
Cited By (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104683496A (en) * | 2015-02-13 | 2015-06-03 | 小米科技有限责任公司 | Address filtering method and device |
| CN104683496B (en) * | 2015-02-13 | 2018-06-19 | 小米通讯技术有限公司 | address filtering method and device |
| CN105245601A (en) * | 2015-10-15 | 2016-01-13 | 桂林电子科技大学 | Data filtering method and data filtering system |
| CN106372155A (en) * | 2016-08-30 | 2017-02-01 | 福建中金在线信息科技有限公司 | Method and device for filtering webpage links |
| CN107222507A (en) * | 2017-07-13 | 2017-09-29 | 广州西麦科技股份有限公司 | A kind of home-network content access control method and device |
| CN109726340A (en) * | 2018-12-21 | 2019-05-07 | 武汉思普崚技术有限公司 | The querying method and device of uniform resource locator classification |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| RU2615057C2 (en) | Method and device for access to web-page and router | |
| EP3595355A1 (en) | Resource obtaining method, apparatus and system | |
| KR102513998B1 (en) | Communication methods and devices, entities and computer readable storage media | |
| CN102694861B (en) | A kind of terminal application software sorting technique, Apparatus and system based on cloud | |
| CN107809383B (en) | MVC-based path mapping method and device | |
| WO2017114206A1 (en) | Method and device for processing short link, and short link server | |
| CN109587290B (en) | Domain name resolution method and related device | |
| CN110557284B (en) | Data aggregation method and device based on client gateway | |
| CN105338026A (en) | Data resource acquisition method, device and system | |
| CN104144170A (en) | URL filtering method, device and system | |
| CN106251202A (en) | Maliciously order recognition methods and device | |
| CN109167840B (en) | Task pushing method, node autonomous server and edge cache server | |
| CN103888358A (en) | Routing method, device, system and gateway equipment | |
| CN104219230B (en) | Identify method and the device of malicious websites | |
| CN105095313A (en) | Data access method and equipment | |
| CN106534268B (en) | Data sharing method and device | |
| WO2016000507A1 (en) | Traffic-saving mode search service method, server, client and system | |
| CN108154024B (en) | Data retrieval method and device and electronic equipment | |
| US20180035367A1 (en) | Method and Apparatus for Accessing Wifi Access Point in Target Shop | |
| CN104618388A (en) | Quick registration and login method and corresponding reset server and information server | |
| CN111159131A (en) | Performance optimization method, device, equipment and computer readable storage medium | |
| CN109842482B (en) | Information synchronization method, system and terminal equipment | |
| CN105610596B (en) | Resource directory management method and network terminal | |
| CN106803830B (en) | Method, device and system for identifying internet access terminal and User Identity Module (UIM) card | |
| CN104717286A (en) | Data processing method, terminal, server and system |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20141112 |
|
| RJ01 | Rejection of invention patent application after publication |