WO2015014279A1 - Method and device for clustering phishing webpages - Google Patents
Method and device for clustering phishing webpages Download PDFInfo
- Publication number
- WO2015014279A1 WO2015014279A1 PCT/CN2014/083261 CN2014083261W WO2015014279A1 WO 2015014279 A1 WO2015014279 A1 WO 2015014279A1 CN 2014083261 W CN2014083261 W CN 2014083261W WO 2015014279 A1 WO2015014279 A1 WO 2015014279A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- domain
- domain name
- sub
- clustering
- phishing
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Ceased
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F21/00—Security arrangements for protecting computers, components thereof, programs or data against unauthorised activity
- G06F21/60—Protecting data
- G06F21/62—Protecting access to data via a platform, e.g. using keys or access control rules
- G06F21/6209—Protecting access to data via a platform, e.g. using keys or access control rules to a single file or object, e.g. in a secure envelope, encrypted and accessed using a key, or with access control rules appended to the object itself
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L63/00—Network architectures or network communication protocols for network security
- H04L63/14—Network architectures or network communication protocols for network security for detecting or protecting against malicious traffic
- H04L63/1441—Countermeasures against malicious traffic
- H04L63/1483—Countermeasures against malicious traffic service impersonation, e.g. phishing, pharming or web spoofing
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F2221/00—Indexing scheme relating to security arrangements for protecting computers, components thereof, programs or data against unauthorised activity
- G06F2221/21—Indexing scheme relating to G06F21/00 and subgroups addressing additional information or applications relating to security arrangements for protecting computers, components thereof, programs or data against unauthorised activity
- G06F2221/2119—Authenticating web pages, e.g. with suspicious links
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F2221/00—Indexing scheme relating to security arrangements for protecting computers, components thereof, programs or data against unauthorised activity
- G06F2221/21—Indexing scheme relating to G06F21/00 and subgroups addressing additional information or applications relating to security arrangements for protecting computers, components thereof, programs or data against unauthorised activity
- G06F2221/2149—Restricted operating environment
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L2101/00—Indexing scheme associated with group H04L61/00
- H04L2101/30—Types of network names
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/02—Protocols based on web technology, e.g. hypertext transfer protocol [HTTP]
Definitions
- the present disclosure specifically relates to a method and a device for clustering phishing webpages in the field of information security.
- a phishing webpage is a disguised bank webpage or e-commerce webpage that may steal private information such as bank accounts and passwords submitted by users.
- the so-called phishing webpage is essentially an online fraud, in which phishers counterfeit the URLs and the page content of real websites by different means, or insert dangerous HTML codes into certain webpages of real websites by taking advantage of loopholes in the server programs of the real websites, so as to trick people into divulging their private information, for example, accounts and passwords of bank/credit cards.
- Clustering of phishing webpages is to cluster the phishing-purposed webpages for use as the criteria for comparison in detecting phishing webpages.
- domain names are substitutes for IP addresses, which are presented numerically to further simplify the process of searching for information on the Internet.
- Domain names servers maintain a list that matches domain names to IP addresses.
- TLD Top Level Domains
- SLD secondary level domains
- a phisher may request to use a secondary level domain name (e.g., a. cn.ms) for phishing activities.
- the prior art methods of clustering phishing webpages may label a large number of secondary level domain (SLD) names in the entire SLD of cn.ms, namely, including not only the sub-domain name of a.cn.ms (i.e., the offending phishing webpage), but also other sub-domain names such as b.cn.ms to ...n.cn.ms which are registered under the SLD of cn.ms.
- SLD secondary level domain
- the innocent sub-domain names e.g., b.cn.ms to ...n.cn.ms
- SLD of cn.ms not only are being mistakenly labeled as phishing webpages, but also in effect, help to hide the offending phishing webpages which are originated from the sub-domain name a.cb.ms as the source.
- the labeling of the other innocent sub-domain names e.g., b.cn.ms to ...n.cn.ms
- sub-domain names b. a.cn.ms, c. a.cn.ms, and d.e. a.cn.ms of a.cn.ms may be the phishing webpages.
- Sophisticated phishers may exploit "extensive domain name analysis" to generate a large number of sub-domain names "*. a.cn.ms" (i.e., sub-domain names of a.cn.ms) within an extremely short period.
- the prior art methods for clustering phishing webpages may include the entire site or every sub-domain names (i.e., "*.
- a.cn.ms under the sub-domain of a.cn.ms as phishing webpages.
- the prior art methods are ineffective in precisely clustering only the source of the phishing webpages (i.e., b. a.cn.ms, c. a.cn.ms, and d.e. a.cn.ms).
- the present disclosure provides a method and device for clustering phishing webpages, which reduces the false positive rate of phishing webpages and improve effectiveness in precisely clustering the phishing webpages which are originated from the source.
- An embodiment of the disclosure provides a method for clustering phishing webpages, including the following operations of: receiving by the terminal, a phishing website; obtaining a domain name of the phishing website; obtaining from a preset domain name table, a domain name type corresponding to the domain name of the phishing website; and clustering phishing webpages according to the domain name type.
- the clustering of phishing webpages according to the domain name type further includes: determining whether the domain name type pertains to a secondary level domain (SLD) name, and if yes, obtaining a sub-domain of the domain name of the phishing website; when a preset cluster information library does not include the sub-domain, obtaining a count result of the sub-domain after incrementing by 1 ; and determining whether the count result of the sub-domain meets clustering requirements, and if yes, clustering the sub-domain of the domain name of the phishing website into the cluster information library.
- SLD secondary level domain
- the method further includes: when the domain name type does not pertain to the SLD name, obtaining a count result of the domain name of the phishing website after incrementing by 1; determining whether the count result of the domain name of the phishing website satisfies clustering requirements, and if yes, clustering the domain name of the phishing website into the cluster information library.
- the clustering requirements include one of: the count result of the sub-domain exceeds a first preset threshold value within a first preset time; or a ratio of the count result of the sub-domain to websites of an entire domain or to websites of the sub-domain exceeds a first preset ratio within the first preset time.
- the clustering requirements may include one of: the count result of the domain name of the phishing website exceeds a second preset threshold value within a second preset time; or a ratio of the domain name of the phishing website to websites of an entire domain or to websites of the sub-domain exceeds a second preset ratio within the second preset time.
- the device may include: at least a processor with circuitry operating in conjunction with at least a memory storing codes to be executed to perform functions as a plurality of modules or sub-modules, wherein the plurality of modules or sub-modules include: a receiving module, which causes the device to receive a phishing website; a first acquisition module, which causes the device to obtain the domain name of the phishing website; a second acquisition module, which causes the device to obtain from a preset domain name table, a domain name type corresponding to the domain name of the phishing website; and a clustering module, which causes the device to cluster phishing webpages according to the domain name type.
- the clustering module includes: a first determining sub-module, which causes the device to determine whether the domain name type pertains to a secondary level domain (SLD) name; a first acquisition sub-module, which causes the device to obtain a sub-domain of the domain name of the phishing website when it is determined that the domain name type pertains to the secondary level domain (SLD) name; a first addition sub-module, which causes the device to obtain a count result of the sub-domain after incrementing by l,when a preset cluster information library does not include the sub-domain; a second determining sub-module, which causes the device to determine whether the count result of the sub-domain meets clustering requirements; and a first clustering sub-module, which causes the device to cluster the sub-domain of the domain name of the phishing website into the cluster information library when it is determined that the count result of the sub-domain meets clustering requirements.
- SLD secondary level domain
- a first acquisition sub-module which causes the device to obtain a sub-domain of the
- the clustering module includes: a second addition sub-module, which causes the device to obtain a count result of the domain name of the phishing website after incrementing by l,when it is determined that the domain name type does not pertain to the SLD name; a third determining sub-module, which causes the device to determine whether the count result of the domain name of the phishing website satisfies clustering requirements; and a second clustering sub-module, which causes the device to cluster the domain name of the phishing website into the cluster information library when it is determined that the count result of the domain name of the phishing website satisfies clustering requirements.
- the present disclosure is capable of clustering phishing webpages according to the domain name type upon obtaining the domain name type corresponding to a phishing website.
- the present disclosure may still be able to precisely cluster the phishing webpages which are originated from the source, thus reduce the false-positive rate in detecting phishing webpages without inclusion of legitimate websites by mistake.
- Figure 1 shows the flowchart illustrating a method for clustering phishing webpages, according to an embodiment of the disclosure
- Figure 2 shows a distribution diagram of different domain name types of phishing websites
- Figure 3 shows a flowchart of a method for clustering phishing webpages, according to another embodiment of the disclosure
- Figure 4 shows an exemplary structure diagram of a device for clustering phishing webpages, according to an embodiment of the disclosure
- Figure 5 shows an exemplary structure diagram of a server provided in Figure 4.
- Domain name types may include a top-level domain (TLD) and a secondary level domain (SLD).
- TLD top-level domain
- SLD secondary level domain
- “.com” is a TLD which may allow a user to request its sub-domains
- "cn.ms” is a SLD which may allow a user to register sub-domain names which are lower levels under the SLD (e.g., a.cn.ms, b.cn.ms... n.cn.ms, and b.a.cn.ms...n.n.cn.ms, d.b.e. a.cn.ms, to name a few, etc.).
- Figure 1 shows a flowchart illustrating a method for clustering phishing webpages, according to an embodiment of the disclosure.
- the method may include at least the following operations:
- Step 101 Receiving a phishing website.
- a phishing website may be received irrespective of the detection method.
- Step 102 Obtaining a domain name of the phishing website.
- the obtained domain name of the phishing website may be a text address associated with a numerical IP address.
- b. a.cn.ms may be a phishing website under a domain name of cn.ms
- b.a.com/l.asp may be a phishing website under a domain name of a.com.
- Step 103 Obtaining from a preset domain name table, a domain name type corresponding to the domain name of the phishing website. Upon obtaining the domain name, a preset domain name table may be queried to look for a domain name type corresponding to the obtained domain name, which the domain name type may either be a SLD type or non-SLD type.
- Table 1 may illustrate an exemplary preset domain name table.
- the format of a specific domain name table may not be limited to that of Table 1.
- the domain name table may be obtained with the results from artificial statistics.
- Table 1 may display domain name types of different domain names as follows:
- the types of domain name may be classified according to domain name fees structure. More specifically, classifying domain name types based on domain name fees may result in at least two domain name types: namely, those of free domains (including free TLDs and free SLDs) and those of low cost domain names (including low cost TLDs and low cost SLDs, such as dynamic domains).
- FIG. 2 shows an exemplary distribution diagram of domain names which are infested with phishing websites domain name types (data source: 2012 Annual Report of Anti-Phishing Alliance of China).
- the domain names excluding .com are basically free domains or low cost domains, .tk, .co.cc, and .pi are representative free TLDs which account for a large ratio.
- Under the TLDs of .ms and .tf they include a large number of free SLDs including cn.ms, hk.ms, net.tf, and eu.tf.
- Low cost TLDs may include: .to, .info, and .in, to name a few.
- Low cost SLDs in China are mostly provided by dynamic domain name providers, such as 3322.org.
- Step 104 Clustering phishing webpages according to the domain name type. More specifically, a domain name may correspond to a domain name type. The domain name type of the domain name may be determined to one which pertains to the SLD, and clustering of phishing webpages may be performed according to the determination result.
- the present disclosure firstly receives any phishing website; secondly, obtains a domain name of the phishing website; thirdly, obtains a domain name type corresponding to the domain name from a preset domain name table; finally, clusters phishing webpages according to the domain name type.
- the present disclosure may sort out and cluster the phishing webpage based on the domain name type within the domain names in the SLD, thereby reducing the false-positive rate of phishing webpages and thoroughly include the phishing webpages spread from the source.
- Figure 3 shows a flowchart of the method for clustering phishing webpages, according to another embodiment.
- the method may include the following operations:
- Step 301 Receiving any phishing website
- Step 302 Obtaining the domain name of the phishing website
- Step 303 Obtaining from a preset domain name table, the domain name type corresponding to the domain name;
- Steps 301 to 303 are the same as Steps 101 to 103 in the embodiment of Fig. 1.
- Step 304 Determining whether the domain name type is of SLD name, if yes, proceeding to Step 305, if not, proceeds to Step 309. More specifically, the domain name type corresponding to the domain name may be determined by referencing to Table 2.
- Table 2 is an exemplary domain name type table, which may be obtained by artificial statistics. Table 2 may be further developed from Table 1, and is not limiting in its content.
- Table 2 may be as follows:
- Step 305 Obtaining a sub-domain of the domain name of the phishing website.
- the sub-domain name of the phishing website's domain name may be obtained. For example, if a phishing website is b.a.cn.ms, then its SLD name may be cn.ms with at least a sub-domain name of a.cn.ms.
- Various methods may be used to obtain a sub-domain name from a SLD name, which is non-restricting to the disclosure.
- Step 306 When the preset cluster information library does not include the sub-domain name, obtaining a count result of the sub-domain after incrementing by 1. More specifically, a real-time count of the detected sub-domains may be performed, and a sub-domain count may be incremented by 1 each time a sub-domain is detected, wherein, the sub-domain counting method is not limited by the disclosure of the embodiment.
- Step 307 Determining whether the count result of the sub-domain meets clustering requirements, and if yes, proceeding to Step 308, if not, proceed to cluster other phishing webpages. More specifically, the determination is performed upon obtaining the result of the sub-domain count.
- the clustering requirement may include a preset threshold value and within a preset time. If the count result of the sub-domain is larger than the preset threshold value within the preset time, or the ratio of the count result to the websites of the entire domain or to the websites of the sub-domain is larger than a preset ratio within the preset time.
- the present disclosure may set the clustering requirement to "The threshold of number of daily blacklisted entire domain websites is 50", then, when the daily secondary level domain name count is larger than 50, proceeds to Step 308.
- the clustering requirement may be set to "The threshold of ratio of daily clustered websites being 50%”, then when the ratio of the daily secondary level domain count result to the number of all blacklisted websites is larger than 50%, proceeds to Step 308.
- Step 308 Clustering the sub-domain name of the domain name into the cluster information library. More specifically, when the result of the sub-domain count meets the preset clustering requirements, clusters the sub-domain into the cluster information library and labels the sub-domain as a phishing webpage.
- Step 309 Obtaining a count result of the domain name of the phishing website after incrementing by 1. More specifically, when the domain name type is not of SLD name, the domain name count is incremented by 1 to obtain the count result of the domain name of the phishing website.
- Step 310 Determining whether the count result of the domain name satisfies the clustering requirements, and if yes, proceeding to Step 311, if not, proceeds to cluster other phishing webpages.
- the preset clustering requirement may be obtained by querying Table 2. For example, for the domain name with the domain name type "1", a corresponding clustering requirement may be set to "The threshold of number of daily blacklisted websites in the entire domain being 50". In other words, the number of daily clustered websites in the entire domain is larger than 50.
- Step 311 Clustering the domain name into the cluster information library, after the domain name count meeting the preset clustering requirements.
- Clustering of phishing webpages may be according to the domain name type, even when phishers use secondary level domain names of SLDs for phishing. Accordingly, this embodiment may effectively reduce the false-positive rate in detecting phishing webpages and thoroughly include the spread of phishing webpages at the source.
- FIG 4 shows an exemplary structure diagram of a device (400) for clustering phishing webpages, according to an embodiment of the disclosure.
- the device may include: at least a processor with circuitry (407) operating in conjunction with at least a memory (405) storing codes to be executed to perform functions as a plurality of modules or sub-modules, wherein the plurality of modules or sub-modules may include at least a receiving module (401), a first acquisition module (402), a second acquisition module (403) and a clustering module (404).
- the receiving module (401) causes the device (400) to receive a phishing website.
- the first acquisition module (402) causes the device (400) to obtain a domain name of the phishing website.
- the second acquisition module (403) causes the device (400) to obtain from a preset domain name table, a domain name type corresponding to the domain name of the phishing website; and the clustering module (4040 causes the device (400) to cluster phishing webpages according to the domain name type.
- the clustering module (404) may further include:
- a first determining sub-module which causes the device to determine whether the domain name type pertains to a SLD
- a first acquisition sub-module which causes the device to obtain a sub-domain of the domain name of the phishing website when the determination result of the first determining sub-module is yes (i.e., the domain name type pertains to the SLD name);
- a first addition sub-module which causes the device to increment by 1 to obtain a count result of the sub-domain, when the preset cluster information library does not include the sub-domain;
- a second determining sub-module which causes the device to determine whether the count result of the sub-domain meets the clustering requirements
- a first clustering sub-module which causes the device to cluster the sub-domain of the domain name of the phishing website into the cluster information library when the determination result of the second determining sub-module is yes (i.e., the count result of the sub-domain meets clustering requirements).
- the clustering module may further include: a second addition sub-module, which causes the device to increment by 1 to obtain a count result of the domain name of the phishing website when it is determined that the domain name type does not pertain to the SLD name; a third determining sub-module, which causes the device to determine whether the count result of the domain name of the phishing website satisfies clustering requirements; and a second clustering sub-module, which causes the device to cluster the domain name of the phishing website into the cluster information library when it is determined that the count result of the domain name of the phishing website satisfies clustering requirements.
- FIG 5 illustrates a server provided in this embodiment, wherein the server (500) may cause the device (400) to carry out the method provided in the foregoing embodiments described in Figs. 1-2.
- the server (500) may include one or more memories (510) made of non-transitory readable storage media, an input unit (520), an output unit (530), a processor (540) comprising one or more processing cores, and a power supply (550).
- the memory (510) may cause the device to store software programs and modules. By running a software program or module stored in the memory (510), the processor (540) may execute various functional applications and data processing.
- the memory (510) may mainly function as a storage program area and a storage data area, wherein the storage program area may store an operating system, application programs required for at least one function, and the storage data area may store the data based on usage of the computer.
- the memory (510) may be such as a high-speed random access memory (RAM) and a non-volatile memory, for example, at least one disk storage device, a flash memory device, or a volatile solid memory device of another type.
- the memory (510) may include a memory controller, which enables the processor (540) and the input unit (520) to access the memory (510).
- the input unit (520) may be one which causes the device (400) to receive the inputted numerical or character information, and generate keyboard inputs, mouse inputs, operating rod inputs, optical inputs, or trackball signal inputs related to user setting and functional control.
- the processor (540) connects different parts of the server by means of various interfaces and lines, and performs various functions of the computer and processes data by running or executing the software program and/or module stored in the memory (510) and invoking the data stored in the memory (510), thereby performing overall monitoring to the mobile phone.
- the processor (540) may include one or more processing cores.
- the server also comprises the power supply (550) (such as a battery) that supplies power to various parts of the server.
- the power supply (350) may be connected to the processor (540) logically through a power management system, so that the power management system may perform such functions as charging management, discharging management, and power consumption management.
- the power supply (550) may further comprise one or multiple DC/AC power supplies, a recharging system, a power failure detection circuit, a power converter or inverter, and a power status indicator.
- the processor (540) may specifically load the executable files associated with the processes of one or multiple applications to the memory (510) according to the following instructions, and run the applications stored in the memory (510), thereby implementing various clustering phishing webpage functions corresponding to Figs. 1-4.
- the server may perform functions including: receiving by a device, a phishing website; obtaining a domain name of the phishing website; obtaining from a preset domain name table, a domain name type corresponding to the domain name of the phishing website; and clustering phishing webpages according to the domain name type.
- modules and units described as separate parts may be or may not be physically separated, and parts displayed as units may be or may not be physical units, that is, they may be located at the same place or be distributed on multiple network units. Some or all of the modules may be selected as needed to attain the objectives of this embodiment. A person with ordinary skills in the art may understand and carry out it without inputting creative effort.
- sequence numbers of the above-mentioned embodiments may be intended only for description, instead of indicating the relative merits of the embodiments. It should be understood by those with ordinary skill in the art that all or some of the steps of the foregoing embodiments may be implemented by hardware, or software program codes stored on a non-transitory computer-readable storage medium with computer-executable commands stored within.
- the disclosure may be implemented as an algorithm as codes stored in a program module or a system with multi-program- modules.
- the computer-readable storage medium may be, for example, nonvolatile memory such as compact disc, hard drive. ROM or flash memory.
- the computer-executable commands may enable a computer, a server, a smart phone, a tablet or any similar computing device to render clustering of phishing webpages operations.
Landscapes
- Engineering & Computer Science (AREA)
- Computer Security & Cryptography (AREA)
- Computer Hardware Design (AREA)
- Theoretical Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Bioethics (AREA)
- Signal Processing (AREA)
- Health & Medical Sciences (AREA)
- Computer Networks & Wireless Communication (AREA)
- General Health & Medical Sciences (AREA)
- Software Systems (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Computing Systems (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
- Data Exchanges In Wide-Area Networks (AREA)
- Alarm Systems (AREA)
Abstract
The present disclosure discloses a method and device for clustering phishing webpages. The method includes: receiving by a device, a phishing website; obtaining a domain name of the phishing website; obtaining from a preset domain name table, a domain name type corresponding to the domain name of the phishing website; and clustering phishing webpages according to the domain name type. In this regard, when phishers use secondary level domain (SLD) names for phishing, the present disclosure may sort out and cluster the phishing webpage based on the domain name type within the domain names in the SLD, thereby reducing the false-positive rate of phishing webpages and thoroughly include the phishing webpages spread from the source.
Description
METHOD AND DEVICE FOR CLUSTERING PHISHING WEBPAGES
CROSS-REFERENCE TO RELATED APPLICATIONS
[0001] The application claims priority to Chinese Patent Application No. 2013103265762, filed on July 30, 2013, which is incorporated by reference in its entirety.
FIELD OF THE TECHNOLOGY
[0002] The present disclosure specifically relates to a method and a device for clustering phishing webpages in the field of information security.
BACKGROUND
[0003] A phishing webpage is a disguised bank webpage or e-commerce webpage that may steal private information such as bank accounts and passwords submitted by users. The so-called phishing webpage is essentially an online fraud, in which phishers counterfeit the URLs and the page content of real websites by different means, or insert dangerous HTML codes into certain webpages of real websites by taking advantage of loopholes in the server programs of the real websites, so as to trick people into divulging their private information, for example, accounts and passwords of bank/credit cards. Clustering of phishing webpages is to cluster the phishing-purposed webpages for use as the criteria for comparison in detecting phishing webpages.
[0004] In the prior art, there are diversified methods for clustering phishing webpages. Conventional methods for clustering phishing webpages usually include: firstly, determining a standard time range, for example, a normal day; secondly, presetting a threshold value, and obtaining the number of detected phishing webpages in any site or domain; thirdly, determining whether the obtained quantity of detected phishing webpages exceeds the preset threshold value, and label the entire sites or entire domains associated with the number of detected phishing webpages that exceed the preset threshold value as phishing webpages.
[0005] For better understanding of domain names, domain names are substitutes for IP addresses, which are presented numerically to further simplify the process of searching for information on the Internet. Domain names servers maintain a list that matches domain names to IP addresses. There are two types of domain names: (A) Top Level Domains (TLD) having domain names such as: .com, .edu, .gov, .net, .org, etc., and (B) secondary level domains (SLD) having domain names which precede TLDs in the web addresses, and usually refer to the
organizations (e.g., msn.com, uspto.gov, edu.net, lsm.org, etc.) that have been registered to the TLD through Internet Corporation for Assigned Names and Numbers (ICANN).
[0006] Therefore, when phishers utilizes secondary level domain names of SLDs for phishing, the prior art methods usually merely cluster phishing webpages into sites or domains to label an entire SLDs as being phishing webpages. Such practice inadvertently also include many other innocent secondary level domain names under the SLDs as also being phishing webpages, thus may incorrectly and unfairly be also labeled as the offending phishing webpages.
[0007] For example, a phisher may request to use a secondary level domain name (e.g., a. cn.ms) for phishing activities. The prior art methods of clustering phishing webpages may label a large number of secondary level domain (SLD) names in the entire SLD of cn.ms, namely, including not only the sub-domain name of a.cn.ms (i.e., the offending phishing webpage), but also other sub-domain names such as b.cn.ms to ...n.cn.ms which are registered under the SLD of cn.ms. In this regard, the innocent sub-domain names (e.g., b.cn.ms to ...n.cn.ms) under the SLD of cn.ms not only are being mistakenly labeled as phishing webpages, but also in effect, help to hide the offending phishing webpages which are originated from the sub-domain name a.cb.ms as the source. In addition, the labeling of the other innocent sub-domain names (e.g., b.cn.ms to ...n.cn.ms) has also caused an erroneously high false positive rate in the clustering of phishing webpages.
[0008] In another example, assuming that only three sub-domain names: b. a.cn.ms, c. a.cn.ms, and d.e. a.cn.ms of a.cn.ms may be the phishing webpages. Sophisticated phishers may exploit "extensive domain name analysis" to generate a large number of sub-domain names "*. a.cn.ms" (i.e., sub-domain names of a.cn.ms) within an extremely short period. The prior art methods for clustering phishing webpages may include the entire site or every sub-domain names (i.e., "*. a.cn.ms") under the sub-domain of a.cn.ms as phishing webpages. As seen, the prior art methods are ineffective in precisely clustering only the source of the phishing webpages (i.e., b. a.cn.ms, c. a.cn.ms, and d.e. a.cn.ms).
SUMMARY
[0009] The present disclosure provides a method and device for clustering phishing webpages, which reduces the false positive rate of phishing webpages and improve effectiveness in precisely clustering the phishing webpages which are originated from the source.
[0010] An embodiment of the disclosure provides a method for clustering phishing webpages,
including the following operations of: receiving by the terminal, a phishing website; obtaining a domain name of the phishing website; obtaining from a preset domain name table, a domain name type corresponding to the domain name of the phishing website; and clustering phishing webpages according to the domain name type.
[0011 ] Preferably, the clustering of phishing webpages according to the domain name type further includes: determining whether the domain name type pertains to a secondary level domain (SLD) name, and if yes, obtaining a sub-domain of the domain name of the phishing website; when a preset cluster information library does not include the sub-domain, obtaining a count result of the sub-domain after incrementing by 1 ; and determining whether the count result of the sub-domain meets clustering requirements, and if yes, clustering the sub-domain of the domain name of the phishing website into the cluster information library.
[0012] Preferably, the method further includes: when the domain name type does not pertain to the SLD name, obtaining a count result of the domain name of the phishing website after incrementing by 1; determining whether the count result of the domain name of the phishing website satisfies clustering requirements, and if yes, clustering the domain name of the phishing website into the cluster information library.
[0013] Preferably, the clustering requirements include one of: the count result of the sub-domain exceeds a first preset threshold value within a first preset time; or a ratio of the count result of the sub-domain to websites of an entire domain or to websites of the sub-domain exceeds a first preset ratio within the first preset time.
[0014] Alternately, the clustering requirements may include one of: the count result of the domain name of the phishing website exceeds a second preset threshold value within a second preset time; or a ratio of the domain name of the phishing website to websites of an entire domain or to websites of the sub-domain exceeds a second preset ratio within the second preset time.
[0015] Another embodiment of the disclosure discloses a device for clustering phishing webpages. The device may include: at least a processor with circuitry operating in conjunction with at least a memory storing codes to be executed to perform functions as a plurality of modules or sub-modules, wherein the plurality of modules or sub-modules include: a receiving module, which causes the device to receive a phishing website; a first acquisition module, which causes the device to obtain the domain name of the phishing website; a second acquisition module, which causes the device to obtain from a preset domain name table, a domain name type corresponding to the domain name of the phishing website; and a clustering
module, which causes the device to cluster phishing webpages according to the domain name type.
[0016] Preferably, the clustering module includes: a first determining sub-module, which causes the device to determine whether the domain name type pertains to a secondary level domain (SLD) name; a first acquisition sub-module, which causes the device to obtain a sub-domain of the domain name of the phishing website when it is determined that the domain name type pertains to the secondary level domain (SLD) name; a first addition sub-module, which causes the device to obtain a count result of the sub-domain after incrementing by l,when a preset cluster information library does not include the sub-domain; a second determining sub-module, which causes the device to determine whether the count result of the sub-domain meets clustering requirements; and a first clustering sub-module, which causes the device to cluster the sub-domain of the domain name of the phishing website into the cluster information library when it is determined that the count result of the sub-domain meets clustering requirements.
[0017] Preferably, the clustering module includes: a second addition sub-module, which causes the device to obtain a count result of the domain name of the phishing website after incrementing by l,when it is determined that the domain name type does not pertain to the SLD name; a third determining sub-module, which causes the device to determine whether the count result of the domain name of the phishing website satisfies clustering requirements; and a second clustering sub-module, which causes the device to cluster the domain name of the phishing website into the cluster information library when it is determined that the count result of the domain name of the phishing website satisfies clustering requirements.
[0018] Compared with the prior art clustering phishing webpages method, the present disclosure is capable of clustering phishing webpages according to the domain name type upon obtaining the domain name type corresponding to a phishing website. In this regard, even when a phisher using sub-domain names of SLDs for phishing to hide its source, the present disclosure may still be able to precisely cluster the phishing webpages which are originated from the source, thus reduce the false-positive rate in detecting phishing webpages without inclusion of legitimate websites by mistake.
BRIEF DESCRIPTION OF THE DRAWINGS
[0019] The accompanying drawings may be included to provide further understanding of the
claims and disclosure which may be incorporated in, and constitute a part of this specification. The detailed description and illustrated embodiments described may serve to explain the principles defined by the claims.
[0020] Figure 1 shows the flowchart illustrating a method for clustering phishing webpages, according to an embodiment of the disclosure;
[0021 ] Figure 2 shows a distribution diagram of different domain name types of phishing websites;
[0022] Figure 3 shows a flowchart of a method for clustering phishing webpages, according to another embodiment of the disclosure;
[0023] Figure 4 shows an exemplary structure diagram of a device for clustering phishing webpages, according to an embodiment of the disclosure;
[0024] Figure 5 shows an exemplary structure diagram of a server provided in Figure 4. DETAILED DESCRIPTION
[0025] The various embodiments of the disclosure may be further described in details in combination with attached drawings and embodiments below. It should be understood that the specific embodiments described here may be used only to explain the disclosure, and may not be used to limit the disclosure. In addition, for the sake of keeping description brief and concise, the newly added features, or features which may be different from those previously described in each new embodiment will be described in details. Similar features may be referenced back to the prior descriptions in a prior numbered drawing or referenced ahead to a higher numbered drawing. Unless otherwise specified, all technical and scientific terms herein may have the same meanings as understood by a person skilled in the art.
[0026] Embodiment 1
[0027] There are a diversity of methods for clustering phishing webpages in the prior art, but none of them utilizes the feature of "domain name type" to cluster the phishing webpages which are originated from the source without inclusion of other legitimate websites by mistake. The embodiments in the disclosure solve the described problems of clustering only the phishing webpages from the source and avoiding falsely creating a high positive rate in detecting phishing webpages.
[0028] Domain name types may include a top-level domain (TLD) and a secondary level
domain (SLD). For example, ".com" is a TLD which may allow a user to request its sub-domains; where "cn.ms" is a SLD which may allow a user to register sub-domain names which are lower levels under the SLD (e.g., a.cn.ms, b.cn.ms... n.cn.ms, and b.a.cn.ms...n.n.cn.ms, d.b.e. a.cn.ms, to name a few, etc.).
[0029] When phishers use sub-domain names of SLDs for phishing, the methods in the prior art for clustering phishing webpages have two disadvantages: namely, unable to precisely cluster only the offending phishing webpages without inclusion of other innocent webpages under the same domain name, and as a result, a high false positive rate for labeling phishing webpages. The present disclosure utilizes the feature of "domain name type" in the method and device embodiments to overcome the disadvantages of the prior art methods.
[0030] Figure 1 shows a flowchart illustrating a method for clustering phishing webpages, according to an embodiment of the disclosure. The method may include at least the following operations:
[0031 ] Step 101: Receiving a phishing website. A phishing website may be received irrespective of the detection method.
[0032] Step 102: Obtaining a domain name of the phishing website. The obtained domain name of the phishing website may be a text address associated with a numerical IP address. For example: b. a.cn.ms may be a phishing website under a domain name of cn.ms, and b.a.com/l.asp may be a phishing website under a domain name of a.com.
[0033] Step 103: Obtaining from a preset domain name table, a domain name type corresponding to the domain name of the phishing website. Upon obtaining the domain name, a preset domain name table may be queried to look for a domain name type corresponding to the obtained domain name, which the domain name type may either be a SLD type or non-SLD type.
[0034] Table 1 may illustrate an exemplary preset domain name table. The format of a specific domain name table may not be limited to that of Table 1. In addition, the domain name table may be obtained with the results from artificial statistics. Table 1 may display domain name types of different domain names as follows:
Domain Name Type Domain Name
1 tk
1 co.cc
2 in
2 info
3 com
4 cn
5 cn.ms
5 net.tf
6 3322.org
7 vicp.net
Table 1
[0035]
In an embodiment, the types of domain name may be classified according to domain name fees structure. More specifically, classifying domain name types based on domain name fees may result in at least two domain name types: namely, those of free domains (including free TLDs and free SLDs) and those of low cost domain names (including low cost TLDs and low cost SLDs, such as dynamic domains).
[0036] It may be pointed out that free or low cost domain names are more likely being utilized by phishers due to low expenses for phishing. Since low cost or free domain names are increasingly becoming a phish- stricken area, in this regard, classifying domain name types according to domain name fees and cost may become a factor in determining whether the domain name type may be a phishing webpage or not.
[0037] Figure 2 shows an exemplary distribution diagram of domain names which are infested with phishing websites domain name types (data source: 2012 Annual Report of Anti-Phishing Alliance of China). It may be seen that the domain names excluding .com are basically free domains or low cost domains, .tk, .co.cc, and .pi are representative free TLDs which account for a large ratio. Under the TLDs of .ms and .tf, they include a large number of free SLDs including cn.ms, hk.ms, net.tf, and eu.tf. Low cost TLDs may include: .to, .info, and .in, to name a few. Low cost SLDs in China are mostly provided by dynamic domain name providers, such as 3322.org.
[0038] Step 104: Clustering phishing webpages according to the domain name type. More specifically, a domain name may correspond to a domain name type. The domain name type of the domain name may be determined to one which pertains to the SLD, and clustering of phishing webpages may be performed according to the determination result.
[0039] To summarize, the present disclosure firstly receives any phishing website; secondly, obtains a domain name of the phishing website; thirdly, obtains a domain name type corresponding to the domain name from a preset domain name table; finally, clusters
phishing webpages according to the domain name type. In this regard, when phishers use secondary level domain names of SLDs for phishing, the present disclosure may sort out and cluster the phishing webpage based on the domain name type within the domain names in the SLD, thereby reducing the false-positive rate of phishing webpages and thoroughly include the phishing webpages spread from the source.
[0040] Embodiment 2
[0041 ] Figure 3 shows a flowchart of the method for clustering phishing webpages, according to another embodiment. The method may include the following operations:
[0042] Step 301: Receiving any phishing website;
[0043] Step 302: Obtaining the domain name of the phishing website;
[0044] Step 303: Obtaining from a preset domain name table, the domain name type corresponding to the domain name;
[0045] In this embodiment, Steps 301 to 303 are the same as Steps 101 to 103 in the embodiment of Fig. 1.
[0046] Step 304: Determining whether the domain name type is of SLD name, if yes, proceeding to Step 305, if not, proceeds to Step 309. More specifically, the domain name type corresponding to the domain name may be determined by referencing to Table 2. Table 2 is an exemplary domain name type table, which may be obtained by artificial statistics. Table 2 may be further developed from Table 1, and is not limiting in its content.
[0047] Specifically, Table 2 may be as follows:
Table 2
[0048] Step 305: Obtaining a sub-domain of the domain name of the phishing website. In this embodiment, when the domain name type pertains to a SLD name, the sub-domain name of the phishing website's domain name may be obtained. For example, if a phishing website is b.a.cn.ms, then its SLD name may be cn.ms with at least a sub-domain name of a.cn.ms. Various methods may be used to obtain a sub-domain name from a SLD name, which is non-restricting to the disclosure.
[0049] Step 306: When the preset cluster information library does not include the sub-domain name, obtaining a count result of the sub-domain after incrementing by 1. More specifically, a real-time count of the detected sub-domains may be performed, and a sub-domain count may be incremented by 1 each time a sub-domain is detected, wherein, the sub-domain counting method is not limited by the disclosure of the embodiment.
[0050] Step 307: Determining whether the count result of the sub-domain meets clustering requirements, and if yes, proceeding to Step 308, if not, proceed to cluster other phishing webpages. More specifically, the determination is performed upon obtaining the result of the sub-domain count. In practice, the clustering requirement may include a preset threshold value and within a preset time. If the count result of the sub-domain is larger than the preset threshold value within the preset time, or the ratio of the count result to the websites of the entire domain or to the websites of the sub-domain is larger than a preset ratio within the preset time.
[0051 ] Referring to Table 2, the present disclosure may set the clustering requirement to "The
threshold of number of daily blacklisted entire domain websites is 50", then, when the daily secondary level domain name count is larger than 50, proceeds to Step 308. Likewise, the clustering requirement may be set to "The threshold of ratio of daily clustered websites being 50%", then when the ratio of the daily secondary level domain count result to the number of all blacklisted websites is larger than 50%, proceeds to Step 308.
[0052] Step 308: Clustering the sub-domain name of the domain name into the cluster information library. More specifically, when the result of the sub-domain count meets the preset clustering requirements, clusters the sub-domain into the cluster information library and labels the sub-domain as a phishing webpage.
[0053] Step 309: Obtaining a count result of the domain name of the phishing website after incrementing by 1. More specifically, when the domain name type is not of SLD name, the domain name count is incremented by 1 to obtain the count result of the domain name of the phishing website.
[0054] Step 310: Determining whether the count result of the domain name satisfies the clustering requirements, and if yes, proceeding to Step 311, if not, proceeds to cluster other phishing webpages.
[0055] More specifically, the preset clustering requirement may be obtained by querying Table 2. For example, for the domain name with the domain name type "1", a corresponding clustering requirement may be set to "The threshold of number of daily blacklisted websites in the entire domain being 50". In other words, the number of daily clustered websites in the entire domain is larger than 50.
[0056] Step 311: Clustering the domain name into the cluster information library, after the domain name count meeting the preset clustering requirements. Clustering of phishing webpages may be according to the domain name type, even when phishers use secondary level domain names of SLDs for phishing. Accordingly, this embodiment may effectively reduce the false-positive rate in detecting phishing webpages and thoroughly include the spread of phishing webpages at the source.
[0057] Embodiment 3
[0058] Figure 4 shows an exemplary structure diagram of a device (400) for clustering phishing webpages, according to an embodiment of the disclosure. The device may include: at least a processor with circuitry (407) operating in conjunction with at least a memory (405)
storing codes to be executed to perform functions as a plurality of modules or sub-modules, wherein the plurality of modules or sub-modules may include at least a receiving module (401), a first acquisition module (402), a second acquisition module (403) and a clustering module (404).
[0059] The receiving module (401) causes the device (400) to receive a phishing website. The first acquisition module (402) causes the device (400) to obtain a domain name of the phishing website. The second acquisition module (403) causes the device (400) to obtain from a preset domain name table, a domain name type corresponding to the domain name of the phishing website; and the clustering module (4040 causes the device (400) to cluster phishing webpages according to the domain name type.
[0060] Wherein, the clustering module (404) may further include:
[0061 ] a first determining sub-module, which causes the device to determine whether the domain name type pertains to a SLD;
[0062] a first acquisition sub-module, which causes the device to obtain a sub-domain of the domain name of the phishing website when the determination result of the first determining sub-module is yes (i.e., the domain name type pertains to the SLD name);
[0063] a first addition sub-module, which causes the device to increment by 1 to obtain a count result of the sub-domain, when the preset cluster information library does not include the sub-domain;
[0064] a second determining sub-module, which causes the device to determine whether the count result of the sub-domain meets the clustering requirements;
[0065] a first clustering sub-module, which causes the device to cluster the sub-domain of the domain name of the phishing website into the cluster information library when the determination result of the second determining sub-module is yes (i.e., the count result of the sub-domain meets clustering requirements).
[0066] The clustering module may further include: a second addition sub-module, which causes the device to increment by 1 to obtain a count result of the domain name of the phishing website when it is determined that the domain name type does not pertain to the SLD name; a third determining sub-module, which causes the device to determine whether the count result of the domain name of the phishing website satisfies clustering requirements; and a second clustering sub-module, which causes the device to cluster the domain name of the
phishing website into the cluster information library when it is determined that the count result of the domain name of the phishing website satisfies clustering requirements.
[0067] Figure 5 illustrates a server provided in this embodiment, wherein the server (500) may cause the device (400) to carry out the method provided in the foregoing embodiments described in Figs. 1-2. Specifically: the server (500) may include one or more memories (510) made of non-transitory readable storage media, an input unit (520), an output unit (530), a processor (540) comprising one or more processing cores, and a power supply (550).
[0068] The memory (510) may cause the device to store software programs and modules. By running a software program or module stored in the memory (510), the processor (540) may execute various functional applications and data processing. The memory (510) may mainly function as a storage program area and a storage data area, wherein the storage program area may store an operating system, application programs required for at least one function, and the storage data area may store the data based on usage of the computer. In addition, the memory (510) may be such as a high-speed random access memory (RAM) and a non-volatile memory, for example, at least one disk storage device, a flash memory device, or a volatile solid memory device of another type. Correspondingly, the memory (510) may include a memory controller, which enables the processor (540) and the input unit (520) to access the memory (510).
[0069] The input unit (520) may be one which causes the device (400) to receive the inputted numerical or character information, and generate keyboard inputs, mouse inputs, operating rod inputs, optical inputs, or trackball signal inputs related to user setting and functional control.
[0070] As the control center of the server (500), the processor (540) connects different parts of the server by means of various interfaces and lines, and performs various functions of the computer and processes data by running or executing the software program and/or module stored in the memory (510) and invoking the data stored in the memory (510), thereby performing overall monitoring to the mobile phone. Optionally, the processor (540) may include one or more processing cores.
[0071 ] The server also comprises the power supply (550) (such as a battery) that supplies power to various parts of the server. Preferably, the power supply (350) may be connected to the processor (540) logically through a power management system, so that the power management system may perform such functions as charging management, discharging management, and power consumption management. The power supply (550) may further comprise one or
multiple DC/AC power supplies, a recharging system, a power failure detection circuit, a power converter or inverter, and a power status indicator.
[0072] In this embodiment, the processor (540) may specifically load the executable files associated with the processes of one or multiple applications to the memory (510) according to the following instructions, and run the applications stored in the memory (510), thereby implementing various clustering phishing webpage functions corresponding to Figs. 1-4. For example, the server may perform functions including: receiving by a device, a phishing website; obtaining a domain name of the phishing website; obtaining from a preset domain name table, a domain name type corresponding to the domain name of the phishing website; and clustering phishing webpages according to the domain name type.
[0073] The modules and units described as separate parts may be or may not be physically separated, and parts displayed as units may be or may not be physical units, that is, they may be located at the same place or be distributed on multiple network units. Some or all of the modules may be selected as needed to attain the objectives of this embodiment. A person with ordinary skills in the art may understand and carry out it without inputting creative effort.
[0074] The sequence numbers of the above-mentioned embodiments may be intended only for description, instead of indicating the relative merits of the embodiments. It should be understood by those with ordinary skill in the art that all or some of the steps of the foregoing embodiments may be implemented by hardware, or software program codes stored on a non-transitory computer-readable storage medium with computer-executable commands stored within. For example, the disclosure may be implemented as an algorithm as codes stored in a program module or a system with multi-program- modules. The computer-readable storage medium may be, for example, nonvolatile memory such as compact disc, hard drive. ROM or flash memory. The computer-executable commands may enable a computer, a server, a smart phone, a tablet or any similar computing device to render clustering of phishing webpages operations.
Claims
1. A method for clustering phishing webpages in a device, comprising:
receiving a phishing website;
obtaining a domain name of the phishing website;
obtaining from a preset domain name table, a domain name type corresponding to the domain name of the phishing website ; and
clustering phishing webpages according to the domain name type.
2. The method according to claim 1, wherein the clustering of phishing webpages according to the domain name type comprises:
determining whether the domain name type pertains to a secondary level domain (SLD) name, and if yes, obtaining a sub-domain of the domain name of the phishing website;
when a preset cluster information library does not include the sub-domain, obtaining a count result of the sub-domain after incrementing by 1 ; and
determining whether the count result of the sub-domain meets clustering requirements, and if yes, clustering the sub-domain of the domain name of the phishing website into the cluster information library.
3. The method according to claim 2, wherein the method further comprises:
when the domain name type does not pertain to the SLD name, obtaining a count result of the domain name of the phishing website after incrementing by 1; and
determining whether the count result of the domain name of the phishing website satisfies clustering requirements, and if yes, clustering the domain name of the phishing website into the cluster information library.
4. The method according to claim 2, wherein the clustering requirements comprises one of: the count result of the sub-domain exceeds a first preset threshold value within a first preset time; or
a ratio of the count result of the sub-domain to websites of an entire domain or to websites
of the sub-domain exceeds a first preset ratio within the first preset time.
5. The method according to claim 3, wherein the clustering requirements comprises one of: the count result of the domain name of the phishing website exceeds a second preset threshold value within a second preset time; or
a ratio of the domain name of the phishing website to websites of an entire domain or to websites of the sub-domain exceeds a second preset ratio within the second preset time.
6. A device for clustering phishing webpages, comprises at least a processor with circuitry operating in conjunction with at least a memory storing codes to be executed to perform functions as a plurality of modules or sub-modules, wherein the plurality of modules or sub-modules comprise:
a receiving module, which causes the device to receive a phishing website;
a first acquisition module, which causes the device to obtain a domain name of the phishing website;
a second acquisition module, which causes the device to obtain from a preset domain name table, a domain name type corresponding to the domain name of the phishing website; and
a clustering module, which causes the device to cluster phishing webpages according to the domain name type.
7. The device according to claim 6, wherein the clustering module comprises:
a first determining sub-module, which causes the device to determine whether the domain name type pertains to a secondary level domain (SLD) name;
a first acquisition sub-module, which causes the device to obtain a sub-domain of the domain name of the phishing website when it is determined that the domain name type pertains to the secondary level domain (SLD) name;
a first addition sub-module, which causes the device to obtain a count result of the sub-domain after incrementing by 1, when a preset cluster information library does not include the sub-domain;
a second determining sub-module, which causes the device to determine whether the count result of the sub-domain meets clustering requirements; and
a first clustering sub-module, which causes the device to cluster the sub-domain of the domain name of the phishing website into the cluster information library when it is determined that the count result of the sub-domain meets clustering requirements.
8. The device according to claim 7, wherein the clustering module comprises:
a second addition sub-module, which causes the device to obtain a count result of the domain name of the phishing website after incrementing by 1, when it is determined that the domain name type does not pertain to the SLD name;
a third determining sub-module, which causes the device to determine whether the count result of the domain name of the phishing website satisfies clustering requirements; and
a second clustering sub-module, which causes the device to cluster the domain name of the phishing website into the cluster information library when it is determined that the count result of the domain name of the phishing website satisfies clustering requirements.
9. The device according to claim 7, wherein the clustering requirements comprises one of: the count result of the sub-domain exceeds a first preset threshold value within a first preset time; or
a ratio of the count result of the sub-domain to websites of an entire domain or to websites of the sub-domain exceeds a first preset ratio within the first preset time.
10. The device according to claim 8, wherein the clustering requirements comprises one of: the count result of the domain name of the phishing website exceeds a second preset threshold value within a second preset time; or
a ratio of the domain name of the phishing website to websites of an entire domain or to websites of the sub-domain exceeds a second preset ratio within the second preset time.
11. The device according to claim 6, wherein the device operates as one or more of: a smart
phone, a personal computer, a laptop computer, a notebook computing device, a tablet computing device, a server or a terminal with a network connection.
12. A non-transitory computer-readable storage medium, wherein the computer readable storage medium stores a program which comprises codes or instructions to cause a processor circuitry to execute operations for clustering webpages, the operations comprising:
receiving a phishing website;
obtaining a domain name of the phishing website;
obtaining from a preset domain name table, a domain name type corresponding to the domain name of the phishing website ; and
clustering phishing webpages according to the domain name type.
13. The non-transitory computer-readable storage medium according to claim 12, wherein the clustering of phishing webpages according to the domain name type comprises:
determining whether the domain name type pertains to a secondary level domain (SLD) name, and if yes, obtaining a sub-domain of the domain name of the phishing website;
when a preset cluster information library does not include the sub-domain, obtaining a count result of the sub-domain after incrementing by 1 ; and
determining whether the count result of the sub-domain meets clustering requirements, and if yes, clustering the sub-domain of the domain name of the phishing website into the cluster information library.
14. The non-transitory computer-readable storage medium according to claim 12, wherein the method further comprises:
when the domain name type does not pertain to the SLD name, obtaining a count result of the domain name of the phishing website after incrementing by 1; and
determining whether the count result of the domain name of the phishing website satisfies clustering requirements, and if yes, clustering the domain name of the phishing website into the cluster information library.
15. The non-transitory computer-readable storage medium according to claim 13, wherein the clustering requirements comprises one of:
the count result of the sub-domain exceeds a first preset threshold value within a first preset time; or
a ratio of the count result of the sub-domain to websites of an entire domain or to websites of the sub-domain exceeds a first preset ratio within the first preset time.
16. The non-transitory computer-readable storage medium according to claim 14, wherein the clustering requirements comprises one of:
the count result of the domain name of the phishing website exceeds a second preset threshold value within a second preset time; or
a ratio of the domain name of the phishing website to websites of an entire domain or to websites of the sub-domain exceeds a second preset ratio within the second preset time.
Applications Claiming Priority (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201310326576.2 | 2013-07-30 | ||
| CN201310326576.2A CN103399912B (en) | 2013-07-30 | 2013-07-30 | A kind of fishing webpage clustering method and device |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| WO2015014279A1 true WO2015014279A1 (en) | 2015-02-05 |
Family
ID=49563540
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| PCT/CN2014/083261 Ceased WO2015014279A1 (en) | 2013-07-30 | 2014-07-29 | Method and device for clustering phishing webpages |
Country Status (2)
| Country | Link |
|---|---|
| CN (1) | CN103399912B (en) |
| WO (1) | WO2015014279A1 (en) |
Cited By (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| GB2555801A (en) * | 2016-11-09 | 2018-05-16 | F Secure Corp | Identifying fraudulent and malicious websites, domain and subdomain names |
| US10129276B1 (en) * | 2016-03-29 | 2018-11-13 | EMC IP Holding Company LLC | Methods and apparatus for identifying suspicious domains using common user clustering |
| CN114629875A (en) * | 2022-02-10 | 2022-06-14 | 互联网域名系统北京市工程研究中心有限公司 | Active detection domain name brand protection method and device |
| CN115941432A (en) * | 2021-06-16 | 2023-04-07 | 北京字跳网络技术有限公司 | Domain name alarm information sending method and device, electronic equipment and computer readable storage medium |
| CN120455169A (en) * | 2025-07-09 | 2025-08-08 | 中国电子科技集团公司第十五研究所 | Abnormal website identification method and system |
Families Citing this family (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103399912B (en) * | 2013-07-30 | 2016-08-17 | 腾讯科技(深圳)有限公司 | A kind of fishing webpage clustering method and device |
| CN103701951B (en) * | 2013-12-27 | 2018-03-06 | 北京奇安信科技有限公司 | The analysis method of website visiting record and the analytical equipment of website visiting record |
| CN104933178B (en) * | 2015-07-01 | 2018-09-11 | 北京奇虎科技有限公司 | Official website determines method and system and the sort method of official website |
| CN106453208A (en) * | 2015-08-07 | 2017-02-22 | 北京奇虎科技有限公司 | Advertisement material data website verification method and device |
| CN106649366B (en) * | 2015-10-30 | 2020-05-22 | 北京国双科技有限公司 | Keyword search result classification method and device |
| CN108696599B (en) * | 2017-04-07 | 2021-02-19 | 北京上元信安技术有限公司 | Method, system and firewall equipment for removing redundant domain names from domain name classification feature library |
| CN117892801B (en) * | 2024-03-13 | 2024-06-21 | 鹏城实验室 | Training method of domain name generation model, phishing website discovery method and related device |
| CN118972117A (en) * | 2024-07-31 | 2024-11-15 | 中信银行股份有限公司 | Phishing website detection method, detection device, processing method and processing device |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20060123464A1 (en) * | 2004-12-02 | 2006-06-08 | Microsoft Corporation | Phishing detection, prevention, and notification |
| US7698442B1 (en) * | 2005-03-03 | 2010-04-13 | Voltage Security, Inc. | Server-based universal resource locator verification service |
| CN102571404A (en) * | 2010-12-31 | 2012-07-11 | 北京新媒传信科技有限公司 | Website access statistical method and website access statistical system |
| CN102938769A (en) * | 2012-11-22 | 2013-02-20 | 国家计算机网络与信息安全管理中心 | Detection method of Domain flux botnet domain names |
| CN103399912A (en) * | 2013-07-30 | 2013-11-20 | 腾讯科技(深圳)有限公司 | Fishing web page clustering method and device |
-
2013
- 2013-07-30 CN CN201310326576.2A patent/CN103399912B/en active Active
-
2014
- 2014-07-29 WO PCT/CN2014/083261 patent/WO2015014279A1/en not_active Ceased
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20060123464A1 (en) * | 2004-12-02 | 2006-06-08 | Microsoft Corporation | Phishing detection, prevention, and notification |
| US7698442B1 (en) * | 2005-03-03 | 2010-04-13 | Voltage Security, Inc. | Server-based universal resource locator verification service |
| CN102571404A (en) * | 2010-12-31 | 2012-07-11 | 北京新媒传信科技有限公司 | Website access statistical method and website access statistical system |
| CN102938769A (en) * | 2012-11-22 | 2013-02-20 | 国家计算机网络与信息安全管理中心 | Detection method of Domain flux botnet domain names |
| CN103399912A (en) * | 2013-07-30 | 2013-11-20 | 腾讯科技(深圳)有限公司 | Fishing web page clustering method and device |
Cited By (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US10129276B1 (en) * | 2016-03-29 | 2018-11-13 | EMC IP Holding Company LLC | Methods and apparatus for identifying suspicious domains using common user clustering |
| GB2555801A (en) * | 2016-11-09 | 2018-05-16 | F Secure Corp | Identifying fraudulent and malicious websites, domain and subdomain names |
| CN115941432A (en) * | 2021-06-16 | 2023-04-07 | 北京字跳网络技术有限公司 | Domain name alarm information sending method and device, electronic equipment and computer readable storage medium |
| CN115941432B (en) * | 2021-06-16 | 2025-09-02 | 北京字跳网络技术有限公司 | Domain name alarm information sending method, device, electronic device and computer-readable storage medium |
| CN114629875A (en) * | 2022-02-10 | 2022-06-14 | 互联网域名系统北京市工程研究中心有限公司 | Active detection domain name brand protection method and device |
| CN114629875B (en) * | 2022-02-10 | 2024-06-04 | 互联网域名系统北京市工程研究中心有限公司 | Active detection domain name brand protection method and device |
| CN120455169A (en) * | 2025-07-09 | 2025-08-08 | 中国电子科技集团公司第十五研究所 | Abnormal website identification method and system |
Also Published As
| Publication number | Publication date |
|---|---|
| CN103399912B (en) | 2016-08-17 |
| CN103399912A (en) | 2013-11-20 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| WO2015014279A1 (en) | Method and device for clustering phishing webpages | |
| Rao et al. | Jail-Phish: An improved search engine based phishing detection system | |
| CN104283843B (en) | A kind of method, apparatus and system that user logs in | |
| US10142291B2 (en) | System for providing DNS-based policies for devices | |
| KR20090019451A (en) | Phishing and pharming notification methods and devices | |
| CN102957664B (en) | A kind of method and device identifying fishing website | |
| CN103442014A (en) | Method and system for automatic detection of suspected counterfeit websites | |
| CN103870553B (en) | A kind of input resource supplying method and system | |
| CN106453436A (en) | Method and device for detecting network security | |
| US10419387B2 (en) | Domain name resolution method, system, and device | |
| CN108112038B (en) | Method and device for controlling access flow | |
| CN110413978B (en) | Data paging export method, device, computer equipment and storage medium | |
| CN105516390B (en) | Domain name management method and device | |
| CN103905372A (en) | Method and device for removing false alarm of phishing website | |
| CN102882889B (en) | Method and System for Collecting and Identifying IP Concentration Based on Phishing Websites | |
| CN108011994A (en) | A kind of method and system of inquiry DNS records | |
| US20140337536A1 (en) | Method and apparatus for data communication | |
| CN105530251A (en) | Method and device for identifying phishing website | |
| CN111556109B (en) | Request processing method and device, electronic equipment and storage medium | |
| CN107148022B (en) | A kind of anti-loiter network based reminding method and relevant device | |
| CN109255254A (en) | A kind of data base authority management method, device, equipment and storage medium | |
| CN110740117B (en) | Counterfeit domain name detection method and device, electronic equipment and storage medium | |
| WO2015014271A1 (en) | Method and device for detecting jump actd/ities of phishing webpages | |
| CN109391707B (en) | Domain name resolution method, device, equipment and storage medium | |
| CN109190406A (en) | A kind of distributed storage authorization check method, permission querying method and device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| 121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 14831503 Country of ref document: EP Kind code of ref document: A1 |
|
| NENP | Non-entry into the national phase |
Ref country code: DE |
|
| 32PN | Ep: public notification in the ep bulletin as address of the adressee cannot be established |
Free format text: NOTING OF LOSS OF RIGHTS PURSUANT TO RULE 112(1) EPC (EPO FORM 1205N DATED 150716) |
|
| 122 | Ep: pct application non-entry in european phase |
Ref document number: 14831503 Country of ref document: EP Kind code of ref document: A1 |
