WO2020199029A1

WO2020199029A1 - Data processing method and apparatus therefor

Info

Publication number: WO2020199029A1
Application number: PCT/CN2019/080652
Authority: WO
Inventors: 莫邵文; 肖艳光; 向展; 周东波; 招伟俊; 黄芷然; 邝继欧; 张伟
Original assignee: 华为技术有限公司
Priority date: 2019-03-29
Filing date: 2019-03-29
Publication date: 2020-10-08
Also published as: CN113545020A; CN113545020B

Abstract

Disclosed in embodiments of the present application are a data processing method and an apparatus for implementing the method, wherein the method is applied to a gateway device. The method comprises: receiving an access request sent by a terminal device; acquiring the transfer probability of a first domain name in the access request; if the transfer probability of the first domain name is greater than a preset probability threshold, then sending the first domain name to a domain name classification server; receiving the category of the first domain name sent by the domain name classification server; and if the category of the first domain name is an allowed access category, acquiring an Internet protocol address corresponding to the first domain name, and sending the Internet protocol address to the terminal device. By means of implementing the embodiments of the present application, the first domain name may be sent to the domain name classification server only when the transfer probability of the first domain name is greater than the preset probability threshold, which may effectively reduce the load of the domain name classification server, thereby facilitating the increase of website access speed.

Description

Data processing method and device

Technical field

This application relates to the field of computer technology, and in particular to a data processing method and device.

Background technique

The Internet is playing an increasingly important role in modern people's lives, but it is undeniable that while the Internet brings people a convenient life, it also has many negative effects. For example, a large number of content containing violent, reactionary and other bad information floods the cyberspace, and is becoming more and more intense, threatening the physical and mental health of students; in addition, many students indulge in the Internet for a long time, which will cause mental and physical illnesses and affect healthy growth.

In order to prevent students from accessing undesirable websites, green Internet technology solutions have emerged. The green Internet technology solutions can effectively control the time students spend online and restrict their access to unhealthy websites. The idea of the green Internet technology solution mainly includes: the green cloud server judges whether the website corresponding to the URL in the user request is an unhealthy website according to the uniform resource locator (URL) in the black and white lists, and prevents users from accessing unhealthy websites website.

Currently, every time a user visits a website, he needs to send the URL of the website to be visited to the green cloud server to query whether the website corresponding to the URL is an unhealthy website. However, users visit a lot during the peak period of the Internet, which will make the load of the green cloud server too high, thereby affecting the speed of website access.

Summary of the invention

The embodiments of the present application provide a data processing method and device, which can effectively reduce the load of a domain name classification server, thereby helping to increase the speed of website access.

In the first aspect, an embodiment of the present application provides a data processing method. The method includes: receiving an access request sent by a terminal device, the access request includes a first domain name, and obtaining the transfer probability of the first domain name. If the transfer probability of the first domain name is Is greater than the preset probability threshold, the first domain name is sent to the domain name classification server, and the category of the first domain name sent by the domain name classification server is received. If the category of the first domain name is the allowed access category, the Internet protocol address corresponding to the first domain name is obtained , And send the Internet Protocol address to the terminal device.

In this technical solution, the transfer probability of the first domain name can be used to characterize the probability that the category of the first domain name exists in the domain name classification server, and the transfer probability of the first domain name is greater than the preset probability threshold. Sending a domain name to the domain name classification server, on the one hand, can increase the probability of successfully obtaining the category of the first domain name through the domain name server; on the other hand, it can avoid placing the first domain name when the transfer probability of the first domain name is less than or equal to the preset probability threshold. The domain name is sent to the domain name classification server, but the category of the first domain name cannot be queried, which is beneficial to reducing the load of the domain name classification server and improving the speed of website access.

In an implementation manner, the gateway device may have a domain name database, and the domain name database may include multiple domain names and categories of each of the multiple domain names; if the transfer probability of the first domain name is greater than the preset probability threshold, the first domain name The specific implementation manner of sending to the domain name classification server may be: if the transfer probability of the first domain name is greater than the preset probability threshold, and the first domain name does not exist in the domain name database, the first domain name is sent to the domain name classification server.

In this technical solution, the first domain name is sent to the domain name classification server only when it is satisfied that the transfer probability of the first domain name is greater than the preset probability threshold and the first domain name does not exist in the domain name database. This can avoid the situation where the first domain name and the category of the first domain name exist in the domain name database, but the category of the first domain name is obtained through the domain name classification server. This can reduce the communication traffic between the gateway device and the domain name classification server, which is beneficial to reduce the domain name Classify the load of the server, thereby helping to improve the speed of website access.

In an implementation manner, after receiving the category of the first domain name sent by the domain name classification server, the method may further include: associating and storing the category of the first domain name and the first domain name in a domain name database.

In this technical solution, by associating the categories of the first domain name with the first domain name and storing it in the domain name database, the first domain name can be directly obtained in the domain name database when subsequent access requests including the first domain name are received again. There is no need to obtain the category of the first domain name through the domain name classification server, which can reduce the communication traffic between the gateway device and the domain name classification server, which is beneficial to reduce the load of the domain name classification server, and is beneficial to improve the website access speed.

In an implementation manner, before the category association between the first domain name and the first domain name is stored in the domain name database, the method may further include: if there is no second domain name among the first-level domain names included in each domain name in the domain name database, Obtain the number of first-level domain names included in all domain names in the domain name database; if the number is greater than or equal to the preset number threshold, obtain the storage value of the first-level domain names included in each domain name in the domain name database; delete the target first-level domain name in the domain name database The domain name and all subdomains of the target first-level domain name. The target first-level domain name is the first-level domain name with the lowest storage value among the first-level domain names included in all domain names in the domain name database; the category association of the first domain name and the first domain name is stored in the domain name database The specific implementation in can be: the second domain name is used as the first-level domain name, the third domain name is used as the subdomain name of the second domain name, and the categories of the second domain name, the third domain name, and the first domain name are associated and stored in the domain name database .

In this technical solution, the target first-level domain name with the lowest storage value and all subdomains of the target first-level domain name are deleted from the domain name database, and then the second domain name is regarded as the first-level domain name, and the third domain name is regarded as the subdomain name of the second domain name. Domain names, and store the categories of the second, third, and first domain names in the domain name database. In this way, on the one hand, the average hit rate of the first-level domain names in the domain name database can be improved; on the other hand, When the gateway device subsequently receives an access request including the first domain name (composed of the second domain name and the third domain name) again, it can directly obtain the category of the first domain name in the domain name database of the gateway device without going through the domain name classification server Obtaining the category of the first domain name can reduce the communication traffic between the gateway device and the domain name classification server, which is beneficial to reduce the load of the domain name classification server, and thus is beneficial to improve the website access speed.

In an implementation manner, the method may further include: upon detecting that the gateway device is powered on, sending a data initialization request to the domain name classification server, the data initialization request is used to request domain name data, and the domain name data includes domain name collections and domain name collections. The category of each domain name. The domain names in the domain name set are determined by the domain name classification server according to the access time, access duration and/or access frequency of each domain name. Each domain name in the domain name set includes the first-level domain name and the sub-domain name of the first-level domain name; Receive the domain name data and store the domain name data in the domain name database.

In this technical solution, when the gateway device is powered on again, the data stored in the domain name database may be lost. When the power-on operation is detected in the embodiment of the application, the domain name can be classified by sending a data initialization request to the domain name classification server. The server requests to obtain domain name data. By storing the domain name data in the domain name database, the initialization of the domain name database can be automatically completed, which is beneficial to improve the hit rate of domain names in the domain name database, and can reduce the number of access requests obtained through the domain name classification server. The number of categories of the domain name, thereby helping to reduce the load of the domain name classification server.

In the second aspect, an embodiment of the present application provides a data processing device, which has the function of implementing the method described in the first aspect. The function can be realized by hardware, or by hardware executing corresponding software. The hardware or software includes one or more units corresponding to the above functions.

In a third aspect, an embodiment of the present application provides a gateway device. The gateway device includes a memory and a processor. The memory stores program instructions. The processor is connected to the memory via a bus. The processor calls the program instructions stored in the memory to enable the service The device executes the method described in the first aspect.

In a fourth aspect, an embodiment of the present application provides a computer-readable storage medium for storing computer program instructions used by the data processing device described in the second aspect, including instructions for executing the program involved in the first aspect.

In a fifth aspect, an embodiment of the present application provides a computer program product, which includes a program, which implements the method described in the first aspect when the program is executed.

Description of the drawings

FIG. 1 is a schematic diagram of the architecture of a communication system provided by an embodiment of the present application;

2 is a schematic flowchart of a data processing method provided by an embodiment of the present application;

FIG. 3 is a schematic flowchart of another data processing method provided by an embodiment of the present application;

FIG. 4 is a schematic flowchart of another data processing method provided by an embodiment of the present application;

FIG. 5 is a schematic diagram of a scenario where there is a hierarchical storage relationship between a first-level domain name and a subdomain name provided by an embodiment of the present application;

Fig. 6 is a schematic structural diagram of a data processing device provided by an embodiment of the present application;

Fig. 7 is a schematic structural diagram of a gateway device provided by an embodiment of the present application.

detailed description

The specific embodiments of the present application will be further described in detail below in conjunction with the accompanying drawings.

In order to better understand the embodiments of the present application, a communication system applicable to the embodiments of the present application will be described below.

Please refer to FIG. 1, which is a schematic diagram of the architecture of a communication system provided by an embodiment of this application. As shown in FIG. 1, the system may include: a terminal device 101, a gateway device 102, and a domain name classification server 103.

The terminal device 101 is mainly used to generate an access request and send the access request to the gateway device 102. The access request may include a domain name, and the access request is used to obtain content recorded in a website corresponding to the domain name. A domain name is the name of a computer or group of computers on a network consisting of a string of names separated by dots, used to identify the electronic location of the computer during data transmission. For example, when the user inputs a URL in the browser of the terminal device 101 through the input device and clicks an access button, the terminal device 101 may generate an access request according to the domain name in the URL. In an implementation manner, the terminal device 101 may be a user equipment (user equipment, UE), a remote terminal, a mobile terminal, a wireless communication device, a user device, or the like.

The gateway device 102 is mainly used to determine whether to send the domain name to the domain name classification server 103 according to whether the transfer probability of the domain name in the access request is greater than a preset probability threshold; and after sending the domain name to the domain name classification server 103, receive the domain name classification The category of the domain name sent by the server 103, and then, when the category of the domain name is an allowed access category, the Internet protocol address corresponding to the domain name is obtained, and the Internet protocol address is sent to the terminal device 101 so that the terminal device 101 can obtain the The content stored in the storage device corresponding to the Internet Protocol address.

Specifically, the gateway device 102 may send the domain name to the domain name classification server 103 when the transfer probability of the domain name is greater than the preset probability threshold; and when the transfer probability of the domain name is less than or equal to the preset probability threshold, not send the domain name The domain name is sent to the domain name classification server 103. Among them, the domain name classification server 103 stores a large number of domain names and categories of various domain names, and the category of each domain name can be an access allowed category or an access prohibited category. When the category of the domain name is an allowed access category, it indicates that the website corresponding to the domain name is a healthy website; when the category of the domain name is a prohibited access category, it indicates that the website corresponding to the domain name is an unhealthy website. In one implementation, the domain name stored in the domain name classification server 103 may be crawled from multiple websites by the domain name classification server 103 through a web crawler, and the category of each domain name may be the domain name classification server 103 through the webpage corresponding to the domain name. The content is analyzed.

In an implementation manner, the website corresponding to the domain name stored in the domain name classification server 103 may be a website with relatively high traffic or a relatively common website. In this embodiment of the application, the transfer probability of a domain name may be used to characterize the probability that the category of the domain name is stored in the domain name classification server 103. For example, for the domain names in the access request generated by some background plug-ins running in the terminal device 101, the websites corresponding to these domain names are relatively uncommon and have low traffic. Therefore, the probability of these domain names being crawled by the domain name classification server 103 is low Correspondingly, the probability that the categories of these domain names are stored in the domain name classification server 103 is low. In other words, even if the gateway device 102 sends these domain names to the domain name classification server 103, the domain name classification server 103 queries the domain name classification server 103 to obtain the categories of these domain names. The probability is also low. Therefore, in this embodiment of the present application, the gateway device 102 sends the domain name to the domain name classification server 103 only when the transfer probability of the domain name is greater than the preset probability threshold, which can avoid when the transfer probability of the domain name is less than or equal to the preset probability threshold When the domain name is sent to the domain name classification server 103 but the category of the domain name cannot be queried, it is beneficial to reduce the load of the domain name classification server 103.

In an implementation manner, the gateway device 102 may be an optical network terminal (Optical network terminal, ONT), an optical network unit (Optical Network Unit, ONU), or an intelligent gateway device with routing function, etc. This embodiment of the application does not do this. limited. In an implementation manner, the domain name classification server 103 may be a physical server or a cloud server (such as a green cloud server in the green Internet technical solution), which is not limited in the embodiment of the present application.

It should be noted that the above-mentioned communication system includes a terminal device 101 for example only. In other feasible implementation manners, the communication system may include 2, 3, or other numbers of terminal devices. This embodiment of the application does not deal with this. limited.

It is understandable that the network architecture described in the embodiments of this application is to illustrate the technical solutions of the embodiments of this application more clearly, and does not constitute a limitation on the technical solutions provided in the embodiments of this application. Those of ordinary skill in the art will know that With the evolution of the system architecture and the emergence of new business scenarios, the technical solutions provided in the embodiments of the present application are equally applicable to similar technical problems.

The data processing method and device provided by this application are described in detail below.

Based on the schematic structural diagram of the communication system shown in FIG. 1, please refer to FIG. 2. FIG. 2 is a schematic flowchart of a data processing method provided by an embodiment of the present application. The method may include but is not limited to the following steps:

Step S201: The gateway device receives the access request sent by the terminal device, where the access request includes the first domain name.

Specifically, after receiving the access request sent by the terminal device, the gateway device may parse the access request to obtain the first domain name. In an implementation manner, the access request may be generated by the terminal device according to a user operation, or the access request may be generated by a background plug-in in the terminal device, which is not limited in the embodiment of the present application. In one implementation, the gateway device can receive access requests sent by one or more terminal devices, and the gateway device processes the access requests sent by each terminal device in the same way. In this embodiment of the application, the gateway device receives one terminal device to send As an example, the visit request of.

Step S202: The gateway device obtains the transfer probability of the first domain name.

Specifically, after the gateway device obtains the first domain name, it needs to obtain the category of the first domain name. In the embodiment of this application, multiple domain names and categories of each domain name may be stored in the domain name classification server. In an implementation manner, the website corresponding to the domain name stored in the domain name classification server may be a website with a higher traffic volume or More common sites. In an implementation manner, the category of the first domain name may or may not exist in the domain name classification server. In this embodiment of the application, the transfer probability of the first domain name may be used to characterize the probability that the category of the first domain name exists in the domain name classification server. In an implementation manner, the transfer probability of the first domain name is greater than the preset probability threshold. , Indicating that the category of the first domain name has a high probability of being in the domain name classification server; the transfer probability of the first domain name is less than or equal to the preset probability threshold, indicating that the category of the first domain name has a low probability of being in the domain name classification server . The gateway device may determine whether to send the first domain name to the domain name classification server according to whether the transfer probability of the first domain name is greater than the preset probability threshold. Specifically, the gateway device may determine whether the transfer probability of the first domain name is greater than the preset probability threshold. In this case, the first domain name is sent to the domain name classification server; and when the transfer probability of the first domain name is less than or equal to the preset probability threshold, the first domain name is not sent to the domain name classification server. In this way, it is possible to avoid the situation that when the transfer probability of the first domain name is less than or equal to the preset probability threshold, the first domain name is sent to the domain name classification server but the category of the first domain name cannot be obtained, which is beneficial to reduce The load of the domain name classification server is conducive to improving the speed of website access.

In an implementation manner, the first domain name may include a character string, and a specific implementation manner for the gateway device to obtain the transfer probability of the first domain name may be: obtain each character pair in the character string and the transfer probability of each character pair, and according to The transition probability of each character pair is obtained, and the transition probability of the character string is taken as the transition probability of the first domain name. Among them, a character pair refers to two adjacent characters in the character string included in the first domain name. If the character string includes n characters, the number of character pairs in the character string is n-1 (n>=2) . For example, when the character string included in the first domain name is "www.abc.com", the character pairs in the character string are: "ww", "ww", "w.", ".a", "ab" , "Bc", "c.", ".c", "co" and "om". In one implementation, the transition probability of each character pair can be obtained by training the character conversion model based on the Markov chain. The discrete event random process with Markov property in Markov chain indexology, at each step In, the system can change from one state to another according to the probability distribution, or it can maintain the current state. The change of state is called transition, and the probability related to different state changes is called transition probability. In the embodiment of the present application, the transition probability of the character pair "ab" is the probability that the next character of the character "a" is "b".

In one implementation, the training process of the character conversion model based on Markov chain is as follows: Obtain a large number of domain names, split each domain name to obtain character pairs in each domain name, and then count the number of occurrences of each character pair , And standardize the total number of occurrences of each character pair (such as normalization processing) to obtain the transition probability of each character pair.

In an implementation manner, the gateway device obtains the transfer probability of the character string included in the first domain name according to the transfer probability of each character pair may be: splitting the first domain name to obtain the transfer probability of the first domain name For each character pair, the transition probability of each character pair included in the first domain name is obtained according to the character conversion model based on Markov chain, and the product of the transition probability of each character pair included in the first domain name is taken as the character string included in the first domain name The transition probability. For example, when the character string included in the first domain name is "abc", and the transition probability of the character pair "ab" is p1, and the transition probability of the character pair "bc" is p2, the transition probability of the character string "abc" is p1* p2.

Step S203: If the transfer probability of the first domain name is greater than the preset probability threshold, the gateway device sends the first domain name to the domain name classification server.

Specifically, after the gateway device obtains the transfer probability of the first domain name, it can determine whether to send the first domain name to the domain name classification server according to whether the transfer probability of the first domain name is greater than the preset probability threshold, by sending the first domain name to the domain name The classification server can query the category of the first domain name in the domain name classification server. In an implementation manner, the category of the first domain name may or may not exist in the domain name classification server. In one implementation, the transfer probability of the first domain name is greater than the preset probability threshold, indicating that the category of the first domain name has a higher probability of being in the domain name classification server. At this time, the gateway device sends the first domain name to the domain name classification The server can make the probability of obtaining the category of the first domain name by querying the domain name classification server higher.

In an implementation manner, the transfer probability of the first domain name is less than or equal to the preset probability threshold, indicating that the probability that the first domain name category exists in the domain name classification server is low. In this case, the gateway device may not transfer the first domain name Send to the domain name classification server, and directly obtain the Internet Protocol address corresponding to the first domain name, and send the obtained Internet Protocol address to the terminal device; or, the gateway device may not send the first domain name to the domain name classification server, and directly ignore or Delete access request. In this way, it is possible to avoid the situation that when the transfer probability of the first domain name is less than or equal to the preset probability threshold, the first domain name is sent to the domain name classification server but the category of the first domain name cannot be obtained, which is beneficial to reduce The load of the domain name classification server.

In an implementation manner, the preset probability threshold may be set by the gateway device by default, or may be set by the gateway device according to user operations, which is not limited in the embodiment of the present application. For example, the gateway device may calculate and count the transfer probabilities of a large number of common domain names, and use the average value of the transfer probabilities of each common domain name as the preset probability threshold.

Step S204: The domain name classification server queries the category of the first domain name.

Specifically, after the domain name classification server receives the first domain name sent by the gateway device, it can query whether the first domain name exists. If the first domain name exists, continue to query the category of the first domain name. The category of the first domain name can be access allowed Category or forbidden category; if the first domain name does not exist, a query failure message is sent to the gateway device, and the query failure message is used to indicate that the first domain name or the category of the first domain name does not exist in the domain name classification server.

Step S205: The domain name classification server sends the category of the first domain name to the gateway device.

Specifically, after the domain name classification server finds the category of the first domain name, it can send the category of the first domain name to the gateway device, so that after receiving the category of the first domain name sent by the domain name classification server, the gateway device can The categories of the received access requests are processed differently.

Step S206: If the category of the first domain name is the allowed access category, the gateway device obtains the Internet Protocol address corresponding to the first domain name, and sends the Internet Protocol address to the terminal device.

Specifically, after the gateway device receives the category of the first domain name sent by the domain name classification server, if the category of the first domain name is an allowed access category, it indicates that the website corresponding to the first domain name is a healthy website. At this time, the gateway device can obtain the category of the first domain name. An Internet Protocol address corresponding to a domain name, and the Internet Protocol address is sent to the terminal device, so that the terminal device can obtain the content stored in the storage device corresponding to the Internet Protocol address. In one implementation, if the category of the first domain name is forbidden, it indicates that the website corresponding to the first domain name is an unhealthy website. At this time, the gateway device can ignore or delete the access request corresponding to the first domain name to prevent the terminal The device obtains content from unhealthy websites and affects the user's mental health.

In one implementation, there is a Domain Name System (DNS) cache in the gateway device. Multiple domain names and the Internet protocol address corresponding to each domain name are recorded in the DNS cache. The gateway device obtains the Internet protocol address corresponding to the first domain name. A specific implementation manner may be: the gateway device queries the Internet Protocol address corresponding to the first domain name in the DNS cache. In an implementation manner, the specific implementation manner for the gateway device to obtain the Internet Protocol address corresponding to the first domain name may also be: the gateway device sends the first domain name to the domain name resolution server, so that the domain name resolution server queries the Internet corresponding to the first domain name Protocol address, and receive the Internet protocol address sent by the domain name resolution server. In an implementation manner, the specific implementation manner for the gateway device to obtain the Internet Protocol address corresponding to the first domain name may also be: the gateway device queries in the DNS cache whether the Internet Protocol address corresponding to the first domain name exists, and if it does not exist in the DNS cache The internet protocol address corresponding to the first domain name is sent to the domain name resolution server, so that the domain name resolution server queries the internet protocol address corresponding to the first domain name and receives the internet protocol address sent by the domain name resolution server.

Compared with the prior art when filtering URLs, encrypted traffic cannot be intercepted and needs to be unpacked, and when filtering URLs, only HyperText Transfer Protocol (HTTP) traffic and traffic on well-known ports can be intercepted. It cannot intercept the traffic of other protocols, the traffic of dynamic ports, or the traffic of private ports. The embodiment of the application filters the domain name, and since the domain name data packet does not need to be unpacked, the cost of unpacking the gateway device can be effectively reduced. In addition, since the domain name does not include the protocol and port number, the embodiment of the present application can intercept any protocol's data as long as the first domain name included in the access request meets the interception requirements (for example, the category of the first domain name is forbidden) Traffic and traffic on any port.

In an implementation manner, the aforementioned access request may also include the identification of the terminal device. After step S201 (that is, the gateway device receives the access request sent by the terminal device), the gateway device may also determine whether the identification of the terminal device is a preset identification. If the identification of the terminal device is the preset identification, step S202 is triggered (ie, the transfer probability of the first domain name is acquired); if the identification of the terminal device is not the preset identification, the acquisition of the Internet Protocol address corresponding to the first domain name is triggered, and The step of sending the Internet Protocol address to the terminal device.

The identification of the terminal device is used to uniquely identify a terminal device. In an implementation manner, the identification of the terminal device may be the unique identification code of the terminal device or the physical address of the terminal device, which is not limited in the embodiment of this application. . The preset identifier may be a preset identifier of a terminal device that needs to restrict access requests. In one implementation, it is applied to a green Internet technical solution, and the preset identifier may be an identifier of a minor terminal device . Before obtaining the transfer probability of the first domain name, this embodiment of the application determines whether the terminal device's identification is a preset identification, and triggers the execution of obtaining the transfer probability of the first domain name when the terminal device's identification is the preset identification The steps can avoid triggering the acquisition of the access request when the terminal device's identifier is not the preset identifier (that is, the terminal device (such as the terminal device of an adult or parent) should not be restricted) Include the steps of the transfer probability of the first domain name, so that on the one hand, it can avoid intercepting the access request initiated by the parent's (or adult) terminal device, thereby causing misoperation; on the other hand, it can also avoid unnecessary expenses and reduce the gateway The load of the device and the domain name classification server. In an implementation manner, the preset identifier may be set by the gateway device according to user operations.

It can be seen that by implementing the embodiments of this application, the first domain name can be sent to the domain name classification server only when the transfer probability of the first domain name is greater than the preset probability threshold. This can prevent the transfer probability of the first domain name from being less than or When it is equal to the preset probability threshold, the first domain name is sent to the domain name classification server but the category of the first domain name cannot be queried, thereby helping to reduce the load of the domain name classification server and improving the website access speed.

Please refer to Figure 3, which is a schematic flow chart of another data processing method provided by an embodiment of the present application. This method elaborates only when the transfer probability of the first domain name is greater than the preset probability threshold at the same time, and the domain name database is not The reason why the first domain name is sent to the domain name classification server only when the first domain name exists, the method includes but is not limited to the following steps:

Step S301: The gateway device receives the access request sent by the terminal device, where the access request includes the first domain name.

Step S302: The gateway device obtains the transfer probability of the first domain name.

It should be noted that the specific execution process of step S301 to step S302 can be referred to the specific description of step S201 to step S202 in FIG. 2 respectively, which is not repeated here.

In an implementation manner, the gateway device may have a domain name database, and the domain name database may include multiple domain names and categories of each of the multiple domain names.

Step S303: If the transfer probability of the first domain name is greater than the preset probability threshold, and the first domain name does not exist in the domain name database, the gateway device sends the first domain name to the domain name classification server.

Specifically, after the gateway device receives the access request sent by the terminal device, it can determine whether the transfer probability of the first domain name is greater than the preset probability threshold, and determine whether the first domain name exists in the domain name database, and only when the first domain name transfer is satisfied at the same time When the probability is greater than the preset probability threshold and the first domain name does not exist in the domain name database, the first domain name is sent to the domain name classification server. This can avoid the situation that the gateway device obtains the category of the first domain name through the domain name classification server when the first domain name and the category of the first domain name exist in the domain name database. This can reduce the communication traffic between the gateway device and the domain name classification server, which is beneficial to Reduce the load of the domain name classification server, thereby helping to improve the speed of website access.

In one implementation, the domain name stored in the domain name database is less than the domain name stored in the domain name classification server, so the probability of obtaining the category of the first domain name in the domain name database is lower than that of obtaining the first domain name in the domain name classification server. The probability of the category, that is, when the first domain name does not exist in the domain name database, by sending the first domain name to the domain name classification server, the category of the first domain name can be queried in the domain name classification server.

In an implementation manner, after receiving the access request sent by the terminal device, the gateway device may first determine whether the transfer probability of the first domain name is greater than the preset probability threshold, and when the transfer probability of the first domain name is greater than the preset probability threshold , It is determined whether the first domain name exists in the domain name database; when the transfer probability of the first domain name is less than or equal to the preset probability threshold, the gateway device can trigger to obtain the Internet Protocol address corresponding to the first domain name, and send the Internet Protocol address to The step of the terminal device, or the gateway device may ignore or delete the access request corresponding to the first domain name. In one implementation, after receiving the access request sent by the terminal device, the gateway device may first determine whether the first domain name exists in the domain name database, and only determine whether the first domain name exists in the domain name database. Whether the transfer probability is greater than the preset probability threshold; when the first domain name exists in the domain name database, the gateway device can continue to query the domain name database for the category of the first domain name, and if the category of the first domain name is the allowed access category, it will trigger the acquisition of the first domain name Corresponding to the Internet Protocol address, and the step of sending the Internet Protocol address to the terminal device, if the category of the first domain name is a forbidden category, then ignore or delete the access request corresponding to the first domain name. It should be noted that the embodiment of the application does not limit the execution order of judging whether the transfer probability of the first domain name is greater than the preset probability threshold and judging whether the first domain name exists in the domain name database. It can be executed in a sequential order or Simultaneous execution.

Step S304: The domain name classification server queries the category of the first domain name.

Step S305: The domain name classification server sends the category of the first domain name to the gateway device.

Step S306: If the category of the first domain name is the allowed access category, the gateway device obtains the Internet Protocol address corresponding to the first domain name, and sends the Internet Protocol address to the terminal device.

It should be noted that the specific execution process of step S304 to step S306 can be referred to the specific description of step S204 to step S206 in FIG. 2 respectively, which will not be repeated here.

In an implementation manner, after step S304 (that is, the gateway device receives the category of the first domain name sent by the domain name classification server), the gateway device may associate the first domain name with the category of the first domain name and store it in the domain name database. In this way, the first domain name and the category of the first domain name can be added to the domain name database, so that when the gateway device subsequently receives an access request including the first domain name again, it can be directly stored in the domain name database in the gateway device Obtain the category of the first domain name without having to obtain the category of the first domain name through the domain name classification server. This can reduce the communication traffic between the gateway device and the domain name classification server, which is beneficial to reduce the load of the domain name classification server, thereby helping to improve website access speed.

In one implementation, when the gateway device detects the power-on operation, it can send a data initialization request to the domain name classification server, and receive the domain name data sent by the domain name classification server, and store the domain name data in the domain name database, where the data The initialization request can be used to request domain name data. The domain name data can include the domain name collection and the category of each domain name in the domain name collection. The domain name in the domain name collection can be determined by the domain name classification server according to the access time, access duration and/or access frequency of each domain name Yes, each domain name in the domain name set can include the first-level domain name and the sub-domain name of the first-level domain name.

In an implementation manner, when the gateway device is powered on again, the data stored in the domain name database may be lost. When the power-on operation is detected in the embodiment of the application, the data initialization request can be sent to the domain name classification server. The classification server requests to obtain domain name data. By storing the domain name data in the domain name database, the initialization of the domain name database can be automatically completed. This helps to improve the hit rate of domain names in the domain name database, and can reduce the number of access requests obtained through the domain name classification server. The number of categories of a domain name, thereby helping to reduce the load of the domain name classification server.

In one implementation, the domain name classification server can count the access time, access duration, and/or access frequency of each domain name stored in the domain name classification server, and perform a weighted calculation on the access time, access duration, and/or access frequency of each domain name. Sum operation to obtain the access value of each domain name, and select the first number of domain names from all the domain names stored in the domain name classification server according to the order of access value from high to low. The first number of domain names form a domain name set and obtain the domain name The category of each domain name in the set is collected, and the domain name set and the category of each domain name in the domain name set are sent to the gateway device as domain name data. Among them, the access time of the domain name can refer to the last time the domain name was hit in the domain name classification server; the access time of the domain name can refer to the total number of hits during the storage period of the domain name in the domain name classification server; the access frequency of the domain name can be Refers to the ratio of the total number of hits during the storage period of the domain name in the domain name classification server to the total storage duration. The higher the visit value of the domain name indicates the higher the probability of the domain name being hit in the domain name classification server, or the user is more inclined to visit the website corresponding to the domain name with higher visit value. Therefore, sending a domain name with a higher access value to the gateway device can increase the probability that the domain name in the gateway device is hit, thereby helping to reduce the load of the domain name classification server.

In an implementation manner, when the gateway device stores each domain name in the domain name set, each domain name may be divided into multi-level storage. The embodiment of the present application takes each domain name divided into two-level storage as an example for introduction. When the gateway device divides each domain name into two levels of storage, each domain name may include the first-level domain name and the subdomain name of the first-level domain name. The first-level domain name may refer to the top-level domain name or the next-level domain name of the top-level domain name. This is not limited. For example, when the first-level domain name refers to the top-level domain name and the domain name is "www.abc.com", the first-level domain name of the domain name can be ".com", and the subdomain name of the first-level domain name can be "www.abc". For another example, when the first-level domain name refers to the next-level domain name of the top-level domain name, and the domain name is "www.abc.com", the first-level domain name of the domain name can be "abc.com", and the subdomains of the first-level domain name can be As "www". In an implementation manner, when the gateway device divides each domain name in the domain name set into two-level storage, it can store the hash value of the first-level domain name of each domain name and the hash value of the sub-domain name of the first-level domain name. When the gateway device uses a two-level storage method to store the domain name, the specific implementation manner for the gateway device to determine whether the first domain name exists in the domain name database may be: determining whether the hash value of the first-level domain name included in the first domain name exists in the domain name database, if the first If the hash value of the first-level domain name included in a domain name does not exist in the domain name database, it indicates that the first domain name does not exist in the domain name database. In this way, only the hash value of the first-level domain name included in the first domain name needs to be calculated, instead of calculating the hash value of the complete first domain name, the power consumption of the gateway device can be reduced.

By implementing the embodiments of this application, the first domain name can be sent to the domain name classification server only when the transfer probability of the first domain name is greater than the preset probability threshold and the first domain name does not exist in the domain name database. Avoid the situation where the first domain name and the category of the first domain name exist in the domain name database, but the category of the first domain name is obtained through the domain name classification server. This can reduce the communication traffic between the gateway device and the domain name classification server, which is beneficial to reduce the domain name classification server The load, which helps to improve the speed of website access.

Please refer to Figure 4. Figure 4 is a schematic flow diagram of another data processing method provided by an embodiment of this application. This method explains in detail how to update the domain name when there is a hierarchical storage relationship between the first-level domain name and the sub-domain name in the domain name database The first-level domain name and subdomain name stored in the database, the method includes but not limited to the following steps:

Step S401: The gateway device receives an access request sent by the terminal device, where the access request includes a first domain name, and the first domain name includes a second domain name and a third domain name.

In the embodiment of the present application, the gateway device may have a domain name database, and each domain name stored in the domain name database may be divided into multi-level storage. The embodiment of the present application takes the two-level storage of each domain name as an example for introduction. Specifically, each domain name in the domain name database may include a first-level domain name and a subdomain name of the first-level domain name. The first-level domain name may refer to a top-level domain name or a sub-domain name of the top-level domain name, which is not limited in this application embodiment. . In an implementation manner, the second domain name included in the first domain name in the access request may be a first-level domain name, and the third domain name included in the first domain name in the access request may be a subdomain name of the second domain name.

It should be noted that, for the specific execution process of the gateway device receiving the access request sent by the terminal device, refer to the specific description of step S201 in FIG. 2, which will not be repeated here.

Step S402: The gateway device judges whether there is a second domain name among the first-level domain names included in each domain name in the domain name database.

In this embodiment of the application, the domain names in the domain name database are stored in a two-level storage manner (for example, divided into first-level domain names and sub-domain names), and there may be a hierarchical storage relationship between the first-level domain names and sub-domain names. Take the scenario diagram of the hierarchical storage relationship between the first-level domain name and the subdomain name shown in Figure 5 as an example, when the complete domain name actually stored in the domain name database is "www.abc.com", "blog.xx.com" and When "blog.xx.net" and the first-level domain name and subdomain name in the domain name database have a hierarchical storage relationship, the storage form of these three complete domain names in the domain name database is shown in Figure 5.

In one implementation, after the gateway device receives the access request sent by the terminal device, it can first determine whether the first domain name exists in the domain name database. If the first domain name does not exist in the domain name database, it triggers the transfer probability of obtaining the first domain name , To determine whether the transfer probability of the first domain name is greater than the preset probability threshold. In this way, when the first domain name exists in the domain name database, that is, when the category of the first domain name can be directly queried in the domain name database, It is possible to avoid obtaining the transfer probability of the first domain name and avoid requesting the domain name classification server to obtain the category of the first domain name, thereby helping to reduce the overhead of the gateway device and the domain name classification server at the same time.

In one implementation, when the domain name in the domain name database is stored in a two-level storage mode, and there is a hierarchical storage relationship between the first-level domain name and the sub-domain name, the gateway device determines whether the first domain name exists in the domain name database. The method can be: the gateway device judges whether there is a second domain name among the first-level domain names included in each domain name in the domain name database. If it does not exist, it means that the first domain name does not exist in the domain name database; if so, it continues to determine whether the second domain name exists in the domain name database. Whether the third domain name exists in the subdomain name of the second domain name, if the third domain name does not exist in the subdomain name of the second domain name in the domain name database, it means that the first domain name does not exist in the domain name database, if the second domain name in the domain name database If the third domain name exists in the subdomain name of, it indicates that the first domain name exists in the domain name database.

In this embodiment of the application, if the second domain name does not exist among the first-level domain names included in each domain name in the domain name database, step S403 may be executed. If the second domain name exists among the first-level domain names included in each domain name in the domain name database, Then step S408 can be executed.

Step S403: If the second domain name does not exist among the first-level domain names included in each domain name in the domain name database, the gateway device obtains the transfer probability of the first domain name.

Specifically, if the second domain name does not exist in the first-level domain names included in each domain name in the domain name database, it indicates that the first domain name does not exist in the domain name database. At this time, the gateway device needs to request the domain name classification server to obtain the category of the first domain name. . In an implementation manner, when the first domain name does not exist in the domain name database, the gateway device can obtain the transfer probability of the first domain name, and then estimate the transfer probability of the first domain name according to whether the transfer probability of the first domain name is greater than a preset probability threshold. The probability that the category is stored in the domain name classification server, and when the probability that the category of the first domain name is stored in the domain name classification server is high, the first domain name is sent to the domain name classification server.

It should be noted that, for the specific execution process of the gateway device obtaining the transfer probability of the first domain name, refer to the specific description of step S202 in FIG. 2, which is not repeated here.

Step S404: If the transfer probability of the first domain name is greater than the preset probability threshold, the gateway device sends the first domain name to the domain name classification server, so that the domain name classification server queries the category of the first domain name, and the gateway device receives the first domain name sent by the domain name classification server. A category of a domain name. If the category of the first domain name is an allowed access category, the Internet Protocol address corresponding to the first domain name is obtained, and the Internet Protocol address is sent to the terminal device.

It should be noted that the specific execution process of step S404 can refer to the specific description of step S203 to step S206 in FIG. 2, which is not repeated here.

Step S405: The gateway device obtains the number of first-level domain names included in all domain names in the domain name database, and determines whether the number of first-level domain names included in all domain names in the domain name database is greater than or equal to a preset number threshold.

Specifically, after receiving the category of the first domain name sent by the domain name classification server, the gateway device may associate the category of the first domain name with the first domain name and store it in the domain name database. When the domain name database in the gateway device uses a two-level storage method to store domain names and there is a hierarchical storage relationship between the first-level domain name and the sub-domain name, the gateway device can store the first-level domain name (that is, the second domain name) and the first-level domain name included in the first domain name. The category association of the subdomain name (ie the third domain name) of the domain name and the first domain name is stored in the domain name database. In this way, the first domain name and the category of the first domain name can be added to the domain name database, so that when the gateway device subsequently receives an access request that includes the first domain name again, it can directly obtain the first domain name in the domain name database. There is no need to obtain the category of the first domain name through the domain name classification server, which can reduce the communication traffic between the gateway device and the domain name classification server, which is beneficial to reduce the load of the domain name classification server, and is beneficial to improve the website access speed.

In an implementation manner, because the storage space of the gateway device is limited, the gateway device can limit the number of first-level domain names stored in the domain name database and limit the number of subdomains of each first-level domain name. For example, the gateway device can set the upper limit of the number of first-level domain names stored in the domain name database to a preset number threshold (such as 10 or other numbers), and set the upper limit of the number of subdomains of each first-level domain name stored in the domain name database as the first predetermined number. Set the number threshold (such as 20 or other numbers), that is, when the upper limit of the number of first-level domain names stored in the domain name database is 10, and the upper limit of the number of sub-domain names of each first-level domain name stored in the domain name database is 20 At the time, the upper limit of the number of domain names stored in the domain name database is equivalent to 200. It should be noted that the gateway device can modify the upper limit of the number of first-level domain names and the upper limit of the number of subdomains of each first-level domain name according to user operations.

In one implementation, after the gateway device receives the category of the first domain name sent by the domain name classification server, if the second domain name does not exist in the first-level domain names included in each domain name in the domain name database, the gateway device needs to be in the domain name database When adding the second domain name, the third domain name, and the first domain name category composed of the second domain name and the third domain name, the gateway device needs to first determine whether the total number of first-level domain names stored in the domain name database is greater than or equal to the preset number threshold If the total number of first-level domain names stored in the domain name database is less than the preset number threshold, the gateway device can directly add the categories of the second domain name, the third domain name, and the first domain name in the domain name database; If the total number of first-level domain names is greater than or equal to the preset number threshold, the gateway device needs to determine the target first-level domain name in the domain name database, and delete the target first-level domain name and all subdomains of the target first-level domain name before adding it to the domain name database The category of the second domain name, third domain name, and first domain name. Among them, the preset number threshold is the upper limit of the preset first-level domain names. When the total number of first-level domain names stored in the domain name database is greater than the preset number threshold, it indicates that the total number of first-level domain names stored in the domain name database exceeds the preset number. Set the upper limit of the number of first-level domain names; when the total number of first-level domain names stored in the domain name database is equal to the preset number threshold, it indicates that adding a first-level domain name to the domain name database will increase the total number of first-level domain names in the domain name database. The number exceeds the preset upper limit number of first-level domain names. In an implementation manner, the preset number threshold may be set by the gateway device by default, or may be set by the gateway device according to user operations, which is not limited in this embodiment of the application. It should be noted that because the physical storage space of the gateway device is limited, and if the number of first-level domain names stored in the domain name database of the gateway device is too large, the load of the gateway device will be too high when querying the domain name database. Therefore, the preset preset The number threshold should be less than or equal to the physical upper limit of the first-level domain name in the gateway device. The physical upper limit of the first-level domain name can be set by the gateway device at the factory.

It should be noted that after the gateway device receives the category of the first domain name sent by the domain name classification server, it may first execute the step of obtaining the Internet Protocol address corresponding to the first domain name, and then execute step S405; or, it may execute step S405 first, and then The step of obtaining the internet protocol address corresponding to the first domain name is performed; or, the step S405 and the step of obtaining the internet protocol address corresponding to the first domain name may be performed at the same time, which is not limited in the embodiment of the present application.

Step S406: If the number of first-level domain names is greater than or equal to the preset number threshold, the gateway device obtains the storage value of the first-level domain names included in each domain name in the domain name database, and deletes the target first-level domain name and the target first-level domain name in the domain name database The target first-level domain name is the first-level domain name with the lowest storage value among all the first-level domain names included in the domain name database.

Among them, the higher the storage value of the first-level domain name, the higher the probability of the first-level domain name being hit in the domain name database. Therefore, the gateway device determines the first-level domain name with the lowest storage value as the target first-level domain name, and then uses the first domain name The included second domain name replaces the target first-level domain name, which can increase the average hit rate of the first-level domain name in the domain name database, thereby minimizing the communication traffic between the gateway device and the domain name classification server, thereby helping to reduce the load of the domain name classification server .

In an implementation manner, the specific implementation manner for the gateway device to obtain the storage value of the first-level domain names included in each domain name in the domain name database may be: the gateway device according to the use time, use time and length of the first-level domain names included in each domain name in the domain name database / Or frequency of use, to obtain the storage value of the first-level domain names included in each domain name in the domain name database. Specifically, the gateway device may perform a weighted sum operation on the use time, use duration, and/or use frequency of the first-level domain names included in each domain name in the domain name database to obtain the storage value of the first-level domain names included in each domain name in the domain name database. Among them, the use time of the first-level domain name can refer to the last time the first-level domain name was hit in the domain name database; the use time of the first-level domain name can refer to the total number of times the first-level domain name was hit during the storage period in the domain name database ; The frequency of use of the first-level domain name may refer to the ratio between the total number of hits during the storage period of the first-level domain name in the domain name database and the total storage duration.

In one implementation, if the number of first-level domain names is less than the preset number threshold, the gateway device can directly associate the categories of the second domain name, the third domain name, and the first domain name in the domain name database, that is, the gateway device can directly Step S407 is executed.

Step S407: The gateway device uses the second domain name as the first-level domain name, and the third domain name as the subdomain name of the second domain name, and stores the second domain name, the third domain name, and the category of the first domain name in the domain name database in association with each other.

Specifically, after the gateway device deletes the target first-level domain name and all subdomains of the target first-level domain name in the domain name database, it can use the second domain name as the first-level domain name, the third domain name as the subdomain name of the second domain name, and the first The category association of the second domain name, the third domain name and the first domain name is stored in the domain name database. In this way, when the gateway device subsequently receives an access request including the first domain name (consisting of the second domain name and the third domain name) again, it can directly obtain the category of the first domain name in the domain name database without passing the domain name. The classification server obtains the category of the first domain name, so that the communication traffic between the gateway device and the domain name classification server can be reduced, which is beneficial to reduce the load of the domain name classification server, and thus is beneficial to improve the website access speed.

Step S408: If there is a second domain name among the first-level domain names included in each domain name in the domain name database, the gateway device determines whether the third domain name exists in the subdomain names of the second domain name in the domain name database.

Specifically, since the domain names in the domain name database are stored in a two-level storage manner, and there is a hierarchical storage relationship between the first-level domain name and the subdomain name, therefore, only the second domain name and the subdomain name of the second domain name exist in the domain name database When the third domain name exists, it can be determined that the first domain name exists in the domain name database. Therefore, if there is a second domain name in the first-level domain name included in each domain name in the domain name database, the gateway device needs to further determine whether the third domain name exists in the subdomain name of the second domain name in the domain name database, in order to determine whether the first domain name exists in the domain name database. A domain name.

Step S409: If the third domain name exists in the subdomain name of the second domain name in the domain name database, the gateway device queries the domain name database for the category of the first domain name, and if the category of the first domain name is the allowed access category, obtain the first domain name Corresponding Internet Protocol address, and send the Internet Protocol address to the terminal device.

Specifically, if the third domain name exists in the subdomain name of the second domain name in the domain name database, it indicates that the first domain name (composed of the second domain name and the third domain name) exists in the domain name database. In the embodiment of the present application, when the first domain name exists in the domain name database, it indicates that the domain name database also stores the category of the first domain name. Therefore, the gateway device can directly query the domain name database to obtain the category of the first domain name, and according to the first domain name Different processing is performed on the category of a domain name. Specifically, if the category of the first domain name is an allowed access category, the gateway device can obtain the Internet Protocol address corresponding to the first domain name and send the Internet Protocol address to the terminal device. If the category of the first domain name is a forbidden category, the gateway device can ignore or delete the access request to prevent the terminal device from acquiring the content of the unhealthy website and affect the user's mental health.

Step S410: If the third domain name does not exist in the subdomain name of the second domain name in the domain name database, the gateway device obtains the transfer probability of the first domain name.

Specifically, if the third domain name does not exist in the subdomain name of the second domain name in the domain name database, it means that the first domain name (composed of the second domain name and the third domain name) does not exist in the domain name database. At this time, the gateway device needs Request the domain name classification server to obtain the category of the first domain name. In an implementation manner, the gateway device may obtain the transfer probability of the first domain name, and then estimate the probability that the category of the first domain name is stored in the domain name classification server according to whether the transfer probability of the first domain name is greater than a preset probability threshold, and When the probability that the category of the first domain name is stored in the domain name classification server is high, the first domain name is sent to the domain name classification server.

Step S411: If the transfer probability of the first domain name is greater than the preset probability threshold, the gateway device sends the first domain name to the domain name classification server, so that the domain name classification server queries the category of the first domain name, and the gateway device receives the first domain name sent by the domain name classification server. A category of a domain name. If the category of the first domain name is an allowed access category, the Internet Protocol address corresponding to the first domain name is obtained, and the Internet Protocol address is sent to the terminal device.

It should be noted that, for the specific execution process of step S411, refer to the specific description of step S203 to step S206 in FIG. 2, which will not be repeated here.

Step S412: The gateway device obtains the number of subdomains of the second domain name in the domain name database, and determines whether the number of subdomains of the second domain name in the domain name database is greater than or equal to a first preset number threshold.

Specifically, when the second domain name exists in the first-level domain names included in each domain name in the domain name database, and the third domain name does not exist in the subdomains of the second domain name in the domain name database, the gateway device receives the domain name classification server After the category of the first domain name is sent, the category of the third domain name and the first domain name may be associated and stored in the domain name database. In this way, the first domain name and the category of the first domain name can be added to the domain name database, so that when the gateway device subsequently receives an access request that includes the first domain name again, it can directly obtain the first domain name in the domain name database. There is no need to obtain the category of the first domain name through the domain name classification server, which can reduce the communication traffic between the gateway device and the domain name classification server, which is beneficial to reduce the load of the domain name classification server, and is beneficial to improve the website access speed.

In one implementation, before the gateway device associates the category of the third domain name with the first domain name and stores it in the domain name database, it needs to first determine whether the total number of subdomain names of the second domain name stored in the domain name database is greater than or equal to the first preset. Set the number threshold. If the total number of subdomains of the second domain name stored in the domain name database is less than the first preset number threshold, it means that even if a third domain name is added to the subdomains of the second domain name in the domain name database, no This will cause the total number of subdomains of the second domain name to exceed the preset upper limit of subdomains, that is, the gateway device can directly add the third domain name and the category of the first domain name in the domain name database. If the total number of subdomains of the second domain name stored in the domain name database is greater than the first preset number threshold, it indicates that the total number of subdomains of the second domain name stored in the domain name database exceeds the preset upper limit of subdomains; If the total number of subdomains of the second domain name stored in the domain name database is equal to the first preset number threshold, it indicates that adding a subdomain to the subdomains of the second domain name stored in the domain name database will cause the domain name database to be stored The total number of subdomains of the second domain name exceeds the preset upper limit number of subdomains. At this time, the gateway device needs to determine the target subdomain among the subdomains of the second domain name stored in the domain name database and delete the target subdomain, The third domain name and the category of the first domain name can be added to the domain name database. In an implementation manner, the first preset number threshold may be set by the gateway device by default, or may be set by the gateway device according to user operations, which is not limited in this embodiment of the application. It should be noted that the physical storage space of the gateway device is limited, and if the number of subdomains of each first-level domain name stored in the domain name database of the gateway device is too large, the load of the gateway device will be too high when querying the domain name database. Therefore, the first preset number threshold set should be less than or equal to the upper physical limit number of subdomains in the gateway device, and the physical upper limit number of subdomain names of each first-level domain name may be set by the gateway device at the factory.

It should be noted that after the gateway device receives the category of the first domain name sent by the domain name classification server, it may first perform the step of obtaining the Internet Protocol address corresponding to the first domain name, and then perform step S412; or, it may perform step S412 first, and then The step of obtaining the internet protocol address corresponding to the first domain name is performed; or, step S412 and the step of obtaining the internet protocol address corresponding to the first domain name may be performed at the same time, which is not limited in the embodiment of the present application.

Step S413: If the number of subdomains of the second domain name is greater than or equal to the first preset number threshold, the gateway device obtains the storage value of each subdomain of the second domain name in the domain name database, and deletes the target subdomain name in the domain name database. The target subdomain name is the subdomain name with the lowest stored value among the subdomain names of the second domain name in the domain name database.

Among them, the higher the storage value of the subdomain, the higher the probability that the subdomain is hit in the domain name database. Therefore, the gateway device determines the subdomain with the lowest storage value as the target subdomain, and then uses the third domain name (that is, the second The subdomain name of the domain name) replaces the target subdomain name, which can increase the average hit rate of the subdomain name in the domain name database, thereby minimizing the communication traffic between the gateway device and the domain name classification server, thereby helping to reduce the load of the domain name classification server.

In an implementation manner, the specific implementation manner for the gateway device to determine the target subdomain name in the subdomain name of the second domain name may be: the gateway device obtains the storage value of each subdomain name of the second domain name, and combines all subdomain names of the second domain name The subdomain with the lowest stored value in the domain name is determined as the target subdomain. In an implementation manner, a specific implementation manner for the gateway device to obtain the stored value of each subdomain name of the second domain name may be: the gateway device obtains the storage value of each subdomain name of the second domain name according to the use time, use duration, and/or use frequency of each subdomain name of the second domain name The storage value of each subdomain name of the second domain name.

In one implementation, if the number of subdomains of the second domain name is less than the first preset number threshold, the gateway device may directly associate the category of the third domain name and the first domain name in the domain name database, that is, the gateway device may Step S414 is directly executed.

Step S414: The gateway device uses the third domain name as a subdomain name of the second domain name, and stores the third domain name and the category of the first domain name in the domain name database.

Specifically, after the gateway device deletes the target subdomain name in the domain name database, the third domain name can be used as the subdomain name of the second domain name, and the third domain name and the category of the first domain name are associated and stored in the domain name database. In this way, when the gateway device subsequently receives an access request including the first domain name (composed of the second domain name and the third domain name) again, it can directly obtain the category of the first domain name in the domain name database without having to pass the domain name. The classification server obtains the category of the first domain name, so that the communication traffic between the gateway device and the domain name classification server can be reduced, which is beneficial to reduce the load of the domain name classification server, and thus is beneficial to improve the website access speed.

By implementing the embodiments of this application, when the second domain name does not exist in the first-level domain names included in each domain name in the domain name database, after the gateway device receives the category of the first domain name sent by the domain name classification server, Delete the target first-level domain name with the lowest storage value and all subdomains of the target first-level domain name, and then use the second domain name as the first-level domain name, the third domain name as the subdomain name of the second domain name, and the second domain name and third domain name And the category association of the first domain name is stored in the domain name database. In this way, on the one hand, the average hit rate of the first-level domain names in the domain name database can be increased; on the other hand, when the gateway device subsequently receives the first domain name (composed of the second domain name and the third domain name) again When accessing the request, the category of the first domain name can be directly obtained from the domain name database of the gateway device, instead of obtaining the category of the first domain name through the domain name classification server, which can reduce the communication traffic between the gateway device and the domain name classification server, which is beneficial Reduce the load of the domain name classification server, thereby helping to improve the speed of website access.

Please refer to FIG. 6. FIG. 6 is a schematic structural diagram of a data processing device provided by an embodiment of the present application. The data processing device 60 is used to execute the steps performed by the gateway device in the method embodiments corresponding to FIG. 2 to FIG. The data processing device 60 may include:

The receiving unit 601 is configured to receive an access request sent by a terminal device, where the access request includes the first domain name;

The obtaining unit 602 is configured to obtain the transfer probability of the first domain name;

The sending unit 603 is configured to send the first domain name to the domain name classification server if the transfer probability of the first domain name is greater than the preset probability threshold;

The receiving unit 601 is further configured to receive the category of the first domain name sent by the domain name classification server;

The obtaining unit 602 is further configured to obtain an Internet Protocol address corresponding to the first domain name if the category of the first domain name is an allowed access category;

The sending unit 603 is also used to send the Internet Protocol address to the terminal device.

In an implementation manner, the first domain name may include a character string. When the obtaining unit 602 is used to obtain the transition probability of the first domain name, it is specifically used to: obtain each character pair in the character string and the transition probability of each character pair, according to For the transition probability of each character pair, the transition probability of the character string included in the first domain name is obtained, and the transition probability of the character string included in the first domain name is taken as the transition probability of the first domain name.

In an implementation manner, the gateway device may have a domain name database, and the domain name database may include multiple domain names and categories of each of the multiple domain names; the sending unit 603 is configured to: if the transfer probability of the first domain name is greater than the preset probability threshold , When sending the first domain name to the domain name classification server, it is specifically used to: if the transfer probability of the first domain name is greater than the preset probability threshold, and the first domain name does not exist in the domain name database, then the first domain name is sent to the domain name classification server .

In an implementation manner, the data processing device 60 may further include a storage unit 604 configured to associate the first domain name with the category of the first domain name and store in the domain name database.

In an implementation manner, each domain name in the domain name database may include a first-level domain name and a subdomain name of the first-level domain name. The first domain name may include a second domain name and a third domain name; the first domain name that does not exist in the domain name database may include: The second domain name does not exist among the first-level domain names included in each domain name in the domain name database, and/or the third domain name does not exist among the subdomains of the first-level domain names included in each domain name in the domain name database.

In an implementation manner, the data processing device 60 may further include a deleting unit 605. The obtaining unit 602 is further configured to obtain all domain names in the domain name database if the second domain name does not exist in the first-level domain names included in each domain name in the domain name database. The number of first-level domain names included; if the number of first-level domain names is greater than or equal to the preset number threshold, the storage value of the first-level domain names included in each domain name in the domain name database is obtained; the deleting unit 605 is used to delete target one in the domain name database The first-level domain name and all subdomains of the target first-level domain name. The target first-level domain name is the first-level domain name with the lowest storage value among all the first-level domain names included in the domain name database; the storage unit 604 is used to combine the first domain name with the first-level domain name. When the category association is stored in the domain name database, it is specifically used to: regard the second domain name as the first-level domain name, the third domain name as the subdomain name of the second domain name, and associate the second domain name, the third domain name, and the category of the first domain name Stored in the domain name database.

In an implementation manner, when the obtaining unit 602 is configured to obtain the storage value of the first-level domain names included in each domain name in the domain name database, it is specifically used to: according to the use time, use time and length of the first-level domain names included in each domain name in the domain name database / Or frequency of use, to obtain the storage value of the first-level domain names included in each domain name in the domain name database.

In an implementation manner, the sending unit 603 is further configured to send a data initialization request to the domain name classification server when it is detected that the gateway device is powered on. The data initialization request is used to request domain name data. The domain name data includes domain name collections and domain name collections. The category of each domain name. The domain names in the domain name set are determined by the domain name classification server according to the access time, access duration and/or access frequency of each domain name. Each domain name in the domain name set includes the first-level domain name and the subdomains of the first-level domain name. Domain name; The receiving unit 601 is also used to receive domain name data; the storage unit 604 is also used to store the domain name data in the domain name database.

In an implementation manner, the access request may also include the identification of the terminal device, and the data processing apparatus 60 may also include a processing unit 606. The processing unit 606 is configured to trigger the acquisition of the first domain name if the identification of the terminal device is a preset identification. Steps of transition probability.

It should be noted that the content not mentioned in the embodiment corresponding to FIG. 6 and the specific implementation of the steps performed by each unit can refer to the embodiment shown in FIG. 2 to FIG. 4 and the foregoing content, and details are not repeated here.

In an implementation manner, related functions implemented by each unit in FIG. 6 can be implemented in combination with a processor and a transceiver. Referring to FIG. 7, FIG. 7 is a schematic structural diagram of a distributed data management device provided by an embodiment of the present application. The distributed data management device 70 includes: a transceiver 701, a processor 702, and a memory 703. The transceiver 701, a processor 702 and memory 703 are connected by one or more communication buses.

The transceiver 701 is used for receiving data or sending data. For example, the transceiver 701 may be used for receiving an access request sent by a terminal device, or for sending the first domain name to a domain name classification server.

The processor 702 is configured to perform corresponding functions of the gateway device in the methods described in FIGS. 2 to 4. The processor 702 may be a central processing unit (CPU), a network processor (NP), a hardware chip, or any combination thereof.

The memory 703 is used to store program codes and the like. The memory 703 may include a volatile memory (volatile memory), such as a random access memory (random access memory, RAM); the memory 703 may also include a non-volatile memory (non-volatile memory), such as a read-only memory (read-only memory). Only memory (ROM), flash memory (flash memory), hard disk drive (HDD) or solid-state drive (SSD); memory 703 may also include a combination of the foregoing types of memories.

The processor 702 may call the program code stored in the memory 703 to perform the following operations:

Receiving an access request sent by the terminal device, where the access request includes the first domain name;

Obtain the transfer probability of the first domain name;

If the transfer probability of the first domain name is greater than the preset probability threshold, sending the first domain name to the domain name classification server;

Receiving the category of the first domain name sent by the domain name classification server;

If the category of the first domain name is an allowed access category, then obtain the Internet Protocol address corresponding to the first domain name;

Send the Internet Protocol address to the terminal device.

Further, the processor 702 may also perform operations corresponding to the gateway device in the embodiment shown in FIG. 2 to FIG. 4. For details, please refer to the description in the method embodiment, which will not be repeated here.

The embodiment of the present application also provides a computer-readable storage medium, which can be used to store computer software instructions used by the data processing apparatus in the embodiment shown in FIG. 6, which contains the program used to execute the gateway device in the above embodiment. .

The aforementioned computer-readable storage medium includes, but is not limited to, flash memory, hard disk, and solid state hard disk.

The embodiments of the present application also provide a computer program product. When the computer product is run by a computing device, it can execute the data processing method designed for the gateway device in the embodiments of FIGS. 2 to 4 above.

An embodiment of the present application also provides a chip, including a processor and a memory, the memory includes a processor and a memory, the memory is used to store a computer program, and the processor is used to call and run the computer program from the memory. The computer program is used to implement the method in the above method embodiment.

A person of ordinary skill in the art may realize that the units and algorithm steps described in the examples in combination with the embodiments disclosed in this application can be implemented by electronic hardware or a combination of computer software and electronic hardware. Whether these functions are executed by hardware or software depends on the specific application and design constraint conditions of the technical solution. Professionals and technicians can use different methods for each specific application to implement the described functions, but such implementation should not be considered beyond the scope of this application.

In the above embodiments, it may be implemented in whole or in part by software, hardware, firmware or any combination thereof. When implemented by software, it can be implemented in the form of a computer program product in whole or in part. The computer program product includes one or more computer instructions. When the computer program instructions are loaded and executed on the computer, the processes or functions described in the embodiments of the present application are generated in whole or in part. The computer may be a general-purpose computer, a special-purpose computer, a computer network, or other programmable devices. The computer instructions may be stored in a computer-readable storage medium or transmitted through the computer-readable storage medium. The computer instructions can be sent from one website site, computer, server, or data center to another website site via wired (such as coaxial cable, optical fiber, digital subscriber line (DSL)) or wireless (such as infrared, wireless, microwave, etc.) , Computer, server or data center for transmission. The computer-readable storage medium may be any available medium that can be accessed by a computer or a data storage device such as a server or a data center integrated with one or more available media. The usable medium may be a magnetic medium (for example, a floppy disk, a hard disk, a magnetic tape), an optical medium (for example, a DVD), or a semiconductor medium (for example, a solid state disk (SSD)), etc.

The above are only specific implementations of this application, but the protection scope of this application is not limited to this. Any person skilled in the art can easily think of changes or substitutions within the technical scope disclosed in this application. Should be covered within the scope of protection of this application. Therefore, the protection scope of this application should be subject to the protection scope of the claims.

Claims

A data processing method, characterized in that it is applied to a gateway device, and the method includes:

Receiving an access request sent by a terminal device, where the access request includes the first domain name;

Acquiring the transfer probability of the first domain name;

If the transfer probability of the first domain name is greater than the preset probability threshold, sending the first domain name to the domain name classification server;

Receiving the category of the first domain name sent by the domain name classification server;

If the category of the first domain name is an allowed access category, the Internet Protocol address corresponding to the first domain name is obtained, and the Internet Protocol address is sent to the terminal device.
The method according to claim 1, wherein the first domain name comprises a character string, and the obtaining the transfer probability of the first domain name comprises:

Acquiring each character pair in the character string and the transition probability of each character pair;

According to the transition probability of each character pair, the transition probability of the character string is obtained, and the transition probability of the character string is taken as the transition probability of the first domain name.
The method according to claim 1 or 2, wherein the gateway device has a domain name database, and the domain name database includes multiple domain names and categories of each of the multiple domain names; If the transfer probability of a domain name is greater than the preset probability threshold, sending the first domain name to the domain name classification server includes:

If the transfer probability of the first domain name is greater than the preset probability threshold, and the first domain name does not exist in the domain name database, sending the first domain name to the domain name classification server.
The method according to claim 3, wherein after the receiving the category of the first domain name sent by the domain name classification server, the method further comprises:

The category association of the first domain name and the first domain name is stored in the domain name database.
The method according to claim 4, wherein each domain name in the domain name database includes a first-level domain name and a subdomain name of the first-level domain name, and the first domain name includes a second domain name and a third domain name;

The absence of the first domain name in the domain name database includes: the second domain name does not exist in the first-level domain names included in each domain name in the domain name database, and/or, each domain name in the domain name database includes The third domain name does not exist in the subdomains of the first-level domain name.
The method according to claim 5, wherein before storing the category association of the first domain name with the first domain name in the domain name database, the method further comprises:

If the second domain name does not exist among the first-level domain names included in each domain name in the domain name database, acquiring the number of first-level domain names included in all domain names in the domain name database;

If the number is greater than or equal to the preset number threshold, acquiring the storage value of the first-level domain names included in each domain name in the domain name database;

Delete the target first-level domain name and all subdomains of the target first-level domain name from the domain name database, where the target first-level domain name is the first-level domain name with the lowest stored value among all the first-level domain names included in the domain name database ；

The storing the first domain name and the category of the first domain name in the domain name database includes:

Use the second domain name as a first-level domain name, use the third domain name as a subdomain name of the second domain name, and store the categories of the second domain name, the third domain name, and the first domain name in association with each other In the domain name database.
The method according to claim 6, wherein said obtaining the storage value of the first-level domain names included in each domain name in the domain name database comprises:

According to the use time, use duration and/or use frequency of the first-level domain names included in each domain name in the domain name database, the storage value of the first-level domain names included in each domain name in the domain name database is obtained.
The method according to any one of claims 3-7, wherein the method further comprises:

When it is detected that the gateway device is powered on, a data initialization request is sent to the domain name classification server. The data initialization request is used to request domain name data. The domain name data includes a domain name set and the category of each domain name in the domain name set. The domain names in the domain name set are determined by the domain name classification server according to the access time, access duration, and/or access frequency of each domain name. Each domain name in the domain name set includes a first-level domain name and a subdomain of the first-level domain name. domain name;

Receiving the domain name data, and storing the domain name data in the domain name database.
The method according to any one of claims 1 to 8, wherein the access request further comprises an identification of the terminal device, and after the access request sent by the terminal device is received, the method further comprises:

If the identifier of the terminal device is a preset identifier, the step of obtaining the transfer probability of the first domain name is triggered.
A data processing device, characterized by comprising:

A receiving unit, configured to receive an access request sent by a terminal device, where the access request includes the first domain name;

An obtaining unit, configured to obtain the transfer probability of the first domain name;

A sending unit, configured to send the first domain name to a domain name classification server if the transfer probability of the first domain name is greater than a preset probability threshold;

The receiving unit is further configured to receive the category of the first domain name sent by the domain name classification server;

The obtaining unit is further configured to obtain an Internet Protocol address corresponding to the first domain name if the category of the first domain name is an allowed access category;

The sending unit is further configured to send the Internet Protocol address to the terminal device.
The apparatus according to claim 10, wherein the first domain name comprises a character string, and when the obtaining unit is used to obtain the transfer probability of the first domain name, it is specifically used to:

Obtain each character pair in the character string and the transition probability of each character pair, obtain the transition probability of the character string according to the transition probability of each character pair, and use the transition probability of the character string as the The transfer probability of the first domain name.
The apparatus according to claim 10 or 11, wherein the gateway device has a domain name database, and the domain name database includes a plurality of domain names and the category of each domain name in the plurality of domain names; the sending unit uses If the transfer probability of the first domain name is greater than the preset probability threshold, when sending the first domain name to the domain name classification server, it is specifically used to:

If the transfer probability of the first domain name is greater than the preset probability threshold, and the first domain name does not exist in the domain name database, sending the first domain name to the domain name classification server.
The device according to claim 12, wherein the data processing device further comprises a storage unit;

The storage unit is configured to store the category association of the first domain name and the first domain name in the domain name database.
The apparatus according to claim 13, wherein each domain name in the domain name database includes a first-level domain name and a subdomain name of the first-level domain name, and the first domain name includes a second domain name and a third domain name;

The absence of the first domain name in the domain name database includes: the second domain name does not exist in the first-level domain names included in each domain name in the domain name database, and/or, each domain name in the domain name database includes The third domain name does not exist in the subdomains of the first-level domain name.
The device according to claim 14, wherein the data processing device further comprises a deletion unit;

The obtaining unit is further configured to obtain the number of first-level domain names included in all domain names in the domain name database if the second domain name does not exist among the first-level domain names included in each domain name in the domain name database; If the number is greater than or equal to the preset number threshold, the storage value of the first-level domain names included in each domain name in the domain name database is obtained;

The deletion unit is configured to delete a target first-level domain name and all subdomains of the target first-level domain name in the domain name database, and the target first-level domain name is among the first-level domain names included in all domain names in the domain name database The first-level domain name with the lowest storage value;

When the storage unit is used to store the category association between the first domain name and the first domain name in the domain name database, it is specifically used to: use the second domain name as the first-level domain name, and store the third The domain name is used as a subdomain name of the second domain name, and the category association of the second domain name, the third domain name, and the first domain name is stored in the domain name database.
The device according to claim 15, wherein when the obtaining unit is used to obtain the stored value of the first-level domain names included in each domain name in the domain name database, it is specifically used to:

According to the use time, use duration and/or use frequency of the first-level domain names included in each domain name in the domain name database, the storage value of the first-level domain names included in each domain name in the domain name database is obtained.
The device according to any one of claims 12 to 16, wherein the data processing device further comprises a storage unit;

The sending unit is further configured to send a data initialization request to the domain name classification server when it is detected that the gateway device is powered on. The data initialization request is used to request domain name data, and the domain name data includes a collection of domain names, The category of each domain name in the domain name set, the domain names in the domain name set are determined by the domain name classification server according to the access time, access duration and/or access frequency of each domain name, and each domain name in the domain name set includes a first-level domain name And subdomains of the first-level domain name;

The receiving unit is further configured to receive the domain name data;

The storage unit is configured to store the domain name data in the domain name database.
The device according to any one of claims 10 to 17, wherein the access request further includes an identifier of the terminal device, and the data processing device further includes a processing unit;

The processing unit is configured to trigger the step of obtaining the transfer probability of the first domain name if the identifier of the terminal device is a preset identifier.
A computer-readable storage medium, wherein the computer-readable storage medium stores a computer program, and the computer program includes program instructions that, when executed by a processor, cause the processor to execute The method of any one of claims 1-9.
A gateway device, characterized by comprising a memory and a processor, the memory stores program instructions, the processor is connected to the memory through a bus, and the processor executes the program instructions stored in the memory, So that the gateway device executes the method according to any one of claims 1-9.