CN110730244A

CN110730244A - Networking method and system of DHT (distributed hash table) system, network equipment and storage medium

Info

Publication number: CN110730244A
Application number: CN201911007651.2A
Authority: CN
Inventors: 刘杰
Original assignee: Shenzhen Onething Technology Co Ltd
Current assignee: Shenzhen Onething Technology Co Ltd
Priority date: 2019-10-22
Filing date: 2019-10-22
Publication date: 2020-01-24

Abstract

The application discloses a networking method and a networking system of a DHT system, a network device and a computer readable storage medium, wherein the method comprises the following steps: after receiving a networking instruction, sending a DHT routing table to an intranet node; after the intranet node determines a target agent module from the DHT routing table, receiving a connection request sent by the intranet node; and connecting the intranet node with the target agent module according to the connection request, storing the node ID of the intranet node into an agent module routing table, and taking the network address of the target agent module as the extranet address of the intranet node. The problem of insufficient node quantity caused by the fact that the existing DHT system can only conduct networking between the nodes of the external network is solved, the nodes of the internal network are connected into the DHT system through the target agent module, the nodes of the external network do not need to be specially designed to meet the networking requirement of the DHT system, the networking cost is saved, and the networking efficiency is improved.

Description

Networking method and system of DHT (distributed hash table) system, network equipment and storage medium

Technical Field

The present application relates to the field of computer technologies, and in particular, to a networking method and system for a DHT system, a network device, and a computer-readable storage medium.

Background

The DHT (Distributed Hash Table) is a Distributed storage method similar to a Tracker network that returns seed information according to seed feature codes. Each client is responsible for a small range of routing without the need for a server and for storing a small portion of data, thereby enabling addressing and storage of the entire DHT network.

The current DHT system can only use extranet nodes (i.e. the nodes have extranet IP and can be directly connected), and when one node is an intranet node (i.e. the node is hung on a router and cannot be directly connected), the part of nodes cannot be used. In the current home users, a home router is commonly used to facilitate the home devices to access the network, and the devices cannot be directly added to the dht system.

Therefore, how to expand DHT nodes is a problem that needs to be solved by those skilled in the art.

Disclosure of Invention

The present application aims to provide a networking method and system for a DHT system, a network device, and a computer-readable storage medium, which can greatly expand the number of nodes in the DHT system.

In order to achieve the above object, the present application provides a networking method for a DHT system, including:

after receiving a networking instruction, sending a DHT routing table to an intranet node;

after the intranet node determines a target agent module from the DHT routing table, receiving a connection request sent by the intranet node;

and connecting the intranet node with the target agent module according to the connection request, storing the node ID of the intranet node to an agent module routing table, and taking the network address of the target agent module as the extranet address of the intranet node.

After the network address of the target agent module is used as the extranet address of the intranet node, the method further includes:

and the intranet node keeps long connection with the target agent module, and broadcasts the information of successful connection of the intranet node in the DHT system.

Wherein the DHT routing table comprises a node ID, a tag field and a network address of the DHT node;

the DHT nodes include an extranet node and an intranet node, and the mark field is used for distinguishing the extranet node from the intranet node.

And the proxy module routing table comprises the node ID of the intranet node and the corresponding long connection session.

Wherein, when the extranet node needs to communicate with the intranet node, the method further comprises:

the external network node sends a communication request to the target agent module through the DHT routing table;

the target agent module queries the agent module routing table according to the communication request so as to confirm a target connection node of the communication request;

and the target agent module sends the communication request to the target connection node, and the intranet node communicates with the extranet node by using the network address of the target agent module.

Wherein, still include:

communication network flow verification is carried out on the intranet nodes to judge whether the intranet nodes receive large-flow attack or not;

and if the intranet node receives the large-flow attack, performing data packet loss processing.

The connection request is a TCP connection instruction sent by the intranet node.

To achieve the above object, the present application provides a network device, which includes a memory and a processor, the memory storing a networking program operable on the processor, the networking program when executed by the processor implementing:

The present application further provides a networking method of a DHT system, including:

the target agent module receives a connection request of an intranet node;

establishing connection with the intranet node, and storing a node ID of the intranet node to a proxy module routing table;

and taking the own network address as the outer network address of the inner network node.

To achieve the above object, the present application also provides a network device, which includes a memory and a processor, where the memory stores a networking program operable on the processor, and the networking program, when executed by the processor, implements the steps of the networking method as described above.

In order to achieve the above object, the present application provides a networking system of a DHT system, including:

the sending module is used for sending the DHT routing list to the intranet node after receiving the networking instruction;

a receiving module, configured to receive, after the intranet node determines a target agent module from the DHT routing table, a connection request sent by the intranet node;

and the connection module is used for connecting the intranet node with the target agent module according to the connection request, storing the node ID of the intranet node to an agent module routing table, and taking the network address of the target agent module as the extranet address of the intranet node.

To achieve the above object, the present application provides a computer readable storage medium, on which a networking program is stored, which when executed by a processor implements the steps of the networking method as described above.

According to the above scheme, the networking method of the DHT system provided by the present application includes: after receiving a networking instruction, sending a DHT routing table to an intranet node; after the intranet node determines a target agent module from the DHT routing table, receiving a connection request sent by the intranet node; and connecting the intranet node with the target agent module according to the connection request, storing the node ID of the intranet node to an agent module routing table, and taking the network address of the target agent module as the extranet address of the intranet node.

And establishing the connection between the extranet node and the intranet node by using the target agent module as an intermediate module, and simultaneously communicating the intranet node with the extranet node by using the network address of the target agent module. The problem of the node quantity is not enough because the networking between the nodes of the outer net can only be carried out in the current DHT system is solved, the nodes of the inner net are connected into the DHT system through the target agent module, the nodes of the outer net do not need to be specially arranged to meet the networking requirement of the DHT system, the networking cost is saved, and meanwhile, the networking efficiency is improved because the nodes of the inner net are the existing node equipment.

The application also discloses a networking system of the DHT system, a network device and a computer readable storage medium, which can also realize the technical effects.

Drawings

In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings used in the description of the embodiments or the prior art will be briefly described below, it is obvious that the drawings in the following description are only some embodiments of the present application, and for those skilled in the art, other drawings can be obtained according to the drawings without creative efforts.

Fig. 1 is a flowchart of a networking method of a DHT system disclosed in an embodiment of the present application;

fig. 2 is a flowchart of another networking method of a DHT system disclosed in an embodiment of the present application;

fig. 3 is a flowchart of a networking method of a DHT system disclosed in an embodiment of the present application;

fig. 4 is a flowchart of a networking method of a DHT system disclosed in the embodiment of the present application;

fig. 5 is a structural diagram of a networking system of a DHT system disclosed in an embodiment of the present application;

fig. 6 is a block diagram of a network device disclosed in an embodiment of the present application;

fig. 7 is a block diagram of another network device disclosed in the embodiment of the present application.

Detailed Description

In order to make the objects, technical solutions and advantages of the present invention more apparent, the present invention is described in further detail below with reference to the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are merely illustrative of the invention and are not intended to limit the invention. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.

The terms "first," "second," "third," "fourth," and the like in the description and in the claims of the present application and in the drawings described above, if any, are used for distinguishing between similar elements and not necessarily for describing a particular sequential or chronological order. It will be appreciated that the data so used may be interchanged under appropriate circumstances such that the embodiments described herein may be practiced otherwise than as specifically illustrated or described herein. Furthermore, the terms "comprises," "comprising," and "having," and any variations thereof, are intended to cover a non-exclusive inclusion, such that a process, method, system, article, or apparatus that comprises a list of steps or elements is not necessarily limited to those steps or elements expressly listed, but may include other steps or elements not expressly listed or inherent to such process, method, article, or apparatus.

It should be noted that the description relating to "first", "second", etc. in the present invention is for descriptive purposes only and is not to be construed as indicating or implying relative importance or implicitly indicating the number of technical features indicated. Thus, a feature defined as "first" or "second" may explicitly or implicitly include at least one such feature. In addition, technical solutions between various embodiments may be combined with each other, but must be realized by a person skilled in the art, and when the technical solutions are contradictory or cannot be realized, such a combination should not be considered to exist, and is not within the protection scope of the present invention.

The embodiment of the application discloses a networking method of a DHT system, which can greatly expand the number of nodes of the DHT system.

Referring to fig. 1, a flowchart of a networking method of a DHT system disclosed in the embodiment of the present application is shown in fig. 1, and includes:

s101: after receiving a networking instruction, sending a DHT routing table to an intranet node;

this step is intended to send the DHT routing table to the intranet node. And the DHT routing table comprises information of each external network node and the agent module. Specifically, after networking is required, that is, a networking instruction is received, the DHT system sends the DHT routing table to the intranet node. The specific contents and form of the DHT routing table are not limited herein, but it will be readily understood that it should include at least network address information for each of the foreign network nodes and the proxy module.

S102: after the intranet node determines a target agent module from the DHT routing table, receiving a connection request sent by the intranet node;

for the intranet node, the intranet node can detect the surrounding agent modules, but the intranet node cannot be directly connected with the extranet node.

The intranet node receives the DHT routing table of the DHT system and then probes surrounding agent modules to test the delay between the two. Typically, the lowest latency target agent module connection needs to be determined. Determining the target agent module according to the DHT routing table actually means determining information such as an ID of the target agent module by using the DHT routing table so as to facilitate subsequent connection, but it should be noted that the delay information does not belong to the content of the DHT routing table, and the network delay between the intranet node and each agent module changes in real time and should be actually detected. In addition, the actual physical distance between the target agent module and the intranet node has no absolute relation with the delay size.

And after the intranet node determines the target agent module, sending a connection request to the DHT system. It will be readily appreciated that at this point, the connection request is typically sent directly to the target proxy module. Preferably, the connection request may be a TCP connection instruction sent by the intranet node.

S103: and connecting the intranet node with the target agent module according to the connection request, storing the node ID of the intranet node into an agent module routing table, and taking the network address of the target agent module as the extranet address of the intranet node.

The step aims to establish the connection between the intranet node and the target agent module, and in the process, the node ID of the intranet node is stored in a routing table of the agent module. It should be noted that the DHT routing table is different from the agent module routing table, the DHT routing table is a routing table at the DHT system level and is used for recording information such as IDs and network addresses of nodes (including intranet nodes connected to the agent module) in the DHT system, and the agent module routing table mainly records node IDs of the intranet nodes connected to the agent module.

Preferably, the intranet node and the target agent module can establish a long connection, and at this time, the intranet node has accessed the DHT system and uses the network address of the target agent module to perform communication.

It will be readily appreciated that there may be multiple intranet nodes connected to each proxy module, and that in this case, each intranet node communicates with an extranet node using the same network address.

Generally, after the target agent module establishes connection with the intranet node, the information that the intranet node is successfully connected can be broadcasted in the DHT system. The specific broadcast content may include information related to an intranet node newly accessing the DHT system, and is not specifically limited herein, and may include, for example, a node ID obtained after the intranet node accesses the DHT system.

According to the embodiment of the application, the target agent module is used as the intermediate module to establish the connection between the extranet node and the intranet node, and meanwhile, the intranet node communicates with the extranet node by using the network address of the target agent module. The problem of insufficient node quantity caused by the fact that the existing DHT system can only carry out networking between external network nodes is solved, the internal network nodes are connected into the DHT system through the target agent module, external network nodes do not need to be specially arranged to meet the networking requirement of the DHT system, the external network node occupation ratio in the existing network is only 5%, and the quantity of the DHT nodes can be greatly expanded. The networking cost is saved, and meanwhile, because the intranet nodes are the existing node equipment, the networking efficiency is improved.

The embodiment of the application discloses a networking method of a DHT system, and compared with the previous embodiment, the embodiment further explains and optimizes the technical scheme. Specifically, the method comprises the following steps:

on the basis of the above embodiment, the embodiment of the present application specifically defines specific contents of the DHT routing table and the proxy module routing table. Preferably, the DHT routing table may include a node ID, a tag field, and a network address of the DHT node. The DHT nodes may include an extranet node and an intranet node, and the flag field is used to distinguish the extranet node from the intranet node, and for example, the nodes may be marked as the extranet node or the intranet node using is _ inner as a field. Of course, other fields or other ways may be used to distinguish DHT nodes as intranet or extranet nodes in the DHT routing table. It is readily understood that each DHT node has a unique ID within the DHT system. Therefore, after the intranet node joins the DHT system, the DHT routing table only needs to include the DHT node ID, the tag field, and the network address of the node. Of course, on the basis, the relationship between each intranet node and the agent module and the like can be noted.

In addition, the proxy module routing table includes the node ID of the intranet node and the corresponding long connection session.

Referring to fig. 3, a flowchart of a networking method of a DHT system provided in the embodiment of the present application is shown in fig. 3, when an extranet node needs to communicate with an intranet node, a specific process may be as follows:

s201: the outer network node sends a communication request to the target agent module through the DHT routing table;

s202: the target agent module queries an agent module routing table according to the communication request to confirm a target connection node of the communication request;

s203: the target agent module sends the communication request to a target connection node, and the intranet node communicates with the extranet node through the network address of the target agent module.

When the outer network node communicates with the inner network node, the communication request is directly sent to the network address corresponding to the inner network node through the DHT routing table. Since the network address is actually the network address of the proxy module, the proxy module receives the communication request and queries the proxy module routing table, and it should be noted that the proxy module routing table and the DHT routing table both include a common parameter, i.e. a node ID, except that the proxy module routing table only records the node ID of the intranet node connected to the proxy module routing table. The proxy module queries the proxy module table to determine the target connection node based on the node ID and forwards the communication request to the target connection node. Thus, communication between the outer network node and the inner network node is realized.

The embodiment of the application discloses a networking method of a DHT system, and compared with the previous embodiment, the embodiment further optimizes the technical scheme. Specifically, the method comprises the following steps:

referring to fig. 3, a flowchart of another networking method of a DHT system provided in the embodiment of the present application is shown in fig. 3, and includes:

s301: carrying out communication network flow verification on the intranet nodes to judge whether the intranet nodes receive a large-flow attack;

s302: and if the intranet node receives the large-flow attack, data packet loss processing is carried out.

The embodiment of the present application is generally executed after the execution of S103 is completed. After the intranet nodes are accessed to the network, the intranet nodes are completely equal to the extranet nodes. And then the DHT system checks the communication network flow, prevents large-flow attack, and performs packet loss processing at large flow so as to play a role in node protection.

Referring to fig. 4, an embodiment of the present application provides a networking method of a DHT system, which is different from the networking methods of the foregoing embodiments, and it is apparent from the foregoing embodiments that a target agent module is used as a medium for interaction between an external network node and an internal network node, and a corresponding networking process also exists between the target agent module and the internal network node, where the process of accessing the internal network node to the DHT system is actually described in this embodiment:

s401: the target agent module receives a connection request of an intranet node;

s402: establishing connection with the intranet node, and storing the node ID of the intranet node to a proxy module routing table;

s403: and taking the own network address as an outer network address of the inner network node.

It should be noted that the intranet node may actively send a connection request to the agent modules nearby, and usually only one agent module, i.e. the target agent module in this embodiment, will connect with the intranet node after receiving the connection request. Generally, the target agent module is the agent module with the shortest physical distance to the intranet node, and of course, the intranet node may select the optimal agent module to connect according to other factors or attributes, such as communication strength, communication connection stability, and the like, which is not limited herein.

After the target agent module establishes connection with the intranet node, the node ID of the intranet node is stored in the agent module routing table, and then the address of the intranet node in the DHT system uses the network address of the agent module. The specific processes may be cross-referenced with respect to the various embodiments described above and will not be repeated here.

In the following, a networking system of a DHT system provided in an embodiment of the present application is introduced, and a networking system of a DHT system described below and a networking method of a DHT system described above may be referred to each other.

Referring to fig. 5, a structure diagram of a networking system of a DHT system provided in an embodiment of the present application is shown in fig. 4, and includes:

a sending module 100, configured to send a DHT routing table to an intranet node after receiving a networking instruction;

a receiving module 200, configured to receive, after the intranet node determines a target agent module from the DHT routing table, a connection request sent by the intranet node;

a connection module 300, configured to connect the intranet node and the target proxy module according to the connection request, store a node ID of the intranet node in a proxy module routing table, and use a network address of the target proxy module as an extranet address of the intranet node.

The application also provides a network device, which may be a PC (Personal Computer), a smart phone, a tablet Computer, a palm Computer, a portable Computer, an intelligent router, an ore machine, a network storage device (playing guest cloud) terminal device. The network device may be a node constituting a CDN network or a blockchain network.

Referring to fig. 6, a block diagram of a network device provided in the embodiment of the present application, as shown in fig. 6, may include a memory 11, a processor 12, and a bus 13.

The memory 11 includes at least one type of readable storage medium, which includes a flash memory, a hard disk, a multimedia card, a card type memory (e.g., SD or DX memory, etc.), a magnetic memory, a magnetic disk, an optical disk, and the like. The memory 11 may in some embodiments be an internal storage unit of the network device, for example a hard disk of the network device. The memory 11 may also be an external storage device of the network device in other embodiments, such as a plug-in hard disk provided on the network device, a Smart Media Card (SMC), a Secure Digital (SD) Card, a flash memory Card (FlashCard), and so on. Further, the memory 11 may also include both an internal storage unit of the network device and an external storage device. The memory 11 may be used not only to store application software for installing the network device and various kinds of data such as a code of a networking program, etc., but also to temporarily store data that has been output or is to be output.

The processor 12 may be a Central Processing Unit (CPU), a controller, a microcontroller, a microprocessor or other data Processing chip in some embodiments, and is configured to run program codes or process data stored in the memory 11, and implement the networking method provided in any of the above embodiments, for example, execute a networking program.

The bus 13 may be a Peripheral Component Interconnect (PCI) bus, an Extended Industry Standard Architecture (EISA) bus, or the like. The bus may be divided into an address bus, a data bus, a control bus, etc. For ease of illustration, only one thick line is shown in FIG. 5, but this is not intended to represent only one bus or type of bus.

On the basis of the above embodiment, as a preferred implementation, referring to fig. 7, the network device further includes:

and the input interface 14 is used for acquiring computer programs, parameters and instructions imported from the outside, and controlling and storing the computer programs, the parameters and the instructions into the memory 11 through the processor 12. The input interface 14 may be connected to an input device for receiving parameters or instructions manually input by a user. The input device may be a touch layer covered on a display screen, a button, a trackball or a touch pad arranged on a terminal housing, a Keyboard (Keyboard), a touch pad or a mouse.

A display unit 15 for displaying data processed by the processor 12 and for displaying a visualized user interface. The display unit 15 may be an LED display, a liquid crystal display, a touch-controlled liquid crystal display, an OLED (Organic Light-Emitting Diode) touch device, and the like.

And a network port 16 for performing communication connection with each external terminal device. The communication technology adopted by the communication connection can be a wired communication technology or a wireless communication technology, such as a mobile high definition link (MHL) technology, a Universal Serial Bus (USB), a High Definition Multimedia Interface (HDMI), a wireless fidelity (WiFi), a bluetooth communication technology, a low power consumption bluetooth communication technology, an ieee802.11 s-based communication technology, and the like.

Fig. 7 shows only a network device with components 11-16 and networking program 01, and those skilled in the art will appreciate that the architecture shown in fig. 7 does not constitute a limitation of network devices, and may include fewer or more components than those shown, or some components in combination, or a different arrangement of components.

In the above embodiments, the implementation may be wholly or partially realized by software, hardware, firmware, or any combination thereof. When implemented in software, may be implemented in whole or in part in the form of a computer program product.

The computer program product includes one or more computer instructions. When loaded and executed on a computer, cause the processes or functions described in accordance with the embodiments of the invention to occur, in whole or in part. The computer may be a general purpose computer, a special purpose computer, a network of computers, or other programmable device. The computer instructions may be stored in a computer readable storage medium or transmitted from one computer readable storage medium to another, for example, from one website site, computer, server, or data center to another website site, computer, server, or data center via wired (e.g., coaxial cable, fiber optic, Digital Subscriber Line (DSL)) or wireless (e.g., infrared, wireless, microwave, etc.). The computer-readable storage medium can be any available medium that a computer can store or a data storage device, such as a server, a data center, etc., that is integrated with one or more available media. The usable medium may be a magnetic medium (e.g., floppy Disk, hard Disk, magnetic tape), an optical medium (e.g., DVD), or a semiconductor medium (e.g., Solid State Disk (SSD)), among others.

It is clear to those skilled in the art that, for convenience and brevity of description, the specific working processes of the above-described systems, apparatuses and units may refer to the corresponding processes in the foregoing method embodiments, and are not described herein again.

In the several embodiments provided in the present application, it should be understood that the disclosed system, apparatus and method may be implemented in other manners. For example, the above-described apparatus embodiments are merely illustrative, and for example, the division of the units is only one logical division, and other divisions may be realized in practice, for example, a plurality of units or components may be combined or integrated into another system, or some features may be omitted, or not executed. In addition, the shown or discussed mutual coupling or direct coupling or communication connection may be an indirect coupling or communication connection through some interfaces, devices or units, and may be in an electrical, mechanical or other form.

The units described as separate parts may or may not be physically separate, and parts displayed as units may or may not be physical units, may be located in one place, or may be distributed on a plurality of network units. Some or all of the units can be selected according to actual needs to achieve the purpose of the solution of the embodiment.

In addition, functional units in the embodiments of the present application may be integrated into one processing unit, or each unit may exist alone physically, or two or more units are integrated into one unit. The integrated unit can be realized in a form of hardware, and can also be realized in a form of a software functional unit.

The integrated unit, if implemented in the form of a software functional unit and sold or used as a stand-alone product, may be stored in a computer readable storage medium. Based on such understanding, the technical solution of the present application may be substantially implemented or contributed to by the prior art, or all or part of the technical solution may be embodied in a software product, which is stored in a storage medium and includes instructions for causing a computer device (which may be a personal computer, a server, or a network device) to execute all or part of the steps of the method according to the embodiments of the present application. And the aforementioned storage medium includes: a U-disk, a removable hard disk, a Read-only Memory (ROM), a Random Access Memory (RAM), a magnetic disk or an optical disk, and other various media capable of storing program codes.

It should be noted that the above-mentioned numbers of the embodiments of the present invention are merely for description, and do not represent the merits of the embodiments. And the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, apparatus, article, or method that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, apparatus, article, or method. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other like elements in a process, apparatus, article, or method that includes the element.

The above description is only a preferred embodiment of the present invention, and not intended to limit the scope of the present invention, and all modifications of equivalent structures and equivalent processes, which are made by using the contents of the present specification and the accompanying drawings, or directly or indirectly applied to other related technical fields, are included in the scope of the present invention.

Claims

1. A networking method of a DHT system is characterized by comprising the following steps:

2. The networking method according to claim 1, further comprising, after taking the network address of the target agent module as the extranet address of the intranet node:

3. The networking method of claim 1, wherein the DHT routing table comprises a node ID, a tag field, and a network address of the DHT node;

4. The networking method according to claim 3, wherein the proxy module routing table includes a node ID of the intranet node and a corresponding long connection session.

5. The networking method according to claim 4, wherein when the extranet node needs to communicate with the intranet node, the networking method further comprises:

6. The networking method of claim 1, further comprising:

7. A networking method of a DHT system is characterized by comprising the following steps:

the target agent module receives a connection request of an intranet node;

8. A network device comprising a memory and a processor, the memory having stored thereon a networking program operable on the processor, the networking program when executed by the processor implementing the steps of the networking method of any of claims 1 to 7.

9. A networking system of a DHT system, comprising:

10. A computer-readable storage medium, having a networking program stored thereon, which when executed by a processor, performs the steps of the networking method of any of claims 1 to 7.