CN115866070B - Data processing system and data processing method - Google Patents
Data processing system and data processing method Download PDFInfo
- Publication number
- CN115866070B CN115866070B CN202310042942.5A CN202310042942A CN115866070B CN 115866070 B CN115866070 B CN 115866070B CN 202310042942 A CN202310042942 A CN 202310042942A CN 115866070 B CN115866070 B CN 115866070B
- Authority
- CN
- China
- Prior art keywords
- token
- network node
- node
- network
- information
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Landscapes
- Data Exchanges In Wide-Area Networks (AREA)
Abstract
The embodiment of the invention provides a data processing system and a data processing method, wherein the data processing system comprises a token server and a plurality of network nodes; the network node is used for acquiring attribute information of the network node, generating token application information and sending the token application information to the token server; the token server is used for receiving the token application information of each network node and constructing a tree network of each network node, and respectively sending a first token and a second token to the root node and the leaf node, wherein the second token of the leaf node comprises attribute information of a father node of the leaf node; under the condition that the network node receives the first token or the second token, calculating path weights according to the path information and sending the path weights to each network node; under the condition that a network node receives a data request, determining a destination network node where target service data is located, and determining a communication path according to path weight; and acquiring target service data through the communication path.
Description
Technical Field
The present invention relates to the field of communications technologies, and in particular, to a data processing system and a data processing method.
Background
With the development of communication technology, a service platform (e.g., a server) may provide a data acquisition service for a user, and when the user needs to acquire data, the user may instruct a client to send a data acquisition request to the service platform. Correspondingly, after receiving the data acquisition request sent by the client, the service platform can send the data requested by the client to the client.
In the related technology, the existing tree network node generally adopts a fixed path, and cannot dynamically change the path according to the service or network state, so that the running cost and the running difficulty of the data processing system are increased.
Disclosure of Invention
An embodiment of the present invention is directed to a data processing system and a data processing method, so as to solve the problem that an existing tree network node cannot dynamically change a path according to a service or a network state. The specific technical scheme is as follows:
in a first aspect of an embodiment of the present invention, there is provided a data processing system, including:
a token server and a plurality of network nodes;
the network node is used for acquiring attribute information of the network node, generating token application information comprising the attribute information of the network node, and sending the token application information to the token server;
The token server is used for receiving the token application information of each network node; constructing a tree network of each network node according to the attribute information of the network node in each token application information; transmitting a first token representing a network node as a root node to a root node in the tree network; sending a second token to a leaf node in the tree network, wherein the second token of the leaf node comprises attribute information of a father node of the leaf node for any leaf node;
the network node is further configured to send, when receiving the second token, own path information to an own parent node according to attribute information of the own parent node in the second token; under the condition that path information sent by a child node of the self is received, the path information sent by the child node of the self is sent to a father node of the self;
the network node is further configured to, when receiving the first token, calculate a path weight of a path between the network nodes according to the received path information of each network node; transmitting the path weights to each network node;
The network node is further configured to determine, when receiving a data request, a destination network node where target service data requested by the data request is located, and determine a communication path from the network node to the destination network node according to the path weight; and acquiring the target service data through the communication path.
Optionally, the system further comprises: a central server;
the network node is further configured to report service data stored in the network node to the central server;
the network node is specifically configured to determine target service data requested by a data request when the data request is received; sending a query request for querying a network node where the target service data are located to the central server; acquiring a query result returned by the central server, wherein the query result comprises a destination network node where the target service data are located;
the central server is used for responding to the query request and querying the destination network node where the target service data are located to obtain a query result; and returning the query result to the network node which sends the query request.
Optionally, for any network node, the attribute information of the network node includes IP address information and service resource information of the network node;
the token server is specifically configured to determine a physical location of each network node according to IP address information of the network node in each token application information; and constructing a tree network of each network node according to the physical position and the service resource information of each network node.
Optionally, the token server is further configured to calculate a timing interval according to the number of the network nodes and service resource information of each network node; transmitting the timing interval to each of the network nodes; wherein the timing interval is positively correlated with the number of the network nodes and positively correlated with the number of the service resources represented by the service resource information of the network nodes;
the network node is specifically configured to obtain attribute information of the network node according to the timing interval, generate token application information including the attribute information of the network node, and send the token application information to the token server.
Optionally, the token server is specifically configured to determine, for each network node, whether the network node is a root node according to a position of the network node in the tree network; generating a first token representing the network node as a root node and transmitting the first token of the network node to the network node under the condition that the network node is the root node; and if the network node is not a root node, determining a father node of the network node, generating a second token comprising attribute information of the father node of the network node, and sending the second token of the network node to the network node.
Optionally, the first token includes a time stamp and a key stamp; the time mark of the first token represents the effective time of the first token, and the key mark of the first token represents the encryption and decryption algorithm of the first token;
the network node is specifically configured to determine an encryption and decryption algorithm corresponding to a key label of the first token to obtain a first encryption and decryption algorithm when the first token is received; decrypting the first token by using the first encryption and decryption algorithm to obtain a time mark of the first token, and determining that the first token is received by the first token; and under the condition that the time mark of the first token indicates that the first token is out of date, acquiring attribute information of the first token, generating token application information comprising the attribute information of the first token, and sending the token application information to the token server.
Optionally, the second token includes a time stamp and a key stamp; the time mark of the second token represents the effective time of the second token, and the key mark of the second token represents the encryption and decryption algorithm of the second token;
the network node is specifically configured to determine an encryption and decryption algorithm corresponding to a key label of the second token to obtain a second encryption and decryption algorithm when the second token is received; decrypting the second token by using the second encryption and decryption algorithm to obtain a time mark of the second token, and determining that the second token is received by the second token; and under the condition that the time mark of the second token indicates that the second token is out of date, acquiring attribute information of the second token, generating token application information comprising the attribute information of the second token, and sending the token application information to the token server.
Optionally, for any network node, the path information of the network node includes at least one of service resource information of the network node, a network state of the network node with a parent node, a number of disconnection times of the network node with the parent node in a unit period, a network state of an alternative parent node, and a network state of a token server.
In a second aspect of the embodiment of the present invention, a data processing method is provided, applied to a data processing system, where the data processing system includes a token server and a plurality of network nodes; the method comprises the following steps:
the network node acquires attribute information of the network node, generates token application information comprising the attribute information of the network node, and sends the token application information to the token server;
the token server receives the token application information of each network node; constructing a tree network of each network node according to the attribute information of the network node in each token application information; transmitting a first token representing a network node as a root node to a root node in the tree network; sending a second token to a leaf node in the tree network, wherein the second token of the leaf node comprises attribute information of a father node of the leaf node for any leaf node;
The network node sends own path information to own father node according to attribute information of own father node in the second token under the condition of receiving the second token; under the condition that path information sent by a child node of the self is received, the path information sent by the child node of the self is sent to a father node of the self;
under the condition that the network node receives the first token, calculating the path weight of the path between the network nodes according to the received path information of the network nodes; transmitting the path weights to each network node;
the network node determines a destination network node where target service data requested by the data request is located under the condition of receiving the data request, and determines a communication path from the network node to the destination network node according to the path weight; and acquiring the target service data through the communication path.
Optionally, the data processing system further comprises a central server;
the method further comprises the steps of: the network node reports the service data stored in the network node to the central server;
the network node determining a destination network node where target service data requested by the data request is located under the condition of receiving the data request, including:
The network node determines target service data requested by the data request under the condition of receiving the data request; sending a query request for querying a network node where the target service data are located to the central server;
the central server responds to the query request and queries the destination network node where the target service data is located to obtain a query result; returning the query result to the network node sending the query request, wherein the query result comprises a target network node where the target service data is located;
and the network node acquires a query result returned by the central server, and analyzes the query result to obtain a target network node where the target service data is located.
In a third aspect of the embodiment of the present invention, a data processing apparatus is provided, which is applied to a data processing system, where the data processing system includes a token server and a plurality of network nodes; the device comprises:
the attribute information acquisition module is used for enabling the network node to acquire attribute information of the network node, generating token application information comprising the attribute information of the network node, and sending the token application information to the token server;
The token sending module is used for enabling the token server to receive token application information of each network node; constructing a tree network of each network node according to the attribute information of the network node in each token application information; transmitting a first token representing a network node as a root node to a root node in the tree network; sending a second token to a leaf node in the tree network, wherein the second token of the leaf node comprises attribute information of a father node of the leaf node for any leaf node;
the path information sending module is used for enabling the network node to send the path information of the network node to the father node according to the attribute information of the father node of the network node in the second token under the condition that the network node receives the second token; under the condition that path information sent by a child node of the self is received, the path information sent by the child node of the self is sent to a father node of the self;
the path weight sending module is used for enabling the network nodes to calculate the path weight of the path between the network nodes according to the received path information of the network nodes under the condition that the first token is received; transmitting the path weights to each network node;
The target service data acquisition module is used for enabling the network node to determine a target network node where target service data requested by the data request is located under the condition that the data request is received, and determining a communication path from the network node to the target network node according to the path weight; and acquiring the target service data through the communication path.
Optionally, the data processing system further comprises a central server; the target service data acquisition module further comprises:
the service data reporting sub-module is used for enabling the network node to report the service data stored in the network node to the central server;
a service data determining submodule, configured to enable the network node to determine, when receiving a data request, a destination network node where target service data requested by the data request is located, where the service data determining submodule includes:
a query request sending unit, configured to enable the network node to determine target service data requested by a data request when receiving the data request; sending a query request for querying a network node where the target service data are located to the central server;
The query result obtaining unit is used for enabling the central server to respond to the query request and query the destination network node where the target service data are located to obtain a query result; returning the query result to the network node sending the query request, wherein the query result comprises a target network node where the target service data is located;
and the query result analysis unit is used for enabling the network node to acquire the query result returned by the central server and analyzing the query result to obtain the target network node where the target service data is located.
In a fourth aspect of the embodiment of the present invention, an electronic device is provided, including a processor, a communication interface, a memory, and a communication bus, where the processor, the communication interface, and the memory complete communication with each other through the communication bus;
a memory for storing a computer program;
and a processor, configured to implement the steps of the data transmission method according to any one of the second aspect when executing the program stored in the memory.
In a fifth aspect of the embodiments of the present invention, there is provided a computer readable storage medium having stored therein a computer program which, when executed by a processor, implements the steps of the data transmission method according to any of the second aspects described above.
The embodiment of the invention has the beneficial effects that: by arranging the token server and a plurality of network nodes in the data processing system, a tree-shaped network node capable of freely selecting a target service data transmission path is formed, and the running cost and the running difficulty of the data processing system are reduced.
Of course, it is not necessary for any one product or method of practicing the invention to achieve all of the advantages set forth above at the same time.
Drawings
In order to more clearly illustrate the embodiments of the invention or the technical solutions in the prior art, the drawings used in the embodiments or the description of the prior art will be briefly described below, and it is obvious that the drawings in the following description are only some embodiments of the invention, and other embodiments may be obtained according to these drawings to those skilled in the art.
FIG. 1 is a first schematic diagram of a data processing system according to an embodiment of the present application;
FIG. 2 is a second architecture diagram of a data processing system according to an embodiment of the present application;
FIG. 3 is a first interactive schematic diagram of a data processing system according to an embodiment of the present application;
FIG. 4 is a second interactive schematic diagram of a data processing system according to an embodiment of the present application;
FIG. 5 is a schematic flow chart of a data processing method according to an embodiment of the present application;
FIG. 6 is a flowchart of a method of interaction between a network node and a central server in an embodiment of the present application;
FIG. 7 is a schematic diagram of a data processing apparatus according to an embodiment of the present application;
fig. 8 is a schematic diagram of an electronic device according to an embodiment of the present application.
Detailed Description
The following description of the embodiments of the present invention will be made clearly and completely with reference to the accompanying drawings, in which it is apparent that the embodiments described are only some embodiments of the present invention, but not all embodiments. Based on the embodiments of the present invention, those of ordinary skill in the art will be able to devise all other embodiments that are obtained based on this application and are within the scope of the present invention.
In order to solve the problem that the tree network node in the prior art generally adopts a fixed path and can not dynamically change the path according to the service or network state, the invention provides the following technical scheme:
with reference to FIG. 1, in a first aspect of an embodiment of the present invention, there is provided a data processing system comprising: a token server 110 and a plurality of network nodes 120;
the network node 120 is configured to obtain attribute information of itself, generate token application information including attribute information of itself, and send the token application information to the token server 110;
The token server 110 is configured to receive token application information of each network node 120; constructing a tree network of each network node according to the attribute information of the network node in each token application information; transmitting a first token 111 representing a network node as a root node to a root node 121 in the tree network; transmitting a second token 112 to leaf nodes 122 in the tree network, wherein for any leaf node 122, the second token 112 of the leaf node 122 includes attribute information of a parent node of the leaf node 122;
the network node 120 is further configured to, when receiving the second token 112, send, according to attribute information of a parent node of the second token 112, path information of the second token to the parent node of the second token; under the condition that path information sent by a child node of the self is received, the path information sent by the child node of the self is sent to a father node of the self;
the network node 120 is further configured to, when receiving the first token 111, calculate a path weight of a path between the network nodes 120 according to the received path information of each network node 120; transmitting the path weights to each network node;
The network node 120 is further configured to determine, when a data request is received, a destination network node where target service data requested by the data request is located, and determine a communication path from itself to the destination network node according to the path weight; and acquiring the target service data through the communication path.
The token server 110 may construct a tree network of each network node according to attribute information of the network node in each token application information, where in the tree network, the network node 120 includes a root node 121 and multiple layers of leaf nodes 122, as shown in fig. 1, for any network node, an upper node of the network node (i.e., a network node near one end of the root node connected to the network node) is called a parent node of the network node, and a lower node of the network node (i.e., a network node near one end of the root node connected to the network node) is called a child node of the network node. As can be seen from fig. 1, the root node 121 is parent-free, while the lowest leaf node 122 is child-free.
The token generated by the token server 110 includes a first token 111 and a second token 112, the first token 111 is sent to the root node 121, and when resolving that the token acquired by the network node 120 is the first token, the network node 120 can determine that the network node itself is the root node 121. The second token 112 is sent to the leaf node 122, and the network node 120 may determine itself to be the leaf node 122 when resolving that the token acquired by itself is the second token. For any leaf node 122, the attribute information, such as an IP address, of the parent node of the leaf node 122 is included in the second token 112 of the leaf node 122, and the leaf node 122 may determine its parent node according to the attribute information of the parent node in the second token.
After the network node determines itself as the leaf node, the network node sends path information to its own parent node according to attribute information of the parent node in the second token, and in addition, if the network node has a child node, the network node forwards the path information of its own child node to its own parent node, so that the root node can finally obtain path information of all network nodes on the whole path, and the root node calculates and obtains path weights of paths between the network nodes based on the received path information, where the path weights are used to represent whether communication quality is good or bad on the path, in one example, the better the communication quality is, the smaller the path weights are, so that the path weights can be regarded as distances of paths, and the network node can obtain communication paths between the network node and the destination network node through a shortest path algorithm. In one example, the better the communication quality, the greater the path weight, in which case the inverse of the path weight may be taken as the distance of the path, and the network node may also obtain the communication path with the destination network node through the shortest path algorithm. The communication path of data transmission is freely selected according to the path weight, so that the efficiency of data transmission is improved; and the first token and the second token realize the dynamic generation of the tree network, form the tree network node capable of freely selecting the target service data transmission path, and reduce the operation cost and operation difficulty of the data processing system.
As shown in fig. 2, in some embodiments, the system further comprises: a center server 130;
the network node 120 is further configured to report service data stored in the network node to the central server 130;
the network node 120 is specifically configured to determine, when a data request is received, target service data requested by the data request; sending a query request for querying the network node 120 where the target service data is located to the central server 130; acquiring a query result returned by the central server 130, wherein the query result comprises a destination network node where the target service data is located;
the central server 130 is configured to query, in response to the query request, a destination network node where the target service data is located, to obtain a query result; and returns the query result to the network node 120 that sent the query request.
When determining the transmission path, the network node, i.e. the destination network node, where the service data needed by the client exists is determined first, so as to perform path selection and transmit the service data needed by the client to the client.
As shown in fig. 2, when determining whether the network node 120 has service data required by the client, the central server 130 needs to be used as a query end, and each network node 120 will report the service data stored in itself to the central server 130, so that which network node 120 includes the service data required by the client can be queried through the central server 130, and finally the query result is returned to the network node 120 to be determined, so as to complete the determination of whether the network node 120 in the transmission path has the service data required by the client.
As shown in fig. 3, in some embodiments, for any network node 120, the attribute information of the network node 120 includes IP address information and service resource information of the network node 120;
the token server 110 is specifically configured to determine a physical location of each network node 120 according to IP address information of the network node in each token application information; and constructing a tree network of each network node 120 according to the physical position and the service resource information of each network node 120.
The traffic resource information of the network node 120 indicates the usage of traffic resources in the network node, e.g. bandwidth usage, computing resource usage, storage resource usage, etc. The token server 110 obtains the IP address of each network node, determines a physical address according to the IP address of each network node 120, and constructs a tree network of network nodes according to the physical address and the service resource information to form a plurality of data transmission paths. In building a tree network, it is first considered that a physical address, based on which a tree network can be built on a physical location level. When a plurality of network nodes are included under the same physical address, a parent node is selected based on the service resource information, for example, a network node with the most service resources is selected as the parent node, and other network nodes are selected as child nodes thereof.
As shown in fig. 3, in some embodiments, the token server 110 is further configured to calculate a timing interval according to the number of the network nodes 120 and service resource information of each of the network nodes; transmitting the timing interval to each of the network nodes 120; wherein the timing interval is positively correlated with the number of the network nodes 120 and positively correlated with the number of the traffic resources represented by the traffic resource information of the network nodes 120;
the network node 120 is specifically configured to obtain attribute information of itself according to the timing interval, generate token application information including attribute information of itself, and send the token application information to the token server 110.
The timing interval refers to that each network node 120 acquires its own attribute information at a certain time interval and transmits token application information to the token server 110.
The longer the timing interval when there are more network nodes 120 in the data processing system, and the longer the timing interval when there are more traffic resources indicated by the traffic resource information in the network nodes 120.
As shown in fig. 1, in some embodiments, the token server 110 is specifically configured to, for each network node 120, determine, according to the location of the network node 120 in the tree network, whether the network node is a root node 121; in the case that the network node is the root node 121, generating a first token 111 indicating that the network node is the root node 121, and transmitting the first token 111 of the network node to the network node; in case the network node is not the root node 121, determining a parent node of the network node, generating a second token 112 comprising attribute information of the parent node of the network node, and transmitting the second token 112 of the network node to the network node.
The root node 121 is generally located at the uppermost stage of each network node in the tree network, and the network node 120 determines itself as the root node 121 after receiving the first token 111 sent by the token server; the network nodes of the other levels than the root node 121 are called leaf nodes 122, and the network node 120 determines itself as a leaf node 122 after receiving the second token 112 issued by the token server.
As shown in fig. 4, in some embodiments, the first token 111 includes a time stamp and a key stamp therein; the time stamp of the first token represents the validity time of the first token 111, and the key stamp of the first token represents the encryption and decryption algorithm of the first token;
the network node is specifically configured to determine, when receiving the first token 111, an encryption algorithm corresponding to a key token of the first token to obtain a first encryption algorithm; decrypting the first token 111 by using the first encryption and decryption algorithm to obtain a time stamp of the first token, and determining that the first token 111 is received by the first token; when the time stamp of the first token indicates that the first token 111 has expired, the attribute information of the first token is acquired, token application information including the attribute information of the first token is generated, and the token application information is transmitted to the token server 110.
The time stamp included in the first token 111 may be understood as the valid time of the first token, and after exceeding the valid time of the first token, i.e. the first token fails, the root node needs to resend the attribute information of itself and send the token application information. In order to ensure data security, the data in the first token can be encrypted through an encryption and decryption algorithm, so that after the network node receives the first token, the first token needs to be decrypted through the encryption and decryption algorithm, and information after the first token is decrypted is obtained. However, the encryption algorithm in the related art is various, so the encryption algorithm used needs to be determined through the key mark, and it can be understood that the key mark does not need to be encrypted by the encryption algorithm, otherwise, the corresponding encryption algorithm cannot be obtained based on the key mark, and the encryption algorithm represented by the key mark is called as a first encryption algorithm in the application.
In addition, when the effective time of the first token expires, which means that the timing interval expires, the duration of the time mark is the timing interval, and when the effective time of the first token expires, the network node automatically sends new token application information to the token server.
As shown in fig. 4, in some embodiments, the second token 112 includes a time stamp and a key stamp therein; the timestamp of the second token represents the validity time of the second token 112, and the key token of the second token represents the encryption and decryption algorithm of the second token;
the network node is specifically configured to determine, when receiving the second token 112, an encryption algorithm corresponding to a key token of the second token to obtain a second encryption algorithm; decrypting the second token 112 by using the second encryption and decryption algorithm to obtain a time stamp of the second token, and determining that the second token 112 is received by the second token; when the time stamp of the second token indicates that the second token 112 expires, the attribute information of the second token is acquired, token application information including the attribute information of the second token is generated, and the token application information is transmitted to the token server.
The time stamp included in the second token 112 may be understood as the validity time of the second token, i.e. each leaf node 122 may obtain attribute information through the second token 112 only within the validity time range, and the key stamp of the second token needs to be decrypted by the second encryption and decryption algorithm before the time stamp is obtained.
In addition, when the valid time of the second token expires, which means that the timing interval expires, the duration of the time stamp is the timing interval, and when the valid time of the second token expires, the network node automatically sends new token application information to the token server.
In some embodiments, for any network node, the path information of the network node includes at least one of traffic resource information of the network node, a network state with a parent node, a number of disconnects with the parent node per unit time, a network state with an alternative parent node, and a network state with a token server.
When selecting a data transmission path, a suitable network node needs to be selected as the data transmission path according to the path information of each network node, and the basis for selecting the data transmission path is that the path information of each network node generally includes the service resource information of the network node, the network state of the parent node, the disconnection times of the parent node in a unit period, the network state of an alternative parent node and the network state of a token server, so that the path information is generally used as the basis for selecting the data transmission path.
The root node is used for processing the path weights of the paths between the network nodes according to the path information of the network nodes, and when the path information is even for a plurality of items, the path weights of the paths can be calculated in a weighted mode. In one example, the better the communication quality of a path, the greater the path weight of that path, in which case: the path weight of the path is positively correlated with the service resource quantity represented by the service resource information of two network nodes on the path, namely when other projects are the same, the larger the service resource quantity of the network nodes is, the more available service resources are, the larger the path weight is; the path weight of the path is positively correlated with the network state of the father node, namely when other items are the same, the better the network state of the father node is, the greater the path weight is; the path weight of the path is inversely related to the disconnection times of the network node and the father node in the unit time period, namely, when other projects are the same, the fewer the disconnection times of the network node and the father node in the unit time period are, the larger the path weight is; the path weight of the path is inversely related to the network state of the alternative father node, namely when other items are the same, the better the network state of the alternative father node is, the smaller the path weight is; the path weight of the path is positively correlated with the network state of the network node and the token server, i.e. the better the network state of the network node and the token server the greater the path weight when the other items are the same.
Referring to fig. 5, in a second aspect of an embodiment of the present invention, there is provided a data processing method applied to a data processing system, the data processing system including a token server and a plurality of network nodes; the method comprises the following steps:
s101, the network node acquires attribute information of the network node, generates token application information comprising the attribute information of the network node, and sends the token application information to the token server;
s102, the token server receives token application information of each network node; constructing a tree network of each network node according to the attribute information of the network node in each token application information; transmitting a first token representing a network node as a root node to a root node in the tree network; sending a second token to a leaf node in the tree network, wherein the second token of the leaf node comprises attribute information of a father node of the leaf node for any leaf node;
s103, under the condition that the network node receives the second token, sending own path information to own father node according to attribute information of own father node in the second token; under the condition that path information sent by a child node of the self is received, the path information sent by the child node of the self is sent to a father node of the self;
S104, under the condition that the network node receives the first token, calculating the path weight of the path between the network nodes according to the received path information of the network nodes; transmitting the path weights to each network node;
s105, under the condition that the network node receives the data request, determining a destination network node where target service data requested by the data request is located, and determining a communication path from the network node to the destination network node according to the path weight; and acquiring the target service data through the communication path.
Referring to FIG. 6, in some embodiments, the data processing system further includes a central server;
the method further comprises the steps of:
s201, the network node reports the service data stored in the network node to the central server;
s202, under the condition that the network node receives a data request, determining a destination network node where target service data requested by the data request is located;
s203, under the condition that the network node receives a data request, determining target service data requested by the data request; sending a query request for querying a network node where the target service data are located to the central server;
S204, the central server responds to the query request and queries the destination network node where the target service data is located to obtain a query result; returning the query result to the network node sending the query request, wherein the query result comprises a target network node where the target service data is located;
s205, the network node obtains the query result returned by the center server, and analyzes the query result to obtain the target network node where the target service data is located.
Referring to fig. 7, in a third aspect of the embodiment of the present invention, there is provided a data processing apparatus, for application in a data processing system, the data processing system including a token server and a plurality of network nodes; the device comprises:
an attribute information acquisition module 701, configured to enable the network node to acquire attribute information of the network node, generate token application information including attribute information of the network node, and send the token application information to the token server;
a token sending module 702, configured to enable the token server to receive token application information of each network node; constructing a tree network of each network node according to the attribute information of the network node in each token application information; transmitting a first token representing a network node as a root node to a root node in the tree network; sending a second token to a leaf node in the tree network, wherein the second token of the leaf node comprises attribute information of a father node of the leaf node for any leaf node;
A path information sending module 703, configured to enable the network node to send, when receiving the second token, own path information to an own parent node according to attribute information of the own parent node in the second token; under the condition that path information sent by a child node of the self is received, the path information sent by the child node of the self is sent to a father node of the self;
a path weight sending module 704, configured to enable the network node to calculate, when receiving the first token, a path weight of a path between the network nodes according to the received path information of each network node; transmitting the path weights to each network node;
a target service data acquisition module 705, configured to enable the network node to determine, when receiving a data request, a destination network node where target service data requested by the data request is located, and determine a communication path from the network node to the destination network node according to the path weight; and acquiring the target service data through the communication path.
In some embodiments, the data processing system further comprises a central server; the target service data acquisition module further comprises:
the service data reporting sub-module is used for enabling the network node to report the service data stored in the network node to the central server;
a service data determining submodule, configured to enable the network node to determine, when receiving a data request, a destination network node where target service data requested by the data request is located, where the service data determining submodule includes:
a query request sending unit, configured to enable the network node to determine target service data requested by a data request when receiving the data request; sending a query request for querying a network node where the target service data are located to the central server;
the query result obtaining unit is used for enabling the central server to respond to the query request and query the destination network node where the target service data are located to obtain a query result; returning the query result to the network node sending the query request, wherein the query result comprises a target network node where the target service data is located;
And the query result analysis unit is used for enabling the network node to acquire the query result returned by the central server and analyzing the query result to obtain the target network node where the target service data is located.
The embodiment of the present invention further provides an electronic device, as shown in fig. 8, including a processor 801, a communication interface 802, a memory 803, and a communication bus 804, where the processor 801, the communication interface 802, and the memory 803 complete communication with each other through the communication bus 804,
a memory 803 for storing a computer program;
the processor 801 is configured to implement any of the above-described data processing method steps when executing a program stored in the memory 803.
The communication bus mentioned above for the electronic devices may be a peripheral component interconnect standard (Peripheral Component Interconnect, PCI) bus or an extended industry standard architecture (Extended Industry Standard Architecture, EISA) bus, etc. The communication bus may be classified as an address bus, a data bus, a control bus, or the like. For ease of illustration, the figures are shown with only one bold line, but not with only one bus or one type of bus.
The communication interface is used for communication between the electronic device and other devices.
The memory may include random access memory (Random Access Memory, RAM) or may include Non-volatile memory (Non-VolatileMemory, NVM), such as at least one disk memory. Optionally, the memory may also be at least one memory device located remotely from the aforementioned processor.
The processor may be a general-purpose processor, including a central processing unit (Central Processing Unit, CPU), a network processor (Network Processor, NP), etc.; but also digital signal processors (Digital Signal Processor, DSP), application specific integrated circuits (Application Specific Integrated Circuit, ASIC), field programmable gate arrays (Field-ProgrammableGate Array, FPGA) or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components.
In yet another embodiment of the present invention, there is also provided a computer readable storage medium having stored therein a computer program which when executed by a processor implements the steps of any of the data processing methods described above.
In the above embodiments, it may be implemented in whole or in part by software, hardware, firmware, or any combination thereof. When implemented in software, may be implemented in whole or in part in the form of a computer program product. The computer program product includes one or more computer instructions. When loaded and executed on a computer, produces a flow or function in accordance with embodiments of the present invention, in whole or in part. The computer may be a general purpose computer, a special purpose computer, a computer network, or other programmable apparatus. The computer instructions may be stored in or transmitted from one computer-readable storage medium to another, for example, by wired (e.g., coaxial cable, optical fiber, digital Subscriber Line (DSL)), or wireless (e.g., infrared, wireless, microwave, etc.). The computer readable storage medium may be any available medium that can be accessed by a computer or a data storage device such as a server, data center, etc. that contains an integration of one or more available media. The usable medium may be a magnetic medium (e.g., floppy Disk, hard Disk, magnetic tape), an optical medium (e.g., DVD), or a semiconductor medium (e.g., solid State Disk (SSD)), etc.
It is noted that relational terms such as first and second, and the like are used solely to distinguish one entity or action from another entity or action without necessarily requiring or implying any actual such relationship or order between such entities or actions. Moreover, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising one … …" does not exclude the presence of other like elements in a process, method, article, or apparatus that comprises the element.
In this specification, each embodiment is described in a related manner, and identical and similar parts of each embodiment are all referred to each other, and each embodiment mainly describes differences from other embodiments. In particular, for system embodiments, since they are substantially similar to method embodiments, the description is relatively simple, as relevant to see a section of the description of method embodiments.
The foregoing description is only of the preferred embodiments of the present invention and is not intended to limit the scope of the present invention. Any modification, equivalent replacement, improvement, etc. made within the spirit and principle of the present invention are included in the protection scope of the present invention.
Claims (10)
1. A data processing system, comprising:
a token server and a plurality of network nodes;
the network node is used for acquiring attribute information of the network node, generating token application information comprising the attribute information of the network node, and sending the token application information to the token server;
the token server is used for receiving the token application information of each network node; constructing a tree network of each network node according to the attribute information of the network node in each token application information; transmitting a first token representing a network node as a root node to a root node in the tree network; sending a second token to a leaf node in the tree network, wherein the second token of the leaf node comprises attribute information of a father node of the leaf node for any leaf node;
the network node is further configured to send, when receiving the second token, own path information to an own parent node according to attribute information of the own parent node in the second token; under the condition that path information sent by a child node of the self is received, the path information sent by the child node of the self is sent to a father node of the self;
The network node is further configured to, when receiving the first token, calculate a path weight of a path between the network nodes according to the received path information of each network node; transmitting the path weights to each network node;
the network node is further configured to determine, when receiving a data request, a destination network node where target service data requested by the data request is located, and determine a communication path from the network node to the destination network node according to the path weight; and acquiring the target service data through the communication path.
2. The data processing system of claim 1, wherein the system further comprises: a central server;
the network node is further configured to report service data stored in the network node to the central server;
the network node is specifically configured to determine target service data requested by a data request when the data request is received; sending a query request for querying a network node where the target service data are located to the central server; acquiring a query result returned by the central server, wherein the query result comprises a destination network node where the target service data are located;
The central server is used for responding to the query request and querying the destination network node where the target service data are located to obtain a query result; and returning the query result to the network node which sends the query request.
3. The data processing system according to claim 1, wherein for any network node, the attribute information of the network node includes IP address information and service resource information of the network node;
the token server is specifically configured to determine a physical location of each network node according to IP address information of the network node in each token application information; and constructing a tree network of each network node according to the physical position and the service resource information of each network node.
4. A data processing system according to claim 3, wherein the token server is further configured to calculate a timing interval based on the number of network nodes and traffic resource information of each of the network nodes; transmitting the timing interval to each of the network nodes; wherein the timing interval is positively correlated with the number of the network nodes and positively correlated with the number of the service resources represented by the service resource information of the network nodes;
The network node is specifically configured to obtain attribute information of the network node according to the timing interval, generate token application information including the attribute information of the network node, and send the token application information to the token server.
5. The data processing system according to claim 1, wherein the token server is specifically configured to determine, for each network node, whether the network node is a root node according to its location in the tree network; generating a first token representing the network node as a root node and transmitting the first token of the network node to the network node under the condition that the network node is the root node; and if the network node is not a root node, determining a father node of the network node, generating a second token comprising attribute information of the father node of the network node, and sending the second token of the network node to the network node.
6. The data processing system of claim 1, wherein the first token includes a time stamp and a key stamp; the time mark of the first token represents the effective time of the first token, and the key mark of the first token represents the encryption and decryption algorithm of the first token;
The network node is specifically configured to determine an encryption and decryption algorithm corresponding to a key label of the first token to obtain a first encryption and decryption algorithm when the first token is received; decrypting the first token by using the first encryption and decryption algorithm to obtain a time mark of the first token, and determining that the first token is received by the first token; and under the condition that the time mark of the first token indicates that the first token is out of date, acquiring attribute information of the first token, generating token application information comprising the attribute information of the first token, and sending the token application information to the token server.
7. The data processing system of claim 1, wherein the second token includes a time stamp and a key stamp; the time mark of the second token represents the effective time of the second token, and the key mark of the second token represents the encryption and decryption algorithm of the second token;
the network node is specifically configured to determine an encryption and decryption algorithm corresponding to a key label of the second token to obtain a second encryption and decryption algorithm when the second token is received; decrypting the second token by using the second encryption and decryption algorithm to obtain a time mark of the second token, and determining that the second token is received by the second token; and under the condition that the time mark of the second token indicates that the second token is out of date, acquiring attribute information of the second token, generating token application information comprising the attribute information of the second token, and sending the token application information to the token server.
8. The data processing system of claim 1, wherein the path information for any network node includes at least one of traffic resource information for the network node, network status with a parent node, number of disconnects with the parent node per unit time, network status with an alternative parent node, and network status with a token server.
9. A data processing method, characterized in that it is applied to a data processing system, the data processing system includes a token server and a plurality of network nodes; the method comprises the following steps:
the network node acquires attribute information of the network node, generates token application information comprising the attribute information of the network node, and sends the token application information to the token server;
the token server receives the token application information of each network node; constructing a tree network of each network node according to the attribute information of the network node in each token application information; transmitting a first token representing a network node as a root node to a root node in the tree network; sending a second token to a leaf node in the tree network, wherein the second token of the leaf node comprises attribute information of a father node of the leaf node for any leaf node;
The network node sends own path information to own father node according to attribute information of own father node in the second token under the condition of receiving the second token; under the condition that path information sent by a child node of the self is received, the path information sent by the child node of the self is sent to a father node of the self;
under the condition that the network node receives the first token, calculating the path weight of the path between the network nodes according to the received path information of the network nodes; transmitting the path weights to each network node;
the network node determines a destination network node where target service data requested by the data request is located under the condition of receiving the data request, and determines a communication path from the network node to the destination network node according to the path weight; and acquiring the target service data through the communication path.
10. The method of claim 9, wherein the data processing system further comprises a central server;
the method further comprises the steps of: the network node reports the service data stored in the network node to the central server;
The network node determining a destination network node where target service data requested by the data request is located under the condition of receiving the data request, including:
the network node determines target service data requested by the data request under the condition of receiving the data request; sending a query request for querying a network node where the target service data are located to the central server;
the central server responds to the query request and queries the destination network node where the target service data is located to obtain a query result; returning the query result to the network node sending the query request, wherein the query result comprises a target network node where the target service data is located;
and the network node acquires a query result returned by the central server, and analyzes the query result to obtain a target network node where the target service data is located.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202310042942.5A CN115866070B (en) | 2023-01-28 | 2023-01-28 | Data processing system and data processing method |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202310042942.5A CN115866070B (en) | 2023-01-28 | 2023-01-28 | Data processing system and data processing method |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN115866070A CN115866070A (en) | 2023-03-28 |
| CN115866070B true CN115866070B (en) | 2023-05-02 |
Family
ID=85657306
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202310042942.5A Active CN115866070B (en) | 2023-01-28 | 2023-01-28 | Data processing system and data processing method |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN115866070B (en) |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102857990A (en) * | 2012-09-29 | 2013-01-02 | 无锡南理工科技发展有限公司 | Three-level tree structure token double-cluster head clustering method oriented to high-speed node ad hoc network |
| CN112423365A (en) * | 2020-09-29 | 2021-02-26 | 国网天津市电力公司 | MESH networking communication method for LoRa communication of power distribution station equipment |
| CN112738812A (en) * | 2020-12-24 | 2021-04-30 | 普联国际有限公司 | Wireless network automatic adjustment method and device, terminal equipment and storage medium |
Family Cites Families (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US8134950B2 (en) * | 2007-04-03 | 2012-03-13 | Harris Corporation | Cluster head election in an ad-hoc network |
| KR101985309B1 (en) * | 2017-06-12 | 2019-06-04 | 주식회사 티맥스데이터 | Method of creating the balanced parse tree having optimized height |
-
2023
- 2023-01-28 CN CN202310042942.5A patent/CN115866070B/en active Active
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102857990A (en) * | 2012-09-29 | 2013-01-02 | 无锡南理工科技发展有限公司 | Three-level tree structure token double-cluster head clustering method oriented to high-speed node ad hoc network |
| CN112423365A (en) * | 2020-09-29 | 2021-02-26 | 国网天津市电力公司 | MESH networking communication method for LoRa communication of power distribution station equipment |
| CN112738812A (en) * | 2020-12-24 | 2021-04-30 | 普联国际有限公司 | Wireless network automatic adjustment method and device, terminal equipment and storage medium |
Also Published As
| Publication number | Publication date |
|---|---|
| CN115866070A (en) | 2023-03-28 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US8510448B2 (en) | Service provider registration by a content broker | |
| US8122098B1 (en) | Managing content delivery network service providers by a content broker | |
| US9124621B2 (en) | Security alert prioritization | |
| US9525659B1 (en) | Request routing utilizing point of presence load information | |
| CN107395783B (en) | IP address processing method, system, device and electronic equipment | |
| Nichols | Lessons learned building a secure network measurement framework using basic NDN | |
| CN103051717A (en) | Method, device and equipment for processing http request | |
| CN105337786A (en) | Server performance detection method, apparatus and equipment | |
| US20210158353A1 (en) | Methods, systems, apparatuses, and devices for processing request in consortium blockchain | |
| US20130173965A1 (en) | Fault tracing system and method for remote maintenance | |
| CN110677684B (en) | Video processing method, video access method, distributed storage method and distributed video access system | |
| CN111355971A (en) | Live streaming transmission method and device, CDN server and computer readable medium | |
| US20230267326A1 (en) | Machine Learning Model Management Method and Apparatus, and System | |
| CN108964822B (en) | Method and system for acquiring network time in parallel by multiple schemes | |
| CN112866062B (en) | Distributed pressure test system, method, device, equipment and storage medium | |
| WO2015154459A1 (en) | Notification method and device for change of subscribed resource | |
| CN113067803B (en) | Resource isolation system, request processing method and request processing device | |
| CN115866070B (en) | Data processing system and data processing method | |
| CN110677683B (en) | Video storage and video access method and distributed storage and video access system | |
| CN108737493B (en) | Address allocation method and device and electronic equipment | |
| RU2008121872A (en) | NEAREST NODE FOR CONNECTIONS OF DISTRIBUTED SERVICES | |
| CN110691023B (en) | Address system | |
| CN111294553B (en) | Method, device, equipment and storage medium for processing video monitoring service signaling | |
| EP3382975B1 (en) | Content designation for a content delivery network | |
| JP2011048504A (en) | Method, apparatus, and program for load distribution between authentication servers |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |