CN116743752A - System for realizing data processing load balance by distributed network communication - Google Patents
System for realizing data processing load balance by distributed network communication Download PDFInfo
- Publication number
- CN116743752A CN116743752A CN202311006624.XA CN202311006624A CN116743752A CN 116743752 A CN116743752 A CN 116743752A CN 202311006624 A CN202311006624 A CN 202311006624A CN 116743752 A CN116743752 A CN 116743752A
- Authority
- CN
- China
- Prior art keywords
- data
- node
- sub
- module
- nodes
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000012545 processing Methods 0.000 title claims abstract description 37
- 238000004891 communication Methods 0.000 title claims abstract description 35
- 230000005540 biological transmission Effects 0.000 claims abstract description 11
- 238000001514 detection method Methods 0.000 claims abstract description 11
- 230000002159 abnormal effect Effects 0.000 claims description 34
- 230000005856 abnormality Effects 0.000 claims description 10
- 238000000034 method Methods 0.000 claims description 10
- 238000012163 sequencing technique Methods 0.000 claims description 8
- 230000008569 process Effects 0.000 claims description 7
- 230000007246 mechanism Effects 0.000 claims description 6
- 238000011084 recovery Methods 0.000 claims description 6
- 230000004044 response Effects 0.000 claims description 4
- 230000006870 function Effects 0.000 claims description 3
- 230000036541 health Effects 0.000 claims description 3
- 238000012544 monitoring process Methods 0.000 claims description 3
- 230000006872 improvement Effects 0.000 description 7
- 238000010586 diagram Methods 0.000 description 3
- 238000011161 development Methods 0.000 description 2
- 230000009286 beneficial effect Effects 0.000 description 1
- 230000003111 delayed effect Effects 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 238000012360 testing method Methods 0.000 description 1
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/10—Protocols in which an application is distributed across nodes in the network
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L41/00—Arrangements for maintenance, administration or management of data switching networks, e.g. of packet switching networks
- H04L41/06—Management of faults, events, alarms or notifications
- H04L41/0654—Management of faults, events, alarms or notifications using network fault recovery
- H04L41/0663—Performing the actions predefined by failover planning, e.g. switching to standby network elements
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/10—Protocols in which an application is distributed across nodes in the network
- H04L67/1001—Protocols in which an application is distributed across nodes in the network for accessing one among a plurality of replicated servers
- H04L67/1004—Server selection for load balancing
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/10—Protocols in which an application is distributed across nodes in the network
- H04L67/1001—Protocols in which an application is distributed across nodes in the network for accessing one among a plurality of replicated servers
- H04L67/1029—Protocols in which an application is distributed across nodes in the network for accessing one among a plurality of replicated servers using data related to the state of servers by a load balancer
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/10—Protocols in which an application is distributed across nodes in the network
- H04L67/1001—Protocols in which an application is distributed across nodes in the network for accessing one among a plurality of replicated servers
- H04L67/1034—Reaction to server failures by a load balancer
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/10—Protocols in which an application is distributed across nodes in the network
- H04L67/1095—Replication or mirroring of data, e.g. scheduling or transport for data synchronisation between network nodes
Landscapes
- Engineering & Computer Science (AREA)
- Computer Networks & Wireless Communication (AREA)
- Signal Processing (AREA)
- Data Exchanges In Wide-Area Networks (AREA)
Abstract
The invention relates to the technical field of data processing, in particular to a distributed network communication realization data processing load balancing system, which comprises a data splitting unit, a data distribution unit, an anomaly detection unit, a data processing unit and a transmission summarizing unit.
Description
Technical Field
The invention relates to the technical field of data processing, in particular to a system for realizing data processing load balance by distributed network communication.
Background
With technological development, network communication is a communication mode widely applied in modern society, network communication data refers to various information transmitted through a computer network, including e-mail, web page browsing, instant messaging, audio and video, etc., with rapid development of cloud computing and big data application, the data processing requirement scale is continuously growing, especially when video data is processed, at present, when a centralized data processing system is mostly adopted to perform network communication transmission on the video data, all communication data processing tasks and operations are performed on a central node or a server, because of a single computing node in the centralized data processing system, when the data is processed, the data set is required to be simultaneously transmitted and processed, when the video data memory is large, the data processing speed is slow and the response delay is caused to affect the efficiency and the real-time performance of the data processing, and the video data is possibly unstable to be lost or delayed due to overlarge load, so that when the video data is processed, the transmission efficiency is low, the failure of the centralized data processing system on the video data is caused to interrupt of the whole system, and the data loss and service unavailability are caused by the failure of the single node, and the system is greatly limited.
In order to address the above problems, a system for implementing data processing load balancing by using distributed network communication is needed.
Disclosure of Invention
The invention aims to provide a distributed network communication system for realizing data processing load balancing so as to solve the problems in the background technology.
In order to achieve the above purpose, a distributed network communication system for realizing data processing load balancing is provided, which comprises a data splitting unit, a distributed data output unit, a node abnormality replacing unit and a distributed data summarizing unit, wherein the data splitting unit is used for splitting data;
the data splitting unit is used for splitting the network communication data to be processed into a plurality of sub-data and marking serial numbers on the plurality of sub-data in sequence;
the distributed data output unit is used for establishing a plurality of nodes with balanced loads, and transmitting the sub-data of the data splitting unit into a plurality of nodes according to the sequence of the serial numbers to process the data, wherein the nodes and the sub-data are in one-to-one correspondence;
the node abnormality replacing unit is used for detecting the working condition of the distributed data output unit node, if the working condition is normal, the sub-data processing is continued, and if the working condition is abnormal, the spare node is used for replacing the abnormal node to process the sub-data;
the distributed data summarizing unit is used for sequentially receiving the sub-data processed in the distributed data output unit according to the sequence numbers marked in the data splitting unit, and sequentially sequencing, summarizing and merging the sub-data into complete network communication data according to the sequence numbers.
As a further improvement of the technical scheme, the data splitting unit comprises a data dividing module and a sub-data marking module;
the data dividing module uniformly divides the network communication data to be processed into a plurality of sub-data with fixed size in an equal dividing mode; the sub data marking module sequentially sorts the plurality of sub data in the data dividing module in a serial number increasing mode and marks the serial numbers.
As a further improvement of the technical scheme, the distributed data output unit comprises a node establishment module and a data distribution module;
the node establishing module establishes a plurality of load balancing nodes through the cloud platform, and the nodes are used for receiving the sub-data in the data dividing module; the data distribution module sends the sub-data to the corresponding nodes through the group sending strategy, so that the nodes established by the node establishment module are in one-to-one correspondence with the sub-data.
As a further improvement of the technical scheme, the mass-sending strategy in the data distribution module sends the sub-data to the corresponding node, and the specific steps are as follows:
determining each sub-data to be sent to a corresponding target node through a hash function; and establishing network connection for each target node, and sending the sub-data to the corresponding node through the network connection.
As a further improvement of the technical scheme, the distributed data output unit further comprises a data backup module, wherein the data backup module adopts a data redundancy backup method to backup the sub data, and when a certain node is damaged, the backup data can be obtained from other nodes.
As a further improvement of the technical scheme, the node abnormality replacement unit comprises a signal detection unit and a work coordinator;
the signal detection unit periodically sends heartbeat information to the nodes in the node building module, the node receiving signal responses to prove that the nodes are normal, and the node receiving signal does not respond to prove that the nodes are damaged; the work coordinator is used for detecting abnormal conditions of the nodes, triggering a fault recovery mechanism when the nodes are damaged, and reassigning unfinished tasks on the nodes to standby nodes so as to ensure smooth execution of the tasks.
As a further improvement of the technical scheme, the work coordinator detects the abnormal condition of the node, and the steps for triggering the fault recovery mechanism when the node is damaged are as follows:
the work coordinator acquires the health condition of the node by periodically or real-timely monitoring the state information of the node; the work coordinator discovers that the node does not respond to the heartbeat signal for a long time, and judges that abnormal damage occurs to the node; the work coordinator detects that the abnormal damage of the node is that the abnormal damage node is marked as an unavailable state, and no new task is allocated to the abnormal damage node; the work coordinator selects the standby node as a target node, and distributes incomplete transmission tasks of the abnormal damaged node to the standby node.
As a further improvement of the technical scheme, the distributed data summarizing unit comprises a sub-data ordering module and a data summarizing module;
the sub-data sequencing module is used for receiving sub-data in the data distribution module and identifying sequence numbers of the sub-data, and sequencing the sub-data sequence numbers in sequence through a sequencing algorithm; and the data summarizing module adopts a merging algorithm to orderly merge the sub-data ordered by the sub-data ordering module into a complete data set.
Compared with the prior art, the invention has the beneficial effects that:
1. in the distributed network communication realization data processing load balancing system, data to be processed is split into a plurality of sub-data through a data splitting unit, the sub-data are marked with serial numbers in sequence, the sub-data are transmitted to corresponding nodes through a distributed data output unit through a group transmission testing, so that the nodes and the sub-data are in one-to-one correspondence, sub-data processing tasks are distributed to the plurality of nodes, the system can realize parallel processing, thereby remarkably improving data processing speed and throughput, maximally utilizing system resources, improving overall performance, sorting and summarizing the sub-data in the distributed data output unit through a distributed data summarizing unit, and guaranteeing stability of data transmission while realizing network communication data load balancing.
2. In the distributed network communication realization data processing load balancing system, the abnormal detection is carried out on a plurality of nodes in the load balancing system through the node abnormal replacement unit, a plurality of standby nodes are arranged at the same time, when a certain node is abnormal, the abnormal node is timely detected through the work coordinator, and the replacement is carried out through the standby nodes, so that the whole system interruption caused by the single node fault is avoided, and the stability and the practicability of the system are improved.
Drawings
FIG. 1 is a schematic diagram of the overall module of the present invention;
FIG. 2 is a schematic diagram of a distributed data output unit according to the present invention;
fig. 3 is a schematic diagram of a distributed data summarizing unit according to the present invention.
The meaning of each reference sign in the figure is:
100. a data splitting unit; 110. a data dividing module; 120. a sub-data marking module;
200. a distributed data output unit; 210. a node building module; 220; a data distribution module; 230. a data backup module;
300. a node abnormality replacement unit; 310. a signal detection unit;
400. a distributed data summarizing unit; 410. a sub-data ordering module; 420. and a summarizing module.
Detailed Description
The following description of the embodiments of the present invention will be made clearly and completely with reference to the accompanying drawings, in which it is apparent that the embodiments described are only some embodiments of the present invention, but not all embodiments. All other embodiments, which can be made by those skilled in the art based on the embodiments of the invention without making any inventive effort, are intended to be within the scope of the invention.
Referring to fig. 1 to 3, a system for implementing data processing load balancing by distributed network communication is provided, which includes a data splitting unit 100, a distributed data output unit 200, a node anomaly replacing unit 300, and a distributed data summarizing unit 400, wherein;
the data splitting unit 100 is configured to split network communication data to be processed into a plurality of sub-data, and mark sequence numbers on the plurality of sub-data in sequence;
the data splitting unit 100 includes a data dividing module 110 and a sub data marking module 120;
the data dividing module 110 divides the network communication data to be processed into a plurality of sub-data with fixed size in an equal dividing manner, and the sub-data marking module 120 sequentially sorts the plurality of sub-data in the data dividing module 110 in a sequential increasing manner and marks the sequence number.
When the device is specifically used, the data splitting unit 100 is used for receiving data to be processed, the data dividing module 110 is used for uniformly splitting the network communication data to be processed, so that the data to be processed form sub-data with a fixed size, the sub-data are synchronously transmitted, and therefore data transmission efficiency is improved, the sub-data are marked with serial numbers through the sub-data marking module 120, for example, the network communication data to be processed is set as A, the A is uniformly split to form a plurality of sub-data, and the serial numbers of the sub-data are marked with A1, A2 and A3.
The distributed data output unit 200 is configured to establish a plurality of load-balanced nodes, so that the sub-data of the data splitting unit 100 is transmitted to the plurality of nodes to process data according to the sequence of the serial numbers, where the nodes and the sub-data are in one-to-one correspondence;
the distributed data output unit 200 includes a node establishment module 210 and a data distribution module 220;
the node establishing module 210 establishes a plurality of load balancing nodes through the cloud platform, and the nodes are used for receiving the sub-data in the data dividing module 110; the data distribution module 220 sends the sub-data to the corresponding nodes through the group sending strategy, so that the nodes established by the node establishment module 210 are in one-to-one correspondence with the sub-data; the mass-sending policy in the data allocation module 220 sends the sub-data to the corresponding node, which specifically includes the following steps:
determining each sub-data to be sent to a corresponding target node through a hash function; and establishing network connection for each target node, and sending the sub-data to the corresponding node through the network connection.
When in specific use, the specific steps of the node establishing module 210 for establishing a plurality of load balancing through the cloud platform are as follows: firstly, selecting a Google Cloud platform, and carrying out a constant load balancer on the Google Cloud platform, wherein the load balancer can distribute sub data to a plurality of nodes according to your load balancing strategy; creating a plurality of node instances in a Google Cloud platform, adding the created node instances into a target group of a load balancer, and sending sub-data to the nodes through a load balancing strategy; the data distribution module 220 transmits the sub data to the corresponding nodes through the group sending strategy, so that the nodes and the sub data are in one-to-one correspondence, the sub data processing tasks are distributed to a plurality of nodes, and the system can realize parallel processing, thereby remarkably improving the data processing speed and throughput, maximizing the utilization of system resources and improving the overall performance.
The distributed data output unit 200 further includes a data backup module 230, where the data backup module 230 performs backup on sub-data by using a data redundancy backup method, when a certain node is damaged, backup data can be obtained from other nodes, and in specific use, the data redundancy backup in the data backup module 230 disperses and stores the sub-data on a plurality of nodes by number, each node has a complete data copy, and when a certain node cannot provide service, the data copy can be obtained from other nodes for processing, thereby improving the security of sub-data transmission.
The node exception replacing unit 300 is configured to detect a node working condition of the distributed data output unit 200, if the working condition is normal, continue to process the sub-data, and if the working condition is abnormal, replace the abnormal node with a standby node to process the sub-data;
the node abnormality replacement unit 300 includes a signal detection unit 310 and a work coordinator;
the signal detection unit 310 periodically sends heartbeat information to the nodes in the node establishing module 210, the node receiving signal responses to prove that the nodes are normal, and the node receiving signal does not respond to prove that the nodes are damaged; the work coordinator is used for detecting abnormal conditions of the nodes, triggering a fault recovery mechanism when the nodes are damaged, and reassigning incomplete tasks on the nodes to standby nodes so as to ensure smooth execution of the tasks;
the work coordinator detects the abnormal condition of the node, and the steps of triggering a fault recovery mechanism when the node is damaged are as follows:
the work coordinator acquires the health condition of the node by periodically or real-timely monitoring the state information of the node; the work coordinator discovers that the node does not respond to the heartbeat signal for a long time, and judges that abnormal damage occurs to the node; the work coordinator detects that the abnormal damage of the node is that the abnormal damage node is marked as an unavailable state, and no new task is allocated to the abnormal damage node; the work coordinator selects the standby node as a target node, and distributes incomplete transmission tasks of the abnormal damaged node to the standby node.
The node abnormality replacement unit 300 performs abnormality detection on a plurality of nodes of the distributed data output unit 200 in the load balancing system, and simultaneously sets a plurality of standby nodes, when a certain node is abnormal, the abnormal node is timely detected through the abnormality detection unit, and the abnormal node is replaced through the standby node, so that the whole system interruption caused by single node faults is avoided, and the stability and the practicability of the system are improved
The distributed data summarizing unit 400 is configured to sequentially receive the sub-data processed in the distributed data output unit 200 according to the sequence number marked in the data splitting unit 100, and sequentially order, summarize and combine the sub-data into complete network communication data according to the sequence number;
the distributed data summarization unit 400 includes a sub-data ordering module 410 and a data summarization module 420;
the sub-data sorting module 410 is configured to receive sub-data from the data distribution module 220 and identify a sequence number of the sub-data, and sequentially sort the sub-data sequence numbers through a sorting algorithm; the data summarization module 420 employs a merging algorithm to sequentially merge the sub-data ordered by the sub-data ordering module 410 into a complete data set.
In specific use, the sub-data sorting module 410 sorts the serial numbers in An incremental manner by identifying and receiving the marked serial numbers of the sub-data, extracting the serial numbers of the data, sorting the sub-data in the sub-data marking module 120 according to A1, A2, a3. Setting pointers to point to the initial positions of all the sub-data; comparing the sub-data of the pointer position, selecting adjacent sub-data to be put into a temporary array, and moving the pointer of the corresponding sub-data backwards; repeating the comparing and putting operations until all the sub data are put into the temporary array; copying the data in the temporary array back to the complete data set; the distributed data summarizing unit 400 sorts the data according to the serial numbers of the sub-data, and combines the sorted data into a complete data set, thereby ensuring the stability of data transmission while realizing the load balancing of the network communication data.
The foregoing has shown and described the basic principles, principal features and advantages of the invention. It will be understood by those skilled in the art that the present invention is not limited to the above-described embodiments, and that the above-described embodiments and descriptions are only preferred embodiments of the present invention, and are not intended to limit the invention, and that various changes and modifications may be made therein without departing from the spirit and scope of the invention as claimed. The scope of the invention is defined by the appended claims and equivalents thereof.
Claims (8)
1. A system for realizing data processing load balancing by distributed network communication is characterized in that: the system comprises a data splitting unit (100), a distributed data output unit (200), a node anomaly replacement unit (300) and a distributed data summarizing unit (400), wherein the data splitting unit is used for splitting data;
the data splitting unit (100) is used for splitting the network communication data to be processed into a plurality of sub-data, and marking serial numbers on the plurality of sub-data in sequence;
the distributed data output unit (200) is used for establishing a plurality of nodes with balanced loads, so that the sub data of the data splitting unit (100) are transmitted to the plurality of nodes to process the data according to the sequence of the serial numbers, wherein the nodes and the sub data are in one-to-one correspondence;
the node abnormality replacing unit (300) is used for detecting the working condition of the nodes of the distributed data output unit (200), if the working condition is normal, the sub-data processing is continued, and if the working condition is abnormal, the spare node is used for replacing the abnormal node to process the sub-data;
the distributed data summarizing unit (400) is used for sequentially receiving the sub-data processed in the distributed data output unit (200) according to the sequence numbers marked in the data splitting unit (100), and sequentially sequencing, summarizing and merging the sub-data into a complete data set according to the sequence numbers.
2. The distributed network communication implementation data processing load balancing system according to claim 1, wherein: the data splitting unit (100) comprises a data dividing module (110) and a sub-data marking module (120);
the data dividing module (110) uniformly divides the network communication data to be processed into a plurality of sub-data with fixed size in an equal dividing mode; the sub data marking module (120) sequentially sorts the plurality of sub data in the data dividing module (110) in a serial number increasing mode and marks the serial number.
3. The distributed network communication implementation data processing load balancing system according to claim 1, wherein: the distributed data output unit (200) comprises a node establishment module (210) and a data distribution module (220);
the node establishing module (210) establishes a plurality of load balancing nodes through the cloud platform, and the nodes are used for receiving the sub-data in the data dividing module (110); the data distribution module (220) sends the sub-data to the corresponding nodes through the group sending strategy, so that the nodes established by the node establishment module (210) are in one-to-one correspondence with the sub-data.
4. A distributed network communication implemented data processing load balancing system according to claim 3, wherein: the mass-sending strategy in the data distribution module (220) sends the sub-data to the corresponding node, and the specific steps are as follows:
determining each sub-data to be sent to a corresponding target node through a hash function; and establishing network connection for each target node, and sending the sub-data to the corresponding node through the network connection.
5. A distributed network communication implemented data processing load balancing system according to claim 3, wherein: the distributed data output unit (200) further comprises a data backup module (230), wherein the data backup module (230) adopts a data redundancy backup method to backup the sub-data, and when a certain node is damaged, the backup data can be obtained from other nodes.
6. The distributed network communication implementation data processing load balancing system according to claim 1, wherein: the node abnormality replacement unit (300) comprises a signal detection unit (310) and a work coordinator;
the signal detection unit (310) periodically sends heartbeat information to the nodes in the node building module (210), the node receiving signal responses prove that the nodes are normal, and the nodes are proved to be damaged when the node receiving signals do not respond; the work coordinator is used for detecting abnormal conditions of the nodes, triggering a fault recovery mechanism when the nodes are damaged, and reassigning unfinished tasks on the nodes to standby nodes so as to ensure smooth execution of the tasks.
7. The distributed network communication implementation data processing load balancing system according to claim 6, wherein: the work coordinator detects the abnormal condition of the node, and the steps of triggering a fault recovery mechanism when the node is damaged are as follows:
the work coordinator acquires the health condition of the node by periodically or real-timely monitoring the state information of the node; the work coordinator discovers that the node does not respond to the heartbeat signal for a long time, and judges that abnormal damage occurs to the node; the work coordinator detects that the abnormal damage of the node is that the abnormal damage node is marked as an unavailable state, and no new task is allocated to the abnormal damage node; the work coordinator selects the standby node as a target node, and distributes incomplete transmission tasks of the abnormal damaged node to the standby node.
8. The distributed network communication implementation data processing load balancing system according to claim 1, wherein: the distributed data summarization unit (400) comprises a sub-data ordering module (410) and a data summarization module (420);
the sub-data sequencing module (410) is used for receiving sub-data in the data distribution module (220) and identifying sequence numbers of the sub-data, and sequencing the sub-data sequence numbers in sequence through a sequencing algorithm; the data summarization module (420) adopts a merging algorithm to orderly merge the sub-data ordered by the sub-data ordering module (410) into a complete data set.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202311006624.XA CN116743752A (en) | 2023-08-11 | 2023-08-11 | System for realizing data processing load balance by distributed network communication |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202311006624.XA CN116743752A (en) | 2023-08-11 | 2023-08-11 | System for realizing data processing load balance by distributed network communication |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN116743752A true CN116743752A (en) | 2023-09-12 |
Family
ID=87913710
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202311006624.XA Pending CN116743752A (en) | 2023-08-11 | 2023-08-11 | System for realizing data processing load balance by distributed network communication |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN116743752A (en) |
Citations (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US7657781B1 (en) * | 2003-07-25 | 2010-02-02 | Cisco Technology, Inc. | System and method for providing redundant data load sharing in a distributed network |
| JP2014153935A (en) * | 2013-02-08 | 2014-08-25 | Nippon Telegr & Teleph Corp <Ntt> | Parallel distributed processing control device, parallel distributed processing control system, parallel distributed processing control method, and parallel distributed processing control program |
| CN105139130A (en) * | 2015-08-27 | 2015-12-09 | 国电南瑞科技股份有限公司 | Power system distributed task management method |
| CN107707592A (en) * | 2017-01-24 | 2018-02-16 | 贵州白山云科技有限公司 | Task processing method, node and content distributing network |
| CN107743246A (en) * | 2017-01-24 | 2018-02-27 | 贵州白山云科技有限公司 | Task processing method, system and data handling system |
| CN107819828A (en) * | 2017-10-16 | 2018-03-20 | 平安科技（深圳）有限公司 | Data transmission method, device, computer equipment and storage medium |
| CN111130899A (en) * | 2019-12-30 | 2020-05-08 | 威创集团股份有限公司 | Service recovery method and system for distributed system |
| CN114610951A (en) * | 2020-12-08 | 2022-06-10 | 国信君和(北京)科技有限公司 | Data processing method and device, electronic equipment and readable storage medium |
| CN114691356A (en) * | 2022-03-09 | 2022-07-01 | 树根互联股份有限公司 | Data parallel processing method and device, computer equipment and readable storage medium |
-
2023
- 2023-08-11 CN CN202311006624.XA patent/CN116743752A/en active Pending
Patent Citations (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US7657781B1 (en) * | 2003-07-25 | 2010-02-02 | Cisco Technology, Inc. | System and method for providing redundant data load sharing in a distributed network |
| JP2014153935A (en) * | 2013-02-08 | 2014-08-25 | Nippon Telegr & Teleph Corp <Ntt> | Parallel distributed processing control device, parallel distributed processing control system, parallel distributed processing control method, and parallel distributed processing control program |
| CN105139130A (en) * | 2015-08-27 | 2015-12-09 | 国电南瑞科技股份有限公司 | Power system distributed task management method |
| CN107707592A (en) * | 2017-01-24 | 2018-02-16 | 贵州白山云科技有限公司 | Task processing method, node and content distributing network |
| CN107743246A (en) * | 2017-01-24 | 2018-02-27 | 贵州白山云科技有限公司 | Task processing method, system and data handling system |
| CN107819828A (en) * | 2017-10-16 | 2018-03-20 | 平安科技（深圳）有限公司 | Data transmission method, device, computer equipment and storage medium |
| CN111130899A (en) * | 2019-12-30 | 2020-05-08 | 威创集团股份有限公司 | Service recovery method and system for distributed system |
| CN114610951A (en) * | 2020-12-08 | 2022-06-10 | 国信君和(北京)科技有限公司 | Data processing method and device, electronic equipment and readable storage medium |
| CN114691356A (en) * | 2022-03-09 | 2022-07-01 | 树根互联股份有限公司 | Data parallel processing method and device, computer equipment and readable storage medium |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN109274557B (en) | Intelligent CMDB management and cloud host monitoring method in cloud environment | |
| EP1652028B1 (en) | Method for clustering processors and assigning service points in a system | |
| US20060277295A1 (en) | Monitoring system and monitoring method | |
| CN112860393B (en) | Distributed task scheduling method and system | |
| CN108933694B (en) | Data center network fault node diagnosis method and system based on dial testing data | |
| CN112118174A (en) | Software defined data gateway | |
| CN102158364A (en) | Time slice scheduling-based device polling method and device | |
| CN111858033A (en) | Load balancing method based on cluster and multiple processes | |
| JPH0529171B2 (en) | ||
| CN111240822B (en) | Task scheduling method, device, system and storage medium | |
| CN101199162B (en) | Method, system and device for controlling communication network | |
| US7246160B2 (en) | Computer monitoring system, computer monitoring method and computer monitoring program | |
| CN116743752A (en) | System for realizing data processing load balance by distributed network communication | |
| CN100538690C (en) | The method that message is transmitted between a kind of multi-CPU system and the CPU | |
| CN111885158A (en) | Cluster task processing method and device, electronic equipment and storage medium | |
| CN105260245A (en) | Resource scheduling method and device | |
| CN110609761B (en) | Method and device for determining fault source, storage medium and electronic equipment | |
| CN111240936A (en) | Data integrity checking method and equipment | |
| CN103530297A (en) | Method and device capable of automatically carrying out website analysis | |
| CN115396752A (en) | Redis-based biplane data acquisition method and system | |
| CN112003746B (en) | Alarm management method, device and medium based on distributed system | |
| CN114205263A (en) | Communication method, system and storage medium for Ether CAT network | |
| CN113872814A (en) | Information processing method, device and system for content distribution network | |
| Ang et al. | Communication-efficient classification in P2P networks | |
| CN116233137B (en) | Cluster-based load sharing and backup method and device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |