CN113626161B - Distributed multi-user data scheduling method and system - Google Patents
Distributed multi-user data scheduling method and system Download PDFInfo
- Publication number
- CN113626161B CN113626161B CN202110778053.6A CN202110778053A CN113626161B CN 113626161 B CN113626161 B CN 113626161B CN 202110778053 A CN202110778053 A CN 202110778053A CN 113626161 B CN113626161 B CN 113626161B
- Authority
- CN
- China
- Prior art keywords
- data
- user
- task
- scheduling
- module
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000000034 method Methods 0.000 title claims abstract description 49
- 238000012544 monitoring process Methods 0.000 claims description 10
- 238000001514 detection method Methods 0.000 claims description 7
- 238000004140 cleaning Methods 0.000 claims description 3
- 238000004891 communication Methods 0.000 description 6
- 238000002955 isolation Methods 0.000 description 2
- 238000013461 design Methods 0.000 description 1
- 238000010586 diagram Methods 0.000 description 1
- 238000004519 manufacturing process Methods 0.000 description 1
- 238000013508 migration Methods 0.000 description 1
- 230000005012 migration Effects 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 238000004806 packaging method and process Methods 0.000 description 1
- 238000013515 script Methods 0.000 description 1
- 238000012360 testing method Methods 0.000 description 1
- 230000001960 triggered effect Effects 0.000 description 1
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F9/00—Arrangements for program control, e.g. control units
- G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
- G06F9/46—Multiprogramming arrangements
- G06F9/48—Program initiating; Program switching, e.g. by interrupt
- G06F9/4806—Task transfer initiation or dispatching
- G06F9/4843—Task transfer initiation or dispatching by program, e.g. task dispatcher, supervisor, operating system
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/27—Replication, distribution or synchronisation of data between databases or within a distributed database system; Distributed database system architectures therefor
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F9/00—Arrangements for program control, e.g. control units
- G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
- G06F9/46—Multiprogramming arrangements
- G06F9/50—Allocation of resources, e.g. of the central processing unit [CPU]
- G06F9/5005—Allocation of resources, e.g. of the central processing unit [CPU] to service a request
- G06F9/5027—Allocation of resources, e.g. of the central processing unit [CPU] to service a request the resource being a machine, e.g. CPUs, Servers, Terminals
- G06F9/505—Allocation of resources, e.g. of the central processing unit [CPU] to service a request the resource being a machine, e.g. CPUs, Servers, Terminals considering the load
Abstract
The invention discloses a data scheduling method and a system for distributed multi-users, comprising the steps of obtaining routing information of a working node B bound by a user B1 by analyzing scheduling data sent by the user A1, and generating a scheduling task T i The method comprises the steps of carrying out a first treatment on the surface of the Will schedule task T i Storing the task queues in corresponding task queues; parsing each scheduling task T i And classifies the batch execution of data scheduling tasks to enable user B1 to obtain the scheduling data from the private data queue of the working node B. The invention dispersedly binds different users on dispersed data dispatching working nodes, dispatches the data among the users, adopts an asynchronous batch classification executing strategy, and uses the management node to manage the working nodes, thereby improving the dispatching load capacity, stability and reliability.
Description
Technical Field
The present invention relates to the field of network communications, and in particular, to a method and system for data scheduling of distributed multiple users.
Background
The distributed scheduling of big data plays a role in the data migration process, and runs through the processes of data production, exchange, consumption and the like. The realization of the scheduling of the computer task can be triggered by depending on the timing task of the operating system, but the scheduling of the task is orderly operated in a service scene, so that the characteristics of low delay, accuracy, reliability, convenience, monitoring and the like of the data scheduling are very complex. The distributed scheduling is developed on the basis of single point scheduling, and is a qualitative process from single point scheduling to distributed scheduling, and has many characteristics which are not possessed by single point scheduling, such as decentralized service, flexible expansion, multi-link scheduling and multi-destination scheduling. In the case of distributed scheduling, how to look at each scheduled task state as well as the scheduling node state is an important issue. In addition, in the service scenario of multiple users, how to provide a unified data scheduling interface and meet the data isolation requirement of user scheduling is also an important problem. Therefore, it is very difficult to design a scheduling system and a scheduling method thereof that meet the above requirements.
Disclosure of Invention
In order to overcome the existing difficulty, the invention provides a data scheduling method and system for distributed multi-users, which utilizes sixteen modules such as a node management module, a user management module, a topology updating module, a link detection module, a task generation module, a task execution module, a task retransmission module, a data consumption module, a task monitoring module, a task reporting module, a state acquisition module, a state reporting module, a task checking module, a state checking module, a command issuing module and a command execution module, and realizes the characteristics of decentralization, low delay, reliability, stability, user data isolation, convenience in checking of scheduling tasks, manageability of scheduling service working nodes and the like of data scheduling services.
The technical scheme of the invention comprises the following steps:
a data scheduling method of distributed multi-user is applicable to a network composed of a management node and a plurality of working nodes, the management node respectively generates unique working node route information or user ID according to the information of each working node and the user information, the steps include:
1) The working node A periodically inquires the global topology and acquires global topology information from the management node;
2) Analyzing the scheduling data sent by the user A1, acquiring the data type, the scheduling data body, the priority and the user ID of the user B1 of the scheduling data, and acquiring the routing information of the working node B bound by the user B1 according to the user ID and the global topology information of the user B1;
3) Generating a scheduling task T according to the generated data scheduling task ID, the user ID of the user B1, the routing information of the working node B, the data type and the scheduling data body i And combine the priority to schedule task T i Storing the task number i into a corresponding task queue;
4) Parsing each scheduling task T i And classifies the batch execution of data scheduling tasks to enable user B1 to obtain the scheduling data from the private data queue of the working node B.
Further, the interface mode for transmitting the scheduling data by the user A1 includes: HTTP/HTTPS RESTful interface mode.
Further, the interface URL is: v1/send_data/{ data_type }, where { data_type } represents a data type; the interface HTTP header field includes: a USER-AGENT field, a LEVEL field, and a DES-USER field, wherein the USER-AGENT field is a USER ID of the USER A1, the LEVEL field is a priority of data, and the DES-USER field is a USER ID of the USER B1; the scheduling data body is stored in the http request body.
Further, the generation rule of the data scheduling task ID includes: working node number_event stamp_n-bit random number, where n.gtoreq.1.
Further, if the scheduling data is not successfully scheduled to the working node B, the failed task is stored in the task retransmission queue and re-executed until the task retransmission is successfully executed.
Further, the generation process of the data scheduling task, the execution process of the data scheduling task and/or the retransmission process of the data scheduling task are recorded, and the record is reported to the management node.
Further, reporting the server hardware state, the service index state network bandwidth occupation state and the command execution state of the working node to a management node; the server hardware state includes: CPU utilization rate, memory utilization rate and disk utilization rate; the business index state includes: task queue backlog number and user data queue backlog number; the network bandwidth occupancy state includes: network egress traffic speed and network ingress traffic speed.
Further, the working node A1 immediately executes the command instruction which is obtained from the management node and is not executed, and returns the recorded command execution state to the management node
A data scheduling system of distributed multi-user is applicable to a network composed of a management node and a plurality of working nodes, comprising:
the node management module is used for managing the nodes to generate unique working node routing information according to the information of each working node;
the user management module is used for generating a unique user ID according to the user information by the management node;
the topology updating module is used for periodically inquiring global topology by the working node A and acquiring global topology information from the management node;
the task generating module is used for analyzing the scheduling data sent by the user A1, acquiring the data type, the scheduling data body, the priority and the user ID of the user B1 of the scheduling data, and acquiring the routing information of the working node B bound by the user B according to the user ID and the global topology information of the user B1; generating a scheduling task T according to the generated data scheduling task ID, the user ID of the user B1, the routing information of the working node B, the data type and the scheduling data body i And combine the priority to schedule task T i Storing the task number i into a corresponding task queue;
task execution module for analyzing each scheduling task T i The routing information of the data scheduling task is classified and executed in batches;
and the data consumption module is used for the working node A to store the user data of the user B1 in the message middleware in an isolated way, so that the user B1 can consume the data scheduled to the user from the working node B1 to other users.
Further, the system also comprises a link detection module, a task retransmission module, a task monitoring module, a task reporting module, a state acquisition module, a state reporting module, a task checking module, a state checking module, a command issuing module and a command executing module; wherein,
the link detection module is used for inquiring the topological structure by the working node A;
the task retransmission module is used for storing the failed task to the task retransmission queue and re-executing if the scheduling data is not successfully scheduled to the working node B;
the task monitoring module is used for recording the generation process of the data scheduling task, the execution process of the data scheduling task and/or the retransmission process of the data scheduling task;
the task reporting module is used for reporting the generation process of the data scheduling task, the execution process of the data scheduling task and/or the retransmission process of the data scheduling task to the management node;
the system comprises a state acquisition module, a control module and a control module, wherein the state acquisition module is used for acquiring a server hardware state, a service index state, a network bandwidth occupation state and a command execution state of a working node, wherein the server hardware state comprises: CPU utilization rate, memory utilization rate and disk utilization rate; the business index state includes: task queue backlog number and user data queue backlog number; the network bandwidth occupancy state includes: network egress traffic speed and network ingress traffic speed;
the state reporting module is used for reporting the server hardware state, the service index state and the network bandwidth occupation state of the working node to the management node;
the task checking module is used for checking the information of each data scheduling task, the execution progress and the consumption information of the scheduling data;
the state checking module is used for checking the system resource hardware state, the service index state and the network bandwidth occupation state of each working node through the management node;
the command issuing module is used for issuing commands to the designated working nodes through the management nodes, wherein the commands comprise: system restart, cache data cleaning or system update;
the command execution module is used for periodically downloading and executing the unexecuted commands from the management node by the working node, and recording the command execution state.
The method of the invention has the following advantages:
different users are bound in scattered data scheduling working nodes in a scattered mode, data scheduling among the users is performed by adopting an asynchronous batch classification executing strategy, and the working nodes are managed by using a management node. Compared with single-machine data scheduling, the scheduling load capacity, stability and reliability are greatly improved. The invention also provides a perfect scheduling task state monitoring method which comprises the processes of generating, executing, retransmitting and the like of the scheduling task and provides unified data scheduling task state query service through the management node.
Drawings
Fig. 1 is a system architecture diagram of the present invention.
Fig. 2 is a flow chart of the data scheduling of the present invention.
Detailed Description
The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the accompanying drawings in the embodiments of the present invention. All other embodiments, which can be made by those skilled in the art based on the embodiments of the invention without making any inventive effort, are intended to be within the scope of the invention.
The technical scheme adopted by the invention mainly comprises sixteen modules: (1) a node management module: firstly, dividing a scheduling node into a management node and a working node, and registering information of the working node in the management node, wherein the information comprises an IP address and a service port of the working node. The management node generates an identity ID and a communication configuration for each node. The communication configuration content contains the IP address and service port of the management node and the identity ID of the working node. The working node may communicate with the management node via a communication arrangement. (2) a user management module: registering information of a user in a management node, binding the user with a working node, generating a unique user ID for the user, and providing the user with the IP address and service port information of the working node bound by the user. (3) a topology upgrade module: the working nodes periodically acquire the latest topological structure from the management nodes, wherein the topological structure comprises information of all the working nodes and information of users bound with each working node. (4) a link detection module: the working node inquires the topological structure, and periodically sends link detection packets to other working nodes to acquire the network connection state. (5) a task generating module: the user sends the data to be scheduled to other users through the bound working nodes, the working nodes can generate data scheduling tasks, the priorities of the tasks are distinguished, and the tasks are stored in task queues of different levels. (6) a task execution module: the work node gathers the data scheduling tasks, and preferentially gathers the scheduling tasks with high priority. And obtaining a link of each task from the topological structure, classifying and converging the dispatching tasks according to the links, executing the converged dispatching tasks, and dispatching the data to the working nodes bound by the destination end user. (7) task resending module: and the task which is to be failed to be executed is supported to be retransmitted, so that the reliability of data scheduling is improved. (8) a data consumption module: the working node stores the destination end user data in the message middleware in an isolated manner, and the destination end user can consume data scheduled to the destination end user from the bound working node to other users. (9) a task monitoring module: and recording events occurring in each stage of the scheduled task for monitoring, wherein the events comprise scheduled task generation, scheduled task execution, scheduled task retransmission, scheduled data consumption and the like. And (10) a task reporting module: each working node reports the new task monitoring record to the management node at regular time. (11) a state acquisition module: the state of the working node is collected, and the state comprises a hardware state of a working node system, a scheduling task queue state, a data consumption queue state, a network bandwidth use state, a command execution state and the like. (12) a status report module: the working node reports the newly generated state information to the management node at regular time. (13) a task viewing module: the management node can check the information of each data scheduling task, the execution progress and the consumption information of the scheduling data. (14) a status viewing module: the management node can check the hardware state of the system resource, the state of the service index and the occupied state of the network bandwidth of each working node. (15) a command issuing module: the management node can issue commands to the designated working node, wherein the commands comprise commands such as system restart, cache data cleaning, system update and the like. (16) a command execution module: the working node periodically downloads and executes the unexecuted command from the management node, and records the command execution state.
In the system architecture of an embodiment of the present invention, as shown in fig. 1, when the distributed data scheduling system is deployed, one server is designated as a management node, and the other servers are designated as working nodes. The firewall open ports 443 of all nodes are used for providing services to the outside. The service ports of each node of the TELNET can test whether the service exists.
The information of each working node needs to be registered on a management node, the management node can generate a unique ID for the working node, the ID is a four-digit number and is numbered from 1000, and therefore, a single distributed scheduling cluster can accommodate 9000 working nodes at maximum. And then downloading the communication configuration file of each node on the management node. After each working node configures the communication configuration file, the working node can communicate with the management node to perform the processes of topology updating, task reporting, state reporting, command issuing and the like.
The user information needs to be registered on the management node, the binding working node can be selected by the user, then the management node can generate a unique user ID (identity) for the user, the ID is a 12-bit number, and the generation rule is as follows: the user registration year_work node number_user type_four-bit sequence number, for example 211000010001, represents that the user is registered in 2021, the work node is selected to be bound 1000, the user type is 01, and the user is registered in 0001 th bit. The management node then feeds back the user ID, the IP address of the bound worker node and the service port to the user. The user can query the management node for the IDs of other users. And the user performs a data scheduling flow through the bound working nodes.
The specific implementation manner of the processes is as follows:
the first topology updating process is that the working node obtains the total node information and the user information of each node from the management node, so that the working node can obtain the route information, namely the IP address and the service port, of the working node bound by the target user of the data scheduling task from the global topology information.
The second task reporting process is that the working node records the processes of generating the data scheduling task, executing the data scheduling task, retransmitting the data scheduling task and the like, and then reports the records to the management node. The user can inquire the execution flow state of the task from the management node through the data scheduling task ID. The data scheduling task ID is a unique number generated by the working node, and the generation rule is as follows: the working node number_timestamp_three-bit random number, and the form of the event stamp is as follows: y_m_d_h_m_s_f. Wherein, each symbol has the meaning of: y-year, M-month, D-day, H-time, M-minutes, S-seconds, F-microseconds.
And the third status reporting process is that the working node records the server hardware status, the service index status and the network bandwidth occupation status of the node and reports the recorded status to the management node. The server hardware state includes CPU usage, memory usage, disk usage. The business index state comprises the backlog number of the task queues and the backlog number of the user data queues. Network bandwidth occupancy includes network egress traffic speed and network ingress traffic speed. The user can query from the management node whether there is data scheduled to him by other users.
The fourth command issuing process is that the working node obtains the command instruction which is not executed from the management node, if the command instruction which is not executed is obtained, the command instruction is immediately executed, and the command execution state is recorded. The command execution status can be viewed by the management node. In the distributed case, after a single device fails, the failure phenomenon of the working node can be solved by issuing an appointed command to the failed device. Commands refer to scripts written in the shell programming language.
The data scheduling process is a process that a user schedules data to other users through the working nodes, and the other users acquire the data from the bound working nodes. As shown in fig. 2, when data of the user A1 is scheduled to the user B1, first, the user A1 sends the data to the bound working node a, and sends the data through the HTTP/HTTPs RESTful interface. The interface URL is: v1/send_data/{ data_type }, represents the data type. The HTTP header field of the interface comprises fields such as USER-AGENT, LEVEL, DES-USER, the USER-AGENT field is the USER ID of the USER A1, the LEVEL field is the priority of the data, and the value range is as follows: 0,1,2, respectively represent normal, medium, priority, DES-USER field is USER ID of USER B1. The scheduling data body is stored in the http request body, and the type is binary. The working node A inquires the global topology, acquires the routing information of the binding working node B of the user B1, and generates the current data scheduling task ID. And packaging and storing the data scheduling task ID, the routing information, the user ID of the user A1, the user ID of the user B1, the data type and the scheduling data body into corresponding priority task queues, and feeding back the data scheduling task ID to the user A1. The work node A sequentially reads the tasks of the task queue according to the priority, analyzes the route information of each task and classifies the tasks, and uses multithreading to execute the tasks of the batch according to the route classification in batches. After the data is successfully scheduled to the working node B, the working node B stores the scheduled data into the private data queue of the user B1. If the data is not successfully scheduled to the working node B, the working node A stores the task which fails to be executed into a task retransmission queue, and the priority of the task retransmission queue is given priority. If the task retransmission fails, the failed task is still stored in the task retransmission queue until the task retransmission is successfully executed. After the working node B acquires the data packets sent by other working nodes, the working node B analyzes the data packets to acquire the ID of the user receiving the data packets, and caches the data into a data queue of the user ID. User B1 obtains data from the working node B via HTTP/HTTPs RESTful interface. The interface URL is: v1/get_data. And acquiring the data packet and the binary type from the HTTP feedback of the interface. The user B1 may parse the packet to obtain: data scheduling task ID, routing information, user ID of user A1, user ID of user B1, data type, scheduling data body, and the like.
The above examples are provided for the purpose of describing the present invention only and are not intended to limit the scope of the present invention. The scope of the invention is defined by the appended claims. Various equivalents and modifications that do not depart from the spirit and principles of the invention are intended to be included within the scope of the invention.
Claims (10)
1. A data scheduling method of distributed multi-user is applicable to a network composed of a management node and a plurality of working nodes, the management node respectively generates unique working node route information or user ID according to the information of each working node and the user information, the steps include:
1) The working node A periodically inquires the global topology and acquires global topology information from the management node;
2) Analyzing the scheduling data sent by the user A1, acquiring the data type, the scheduling data body, the priority and the user ID of the user B1 of the scheduling data, and acquiring the routing information of the working node B bound by the user B1 according to the user ID and the global topology information of the user B1;
3) Generating a scheduling task T according to the generated data scheduling task ID, the user ID of the user B1, the routing information of the working node B, the data type and the scheduling data body i And combine the priority to schedule task T i Storing the task number i in a corresponding task queue;
4) Parsing each scheduling task T i And classifies the batch execution of data scheduling tasks to enable user B1 to obtain the scheduling data from the private data queue of the working node B.
2. The method of claim 1, wherein the interface manner in which the user A1 transmits the scheduling data comprises: HTTP/HTTPS RESTful interface mode.
3. The method of claim 2, wherein the interface URL is: v1/send_data/{ data_type }, where { data_type } represents a data type; the interface HTTP header field includes: a USER-AGENT field, a LEVEL field, and a DES-USER field, wherein the USER-AGENT field is a USER ID of the USER A1, the LEVEL field is a priority of data, and the DES-USER field is a USER ID of the USER B1; the scheduling data body is stored in the http request body.
4. The method of claim 1, wherein the generation rule of the data scheduling task ID comprises: working node number_event stamp_n-bit random number, where n.gtoreq.1.
5. The method of claim 1, wherein if the scheduled data is not successfully scheduled to the worker node B, the failed task is stored in a task retransmission queue and re-executed until the task retransmission is successfully executed.
6. The method according to claim 1, characterized in that the generation process of the data scheduling task, the execution process of the data scheduling task and/or the retransmission process of the data scheduling task are recorded and the record is reported to the management node.
7. The method of claim 1, wherein server hardware status, traffic index status, network bandwidth occupancy status, and command execution status of the present working node are reported to the management node; the server hardware state includes: CPU utilization rate, memory utilization rate and disk utilization rate; the business index state includes: task queue backlog number and user data queue backlog number; the network bandwidth occupancy state includes: network egress traffic speed and network ingress traffic speed.
8. The method of claim 1, wherein the working node a immediately executes the command instruction acquired from the management node not executed and returns the recorded command execution status to the management node.
9. A data scheduling system of distributed multi-user is applicable to a network composed of a management node and a plurality of working nodes, comprising:
the node management module is used for managing the nodes to generate unique working node routing information according to the information of each working node;
the user management module is used for generating a unique user ID according to the user information by the management node;
the topology updating module is used for periodically inquiring global topology by the working node A and acquiring global topology information from the management node;
the task generating module is used for analyzing the scheduling data sent by the user A1, acquiring the data type, the scheduling data body, the priority and the user ID of the user B1 of the scheduling data, and acquiring the routing information of the working node B bound by the user B1 according to the user ID of the user B1 and the global topology information; generating a scheduling task T according to the generated data scheduling task ID, the user ID of the user B1, the routing information of the working node B, the data type and the scheduling data body i And combine the priority to schedule task T i Storing the task number i into a corresponding task queue;
task execution module for analyzing each scheduling task T i The routing information of the data scheduling task is classified and executed in batches;
and the data consumption module is used for the working node A to store the user data of the user B1 in the message middleware in an isolated way, so that the user B1 can consume the data scheduled to the user from the working node B to other users.
10. The system of claim 9, further comprising a link detection module, a task resending module, a task monitoring module, a task reporting module, a status acquisition module, a status reporting module, a task viewing module, a status viewing module, a command issuing module, a command execution module; wherein,
the link detection module is used for inquiring the topological structure by the working node A;
the task retransmission module is used for storing the failed task to the task retransmission queue and re-executing if the scheduling data is not successfully scheduled to the working node B;
the task monitoring module is used for recording the generation process of the data scheduling task, the execution process of the data scheduling task and/or the retransmission process of the data scheduling task;
the task reporting module is used for reporting the generation process of the data scheduling task, the execution process of the data scheduling task and/or the retransmission process of the data scheduling task to the management node;
the system comprises a state acquisition module, a control module and a control module, wherein the state acquisition module is used for acquiring a server hardware state, a service index state, a network bandwidth occupation state and a command execution state of a working node, wherein the server hardware state comprises: CPU utilization rate, memory utilization rate and disk utilization rate; the business index state includes: task queue backlog number and user data queue backlog number; the network bandwidth occupancy state includes: network egress traffic speed and network ingress traffic speed;
the state reporting module is used for reporting the server hardware state, the service index state and the network bandwidth occupation state of the working node to the management node;
the task checking module is used for checking the information of each data scheduling task, the execution progress and the consumption information of the scheduling data;
the state checking module is used for checking the system resource hardware state, the service index state and the network bandwidth occupation state of each working node through the management node;
the command issuing module is used for issuing commands to the designated working nodes through the management nodes, wherein the commands comprise: system restart, cache data cleaning or system update;
the command execution module is used for periodically downloading and executing the unexecuted commands from the management node by the working node, and recording the command execution state.
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN202110778053.6A CN113626161B (en) | 2021-07-09 | 2021-07-09 | Distributed multi-user data scheduling method and system |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN202110778053.6A CN113626161B (en) | 2021-07-09 | 2021-07-09 | Distributed multi-user data scheduling method and system |
Publications (2)
Publication Number | Publication Date |
---|---|
CN113626161A CN113626161A (en) | 2021-11-09 |
CN113626161B true CN113626161B (en) | 2023-12-22 |
Family
ID=78379399
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN202110778053.6A Active CN113626161B (en) | 2021-07-09 | 2021-07-09 | Distributed multi-user data scheduling method and system |
Country Status (1)
Country | Link |
---|---|
CN (1) | CN113626161B (en) |
Families Citing this family (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN114448816B (en) * | 2021-12-30 | 2023-10-10 | 中国航空研究院 | Integrated IP networking method based on heterogeneous data chain |
Citations (7)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN101309201A (en) * | 2007-05-14 | 2008-11-19 | 华为技术有限公司 | Route processing method, routing processor and router |
CN101340331A (en) * | 2007-07-06 | 2009-01-07 | 中国电信股份有限公司 | Method for executing system task by idle terminal in P2P network |
CN102084628A (en) * | 2008-04-24 | 2011-06-01 | 厄塞勒拉特公司 | A traffic manager and a method for a traffic manager |
CN103279351A (en) * | 2013-05-31 | 2013-09-04 | 北京高森明晨信息科技有限公司 | Method and device for task scheduling |
CN106126346A (en) * | 2016-07-05 | 2016-11-16 | 东北大学 | A kind of large-scale distributed data collecting system and method |
CN108268317A (en) * | 2016-12-30 | 2018-07-10 | 华为技术有限公司 | A kind of resource allocation methods and device |
CN111367630A (en) * | 2019-07-12 | 2020-07-03 | 北京关键科技股份有限公司 | Multi-user multi-priority distributed cooperative processing method based on cloud computing |
Family Cites Families (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US10447608B2 (en) * | 2014-11-14 | 2019-10-15 | Marvell Semiconductor, Inc. | Packet scheduling using hierarchical scheduling process with priority propagation |
-
2021
- 2021-07-09 CN CN202110778053.6A patent/CN113626161B/en active Active
Patent Citations (7)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN101309201A (en) * | 2007-05-14 | 2008-11-19 | 华为技术有限公司 | Route processing method, routing processor and router |
CN101340331A (en) * | 2007-07-06 | 2009-01-07 | 中国电信股份有限公司 | Method for executing system task by idle terminal in P2P network |
CN102084628A (en) * | 2008-04-24 | 2011-06-01 | 厄塞勒拉特公司 | A traffic manager and a method for a traffic manager |
CN103279351A (en) * | 2013-05-31 | 2013-09-04 | 北京高森明晨信息科技有限公司 | Method and device for task scheduling |
CN106126346A (en) * | 2016-07-05 | 2016-11-16 | 东北大学 | A kind of large-scale distributed data collecting system and method |
CN108268317A (en) * | 2016-12-30 | 2018-07-10 | 华为技术有限公司 | A kind of resource allocation methods and device |
CN111367630A (en) * | 2019-07-12 | 2020-07-03 | 北京关键科技股份有限公司 | Multi-user multi-priority distributed cooperative processing method based on cloud computing |
Also Published As
Publication number | Publication date |
---|---|
CN113626161A (en) | 2021-11-09 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US11706102B2 (en) | Dynamically deployable self configuring distributed network management system | |
US10200251B2 (en) | Methods and apparatus for accessing selectable application processing of data packets in an adaptive private network | |
US10284389B2 (en) | High availability for distributed network services in an extended bridge | |
Tolle et al. | Design of an application-cooperative management system for wireless sensor networks | |
EP1615378B1 (en) | NMS with multi-server events processing | |
US20030182464A1 (en) | Management of message queues | |
Bhowmik et al. | High performance publish/subscribe middleware in software-defined networks | |
CN108353040A (en) | system and method for distributed packet scheduling | |
Bellavista et al. | MANET-Oriented SDN: motivations, challenges, and a solution prototype | |
Li et al. | OPTAS: Decentralized flow monitoring and scheduling for tiny tasks | |
CN115086250B (en) | Network target range distributed flow generation system and method | |
KR20180028499A (en) | Method and system for providing ICT service | |
CN113626161B (en) | Distributed multi-user data scheduling method and system | |
Brunner et al. | Probabilistic decentralized network management | |
Xiong et al. | Evaluating technologies for tactical information management in net-centric systems | |
Silva et al. | Controlling network latency in mixed hadoop clusters: Do we need active queue management? | |
Shih et al. | Data alignment for multiple temporal data streams without synchronized clocks on iot fusion gateway | |
Chen et al. | Petri net modeling of the reconfigurable protocol stack for cloud computing control systems | |
Sedaghat et al. | R2T-DSDN: reliable real-time distributed controller-based SDN | |
CN116074392B (en) | Intelligent matching method and device for data stream transmission modes | |
Gillen et al. | Information dissemination in disadvantaged wireless communications using a data dissemination service and content data network | |
Porter et al. | Managing software evolution in large-scale wireless sensor and actuator networks | |
Yuan et al. | Energy Efficient Node Rank-Based Routing Algorithm in Mobile Ad-Hoc Networks | |
Tian et al. | Traffic Flow Analysis | |
CN113660178A (en) | CDN content management system |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PB01 | Publication | ||
PB01 | Publication | ||
SE01 | Entry into force of request for substantive examination | ||
SE01 | Entry into force of request for substantive examination | ||
GR01 | Patent grant | ||
GR01 | Patent grant |