CN107087019B - Task scheduling method and device based on end cloud cooperative computing architecture - Google Patents

Task scheduling method and device based on end cloud cooperative computing architecture Download PDF

Info

Publication number
CN107087019B
CN107087019B CN201710148795.4A CN201710148795A CN107087019B CN 107087019 B CN107087019 B CN 107087019B CN 201710148795 A CN201710148795 A CN 201710148795A CN 107087019 B CN107087019 B CN 107087019B
Authority
CN
China
Prior art keywords
cloud
tasks
terminal
task
computing
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201710148795.4A
Other languages
Chinese (zh)
Other versions
CN107087019A (en
Inventor
沈玉龙
王思怡
司旭
保积元
张宇恒
阮金清
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Xidian University
Original Assignee
Xidian University
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Xidian University filed Critical Xidian University
Priority to CN201710148795.4A priority Critical patent/CN107087019B/en
Publication of CN107087019A publication Critical patent/CN107087019A/en
Application granted granted Critical
Publication of CN107087019B publication Critical patent/CN107087019B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00Network arrangements or protocols for supporting network services or applications
    • H04L67/50Network services
    • H04L67/60Scheduling or organising the servicing of application requests, e.g. requests for application data transmissions using the analysis and optimisation of the required network resources
    • H04L67/61Scheduling or organising the servicing of application requests, e.g. requests for application data transmissions using the analysis and optimisation of the required network resources taking into account QoS or priority requirements
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F9/00Arrangements for program control, e.g. control units
    • G06F9/06Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
    • G06F9/44Arrangements for executing specific programs
    • G06F9/455Emulation; Interpretation; Software simulation, e.g. virtualisation or emulation of application or operating system execution engines
    • G06F9/45533Hypervisors; Virtual machine monitors
    • G06F9/45558Hypervisor-specific management and integration aspects
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F9/00Arrangements for program control, e.g. control units
    • G06F9/06Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
    • G06F9/46Multiprogramming arrangements
    • G06F9/48Program initiating; Program switching, e.g. by interrupt
    • G06F9/4806Task transfer initiation or dispatching
    • G06F9/4843Task transfer initiation or dispatching by program, e.g. task dispatcher, supervisor, operating system
    • G06F9/4881Scheduling strategies for dispatcher, e.g. round robin, multi-level priority queues
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F9/00Arrangements for program control, e.g. control units
    • G06F9/06Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
    • G06F9/46Multiprogramming arrangements
    • G06F9/50Allocation of resources, e.g. of the central processing unit [CPU]
    • G06F9/5005Allocation of resources, e.g. of the central processing unit [CPU] to service a request
    • G06F9/5027Allocation of resources, e.g. of the central processing unit [CPU] to service a request the resource being a machine, e.g. CPUs, Servers, Terminals
    • G06F9/5038Allocation of resources, e.g. of the central processing unit [CPU] to service a request the resource being a machine, e.g. CPUs, Servers, Terminals considering the execution order of a plurality of tasks, e.g. taking priority or time dependency constraints into consideration
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F9/00Arrangements for program control, e.g. control units
    • G06F9/06Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
    • G06F9/46Multiprogramming arrangements
    • G06F9/50Allocation of resources, e.g. of the central processing unit [CPU]
    • G06F9/5083Techniques for rebalancing the load in a distributed system
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00Network arrangements or protocols for supporting network services or applications
    • H04L67/01Protocols
    • H04L67/10Protocols in which an application is distributed across nodes in the network
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00Network arrangements or protocols for supporting network services or applications
    • H04L67/01Protocols
    • H04L67/10Protocols in which an application is distributed across nodes in the network
    • H04L67/1001Protocols in which an application is distributed across nodes in the network for accessing one among a plurality of replicated servers
    • H04L67/1004Server selection for load balancing
    • H04L67/1008Server selection for load balancing based on parameters of servers, e.g. available memory or workload
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00Network arrangements or protocols for supporting network services or applications
    • H04L67/50Network services
    • H04L67/56Provisioning of proxy services
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F9/00Arrangements for program control, e.g. control units
    • G06F9/06Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
    • G06F9/44Arrangements for executing specific programs
    • G06F9/455Emulation; Interpretation; Software simulation, e.g. virtualisation or emulation of application or operating system execution engines
    • G06F9/45533Hypervisors; Virtual machine monitors
    • G06F9/45558Hypervisor-specific management and integration aspects
    • G06F2009/45595Network integration; Enabling network access in virtual machine instances
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F2209/00Indexing scheme relating to G06F9/00
    • G06F2209/48Indexing scheme relating to G06F9/48
    • G06F2209/484Precedence
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F2209/00Indexing scheme relating to G06F9/00
    • G06F2209/50Indexing scheme relating to G06F9/50
    • G06F2209/5021Priority

Landscapes

  • Engineering & Computer Science (AREA)
  • Software Systems (AREA)
  • Theoretical Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Signal Processing (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Computer Hardware Design (AREA)
  • Computer And Data Communications (AREA)

Abstract

The invention discloses a terminal cloud cooperative computing architecture and a task scheduling device and method, and aims to solve the problems that in the cloud application era of rapid development, the load of the existing edge cloud platform is large, and the cost of submitting tasks to remote communication is large. Different from the traditional cloud computing platform, the terminal with certain computing capacity in the security certification access system is added into the computing resource pool to form a terminal cluster, the terminal cluster has strong expansibility, the expansibility of the cloud is increased, the terminal cluster and the service node cluster in the static cloud jointly complete tasks required by the single cloud platform, the traditional cloud platform is optimized, and the load of the cloud is effectively reduced. The framework has the real-time and quick characteristics of edge cloud, and can provide more powerful and stable services for big data applications such as the Internet of things.

Description

Task scheduling method and device based on end cloud cooperative computing architecture
Technical Field
The invention relates to the technical field of computers, in particular to a terminal cloud cooperative computing architecture and a task scheduling device and method.
Background
The cloud era has led to the rapid development of various services and various intelligent applications. As many industries advance to digitalization, storage and calculation increasingly depend on the cloud, and the cloud becomes a hub for constructing an information society. In the big data era, if all data are processed uniformly by a cloud data center, not only too much load is added to the cloud, but also certain communication overhead exists when tasks are submitted to a remote cloud center, and the traditional cloud platform faces many problems, so that an edge cloud taking the data as the center is generated. In the era of rapidly developing cloud applications, the load of the edge cloud computing platform is gradually overlarge, and some nearby intelligent terminals and equipment need to be added to expand resources in real time, so that the stability and the high efficiency of the edge cloud are ensured, and the normal service provision of big data applications such as the internet of things is ensured, thereby generating an end cloud cooperative computing architecture under the edge cloud computing platform.
The cloud computing is a resource usage mode developed based on a network technology and a virtualization technology and aiming at improving the utilization rate of resources such as computing, storage and the like. Task scheduling directly determines the effective utilization of resources, and is one of the most important and critical problems of cloud computing.
The terminal cloud cooperation is different from a traditional single cloud computing platform, and terminals providing certain computing power are added into a resource pool to jointly complete computing tasks. At the moment, due to the heterogeneity of resources, the difference of the computing capacity of terminal resources and the cloud, the complexity of task scheduling is greatly increased.
At present, more researches on task scheduling algorithms of cloud computing are based on grid computing, and the traditional classical algorithms are improved to adapt to a cloud computing platform, but due to the heterogeneity of resources, the terminal resource computing capability and the cloud difference are not suitable for end cloud cooperative computing under an edge cloud computing platform.
Disclosure of Invention
In view of the foregoing defects in the prior art, the technical problem to be solved by the present invention is to provide a peer cloud cooperative computing architecture, a task scheduling apparatus and a task scheduling method, so as to reduce the useless overhead of the traditional virtualization and improve the resource utilization rate and allocation efficiency.
In order to achieve the above object, the present invention provides an end cloud cooperative computing architecture and a task scheduling device, including:
the cloud cluster comprises service nodes and virtual machine nodes in a static cloud under the edge cloud, the service nodes in the static cloud under the edge cloud generally comprise virtual machine computing nodes, the virtual machine computing nodes are virtual machines dynamically generated in a cloud management server, and the virtual machine nodes can be dynamically generated, managed and destroyed by the cloud management server;
the terminal cloud collaborative middleware is in charge of trusted security authentication access of terminal resources on one hand, and provides reasonable task allocation and scheduling strategies for the terminal cloud collaborative computing architecture on the other hand, so that the task is reasonably and efficiently collaboratively computed between the terminal and the cloud end;
and the terminal cluster consists of various hardware terminals, is accessed to the cloud platform in a safe manner, and provides certain computing resources.
The end cloud collaborative computing architecture and the task scheduling device are characterized in that the end cloud collaborative middleware comprises an automatic discovery and expansion module, a terminal resource monitoring and synchronization module and an end cloud task scheduling module.
The terminal cloud collaborative computing architecture and the task scheduling device are characterized in that various hardware terminals of the terminal cluster are divided into various terminal devices which are connected through wires, connected through wireless, and Android as a main operating system.
An end cloud cooperative computing architecture and a task scheduling method are characterized by comprising the following steps:
step one, a user submits a task to a task queue and puts forward the priority of the task;
enqueuing the tasks submitted by the users according to the priorities of the tasks and the real-time performance of the tasks, selecting the dequeued tasks through queue strategy control, directly sending the tasks to service nodes in a static cloud if the dequeued tasks are real-time, and sending the tasks to an end cloud cooperative server if the tasks are non-real-time;
dividing non-real-time tasks sent by the task queue into divisible tasks and nondividable tasks by the end cloud cooperative server, then scheduling the tasks, distributing the nondividable tasks to a single service node in the static cloud for processing, and distributing the divisible tasks to a service node cluster and a terminal cluster in the static cloud for processing according to an end cloud cooperative computing task distribution algorithm;
and fourthly, establishing a heartbeat mechanism by the service node cluster and the terminal cluster in the static cloud and the end cloud cooperative server, and reporting the task completion condition, the CPU rate, the node load, the idle resources and the network transmission rate to the end cloud cooperative server by the service node cluster and the terminal cluster in the static cloud so as to distribute and schedule the resources according to the current resource state when the tasks are distributed.
The end cloud cooperative computing architecture and the task scheduling method are characterized in that the third inseparable task is inseparable or dependent relationships exist among subtasks and serial execution is required.
The terminal cloud cooperative computing architecture and the task scheduling method are characterized in that in the third step, the tasks sent to the terminal cluster are backed up at the cloud end, and due to the fact that the network and resource conditions of the terminals are complex, if the terminal computing is in a problem, the tasks can be processed at the service nodes in the static cloud.
The invention has the beneficial effects that:
the invention provides a terminal cloud cooperative computing architecture, a task scheduling device and a task scheduling method under an edge cloud computing platform, and aims to solve the problems that the existing edge cloud platform is large in load and the communication overhead from task submission to a far end is large in a cloud application era with rapid development. Different from the traditional cloud computing platform, the terminal with certain computing capacity in the security certification access system is added into the computing resource pool to form a terminal cluster, the terminal cluster has strong expansibility, the expansibility of the cloud is increased, the terminal cluster and the service node cluster in the static cloud jointly complete tasks required by the single cloud platform, the traditional cloud platform is optimized, and the load of the cloud is effectively reduced. The framework has the real-time and quick characteristics of edge cloud, and can provide more powerful and stable services for big data applications such as the Internet of things.
The conception, the specific structure and the technical effects of the present invention will be further described with reference to the accompanying drawings to fully understand the objects, the features and the effects of the present invention.
Drawings
FIG. 1 is a diagram of a peer-cloud collaborative computing architecture
FIG. 2 is a flow chart of end cloud collaborative computing
FIG. 3 is a flowchart of a scheduling method of end cloud cooperative computing tasks according to the present invention
Detailed Description
As shown in fig. 1, an end cloud cooperative computing architecture and a task scheduling device are characterized by comprising:
cloud clustering: the cloud-based cloud service system comprises service nodes and virtual machine nodes in a static cloud under an edge cloud, wherein the service nodes in the static cloud under the edge cloud are generally composed of virtual machine computing nodes, and the virtual machine nodes can be dynamically generated, managed and destroyed by a cloud management server.
End cloud collaboration middleware: the end cloud collaborative middleware comprises an automatic discovery and expansion module, a terminal resource monitoring and synchronization module and an end cloud task scheduling module. The terminal cloud collaborative middleware is in charge of trusted security authentication access of terminal resources on one hand, and provides reasonable task allocation and scheduling strategies for the terminal cloud collaborative computing framework on the other hand, so that the task is reasonably and efficiently collaboratively computed between the terminal and the cloud.
Terminal clustering: the terminal cluster is composed of various hardware terminals, the terminals can be divided into wired connected PCs, wireless connected PCs, various terminal devices such as mobile phones and tablets and the like which take Android as a main operating system, the number of the terminals is large, the terminals can be expanded anytime and anywhere, and meanwhile the terminals are accessed to a cloud platform in a safe mode to provide certain computing resources.
The terminal cloud collaboration middleware mainly comprises the following functional modules:
1. auto discovery and extension module
The end cloud cooperative computing architecture is established on the basis of the local edge cloud, and the problems of cross-domain and cross-network access and the like do not exist. The terminal in the area can interact with the whole cloud in a wired and wireless network connection mode.
The automatic discovery is a basic function of the end cloud collaboration server, and is a dynamic method for expanding terminal resources by a cloud platform. The method for actively detecting is used by the end cloud cooperative server and used for discovering available terminal resources in time. The terminal cloud cooperation server actively sends a corresponding data packet to a network accessed by the terminal at regular time, and at the moment, if the terminal capable of providing the computing resources receives the data packet, the terminal uses a corresponding security authentication protocol and then uses a data packet with a certain format to transmit the data packet to the terminal cloud cooperation server for trusted authentication of the resources. And the end cloud coordinator receives the data packet and then analyzes the data packet according to a specified data format to judge whether the authentication is successful. If the authentication is successful, the collaboration server immediately regards the terminal as a trusted computing resource node, adds the trusted computing resource node into a real-time computing resource pool, records a MacAddr field in a data packet as a unique identifier of the trusted terminal, and if the IP address changes and the connection is disconnected due to instability of a wireless network of the terminal, the system can perform an ARP request through the recorded MacAddr of the terminal, acquire the network address of the terminal and perform reconnection.
2. Terminal resource monitoring and synchronizing module
The end cloud cooperation server allocates and schedules resources according to the resource state and the task attribute in the current system when distributing the task, so that the end cloud cooperation server needs to maintain a resource pool for real-time computing and record computing resource information of each cloud end or terminal node which is added to the cloud platform at present.
And after the terminal is successfully accessed to the cloud platform, the terminal resource monitoring module calls corresponding services and sends the computing resource configuration information to the end cloud cooperation server. The terminal cloud cooperative server can issue a resource information request to the terminal at regular time, and the terminal receives the request and continues to call the resource monitoring module to feed back the resource information request to the terminal cloud cooperative server in time, so that the resource information request is ensured to be synchronous with records in the real-time computing resource pool as far as possible.
3. End cloud task scheduling module
And the end cloud task scheduling module is completed by matching the task queue and the end cloud cooperative server. The method comprises the steps that firstly, a task queue is classified according to task attributes or priorities, then a corresponding task needing to be processed is taken out by an end cloud cooperative server, and the task and the resource are scheduled according to current real-time resource information and a certain task allocation algorithm. And finally, the reasonable distribution of the tasks to the cloud and the terminal computing is ensured, and the direct computing cooperation of the tasks in the cloud and the load balance of the whole system are kept.
An end cloud cooperative computing architecture and a task scheduling method are characterized by comprising the following steps:
step one, a user submits a task to a task queue and puts forward the priority of the task.
And step two, enqueuing the tasks submitted by the users according to the priorities of the tasks and the real-time performance of the tasks, selecting the dequeued tasks through queue strategy control, directly sending the tasks to service nodes in the static cloud if the dequeued tasks are real-time, and sending the tasks to the end cloud cooperative server if the tasks are non-real-time.
And thirdly, dividing the non-real-time tasks sent by the task queue into divisible tasks and inseparable tasks by the end cloud cooperative server, then scheduling the tasks, wherein the inseparable tasks are inseparable or dependency relationships exist among subtasks and need to be executed in series, the inseparable tasks are distributed to a single service node in a static cloud for processing, the divisible tasks are distributed to a service node cluster and a terminal cluster in the static cloud for processing according to an end cloud cooperative computing task distribution algorithm, and for the tasks sent to the terminal cluster, backup is carried out at a cloud end firstly, and due to the fact that network and resource conditions of terminals are complex, if terminal computing has problems, the tasks can be processed at the service node in the static cloud.
And fourthly, establishing a heartbeat mechanism by the service node cluster and the terminal cluster in the static cloud and the end cloud cooperative server, and reporting task completion conditions, CPU (central processing unit) rates, node loads, idle resources, network transmission rates and the like to the end cloud cooperative server by the service node cluster and the terminal cluster in the static cloud so as to distribute and schedule resources according to the current resource state during task distribution.
As shown in fig. 2 and 3, which are flowcharts of the scheduling method for the end cloud collaborative computing task of the present invention, the whole process is as follows:
1. enqueuing the tasks according to the real-time performance of the tasks and the priority of the tasks proposed by the users, and then determining the dequeuing sequence of the tasks in the queue through queue strategy control.
2. And carrying out real-time judgment on the dequeuing task.
a. And if so, immediately sending the data to the service node in the static cloud.
b. And if the dequeuing is not real-time, sending the dequeuing non-real-time task to the end cloud cooperative server.
3. And carrying out separability judgment on the non-real-time tasks.
a. And if the task is not separable, sending the task to a service node in the static cloud.
b. And if the tasks can be divided, calculating the task amount to be distributed by each node according to a task distribution algorithm, then distributing the task amount to the service nodes and the terminal clusters in the static cloud for processing, and if the tasks are sent to the nodes of the terminal clusters, carrying out safe backup at the cloud end for recovery when errors occur.
The task assignment algorithm is as follows:
definition 1: the task scheduling is composed of scheduling nodes, networks, terminals or cloud computing nodes. The end and the cloud computing nodes are regarded as a whole to be processed uniformly, the set of all the computing nodes is M, the computing node of the resource is d, wherein M is { d ═ d1,d2,…,dnAnd n is the total number of the computing nodes. Computing node diThe transmission time and the calculation time of the unit task are respectively biAnd ci
Definition 2: the total size of tasks submitted by users needing to be processed currently is A, and the purpose of the algorithm is to divide the tasks with the total size of A into n subtasks (the number of all computing nodes) and divide the subtasks into each computing node to run. These subtasks are independent tasks and have no dependencies with other tasks.
Definition 3: computing node diProcessing sub-task aiHas a completion time of Ti. The shortest time for completing the task is the time for completing all the subtasks simultaneously, namely T1=T2=…=TnIf the shortest time is not that all subtasks are run and completed at the same time, the running computing node is not completedThe assignment of the task to the computing node that has completed running may result in a shorter running time.
Step one, determining the optimal scheduling sequence of all the computing nodes, wherein the optimal scheduling sequence of the computing nodes is a descending bandwidth sequence, and tasks can reach the computing nodes to run as soon as possible by scheduling the tasks to the computing nodes with high bandwidth. Because the tasks submitted by the users are directly submitted to the local edge cloud, the cloud network bandwidth is relatively excellent, the cloud computing reliability is higher, and the problems of communication overhead, safety and the like are solved, namely, the tasks are mainly firstly distributed to the cloud tasks and then distributed to the end tasks. Let d1,d2,...,dnAnd the data are well ordered according to the scheduling sequence.
Step two, calculating the node di to process the subtask aiIs Ti, equal to the transmission time of the task plus the computation time, i.e. Ti=aibi+aiciAnd because the shortest time for completing the task is the time for completing all the subtasks simultaneously, namely T1=T2=…=TnCalculating the relationship a between the task sizes of the calculation nodes according to the above equationi=βia1Wherein
Figure GDA0002477566520000071
Step three, dividing the task size according to the relation a between the calculation nodesi=βia1And the total amount of tasks A ═ a1+a2+…+anCalculating the task size of the first computing node
Figure GDA0002477566520000072
Step four, dividing the task size into the relationship a according to each computing nodei=βia1And the first computing node is assigned to the task size
Figure GDA0002477566520000073
Calculating the task size of each computing node
Figure GDA0002477566520000074
And distributing the solution to each cloud or terminal computing node in the system for computing according to the solution result.
The foregoing detailed description of the preferred embodiments of the invention has been presented. It should be understood that numerous modifications and variations could be devised by those skilled in the art in light of the present teachings without departing from the inventive concepts. Therefore, the technical solutions available to those skilled in the art through logic analysis, reasoning and limited experiments based on the prior art according to the concept of the present invention should be within the scope of protection defined by the claims.

Claims (4)

1. A task scheduling method based on an end cloud cooperative computing architecture is characterized by comprising the following steps:
step one, a user submits a task to a task queue and puts forward the priority of the task;
enqueuing the tasks submitted by the users according to the priorities of the tasks and the real-time performance of the tasks, selecting the dequeued tasks through queue strategy control, directly sending the tasks to service nodes in a static cloud if the dequeued tasks are real-time, and sending the tasks to an end cloud cooperative server if the tasks are non-real-time;
dividing non-real-time tasks sent by the task queue into divisible tasks and nondividable tasks by the end cloud cooperative server, then scheduling the tasks, distributing the nondividable tasks to a single service node in the static cloud for processing, and distributing the divisible tasks to a service node cluster and a terminal cluster in the static cloud for processing according to an end cloud cooperative computing task distribution algorithm;
step four, a heartbeat mechanism is established between the service node cluster and the terminal cluster in the static cloud and the end cloud cooperative server, and the service node cluster and the terminal cluster in the static cloud report task completion conditions, CPU (central processing unit) rates, node loads, idle resources and network transmission rates to the end cloud cooperative server so as to distribute and schedule resources according to the current resource state when the tasks are distributed;
the third step of inseparable tasks refers to inseparable tasks or tasks which have dependency relationship among subtasks and need to be executed serially;
and step three, for the task sent to the terminal cluster, backup is carried out at the cloud end, and due to the fact that the network and resource conditions of the terminal are complex, if the terminal is in a problem during calculation, the task can be processed in a service node in the static cloud.
2. A task scheduling device based on an end cloud collaborative computing architecture, the device being configured to implement the task scheduling method according to claim 1, wherein the task scheduling device based on the end cloud collaborative computing architecture comprises:
the cloud cluster comprises service nodes and virtual machine nodes in a static cloud under the edge cloud, the service nodes in the static cloud under the edge cloud are formed by virtual machine computing nodes, the virtual machine computing nodes are virtual machines dynamically generated in the cloud management server, and the virtual machine nodes can be dynamically generated, managed and destroyed by the cloud management server;
the terminal cloud collaborative middleware is in charge of trusted security authentication access of terminal resources on one hand, and provides reasonable task allocation and scheduling strategies for the terminal cloud collaborative computing architecture on the other hand, so that the task is reasonably and efficiently collaboratively computed between the terminal and the cloud end;
and the terminal cluster consists of various hardware terminals, is accessed to the cloud platform in a safe manner, and provides certain computing resources.
3. The task scheduling device based on the end cloud collaborative computing architecture as claimed in claim 2, wherein the end cloud collaborative middleware comprises an auto discovery and extension module, a terminal resource monitoring and synchronization module, and an end cloud task scheduling module.
4. The task scheduling device based on the end cloud collaborative computing architecture as claimed in claim 2, wherein various hardware terminals of the terminal cluster are divided into a wired PC, a wireless PC and various terminal devices with Android as a main operating system.
CN201710148795.4A 2017-03-14 2017-03-14 Task scheduling method and device based on end cloud cooperative computing architecture Active CN107087019B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201710148795.4A CN107087019B (en) 2017-03-14 2017-03-14 Task scheduling method and device based on end cloud cooperative computing architecture

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201710148795.4A CN107087019B (en) 2017-03-14 2017-03-14 Task scheduling method and device based on end cloud cooperative computing architecture

Publications (2)

Publication Number Publication Date
CN107087019A CN107087019A (en) 2017-08-22
CN107087019B true CN107087019B (en) 2020-07-07

Family

ID=59614540

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201710148795.4A Active CN107087019B (en) 2017-03-14 2017-03-14 Task scheduling method and device based on end cloud cooperative computing architecture

Country Status (1)

Country Link
CN (1) CN107087019B (en)

Families Citing this family (50)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109491770A (en) * 2017-09-13 2019-03-19 中兴通讯股份有限公司 Method for scheduling task, device, system, equipment and storage medium
CN107770263B (en) * 2017-10-16 2019-12-10 电子科技大学 safe access method and system for Internet of things terminal based on edge calculation
CN107959708B (en) * 2017-10-24 2020-10-13 北京邮电大学 Cloud-end-edge-vehicle-end-based vehicle networking service collaborative computing method and system
CN108519910A (en) * 2018-03-21 2018-09-11 四川斐讯信息技术有限公司 A kind of data processing method and system based on single phase in even-numbered days
CN108536518A (en) * 2018-03-28 2018-09-14 深圳市银之杰科技股份有限公司 Method and system, reference platform, service terminal and the memory of task scheduling
CN109032787B (en) * 2018-05-29 2021-02-12 北京奇艺世纪科技有限公司 Task allocation method and device
CN108901046B (en) * 2018-06-14 2020-10-09 北京大学 Cooperative task unloading algorithm and system design scheme for mobile edge computing
CN108762122B (en) * 2018-06-22 2020-10-30 上海际链网络科技有限公司 Intelligent control box and control method thereof
CN109067859B (en) * 2018-07-20 2021-03-16 北京航空航天大学 Cross-domain collaborative service-oriented double-layer cloud architecture system and implementation method
CN108848537B (en) * 2018-08-20 2023-04-18 中国联合网络通信集团有限公司 Edge cloud construction method and system
CN109450512B (en) * 2018-09-17 2020-05-26 厦门大学 Method for network coding and wireless relay to cooperate in edge cache
CN111047045B (en) * 2018-10-12 2021-03-19 中科寒武纪科技股份有限公司 Distribution system and method for machine learning operation
CN111083180B (en) * 2018-10-19 2022-04-26 北京奇虎科技有限公司 Internet of things system and Internet of things equipment linkage method and device
CN109522106B (en) * 2018-10-22 2023-01-17 广东工业大学 Risk value simulation dynamic task scheduling method based on cooperative computing
CN109684083B (en) * 2018-12-11 2020-08-28 北京工业大学 Multistage transaction scheduling allocation strategy oriented to edge-cloud heterogeneous environment
CN109992387B (en) * 2019-04-01 2021-09-24 北京邮电大学 Terminal collaborative task processing method and device and electronic equipment
CN109976915B (en) * 2019-04-02 2021-04-13 中国联合网络通信集团有限公司 Edge cloud collaborative demand optimization method and system based on edge computing
CN110032364B (en) * 2019-04-11 2023-08-15 上海商汤智能科技有限公司 Data processing method, device, electronic equipment and computer storage medium
CN113746679B (en) * 2019-04-22 2023-05-02 腾讯科技(深圳)有限公司 Cross-subdomain communication operation and maintenance method, total operation and maintenance server and medium
CN110377352B (en) * 2019-05-20 2022-06-14 中国人民解放军军事科学院战争研究院 Task processing method and device based on mobile device cloud system
CN110399210B (en) * 2019-07-30 2021-10-01 中国联合网络通信集团有限公司 Task scheduling method and device based on edge cloud
CN110536308A (en) * 2019-08-07 2019-12-03 中科边缘智慧信息科技(苏州)有限公司 A kind of multinode calculating discharging method based on game
CN112399388A (en) * 2019-08-13 2021-02-23 中兴通讯股份有限公司 Method, device and system for realizing edge calculation
CN110572448B (en) * 2019-08-30 2020-11-06 烽火通信科技股份有限公司 Distributed edge cloud system architecture
CN111399994B (en) * 2019-11-27 2023-10-10 杭州海康威视系统技术有限公司 Request scheduling method, request scheduling device, electronic equipment and storage medium
CN110991040A (en) * 2019-12-02 2020-04-10 北京仿真中心 Complex product collaborative simulation environment construction method
CN111124640A (en) * 2019-12-11 2020-05-08 浙江大华技术股份有限公司 Task allocation method and system, storage medium and electronic device
CN111245958A (en) * 2020-03-09 2020-06-05 中国能源建设集团陕西省电力设计院有限公司 Unified cloud computing system for ubiquitous power Internet of things
CN111427679B (en) * 2020-03-25 2023-12-22 中国科学院自动化研究所 Computing task scheduling method, system and device for edge computing
CN111432007B (en) * 2020-03-30 2022-07-15 中科边缘智慧信息科技(苏州)有限公司 Method for node access management and authentication in mobile environment
CN113301587B (en) * 2020-04-15 2022-06-03 阿里巴巴集团控股有限公司 Node control method, network system, device and storage medium
CN111611071B (en) * 2020-04-21 2021-09-07 中国人民解放军军事科学院国防科技创新研究院 Satellite system of satellite-cloud-edge-end architecture and data processing method thereof
CN111694789A (en) * 2020-04-22 2020-09-22 西安电子科技大学 Embedded reconfigurable heterogeneous determination method, system, storage medium and processor
CN111629040B (en) * 2020-05-20 2023-04-07 中移雄安信息通信科技有限公司 Cloud edge coordination method, device, system, equipment and medium
CN111736988A (en) * 2020-05-29 2020-10-02 浪潮电子信息产业股份有限公司 Heterogeneous acceleration method, equipment and device and computer readable storage medium
CN111984383B (en) * 2020-08-18 2021-05-14 上海悟景信息科技有限公司 Service data processing method and cloud platform based on cloud network fusion and artificial intelligence
CN112039992B (en) * 2020-09-01 2022-10-28 平安资产管理有限责任公司 Model management method and system based on cloud computing architecture
CN112202900B (en) * 2020-09-30 2022-06-21 无锡雪浪数制科技有限公司 Novel-architecture edge computing system
CN112287609B (en) * 2020-12-28 2021-03-30 之江实验室 End, edge and cloud collaborative computing device for robot task division
CN113821313A (en) * 2020-12-28 2021-12-21 京东科技控股股份有限公司 Task scheduling method and device and electronic equipment
CN112804446B (en) * 2020-12-30 2022-08-12 江苏达科信息科技有限公司 Big data processing method and device based on cloud platform big data
CN112783651B (en) * 2021-01-22 2022-11-25 苏州浪潮智能科技有限公司 Load balancing scheduling method, medium and device for vGPU of cloud platform
CN113379708A (en) * 2021-02-26 2021-09-10 山东大学 Air conditioner external unit appearance detection method and system based on federal learning
CN113254095B (en) * 2021-04-25 2022-08-19 西安电子科技大学 Task unloading, scheduling and load balancing system and method for cloud edge combined platform
CN113612732B (en) * 2021-07-06 2023-12-26 华控清交信息科技(北京)有限公司 Resource calling method and device and multiparty secure computing system
CN114461344A (en) * 2021-09-17 2022-05-10 支付宝(杭州)信息技术有限公司 Terminal keep-alive management method and device based on cloud edge terminal architecture
CN114090247A (en) * 2021-11-22 2022-02-25 北京百度网讯科技有限公司 Method, device, equipment and storage medium for processing data
CN116595384B (en) * 2023-07-14 2023-11-24 支付宝(杭州)信息技术有限公司 Model training method and device
CN116662021A (en) * 2023-08-01 2023-08-29 鹏城实验室 Collaborative scheduling system and method based on end-edge cloud architecture
CN117076257B (en) * 2023-09-14 2024-03-05 研华科技(中国)有限公司 Management method, management server and management system based on server cluster

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101719931A (en) * 2009-11-27 2010-06-02 南京邮电大学 Multi-intelligent body-based hierarchical cloud computing model construction method
CN101923487A (en) * 2010-08-06 2010-12-22 西华师范大学 Comprehensive embedded type real-time period task scheduling method
CN101977242A (en) * 2010-11-16 2011-02-16 西安电子科技大学 Layered distributed cloud computing architecture and service delivery method
CN103260194A (en) * 2013-05-06 2013-08-21 西安邮电大学 Wireless sensor distributary system based on cloud computing
CN104767810A (en) * 2015-04-07 2015-07-08 中国海洋大学 Cloud-client cooperative service system and cloud-client cooperative work method

Family Cites Families (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8627426B2 (en) * 2010-04-26 2014-01-07 Vmware, Inc. Cloud platform architecture

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101719931A (en) * 2009-11-27 2010-06-02 南京邮电大学 Multi-intelligent body-based hierarchical cloud computing model construction method
CN101923487A (en) * 2010-08-06 2010-12-22 西华师范大学 Comprehensive embedded type real-time period task scheduling method
CN101977242A (en) * 2010-11-16 2011-02-16 西安电子科技大学 Layered distributed cloud computing architecture and service delivery method
CN103260194A (en) * 2013-05-06 2013-08-21 西安邮电大学 Wireless sensor distributary system based on cloud computing
CN104767810A (en) * 2015-04-07 2015-07-08 中国海洋大学 Cloud-client cooperative service system and cloud-client cooperative work method

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
"移动网络中的云服务资源优化研究";陈家玓;《中国博士学位论文全文数据库 信息科技辑》;20160331;正文第28-31页 *

Also Published As

Publication number Publication date
CN107087019A (en) 2017-08-22

Similar Documents

Publication Publication Date Title
CN107087019B (en) Task scheduling method and device based on end cloud cooperative computing architecture
Zhang et al. Adaptive interference-aware VNF placement for service-customized 5G network slices
EP3637733B1 (en) Load balancing engine, client, distributed computing system, and load balancing method
CN113448721A (en) Network system for computing power processing and computing power processing method
CN103516807B (en) A kind of cloud computing platform server load balancing system and method
US20160378570A1 (en) Techniques for Offloading Computational Tasks between Nodes
Wang et al. Towards green service composition approach in the cloud
US9104488B2 (en) Support server for redirecting task results to a wake-up server
EP3211531B1 (en) Virtual machine start method and apparatus
Rikos et al. Optimal CPU scheduling in data centers via a finite-time distributed quantized coordination mechanism
CN113259415B (en) Network message processing method and device and network server
Liu et al. Service resource management in edge computing based on microservices
Kanwal et al. A genetic based leader election algorithm for IoT cloud data processing
Edinger et al. Decentralized low-latency task scheduling for ad-hoc computing
CN111586140A (en) Data interaction method and server
WO2022257247A1 (en) Data processing method and apparatus, and computer-readable storage medium
CN112099930A (en) Quantum computer cluster distributed queue scheduling method
CN113434591B (en) Data processing method and device
WO2022111466A1 (en) Task scheduling method, control method, electronic device and computer-readable medium
Sowmya et al. An adaptive load balancing strategy in cloud computing based on Map reduce
Chen et al. Scheduling of job combination and dispatching strategy for grid and cloud system
CN117076057B (en) AI service request scheduling method, device, equipment and medium
CN114253747B (en) Distributed message management system and method
CN110971627B (en) Node control method and device and task processing system
WO2023093200A1 (en) Method and apparatus for asynchronously processing tasks, and storage medium and electronic apparatus

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant