CN111539863B - Intelligent city operation method and system based on multi-source task line - Google Patents

Intelligent city operation method and system based on multi-source task line Download PDF

Info

Publication number
CN111539863B
CN111539863B CN202010225913.9A CN202010225913A CN111539863B CN 111539863 B CN111539863 B CN 111539863B CN 202010225913 A CN202010225913 A CN 202010225913A CN 111539863 B CN111539863 B CN 111539863B
Authority
CN
China
Prior art keywords
task
calculation
cloud server
cloud
local
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN202010225913.9A
Other languages
Chinese (zh)
Other versions
CN111539863A (en
Inventor
不公告发明人
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Light control tesilian (Chongqing) Information Technology Co.,Ltd.
Original Assignee
Light Control Tesilian Chongqing Information Technology Co ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Light Control Tesilian Chongqing Information Technology Co ltd filed Critical Light Control Tesilian Chongqing Information Technology Co ltd
Priority to CN202010225913.9A priority Critical patent/CN111539863B/en
Publication of CN111539863A publication Critical patent/CN111539863A/en
Application granted granted Critical
Publication of CN111539863B publication Critical patent/CN111539863B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q50/00—Systems or methods specially adapted for specific business sectors, e.g. utilities or tourism
    • G06Q50/10—Services
    • G06Q50/26—Government or public services
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F9/00—Arrangements for program control, e.g. control units
    • G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
    • G06F9/46—Multiprogramming arrangements
    • G06F9/48—Program initiating; Program switching, e.g. by interrupt
    • G06F9/4806—Task transfer initiation or dispatching
    • G06F9/4812—Task transfer initiation or dispatching by interrupt, e.g. masked
    • G06F9/4831—Task transfer initiation or dispatching by interrupt, e.g. masked with variable priority

Landscapes

  • Engineering & Computer Science (AREA)
  • Business, Economics & Management (AREA)
  • Theoretical Computer Science (AREA)
  • Software Systems (AREA)
  • Physics & Mathematics (AREA)
  • Tourism & Hospitality (AREA)
  • General Physics & Mathematics (AREA)
  • Educational Administration (AREA)
  • Development Economics (AREA)
  • General Engineering & Computer Science (AREA)
  • Health & Medical Sciences (AREA)
  • Economics (AREA)
  • General Health & Medical Sciences (AREA)
  • Human Resources & Organizations (AREA)
  • Marketing (AREA)
  • Primary Health Care (AREA)
  • Strategic Management (AREA)
  • General Business, Economics & Management (AREA)
  • Computer And Data Communications (AREA)

Abstract

The invention discloses a method and a system for running an intelligent city based on a multi-source task line, wherein the method mainly comprises the steps of analyzing and calculating any data in the running of the intelligent city, and splitting the data into a local calculation task line and one or more cloud calculation task lines; determining the data calculation amount and the calculation thread number of the cloud server according to the principle of optimal utility, and further determining the number of task threads capable of being born by the cloud server and the expected completion time of the task threads; and distributing the split cloud computing task lines to appropriate cloud servers in a mode of maximally paralleling the local computing task lines and the cloud computing task lines of one data analysis operation requirement. The system mainly comprises a cloud server, a local terminal, a task scheduling controller and a coordinator. By the system and the method, the calculation of the multitask line is realized, the calculation and transmission efficiency is improved, and the overall benefit is maximized.

Description

Intelligent city operation method and system based on multi-source task line
Technical Field
The invention relates to the technical field of multisource task lines of intelligent cities, in particular to a method and a system for operating an intelligent city based on a multisource task line.
Background
The intelligent city is an intelligent system which takes the wireless Internet of things as a medium and covers the whole city range, various sensing facilities, monitoring facilities, access control card swiping facilities, traffic facilities, lighting facilities, multimedia facilities and the like in the city can upload and download data by utilizing the wireless Internet of things, so that the preset intelligent function of the intelligent city is realized on the basis of data acquisition and analysis, for example, the sensing facilities analyze the conditions of temperature, humidity, illumination intensity and the like of a city area, the monitoring facilities and the access control card swiping facilities perform identity verification, traffic control, suspicious alarm and the like on the basis of human body characteristic quantity identification such as human faces and the like, and the traffic facilities realize traffic current limiting, traffic command and the like, so that the operation of the whole intelligent city is supported.
As described above, most of the data analysis operations in the smart city have large computation and data processing amounts, and as the intelligence develops in the depth direction, the magnitude of the computation and data amount of the data analysis operations increases significantly, and the processing capability, data storage capability, battery standby capability, and the like of local computation of a single smart facility become insufficient.
The intelligent facility at the front end of the cloud computing is only responsible for basic data acquisition, result feedback, action execution and the like, data analysis and operation are moved to a server at the cloud end, and the server is executed by utilizing the powerful computing capability. However, in the scale and data magnitude of the smart city, cloud computing adds intermediate links, which increases communication load, increases overhead of data operation, and decreases response speed of smart facilities.
Therefore, for the operation of the smart city, the data analysis operation needs to realize the optimized balance between the local calculation and the cloud calculation, and the operation tasks are disassembled and distributed locally and at the cloud, so that the overall benefit is optimized.
In addition, the coverage space and the network scale of the Internet of things of the intelligent city are large, so that the sources of data analysis and operation tasks are numerous, and the parallel characteristic of a multi-source task line is presented. How to realize effective dynamic management between local calculation and cloud calculation for multi-source and concurrent task lines related to data analysis and calculation, keep the overall smoothness of the task lines, avoid excessive stagnation and interruption and solve the problems.
Disclosure of Invention
Objects of the invention
In order to overcome at least one defect in the prior art, the method and the system for operating the smart city based on the multi-source task line distribute the calculation tasks to the local calculation task line and the cloud task line for calculation, so that the calculation and the processing of the multi-source task line are realized, the optimal balance between the local calculation and the cloud calculation is realized through data analysis and calculation, and the calculation tasks are disassembled and distributed locally and at the cloud, so that the overall benefit is optimized.
(II) technical scheme
As a first aspect of the invention, the invention discloses a method for operating an intelligent city based on a multi-source task line, which comprises the following steps:
for any data analysis and operation requirement in the operation of the intelligent city, splitting the data analysis and operation requirement into a local calculation task line and one or more cloud calculation task lines;
determining the data calculation amount and the calculation thread number of the cloud server according to the principle of optimal utility, and further determining the number of task threads capable of being born by the cloud server and the expected completion time of the task threads;
and distributing the split cloud computing task lines to appropriate cloud servers in a mode of maximally paralleling the local computing task lines and the cloud computing task lines of one data analysis operation requirement.
In a possible implementation manner, the specific manner of splitting any data analysis operation requirement into a local computing task line and one or more cloud computing task lines includes:
splitting the data analysis operation requirement into a locally calculated task line MkLAnd one or more cloud computing task lines MkC1,MkC2...MkCn...; wherein the local computing task line MkLCorresponding to an operation data amount of DkLOne or more cloud computing task lines MkC1,MkC2...MkCn.., the total corresponding operation data amount is DkC；
Wherein Dk＝εDkL+(1-ε)DkC；
Epsilon represents the splitting ratio of local calculation and cloud calculation, and epsilon is more than or equal to 0 and less than or equal to 1;
wherein the local computing task line MkLIs calculated with a time delay of tkLCloud computing task line MkC1,MkC2...MkCn.., the calculated time delays are tkC1,tkC2...tkCn...；
The way to calculate the split ratio epsilon is: when the constraint condition is satisfied, i.e. t is more than or equal to 0kL,tkC1,tkC2...tkCn...≤tmaxLet max (t)kL,tkC1,tkC2...tkCn) The minimum ε; wherein t ismaxIs the maximum allowed time delay;
on the basis of determining epsilon, determining a task line M of cloud computing splitting according to the number of available cloud serverskC1,MkC2...MkCn...
In a possible implementation manner, the specific manner of determining the data computation amount and the computation thread number of the cloud server, and further determining the number of task threads that can be assumed by the cloud server and the expected completion time of the task threads includes:
defining the cost of local computation as
Figure BDA0002427628230000031
Where n is the number of the local terminal,
Figure BDA0002427628230000032
represents the total overhead of the nth local terminal,
Figure BDA0002427628230000033
a weight of the temporal overhead is represented,
Figure BDA0002427628230000034
a time overhead is represented by the time of day,
Figure BDA0002427628230000035
wherein
Figure BDA0002427628230000036
Is the number of calculation threads that can be invoked by the local terminal in local unit time, dnThe calculation thread number started by the task line of the local terminal to successfully finish the calculation is shown,
Figure BDA0002427628230000037
representing the weight of the overhead of the computational resource,
Figure BDA0002427628230000038
is the overhead of the computational resources and is,
Figure BDA0002427628230000039
wherein
Figure BDA00024276282300000310
Is the computational resource overhead for each computational thread,
Figure BDA00024276282300000311
computational resource overhead in units of data volume;
the cost of the cloud server for carrying out cloud computing on the computing task uploaded by the nth local terminal is
Figure BDA00024276282300000312
Wherein the content of the first and second substances,
Figure BDA00024276282300000313
representing the time to upload a computing task from the local terminal to the cloud server,
Figure BDA0002427628230000041
representing the computation time of the cloud server,
Figure BDA0002427628230000042
wherein C is the calculation thread number, pi, which can be used by the cloud server in unit timenRepresenting a profit value obtained by the cloud server after completing a calculation task;
the comprehensive utility of the cloud server is
Figure BDA0002427628230000043
Wherein R represents the comprehensive utility of the cloud server, K is a task line corresponding to the cloud server, and K task lines are calculated by the cloud server; n is a radical ofkFor the number of successfully completed calculations, π, within the utility statistics window in the kth task linekThe profit value pr obtained by the cloud server after the kth task line completes calculation successfully every timebCost, pr, representing unit data computation of cloud serverdCost of the unit calculation thread number of the cloud server, bkRepresenting the amount of data computation incurred by each successful completion of the computation by the kth task line, dkRepresenting the number of calculation threads started by the kth task line for successfully completing the calculation each time;
further, local terminal overhead is set
Figure BDA0002427628230000044
Overhead greater than cloud server
Figure BDA0002427628230000045
Taking the maximum comprehensive utility R of the cloud server as a target for constraint conditions, and solving bk，dkAnd pik；
Reference bk，dkAnd pikAnd distributing the calculation tasks to the cloud server, namely acquiring the data calculation amount and the calculation thread number born by the cloud server for the kth task line according to the maximization of the comprehensive utility R of the cloud server, and determining the calculation born by the cloud server according to the data calculation amount and the calculation thread number.
In a possible implementation manner, the specific manner of splitting any data analysis operation requirement into a local computation task line and one or more cloud computation task lines, determining the data computation amount and the computation thread number of the cloud server, and further determining the number of task lines that the cloud server can undertake and the expected completion time of the task lines includes:
after the data calculation amount and the calculation thread number borne by the cloud server are determined for the cloud server, the cloud task lines split according to each data analysis calculation requirement are determined, the task lines are determined to be allocated to the queuing period faced by the cloud server according to the data calculation amount and the calculation thread number borne by the cloud server, and then the cloud task lines are allocated to the appropriate cloud server under the condition that the local calculation task lines and the cloud calculation task lines are maximally parallel.
As a second aspect of the invention, the invention also discloses a system for operating the intelligent city based on the multi-source task line, which comprises:
the system comprises a cloud server, a local terminal, a task scheduling controller and a coordinator.
The task scheduling controller is central computing equipment of the whole network, the coordinator is connected below the task scheduling controller, the coordinator distributes tasks to a cloud computing task line and a local computing task line, the cloud computing task line is provided with the cloud server, and the local computing task line is provided with the local terminal. The local terminal undertakes calculation of local tasks, and the cloud server undertakes calculation of cloud tasks. And the cloud computing task line and the local computing task line perform edge computing and transmit the computed data to the task scheduling controller.
The task scheduling controller is used for receiving data calculated by the local terminal and the cloud server;
the coordinator is used for splitting any data analysis operation requirement into a local computing task line and one or more cloud computing task lines; determining the data calculation amount and the calculation thread number of the cloud server according to the principle of optimal utility, and further determining the number of task threads capable of being born by the cloud server and the expected completion time of the task threads; and distributing the split cloud computing task lines to appropriate cloud servers in a mode of maximizing parallelism of the local computing task lines and the cloud computing task lines of one data analysis operation requirement.
The coordinator comprises a task line splitting module, and the task line splitting module is used for splitting the data analysis operation requirement into a locally calculated task line MkLAnd one or more cloud computing task lines MkC1,MkC2...MkCn...; wherein the local computing task line MkLCorresponding to an operation data amount of DkLOne or more cloud computing task lines MkC1,MkC2...MkCn.., the total corresponding operation data amount is DkC；
Wherein Dk＝εDkL+(1-ε)DkC；
Epsilon represents the splitting ratio of local calculation and cloud calculation, and epsilon is more than or equal to 0 and less than or equal to 1;
wherein the local computing task line MkLIs calculated with a time delay of tkLCloud computing task line MkC1,MkC2...MkCn.., the calculated time delays are tkC1,tkC2...tkCn...；
The way of calculating the split ratio epsilonComprises the following steps: when the constraint condition is satisfied, i.e. t is more than or equal to 0kL,tkC1,tkC2...tkCn...≤tmaxLet max (t)kL,tkC1,tkC2...tkCn) The minimum ε; wherein t ismaxIs the maximum allowed time delay;
on the basis of determining epsilon, determining a task line M of cloud computing splitting according to the number of available cloud serverskC1,MkC2...MkCn...
The coordinator comprises a cloud server calculation amount evaluation module, and the cost of local calculation is defined as
Figure BDA0002427628230000061
Where n is the number of the local terminal,
Figure BDA0002427628230000062
represents the total overhead of the nth local terminal,
Figure BDA0002427628230000063
a weight of the temporal overhead is represented,
Figure BDA0002427628230000064
a time overhead is represented by the time of day,
Figure BDA0002427628230000065
wherein
Figure BDA0002427628230000066
Is the number of calculation threads that can be invoked by the local terminal in local unit time, dnCan be expressed in units of the calculated amount of a single thread per unit time,
Figure BDA0002427628230000067
representing the weight of the overhead of the computational resource,
Figure BDA0002427628230000068
is the overhead of the computational resources and is,
Figure BDA0002427628230000069
wherein
Figure BDA00024276282300000610
Is the computational resource overhead for each computational thread,
Figure BDA00024276282300000611
computational resource overhead in units of data size, bnIs the amount of data processed by the local terminal;
the cost of the cloud server for carrying out cloud computing on the computing task uploaded by the nth local terminal is
Figure BDA00024276282300000612
Wherein the content of the first and second substances,
Figure BDA00024276282300000613
representing the time to upload a computing task from the local terminal to the cloud server,
Figure BDA00024276282300000614
representing the computation time of the cloud server,
Figure BDA00024276282300000615
wherein C is the calculation thread number, pi, which can be used by the cloud server in unit timenRepresenting a profit value obtained by the cloud server after completing a calculation task;
the comprehensive utility of the cloud server is
Figure BDA00024276282300000616
Wherein R represents the comprehensive utility of the cloud server, K is a task line corresponding to the cloud server, and K task lines are calculated by the cloud server; n is a radical ofkFor the number of successfully completed calculations, π, within the utility statistics window in the kth task linekThe profit value pr obtained by the cloud server after the kth task line completes calculation successfully every timebCost, pr, representing unit data computation of cloud serverdUnit meter for representing cloud serverCost of calculating the number of threads, bkRepresenting the amount of data computation incurred by each successful completion of the computation by the kth task line, dkRepresents the number of calculation threads, g, opened for each successful completion of the calculation of the kth task linekRepresenting the cost of the cloud server after the kth task line successfully completes the calculation each time;
further, local terminal overhead is set
Figure BDA0002427628230000071
Overhead greater than cloud server
Figure BDA0002427628230000072
Taking the maximum comprehensive utility R of the cloud server as a target for constraint conditions, and solving bk，dkAnd pik；
Reference bk，dkAnd pikAnd distributing the calculation tasks to the cloud server, namely acquiring the data calculation amount and the calculation thread number born by the cloud server for the kth task line according to the maximization of the comprehensive utility R of the cloud server, and determining the calculation born by the cloud server according to the data calculation amount and the calculation thread number.
The coordinator also comprises a cloud task line distribution module, and the cloud task line distribution module determines the data calculation amount and the calculation thread number born by the cloud server for the cloud server; and determining the queuing period for allocating the task lines to the cloud server according to the data calculation amount and the calculation thread number born by the cloud server for each cloud task line split according to the data analysis calculation requirements, and allocating the cloud task lines to the appropriate cloud server under the condition that the local calculation task lines and the cloud calculation task lines are maximally parallel.
(III) advantageous effects
The invention discloses a method and a system for intelligent city operation based on a multi-source task line, which have the following beneficial effects:
1. improving the response speed of the local facility: the multi-source task line can be calculated and processed at the same time without being clamped on one line.
2. The data analysis operation realizes the optimized balance between the local calculation and the cloud calculation, and the operation tasks are disassembled and distributed at the local and the cloud, so that the overall benefit is optimized.
3. Effective dynamic management is realized between local computing and cloud computing, the whole smoothness of the task line is kept, and excessive stagnation interruption is avoided.
Drawings
The embodiments described below with reference to the drawings are exemplary and intended to be used for explaining and illustrating the present invention and should not be construed as limiting the scope of the present invention.
FIG. 1 is a schematic structural diagram of a system for intelligent city operation based on a multi-source task line, which is disclosed by the invention;
FIG. 2 is a flow chart of a method for operating an intelligent city based on a multi-source task line, which is disclosed by the invention.
Detailed Description
In order to make the implementation objects, technical solutions and advantages of the present invention clearer, the technical solutions in the embodiments of the present invention will be described in more detail below with reference to the accompanying drawings in the embodiments of the present invention.
It should be noted that: in the drawings, the same or similar reference numerals denote the same or similar elements or elements having the same or similar functions throughout. The embodiments described are some embodiments of the present invention, not all embodiments, and features in embodiments and embodiments in the present application may be combined with each other without conflict. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
With the development of science and technology, the artificial intelligent internet of things is increasingly integrated into the daily life of people. The smart city is a specific application case. The operation of the intelligent city cannot be separated from the analysis and operation of data, wherein most of the data analysis and operation have larger operation amount and data processing amount, along with the development of intellectualization to the depth direction, the operation amount and the magnitude of the data amount of the data analysis and operation are remarkably increased, and the processing capability, the data storage capability, the battery standby and other aspects of local calculation of a single intelligent facility are gradually insufficient. For example: temperature and humidity sensors, air quality sensors and optical sensors can collect a large amount of receipts of cities, and the processing capability, data storage capability, battery standby and other aspects of local calculation which only depend on single intelligent facilities cannot meet the requirements of the stability and real-time performance of the whole internet of things.
The intelligent facility at the front end of the cloud computing is only responsible for basic data acquisition, result feedback, action execution and the like, data analysis and operation are moved to a server at the cloud end, and the server is executed by utilizing the powerful computing capability. However, there are thousands of sensors in a smart city, which collect various data in real time and transmit the data to the central computing module. Under the scale and data magnitude of an intelligent city, cloud computing can increase intermediate links, so that the communication load is increased, the overhead of data operation is increased, and meanwhile, the response speed of an intelligent facility is reduced.
Therefore, for the operation of the smart city, the data analysis operation needs to realize the optimized balance between the local calculation and the cloud calculation, and the operation tasks are disassembled and distributed locally and at the cloud, so that the overall benefit is optimized.
In addition, the coverage space and the network scale of the Internet of things of the intelligent city are large, so that the sources of data analysis and operation tasks are numerous, and the parallel characteristic of a multi-source task line is presented. How to realize effective dynamic management between local calculation and cloud calculation for multi-source and concurrent task lines related to data analysis and calculation, keep the overall smoothness of the task lines, avoid excessive stagnation and interruption and solve the problems.
In order to process data collected by various types of sensors and meet interaction of bottom-layer interaction equipment, the intelligent Internet of things continuously generates calculation tasks to be executed. The invention adopts the framework of a multi-source task line, and a task is calculated to generate a task request; the task scheduling controller distributes tasks to a cloud task line and a local task line according to the requirements of the task request on computing resources, real-time performance and network transmission stability, the various sensors and various bottom layer interaction devices transmit the acquired data to a cloud server and a local terminal, and the cloud server and the local terminal meet the task request and execute related task computation.
In order to meet the difference requirements of task requests of the intelligent internet of things on computing resources, real-time performance and network transmission stability, an intelligent city operation method based on a multi-source task line is designed, the method is combined with a multi-task line computing task scheduling method of a task scheduling controller technology, and a network structure diagram is shown in fig. 1. The central computing equipment of the whole network is a task scheduling controller, a coordinator is connected below the task scheduling controller, the coordinator distributes tasks to a cloud task line and a local task line, a cloud server is arranged on the cloud task line, and a local terminal is arranged on the local task line. The local terminal undertakes the calculation of local tasks, and the cloud server undertakes the calculation of cloud tasks. And the cloud task line and the local task line perform edge calculation and transmit the calculated data to the task scheduling controller. The coordinator allocates the tasks to the cloud task lines and the local task lines through the following rules. Data analysis and operation need to realize optimized balance between local calculation and cloud calculation, and operation tasks are disassembled and distributed locally and at the cloud, so that the overall benefit is optimized.
As shown in fig. 2, the method for operating an intelligent city based on a multi-source task line in this embodiment mainly includes the following steps:
300. for any data analysis and operation requirement in the operation of the intelligent city, splitting the data analysis and operation requirement into a task line for local computation and one or more task lines for cloud computation;
400. determining the data calculation amount and the calculation thread number of the cloud server according to the principle of optimal utility, and further determining the number of task threads capable of being born by the cloud server and the expected completion time of the task threads;
500. and distributing the split task lines to the appropriate cloud servers in a mode of maximally paralleling the local computing task line and the cloud computing task line of one data analysis operation requirement.
300. For any data analysis and operation requirement in the operation of the intelligent city, splitting the data analysis and operation requirement into a task line for local computation and one or more task lines for cloud computation;
wherein one data analysis operation requirement is expressed as Mk＝{Dk,Ck,tmaxIn which D iskIs the amount of operation data of the demand, CkIs the number of computational threads required by the demand, tmaxIs the maximum completion time for the demand.
Splitting the data analysis operation requirement into a locally calculated task line MkLAnd one or more cloud computing task lines MkC1,MkC2...MkCn...; wherein the local computing task line MkLCorresponding to an operation data amount of DkLOne or more cloud computing task lines MkC1,MkC2...MkCn.., the total corresponding operation data amount is DkC；
Wherein Dk＝εDkL+(1-ε)DkC；
Epsilon represents the splitting ratio of local calculation and cloud calculation, and epsilon is more than or equal to 0 and less than or equal to 1;
wherein the local computing task line MkLIs calculated with a time delay of tkLCloud computing task line MkC1,MkC2...MkCn.., the calculated time delays are tkC1,tkC2...tkCn...；
The way to calculate the split ratio epsilon is: when the constraint condition is satisfied, i.e. t is more than or equal to 0kL,tkC1,tkC2...tkCn...≤tmaxLet max (t)kL,tkC1,tkC2...tkCn) The minimum ε; wherein t ismaxIs the maximum allowed time delay;
on the basis of determining epsilon, determining a task line M of cloud computing splitting according to the number of available cloud serverskC1,MkC2...MkCn...
400. Determining the data calculation amount and the calculation thread number of the cloud server according to the principle of optimal utility, and further determining the number of task threads capable of being born by the cloud server and the expected completion time of the task threads;
the invention defines the cost of local computation as
Figure BDA0002427628230000111
Where n is the number of the local terminal,
Figure BDA0002427628230000112
represents the total overhead of the nth local terminal,
Figure BDA0002427628230000113
a weight of the temporal overhead is represented,
Figure BDA0002427628230000114
a time overhead is represented by the time of day,
Figure BDA0002427628230000115
wherein
Figure BDA0002427628230000116
Is the calculation thread number which can be started in unit time at the local terminal,
Figure BDA0002427628230000117
representing the weight of the overhead of the computational resource,
Figure BDA0002427628230000118
is the overhead of the computational resources and is,
Figure BDA0002427628230000119
wherein
Figure BDA00024276282300001110
Is the computational resource overhead for each computational thread,
Figure BDA00024276282300001111
computational resource overhead in units of data volume;
the cost of the cloud server for carrying out cloud computing on the nth local terminal is
Figure BDA00024276282300001112
Wherein the content of the first and second substances,
Figure BDA00024276282300001113
representing the time to upload a computing task from the local terminal to the cloud server,
Figure BDA00024276282300001114
representing the computation time of the cloud server,
Figure BDA00024276282300001115
wherein C is the calculation thread number, pi, which can be used by the cloud server in unit timenRepresenting a profit value obtained by the cloud server after completing PoW calculation;
the comprehensive utility of the cloud server is
Figure BDA00024276282300001116
Wherein R represents the comprehensive utility of the cloud server, K is a task line corresponding to the cloud server, and K task lines are calculated by the cloud server; n is a radical ofkThe number of local terminals, pi, successfully completing the calculation in the utility statistical window in the kth task linekThe profit value pr obtained by the cloud server after the kth task line completes calculation successfully every timebCost, pr, representing unit data computation of cloud serverdCost of the unit calculation thread number of the cloud server, bkRepresenting the amount of data computation incurred by each successful completion of the computation by the kth task line, dkIndicating the number of calculation threads opened for each successful completion of the calculation of the kth task line.
Further, local terminal overhead is set
Figure BDA0002427628230000121
Overhead greater than cloud server
Figure BDA0002427628230000122
Taking the maximum comprehensive utility R of the cloud server as a target for constraint conditions, and solving bk，dkAnd pik。
Reference bk，dkAnd pikAnd distributing the PoW calculation to the cloud server, namely acquiring the data calculation amount and the calculation thread number born by the cloud server for the kth task line according to the maximization of the comprehensive utility R of the cloud server, and determining the calculation born by the cloud server according to the data calculation amount and the calculation thread number.
500. And distributing the split task lines to the appropriate cloud servers in a mode of maximally paralleling the local computing task line and the cloud computing task line of one data analysis operation requirement.
In the steps, the data calculation amount and the calculation thread number born by the cloud server are determined for the cloud server; and determining a queuing period for allocating the task lines to the cloud server according to the data calculation amount and the calculation thread number born by the cloud server for each cloud computing task line split according to the data analysis calculation requirements, and allocating the cloud computing task lines to the appropriate cloud server under the condition that the local computing task lines and the cloud computing task lines are maximally parallel.
The above description is only for the specific embodiments of the present invention, but the scope of the present invention is not limited thereto, and any changes or substitutions that can be easily conceived by those skilled in the art within the technical scope of the present invention are included in the scope of the present invention. Therefore, the protection scope of the present invention shall be subject to the protection scope of the claims.

Claims (4)

1. A method for running an intelligent city based on a multi-source task line is characterized by comprising the following steps:
for any data analysis and operation requirement in the operation of the intelligent city, splitting the data analysis and operation requirement into a local calculation task line and one or more cloud calculation task lines; the method specifically comprises the following steps:splitting the data analysis operation requirement into a local computation task line MkLAnd/or one or more cloud computing task lines MkC1,MkC2...MkCn...; wherein the local computing task line MkLCorresponding to an operation data amount of DkLOne or more cloud computing task lines MkC1,MkC2...MkCn.., the total corresponding operation data amount is DkC(ii) a Wherein Dk＝εDkL+(1-ε)DkC(ii) a Epsilon represents the splitting ratio of local calculation and cloud calculation, and epsilon is more than or equal to 0 and less than or equal to 1; wherein the local computing task line MkLIs calculated with a time delay of tkLCloud computing task line MkC1,MkC2...MkCn.., the calculated time delays are tkC1,tkC2...tkCn...; the way to calculate the split ratio epsilon is: when the constraint condition is satisfied, i.e. t is more than or equal to 0kL,tkC1,tkC2...tkCn...≤tmaxLet max (t)kL,tkC1,tkC2...tkCn) The minimum ε; wherein t ismaxIs the maximum allowed time delay; on the basis of determining epsilon, determining a task line M of cloud computing splitting according to the number of available cloud serverskC1,MkC2...MkCn..;
determining the data calculation amount and the calculation thread number of the cloud server according to the principle of optimal utility, and further determining the number of task threads capable of being born by the cloud server and the expected completion time of the task threads; the method specifically comprises the following steps: defining the cost of local computation as
Figure FDA0002807408040000011
Where n is the number of the local terminal,
Figure FDA0002807408040000012
represents the total overhead of the nth local terminal,
Figure FDA0002807408040000013
a weight of the temporal overhead is represented,
Figure FDA0002807408040000014
a time overhead is represented by the time of day,
Figure FDA0002807408040000015
wherein
Figure FDA0002807408040000016
Is the number of calculation threads that can be invoked by the local terminal in local unit time, dnCan be expressed in units of the calculated amount of a single thread per unit time,
Figure FDA0002807408040000017
representing the weight of the overhead of the computational resource,
Figure FDA0002807408040000018
is the overhead of the computational resources and is,
Figure FDA0002807408040000019
wherein
Figure FDA00028074080400000110
Is the computational resource overhead for each computational thread,
Figure FDA00028074080400000111
computational resource overhead in units of data size, bnIs the amount of data processed by the local terminal; the cost of the cloud server for carrying out cloud computing on the computing task uploaded by the nth local terminal is
Figure FDA00028074080400000112
Wherein the content of the first and second substances,
Figure FDA00028074080400000113
representing the time to upload a computing task from the local terminal to the cloud server,
Figure FDA00028074080400000114
representing the computation time of the cloud server,
Figure FDA0002807408040000021
wherein C is the calculation thread number, pi, which can be used by the cloud server in unit timenRepresenting a profit value obtained by the cloud server after completing a calculation task; the comprehensive utility of the cloud server is
Figure FDA0002807408040000022
Wherein R represents the comprehensive utility of the cloud server, K is a task line corresponding to the cloud server, and K task lines are calculated by the cloud server; n is a radical ofkFor the number of successfully completed calculations, π, within the utility statistics window in the kth task linekThe profit value pr obtained by the cloud server after the kth task line completes calculation successfully every timebCost, pr, representing unit data computation of cloud serverdCost of the unit calculation thread number of the cloud server, bkRepresenting the amount of data computation incurred by each successful completion of the computation by the kth task line, dkRepresents the number of calculation threads, g, opened for each successful completion of the calculation of the kth task linekRepresenting the cost of the cloud server after the kth task line successfully completes the calculation each time; further, local terminal overhead is set
Figure FDA0002807408040000023
Overhead greater than cloud server
Figure FDA0002807408040000024
Taking the maximum comprehensive utility R of the cloud server as a target for constraint conditions, and solving bk，dkAnd pik(ii) a Reference bk，dkAnd pikAnd distributing the computing task to the cloud server, namely obtaining the data computing amount and the computing line born by the cloud server for the kth task line according to the maximization of the comprehensive utility R of the cloud serverThe process number determines the calculation born by the cloud server according to the data calculation amount and the calculation process number;
and distributing the split cloud computing task lines to appropriate cloud servers in a mode of maximally paralleling the local computing task lines and the cloud computing task lines of one data analysis operation requirement.
2. The method of claim 1,
after the data calculation amount and the calculation thread number borne by the cloud server are determined for the cloud server, the cloud task lines split according to each data analysis calculation requirement are determined, the task lines are determined to be allocated to the queuing period faced by the cloud server according to the data calculation amount and the calculation thread number borne by the cloud server, and then the cloud task lines are allocated to the appropriate cloud server under the condition that the local calculation task lines and the cloud calculation task lines are maximally parallel.
3. A system for intelligent city operation based on multi-source task lines is characterized by comprising:
a cloud server for computing the computing task of the cloud task line
The local terminal is used for calculating the calculation task of the local task line;
the task scheduling controller is used for receiving data calculated by the local terminal and the cloud server;
the coordinator is used for splitting any data analysis operation requirement into a local computing task line and one or more cloud computing task lines; determining the data calculation amount and the calculation thread number of the cloud server according to the principle of optimal utility, and further determining the number of task threads capable of being born by the cloud server and the expected completion time of the task threads; distributing the split cloud computing task lines to appropriate cloud servers in a mode that the local computing task lines and the cloud computing task lines of one data analysis operation requirement are maximally parallel; wherein the content of the first and second substances,
the coordinator comprisesA task line splitting module for splitting the data analysis operation requirement into a locally calculated task line MkLAnd/or one or more cloud computing task lines MkC1,MkC2...MkCn...; wherein the local computing task line MkLCorresponding to an operation data amount of DkLOne or more cloud computing task lines MkC1,MkC2...MkCn.., the total corresponding operation data amount is DkC(ii) a Wherein Dk＝εDkL+(1-ε)DkC(ii) a Epsilon represents the splitting ratio of local calculation and cloud calculation, and epsilon is more than or equal to 0 and less than or equal to 1; wherein the local computing task line MkLIs calculated with a time delay of tkLCloud computing task line MkC1,MkC2...MkCn.., the calculated time delays are tkC1,tkC2...tkCn...; the way to calculate the split ratio epsilon is: when the constraint condition is satisfied, i.e. t is more than or equal to 0kL,tkC1,tkC2...tkCn...≤tmaxLet max (t)kL,tkC1,tkC2...tkCn) The minimum ε; wherein t ismaxIs the maximum allowed time delay; on the basis of determining epsilon, determining a task line M of cloud computing splitting according to the number of available cloud serverskC1,MkC2...MkCn..;
the coordinator also comprises a cloud server calculation amount evaluation module which defines the cost of local calculation as
Figure FDA0002807408040000041
Where n is the number of the local terminal,
Figure FDA0002807408040000042
represents the total overhead of the nth local terminal,
Figure FDA0002807408040000043
a weight of the temporal overhead is represented,
Figure FDA0002807408040000044
a time overhead is represented by the time of day,
Figure FDA0002807408040000045
wherein
Figure FDA0002807408040000046
Is the number of calculation threads that can be invoked by the local terminal in local unit time, dnCan be expressed in units of the calculated amount of a single thread per unit time,
Figure FDA0002807408040000047
representing the weight of the overhead of the computational resource,
Figure FDA0002807408040000048
is the overhead of the computational resources and is,
Figure FDA0002807408040000049
wherein
Figure FDA00028074080400000410
Is the computational resource overhead for each computational thread,
Figure FDA00028074080400000411
computational resource overhead in units of data size, bnIs the amount of data processed by the local terminal; the cost of the cloud server for carrying out cloud computing on the computing task uploaded by the nth local terminal is
Figure FDA00028074080400000412
Wherein the content of the first and second substances,
Figure FDA00028074080400000413
representing the time to upload a computing task from the local terminal to the cloud server,
Figure FDA00028074080400000414
representing the computation time of the cloud server,
Figure FDA00028074080400000415
wherein C is the calculation thread number, pi, which can be used by the cloud server in unit timenRepresenting a profit value obtained by the cloud server after completing a calculation task; the comprehensive utility of the cloud server is
Figure FDA00028074080400000416
Wherein R represents the comprehensive utility of the cloud server, K is a task line corresponding to the cloud server, and K task lines are calculated by the cloud server; n is a radical ofkFor the number of successfully completed calculations, π, within the utility statistics window in the kth task linekThe profit value pr obtained by the cloud server after the kth task line completes calculation successfully every timebCost, pr, representing unit data computation of cloud serverdCost of the unit calculation thread number of the cloud server, bkRepresenting the amount of data computation incurred by each successful completion of the computation by the kth task line, dkRepresents the number of calculation threads, g, opened for each successful completion of the calculation of the kth task linekRepresenting the cost of the cloud server after the kth task line successfully completes the calculation each time; further, local terminal overhead is set
Figure FDA00028074080400000417
Overhead greater than cloud server
Figure FDA00028074080400000418
Taking the maximum comprehensive utility R of the cloud server as a target for constraint conditions, and solving bk，dkAnd pik(ii) a Reference bk，dkAnd pikDistributing the computing task to the cloud server, namely obtaining the data computing amount and the computing thread number born by the cloud server for the kth task line according to the maximization of the comprehensive utility R of the cloud server, and according to the dataThe calculation amount and the calculation thread number determine the calculation born by the cloud server.
4. The system of claim 3,
the coordinator also comprises a cloud task line distribution module, and the cloud task line distribution module determines the data calculation amount and the calculation thread number born by the cloud server for the cloud server; and determining the queuing period for allocating the task lines to the cloud server according to the data calculation amount and the calculation thread number born by the cloud server for each cloud task line split according to the data analysis calculation requirements, and allocating the cloud task lines to the appropriate cloud server under the condition that the local calculation task lines and the cloud calculation task lines are maximally parallel.
CN202010225913.9A 2020-03-26 2020-03-26 Intelligent city operation method and system based on multi-source task line Active CN111539863B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202010225913.9A CN111539863B (en) 2020-03-26 2020-03-26 Intelligent city operation method and system based on multi-source task line

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202010225913.9A CN111539863B (en) 2020-03-26 2020-03-26 Intelligent city operation method and system based on multi-source task line

Publications (2)

Publication Number Publication Date
CN111539863A CN111539863A (en) 2020-08-14
CN111539863B true CN111539863B (en) 2021-03-19

Family

ID=71974823

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202010225913.9A Active CN111539863B (en) 2020-03-26 2020-03-26 Intelligent city operation method and system based on multi-source task line

Country Status (1)

Country Link
CN (1) CN111539863B (en)

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112104996A (en) * 2020-09-08 2020-12-18 电子科技大学 Low-cost crowd sensing calculation method applied to shared traffic system

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2017176542A1 (en) * 2016-04-08 2017-10-12 Alcatel-Lucent Usa Inc. Optimal dynamic cloud network control
CN109819032A (en) * 2019-01-24 2019-05-28 中山大学 A kind of base station selected cloud robot task distribution method with computation migration of joint consideration
CN110418416A (en) * 2019-07-26 2019-11-05 东南大学 Resource allocation methods based on multiple agent intensified learning in mobile edge calculations system

Family Cites Families (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN108170523B (en) * 2017-12-28 2021-05-04 合肥工业大学 Random task sequence scheduling method for mobile cloud computing
CN108600299B (en) * 2018-03-02 2021-08-24 中国科学院上海微系统与信息技术研究所 Distributed multi-user computing task unloading method and system
CN108540406B (en) * 2018-07-13 2021-06-08 大连理工大学 Network unloading method based on hybrid cloud computing
CN109474681A (en) * 2018-11-05 2019-03-15 安徽大学 Resource allocation methods, system and the server system of mobile edge calculations server
CN109669768B (en) * 2018-12-11 2023-03-14 北京工业大学 Resource allocation and task scheduling method for edge cloud combined architecture

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2017176542A1 (en) * 2016-04-08 2017-10-12 Alcatel-Lucent Usa Inc. Optimal dynamic cloud network control
CN109819032A (en) * 2019-01-24 2019-05-28 中山大学 A kind of base station selected cloud robot task distribution method with computation migration of joint consideration
CN110418416A (en) * 2019-07-26 2019-11-05 东南大学 Resource allocation methods based on multiple agent intensified learning in mobile edge calculations system

Also Published As

Publication number Publication date
CN111539863A (en) 2020-08-14

Similar Documents

Publication Publication Date Title
Abd Elaziz et al. Advanced optimization technique for scheduling IoT tasks in cloud-fog computing environments
CN110096349B (en) Job scheduling method based on cluster node load state prediction
CN109324875B (en) Data center server power consumption management and optimization method based on reinforcement learning
CN111045828B (en) Distributed edge calculation method based on distribution network area terminal and related device
US9207993B2 (en) Dynamic application placement based on cost and availability of energy in datacenters
Liu et al. Resource preprocessing and optimal task scheduling in cloud computing environments
CN102724103B (en) Proxy server, hierarchical network system and distributed workload management method
Li et al. Adaptive resource allocation based on the billing granularity in edge-cloud architecture
CN103401939A (en) Load balancing method adopting mixing scheduling strategy
CN114816721B (en) Multitask optimization scheduling method and system based on edge calculation
Cheng et al. Heterogeneity aware workload management in distributed sustainable datacenters
CN111539863B (en) Intelligent city operation method and system based on multi-source task line
CN108132840A (en) Resource regulating method and device in a kind of distributed system
CN115794341A (en) Task scheduling method, device, equipment and storage medium based on artificial intelligence
Falah et al. Comparison of cloud computing providers for development of big data and internet of things application
CN114064261A (en) Multi-dimensional heterogeneous resource quantification method and device based on industrial edge computing system
CN117472587A (en) Resource scheduling system of AI intelligent computation center
CN111131447A (en) Load balancing method based on intermediate node task allocation
CN105786626B (en) The Storm platform thread distribution method divided based on K
More et al. Energy-aware VM migration using dragonfly–crow optimization and support vector regression model in Cloud
CN107908459B (en) Cloud computing scheduling system
Naik A deadline-based elastic approach for balanced task scheduling in computing cloud environment
CN113259472A (en) Edge node resource allocation method for video analysis task
CN116048821B (en) High-utilization AI server and resource allocation method thereof
Zhou et al. Resource allocation in cloud computing based on clustering method

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
TA01 Transfer of patent application right

Effective date of registration: 20210210

Address after: 400010 no.50-6, 19 dapingzheng street, Yuzhong District, Chongqing

Applicant after: Light control tesilian (Chongqing) Information Technology Co.,Ltd.

Address before: 401329 no.2-1, building 6, No.39 Xinggu Road, Jiulongpo District, Chongqing

Applicant before: CHONGQING TERMINUS TECHNOLOGIES Co.,Ltd.

TA01 Transfer of patent application right
GR01 Patent grant
GR01 Patent grant