CN115550357A - Multi-agent multi-task cooperative unloading method - Google Patents

Multi-agent multi-task cooperative unloading method Download PDF

Info

Publication number
CN115550357A
CN115550357A CN202211016816.4A CN202211016816A CN115550357A CN 115550357 A CN115550357 A CN 115550357A CN 202211016816 A CN202211016816 A CN 202211016816A CN 115550357 A CN115550357 A CN 115550357A
Authority
CN
China
Prior art keywords
task
vehicle
node
unloading
service node
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN202211016816.4A
Other languages
Chinese (zh)
Other versions
CN115550357B (en
Inventor
曹敦
张应宝
杨逸帆
王进
王磊
邹电
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Changsha University of Science and Technology
Original Assignee
Changsha University of Science and Technology
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Changsha University of Science and Technology filed Critical Changsha University of Science and Technology
Priority to CN202211016816.4A priority Critical patent/CN115550357B/en
Publication of CN115550357A publication Critical patent/CN115550357A/en
Application granted granted Critical
Publication of CN115550357B publication Critical patent/CN115550357B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00Network arrangements or protocols for supporting network services or applications
    • H04L67/01Protocols
    • H04L67/10Protocols in which an application is distributed across nodes in the network
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00Network arrangements or protocols for supporting network services or applications
    • H04L67/01Protocols
    • H04L67/12Protocols specially adapted for proprietary or special-purpose networking environments, e.g. medical networks, sensor networks, networks in vehicles or remote metering networks

Landscapes

  • Engineering & Computer Science (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Signal Processing (AREA)
  • Health & Medical Sciences (AREA)
  • Computing Systems (AREA)
  • General Health & Medical Sciences (AREA)
  • Medical Informatics (AREA)
  • Mobile Radio Communication Systems (AREA)

Abstract

The application discloses a multi-agent multi-task cooperative unloading method, which comprises the following steps: setting a task and a service node thereof; then determining the node type, and then representing the tasks generated by any task vehicle by using triples; then, local computation and multi-service node edge unloading computation are selected for task unloading; on the basis of selecting edge unloading calculation, judging the idle state of a service node of a task vehicle TaV, wherein the service node meets the requirement of serving as the relay node; then, based on the result judgment of the idle state, executing the unloading task in a single-hop unloading mode; and if the idle state does not meet the single-hop unloading condition, unloading the calculation unloading task into an idle service node of the relay node for execution in two hops. According to the technical scheme, in a dynamic vehicle-mounted environment, the problem of multi-vehicle multi-task cooperative unloading conflict can be solved by using limited computing resources of task vehicles and service resources of surrounding spaces, and minimum system average time delay is realized.

Description

一种多智能体多任务协同卸载方法A multi-agent multi-task cooperative unloading method

技术领域technical field

本申请涉及车辆联网通信技术领域,更具体地说,尤其涉及一种多智能体多任务协同卸载方法。The present application relates to the technical field of vehicle networking communication, and more specifically, relates to a multi-agent and multi-task cooperative unloading method.

背景技术Background technique

车辆互联网是一种典型的工业物联网技术,在这种技术中,无需人工干预,车辆之间可以交换和共享无处不在的信息。在车联网环境下,行驶中的车辆每秒产生海量的传感器数据,为了拥有复杂驾驶环境下的智能视野,需要在较短时间内完成大量的数据传输、存储和处理等操作。真实三维盘山公路多任务场景,属于交通事故高发路段,受地形条件和遮挡环境的限制,车辆行驶速度缓慢,RSU信号覆盖存在盲区,因此任务协同卸载显得格外重要。The Internet of Vehicles is a typical Industrial IoT technology in which ubiquitous information can be exchanged and shared between vehicles without human intervention. In the Internet of Vehicles environment, driving vehicles generate massive amounts of sensor data per second. In order to have an intelligent vision in a complex driving environment, it is necessary to complete a large number of data transmission, storage, and processing operations in a relatively short period of time. The multi-task scene of the real 3D winding mountain road is a road section with a high incidence of traffic accidents. Due to the limitation of terrain conditions and occlusion environment, the vehicle speed is slow, and there are blind spots in the RSU signal coverage. Therefore, task collaborative unloading is particularly important.

目前,在现有研究的车辆联网任务协同卸载方案中,存在多方面不足。在卸载协同卸载模型上,大多数的协同卸载模式均采用单进程的卸载模型执行,这样的卸载模式将带来更高的时延,同时信道资源利用率更低;接着在任务拆分方式上,协同卸载的任务类型当前主要为不可拆分和均等拆分,这样的任务拆分方案,往往无法将宿主车辆的服务车辆上的计算资源充分利用;其次在车辆移动状态上,当前卸载的研究过程中车辆都相对处于静止状态,然而对于现实三维道路场景而言,车辆在协同卸载过程中处于运动状态;而更为关键的是:在处理冲突上,当出现多任务多宿主车辆协同卸载场景时,会遇到多个宿主车辆共同竞争一个协同节点这样的问题,出现通信冲突,降低任务卸载效率,增大任务卸载时延,无法为用户提供良好服务质量。At present, there are many deficiencies in the existing research on the cooperative offloading scheme of vehicle networking tasks. In the unloading cooperative unloading model, most of the cooperative unloading modes are executed by a single-process unloading model. Such an unloading mode will bring higher latency and lower channel resource utilization; then in the task splitting method , the task types of collaborative unloading are currently mainly indivisible and equal splitting. Such a task splitting scheme often cannot fully utilize the computing resources on the service vehicle of the host vehicle; secondly, in terms of vehicle movement status, the current unloading research During the process, the vehicles are relatively in a static state, but for the real 3D road scene, the vehicle is in a moving state during the collaborative unloading process; and more critically: in dealing with conflicts, when there is a multi-task multi-host vehicle cooperative unloading scene In this case, multiple host vehicles will compete for a collaborative node, resulting in communication conflicts, reducing the efficiency of task offloading, increasing the delay of task offloading, and failing to provide users with good quality of service.

因此,如何提供一种多智能体多任务协同卸载方法,其在动态车载环境中,能够利用任务车辆有限计算资源和周围空间的服务资源,解决多车辆多任务协同卸载冲突问题,实现最小的系统平均时延,已经成为本领域技术人员亟待解决的技术问题。Therefore, how to provide a multi-agent multi-task cooperative unloading method, which can use the limited computing resources of the mission vehicle and the service resources of the surrounding space in a dynamic vehicle environment to solve the problem of multi-vehicle multi-task cooperative unloading conflicts and achieve the smallest system The average delay has become a technical problem to be solved urgently by those skilled in the art.

发明内容Contents of the invention

为解决上述技术问题,本申请提供一种多智能体多任务协同卸载方法,其在动态车载环境中,能够利用任务车辆有限计算资源和周围空间的服务资源,解决多车辆多任务协同卸载冲突问题,实现最小的系统平均时延。In order to solve the above technical problems, this application provides a multi-agent multi-task cooperative unloading method, which can solve the problem of multi-vehicle multi-task cooperative unloading conflicts by using the limited computing resources of task vehicles and the service resources of the surrounding space in a dynamic vehicle environment , to achieve the minimum average system delay.

本申请提供的技术方案如下:The technical scheme that this application provides is as follows:

本申请提供一种多智能体多任务协同卸载方法,包括以下步骤:S1、设置车辆任务卸载场景:将产生任务的车辆认定为任务车辆TaV;在所述任务车辆最大可容忍时延内始终处于通信范围内,配置为所述任务车辆提供卸载服务的服务节点;S2、确定节点类型:将从属于多个任务车辆TaV通信范围内的服务节点,认定为候选服务节点;当候选服务节点确定为任务车辆TaV中vi的服务节点后,当前候选服务节点可充当剩余任务车辆的候选中继节点;随后从候选中继节点中筛选出可执行两跳卸载的中继节点,以及所述中继节点的服务节点;S3、卸载任务表示:将任意任务车辆vi产生的任务用三元组:

Figure BDA0003812845610000021
表示;其中Di为卸载任务的大小,Ci为任务所需计算资源,Tmaxi为执行任务的最大可容限时延;S4、卸载方式选择:在定义节点状态后,选择本地计算和多服务节点边缘卸载计算进行任务卸载,其中所述边缘卸载计算包括单跳卸载与两跳卸载;S5、执行卸载任务:在选择边缘卸载计算基础上,判断任务车辆TaV中vi的服务节点vj的空闲状态,且所述服务节点vj满足充当所述中继节点的要求;随后基于空闲状态的结果判断,通过所述单跳卸载方式执行卸载任务;若所述空闲状态不满足单跳卸载条件,则将计算卸载任务通过所述两跳卸载到所述中继节点vj的空闲服务节点vk中执行。The application provides a multi-agent and multi-task cooperative unloading method, comprising the following steps: S1, setting the vehicle task unloading scene: identifying the vehicle that generates the task as the task vehicle TaV; within the maximum tolerable time delay of the task vehicle, it is always in Within the communication range, configure a service node that provides unloading services for the task vehicle; S2, determine the node type: identify a service node that is subordinate to multiple task vehicles within the TaV communication range as a candidate service node; when the candidate service node is determined to be After the service node of vi in the task vehicle TaV , the current candidate service node can act as a candidate relay node for the remaining task vehicles; then select the relay node that can perform two-hop offloading from the candidate relay nodes, and the relay node The service node of the node; S3, unloading task representation: the task generated by any task vehicle v i is represented by a triplet:
Figure BDA0003812845610000021
where D i is the size of the offloading task, C i is the computing resource required by the task, and Tmax i is the maximum tolerable delay in executing the task; S4. Selection of offloading method: after defining the node state, select local computing and multi-service Node edge offloading calculations perform task offloading, wherein the edge offloading calculations include single-hop offloading and two-hop offloading; S5, perform offloading tasks: on the basis of selecting edge offloading calculations, determine the service node vj of v i in the task vehicle TaV Idle state, and the service node v j meets the requirements of acting as the relay node; then judge based on the result of the idle state, perform the offloading task through the single-hop offloading method; if the idle state does not meet the single-hop offloading condition , then the computation offloading task is offloaded to the idle service node v k of the relay node v j through the two hops for execution.

进一步地,在本发明一种优选方式中,在所述步骤S4中,还包括:Further, in a preferred manner of the present invention, in the step S4, it also includes:

若选择所述本地计算,即TaV选择使用本地自身的计算资源处理任务时,直接获取本地计算时延

Figure BDA0003812845610000027
If the local computing is selected, that is, when TaV chooses to use its own local computing resources to process tasks, it will directly obtain the local computing delay
Figure BDA0003812845610000027

Figure BDA0003812845610000023
Figure BDA0003812845610000023

其中,

Figure BDA0003812845610000024
表示TaV的本地计算能力,
Figure BDA0003812845610000025
表示本地任务的计算量。in,
Figure BDA0003812845610000024
Indicates the local computing power of the TaV,
Figure BDA0003812845610000025
Indicates the calculation amount of the local task.

进一步地,在本发明一种优选方式中,在所述步骤S4中,所述定义节点状态具体为:使用0-1变量Δi,j表示所述单跳卸载中任务车辆vi的通信范围内服务节点vj的状态:Further, in a preferred manner of the present invention, in the step S4, the definition of the node state is specifically: use the 0-1 variable Δ i, j to represent the communication range of the task vehicle v i in the single-hop unloading The status of the internal service node v j :

Figure BDA0003812845610000026
Figure BDA0003812845610000026

使用0-1变量βj,k表示执行两跳卸载时中继节点vj的服务节点vk的状态:Use the 0-1 variable β j, k to represent the state of the service node v k of the relay node v j when performing two-hop offloading:

Figure BDA0003812845610000031
Figure BDA0003812845610000031

进一步地,在本发明一种优选方式中,在所述步骤S5中,所述执行卸载任务的步骤具体为:Further, in a preferred manner of the present invention, in the step S5, the step of executing the unloading task is specifically:

判断任务车辆TaV中vi的服务节点vj的空闲状态:Judging the idle state of the service node v j of v i in the task vehicle TaV:

若所述任务车辆vi的服务节点vj处于空闲状态,即αi,j=0;通过单跳卸载将任务直接卸载到服务节点vj中进行计算,获取单跳计算时延;If the service node v j of the task vehicle v i is in an idle state, i.e. α i, j =0; the task is directly unloaded to the service node v j for calculation by single-hop unloading, and the single-hop calculation delay is obtained;

Figure BDA00038128456100000316
Figure BDA00038128456100000316

其中,

Figure BDA0003812845610000033
为任务车辆vi向服务节点vj分配的子计算任务;ri,j为vi传输计算任务到vj的上传速率;μ1为通信过程中的重叠因子,表示能被执行卸载到边缘节点数据比例;
Figure BDA0003812845610000034
表示服务节点vj给任务车辆车辆vi分配的算力;in,
Figure BDA0003812845610000033
is the subcomputing task assigned by the task vehicle v i to the service node v j ; r i,j is the upload rate of vi i transmitting the computing task to v j ; μ 1 is the overlap factor in the communication process, indicating that it can be executed and offloaded to the edge Node data ratio;
Figure BDA0003812845610000034
Indicates the computing power allocated by the service node v j to the task vehicle v i ;

若所述任务车辆vi的服务节点vj处于占用状态,即αi,j=1,说明服务节点vj已被其余TaV选定为服务节点;在服务节点vj满足充当中继节点的要求下,将节点vj作为中继节点通过两跳卸载至其空闲的服务节点vk执行卸载计算任务,即βj,k=0;随后获取两跳计算时延:If the service node v j of the task vehicle v i is in the occupied state, i.e. α i, j = 1, it means that the service node v j has been selected as the service node by the remaining TaV; Under the requirement, the node v j as a relay node is offloaded to its idle service node v k through two hops to perform unloaded calculation tasks, that is, β j, k = 0; then obtain the two-hop calculation delay:

Figure BDA0003812845610000035
Figure BDA0003812845610000035

其中,

Figure BDA0003812845610000036
表示vi将计算子任务
Figure BDA0003812845610000037
上传到中继节点vj
Figure BDA0003812845610000038
表示中继节点vj将计算任务
Figure BDA0003812845610000039
两跳卸载到中继节点vj的服务节点vk;Vt表示为任务车辆TaV的集合;Vs表示为服务节点的集合。in,
Figure BDA0003812845610000036
Indicates that v i will compute subtasks
Figure BDA0003812845610000037
Upload to relay node v j ;
Figure BDA0003812845610000038
Indicates that the relay node v j will calculate the task
Figure BDA0003812845610000039
Two hops are offloaded to the service node v k of the relay node v j ; Vt is represented as a collection of task vehicles TaV; Vs is represented as a collection of service nodes.

进一步地,在本发明一种优选方式中,步骤S2中,在完成所述确定节点类型后,还包括:构建车辆运动模型,通过任务车辆vα在t时刻的位置信息

Figure BDA00038128456100000310
预估t+Δt时刻的位置信息
Figure BDA00038128456100000311
Further, in a preferred manner of the present invention, in step S2, after completing the determination of the node type, it also includes: constructing a vehicle motion model, and passing the position information of the task vehicle v α at time t
Figure BDA00038128456100000310
Estimated position information at time t+Δt
Figure BDA00038128456100000311

进一步地,在本发明一种优选方式中,构建车辆运动模型,预估位置信息

Figure BDA00038128456100000312
的步骤具体包括:Further, in a preferred mode of the present invention, a vehicle motion model is constructed to estimate position information
Figure BDA00038128456100000312
The steps specifically include:

S1、获取任务车辆vα在t时刻速度

Figure BDA00038128456100000313
与x轴、y轴与z轴之夹角分别为θx,θy,θz∈[0,π];S1. Obtain the speed of the task vehicle v α at time t
Figure BDA00038128456100000313
The included angles with the x-axis, y-axis and z-axis are θ x , θ y , θ z ∈ [0, π];

S2、根据所述速度

Figure BDA00038128456100000314
和夹角获取速度
Figure BDA00038128456100000315
在x轴、y轴与z轴的速度分量;S2. According to the speed
Figure BDA00038128456100000314
and the included angle to get the velocity
Figure BDA00038128456100000315
Velocity components on the x-axis, y-axis and z-axis;

Figure BDA0003812845610000041
Figure BDA0003812845610000041

S3、随后通过方向余弦定理获取车辆运行Δt后,任务车辆vα在x轴、y轴与z轴方向上行驶的距离分量;S3. Then obtain the distance components of the task vehicle v α traveling in the x-axis, y-axis and z-axis directions after the vehicle runs Δt through the direction cosine theorem;

由方向余弦定理可得cos2θx+cos2θy+cos2θz=1,即:According to the law of direction cosines, cos 2 θ x +cos 2 θ y +cos 2 θ z = 1, that is:

Figure BDA0003812845610000042
Figure BDA0003812845610000042

S4、随后运用L2范数计算得出任务车辆vα到vβ在任何时刻的欧式距离:S4. Then use the L2 norm to calculate the Euclidean distance from the task vehicle v α to v β at any time:

Figure BDA0003812845610000043
which is
Figure BDA0003812845610000043

进一步地,在本发明一种优选方式中,在所述步骤S2确定节点类型中,还包括:基于任务车辆来对车辆行驶道路进行分簇,其边缘服务器设有N+1个,任务车辆Vt设有M个,以此进行多任务车辆的服务节点聚类;Further, in a preferred manner of the present invention, in the step S2 determining the node type, it also includes: clustering the vehicle driving road based on the task vehicle, and there are N+1 edge servers, and the task vehicle Vt There are M, so as to cluster the service nodes of multi-tasking vehicles;

其中所述服务节点聚类的步骤具体包括:Wherein, the steps of clustering service nodes specifically include:

S1、从车辆集合V={v0,v1,v2,...,vN}中随机选取M个任务车辆作为质心;S1. Randomly select M mission vehicles from the vehicle set V={v 0 , v 1 , v 2 ,..., v N } as centroids;

S2、在服务节点中进行取样,计算每个样本到M个质心的欧式距离;S2. Sampling is performed in the service node, and the Euclidean distance from each sample to M centroids is calculated;

S3、如果样本在Δt∈[0~Tmaxi]任意时刻到质心的欧式距离

Figure BDA0003812845610000044
进入后续步骤;其中R为设于道路为所有设备提供服务的路边单元RSU的覆盖半径;S3. If the Euclidean distance from the sample to the centroid at any time Δt∈[0~Tmax i ]
Figure BDA0003812845610000044
Enter the next step; where R is the coverage radius of the RSU located on the road to provide services for all equipment;

S4、如果样本处于多个质心的通信范围内,αi,j=1则将此样本作为获选服务节点;否则αi,j=0,将此样本划分到此质心所对应的簇中;S4. If the sample is within the communication range of multiple centroids, α i, j = 1, then use this sample as the selected service node; otherwise, α i, j = 0, divide this sample into the cluster corresponding to this centroid;

S5、最后输出聚类结果,得到任务车辆的服务节点集合Vs。S5. Finally output the clustering result to obtain the service node set Vs of the mission vehicle.

进一步地,在本发明一种优选方式中,在步骤S4卸载方式选择前,还包括:构建通信模型,获取通信上传链路的速率;其步骤具体包括:Further, in a preferred mode of the present invention, before the selection of the unloading mode in step S4, it also includes: constructing a communication model, and obtaining the rate of the communication upload link; the steps specifically include:

S1、设定任务车辆与服务节点的通信模式:短程无线通信方式;采用正交频率减少通信过程中的相互影响;S1. Set the communication mode between the mission vehicle and the service node: short-range wireless communication; use orthogonal frequencies to reduce mutual influence during communication;

S2、将通信过程中上传链路设定为平坦瑞利衰落信道,不考虑信道干扰;S2. Set the upload link in the communication process as a flat Rayleigh fading channel, regardless of channel interference;

S3、随后根据香农公式可以计算出任务车辆vi到服务节点vj上传链路的平均传输速率:S3. Then, according to the Shannon formula, the average transmission rate of the upload link from the mission vehicle v i to the service node v j can be calculated:

Figure BDA0003812845610000051
Figure BDA0003812845610000051

其中,*可为v2v或者v2r,Wv2v和Wv2r分别表示V2V和V2R信道带宽;Pi是任务车辆vi的发射功率,ρ0表示白高斯噪声功率,di,j是vi到vj的传输距离;

Figure BDA0003812845610000056
代表路径损耗指数;信道衰落系数用h表示。Among them, * can be v2v or v2r, W v2v and W v2r represent the channel bandwidth of V2V and V2R respectively; Pi is the transmission power of the mission vehicle v i , ρ 0 represents the white Gaussian noise power, and d i, j are v i to v j transmission distance;
Figure BDA0003812845610000056
Represents the path loss index; the channel fading coefficient is represented by h.

进一步地,在本发明一种优选方式中,在所述步骤S3卸载任务表示前,还包括任务分配:确定所述任务车辆分配给服务节点的不等任务集C。Further, in a preferred manner of the present invention, before the task representation is unloaded in step S3, task assignment is also included: determining the unequal task set C assigned to the service node by the task vehicle.

进一步地,在本发明一种优选方式中,所述任务分配的具体步骤包括:Further, in a preferred manner of the present invention, the specific steps of task assignment include:

S1、设定目标函数,所述目标函数旨在求解多车辆多任务卸载的计算时延问题;S1. Setting an objective function, the objective function aims to solve the calculation time delay problem of multi-vehicle multi-task unloading;

S2、将所述目标函数转化为边缘节点卸载和本地计算并行差值绝对值

Figure BDA0003812845610000052
最小化问题,即
Figure BDA0003812845610000053
越靠近0代表并行程度越高;转化后目标函数为:S2. Transform the objective function into the absolute value of edge node unloading and local calculation parallel difference
Figure BDA0003812845610000052
The minimization problem is
Figure BDA0003812845610000053
The closer to 0, the higher the degree of parallelism; the transformed objective function is:

Figure BDA0003812845610000054
Figure BDA0003812845610000054

其中,C表示不等拆分的计算子任务;约束条件C1表示本地和卸载计算子任务的约束边界;C2表示在任务最大容忍时限Tmaxi内任务车辆vi到服务节点vj之间的相对欧式距离小于或等于vi的通信范围R;C3表示本地和多服务节点卸载计算子任务之和等于任务车辆vi的总计算任务

Figure BDA0003812845610000055
Among them, C represents the computing subtasks that are not equally split; the constraint condition C 1 represents the constraint boundary of the local and offloaded computing subtasks; C 2 represents the distance between the task vehicle v i and the service node v j within the task maximum tolerance time limit Tmax i The relative Euclidean distance of is less than or equal to the communication range R of vi ; C 3 means that the sum of the local and multi-service node offloaded computing subtasks is equal to the total computing task of the task vehicle vi
Figure BDA0003812845610000055

S3、随后利用差分进化算法进行将卸载任务分配给所述服务节点。S3. Then use the differential evolution algorithm to assign the offloading task to the service node.

本发明提供的一种多智能体多任务协同卸载方法,与现有技术相比,包括以下步骤:S1、设置车辆任务卸载场景:将产生任务的车辆认定为任务车辆TaV;在所述任务车辆最大可容忍时延内始终处于通信范围内,配置为所述任务车辆提供卸载服务的服务节点;S2、确定节点类型:将从属于多个任务车辆TaV通信范围内的服务节点,认定为候选服务节点;当候选服务节点确定为任务车辆TaV中vi的服务节点后,当前候选服务节点可充当剩余任务车辆的候选中继节点;随后从候选中继节点中筛选出可执行两跳卸载的中继节点,以及所述中继节点的服务节点;S3、卸载任务表示:将任意任务车辆vi产生的任务用三元组:

Figure BDA0003812845610000061
表示;其中Di为卸载任务的大小,Ci为任务所需计算资源,Tmaxi为执行任务的最大可容限时延;S4、卸载方式选择:在定义节点状态后,选择本地计算和多服务节点边缘卸载计算进行任务卸载,其中所述边缘卸载计算包括单跳卸载与两跳卸载;S5、执行卸载任务:在选择边缘卸载计算基础上,判断任务车辆TaV中vi的服务节点vj的空闲状态,且所述服务节点vj满足充当所述中继节点的要求;随后基于空闲状态的结果判断,通过所述单跳卸载方式执行卸载任务;若所述空闲状态不满足单跳卸载条件,则将计算卸载任务通过所述两跳卸载到所述中继节点vj的空闲服务节点vk中执行。利用本申请提供的多智能体多任务协同卸载方法,当出现有限计算资源和用户需要体验之间的矛盾,通过本地执行和多服务节点多跳分布式卸载执行并行计算任务,在保障用户服务需求的前提下,充分利用了任务车辆本身的计算资源和周围空间的服务资源,实现最小系统整体的计算时延。在任务车辆数较大的情况时,采用多跳分布式卸载相比传统的单跳单节点卸载系统整体时延更优。本申请公开的技术方案,其能够利用任务车辆有限计算资源和周围空间的服务资源,解决多车辆多任务协同卸载冲突问题,实现最小的系统平均时延。Compared with the prior art, a multi-agent and multi-task cooperative unloading method provided by the present invention includes the following steps: S1, setting a vehicle task unloading scene: identifying the vehicle that generates the task as a task vehicle TaV; The maximum tolerable time delay is always within the communication range, and configured as a service node that provides unloading services for the task vehicle; S2. Determine the node type: identify service nodes that belong to multiple task vehicles within the communication range of the TaV as candidate services node; when the candidate service node is determined to be the service node of vi in the task vehicle TaV , the current candidate service node can act as a candidate relay node for the remaining task vehicles; then the intermediate node that can perform two-hop unloading is selected from the candidate relay nodes Relay node, and the service node of the relay node; S3, unloading task representation: the task that any task vehicle v i produces is triplet:
Figure BDA0003812845610000061
where D i is the size of the offloading task, C i is the computing resource required by the task, and Tmax i is the maximum tolerable delay in executing the task; S4. Selection of offloading method: after defining the node state, select local computing and multi-service Node edge offloading calculations perform task offloading, wherein the edge offloading calculations include single-hop offloading and two-hop offloading; S5, perform offloading tasks: on the basis of selecting edge offloading calculations, determine the service node vj of v i in the task vehicle TaV Idle state, and the service node v j meets the requirements of acting as the relay node; then judge based on the result of the idle state, perform the offloading task through the single-hop offloading method; if the idle state does not meet the single-hop offloading condition , then the computation offloading task is offloaded to the idle service node v k of the relay node v j through the two hops for execution. Using the multi-agent multi-task cooperative unloading method provided by this application, when there is a contradiction between limited computing resources and user needs, parallel computing tasks are executed through local execution and multi-hop distributed offloading of multi-service nodes, ensuring user service needs Under the premise of the system, the computing resources of the task vehicle itself and the service resources of the surrounding space are fully utilized to achieve the minimum overall system computing delay. When the number of mission vehicles is large, the overall delay of the multi-hop distributed offloading system is better than that of the traditional single-hop single-node offloading system. The technical solution disclosed in this application can utilize the limited computing resources of mission vehicles and the service resources of the surrounding space to solve the problem of multi-vehicle multi-tasking cooperative unloading conflicts and achieve the minimum average system delay.

有益效果:Beneficial effect:

1、本申请提供的多智能体多任务协同卸载方法,能够多任务多节点采用多跳串行卸载分布式执行的卸载策略,解决多车辆多任务协同卸载冲突问题;1. The multi-agent multi-task cooperative unloading method provided by this application can adopt multi-hop serial unloading distributed execution unloading strategy for multi-task and multi-node, and solve the problem of multi-vehicle multi-task cooperative unloading conflict;

2、本申请提供的多智能体多任务协同卸载方法,在解决多任务优化卸载问题具有很明显的低时延特性,实现三维道路场景下车辆移动轨迹的预测;2. The multi-agent and multi-task cooperative unloading method provided by this application has obvious low-latency characteristics in solving the problem of multi-task optimization unloading, and realizes the prediction of vehicle movement trajectories in three-dimensional road scenes;

3、本申请提供的多智能体多任务协同卸载方法,基于差分进化算法将任务车辆的卸载任务分配给服务节点,在解决任务不等拆分的这种高维非线性问题时,具有良好的收敛性。3. The multi-agent and multi-task cooperative unloading method provided by this application distributes the unloading tasks of the task vehicles to the service nodes based on the differential evolution algorithm, and has good convergence when solving the high-dimensional nonlinear problem of unequal splitting of tasks. .

附图说明Description of drawings

为了更清楚地说明本申请实施例或现有技术中的技术方案,下面将对实施例或现有技术描述中所需要使用的附图作简单地介绍,显而易见地,下面描述中的附图仅仅是本申请的一些实施例,对于本领域普通技术人员来讲,在不付出创造性劳动的前提下,还可以根据这些附图获得其他的附图。In order to more clearly illustrate the technical solutions in the embodiments of the present application or the prior art, the following will briefly introduce the drawings that need to be used in the description of the embodiments or the prior art. Obviously, the accompanying drawings in the following description are only These are some embodiments of the present application. Those skilled in the art can also obtain other drawings based on these drawings without creative work.

图1为本发明实施例提供的多智能体多任务协同卸载方法的步骤流程图;Fig. 1 is a flow chart of the steps of the multi-agent multi-task cooperative unloading method provided by the embodiment of the present invention;

图2为本发明实施例提供的聚类算法求解服务节点的框架流程图;Fig. 2 is a framework flowchart of a clustering algorithm solving service node provided by an embodiment of the present invention;

图3为本发明实施例提供的服务节点集合第一聚类结构示意图;FIG. 3 is a schematic diagram of a first clustering structure of a service node set provided by an embodiment of the present invention;

图4为本发明实施例提供的服务节点集合第二聚类结构示意图;FIG. 4 is a schematic diagram of a second clustering structure of a service node set provided by an embodiment of the present invention;

图5为本发明实施例提供的服务节点集合第三聚类结构示意图;FIG. 5 is a schematic diagram of a third clustering structure of a service node set provided by an embodiment of the present invention;

图6为本发明实施例提供的任务卸载计算时延对比图。FIG. 6 is a comparison chart of task offloading calculation delays provided by an embodiment of the present invention.

具体实施方式detailed description

为了使本领域的技术人员更好地理解本申请中的技术方案,下面将结合本申请实施例中的附图对本申请实施例中的技术方案进行清楚、完整地描述,显然,所描述的实施例仅仅是本申请的一部分实施例,而不是全部的实施例。基于本申请中的实施例,本领域普通技术人员在没有做出创造性劳动前提下所获得的所有其他实施例,都属于本申请保护的范围。In order to enable those skilled in the art to better understand the technical solution in the application, the technical solution in the embodiment of the application will be clearly and completely described below in conjunction with the drawings in the embodiment of the application. Obviously, the described implementation Examples are only some of the embodiments of the present application, but not all of them. Based on the embodiments in this application, all other embodiments obtained by persons of ordinary skill in the art without making creative efforts belong to the scope of protection of this application.

需要说明的是,当元件被称为“固定于”或“设置于”另一个元件上,它可以直接在另一个元件上或者间接设置在另一个元件上;当一个元件被称为是“连接于”另一个元件,它可以是直接连接到另一个元件或间接连接至另一个元件上。It should be noted that when an element is referred to as being "fixed" or "disposed on" another element, it may be directly disposed on another element or indirectly disposed on another element; when an element is referred to as being "connected" It may be directly connected to another element or indirectly connected to another element.

需要理解的是,术语“长度”、“宽度”、“上”、“下”、“前”、“后”、“第一”、“第二”、“竖直”、“水平”、“顶”、“底”、“内”、“外”等指示的方位或位置关系为基于附图所示的方位或位置关系,仅是为了便于描述本申请和简化描述,而不是指示或暗示所指的装置或元件必须具有特定的方位、以特定的方位构造和操作,因此不能理解为对本申请的限制。It is to be understood that the terms "length", "width", "upper", "lower", "front", "rear", "first", "second", "vertical", "horizontal", " The orientations or positional relationships indicated by "top", "bottom", "inner", "outer", etc. are based on the orientations or positional relationships shown in the drawings, and are only for the convenience of describing the application and simplifying the description, rather than indicating or implying the It should not be construed as limiting the application to indicate that a device or element must have a particular orientation, be constructed, and operate in a particular orientation.

此外,术语“第一”、“第二”仅用于描述目的,而不能理解为指示或暗示相对重要性或者隐含指明所指示的技术特征的数量。由此,限定有“第一”、“第二”的特征可以明示或者隐含地包括一个或者更多个该特征。在本申请的描述中,“多个”、“若干个”的含义是两个或两个以上,除非另有明确具体的限定。In addition, the terms "first" and "second" are used for descriptive purposes only, and cannot be interpreted as indicating or implying relative importance or implicitly specifying the quantity of indicated technical features. Thus, a feature defined as "first" and "second" may explicitly or implicitly include one or more of these features. In the description of the present application, the meanings of "plurality" and "several" are two or more, unless otherwise specifically defined.

须知,本说明书附图所绘示的结构、比例、大小等,均仅用以配合说明书所揭示的内容,以供熟悉此技术的人士了解与阅读,并非用以限定本申请可实施的限定条件,故不具技术上的实质意义,任何结构的修饰、比例关系的改变或大小的调整,在不影响本申请所能产生的功效及所能达成的目的下,均应仍落在本申请所揭示的技术内容得能涵盖的范围内。It should be noted that the structures, proportions, sizes, etc. shown in the drawings of this specification are only used to match the content disclosed in the specification, for those who are familiar with this technology to understand and read, and are not used to limit the conditions that this application can implement , so it has no technical substantive meaning, and any modification of structure, change of proportional relationship or adjustment of size shall still fall within the scope of the disclosure disclosed in this application without affecting the effect and purpose of this application. The technical content must be within the scope covered.

本发明提供的一种多智能体多任务协同卸载方法,包括以下步骤:S1、设置车辆任务卸载场景:将产生任务的车辆认定为任务车辆TaV;在所述任务车辆最大可容忍时延内始终处于通信范围内,配置为所述任务车辆提供卸载服务的服务节点;S2、确定节点类型:将从属于多个任务车辆TaV通信范围内的服务节点,认定为候选服务节点;当候选服务节点确定为任务车辆TaV中vi的服务节点后,当前候选服务节点可充当剩余任务车辆的候选中继节点;随后从候选中继节点中筛选出可执行两跳卸载的中继节点,以及所述中继节点的服务节点;S3、卸载任务表示:将任意任务车辆vi产生的任务用三元组:

Figure BDA0003812845610000081
表示;其中Di为卸载任务的大小,Ci为任务所需计算资源,Tmaxi为执行任务的最大可容限时延;S4、卸载方式选择:在定义节点状态后,选择本地计算和多服务节点边缘卸载计算进行任务卸载,其中所述边缘卸载计算包括单跳卸载与两跳卸载;S5、执行卸载任务:在选择边缘卸载计算基础上,判断任务车辆TaV中vi的服务节点vj的空闲状态,且所述服务节点vj满足充当所述中继节点的要求;随后基于空闲状态的结果判断,通过所述单跳卸载方式执行卸载任务;若所述空闲状态不满足单跳卸载条件,则将计算卸载任务通过所述两跳卸载到所述中继节点vj的空闲服务节点vk中执行。本发明提供一种多智能体多任务协同卸载方法,其能够利用任务车辆有限计算资源和周围空间的服务资源,解决多车辆多任务协同卸载冲突问题,实现最小的系统平均时延。A multi-agent and multi-task cooperative unloading method provided by the present invention includes the following steps: S1, setting a vehicle task unloading scene: identifying the vehicle that generates the task as a task vehicle TaV; always within the maximum tolerable time delay of the task vehicle Within the communication range, configure a service node that provides unloading services for the task vehicle; S2, determine the node type: identify a service node that is subordinate to a plurality of task vehicles within the TaV communication range as a candidate service node; when the candidate service node is determined After serving as the service node of vi in the task vehicle TaV , the current candidate service node can act as the candidate relay node of the remaining task vehicles; then select the relay node that can perform two-hop offloading from the candidate relay nodes, and the The service node of the successor node; S3, unloading task representation: the task generated by any task vehicle v i is represented by a triplet:
Figure BDA0003812845610000081
where D i is the size of the offloading task, C i is the computing resource required by the task, and Tmax i is the maximum tolerable delay in executing the task; S4. Selection of offloading method: after defining the node state, select local computing and multi-service Node edge offloading calculations perform task offloading, wherein the edge offloading calculations include single-hop offloading and two-hop offloading; S5, perform offloading tasks: on the basis of selecting edge offloading calculations, determine the service node vj of v i in the task vehicle TaV Idle state, and the service node v j meets the requirements of acting as the relay node; then judge based on the result of the idle state, perform the offloading task through the single-hop offloading method; if the idle state does not meet the single-hop offloading condition , then the computation offloading task is offloaded to the idle service node v k of the relay node v j through the two hops for execution. The invention provides a multi-agent and multi-task cooperative unloading method, which can solve the problem of multi-vehicle multi-task cooperative unloading conflicts by utilizing the limited computing resources of task vehicles and service resources in the surrounding space, and realize the minimum average system delay.

如图1至图6所示,以下结合具体实施例对本申请公开的一种多智能体多任务协同卸载方法的步骤流程进行具体阐述。As shown in FIG. 1 to FIG. 6 , the steps and flow of a multi-agent and multi-task cooperative offloading method disclosed in the present application will be described in detail below in conjunction with specific embodiments.

本申请以湖北恩施十拐弯作为具体实施例,提出一种多智能体多任务协同卸载方法,具体包括以下步骤:This application takes Enshi, Hubei as a specific example, and proposes a multi-agent multi-task cooperative unloading method, which specifically includes the following steps:

S1、设置车辆任务卸载场景:将产生任务的车辆认定为任务车辆TaV;在所述任务车辆最大可容忍时延内始终处于通信范围内,配置为所述任务车辆提供卸载服务的服务节点。S1. Setting the vehicle task offloading scenario: identify the vehicle that generates the task as the task vehicle TaV; the task vehicle is always within the communication range within the maximum tolerable time delay, and is configured as a service node that provides offloading services for the task vehicle.

其中,在本申请实施例中,将十拐弯道路作为卸载场景;首先在道路上部署有一个覆盖半径为R,并且可同时为所有设备提供服务的路边单元(Road Side Unit,RSU),该RSU上部署了MEC服务器,标示v0。用集合V={v1,v2,...,vN}表示RSU覆盖范围内N辆呈泊松分布的车载终端,并且每辆车载终端内都装有北斗卫星导航系统(BDS)等定位设备,可通过此设备实时获取到车辆的轨迹信息;产生任务的车辆称为任务车辆(Task Vehicle,TaV),表示为集合

Figure BDA0003812845610000091
TaV通信范围内且可提供服务的车辆和RSU,统称为服务节点(ServiceNodes,SN),用集合
Figure BDA0003812845610000092
表示。集合
Figure BDA0003812845610000093
标示道路所有车辆的实时轨迹信息,第α辆车在第t时刻的轨迹信息为
Figure BDA0003812845610000094
其中
Figure BDA0003812845610000095
为速度,
Figure BDA0003812845610000096
为第α辆车的位置坐标。Among them, in the embodiment of this application, the ten-turn road is used as the unloading scene; firstly, a Road Side Unit (Road Side Unit, RSU) with a coverage radius of R and which can provide services for all devices at the same time is deployed on the road. The MEC server is deployed on the RSU, marked v 0 . Use the set V={v 1 , v 2 ,...,v N } to represent N vehicle-mounted terminals with a Poisson distribution within the coverage of the RSU, and each vehicle-mounted terminal is equipped with a Beidou satellite navigation system (BDS), etc. Positioning equipment, through which the trajectory information of the vehicle can be obtained in real time; the vehicle that generates the task is called a task vehicle (Task Vehicle, TaV), expressed as a set
Figure BDA0003812845610000091
Vehicles and RSUs that are within the communication range of TaV and can provide services are collectively referred to as service nodes (ServiceNodes, SN).
Figure BDA0003812845610000092
express. gather
Figure BDA0003812845610000093
The real-time trajectory information of all vehicles on the marked road, the trajectory information of the αth vehicle at the time t is
Figure BDA0003812845610000094
in
Figure BDA0003812845610000095
for speed,
Figure BDA0003812845610000096
is the position coordinate of the αth car.

S2、确定节点类型:将从属于多个任务车辆TaV通信范围内的服务节点,认定为候选服务节点;当候选服务节点确定为任务车辆TaV中vi的服务节点后,当前候选服务节点可充当剩余任务车辆的候选中继节点;随后从候选中继节点中筛选出可执行两跳卸载的中继节点,以及所述中继节点的服务节点。S2. Determine the node type: identify the service nodes that belong to the communication range of multiple task vehicles TaV as candidate service nodes; when the candidate service node is determined to be the service node of vi in the task vehicle TaV , the current candidate service node can act as Candidate relay nodes for the remaining task vehicles; then select relay nodes capable of performing two-hop offloading from the candidate relay nodes, and the service nodes of the relay nodes.

其中,当SN从属于多个任务车辆TaV的通信范围内时的交集车辆,统称为候选服务节点(Candidate service Nodes,CsN),用集合

Figure BDA0003812845610000097
当候选服务节点已确定为TaV vi的服务节点后,当前候选服务节点可充当剩余任务车辆(Vs-{vi})的候选中继节点(Candidate relay Nodes,CrN),用集合
Figure BDA0003812845610000098
随后通过从CrN中进一步筛选出可执行两跳卸载的中继节点(Relay Nodes,RN),用集合
Figure BDA0003812845610000099
中继节点的服务节点(Relay service Nodes,RsN),用集合
Figure BDA00038128456100000910
Among them, when the SN belongs to the communication range of multiple task vehicles TaV, the intersection vehicles are collectively referred to as candidate service nodes (Candidate service Nodes, CsN).
Figure BDA0003812845610000097
When the candidate service node has been determined as the service node of TaV v i , the current candidate service node can act as the candidate relay node (Candidate relay Nodes, CrN) of the remaining mission vehicles (Vs-{v i }), using the set
Figure BDA0003812845610000098
Then, by further screening out the relay nodes (Relay Nodes, RN) that can perform two-hop offloading from CrN, use the set
Figure BDA0003812845610000099
The service node of the relay node (Relay service Nodes, RsN), uses the collection
Figure BDA00038128456100000910

具体地,在本发明的实施例中,所述多智能体多任务协同卸载方法还包括:在完成所述确定节点类型后,还包括:构建车辆运动模型,通过任务车辆vα在t时刻的位置信息

Figure BDA00038128456100000911
预估t+Δt时刻的位置信息
Figure BDA00038128456100000912
Specifically, in an embodiment of the present invention, the multi-agent multi-task cooperative unloading method further includes: after completing the determination of the node type, it also includes: constructing a vehicle motion model, through the task vehicle v α at time t location information
Figure BDA00038128456100000911
Estimated position information at time t+Δt
Figure BDA00038128456100000912

具体地,在本发明的实施例中,构建车辆运动模型,预估位置信息

Figure BDA00038128456100000913
的步骤具体包括:S1、获取任务车辆vα在t时刻速度
Figure BDA00038128456100000914
与x轴、y轴与z轴之夹角分别为θx,θy,θz∈[0,π];Specifically, in the embodiment of the present invention, a vehicle motion model is constructed to estimate position information
Figure BDA00038128456100000913
The steps specifically include: S1. Obtain the speed of task vehicle v α at time t
Figure BDA00038128456100000914
The included angles with the x-axis, y-axis and z-axis are θ x , θ y , θ z ∈ [0, π];

S2、根据所述速度

Figure BDA00038128456100000915
和夹角获取速度
Figure BDA00038128456100000916
在x轴、y轴与z轴的速度分量;S2. According to the speed
Figure BDA00038128456100000915
and the included angle to get the velocity
Figure BDA00038128456100000916
Velocity components on the x-axis, y-axis and z-axis;

Figure BDA00038128456100000917
Figure BDA00038128456100000917

S3、随后通过方向余弦定理获取车辆运行Δt后,任务车辆vα在x轴、y轴与z轴方向上行驶的距离分量;S3. Then obtain the distance components of the task vehicle v α traveling in the x-axis, y-axis and z-axis directions after the vehicle runs Δt through the direction cosine theorem;

由方向余弦定理可得cos2θx+cos2θy+cos2θz=1,According to the law of direction cosines, cos 2 θ x +cos 2 θ y +cos 2 θ z = 1,

即:which is:

Figure BDA0003812845610000101
Figure BDA0003812845610000101

S4、随后运用L2范数计算得出任务车辆vα到vβ在任何时刻的欧式距离:S4. Then use the L2 norm to calculate the Euclidean distance from the task vehicle v α to v β at any time:

Figure BDA0003812845610000102
Figure BDA0003812845610000102

S3、卸载任务表示:将任意任务车辆vi产生的任务用三元组:

Figure BDA0003812845610000103
Figure BDA0003812845610000104
表示;其中Di为卸载任务的大小,Ci为任务所需计算资源,Tmaxi为执行任务的最大可容限时延。S3. Unloading task representation: the task generated by any task vehicle v i is represented by a triplet:
Figure BDA0003812845610000103
Figure BDA0003812845610000104
where D i is the size of the unloaded task, C i is the computing resource required by the task, and Tmax i is the maximum tolerable time delay for executing the task.

具体地,在本发明实施例中,所述多智能体多任务协同卸载方法还包括:构建通信模型,获取通信上传链路的速率;其步骤具体包括:Specifically, in the embodiment of the present invention, the multi-agent multi-task cooperative unloading method further includes: constructing a communication model, and obtaining the rate of the communication upload link; the steps specifically include:

S1、设定任务车辆与服务节点的通信模式:短程无线通信方式;采用正交频率减少通信过程中的相互影响;S1. Set the communication mode between the mission vehicle and the service node: short-range wireless communication; use orthogonal frequencies to reduce mutual influence during communication;

S2、将通信过程中上传链路设定为平坦瑞利衰落信道,不考虑信道干扰;S2. Set the upload link in the communication process as a flat Rayleigh fading channel, regardless of channel interference;

S3、随后根据香农公式可以计算出任务车辆vi到服务节点vj上传链路的平均传输速率:S3. Then, according to the Shannon formula, the average transmission rate of the upload link from the mission vehicle v i to the service node v j can be calculated:

Figure BDA0003812845610000105
Figure BDA0003812845610000105

其中,*可为v2v或者v2r,Wv2v和Wv2r分别表示V2V和V2R信道带宽;Pi是任务车辆vi的发射功率,ρ0表示白高斯噪声功率,di,j是vi到vj的传输距离;

Figure BDA0003812845610000106
代表路径损耗指数;信道衰落系数用h表示。Among them, * can be v2v or v2r, W v2v and W v2r represent the channel bandwidth of V2V and V2R respectively; P i is the transmission power of task vehicle v i , ρ 0 represents the white Gaussian noise power, and d i, j are v i to v The transmission distance of j ;
Figure BDA0003812845610000106
Represents the path loss index; the channel fading coefficient is represented by h.

在实施例中,车与车和车与RSU之间的通信采用短程无线通信方式中的IEEE802.11协议。在通信过程中采用正交频率,可以减少通信过程中的相互影响。将通信过程中的上传链路设定为平坦瑞利衰落信道,不考虑信道干扰。In the embodiment, the communication between the vehicle and the vehicle and the RSU adopts the IEEE802.11 protocol in the short-range wireless communication mode. The use of orthogonal frequencies in the communication process can reduce the mutual influence in the communication process. The upload link in the communication process is set as a flat Rayleigh fading channel, regardless of channel interference.

S4、卸载方式选择:在定义节点状态后,选择本地计算和多服务节点边缘卸载计算进行任务卸载,其中所述边缘卸载计算包括单跳卸载与两跳卸载。S4. Selection of offloading mode: After defining the node state, select local computing and multi-service node edge offloading computing to offload tasks, wherein the edge offloading computing includes single-hop offloading and two-hop offloading.

在本申请的实施例中,处理任务的方式有4种:本地处理、单跳V2I(Vehicle toInfrastructure)方式卸载到RUS的MEC服务器、单跳V2V(Vehicle to Vehicle)方式卸载到临近的空闲服务车辆和两跳方式卸载到中继节点空闲的服务车辆;后续三种卸载方式为边缘卸载计算。In the embodiment of this application, there are four ways to process tasks: local processing, single-hop V2I (Vehicle to Infrastructure) way to offload to the MEC server of RUS, and single-hop V2V (Vehicle to Vehicle) way to offload to adjacent idle service vehicles and two-hop methods to offload to the idle service vehicle of the relay node; the next three offloading methods are edge offloading calculations.

具体地,在本发明的实施例中,所述定义节点状态具体为:使用0-1变量αi,j表示所述单跳卸载中任务车辆vi的通信范围内服务节点vj的状态:Specifically, in an embodiment of the present invention, the definition of the node state is specifically: using the 0-1 variable αi ,j to represent the state of the service node v j within the communication range of the task vehicle v i in the single-hop unloading:

Figure BDA0003812845610000111
Figure BDA0003812845610000111

使用0-1变量βj,k表示执行两跳卸载时中继节点vj的服务节点vk的状态:Use the 0-1 variable β j, k to represent the state of the service node v k of the relay node v j when performing two-hop offloading:

Figure BDA0003812845610000112
Figure BDA0003812845610000112

S5、执行卸载任务:在选择边缘卸载计算基础上,判断任务车辆TaV中vi的服务节点vj的空闲状态,且所述服务节点vj满足充当所述中继节点的要求;随后基于空闲状态的结果判断,通过所述单跳卸载方式执行卸载任务;若所述空闲状态不满足单跳卸载条件,则将计算卸载任务通过所述两跳卸载到所述中继节点vj的空闲服务节点vk中执行。S5. Execute unloading task: on the basis of selecting the edge offloading calculation, judge the idle state of the service node v j of vi in the task vehicle TaV, and the service node v j meets the requirements of acting as the relay node; then based on the idle state Judging the result of the state, the unloading task is executed through the single-hop offloading method; if the idle state does not meet the single-hop offloading condition, the calculation offloading task is offloaded to the idle service of the relay node v j through the two-hop Executed in node v k .

在本实施例中,为了充分利用车辆的计算资源,任务车辆TaV不仅仅可在本地处理任务,还可以借助

Figure BDA0003812845610000113
时刻内始终处于TaV通信范围内的SN。可以通过本地计算和边缘卸载计算2种方式处理任务。In this embodiment, in order to make full use of the computing resources of the vehicle, the task vehicle TaV can not only process tasks locally, but also use
Figure BDA0003812845610000113
The SN is always within the communication range of TaV at all times. Tasks can be processed in two ways: local computing and edge offloading computing.

1)利用本地计算进行计算卸载:1) Use local computing to offload computing:

当TaV选择使用本地自身的计算资源处理任务时,本地计算时延为:When TaV chooses to use its own local computing resources to process tasks, the local computing delay is:

Figure BDA0003812845610000114
Figure BDA0003812845610000114

其中,TaV的本地计算能力为

Figure BDA0003812845610000115
表示本地任务的计算量。Among them, the local computing power of TaV is
Figure BDA0003812845610000115
Indicates the calculation amount of the local task.

2)边缘卸载计算2) Offloading computing at the edge

当TaV在执行服务节点卸载计算时,包含以下阶段:任务上传,任务计算和结果反馈。因结果反馈阶段任务下行传输速度远大于上行速度,所以在本实施例中忽略结果反馈的时延。假设TaV的ui选择卸载的服务节点集合VSi,分别对不同阶段的时延进行了分析:When TaV executes service node offload calculation, it includes the following stages: task upload, task calculation and result feedback. Since the downlink transmission speed of the task in the result feedback stage is much higher than the uplink speed, the time delay of the result feedback is ignored in this embodiment. Assuming that u i of TaV chooses the offloaded service node set V i , the time delay of different stages is analyzed separately:

情况1:任务车辆vi的服务节点vj处于空闲状态时,即αi,j=0。在该情况下,任务卸载到服务节点可直接计算任务:Case 1: when the service node v j of the task vehicle v i is in an idle state, that is, α i,j =0. In this case, offloading the task to the service node can directly calculate the task:

Figure BDA0003812845610000116
Figure BDA0003812845610000116

其中,

Figure BDA0003812845610000117
为任务车辆vi向服务节点vj分配的子计算任务;ri,j为vi传输计算任务到vj的上传速率;μ1为通信过程中的重叠因子,表示能被执行卸载到边缘节点数据比例;
Figure BDA0003812845610000121
表示服务节点vj给任务车辆车辆vi分配的算力。in,
Figure BDA0003812845610000117
is the subcomputing task assigned by the task vehicle v i to the service node v j ; r i,j is the upload rate of vi i transmitting the computing task to v j ; μ 1 is the overlap factor in the communication process, indicating that it can be executed and offloaded to the edge Node data ratio;
Figure BDA0003812845610000121
Indicates the computing power allocated by the service node v j to the task vehicle v i .

情况2:任务车辆vi的服务节点vj处于占用状态时,即αi,j=1。造成此种原因为,该服务节点vj已被其余TaV选定为服务节点,这种情况下vj只能为任务车辆vi的候选中继节点CrN。假设vk始终处于vj的通信范围内且

Figure BDA0003812845610000122
Figure BDA0003812845610000123
则vj车辆可作为中继节点通过两跳卸载方式执行卸载计算任务,即βj,k=0。Case 2: when the service node v j of the task vehicle v i is in the occupied state, that is, α i,j =1. The reason for this is that the service node v j has been selected as a service node by other TaVs, and in this case v j can only be the candidate relay node CrN of the mission vehicle v i . Suppose v k is always within the communication range of v j and
Figure BDA0003812845610000122
Figure BDA0003812845610000123
Then vehicle v j can be used as a relay node to perform unloaded computing tasks in a two-hop offloading manner, that is, β j,k =0.

Figure BDA0003812845610000124
Figure BDA0003812845610000124

其中,

Figure BDA0003812845610000125
表示vi将计算子任务
Figure BDA0003812845610000126
上传到中继节点vj
Figure BDA0003812845610000127
表示中继节点vj将计算任务
Figure BDA0003812845610000128
两跳卸载到中继节点vj的服务节点vk。in,
Figure BDA0003812845610000125
Indicates that v i will compute subtasks
Figure BDA0003812845610000126
Upload to relay node v j ;
Figure BDA0003812845610000127
Indicates that the relay node v j will calculate the task
Figure BDA0003812845610000128
Two-hop offload to service node v k of relay node v j .

具体地,在本本发明的实施例中,多任务卸载总表达式为:Specifically, in the embodiment of the present invention, the total expression of multi-task offloading is:

Figure BDA0003812845610000129
Figure BDA0003812845610000129

基于此,当出现有限计算资源和用户需要体验之间的矛盾,通过本地执行和多服务节点多跳分布式卸载执行并行计算任务,用多跳分布式卸载相比传统的单跳单节点卸载系统整体时延更优。设计目标函数如下:Based on this, when there is a contradiction between limited computing resources and user experience, parallel computing tasks are performed through local execution and multi-hop distributed offloading of multi-service nodes. Compared with traditional single-hop single-node offloading systems, multi-hop distributed offloading Overall latency is better. The design objective function is as follows:

Figure BDA00038128456100001210
Figure BDA00038128456100001210

其中,C表示不同Vs、Vrn和Vrs不等拆分的计算子任务。Among them, C represents the computing subtasks that are split differently by different Vs, Vrn and Vrs.

约束条件C1表示本地和卸载计算子任务的约束边界;C2表示在任务最大容忍时限Tmaxi内任务车辆vi到服务节点vj之间的相对欧式距离小于或等于vi的通信范围R;C3表示本地和多服务节点卸载计算子任务之和等于任务车辆vi的总计算任务

Figure BDA0003812845610000131
Constraint condition C 1 represents the constraint boundary of local and offloaded computing subtasks; C 2 represents the communication range R where the relative Euclidean distance between task vehicle v i and service node v j within the task maximum tolerance time limit Tmax i is less than or equal to v i ; C 3 means that the sum of local and multi-service node offloading computing subtasks is equal to the total computing tasks of task vehicle v i
Figure BDA0003812845610000131

在步骤S2中,鉴于车辆位置是不断动态变化的使得网络拓扑结构也不断改变,同时任务车辆的通信范围也是受限的,三维道路上车辆并非全部可作为任务车辆的服务节点。因此本申请中使用聚类算法确定不同任务车辆的服务节点集合和中继节点,以及两跳服务节点。In step S2, in view of the fact that the position of the vehicle is constantly changing dynamically, the network topology is also constantly changing, and the communication range of the task vehicle is also limited, not all vehicles on the three-dimensional road can be used as service nodes of the task vehicle. Therefore, in this application, a clustering algorithm is used to determine service node sets, relay nodes, and two-hop service nodes of different mission vehicles.

具体地,在本发明实时中,在所述步骤S2确定节点类型中,还包括:基于任务车辆来对车辆行驶道路进行分簇,其边缘服务器设有N+1个,任务车辆Vt设有M个,以此进行多任务车辆的服务节点聚类;Specifically, in the real-time of the present invention, in the step S2 determining the node type, it also includes: clustering the vehicle driving road based on the task vehicle, with N+1 edge servers, and M task vehicles Vt , so as to cluster the service nodes of multi-tasking vehicles;

其中所述服务节点聚类的步骤具体包括:Wherein, the steps of clustering service nodes specifically include:

S1、从车辆集合V={v0,v1,v2,...,vN}中随机选取M个任务车辆作为质心;S1. Randomly select M mission vehicles from the vehicle set V={v 0 , v 1 , v 2 ,..., v N } as centroids;

S2、在服务节点中进行取样,计算每个样本到M个质心的欧式距离;S2. Sampling is performed in the service node, and the Euclidean distance from each sample to M centroids is calculated;

S3、如果样本在Δt∈[0~Tmaxi]任意时刻到质心的欧式距离

Figure BDA0003812845610000132
进入后续步骤;其中R为设于道路为所有设备提供服务的路边单元RSU的覆盖半径;S3. If the Euclidean distance from the sample to the centroid at any time Δt∈[0~Tmax i ]
Figure BDA0003812845610000132
Enter the next step; where R is the coverage radius of the RSU located on the road to provide services for all equipment;

S4、如果样本处于多个质心的通信范围内,αi,j=1则将此样本作为获选服务节点;否则αi,j=0,将此样本划分到此质心所对应的簇中;S4. If the sample is within the communication range of multiple centroids, α i, j = 1, then use this sample as the selected service node; otherwise, α i, j = 0, divide this sample into the cluster corresponding to this centroid;

S5、最后输出聚类结果,得到任务车辆的服务节点集合Vs。S5. Finally output the clustering result to obtain the service node set Vs of the mission vehicle.

其中,为了验证聚类程度的质量,选择相似性度量为欧几里德距离的倒数

Figure BDA0003812845610000133
即任务车辆与服务节点的距离越小表示二者的相似性越大,反之则相似性越小。Among them, in order to verify the quality of the degree of clustering, the similarity measure is chosen as the reciprocal of the Euclidean distance
Figure BDA0003812845610000133
That is, the smaller the distance between the task vehicle and the service node, the greater the similarity between the two, and vice versa.

本申请所优化的目标函数为系统平均时延最小化问题,候选服务节点若已作为某个任务车辆的服务节点,则此节点可充当通信范围内其余Tav的候选中继节点。为了保证系统时延最小化,通过比较TaV聚类后的簇数大小来确定,即将获选服务节点作为簇数少的TaV服务节点。The objective function optimized in this application is the problem of minimizing the average delay of the system. If a candidate service node has been used as a service node of a task vehicle, this node can act as a candidate relay node for other Tavs within the communication range. In order to ensure the minimum system delay, it is determined by comparing the number of clusters after TaV clustering, that is, the selected service node will be used as a TaV service node with a small number of clusters.

为了更加清楚的表达,我们假设V0和V4为任务车辆,A和B分别为其服务节点集合,C=A∩B为候选服务节点,通过举例说明不同情况下C中元素应为TaV的服务节点还是获选中继节点。具体情况分析如下:In order to express more clearly, we assume that V 0 and V 4 are task vehicles, A and B are their service node sets respectively, and C=A∩B is a candidate service node. By giving examples to illustrate that the elements in C should be TaV in different cases Service nodes are also elected relay nodes. The specific situation is analyzed as follows:

情况1:如图3所示,服务节点集合第一聚类结构:|A|>|B|时,则V3为V4的服务节点,为V0的获选中继节点。Case 1: As shown in Figure 3, when the first clustering structure of the service node set is: |A|>|B|, then V 3 is the service node of V 4 and the selected relay node of V 0 .

情况2:如图4所示,服务节点集合第二聚类结构:|A|<|B|时,则V3为V0的服务节点,为V4的获选中继节点。Case 2: As shown in FIG. 4 , when the second clustering structure of the set of service nodes is |A|<|B|, then V 3 is the service node of V 0 and the selected relay node of V 4 .

情况3:如图5所示,服务节点集合第三聚类结构:|A|=|B|时,若

Figure BDA0003812845610000141
Figure BDA0003812845610000142
则V3为V0的服务节点,为V4的获选中继节点,反之依然。Case 3: As shown in Figure 5, the third clustering structure of the service node set: |A|=|B|, if
Figure BDA0003812845610000141
Figure BDA0003812845610000142
Then V 3 is the serving node of V 0 and the selected relay node of V 4 , and vice versa.

接下来需要从候选中继节点CrN中确定RN和RsN,采用的策略为候选中继节点通信范围是否有空闲车辆,即βj,k=0。如果存在βi,k=0,则此节点选中为中继节点,否则无法作为中继节点进行两跳卸载。通过上述方法可以计算出集合Vrn和Vrs。Next, RN and RsN need to be determined from the candidate relay node CrN, and the adopted strategy is whether there is an idle vehicle in the communication range of the candidate relay node, that is, β j,k =0. If β i, k = 0, this node is selected as a relay node, otherwise it cannot be used as a relay node for two-hop offloading. The sets Vrn and Vrs can be calculated by the above method.

具体地,在本发明的实施例中,在所述步骤S3卸载任务表示前,还包括任务分配:确定所述任务车辆分配给服务节点的不等任务集C。Specifically, in the embodiment of the present invention, before the task representation is unloaded in the step S3, task allocation is further included: determining the unequal task set C allocated to the service node by the task vehicle.

为了实现系统平均时延最小化,在本实施例中将优化目标函数转化为边缘节点卸载和本地计算并行差值绝对值

Figure BDA0003812845610000143
最小化问题,即
Figure BDA0003812845610000144
越靠近0代表并行程度越高;转化后的目标函数如下:In order to minimize the average system delay, in this embodiment, the optimization objective function is transformed into the absolute value of edge node offloading and local calculation parallel difference
Figure BDA0003812845610000143
The minimization problem is
Figure BDA0003812845610000144
The closer to 0, the higher the degree of parallelism; the transformed objective function is as follows:

Figure BDA0003812845610000145
Figure BDA0003812845610000145

随后利用差分进化算法(DE算法)进行将卸载任务分配给所述服务节点:Then use the differential evolution algorithm (DE algorithm) to assign the offloading task to the service node:

DE算法通过采用浮点矢量进行编码生成种群个体。在DE算法寻优的过程中,首先,从父代个体间选择二个个体进行向量做差生成差分矢量;其次选择另外一个个体与差分矢量求和生成实验个体;然后,对父代个体与相应的实验个体进行交叉操作,生成新的子代个体;最后在父代个体和子代个体之间进行选择操作,将符合要求的个体保存到下一代群体中去。The DE algorithm generates population individuals by encoding with floating-point vectors. In the optimization process of the DE algorithm, firstly, select two individuals from the parent individuals to perform vector difference to generate a difference vector; secondly, select another individual and sum the difference vector to generate an experimental individual; then, the parent individual and the corresponding The experimental individuals are cross-operated to generate new offspring individuals; finally, the selection operation is performed between the parent individual and the offspring individual, and the individuals that meet the requirements are saved to the next generation group.

多任务车辆卸载只会对卸载策略有影响,并不会对任务分配产生影响,仅以任务车辆vi为例,说明任务不等拆分过程。C2仅仅影响卸载策略,在本节计算任务的不等拆分集合C不考虑其影响。优化问题的数学模型简化为:The unloading of multi-tasking vehicles will only affect the unloading strategy, and will not affect the assignment of tasks. Only the task vehicle v i is taken as an example to illustrate the splitting process of unequal tasks. C 2 only affects the unloading strategy, and the unequal splitting set C of computing tasks in this section does not consider its impact. The mathematical model of the optimization problem is simplified as:

Figure BDA0003812845610000146
Figure BDA0003812845610000146

其中,D是解空间的维数,x1,x2,...,xD分别表示分配计算子任务量,

Figure BDA0003812845610000151
Figure BDA0003812845610000152
分别表示计算子任务取值范围的上界和下界。DE算法流程如下:Among them, D is the dimension of the solution space, x 1 , x 2 ,..., x D respectively represent the amount of assigned calculation subtasks,
Figure BDA0003812845610000151
Figure BDA0003812845610000152
Respectively represent the upper bound and lower bound of the value range of the calculation subtask. The DE algorithm flow is as follows:

1)初始化种群:初始种群

Figure BDA0003812845610000153
随机产生:1) Initial population: initial population
Figure BDA0003812845610000153
Generate randomly:

Figure BDA0003812845610000154
Figure BDA0003812845610000154

其中,xi(0)表示种群中第0代的第i条“染色体”(或个体);xj,i(0)表示第0代的第i条“染色体”的第j个“基因”;NP表示种群大小,rand(0,1)表示在区间(0,1)区间均匀分布的随机数。Among them, x i (0) represents the i-th "chromosome" (or individual) of the 0th generation in the population; x j, i (0) represents the j-th "gene" of the i-th "chromosome" in the 0th generation ; NP represents the population size, and rand(0, 1) represents a random number uniformly distributed in the interval (0, 1).

2)变异操作:DE通过差分策略实现个体变异,而差分策略是随机选取种群中两个不同的个体,将其向量差缩放后与待变异个体进行向量合成,即2) Mutation operation: DE realizes individual variation through the difference strategy, and the difference strategy is to randomly select two different individuals in the population, scale their vector difference and then perform vector synthesis with the individual to be mutated, that is

Figure BDA0003812845610000155
Figure BDA0003812845610000155

其中,F为缩放因子,

Figure BDA0003812845610000156
表示第g代种群中第i个个体。Among them, F is the scaling factor,
Figure BDA0003812845610000156
Represents the i-th individual in the g-th generation population.

在进化过程中,为了保证解的有效性,必须判断“染色体”中各“基因”用随机方法重新生成(与初始种群的产生方法相同)。In the process of evolution, in order to ensure the validity of the solution, it must be judged that each "gene" in the "chromosome" is regenerated by a random method (the same method as the generation of the initial population).

第g代种群

Figure BDA0003812845610000157
通过变异后,产生一个中间体
Figure BDA0003812845610000158
g generation population
Figure BDA0003812845610000157
After mutation, an intermediate
Figure BDA0003812845610000158

3)交叉操作:对第g代种群{xi(g)}及变异的中间体{hi(g+1)}进行个体间的交叉操作:3) Crossover operation: Perform inter-individual crossover operation on the g-th generation population { xi (g)} and the mutated intermediate {h i (g+1)}:

Figure BDA0003812845610000159
Figure BDA0003812845610000159

其中,CR为交叉概率,jrand为[1,2,...,D]的随机整数。Among them, CR is the crossover probability, and j rand is a random integer in [1, 2, ..., D].

为了确保变异中间体{hi(g+1)}的每个“染色体”至少有一个“基因”遗传给下一代。第一个交叉操作的基因是随机取出hi(g+1)中的第jrand位“基因”作为交叉后“染色体”ui(g+1)第jrand位等位“基因”。后续的交叉操作过程,则是通过交叉概率CR来选取xi(g)将hi(g+1)作为ui(g+1)的等位基因。In order to ensure that each "chromosome" of the variant intermediate {h i (g+1)} has at least one "gene" inherited to the next generation. The gene of the first crossover operation is to randomly select the j rand "gene" in h i (g+1) as the j rand allele "gene" of the "chromosome" u i (g+1) after crossover. In the subsequent crossover operation process, xi (g) is selected through the crossover probability CR, and h i (g+1) is used as the allele of u i (g+1).

3)选择操作:DE采用贪婪算法来选择进入下一代种群的个体:3) Selection operation: DE uses a greedy algorithm to select individuals to enter the next generation population:

Figure BDA00038128456100001510
Figure BDA00038128456100001510

其具体进化流程如下:Its specific evolution process is as follows:

(1)确定差分进化算法控制参数,确定适应度函数。差分进化算法控制参数包括:种群大小NP、缩放因子F与杂交概率CR。(1) Determine the control parameters of the differential evolution algorithm and determine the fitness function. The control parameters of differential evolution algorithm include: population size NP, scaling factor F and hybridization probability CR.

(2)随机产生初始种群。(2) Randomly generate the initial population.

(3)对初始种群进行评价,即计算初始种群中每个个体的适应度值。(3) Evaluate the initial population, that is, calculate the fitness value of each individual in the initial population.

(4)判断是否达到终止条件或进化代数达到最大。若是,则终止进化,将得到最佳个体作为最优解输出;若否,继续。(4) Judging whether the termination condition is reached or the evolution algebra reaches the maximum. If yes, terminate the evolution, and output the best individual as the optimal solution; if not, continue.

(5)进行变异和交叉操作,得到中间种群。(5) Perform mutation and crossover operations to obtain intermediate populations.

(6)在原种群和中间种群中选择个体,得到新一代种群。(6) Select individuals from the original population and the intermediate population to obtain a new generation population.

(7)进化代数g=g+1,转步骤(4)。(7) Evolution algebra g=g+1, go to step (4).

由上所述,本发明实施例涉及的多智能体多任务协同卸载方法,包括:S1、设置车辆任务卸载场景:将产生任务的车辆认定为任务车辆TaV;在所述任务车辆最大可容忍时延内始终处于通信范围内,配置为所述任务车辆提供卸载服务的服务节点;S2、确定节点类型:将从属于多个任务车辆TaV通信范围内的服务节点,认定为候选服务节点;当候选服务节点确定为任务车辆TaV中vi的服务节点后,当前候选服务节点可充当剩余任务车辆的候选中继节点;随后从候选中继节点中筛选出可执行两跳卸载的中继节点,以及所述中继节点的服务节点;S3、卸载任务表示:将任意任务车辆vi产生的任务用三元组:

Figure BDA0003812845610000161
表示;其中Di为卸载任务的大小,Ci为任务所需计算资源,Tmaxi为执行任务的最大可容限时延;S4、卸载方式选择:在定义节点状态后,选择本地计算和多服务节点边缘卸载计算进行任务卸载,其中所述边缘卸载计算包括单跳卸载与两跳卸载;S5、执行卸载任务:在选择边缘卸载计算基础上,判断任务车辆TaV中vi的服务节点vj的空闲状态,且所述服务节点vj满足充当所述中继节点的要求;随后基于空闲状态的结果判断,通过所述单跳卸载方式执行卸载任务;若所述空闲状态不满足单跳卸载条件,则将计算卸载任务通过所述两跳卸载到所述中继节点vj的空闲服务节点vk中执行。本发明提供一种多智能体多任务协同卸载方法,其能够利用任务车辆有限计算资源和周围空间的服务资源,解决多车辆多任务协同卸载冲突问题,实现最小的系统平均时延。From the above, the multi-agent and multi-task cooperative unloading method involved in the embodiment of the present invention includes: S1, setting the vehicle task unloading scene: identifying the vehicle that generates the task as the task vehicle TaV; when the task vehicle is at its maximum tolerable Yannei is always within the communication range, configured as a service node that provides unloading services for the task vehicle; S2, determining the node type: identifying a service node that is within the communication range of multiple task vehicles TaV as a candidate service node; when the candidate After the service node is determined as the service node of vi in the task vehicle TaV , the current candidate service node can act as a candidate relay node for the remaining task vehicles; then select the relay node that can perform two-hop offloading from the candidate relay nodes, and The service node of the relay node; S3, unloading task representation: the task generated by any task vehicle v is triplet :
Figure BDA0003812845610000161
where D i is the size of the offloading task, C i is the computing resource required by the task, and Tmaxi is the maximum tolerable delay in executing the task; S4. Selection of offloading mode: after defining the node status, select local computing and multi-service nodes The edge offloading calculation performs task offloading, wherein the edge offloading calculation includes single-hop offloading and two-hop offloading; S5. Execute the offloading task: on the basis of selecting the edge offloading calculation, determine the idleness of the service node v j of v i in the task vehicle TaV state, and the service node v j meets the requirements of acting as the relay node; then judge based on the result of the idle state, and perform the offloading task through the single-hop offloading method; if the idle state does not meet the single-hop offloading condition, Then the calculation offloading task is offloaded to the idle service node v k of the relay node v j through the two hops for execution. The invention provides a multi-agent and multi-task cooperative unloading method, which can solve the problem of multi-vehicle multi-task cooperative unloading conflicts by utilizing the limited computing resources of task vehicles and service resources in the surrounding space, and realize the minimum average system delay.

对所公开的实施例的上述说明,使本领域专业技术人员能够实现或使用本发明。对这些实施例的多种修改对本领域的专业技术人员来说将是显而易见的,本申请中所定义的一般原理可以在不脱离本发明的精神或范围的情况下,在其他实施例中实现。因此,本发明将不会被限制于本申请所示的这些实施例,而是要符合与本申请所公开的原理和新颖特点相一致的最宽的范围。The above description of the disclosed embodiments is provided to enable any person skilled in the art to make or use the invention. Various modifications to these embodiments will be readily apparent to those skilled in the art, and the general principles defined in this application may be implemented in other embodiments without departing from the spirit or scope of the invention. Therefore, the present invention will not be limited to these embodiments shown in this application, but will conform to the widest scope consistent with the principles and novel features disclosed in this application.

Claims (10)

1. A multi-agent multi-task cooperative unloading method is characterized by comprising the following steps:
s1, setting a vehicle task unloading scene: identifying the vehicle producing the mission as mission vehicle TaV; the task vehicle is always within a communication range within the maximum tolerable time delay, and a service node for providing unloading service for the task vehicle is configured;
s2, determining the node type: service nodes belonging to the communication range of the plurality of task vehicles TaV are determined as candidate service nodes; when the candidate service node is determined to be v in task vehicle TaV i After the service node is obtained, the current candidate service node can be used as a candidate relay node of the rest task vehicles; then, screening out relay nodes capable of executing two-hop unloading and service nodes of the relay nodes from the candidate relay nodes;
s3, unloading task representation: will arbitrarily task the vehicle v i Generated task-use triplets:
Figure FDA0003812845600000011
Figure FDA0003812845600000012
represents; wherein D i To unload the size of a task, C i Tmax, the computational resources required for a task i Maximum tolerable latency for executing the task;
s4, unloading mode selection: after defining the node state, selecting local computation and multi-service node edge unloading computation for task unloading, wherein the edge unloading computation comprises single-hop unloading and two-hop unloading;
s5, executing an unloading task: on the basis of selecting edge unloading calculation, judging v in task vehicle TaV i Service node v j And said serving node v, and j satisfying a requirement to act as the relay node; then, based on the result judgment of the idle state, executing the unloading task in the single-hop unloading mode;
if the idle state does not meet the single-hop unloading condition, the calculation unloading task is unloaded to the relay through the two hopsNode v j Idle service node v k Is executed.
2. The multi-agent multi-tasking cooperative offloading method of claim 1, wherein in step S4, further comprising:
if the local computation is selected, namely TaV selects to use local computing resources to process tasks, the local computation time delay is directly obtained
Figure FDA0003812845600000013
Figure FDA0003812845600000014
Wherein,
Figure FDA0003812845600000015
representing the local computing power of TaV,
Figure FDA0003812845600000016
representing the computational load of the local task.
3. The multi-agent multi-task cooperative offloading method of claim 2, wherein in the step S4, the defining node state is specifically: using a variable alpha of 0-1 i,j Representing said mission vehicle v in single hop unloading i Of a serving node v within communication range j The state of (2):
Figure FDA0003812845600000017
using a variable beta of 0-1 j,k Indicating a relay node v when performing two-hop offloading j Service node v k The state of (1):
Figure FDA0003812845600000021
4. the multi-agent multi-task cooperative offloading method of claim 3, wherein in the step S5, the step of performing an offloading task is specifically:
judging v in task vehicle TaV i Service node v j Idle state of (2):
if the task vehicle v i Service node v of j In an idle state, i.e. alpha i,j =0; offloading tasks directly to service node v through single hop offloading j Calculating to obtain single-hop calculation time delay;
Figure FDA0003812845600000022
wherein,
Figure FDA0003812845600000023
for task vehicles v i To the service node v j A distributed sub-computation task; r is i,j Is v is i Transmitting a computing task to v j The upload rate of (d); mu.s 1 The overlapping factor in the communication process represents the proportion of data which can be unloaded to the edge node;
Figure FDA0003812845600000024
representing a service node v j For task vehicle v i The calculated force of the distribution;
if the task vehicle v i Service node v j In an occupied state, i.e. alpha i,j =1, description serving node v j Has been selected as a serving node by the remaining TaV; at a service node v j Under the condition of meeting the requirement of serving as a relay node, the node v j Serving node v offloaded to its idle as a relay node over two hops k Performing off-load computing tasks, i.e. beta j,k =0; then obtain twoJump calculation delay:
Figure FDA0003812845600000025
wherein,
Figure FDA0003812845600000026
denotes v i Will calculate the subtask
Figure FDA0003812845600000027
Upload to relay node v j
Figure FDA0003812845600000028
Indicating a relay node v j Will calculate the task
Figure FDA0003812845600000029
Two-hop offload to relay node v j Service node v k (ii) a Vt is represented as a set of mission vehicles TaV; vs is represented as a collection of service nodes.
5. The multi-agent multi-task cooperative offloading method of claim 3, wherein in step S2, after completing the determining the node type, further comprising: constructing a vehicle motion model, passing a mission vehicle v α Position information at time t
Figure FDA00038128456000000210
Predicting position information at t + delta t moment
Figure FDA00038128456000000211
6. The multi-agent multi-task collaborative offloading method of claim 5, wherein a vehicle motion model is constructed and location information is predicted
Figure FDA00038128456000000212
The method specifically comprises the following steps:
s1, obtaining task vehicle v α Velocity at time t
Figure FDA00038128456000000213
The included angles with the x-axis, the y-axis and the z-axis are theta xyz ∈[0,π];
S2, according to the speed
Figure FDA0003812845600000031
And included angle acquisition speed
Figure FDA0003812845600000032
Velocity components in the x, y and z axes;
Figure FDA0003812845600000033
s3, obtaining a vehicle running delta t through the direction cosine law, and then obtaining a task vehicle v α Distance components traveled in the x, y and z directions;
cos is obtained by the direction cosine theorem 2 θ x +cos 2 θ y +cos 2 θ z =1, i.e.:
Figure FDA0003812845600000034
s4, subsequent application of L 2 Calculating norm to obtain task vehicle v α To v β Euclidean distance at any instant:
Figure FDA0003812845600000035
namely that
Figure FDA0003812845600000036
7. The multi-agent multitask coordinated offload method according to claim 6, wherein in said step S2 determining node type, further comprising: clustering the running roads of the vehicles based on the task vehicles, wherein N +1 edge servers are provided, and M task vehicles Vt are provided, so that service node clustering of the multi-task vehicles is performed;
wherein the step of clustering the service nodes specifically comprises:
s1, from a vehicle set V = { V = 0 ,v 1 ,v 2 ,…,v N Randomly selecting M task vehicles as mass centers;
s2, sampling in the service node, and calculating Euclidean distances from each sample to M centroids;
s3, if the sample is within the range of delta t epsilon from 0 to Tmax i ]Euclidean distance from any time to centroid
Figure FDA0003812845600000037
Entering the subsequent step; wherein R is the coverage radius of a roadside unit RSU which is arranged on a road and provides service for all equipment;
s4, if the sample is in the communication range of the centroids, alpha i,j =1 using the sample as the selected serving node; otherwise alpha i,j =0, the sample is divided into clusters corresponding to the centroid;
and S5, finally, outputting a clustering result to obtain a service node set Vs of the task vehicle.
8. The multi-agent multi-task cooperative offloading method of claim 1, further comprising, before the offloading mode selection in step S4: constructing a communication model, and acquiring the rate of a communication uploading link; the method comprises the following steps:
s1, setting a communication mode between a task vehicle and a service node: a short-range wireless communication mode; orthogonal frequencies are adopted to reduce the mutual influence in the communication process;
s2, setting an uplink in the communication process as a flat Rayleigh fading channel without considering channel interference;
s3, calculating the task vehicle v according to the Shannon formula i To the service node v j Average transmission rate of the uplink:
Figure FDA0003812845600000041
wherein, v2v or v2r, W v2v And W v2r Respectively representing V2V and V2R channel bandwidths; p is i Is a task vehicle v i Of the transmitted power, p 0 Representing the white Gaussian noise power, d i,j Is v i To v j The transmission distance of (a); θ represents a path loss exponent; the channel fading coefficient is denoted by h.
9. The multi-agent multi-task collaborative offload method according to claim 6, further comprising, before offloading the task representation in the step S3: and determining an unequal task set C of the task vehicle distributed to the service nodes.
10. The multi-agent multi-task cooperative work method according to claim 9, wherein the specific step of task assignment comprises:
s1, setting an objective function, wherein the objective function aims to solve a calculation time delay problem of multi-vehicle multi-task unloading;
s2, converting the target function into an absolute value of a parallel difference between unloading of the edge node and local computation
Figure FDA0003812845600000042
Minimization problem, i.e.
Figure FDA0003812845600000043
Closer to 0 represents higher parallelism; the transformed objective function is:
Figure FDA0003812845600000044
st.
C 1 :
Figure FDA0003812845600000045
C 2 :
Figure FDA0003812845600000046
C 3 :
Figure FDA0003812845600000047
wherein, C represents a computation subtask with unequal splitting; constraint C 1 Representing constraint boundaries for local and offload computation subtasks; c 2 Indicating the maximum tolerance time limit Tmax of the task i Inner mission vehicle v i To the service node v j Relative Euclidean distance therebetween is less than or equal to v i The communication range R of (2); c 3 Indicating that the sum of local and multi-service node offload computation subtasks equals task vehicle v i Total calculation task of
Figure FDA0003812845600000048
And S3, distributing the unloading task to the service node by utilizing a differential evolution algorithm.
CN202211016816.4A 2022-08-24 2022-08-24 A multi-agent multi-task collaborative offloading method Active CN115550357B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202211016816.4A CN115550357B (en) 2022-08-24 2022-08-24 A multi-agent multi-task collaborative offloading method

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202211016816.4A CN115550357B (en) 2022-08-24 2022-08-24 A multi-agent multi-task collaborative offloading method

Publications (2)

Publication Number Publication Date
CN115550357A true CN115550357A (en) 2022-12-30
CN115550357B CN115550357B (en) 2025-01-28

Family

ID=84725292

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202211016816.4A Active CN115550357B (en) 2022-08-24 2022-08-24 A multi-agent multi-task collaborative offloading method

Country Status (1)

Country Link
CN (1) CN115550357B (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN115988462A (en) * 2023-03-17 2023-04-18 中电建市政建设集团山东工程有限公司 Debugging method of edge computing module based on vehicle-road cooperation

Citations (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102638872A (en) * 2012-04-18 2012-08-15 西安邮电学院 Relay selection method based on load balancing in cooperation relay network
US20190188043A1 (en) * 2017-12-19 2019-06-20 International Business Machines Corporation Dynamic task allocation and node reconfiguration in mesh network
CN111818168A (en) * 2020-06-19 2020-10-23 重庆邮电大学 An adaptive joint computing offloading and resource allocation method in the Internet of Vehicles
CN111970318A (en) * 2020-05-18 2020-11-20 北京邮电大学 Vehicle and roadside unit cooperative task unloading method and device based on mobile edge calculation
CN112055329A (en) * 2020-08-03 2020-12-08 广东工业大学 An edge car networking task offload method suitable for RSU coverage switching
US20200404069A1 (en) * 2019-09-11 2020-12-24 Intel Corporation Framework for computing in radio access network (ran)
CN112685186A (en) * 2021-01-08 2021-04-20 北京信息科技大学 Method and device for unloading computing tasks, electronic equipment and storage medium
CN112738272A (en) * 2021-01-12 2021-04-30 浙江工业大学 Edge node load balancing method for minimizing network delay
CN113542376A (en) * 2021-07-01 2021-10-22 广东工业大学 Task unloading method based on energy consumption and time delay weighting
CN113821270A (en) * 2021-07-29 2021-12-21 长沙理工大学 Task unloading sequence prediction method, decision-making method, electronic device and storage medium
CN114153515A (en) * 2021-09-18 2022-03-08 南京邮电大学 Expressway internet of vehicles task unloading algorithm based on 5G millimeter wave communication

Patent Citations (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102638872A (en) * 2012-04-18 2012-08-15 西安邮电学院 Relay selection method based on load balancing in cooperation relay network
US20190188043A1 (en) * 2017-12-19 2019-06-20 International Business Machines Corporation Dynamic task allocation and node reconfiguration in mesh network
US20200404069A1 (en) * 2019-09-11 2020-12-24 Intel Corporation Framework for computing in radio access network (ran)
CN111970318A (en) * 2020-05-18 2020-11-20 北京邮电大学 Vehicle and roadside unit cooperative task unloading method and device based on mobile edge calculation
CN111818168A (en) * 2020-06-19 2020-10-23 重庆邮电大学 An adaptive joint computing offloading and resource allocation method in the Internet of Vehicles
CN112055329A (en) * 2020-08-03 2020-12-08 广东工业大学 An edge car networking task offload method suitable for RSU coverage switching
CN112685186A (en) * 2021-01-08 2021-04-20 北京信息科技大学 Method and device for unloading computing tasks, electronic equipment and storage medium
CN112738272A (en) * 2021-01-12 2021-04-30 浙江工业大学 Edge node load balancing method for minimizing network delay
CN113542376A (en) * 2021-07-01 2021-10-22 广东工业大学 Task unloading method based on energy consumption and time delay weighting
CN113821270A (en) * 2021-07-29 2021-12-21 长沙理工大学 Task unloading sequence prediction method, decision-making method, electronic device and storage medium
CN114153515A (en) * 2021-09-18 2022-03-08 南京邮电大学 Expressway internet of vehicles task unloading algorithm based on 5G millimeter wave communication

Non-Patent Citations (3)

* Cited by examiner, † Cited by third party
Title
KUN WANG, XIAOFENG WANG, XUAN LIU, ALIREZA JOLFAEI: "Task offloading Strategy Based on Reinforcement Learning Computing in Edge Computing Architecture of Internet of Vehicles", 《IEEE ACCESS》, 16 December 2020 (2020-12-16) *
刘伟琦: "车联网场景中移动边缘计算卸载方案研究", 《中国优秀硕士学位论文全文数据库》, 1 December 2021 (2021-12-01) *
曹敦,张应宝,邹电,王进,汤强,冀保峰: "V2X多节点协同分布式卸载策略", 《通信学报》, 8 February 2022 (2022-02-08) *

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN115988462A (en) * 2023-03-17 2023-04-18 中电建市政建设集团山东工程有限公司 Debugging method of edge computing module based on vehicle-road cooperation
CN115988462B (en) * 2023-03-17 2023-06-30 中电建市政建设集团山东工程有限公司 Debugging method of edge computing module based on vehicle-road cooperation

Also Published As

Publication number Publication date
CN115550357B (en) 2025-01-28

Similar Documents

Publication Publication Date Title
Yadav et al. Energy-latency tradeoff for dynamic computation offloading in vehicular fog computing
Chen et al. Efficiency and fairness oriented dynamic task offloading in internet of vehicles
CN111586696B (en) Resource allocation and unloading decision method based on multi-agent architecture reinforcement learning
CN109905470A (en) A cost-optimized task scheduling method based on edge gateway system
CN111182495B (en) A 5G Internet of Vehicles Partial Computing Offloading Method
CN113891477A (en) Resource allocation method based on MEC calculation task unloading in Internet of vehicles
CN109151864A (en) A kind of migration decision and resource optimal distribution method towards mobile edge calculations super-intensive network
CN112511614B (en) Intelligent networking vehicle task unloading method under vehicle-mounted edge environment based on reinforcement learning
Li et al. DNN partition and offloading strategy with improved particle swarm genetic algorithm in VEC
CN113703984B (en) Cloud task optimization strategy method based on SOA (service oriented architecture) under 5G cloud edge cooperative scene
CN112153145A (en) Method and device for unloading calculation tasks facing Internet of vehicles in 5G edge environment
Wu et al. A mobile edge computing-based applications execution framework for Internet of Vehicles
Lan et al. Deep reinforcement learning for computation offloading and caching in fog-based vehicular networks
Hou et al. Hierarchical task offloading for vehicular fog computing based on multi-agent deep reinforcement learning
Gao et al. Fast adaptive task offloading and resource allocation in large-scale MEC systems via multiagent graph reinforcement learning
CN115080249B (en) Vehicle networking multidimensional resource allocation method and system based on federal learning
CN118540743A (en) Method for unloading and caching service of partitionable tasks in cloud-edge cooperative internet of vehicles scene
CN115550357A (en) Multi-agent multi-task cooperative unloading method
CN114928611B (en) IEEE802.11p protocol-based energy-saving calculation unloading optimization method for Internet of vehicles
CN115835294A (en) RAN slice and task unloading joint optimization method assisted by deep reinforcement learning in Internet of vehicles
CN113891466A (en) Online scheduling system and method for UDL task in edge wireless network
CN116528295A (en) Hierarchical task offloading method for fog computing in Internet of Vehicles based on multi-agent reinforcement learning
CN116360996A (en) Reliable edge acceleration reasoning task allocation method in Internet of vehicles environment
CN115665859A (en) Multi-agent task unloading and resource scheduling combined optimization method
CN114980127A (en) A computational offloading method based on federated reinforcement learning in fog radio access networks

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant