CN114780163A - Task processing method and device and electronic equipment - Google Patents
Task processing method and device and electronic equipment Download PDFInfo
- Publication number
- CN114780163A CN114780163A CN202110005306.6A CN202110005306A CN114780163A CN 114780163 A CN114780163 A CN 114780163A CN 202110005306 A CN202110005306 A CN 202110005306A CN 114780163 A CN114780163 A CN 114780163A
- Authority
- CN
- China
- Prior art keywords
- task
- cloud
- user terminal
- processing
- target
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000003672 processing method Methods 0.000 title claims abstract description 21
- 238000012545 processing Methods 0.000 claims abstract description 202
- 238000000034 method Methods 0.000 claims abstract description 57
- 230000003190 augmentative effect Effects 0.000 claims description 26
- 230000008569 process Effects 0.000 claims description 15
- 238000004590 computer program Methods 0.000 claims description 6
- 230000004044 response Effects 0.000 claims description 6
- 230000005540 biological transmission Effects 0.000 description 13
- 238000013468 resource allocation Methods 0.000 description 10
- 238000004364 calculation method Methods 0.000 description 6
- 238000009877 rendering Methods 0.000 description 5
- 230000000694 effects Effects 0.000 description 4
- 238000004891 communication Methods 0.000 description 3
- 230000008878 coupling Effects 0.000 description 3
- 238000010168 coupling process Methods 0.000 description 3
- 238000005859 coupling reaction Methods 0.000 description 3
- 238000005516 engineering process Methods 0.000 description 3
- 238000000354 decomposition reaction Methods 0.000 description 2
- 238000011161 development Methods 0.000 description 2
- 238000010586 diagram Methods 0.000 description 2
- 238000005265 energy consumption Methods 0.000 description 2
- 238000013507 mapping Methods 0.000 description 2
- 238000010606 normalization Methods 0.000 description 2
- 238000005457 optimization Methods 0.000 description 2
- 230000006798 recombination Effects 0.000 description 2
- 238000005215 recombination Methods 0.000 description 2
- 239000000126 substance Substances 0.000 description 2
- 230000009286 beneficial effect Effects 0.000 description 1
- 238000004422 calculation algorithm Methods 0.000 description 1
- 230000001934 delay Effects 0.000 description 1
- 238000013461 design Methods 0.000 description 1
- 230000006870 function Effects 0.000 description 1
- 230000010365 information processing Effects 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 230000006855 networking Effects 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 230000002035 prolonged effect Effects 0.000 description 1
- 239000002699 waste material Substances 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F9/00—Arrangements for program control, e.g. control units
- G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
- G06F9/44—Arrangements for executing specific programs
- G06F9/445—Program loading or initiating
- G06F9/44594—Unloading
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F9/00—Arrangements for program control, e.g. control units
- G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
- G06F9/46—Multiprogramming arrangements
- G06F9/50—Allocation of resources, e.g. of the central processing unit [CPU]
- G06F9/5005—Allocation of resources, e.g. of the central processing unit [CPU] to service a request
- G06F9/5027—Allocation of resources, e.g. of the central processing unit [CPU] to service a request the resource being a machine, e.g. CPUs, Servers, Terminals
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F9/00—Arrangements for program control, e.g. control units
- G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
- G06F9/46—Multiprogramming arrangements
- G06F9/50—Allocation of resources, e.g. of the central processing unit [CPU]
- G06F9/5061—Partitioning or combining of resources
- G06F9/5072—Grid computing
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F2209/00—Indexing scheme relating to G06F9/00
- G06F2209/50—Indexing scheme relating to G06F9/50
- G06F2209/509—Offload
Landscapes
- Engineering & Computer Science (AREA)
- Software Systems (AREA)
- Theoretical Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Mathematical Physics (AREA)
- Information Transfer Between Computers (AREA)
Abstract
The embodiment of the invention provides a task processing method, a task processing device and electronic equipment, wherein the method applied to a user terminal comprises the following steps: initializing parameters of a user terminal, and sending a task unloading request aiming at a target task to a cloud; under the condition that an initialization completion instruction sent by a cloud terminal is received, task data parameters are collected and sent to the cloud terminal, wherein the task data parameters are associated with a target task; receiving a task processing strategy sent by a cloud end responding to the task unloading request; and unloading the target task to the cloud according to the task processing strategy. The scheme of the invention can reduce the time delay of task processing.
Description
Technical Field
The present invention relates to the field of information processing technologies, and in particular, to a task processing method and apparatus, and an electronic device.
Background
The cloud AR (Augmented Reality) service greatly reduces the calculation load and the battery consumption of AR terminal equipment by using the cloud calculation capability by cloud and content cloud of key technologies in the AR service, and gets rid of the constraint of cables.
The existing cloud AR resource allocation scheme is that the uplink transmission power of each user is considered as a fixed value, the uplink and downlink bandwidths of the users are changed in proportion to the channel gain of the users, and the minimum total energy consumption of an application system is realized on the premise of realizing resource allocation and task processing by optimizing the total energy of the system.
According to the scheme, transmission of redundant information in a multi-user uplink is limited, uplink transmission power of a system is regarded as a fixed value and is used as a precondition of the whole optimization system, and total energy consumption is used as a constraint condition of an optimization target, so that cloud service performance resources are unreasonably distributed, service experience delay is overlarge, and user experience is not guaranteed.
Disclosure of Invention
The invention provides a task processing method and device and electronic equipment, which can reduce the time delay of task processing.
To solve the above technical problem, an embodiment of the present invention provides the following solutions:
a task processing method is applied to a user terminal and comprises the following steps:
initializing parameters of a user terminal, and sending a task unloading request aiming at a target task to a cloud;
under the condition that an initialization completion instruction sent by a cloud terminal is received, task data parameters are collected and sent to the cloud terminal, wherein the task data parameters are associated with a target task;
receiving a task processing strategy sent by a cloud end in response to a task unloading request;
and unloading the target task to the cloud according to the task processing strategy.
Optionally, the offloading of the target task to the cloud according to the task processing policy includes:
determining a first subtask executed by a user terminal and a second subtask executed by a cloud according to a task processing strategy, wherein a target task comprises the first subtask and the second subtask;
and sending the data corresponding to the second subtask to the cloud.
Optionally, after the target task is offloaded to the cloud according to the task processing policy, the method further includes:
acquiring a processing result returned after the cloud end processes the target task;
and when the target task is the augmented reality processing task, decoding the processing result and displaying a picture obtained by decoding.
Optionally, the parameter initialization is performed on the user terminal, and includes:
and initializing the number of areas of the augmented reality scene, the number of users participating in the augmented reality scene, the number of tasks required to be unloaded by each user and the size of the tasks under the condition that the target task is the augmented reality processing task.
Optionally, the task data parameters include: at least one of data size of the target task, number of CPU cycles required for calculating the target task, transmission power of the user terminal, power gain of the channel, power noise of the channel, and bandwidth.
The embodiment of the invention also provides a task processing method, which is applied to a cloud and comprises the following steps:
initializing parameters of a cloud, and acquiring a task unloading request sent by a user terminal;
under the condition that the cloud end completes parameter initialization, an initialization completion instruction is sent to the user terminal;
acquiring task data parameters sent by a user terminal;
generating a task processing strategy according to the task data parameters, and sending the task processing strategy to the user terminal, wherein the task processing strategy is used for indicating the user terminal to unload the target task to the cloud;
and acquiring a target task unloaded to the cloud end by the user terminal.
Optionally, generating a task processing policy according to the task data parameter, and sending the task processing policy to the user terminal, includes:
determining a first subtask executed by a user terminal and a second subtask executed by a cloud according to the task data parameters, wherein the target task comprises the first subtask and the second subtask;
according to the first subtask, allocating a first resource required by executing the first subtask to the user terminal;
and sending the task processing strategy to the user terminal, wherein the task processing strategy is used for indicating the first user terminal to execute the first subtask by using the first resource.
Optionally, determining, according to the task data parameter, a first subtask executed by the user terminal and a second subtask executed by the cloud, where the determining includes:
determining a first time delay and a first processing capacity of the user terminal according to the task data parameters;
and determining a first subtask and a second subtask according to the first time delay, the first processing capacity and a second time delay, wherein the second time delay is the time delay from the cloud to the user terminal.
Optionally, after obtaining the target task offloaded to the cloud by the user terminal, the method further includes:
acquiring video stream data sent by a user terminal under the condition that a target task is an augmented reality processing task;
decoding video stream data to obtain a target image frame;
performing three-dimensional reconstruction processing according to the target image frame to obtain a processing result;
and sending the processing result to the user terminal.
Optionally, the three-dimensional reconstruction processing is performed according to the target image frame to obtain a processing result, and the processing result includes:
judging whether shared data corresponding to the target task exists in the cache, wherein the shared data are obtained by processing the data requested by the second user terminal in an augmented reality scene corresponding to the target task;
under the condition that shared data corresponding to the target task exist, three-dimensional reconstruction processing is carried out according to a first image frame in the target image frame to obtain a first processing result, wherein the processing data corresponding to the first image frame does not exist in the shared data;
and obtaining a processing result according to the first processing result and the shared data.
The embodiment of the invention also provides a task processing device, which is applied to the user terminal and comprises the following steps:
the first processing module is used for initializing parameters of the user terminal and sending a task unloading request aiming at a target task to the cloud;
the system comprises an acquisition module, a processing module and a display module, wherein the acquisition module is used for acquiring task data parameters and sending the task data parameters to a cloud under the condition of receiving an initialization completion instruction sent by the cloud, and the task data parameters are associated with a target task;
the first receiving module is used for receiving a task processing strategy sent by the cloud end in response to the task unloading request;
and the unloading module is used for unloading the target task to the cloud end according to the task processing strategy.
An embodiment of the present invention further provides a task processing device, which is applied to a cloud, and includes:
the third processing module is used for initializing parameters of the cloud and acquiring a task unloading request sent by the user terminal;
the first sending module is used for sending an initialization completion instruction to the user terminal under the condition that the cloud end completes parameter initialization;
the second acquisition module is used for acquiring task data parameters sent by the user terminal;
the fourth processing module is used for generating a task processing strategy according to the task data parameters and sending the task processing strategy to the user terminal, wherein the task processing strategy is used for indicating the user terminal to unload the target task to the cloud end;
and the third acquisition module is used for acquiring the target task unloaded to the cloud end by the user terminal.
The invention also provides an electronic device comprising a memory in which a computer program is stored and a processor arranged to execute the method as described above by means of the computer program.
The invention also provides a processor-readable storage medium having stored thereon processor-executable instructions for causing a processor to perform the method as described above.
The scheme of the invention at least comprises the following beneficial effects:
according to the technical scheme, parameter initialization is carried out on the user terminal, and a task unloading request aiming at a target task is sent to the cloud; and the task data parameters are collected and sent to the cloud end, so that the cloud end can distribute tasks and resources according to the task data parameters, and the user terminal can unload the target tasks to the cloud end according to the task processing strategies sent by the cloud end, so that the time delay of task processing is reduced through reasonable distribution of the resources by the cloud end.
Drawings
FIG. 1 is a flowchart illustrating a task processing method according to an embodiment of the present invention;
FIG. 2 is a flowchart illustrating a task processing method according to another embodiment of the present invention;
FIG. 3 is a flowchart illustrating a task processing method according to another embodiment of the present invention;
FIG. 4 is a flowchart illustrating a task processing method according to another embodiment of the present invention;
FIG. 5 is a flowchart illustrating a task processing method according to another embodiment of the present invention;
FIG. 6 is a block diagram of a task processing device according to an embodiment of the present invention;
fig. 7 is a block diagram of a task processing device according to another embodiment of the present invention.
Detailed Description
Exemplary embodiments of the present disclosure will be described in more detail below with reference to the accompanying drawings. While exemplary embodiments of the present disclosure are shown in the drawings, it should be understood that the present disclosure may be embodied in various forms and should not be limited by the embodiments set forth herein. Rather, these embodiments are provided so that this disclosure will be thorough and complete, and will fully convey the scope of the invention to those skilled in the art.
A general AR service system requires five components: 1. video stream acquisition, which can first obtain original video frames from a mobile camera; 2. positioning and tracking, namely identifying and tracking the relative position of a user in the current environment; 3. establishing a graph, namely establishing a model for the current environment; 4. object recognition, namely recognizing known objects in the current environment; 5. and rendering, namely generating a virtual image frame by using computer graphics.
Considering the development of the next generation mobile network, a special network aiming at service requirements and a novel service fused with the network are formed, especially the cloud AR type service with high bandwidth and ultra-low time delay characteristics, and the specific requirements on the network will influence the networking standard of the 6G network.
(1) The existing method only considers the total consumption of the network, but like the services such as the cloud AR, a plurality of resources exist in the cloud end and can be shared, the existing scheme does not consider, and the network does not intelligently allocate the performance resources of the cloud service, so that the cloud service experience is not guaranteed;
(2) network resource allocation and end cloud task processing need variable time, so that user waiting time is prolonged, requirements of the network and AR service combination on low time delay of novel cloud services are not facilitated, and resource waste in the waiting time is caused.
Referring to fig. 1, to solve the above technical problem, an embodiment of the present invention provides a task processing method applied to a user terminal, including:
in the embodiment of the present invention, the task data parameters include: at least one of data size of the target task, number of CPU cycles required for calculating the target task, transmission power of the user terminal, power gain of the channel, power noise of the channel, and bandwidth. In the embodiment of the invention, the parameters are used for determining the optimal task processing strategy by the cloud end, and resources are reasonably distributed, so that the time delay is reduced.
and 14, unloading the target task to the cloud according to the task processing strategy.
According to the method, parameter initialization is carried out on the user terminal, and a task unloading request aiming at a target task is sent to the cloud; and the task data parameters are collected and sent to the cloud, so that the cloud can distribute tasks and resources according to the task data parameters, the user terminal can unload the target tasks to the cloud according to the task processing strategy sent by the cloud, and the time delay of task processing is reduced through reasonable distribution of the resources by the cloud. The method provided by the embodiment of the invention can solve the problem that the service experience is reduced due to overlarge time delay caused by unreasonable network resource allocation because of unreasonable end cloud task processing strategy of the cloud augmented reality service in the prior art.
It is to be understood that, in the embodiment of the present invention, the cloud end may be an edge cloud or a center cloud, and the present invention is not limited thereto. The method of the embodiment of the present invention may be applied to processing an AR rendering task, and certainly, the method of the embodiment of the present invention is also applicable to rendering a graph in a non-AR technology, and is not limited thereto.
In an optional embodiment of the present invention, offloading the target task to the cloud according to the task processing policy includes: determining a first subtask executed by a user terminal and a second subtask executed by a cloud according to a task processing strategy, wherein a target task comprises the first subtask and the second subtask; and sending the data corresponding to the second subtask to the cloud.
In the embodiment of the invention, the cloud divides the whole target task into the first subtask executed by the user terminal and the second subtask executed by the cloud, so that the side and cloud resources of the real user are comprehensively allocated and enhanced, the time delay minimization resource allocation and task processing of end-cloud cooperation are realized, and the user experience is improved.
In the embodiment of the invention, the cloud end can determine the processing capacity of the user terminal, the time delay corresponding to the user terminal and the time delay from the cloud end to the user terminal according to the task data parameters, so that the resources are distributed by combining the factors, and the optimal time delay is realized.
In an optional embodiment of the present invention, after the target task is offloaded to the cloud according to the task processing policy, the method further includes: acquiring a processing result returned after the cloud processing target task; and when the target task is the augmented reality processing task, decoding the processing result and displaying a picture obtained by decoding.
In the embodiment of the invention, the cloud carries out three-dimensional modeling processing on the video stream collected and sent by the user terminal, rendered image data is generated and sent to the user terminal, and the user terminal receives the image data and renders the image data to obtain the AR picture. It can be understood that, under the condition that the user terminal also performs a part of the image rendering processing, the user terminal renders the AR image together according to the image data sent by the cloud and the data obtained by the user terminal processing.
In an optional embodiment of the present invention, the initializing the parameter of the user terminal includes: and initializing the number of areas of the augmented reality scene, the number of users participating in the augmented reality scene, the number of tasks required to be unloaded by each user and the size of the tasks under the condition that the target task is the augmented reality processing task.
Referring to fig. 2, an embodiment of the present invention further provides a task processing method, applied to a cloud, including:
in the embodiment of the present invention, the parameter initialization performed by the cloud may include: initializing network bandwidth resources, computing resources of a cloud server, computing models of cloud computing storage and the like.
and step 25, acquiring the target task unloaded to the cloud end by the user terminal.
In the embodiment of the invention, after the cloud is initialized, the task data parameters sent by the user terminal are obtained, the task processing strategy is generated according to the task data parameters and sent to the user terminal, and therefore the user terminal is instructed to unload the target task to the cloud for processing according to the task processing strategy. Here, the cloud can reasonably distribute resources according to the task data parameters, so that the time delay of task processing is reduced.
Optionally, generating a task processing policy according to the task data parameter, and sending the task processing policy to the user terminal, including: determining a first subtask executed by a user terminal and a second subtask executed by a cloud according to the task data parameters, wherein the target task comprises the first subtask and the second subtask; according to the first subtask, allocating a first resource required by executing the first subtask to the user terminal; and sending the task processing strategy to the user terminal, wherein the task processing strategy is used for indicating the first user terminal to execute the first subtask by using the first resource.
In the embodiment of the invention, the cloud divides the target task into the first subtask and the second subtask according to the task data parameter, so that the target task is processed by using the cloud and the user terminal together, and the resource allocation and task processing of end cloud cooperation are realized.
Optionally, determining a first subtask executed by the user terminal and a second subtask executed by the cloud according to the task data parameter includes: determining a first time delay and a first processing capacity of the user terminal according to the task data parameters; and determining the first subtask and the second subtask according to the first time delay, the first processing capacity and the second time delay, wherein the second time delay is the time delay from the cloud end to the user terminal.
In the embodiment of the invention, the cloud end can confirm the first time delay of the user terminal and the processing capacity of the user terminal according to the task parameters, so that the cloud end can combine the time delay between the user terminal and the cloud end. The first time delay and the processing capacity of the user terminal are used for comprehensively allocating resources and tasks required to be processed respectively, so that the time delay minimization resource allocation and task processing of end cloud cooperation can be realized.
Optionally, after obtaining the target task offloaded to the cloud by the user terminal, the method further includes: under the condition that the target task is an augmented reality processing task, acquiring video stream data sent by a user terminal; decoding video stream data to obtain a target image frame; performing three-dimensional reconstruction processing according to the target image frame to obtain a processing result; and sending the processing result to the user terminal.
It can be understood that, in the embodiment of the present invention, the three-dimensional reconstruction processing performed by the cloud includes: positioning tracking, drawing and object identification, thereby facilitating the rendering of an AR picture by a user terminal.
Optionally, the three-dimensional reconstruction processing is performed according to the target image frame to obtain a processing result, and the processing result includes: judging whether shared data corresponding to the target task exists in the cache, wherein the shared data are obtained by processing the second user terminal request cloud under the augmented reality scene corresponding to the target task; under the condition that shared data corresponding to the target task exist, performing three-dimensional reconstruction processing according to a first image frame in the target image frame to obtain a first processing result, wherein the processing data corresponding to the first image frame does not exist in the shared data; and obtaining a processing result according to the first processing result and the shared data.
It can be understood that, in an AR scene in which multiple users participate, each user terminal needs to render an AR picture. Since multiple users are participating in the same AR scene, there are the same tasks that need to be processed. Referring to fig. 5, in the embodiment of the present invention, the cloud may further reduce tasks that the cloud needs to process by determining whether shared data corresponding to the target task exists in the cache, so as to further reduce the time delay. According to the method provided by the embodiment of the invention, the resource allocation strategy is determined according to the importance of the resource allocation in time delay and the end-to-end system time delay and the shared resource existing in the cloud based on the cloud AR service characteristic, the end side and the cloud resource of a real user are enhanced by comprehensive allocation, the time delay minimization resource allocation and the task processing of end cloud cooperation are realized, and the user experience is improved.
The invention will now be illustrated with reference to figures 3 to 4.
The task processing method of the embodiment of the invention comprises the following steps:
step 1: initializing parameters, including terminal initialization and cloud system initialization, wherein the terminal initialization includes the area quantity, the user number, the task size and the like, and the cloud system initializes network bandwidth resources, computing resources of a cloud server, computing models stored in cloud computing and the like;
step 2: the terminal side sends a task unloading request to the cloud server, and starts to acquire relevant data parameters including the required CPU (Central processing Unit) periodicity and the transmitting power p of a user until the terminal receives a cloud resource initialization completion instructioni,jPower gain h of the channeli,jAnd power noise N of the channel0Bandwidth B, etc.;
and 3, step 3: the cloud server determines an optimal task processing method according to parameters transmitted by the terminal side (in step 2), so that the end-to-end weighted delay sum of the AR task is minimum, and bandwidth resources, computing resources and the like are distributed to each user under the condition;
and 4, step 4: the terminal side transmits the unloading task of the cloud AR in the form of video stream according to the resources distributed by the cloud and the task processing method, and calculates the processing time delay of the terminal side;
and 5: the cloud server performs calculation processing according to the type of network uplink transmission data, allocates resources to the terminal side according to a specific strategy, implements an AR task processing method, transmits the result to the terminal through the network, and calculates uplink transmission delay and cloud processing delay;
step 6: and the terminal performs decoding processing and display, calculates the processing time delay of the terminal and calculates the processing time delay of the cloud computing system.
Specifically, in the step 1, the method includes terminal initialization, j tasks of the area quantity D under the multi-person cloud AR service scene, the user quantity U (one user corresponds to one terminal) and the area i which needs to be unloaded by each user, the embodiment of the invention does not set the specific form of the terminal, and can be a smart phone, a terminal HMD (Head Mounted Display device) and the like, and each terminal is set to have only one task to be processed to determine the task size; and initializing a cloud system, wherein the cloud system comprises available network bandwidth resources of the system and computing resources of a cloud server, and a computing model of cloud computing storage is initialized.
In step 2, the terminal side sends a task unloading request to the cloud server, wherein the specific content comprises that relevant parameters of a user (terminal HMD) are sent to the cloud server, and the parameters comprise a task size j of unloading calculation, a CPU (Central processing Unit) period number required by calculating a task, and transmitting power p of the useri,jPower gain h of the channeli,jAnd power noise N of the channel0Bandwidth B, computing resources f available to the cloud computing serveri,jComputing power of device j
Total computing power F with cloudedge. Then, the data rate R of the device j in the domain ii,jComprises the following steps:
in step 3, a task processing method of the AR service under the following cloud computing scene is established:
wherein the content of the first and second substances,
the end-to-end weighted time delay sum of the AR task j representing the domain i, fi,jOn behalf of the cloud computing power normalization process,
and
respectively representing the uplink and downlink transmission time delay of the task after normalization processing,
according to the method in the step 3, in the step 2, all users are set to migrate the tasks to the cloud server for task processing, the terminal processes part of the tasks at the same time, the terminal and the cloud server process the cloud AR tasks in parallel, and the proportion of data needing to be processed at the cloud server and the terminal is set as
And
and is
In step 4, the terminal sensor needs to acquire the real scene information in the real scene, including the number n of video frames included in each taski,jCorresponding to the size v of a frame in the videoi,j(Unit bit), mobile terminal processing capability
The processing delay of the terminal can be expressed as the amount of tasks processed by the terminal/the processing capability of the terminal:
in step 5, after the cloud server receives the video stream which is transmitted by the mobile terminal through the network in an uplink manner, the video stream is decoded and converted into each frame of picture, and the task transmission uplink time delay is represented as:
the time delay of the cloud end for positioning, modeling, identifying and other steps is as follows:
terminal side calculation amount
And cloud computing volume
The specific calculation method of (2) is as follows:
as shown in fig. 5, the task ratio in the AR mapping module is divided into two parts, one part is a task that the terminal side processes some computations, and the other part is a task that the cloud processing computation complexity is high. Wherein the content of the first and second substances,
respectively representing the total computation of the processing tasks of the tracking module, the mapping module and the object recognition module. The proportion of cloud-shared data in domain i is δi,j，0≤δi,jLess than or equal to 1, the corresponding terminal processing task amount is the part which can not be shared
Computing workload in cloud and each terminal for processing a task
And
can be expressed as:
the size ratio between the data result after cloud processing and the original data of uplink transmission is determined by lambdai,jIf so, the network downlink transmission delay is represented as:
in the step 6, the terminal and the cloud are in a parallel processing relationship, namely, the cloud image building module also carries out three-dimensional reconstruction and other operations on the environment while the terminal collects images. Wherein the sum of the time delays occupying the network and communication resources
So the AR end-to-end system delay can be expressed as:
considering the trend of cooperative development of the processing capacity of the network and the terminal equipment in the future, the terminal and the cloud end present a state of a distributed system, and although the processing capacity of the terminal is reserved and is improved to a certain extent, the processing capacity of the cloud end is still larger than that of the terminal. In order to reduce the waiting time delay of the user experience service, the cloud terminal and the terminal simultaneously process the cloud AR task, and the possible optimal time delay scheme can meet the requirement that the terminal processes the task time delay (namely network transmission task time delay (uplink and downlink) + cloud terminal processing task time delay.
Referring to fig. 6, an embodiment of the present invention further provides a task processing apparatus 60, applied to a user terminal, including:
the first processing module 61 is configured to perform parameter initialization on the user terminal, and send a task uninstalling request for a target task to the cloud;
the acquisition module 62 is configured to acquire task data parameters and send the task data parameters to the cloud when receiving an initialization completion instruction sent by the cloud, where the task data parameters are associated with a target task;
the first receiving module 63 is configured to receive a task processing policy sent by the cloud in response to the task offloading request;
and the unloading module 64 is configured to unload the target task to the cloud according to the task processing policy.
Optionally, the unloading module 64 may include:
the first determining unit is used for determining a first subtask executed by the user terminal and a second subtask executed by the cloud according to the task processing strategy, wherein the target task comprises the first subtask and the second subtask;
and the first sending unit is used for sending the data corresponding to the second subtask to the cloud.
Optionally, the apparatus 60 may further include:
the first acquisition module is used for acquiring a processing result returned after the cloud end processes the target task;
and the second processing module is used for decoding the processing result and displaying the picture obtained by decoding under the condition that the target task is the augmented reality processing task.
Optionally, the first processing module 61 may include:
and the initialization unit is used for initializing the number of the areas of the augmented reality scene, the number of the users participating in the augmented reality scene, the number of the tasks required to be unloaded by each user and the size of the tasks under the condition that the target task is the augmented reality processing task.
Optionally, the task data parameters include: at least one of data size of the target task, number of CPU cycles required for calculating the target task, transmission power of the user terminal, power gain of the channel, power noise of the channel, and bandwidth.
It should be noted that the apparatus is an apparatus corresponding to the above method embodiment applied to the user terminal, and all implementation manners in the above method embodiment are applicable to the embodiment of the apparatus, and the same technical effect can be achieved.
Referring to fig. 7, an embodiment of the present invention further provides a task processing device 70, applied to a cloud, including:
the third processing module 71 is configured to perform parameter initialization on the cloud, and acquire a task uninstalling request sent by the user terminal;
a first sending module 72, configured to send an initialization completion instruction to the user terminal when the cloud completes parameter initialization;
a second obtaining module 73, configured to obtain task data parameters sent by the user terminal;
the fourth processing module 74 is configured to generate a task processing policy according to the task data parameter, and send the task processing policy to the user terminal, where the task processing policy is used to instruct the user terminal to unload the target task to the cloud;
the third obtaining module 75 is configured to obtain a target task that is offloaded to the cloud by the user terminal.
Optionally, the fourth processing module 74 may include:
the second determining unit is used for determining a first subtask executed by the user terminal and a second subtask executed by the cloud according to the task data parameter, wherein the target task comprises the first subtask and the second subtask;
the allocation unit is used for allocating first resources required by executing the first subtask to the user terminal according to the first subtask;
and the second sending unit is used for sending the task processing strategy to the user terminal, wherein the task processing strategy is used for indicating the first user terminal to execute the first subtask by using the first resource.
Optionally, the second determining unit is specifically configured to: determining a first time delay and a first processing capacity of the user terminal according to the task data parameters; and determining a first subtask and a second subtask according to the first time delay, the first processing capacity and a second time delay, wherein the second time delay is the time delay from the cloud to the user terminal.
Optionally, the apparatus 70 may further include:
the fourth acquisition module is used for acquiring video stream data sent by the user terminal under the condition that the target task is an augmented reality processing task;
the fifth acquisition module is used for decoding the video stream data to obtain a target image frame;
the sixth acquisition module is used for carrying out three-dimensional reconstruction processing according to the target image frame to obtain a processing result;
and the second sending module is used for sending the processing result to the user terminal.
Optionally, the sixth obtaining module may include:
the judging unit is used for judging whether shared data corresponding to the target task exists in the cache, wherein the shared data are obtained by processing the shared data by a second user terminal requesting a cloud under an augmented reality scene corresponding to the target task;
the processing unit is used for performing three-dimensional reconstruction processing according to a first image frame in the target image frame under the condition that shared data corresponding to the target task exists, and obtaining a first processing result, wherein the processed data corresponding to the first image frame does not exist in the shared data;
and the obtaining unit is used for obtaining the processing result according to the first processing result and the shared data.
It should be noted that the apparatus is an apparatus corresponding to the method embodiment applied to the cloud, and all implementation manners in the method embodiment are applicable to the embodiment of the apparatus, and the same technical effect can be achieved.
An embodiment of the present invention further provides an electronic device, which includes a memory and a processor, where the memory stores a computer program, and the processor is configured to execute the method described above through the computer program. All the implementation manners in the above method embodiment are applicable to the embodiment of the apparatus, and the same technical effect can be achieved.
An embodiment of the present invention further provides a processor-readable storage medium, where the processor-readable storage medium stores processor-executable instructions, and the processor-executable instructions are configured to cause the processor to execute the method described above. All the implementation manners in the method embodiment are applicable to the embodiment, and the same technical effect can be achieved.
Those of ordinary skill in the art will appreciate that the various illustrative elements and algorithm steps described in connection with the embodiments disclosed herein may be implemented as electronic hardware, or combinations of computer software and electronic hardware. Whether such functionality is implemented as hardware or software depends upon the particular application and design constraints imposed on the implementation. Skilled artisans may implement the described functionality in varying ways for each particular application, but such implementation decisions should not be interpreted as causing a departure from the scope of the present invention.
It is clear to those skilled in the art that, for convenience and brevity of description, the specific working processes of the above-described systems, apparatuses and units may refer to the corresponding processes in the foregoing method embodiments, and are not described herein again.
In the embodiments provided in the present invention, it should be understood that the disclosed apparatus and method may be implemented in other ways. For example, the above-described apparatus embodiments are merely illustrative, and for example, the division of the units is only one type of logical functional division, and other divisions may be realized in practice, for example, multiple units or components may be combined or integrated into another system, or some features may be omitted, or not executed. In addition, the shown or discussed mutual coupling or direct coupling or communication connection may be an indirect coupling or communication connection through some interfaces, devices or units, and may be in an electrical, mechanical or other form.
The units described as separate parts may or may not be physically separate, and parts displayed as units may or may not be physical units, may be located in one place, or may be distributed on a plurality of network units. Some or all of the units can be selected according to actual needs to achieve the purpose of the solution of the embodiment.
In addition, functional units in the embodiments of the present invention may be integrated into one processing unit, or each unit may exist alone physically, or two or more units are integrated into one unit.
The functions may be stored in a computer-readable storage medium if they are implemented in the form of software functional units and sold or used as separate products. Based on such understanding, the technical solution of the present invention may be embodied in the form of a software product, which is stored in a storage medium and includes instructions for causing a computer device (which may be a personal computer, a server, or a network device) to execute all or part of the steps of the method according to the embodiments of the present invention. And the aforementioned storage medium includes: various media capable of storing program codes, such as a U disk, a removable hard disk, a ROM, a RAM, a magnetic disk, or an optical disk.
Furthermore, it is to be noted that in the device and method of the invention, it is obvious that the individual components or steps can be decomposed and/or recombined. These decompositions and/or recombinations are to be regarded as equivalents of the present invention. Also, the steps of performing the series of processes described above may naturally be performed chronologically in the order described, but need not necessarily be performed chronologically, and some steps may be performed in parallel or independently of each other. It will be understood by those skilled in the art that all or any of the steps or elements of the method and apparatus of the present invention may be implemented in any computing device (including processors, storage media, etc.) or network of computing devices, in hardware, firmware, software, or any combination thereof, which can be implemented by those skilled in the art using their basic programming skills after reading the description of the present invention.
The object of the invention is thus also achieved by a program or a set of programs running on any computing device. The computing device may be a general purpose device as is well known. The object of the invention is thus also achieved solely by providing a program product containing program code for implementing the method or device. That is, such a program product also constitutes the present invention, and a storage medium storing such a program product also constitutes the present invention. It is to be understood that the storage medium may be any known storage medium or any storage medium developed in the future. It is further noted that in the apparatus and method of the present invention, it is apparent that each component or step can be decomposed and/or recombined. These decompositions and/or recombinations are to be regarded as equivalents of the present invention. Also, the steps of executing the series of processes described above may naturally be executed chronologically in the order described, but need not necessarily be executed chronologically. Some steps may be performed in parallel or independently of each other.
While the foregoing is directed to the preferred embodiment of the present invention, it will be understood by those skilled in the art that various changes and modifications may be made without departing from the spirit and scope of the invention as defined in the appended claims.
Claims (14)
1. A task processing method is applied to a user terminal and is characterized by comprising the following steps:
initializing parameters of the user terminal, and sending a task unloading request aiming at a target task to a cloud;
under the condition that an initialization completion instruction sent by the cloud is received, task data parameters are collected and sent to the cloud, wherein the task data parameters are associated with the target task;
receiving a task processing strategy sent by the cloud end in response to the task unloading request;
and unloading the target task to the cloud according to the task processing strategy.
2. The method of claim 1, wherein offloading the target task to the cloud in accordance with the task processing policy comprises:
determining a first subtask executed by the user terminal and a second subtask executed by the cloud according to the task processing policy, wherein the target task comprises the first subtask and the second subtask;
and sending the data corresponding to the second subtask to the cloud.
3. The method of claim 1, wherein after offloading the target task to the cloud in accordance with the task processing policy, the method further comprises:
acquiring a processing result returned after the cloud processes the target task;
and under the condition that the target task is an augmented reality processing task, decoding the processing result and displaying a picture obtained by decoding.
4. The method according to any of claims 1 to 3, wherein the parameter initialization for the UE comprises:
and initializing the number of regions of the augmented reality scene, the number of users participating in the augmented reality scene, the number of tasks required to be unloaded by each user and the size of the tasks under the condition that the target task is an augmented reality processing task.
5. The method of any of claims 1 to 3, wherein the task data parameters comprise: the data size of the target task, the number of CPU cycles required for calculating the target task, the transmitting power of the user terminal, the power gain of a channel, the power noise of the channel, and at least one of the bandwidth.
6. A task processing method is applied to a cloud end and is characterized by comprising the following steps:
initializing parameters of the cloud and acquiring a task unloading request sent by a user terminal;
sending an initialization completion instruction to the user terminal under the condition that the cloud end completes parameter initialization;
acquiring task data parameters sent by the user terminal;
generating a task processing strategy according to the task data parameters, and sending the task processing strategy to the user terminal, wherein the task processing strategy is used for indicating the user terminal to unload a target task to the cloud;
and acquiring the target task unloaded to the cloud end by the user terminal.
7. The method of claim 6, wherein generating a task processing policy according to the task data parameters and sending the task processing policy to the user terminal comprises:
determining a first subtask executed by the user terminal and a second subtask executed by the cloud according to the task data parameter, wherein the target task comprises the first subtask and the second subtask;
according to the first subtask, allocating a first resource required for executing the first subtask to the user terminal;
and sending a task processing strategy to the user terminal, wherein the task processing strategy is used for indicating the first user terminal to execute the first subtask by using the first resource.
8. The method of claim 7, wherein determining a first subtask executed by the user terminal and a second subtask executed by the cloud according to the task data parameter comprises:
determining a first time delay and a first processing capacity of the user terminal according to the task data parameters;
and determining the first subtask and the second subtask according to the first time delay, the first processing capacity and a second time delay, wherein the second time delay is the time delay from the cloud to the user terminal.
9. The method of claim 6, wherein after obtaining the target task offloaded by the user terminal to the cloud, the method further comprises:
under the condition that the target task is an augmented reality processing task, acquiring video stream data sent by the user terminal;
decoding the video stream data to obtain a target image frame;
performing three-dimensional reconstruction processing according to the target image frame to obtain a processing result;
and sending the processing result to the user terminal.
10. The method according to claim 9, wherein performing three-dimensional reconstruction processing based on the target image frame to obtain a processing result comprises:
judging whether shared data corresponding to the target task exists in a cache, wherein the shared data is obtained by a second user terminal requesting a cloud end to process in an augmented reality scene corresponding to the target task;
under the condition that shared data corresponding to the target task exist, performing three-dimensional reconstruction processing according to a first image frame in the target image frames to obtain a first processing result, wherein the processing data corresponding to the first image frame does not exist in the shared data;
and obtaining the processing result according to the first processing result and the shared data.
11. A task processing device applied to a user terminal is characterized by comprising:
the first processing module is used for initializing parameters of the user terminal and sending a task unloading request aiming at a target task to the cloud;
the system comprises an acquisition module, a processing module and a processing module, wherein the acquisition module is used for acquiring task data parameters and sending the task data parameters to the cloud under the condition of receiving an initialization completion instruction sent by the cloud, and the task data parameters are associated with the target task;
the first receiving module is used for receiving a task processing strategy sent by the cloud end in response to the task unloading request;
and the unloading module is used for unloading the target task to the cloud end according to the task processing strategy.
12. The utility model provides a task processing apparatus, is applied to the high in the clouds, its characterized in that includes:
the third processing module is used for carrying out parameter initialization on the cloud end and acquiring a task unloading request sent by the user terminal;
the first sending module is used for sending an initialization completion instruction to the user terminal under the condition that the cloud end completes parameter initialization;
the second acquisition module is used for acquiring the task data parameters sent by the user terminal;
the fourth processing module is used for generating a task processing strategy according to the task data parameters and sending the task processing strategy to the user terminal, wherein the task processing strategy is used for indicating the user terminal to unload a target task to the cloud end;
and the third acquisition module is used for acquiring the target task unloaded to the cloud end by the user terminal.
13. An electronic device comprising a memory and a processor, wherein the memory has stored therein a computer program and the processor is arranged to execute the method of any of claims 1 to 10 by means of the computer program.
14. A processor-readable storage medium having stored thereon processor-executable instructions for causing a processor to perform the method of any one of claims 1 to 10.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110005306.6A CN114780163A (en) | 2021-01-05 | 2021-01-05 | Task processing method and device and electronic equipment |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110005306.6A CN114780163A (en) | 2021-01-05 | 2021-01-05 | Task processing method and device and electronic equipment |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN114780163A true CN114780163A (en) | 2022-07-22 |
Family
ID=82407766
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202110005306.6A Pending CN114780163A (en) | 2021-01-05 | 2021-01-05 | Task processing method and device and electronic equipment |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN114780163A (en) |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20190197339A1 (en) * | 2017-12-21 | 2019-06-27 | At&T Intellectual Property I, L.P. | Adaptive Cloud Offloading of Mobile Augmented Reality |
| CN110851277A (en) * | 2019-11-08 | 2020-02-28 | 中国石油大学(华东) | Task scheduling strategy based on edge cloud cooperation in augmented reality scene |
| CN111708620A (en) * | 2020-05-08 | 2020-09-25 | 北京中科晶上超媒体信息技术有限公司 | Task unloading method with charging mechanism |
| CN111970323A (en) * | 2020-07-10 | 2020-11-20 | 北京大学 | Time delay optimization method and device for cloud-edge multi-layer cooperation in edge computing network |
-
2021
- 2021-01-05 CN CN202110005306.6A patent/CN114780163A/en active Pending
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20190197339A1 (en) * | 2017-12-21 | 2019-06-27 | At&T Intellectual Property I, L.P. | Adaptive Cloud Offloading of Mobile Augmented Reality |
| CN110851277A (en) * | 2019-11-08 | 2020-02-28 | 中国石油大学(华东) | Task scheduling strategy based on edge cloud cooperation in augmented reality scene |
| CN111708620A (en) * | 2020-05-08 | 2020-09-25 | 北京中科晶上超媒体信息技术有限公司 | Task unloading method with charging mechanism |
| CN111970323A (en) * | 2020-07-10 | 2020-11-20 | 北京大学 | Time delay optimization method and device for cloud-edge multi-layer cooperation in edge computing network |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN110227259B (en) | Data processing method, device, server and system | |
| Liu et al. | Dare: Dynamic adaptive mobile augmented reality with edge computing | |
| CN111681167B (en) | Image quality adjusting method and device, storage medium and electronic equipment | |
| CN111026547B (en) | Edge computing server resource allocation method based on auction mechanism | |
| CN110519370B (en) | Edge computing resource allocation method based on facility site selection problem | |
| CN111614967B (en) | Live virtual image broadcasting method and device, electronic equipment and storage medium | |
| CN111182303A (en) | Encoding method and device for shared screen, computer readable medium and electronic equipment | |
| CN112839184B (en) | Image processing method, image processing device, electronic equipment and storage medium | |
| CN110069341A (en) | What binding function configured on demand has the dispatching method of dependence task in edge calculations | |
| CN116389831A (en) | Yun Yuansheng-based offline rendering system and method | |
| WO2022000298A1 (en) | Reinforcement learning based rate control | |
| CN112488907A (en) | Data processing method and system | |
| KR20210147240A (en) | Energy Optimization Scheme of Mobile Devices for Mobile Augmented Reality Applications in Mobile Edge Computing | |
| CN108965364B (en) | Resource allocation method, device and system | |
| CN115242800B (en) | Game theory-based mobile edge computing resource optimization method and device | |
| CN117115326A (en) | Rendering method and device of three-dimensional scene model and distributed rendering server | |
| CN114780163A (en) | Task processing method and device and electronic equipment | |
| CN114900717B (en) | Video data transmission method, device, medium and computing equipment | |
| CN116567247A (en) | Video encoding method, real-time communication method, device, equipment and storage medium | |
| CN109391817A (en) | Data texturing transmission method and device | |
| CN110944335B (en) | Resource allocation method and device for virtual reality service | |
| CN113792869A (en) | Video processing method and device based on neural network chip and electronic equipment | |
| CN114741198B (en) | Video stream processing method and device, electronic equipment and computer readable medium | |
| CN116996661B (en) | Three-dimensional video display method, device, equipment and medium | |
| CN114928757B (en) | 360-degree VR video data transmission method and device based on millimeter waves |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |