CN113391872A - Task processing method and device, electronic equipment and storage medium - Google Patents
Task processing method and device, electronic equipment and storage medium Download PDFInfo
- Publication number
- CN113391872A CN113391872A CN202010164729.8A CN202010164729A CN113391872A CN 113391872 A CN113391872 A CN 113391872A CN 202010164729 A CN202010164729 A CN 202010164729A CN 113391872 A CN113391872 A CN 113391872A
- Authority
- CN
- China
- Prior art keywords
- target
- tool
- task
- program
- tool program
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F9/00—Arrangements for program control, e.g. control units
- G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
- G06F9/44—Arrangements for executing specific programs
- G06F9/455—Emulation; Interpretation; Software simulation, e.g. virtualisation or emulation of application or operating system execution engines
- G06F9/45533—Hypervisors; Virtual machine monitors
- G06F9/45558—Hypervisor-specific management and integration aspects
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F8/00—Arrangements for software engineering
- G06F8/60—Software deployment
- G06F8/61—Installation
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F9/00—Arrangements for program control, e.g. control units
- G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
- G06F9/44—Arrangements for executing specific programs
- G06F9/455—Emulation; Interpretation; Software simulation, e.g. virtualisation or emulation of application or operating system execution engines
- G06F9/45533—Hypervisors; Virtual machine monitors
- G06F9/45558—Hypervisor-specific management and integration aspects
- G06F2009/45562—Creating, deleting, cloning virtual machine instances
Abstract
The embodiment of the application provides a task processing method and device, electronic equipment and a storage medium. The task processing method provided by the embodiment of the application is applied to task processing equipment, and the method comprises the following steps: acquiring a target task to be processed; processing the target task by utilizing a container instance which is created locally and relates to the target tool program; wherein the target tool program is a tool program required when the target task is processed; the container instance related to the target tool program is a container instance created by running an image file of the target tool program. By the aid of the technical scheme, the problem that the accuracy of task processing is affected due to insufficient safety of the tool programs installed in the task processing equipment in the related technology can be solved.
Description
Technical Field
The present application relates to the field of task scheduling technologies, and in particular, to a task processing method and apparatus, an electronic device, and a storage medium.
Background
In order to realize task processing, a scheduling node in the task scheduling system allocates tasks to the task processing equipment according to a preset scheduling flow, and then the task processing equipment realizes the processing of the tasks. The task processing device may be a device in the scheduling system, or may be a device associated with the scheduling system for executing a task.
In the related art, when a task processing device obtains a task to be processed, a tool program installed locally by the task processing device and required for processing the task is called to process the task.
The inventor finds that the related art has at least the following problems in the process of implementing the application:
the security of the tool program installed in the task processing apparatus is insufficient, resulting in the accuracy of the processing result of the task processing being affected.
Disclosure of Invention
An object of the embodiments of the present application is to provide a task processing method, a task processing apparatus, an electronic device, and a storage medium, so as to solve a problem in the related art that accuracy of a processing result of task processing is affected due to insufficient security of a tool program installed in a task processing device. The specific technical scheme is as follows:
in a first aspect, an embodiment of the present application provides a task processing method, which is applied to a task processing device, and the method includes:
acquiring a target task to be processed;
processing the target task by utilizing a container instance which is created locally and relates to the target tool program;
wherein the target tool program is a tool program required when the target task is processed; the container instance related to the target tool program is a container instance created by running an image file of the target tool program.
Optionally, in an implementation, the processing the target task by using a container instance created locally for a target utility includes:
sending a tool request carrying identification information of the target tool program to a preset tool management end, so that the tool management end determines an image file of the target tool program according to the identification information in the tool request and feeds the determined image file back to the task processing equipment;
creating a container instance related to the target tool program by running the mirror image file fed back by the tool management terminal;
processing the target task using the created container instance for the target utility.
Optionally, in an implementation manner, before sending the tool request carrying the identification information of the target tool program to a predetermined tool management end, the method further includes:
judging whether a container instance related to the target tool program is created locally or not based on the identification information of the target tool program;
if not, executing a step of sending a tool request carrying the identification information of the target tool program to a preset tool management end;
If so, the target task is processed by utilizing the container instance which is created locally and relates to the target tool program.
Optionally, in an implementation manner, before the processing the target task by using a locally created container instance related to the target utility, the method further includes:
judging whether a first version and a second version are the same, wherein the first version is a container example which is created locally and is related to the target tool program, and a tool program version is represented; the second version is a tool program version represented by an image file of the target tool program in the tool management terminal;
if yes, executing the step of processing the target task by utilizing the locally created container instance related to the target tool program;
and if not, executing the step of sending the tool request carrying the identification information of the target tool program to a preset tool management end.
Optionally, in an implementation manner, the method further includes:
after the target task is processed, obtaining a judgment result given by a user aiming at a processing result of the target task;
And sending the judgment result to the tool management end so that the tool management end determines the performance analysis result of the target tool program based on the judgment result.
In a second aspect, an embodiment of the present application provides a task processing apparatus, which is applied to a task processing device, and the apparatus includes:
the task obtaining module is used for obtaining a target task to be processed;
the task processing module is used for processing the target task by utilizing a container instance which is created locally and relates to the target tool program;
wherein the target tool program is a tool program required when the target task is processed; the container instance related to the target tool program is a container instance created by running an image file of the target tool program.
Optionally, in an implementation manner, the task processing module includes:
a request sending submodule, configured to send a tool request carrying identification information of the target tool program to a predetermined tool management terminal, so that the tool management terminal determines an image file of the target tool program according to the identification information in the tool request, and feeds back the determined image file to the task processing device;
The instance creating submodule is used for creating a container instance related to the target tool program by running the mirror image file fed back by the tool management terminal;
and the task processing submodule is used for processing the target task by utilizing the created container instance related to the target tool program.
Optionally, in an implementation manner, the apparatus further includes:
a first analysis module, configured to, before the request sending sub-module sends a tool request carrying identification information of the target tool program to a predetermined tool management terminal, determine, based on the identification information of the target tool program, whether a container instance related to the target tool program has been created locally, and if not, trigger the request sending sub-module; if yes, triggering a local processing module;
the local processing module is used for processing the target task by utilizing the container instance which is created locally and related to the target tool program.
Optionally, in an implementation manner, the apparatus further includes:
a second analysis module, configured to, before the local processing module processes the target task, determine whether a first version and a second version are the same version by using a locally created container instance related to the target utility, where the first version is a locally created container instance related to the target utility and a characterized utility version; the second version is a tool program version represented by an image file of the target tool program in the tool management terminal; if yes, triggering the local processing module; and if not, triggering the request sending submodule.
Optionally, in an implementation manner, the apparatus further includes:
the judgment result obtaining module is used for obtaining a judgment result given by a user aiming at the processing result of the target task after the target task is processed;
and the result reporting module is used for sending the judgment result to the tool management end so that the tool management end determines the performance analysis result of the target tool program based on the judgment result.
In a third aspect, an embodiment of the present application provides a task processing system, including: the system comprises a task processing device and a management device running with a tool management end;
the task processing equipment is used for acquiring a target task to be processed; sending a tool request carrying identification information of a target tool program to the management equipment, so that the management equipment determines an image file of the target tool program according to the identification information in the tool request and feeds back the determined image file to the task processing equipment; creating a container instance related to the target tool program by running the mirror image file fed back by the tool management terminal; processing the target task using the created container instance for the target utility; wherein the target tool program is a tool program required when the target task is processed;
And the management device is used for determining an image file of the target tool program according to the identification information in the tool request after receiving the tool request sent by the task processing device, and feeding back the determined image file to the task processing device.
In a fourth aspect, an embodiment of the present application provides an electronic device, including a processor, a communication interface, a memory, and a communication bus, where the processor and the communication interface complete communication between the memory and the processor through the communication bus;
a memory for storing a computer program;
a processor, configured to implement the steps of any of the task processing methods according to the first aspect when executing the program stored in the memory.
In a fifth aspect, the present application provides a computer-readable storage medium, in which a computer program is stored, and the computer program, when executed by a processor, implements the steps of any of the task processing methods described in the first aspect.
According to the scheme provided by the embodiment of the application, when the target task to be processed is obtained, the target task is processed by using a container instance which is created locally and is related to a target tool program; wherein, the target tool program is a tool program required when the target task is processed; the container instance related to the target tool program is a container instance created by running an image file of the target tool program. Because the tool program exists in the form of the container instance created when the image file is run, and the container instance has higher security compared with the tool program installed locally, the problem that the accuracy of the processing result of the task processing is influenced due to insufficient security of the tool program installed in the task processing equipment in the related art can be solved through the scheme.
Of course, not all advantages described above need to be achieved at the same time in the practice of any one product or method of the present application.
Drawings
In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings used in the description of the embodiments or the prior art will be briefly described below, it is obvious that the drawings in the following description are only some embodiments of the present invention, and for those skilled in the art, other drawings can be obtained according to the drawings without creative efforts.
Fig. 1 is a flowchart of a task processing method provided in an embodiment of the present application;
FIG. 2 is another flowchart of a task processing method provided in an embodiment of the present application;
FIG. 3 is another flowchart of a task processing method provided in an embodiment of the present application;
fig. 4 is a schematic structural diagram of a task processing device according to an embodiment of the present application;
fig. 5 is another schematic structural diagram of a task processing device according to an embodiment of the present application;
fig. 6 is a schematic structural diagram of a task processing system according to an embodiment of the present application;
fig. 7 is a schematic structural diagram of an electronic device according to an embodiment of the present application;
Fig. 8 is a schematic diagram illustrating a task processing method according to an embodiment of the present disclosure.
Detailed Description
The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
In order to solve the problem that the accuracy of a processing result of task processing is affected due to insufficient safety of a tool program installed in task processing equipment in the related art, embodiments of the present application provide a task processing method and apparatus, an electronic device, and a storage medium.
First, a task processing method provided in an embodiment of the present application is described below.
The task processing method provided by the embodiment of the application is applied to the task processing equipment. In a specific application, the task processing device may be a device in a scheduling system, for example: working nodes in the Apache AirFlow scheduling system; of course, the task processing device may also be a device associated with the scheduling system for performing tasks, such as: the Apache Oozie scheduling system is associated with a Hadoop big data cluster YARN node. The invention of the application is not in the scheduling process of the scheduling system, so the generation process of the task and the scheduling issuing process of the task are not limited.
In addition, the tool program mentioned in the embodiments of the present application is a program object capable of realizing a predetermined processing function; the facility required for different tasks may be the same or different. Further, a tool program required for any task is set in advance. The following are exemplary: the tool program may be: phthon, java, shell and the like.
As shown in fig. 1, a task processing method provided in the embodiment of the present application may include the following steps:
s101, acquiring a target task to be processed;
s102, processing the target task by using a container instance which is created locally and is related to the target tool program;
wherein, the target tool program is a tool program required when the target task is processed; the container instance related to the target tool program is a container instance created by running an image file of the target tool program.
In S101, it is reasonable that the target task to be processed is issued by the scheduling node, or the task processing device obtains from the task queue. And, the task data of the target task may include: task item information, the task item information is used for indicating what to do, and correspondingly, the task data of the target task can indicate what to do; of course, the task data of the target task may include, in addition to the task item information: identification information of the facility program required to process the target task, at which point the task data of the target task may indicate what to do with what facility.
In S102, after the target task is obtained, the target task may be processed by using a container instance created locally for the target utility.
It should be noted that there are many ways to implement the processing of the target task by using the container instance created locally with respect to the target tool program.
For example, in an implementation manner, in a scenario where container instances of respective tools are created, processing the target task by using a container instance created locally with respect to a target tool may include:
and searching the container instance related to the target tool program from each container instance which is created locally by utilizing the identification information of the target tool program.
In other implementations, the identification information may be utilized to obtain the image file of the target utility from local/remote locations, and run the image file of the target utility to create a container instance related to the target utility. The container engine can pack the application program and the dependency thereof in the image file. Also, the container engine may create a container instance from the image file. Moreover, the same image file can generate a plurality of container instances running simultaneously. In actual development, one image file can be generated by inheriting another image file and adding some personalized settings. Accordingly, the image of the facility is the image of the packaged facility and its dependencies.
Based on the above implementation, the identification information of the target utility serves as a basis for determining the container instance of the target utility. It is understood that the task data of the target task includes different contents, and the identification information of the target utility program may be determined in different ways. The task data for the target task may include: in the case of the task item information, the identification information of the target tool program may be determined based on a mapping relationship between the preset task item information and the identification information of the tool program. In the case where the task data of the target task includes both the task item information and the identification information of the target tool program, the identification information of the target tool program may be acquired from the task data of the target task.
In addition, in processing the target task, parameters of the target task related to task item information may be passed for the container instance related to the target utility, so that the container instance related to the target utility performs a data processing flow using the received parameters. Wherein the parameters related to the transfer are the same as those utilized when the target task is processed by the installed target tool program in the prior art. It is also reasonable that, when processing the target task, data necessary for processing the target task may be requested from another data storage device.
According to the scheme provided by the embodiment of the application, when the target task to be processed is obtained, the target task is processed by using a container instance which is created locally and is related to a target tool program; wherein, the target tool program is a tool program required when the target task is processed; the container instance related to the target tool program is a container instance created by running an image file of the target tool program. Because the tool program exists in the form of the container instance created when the image file is run, and the container instance has higher security compared with the tool program installed locally, the problem that the accuracy of the processing result of the task processing is influenced due to insufficient security of the tool program installed in the task processing equipment in the related art can be solved through the scheme.
In order to uniformly manage the tool programs of the task processing devices, a tool management end can be set, and the tool management end can provide the mirror image files of the tool programs for the task processing devices, so that the tool programs are concentrated on the tool management end, and the management convenience is greatly improved. The tool management terminal may be a program running on the management device, and the plurality of task processing devices may request the tool management terminal in the management device for an image file of the tool program. And, in a specific application, the management device may be a terminal device or a server, which is reasonable.
Based on the processing idea, as shown in fig. 2, the task processing method provided in the embodiment of the present application, applied to a task processing device, may include the following steps:
s201, acquiring a target task to be processed;
s202, sending a tool request carrying the identification information of the target tool program to a preset tool management end, so that the tool management end determines the image file of the target tool program according to the identification information in the tool request and feeds back the determined image file to the task processing equipment;
s203, creating a container instance related to the target tool program by running the mirror image file fed back by the tool management end;
s204, the created container instance related to the target tool program is utilized to process the target task.
S201 is the same as S101, and is not described herein.
In S202, after the target task to be processed is obtained, the identification information of the target tool program required when the target task is processed may be obtained, and then the image file of the target tool program is requested from the tool management end by using the identification information as a request basis. For the related description content of the image file, refer to the description content of the image file in the above embodiment.
In addition, the tool management side stores in advance the image files of the tool programs required for the respective tasks. In addition, in order to ensure that the image file of the tool program can be found through the identification information of the tool program, the image file of each tool program may be named by the identification information of the corresponding tool program, or the image file of each tool program may correspond to the identification information of the tool program.
In S203, after obtaining the image file fed back by the tool management side, a container instance related to the target tool program may be created by running the image file fed back by the tool management side, so as to form a locally created container instance related to the target tool program. The method for running the image file of the target utility program may refer to a method for running any type of image file in the prior art, which is not limited herein, for example, the image file is run by a container engine, but is not limited thereto.
In S204, when the target task is processed by using the created container instance related to the target utility, parameters related to task item information of the target task may be passed for the container instance related to the target utility, so that the container instance related to the target utility performs a data processing flow by using the received parameters. Wherein the parameters related to the transfer are the same as those utilized when the target task is processed by the installed target tool program in the prior art. It is also reasonable that, when processing the target task, data necessary for processing the target task may be requested from another data storage device.
In addition, after the execution of S204 is completed, the container instance of the target tool program may be destroyed, so as to reduce the occupation of the storage space.
For ease of understanding, fig. 8 gives a schematic view of the principle that the task processing device processes the task 1 to be processed. In fig. 8, the task processing device obtains a task 1 to be processed, and the task data of the task 1 can indicate what tool is taken, what is done, and what is done; acquiring an image file A of a tool program a from a tool management terminal based on identification information of the tool program a required when the task 1 is executed; and creating a container instance of the tool program a through the image file A, and further running the container instance of the tool program a to process the task 1. Wherein the external big data service can be accessed when processing task 1.
In the solution provided by the embodiment of the present application, because the tool program exists in the form of the container instance created when the image file is run, and the container instance has higher security compared with the tool program installed locally, the problem that the accuracy of the processing result of the task processing is affected due to insufficient security of the tool program installed in the task processing device in the related art can be solved by the solution. In addition, by setting the tool management end, the tool programs of all the task processing devices can be managed in a unified mode, so that the tool programs are concentrated on the tool management end, and convenience of management is greatly improved.
On the basis of setting a tool management end, the management convenience of a tool program is improved and the consumption of network bandwidth is reduced by combining a local mode with a remote mode.
Based on the processing idea, as shown in fig. 3, the task processing method provided in the embodiment of the present application is applied to a task processing device, and may include the following steps:
s301, acquiring a target task to be processed;
s302, based on the identification information of the target tool program, judging whether a container instance related to the target tool program is established locally, if not, executing S303; if yes, executing S306;
s303, sending a tool request carrying the identification information of the target tool program to a preset tool management end, so that the tool management end determines the image file of the target tool program according to the identification information in the tool request and feeds back the determined image file to the task processing equipment;
s304, creating a container instance related to the target tool program by running the mirror image file fed back by the tool management end;
s305, processing the target task by using the created container instance related to the target tool program;
s306, the container instance which is created locally and is related to the target tool program is utilized to process the target task.
S301 is the same as S101 described above, and will not be described herein.
In S302, after obtaining the target task, identification information of the target utility needed when the target task is processed may be obtained, and further, it may be determined whether a container instance related to the target utility has been created locally based on the identification information of the target utility, and different processing may be performed according to different execution results. If the result of the determination is negative, S303 may be executed to request the predetermined tool management terminal for the image file of the target tool program, and then run the requested image file, and create a container instance of the target tool program; and when the judgment result is yes, S306 may be executed to process the target task by using the container instance that has been created locally for the target utility.
For the contents of S303 to S305, reference may be made to the contents of S202 to S204 in the above embodiments, which are not described herein again.
In addition, since the version of the tool program managed by the tool management side can be updated, in order to ensure that the tool program used by the task processing device is the latest version, the version matching analysis can be performed, and then different processing flows can be performed according to the result of the version matching analysis. Based on the processing idea, optionally, before utilizing the locally created container instance related to the target utility when it is determined that the container instance related to the target utility is locally created, the method provided in the embodiment of the present application may further include:
Judging whether the first version and the second version are the same, wherein the first version is a container example which is created locally and is related to the target tool program, and the first version is a characterized tool program version; the second version is a tool program version represented by the image file of the target tool program in the tool management terminal;
if yes, executing the step of processing the target task by utilizing the locally created container instance related to the target tool program;
and if not, executing the step of sending the tool request carrying the identification information of the target tool program to a preset tool management end, further, after obtaining the image file fed back by the tool management end, creating a container instance related to the target tool program by running the image file fed back by the tool management end, and processing the target task by utilizing the created container instance related to the target tool program.
The task execution device may send a data request carrying identification information of the target tool program to the tool management end, so as to request the tool management end for version information of a tool program version represented by an image file of the target tool program. Moreover, since the task execution device can find the locally created container instance related to the target utility program, and the target utility program runs in the container instance, the task processing device can know the locally created container instance related to the target utility program and the characterized utility program version.
In the solution provided by the embodiment of the present application, because the tool program exists in the form of the container instance created when the image file is run, and the container instance has higher security compared with the tool program installed locally, the problem that the accuracy of the processing result of the task processing is affected due to insufficient security of the tool program installed in the task processing device in the related art can be solved by the solution. In addition, by setting the tool management end, the tool programs of the execution devices can be managed in a unified mode, so that the tool programs are concentrated on the tool management end, and convenience of management is greatly improved. Meanwhile, the bandwidth consumption brought by the data request can be reduced by combining the local mode and the remote mode.
Optionally, for any embodiment in which a predetermined tool management end exists, the task processing method provided in the embodiment of the present application may further include:
after the target task is processed, obtaining a judgment result given by a user aiming at the processing result of the target task;
and sending the judgment result to the tool management terminal so that the tool management terminal determines the performance analysis result of the tool program based on the judgment result.
The task processing equipment can obtain the judgment result given by the user aiming at the processing result of the target task by showing a judgment interface containing the processing result of the target task to the user. The judgment result can be an accurate or inaccurate dichotomous result, and can also be a scoring score, which is reasonable.
In addition, the tool management terminal may determine a performance analysis result of the target tool program based on a judgment result reported by one or more task processing devices, and then subsequently determine whether the target tool program continues to be applied. The performance analysis results may be stable or unstable, better or worse, etc. The specific implementation manner of determining the performance analysis result of the target tool program is various based on the evaluation result reported by one or more task processing devices, and the embodiment of the present application is not limited thereto.
Corresponding to the method embodiment, the embodiment of the application provides a task processing device. As shown in fig. 4, a task processing device provided in an embodiment of the present application may include:
a task obtaining module 410, configured to obtain a target task to be processed;
A task processing module 420, configured to process the target task by using a container instance created locally for the target tool program;
wherein the target tool program is a tool program required when the target task is processed; the container instance related to the target tool program is a container instance created by running an image file of the target tool program.
According to the scheme provided by the embodiment of the application, when the target task to be processed is obtained, the target task is processed by using a container instance which is created locally and is related to a target tool program; wherein, the target tool program is a tool program required when the target task is processed; the container instance related to the target tool program is a container instance created by running an image file of the target tool program. Because the tool program exists in the form of the container instance created when the image file is run, and the container instance has higher security compared with the tool program installed locally, the problem that the accuracy of the processing result of the task processing is influenced due to insufficient security of the tool program installed in the task processing equipment in the related art can be solved through the scheme.
Alternatively, as shown in fig. 5, the task processing module 420 may include:
a request sending submodule 421, configured to send a tool request carrying identification information of the target tool program to a predetermined tool management end, so that the tool management end determines an image file of the target tool program according to the identification information in the tool request, and feeds back the determined image file to the task processing device;
an instance creating sub-module 422, configured to create a container instance related to the target tool program by running the image file fed back by the tool management side;
a task processing sub-module 423 for processing the target task using the created container instance for the target utility.
Optionally, the apparatus further comprises:
a first analysis module, configured to, before the request sending sub-module sends a tool request carrying identification information of the target tool program to a predetermined tool management terminal, determine, based on the identification information of the target tool program, whether a container instance related to the target tool program has been created locally, and if not, trigger the request sending sub-module; if yes, triggering a local processing module;
The local processing module is used for processing the target task by utilizing the container instance which is created locally and related to the target tool program.
Optionally, the apparatus further comprises:
a second analysis module, configured to, before the local processing module processes the target task, determine whether a first version and a second version are the same version by using a locally created container instance related to the target utility, where the first version is a locally created container instance related to the target utility and a characterized utility version; the second version is a tool program version represented by an image file of the target tool program in the tool management terminal; if yes, triggering the local processing module; and if not, triggering the request sending submodule.
Optionally, the apparatus further comprises:
the judgment result obtaining module is used for obtaining a judgment result given by a user aiming at the processing result of the target task after the target task is processed;
and the result reporting module is used for sending the judgment result to the tool management end so that the tool management end determines the performance analysis result of the target tool program based on the judgment result.
Based on the method embodiment, the embodiment of the application also provides a task processing system. As shown in fig. 6, the task processing system includes: a task processing device 610 and a management device 620 running a tool management side;
the task processing device 610 is used for acquiring a target task to be processed; sending a tool request carrying identification information of a target tool program to the management device, so that the management device 620 determines an image file of the target tool program according to the identification information in the tool request and feeds back the determined image file to the task processing device; creating a container instance related to the target tool program by running the mirror image file fed back by the tool management terminal; processing the target task using the created container instance for the target utility; wherein the target tool program is a tool program required when the target task is processed;
the management device 620 is configured to, after receiving the tool request sent by the task processing device, determine an image file of the target tool program according to the identification information in the tool request, and feed back the determined image file to the task processing device.
In the solution provided by the embodiment of the present application, because the tool program exists in the form of the container instance created when the image file is run, and the container instance has higher security compared with the tool program installed locally, the problem that the accuracy of the processing result of the task processing is affected due to insufficient security of the tool program installed in the task processing device in the related art can be solved by the solution. In addition, by setting the tool management end, the tool programs of all the task processing devices can be managed in a unified mode, so that the tool programs are concentrated on the tool management end, and convenience of management is greatly improved.
Optionally, the task processing device 610 is further configured to, before sending the tool request carrying the identification information of the target tool program to a predetermined tool management end, determine whether a container instance related to the target tool program has been created locally based on the identification information of the target tool program;
if not, executing a step of sending a tool request carrying the identification information of the target tool program to a preset tool management end;
if so, the target task is processed by utilizing the container instance which is created locally and relates to the target tool program.
Optionally, the task processing device 610 is further configured to, before processing the target task by using a locally created container instance related to the target utility, determine whether a first version and a second version are the same version, where the first version is a locally created container instance related to the target utility, and is a characterized utility version; the second version is a tool program version represented by an image file of the target tool program in the tool management terminal;
if yes, executing the step of processing the target task by utilizing the locally created container instance related to the target tool program;
and if not, executing the step of sending the tool request carrying the identification information of the target tool program to a preset tool management end.
Optionally, the task processing device 610 is further configured to obtain, after the target task is processed, a judgment result given by a user for a processing result of the target task; sending the judgment result to the tool management equipment;
the tool management device 620 is further configured to determine a performance analysis result of the target tool program based on the evaluation result.
In addition, an electronic device is provided in this embodiment of the present application, as shown in fig. 7, and includes a processor 701, a communication interface 702, a memory 703 and a communication bus 704, where the processor 701, the communication interface 702, and the memory 703 complete mutual communication through the communication bus 704,
a memory 703 for storing a computer program;
the processor 701 is configured to implement the steps of any task processing method provided in the embodiment of the present application when executing the program stored in the memory 703.
The communication bus mentioned in the electronic device may be a Peripheral Component Interconnect (PCI) bus, an Extended Industry Standard Architecture (EISA) bus, or the like. The communication bus may be divided into an address bus, a data bus, a control bus, etc. For ease of illustration, only one thick line is shown, but this does not mean that there is only one bus or one type of bus.
The communication interface is used for communication between the electronic equipment and other equipment.
The Memory may include a Random Access Memory (RAM) or a Non-Volatile Memory (NVM), such as at least one disk Memory. Optionally, the memory may also be at least one memory device located remotely from the processor.
The Processor may be a general-purpose Processor, including a Central Processing Unit (CPU), a Network Processor (NP), and the like; but also Digital Signal Processors (DSPs), Application Specific Integrated Circuits (ASICs), Field Programmable Gate Arrays (FPGAs) or other Programmable logic devices, discrete Gate or transistor logic devices, discrete hardware components.
In yet another embodiment provided by the present application, a computer-readable storage medium is further provided, in which a computer program is stored, and the computer program realizes the steps of any one of the above task processing methods when executed by a processor.
In yet another embodiment provided by the present application, there is also provided a computer program product containing instructions which, when run on a computer, cause the computer to perform the steps of any of the task processing methods of the above embodiments.
In the above embodiments, the implementation may be wholly or partially realized by software, hardware, firmware, or any combination thereof. When implemented in software, may be implemented in whole or in part in the form of a computer program product. The computer program product includes one or more computer instructions. When loaded and executed on a computer, cause the processes or functions described in accordance with the embodiments of the application to occur, in whole or in part. The computer may be a general purpose computer, a special purpose computer, a network of computers, or other programmable device. The computer instructions may be stored in a computer readable storage medium or transmitted from one computer readable storage medium to another, for example, from one website site, computer, server, or data center to another website site, computer, server, or data center via wired (e.g., coaxial cable, fiber optic, Digital Subscriber Line (DSL)) or wireless (e.g., infrared, wireless, microwave, etc.). The computer-readable storage medium can be any available medium that can be accessed by a computer or a data storage device, such as a server, a data center, etc., that incorporates one or more of the available media. The usable medium may be a magnetic medium (e.g., floppy Disk, hard Disk, magnetic tape), an optical medium (e.g., DVD), or a semiconductor medium (e.g., Solid State Disk (SSD)), among others.
It is noted that, herein, relational terms such as first and second, and the like may be used solely to distinguish one entity or action from another entity or action without necessarily requiring or implying any actual such relationship or order between such entities or actions. Also, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other identical elements in a process, method, article, or apparatus that comprises the element.
All the embodiments in the present specification are described in a related manner, and the same and similar parts among the embodiments may be referred to each other, and each embodiment focuses on the differences from the other embodiments. In particular, for the apparatus embodiment, since it is substantially similar to the method embodiment, the description is relatively simple, and for the relevant points, reference may be made to the partial description of the method embodiment.
The above description is only for the preferred embodiment of the present application, and is not intended to limit the scope of the present application. Any modification, equivalent replacement, improvement and the like made within the spirit and principle of the present application are included in the protection scope of the present application.
Claims (13)
1. A task processing method is applied to a task processing device, and the method comprises the following steps:
acquiring a target task to be processed;
processing the target task by utilizing a container instance which is created locally and relates to the target tool program;
wherein the target tool program is a tool program required when the target task is processed; the container instance related to the target tool program is a container instance created by running an image file of the target tool program.
2. The method of claim 1, wherein processing the target task using the container instance created locally with respect to the target utility comprises:
sending a tool request carrying identification information of the target tool program to a preset tool management end, so that the tool management end determines an image file of the target tool program according to the identification information in the tool request and feeds the determined image file back to the task processing equipment;
Creating a container instance related to the target tool program by running the mirror image file fed back by the tool management terminal;
processing the target task using the created container instance for the target utility.
3. The method according to claim 2, wherein before sending the tool request carrying the identification information of the target tool program to a predetermined tool management terminal, the method further comprises:
judging whether a container instance related to the target tool program is created locally or not based on the identification information of the target tool program;
if not, executing a step of sending a tool request carrying the identification information of the target tool program to a preset tool management end;
if so, the target task is processed by utilizing the container instance which is created locally and relates to the target tool program.
4. The method of claim 3, wherein prior to processing the target task using the locally created container instance for the target utility, the method further comprises:
judging whether a first version and a second version are the same, wherein the first version is a container example which is created locally and is related to the target tool program, and a tool program version is represented; the second version is a tool program version represented by an image file of the target tool program in the tool management terminal;
If yes, executing the step of processing the target task by utilizing the locally created container instance related to the target tool program;
and if not, executing the step of sending the tool request carrying the identification information of the target tool program to a preset tool management end.
5. The method according to any one of claims 2-4, further comprising:
after the target task is processed, obtaining a judgment result given by a user aiming at a processing result of the target task;
and sending the judgment result to the tool management end so that the tool management end determines the performance analysis result of the target tool program based on the judgment result.
6. A task processing apparatus applied to a task processing device, the apparatus comprising:
the task obtaining module is used for obtaining a target task to be processed;
the task processing module is used for processing the target task by utilizing a container instance which is created locally and relates to the target tool program;
wherein the target tool program is a tool program required when the target task is processed; the container instance related to the target tool program is a container instance created by running an image file of the target tool program.
7. The apparatus of claim 6, wherein the task processing module comprises:
a request sending submodule, configured to send a tool request carrying identification information of the target tool program to a predetermined tool management terminal, so that the tool management terminal determines an image file of the target tool program according to the identification information in the tool request, and feeds back the determined image file to the task processing device;
the instance creating submodule is used for creating a container instance related to the target tool program by running the mirror image file fed back by the tool management terminal;
and the task processing submodule is used for processing the target task by utilizing the created container instance related to the target tool program.
8. The apparatus of claim 7, further comprising:
a first analysis module, configured to, before the request sending sub-module sends a tool request carrying identification information of the target tool program to a predetermined tool management terminal, determine, based on the identification information of the target tool program, whether a container instance related to the target tool program has been created locally, and if not, trigger the request sending sub-module; if yes, triggering a local processing module;
The local processing module is used for processing the target task by utilizing the container instance which is created locally and related to the target tool program.
9. The apparatus of claim 8, further comprising:
a second analysis module, configured to, before the local processing module processes the target task, determine whether a first version and a second version are the same version by using a locally created container instance related to the target utility, where the first version is a locally created container instance related to the target utility and a characterized utility version; the second version is a tool program version represented by an image file of the target tool program in the tool management terminal; if yes, triggering the local processing module; and if not, triggering the request sending submodule.
10. The apparatus according to any one of claims 7-9, further comprising:
the judgment result obtaining module is used for obtaining a judgment result given by a user aiming at the processing result of the target task after the target task is processed;
and the result reporting module is used for sending the judgment result to the tool management end so that the tool management end determines the performance analysis result of the target tool program based on the judgment result.
11. A task processing system, comprising: the system comprises a task processing device and a management device running with a tool management end;
the task processing equipment is used for acquiring a target task to be processed; sending a tool request carrying identification information of a target tool program to the management equipment, so that the management equipment determines an image file of the target tool program according to the identification information in the tool request and feeds back the determined image file to the task processing equipment; creating a container instance related to the target tool program by running the mirror image file fed back by the tool management terminal; processing the target task using the created container instance for the target utility; wherein the target tool program is a tool program required when the target task is processed;
and the management device is used for determining an image file of the target tool program according to the identification information in the tool request after receiving the tool request sent by the task processing device, and feeding back the determined image file to the task processing device.
12. An electronic device is characterized by comprising a processor, a communication interface, a memory and a communication bus, wherein the processor and the communication interface are used for realizing mutual communication by the memory through the communication bus;
A memory for storing a computer program;
a processor for implementing the method steps of any one of claims 1 to 5 when executing a program stored in the memory.
13. A computer-readable storage medium, characterized in that a computer program is stored in the computer-readable storage medium, which computer program, when being executed by a processor, carries out the method steps of any one of the claims 1-5.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010164729.8A CN113391872A (en) | 2020-03-11 | 2020-03-11 | Task processing method and device, electronic equipment and storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010164729.8A CN113391872A (en) | 2020-03-11 | 2020-03-11 | Task processing method and device, electronic equipment and storage medium |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN113391872A true CN113391872A (en) | 2021-09-14 |
Family
ID=77615265
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202010164729.8A Pending CN113391872A (en) | 2020-03-11 | 2020-03-11 | Task processing method and device, electronic equipment and storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN113391872A (en) |
-
2020
- 2020-03-11 CN CN202010164729.8A patent/CN113391872A/en active Pending
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US9182975B2 (en) | Automatic application updates | |
| TW201911033A (en) | Method, device and electronic device for updating application on client | |
| CN108287708B (en) | Data processing method and device, server and computer readable storage medium | |
| CN110022259B (en) | Message arrival rate determining method and device, data statistics server and storage medium | |
| CN111694639A (en) | Method and device for updating address of process container and electronic equipment | |
| CN114817146A (en) | Method and device for processing data | |
| CN114090623A (en) | Method and device for creating cache resources, electronic equipment and storage medium | |
| CN110674153B (en) | Data consistency detection method and device and electronic equipment | |
| CN113298331A (en) | Work order processing method, device and system and electronic equipment | |
| CN110309028B (en) | Monitoring information acquisition method, service monitoring method, device and system | |
| CN112948138A (en) | Method and device for processing message | |
| CN114090268B (en) | Container management method and container management system | |
| CN110955460A (en) | Service process starting method and device, electronic equipment and storage medium | |
| CN113391872A (en) | Task processing method and device, electronic equipment and storage medium | |
| CN113726885A (en) | Method and device for adjusting flow quota | |
| CN115269063A (en) | Process creation method, system, device and medium | |
| CN109254855B (en) | Registration method and device of parameter transmission protocol and electronic equipment | |
| CN113609168A (en) | Data export method, device, terminal and readable storage medium | |
| CN113867778A (en) | Method and device for generating mirror image file, electronic equipment and storage medium | |
| CN108363614B (en) | Application service module management method and device and server | |
| CN112261072A (en) | Service calling method, device, equipment and storage medium | |
| CN112860273A (en) | Page display method and device | |
| CN110784479B (en) | Data verification method and device, electronic equipment and storage medium | |
| CN111163088B (en) | Message processing method, system and device and electronic equipment | |
| CN110262756B (en) | Method and device for caching data |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |