CN111666156B - Container arranging method, device, equipment and storage medium - Google Patents
Container arranging method, device, equipment and storage medium Download PDFInfo
- Publication number
- CN111666156B CN111666156B CN202010494825.9A CN202010494825A CN111666156B CN 111666156 B CN111666156 B CN 111666156B CN 202010494825 A CN202010494825 A CN 202010494825A CN 111666156 B CN111666156 B CN 111666156B
- Authority
- CN
- China
- Prior art keywords
- container
- container arrangement
- adjustment information
- execution
- arrangement
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F9/00—Arrangements for program control, e.g. control units
- G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
- G06F9/46—Multiprogramming arrangements
- G06F9/50—Allocation of resources, e.g. of the central processing unit [CPU]
- G06F9/5005—Allocation of resources, e.g. of the central processing unit [CPU] to service a request
- G06F9/5027—Allocation of resources, e.g. of the central processing unit [CPU] to service a request the resource being a machine, e.g. CPUs, Servers, Terminals
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F8/00—Arrangements for software engineering
- G06F8/70—Software maintenance or management
- G06F8/71—Version control; Configuration management
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F9/00—Arrangements for program control, e.g. control units
- G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
- G06F9/46—Multiprogramming arrangements
- G06F9/50—Allocation of resources, e.g. of the central processing unit [CPU]
- G06F9/5061—Partitioning or combining of resources
Abstract
The embodiment of the invention discloses a container arranging method, a device, equipment and a storage medium, wherein the container arranging method comprises the following steps: executing container arrangement operation according to the container arrangement demand instruction based on the system software unit; acquiring processing data corresponding to the execution of container arrangement operation based on the heterogeneous hardware unit, and acquiring container arrangement adjustment information according to the processing data; the container arrangement operation is updated based on the container arrangement adjustment information. The container arrangement is carried out based on a system comprising heterogeneous hardware units, so that the container arrangement method supports multi-architecture platform expansion, and the container arrangement operation can be updated according to arrangement adjustment information fed back by the heterogeneous hardware units, thereby improving the efficiency and the accuracy of the container arrangement operation.
Description
Technical Field
The embodiment of the invention relates to the technical field of container arrangement, in particular to a container arrangement method, a device, equipment and a storage medium.
Background
To efficiently manage and control container clusters, container orchestration tools provide a useful and powerful solution for the coordinated creation, management, and updating of multiple containers across multiple hosts. Three methods, i.e., Docker-Swarm, Amazon Elastic Container Service (Amazon ECS) or Kubernets, are commonly used for Container arrangement.
However, the Docker-Swarm is dependent on a software platform, cannot run the same application on different platforms, and is only suitable for an x86 architecture; the Amazon ECS is very large in structure, so that platform cost and application conversion cost are too high, a complex cost structure and management system are required, and application transplantation to a platform requires reconstruction; the Kubernetes has more component modules, so that the communication is complex, the cost of the deployment complex technology is too high, and the expansion of a heterogeneous hardware platform is not supported, so that the existing container arranging method cannot meet the container arranging requirement of a user.
Disclosure of Invention
The embodiment of the invention provides a container arranging method, a device, equipment and a storage medium. To enable the arrangement of containers.
A first convenience is that an embodiment of the present invention provides a container arrangement method, and a container arrangement system includes: the system is formed by combining at least one server node, and each server node comprises a system software unit and a heterogeneous hardware unit;
executing container arrangement operation according to the container arrangement demand instruction based on the system software unit;
acquiring processing data corresponding to the execution of container arrangement operation based on the heterogeneous hardware unit, and acquiring container arrangement adjustment information according to the processing data;
the container arrangement operation is updated based on the container arrangement adjustment information.
In a second aspect, an embodiment of the present invention provides a container arranging apparatus, including:
the container arranging module is used for executing container arranging operation according to the container arranging requirement instruction based on the system software unit;
the adjustment information acquisition module is used for acquiring processing data corresponding to the execution of the container arrangement operation based on the heterogeneous hardware unit and acquiring container arrangement adjustment information according to the processing data;
and the arrangement operation updating module is used for updating the container arrangement operation based on the container arrangement adjustment information.
In a third aspect, an embodiment of the present invention provides an apparatus, including:
one or more processors;
a memory for storing one or more programs;
when the one or more programs are executed by the one or more processors, the one or more processors are caused to implement the above-described methods.
In a fourth aspect, an embodiment of the present invention provides a computer storage medium, on which a computer program is stored, which when executed by a processor implements the above method.
According to the technical scheme of the embodiment of the invention, the container arrangement is carried out based on the system comprising the heterogeneous hardware unit, so that the container arrangement method supports multi-architecture platform expansion, and the container arrangement operation can be updated according to the arrangement adjustment information fed back by the heterogeneous hardware unit, thereby improving the efficiency and the accuracy of the container arrangement operation.
Drawings
In order to more clearly illustrate the technical solutions of the embodiments of the present invention, the drawings needed to be used in the embodiments will be briefly described below, it should be understood that the following drawings only illustrate some embodiments of the present invention and therefore should not be considered as limiting the scope, and for those skilled in the art, other related drawings can be obtained according to the drawings without inventive efforts.
FIG. 1(a) is a schematic structural diagram of a container arrangement system according to an embodiment of the present invention;
fig. 1(b) is a flowchart of a container arrangement method according to an embodiment of the present invention;
FIG. 2 is a flowchart of a container arrangement method according to a second embodiment of the present invention;
FIG. 3 is a schematic structural diagram of a container arranging apparatus according to a third embodiment of the present invention
Fig. 4 is a schematic structural diagram of an apparatus according to an embodiment of the present invention.
Detailed Description
The present invention will be described in further detail with reference to the accompanying drawings and examples. It is to be understood that the specific embodiments described herein are merely illustrative of the invention and are not limiting of the invention. It should be further noted that, for the convenience of description, only some of the structures related to the present invention are shown in the drawings, not all of the structures.
Example one
Fig. 1(a) is a schematic structural diagram of a container layout system according to a first embodiment of the present invention, which is formed by merging at least one server node, and each server node includes a system software unit OS and a heterogeneous Hardware unit Hardware, and in order to improve the computing power of the container layout system, the heterogeneous Hardware units in each server node are linked through a Hardware bus to implement merging of Hardware functions. The multiple server nodes for merging the heterogeneous hardware units can simultaneously support the same task executed in the system software unit, and each server node can respectively complete different parts of the same operation step, so that the sharing of the task is realized, and the efficiency of container arrangement work is improved.
As shown by the dotted line box in fig. 1(a), a specific description of the structure of the heterogeneous hardware unit in any server node is provided, and of course, the structure of the heterogeneous hardware unit in other server nodes is substantially the same as that of the heterogeneous hardware unit in any server node, and is not described in detail in this embodiment.
It should be noted that the container arrangement system in this embodiment is based on a heterogeneous hardware platform as an implementation basis, and the container arrangement tool is deployed in a distributed manner in each server node in the system, and the deployed container arrangement tool is run based on a system software unit of the server node, and in the system, a plurality of server nodes are linked through a hardware bus, so as to implement cooperative work of the plurality of server nodes. Each server node in the system is respectively configured with a driver related to hardware, for example, a Universal Serial Bus (USB), a Human Interface Device (HID), and the like, and the specific type of the driver is not limited in the embodiments of the present invention. In addition, a processing module is respectively embedded in the heterogeneous hardware units of each server node, so that the embedded processing module processes the data for executing the container arrangement.
As shown in fig. 1(b), which is a flowchart of a container arranging method provided in an embodiment of the present application, this embodiment may be applicable to a case of arranging containers, and the method may be executed by a container arranging apparatus in an embodiment of the present invention, where the apparatus may be implemented in a software and/or hardware manner. As shown in fig. 1(b), the method specifically includes the following operations:
and step 101, executing container arrangement operation according to the container arrangement requirement instruction based on the system software unit.
Optionally, executing the container arrangement operation according to the container arrangement requirement instruction based on the system software unit may include: distributing the container arranging demand instruction to each server node according to the current load condition of each server node; and executing the corresponding container arrangement operation based on the system software unit through each server node according to the distributed container arrangement demand instruction.
Optionally, the container arrangement requirement instruction includes: the number of containers, the function each container has, and the transaction to be executed.
Optionally, executing the container arrangement operation according to the container arrangement requirement instruction based on the system software unit may include: based on system software unit, creating containers according to the number of containers and the functions of each container; and executing the transaction to be executed according to the created container.
Specifically, each server node in the container arrangement system is subjected to hardware combination through a hardware bus, so that each server node can respectively execute a part of the same task, and the overall computing power of the whole system is improved. And in particular the related operations of container orchestration are realized by the orchestration tool software code running on the server node system software unit OS.
Wherein, the orchestration tool running on the system software unit OS may comprise: the application program interface service API server, the Controller Manager, the instruction storage database etc. and the transaction execution scheduling Scheduler are, of course, described by way of example only in this embodiment, and do not limit the specific configuration of the scheduling tool running in the system software unit OS, so long as the container scheduling can be implemented within the scope of the present application. And when container arrangement is carried out, a plurality of server nodes work together by running an arrangement tool on the system software unit OS.
In one embodiment, the container arrangement system is exemplified by a combination of two server nodes. The container arrangement system comprises a user interface, and the step of acquiring a container arrangement requirement instruction input by a user through the user interface comprises the following steps: the number of containers 4; the container 1 has a storage function, the container 2 has an http protocol function, the container 3 has a data transmission function, and the container 4 has a data verification function; the tasks to be executed are: task a is performed in conjunction with container 2 and container 3. At this time, the container arrangement system distributes the container arrangement demand instruction to the two server nodes according to the current load condition of each server node, executes the corresponding container arrangement operation based on the system software unit according to the distributed container arrangement demand instruction through each server node, and acquires the processing data corresponding to the container arrangement operation.
When the containers are created, the current load of the server nodes is larger, the distributed tasks for creating the containers are smaller, when the load conditions of the two service nodes are the same, the tasks for creating the containers with the same size can be distributed, for example, 10 containers are required to be created in a container arrangement demand instruction, 5 containers are created by an application program interface service API server in the first server node, and a corresponding function is configured for each container through a Controller Manager; the API server in the second server node creates another 5 containers, and configures corresponding functions for each container through the Controller Manager, so that the two server nodes together complete the creation process of 10 containers, which is similar to the principle of the container creation process, and the first service node and the second service node can also be completed cooperatively when executing task a according to the created container.
The system software unit in this embodiment includes not only the orchestration tool, but also the network component and the operating environment, so as to support the normal operation of the orchestration tool. And the execution of the above work is realized under the condition that the hardware combination is completed based on a plurality of service nodes.
It should be noted that, in the container arrangement system in this embodiment, a plurality of business applications may be developed to realize mutual extension support in the business application model, so that a large-scale application ecosystem may be formed to enrich the functions of the container arrangement system.
And 102, acquiring processing data corresponding to the execution of the container arrangement operation based on the heterogeneous hardware unit, and acquiring container arrangement adjustment information according to the processing data.
Optionally, the heterogeneous hardware unit may include a heterogeneous device, a controller, and a container arrangement acceleration module; the types of heterogeneous devices include a Central Processing Unit (CPU) and a Graphics Processing Unit (Graphics Processing Unit)，GPU), Field Programmable Gate Array (Field Programmable Gate Array)，FPGA), Application Specific Integrated Circuit (ASIC), and Digital Signal Processor (DSP).
In this embodiment, the types of the heterogeneous devices in the heterogeneous hardware unit at least include two heterogeneous devices of different types, for example, CPU + GPU, CPU + FPGA, CPU + ASIC, FPGA + DSP, or the like. The combination of the heterogeneous devices in each server node may be the same or different, for example, the heterogeneous device in the first server node includes a CPU + GPU, and the heterogeneous device in the second server node includes a CPU + FPGA, and the specific combination manner of the heterogeneous devices in the heterogeneous hardware unit of each server node is not limited in the embodiment of the present application. And the integration of the computing resources of different types of heterogeneous devices in the heterogeneous platform can be realized by combining the server nodes through the hardware bus.
Note that, the heterogeneous hardware unit in this embodiment may further include conventional structures such as a motherboard, a fan, and a data line, and fig. 1(a) only identifies structures important for arranging containers, and omits other conventional structures.
Optionally, obtaining, based on the heterogeneous hardware unit, processing data corresponding to the execution of the container arrangement operation, and obtaining the container arrangement adjustment information according to the processing data may include: acquiring container creation data corresponding to the creation of the execution container and transaction execution data corresponding to the execution of the to-be-executed transaction based on the heterogeneous hardware unit; taking the container creation data and the transaction execution data as processing data; the controller controls the container arrangement acceleration module to classify the processing data according to a preset type to obtain at least two classification data; and obtaining container arrangement adjustment information according to the at least two classification data.
Optionally, obtaining the container arrangement adjustment information according to at least two classification data may include: preprocessing at least two classification data by adopting a container arrangement accelerating module to obtain at least two processed classification data; and determining an adjusting mode of container arrangement according to the at least two processed classification data, and determining container arrangement adjusting information according to the adjusting mode of container arrangement.
The adjusting method of the container arrangement is determined according to the at least two processed classification data, and specifically, the adjusting method of the container arrangement may be determined according to the condition of the container arrangement obtained from the at least two processed classification data.
Specifically, for each server node, because the heterogeneous hardware units include two types of heterogeneous devices, when a container is created and a transaction is executed on one server node, the two types of heterogeneous devices are specifically operated simultaneously, for example, when the heterogeneous hardware unit in the first server node is a combination of a CPU + an FPGA, two memory units MEM may be included in the FPGA, and one memory unit MEM is included in the CPU, so that the computational power of the FPGA is stronger than that of the CPU. Therefore, each server node may obtain, based on the heterogeneous hardware unit, container creation data corresponding to the execution container creation, and obtain transaction execution data corresponding to the execution of the to-be-executed transaction, where the container creation data may include: the time occupied by the container creation and the consumed computing resources are operated on each server node arranging tool, the container creation data can be recorded in a log form, the transaction execution data can also be recorded in the log form, and the obtained container creation data and the obtained transaction execution data are used as the processing data corresponding to the container arranging process. And the controller will call the input/output buffer to control the container arrangement acceleration module to classify the processing data according to the preset type to obtain at least two classified data, for example, the service data contained in the processing data is used as the first type data, the operation data is used as the second type data, and the communication signal data is used as the third type data. Of course, this embodiment is only an example, and the preset type may be set in advance, the processing data may be classified according to the set preset type, or the processing data may be randomly classified according to the actual content of the processing data, and the specific classification method of the processing data is not limited in this embodiment.
After acquiring different types of data, the container arrangement acceleration module preprocesses each classification data to acquire at least two processed classification data. The preprocessing includes denoising processing of processing data such as cleaning, analysis and screening, and obtaining a container arrangement state according to at least two processed classification data, for example, it is determined that 5 containers are respectively created in the server node 1 and the server node 2 according to service data, but it is determined that the creation time of the server node 1 is 5 seconds and the creation time of the server node 2 is 2 seconds according to operation data, so that it can be determined that the container arrangement state is that the performance of the server node 1 is stronger than that of the server node 2, and therefore, an adjustment mode of the container arrangement can be determined by analyzing according to the current container arrangement state, that is, a container creation task of the server node 1 is reduced in a preset range, a container creation task of the server node 2 is increased, and container arrangement adjustment information is determined according to the adjustment mode of the container arrangement. Since the adjustment manner of the container arrangement has been determined, the container arrangement adjustment information can be determined according to the adjustment amount set in advance, for example, the container arrangement adjustment information determined according to the adjustment manner and the adjustment amount is: in the next container arrangement process, 3 containers are created by using the server node 1, and 7 containers are created by using the server node 2, so that the container creation time is shortened. The specific number of created containers that are increased or decreased each time may be set in advance, or may also be set to a preset range, and the adjustment is automatically performed within the preset range.
In step 103, the container arrangement operation is updated based on the container arrangement adjustment information.
Optionally, the container arrangement adjustment information is transmitted to the system software unit, so that the container arrangement operation running on the system software unit is updated based on the container arrangement adjustment information.
Specifically, after the container arrangement adjustment information is obtained, the container arrangement adjustment information may be transmitted to the system software unit, and specifically to an application program interface service API server running in the system software unit OS arrangement tool, so that the container arrangement operation running on the system software unit API server is updated based on the container arrangement adjustment information.
For example, in determining that the container arrangement adjustment information is: in the next container arrangement process, 3 containers can be created by using the server node 1, and 7 containers are created by using the server node 2, so that the original container arrangement operation "5 containers are respectively created in the server node 1 and the server node 2" is updated according to the acquired container arrangement adjustment information, and the subsequent received container arrangement requirement instruction can be executed according to the updated container arrangement operation.
According to the technical scheme of the embodiment of the invention, the container arrangement is carried out based on the system comprising the heterogeneous hardware unit, so that the container arrangement method supports multi-architecture platform expansion, and the container arrangement operation can be updated according to the arrangement adjustment information fed back by the heterogeneous hardware unit, thereby improving the efficiency and the accuracy of the container arrangement operation.
Example two
Fig. 2 is a flowchart of a container arrangement method according to a second embodiment of the present invention, where the present embodiment is based on the foregoing embodiment, and after updating a container arrangement operation according to container arrangement adjustment information, the present embodiment further includes: and detecting the updating result of the container arranging operation.
And step 201, executing container arrangement operation according to the container arrangement requirement instruction based on the system software unit.
Optionally, executing the container arrangement operation according to the container arrangement requirement instruction based on the system software unit may include: distributing the container arranging demand instruction to each server node according to the current load condition of each server node; and executing the corresponding container arrangement operation based on the system software unit through each server node according to the distributed container arrangement demand instruction.
Optionally, the container arrangement requirement instruction includes: the number of containers, the function each container has, and the transaction to be executed.
Optionally, executing the container arrangement operation according to the container arrangement requirement instruction based on the system software unit may include: based on system software unit, creating containers according to the number of containers and the functions of each container; and executing the transaction to be executed according to the created container.
Optionally, isomerismThe hardware unit can comprise heterogeneous equipment, a controller and a container arranging and accelerating module; the types of heterogeneous devices include a Central Processing Unit (CPU) and a Graphics Processing Unit (Graphics Processing Unit)，GPU), Field Programmable Gate Array (Field Programmable Gate Array)，FPGA), Application Specific Integrated Circuit (ASIC), and Digital Signal Processor (DSP).
Optionally, obtaining, based on the heterogeneous hardware unit, processing data corresponding to the execution of the container arrangement operation, and obtaining the container arrangement adjustment information according to the processing data may include: acquiring container creation data corresponding to the creation of the execution container and transaction execution data corresponding to the execution of the to-be-executed transaction based on the heterogeneous hardware unit; taking the container creation data and the transaction execution data as processing data; the controller controls the container arrangement acceleration module to classify the processing data according to a preset type to obtain at least two classification data; and obtaining container arrangement adjustment information according to the at least two classification data.
Optionally, obtaining the container arrangement adjustment information according to at least two classification data may include: preprocessing at least two classification data by adopting a container arrangement accelerating module to obtain at least two processed classification data; and determining an adjusting mode of container arrangement according to the at least two processed classification data, and determining container arrangement adjusting information according to the adjusting mode of container arrangement.
In step 203, the container arrangement operation is updated based on the container arrangement adjustment information.
Optionally, the container arrangement adjustment information is transmitted to the system software unit, so that the container arrangement operation running on the system software unit is updated based on the container arrangement adjustment information.
And step 204, detecting the updating result of the container arranging operation.
Specifically, in this embodiment, after the container arrangement operation is updated according to the container arrangement adjustment information, the accuracy of the container arrangement adjustment information can be determined by detecting the update result of the container arrangement operation, for example, 5 containers are respectively created for the server node 1 and the server node 2 when the original container is created, the time taken for creating is 3 seconds, 3 containers are created for the server node 1 after the container arrangement operation is updated, and 7 containers are created for the server node 2, but the time taken for creating is 5 seconds, so that by detecting the update result of the container arrangement operation, it is determined that the creation time is longer, and it can be determined that the obtained container arrangement instruction is wrong, and at this time, it may be that the hardware unit of the service node is damaged or the operation of the system software unit is failed, in this case, therefore, timely servicing of the container arrangement system is required.
EXAMPLE III
Fig. 3 is a schematic structural diagram of a container arranging apparatus according to a third embodiment of the present invention, where the apparatus includes: a container arrangement module 301, an adjustment information acquisition module 302, and an arrangement operation update module 303.
The container arranging module 301 is configured to execute a container arranging operation according to a container arranging requirement instruction based on a system software unit;
an adjustment information obtaining module 302, configured to obtain, based on the heterogeneous hardware unit, processing data corresponding to the execution of the container arrangement operation, and obtain container arrangement adjustment information according to the processing data;
and an updating module 303 for updating the container arrangement operation based on the container arrangement adjustment information.
The device can execute the container arranging method provided by any embodiment of the invention, and has corresponding functional modules and beneficial effects of the executing method. For details of the container arrangement method according to any embodiment of the present invention, reference may be made to the following description.
Example four
A fourth embodiment of the present invention relates to an apparatus, as shown in fig. 4, which is a diagram illustrating an example of a structure of an apparatus, including at least one processor 401; and a memory 402 communicatively coupled to the at least one processor 401. Wherein the memory 402 stores instructions executable by the at least one processor 401 to be executed by the at least one processor 401 to enable the at least one processor 401 to perform the container arrangement method.
The processors 401 and the memory 402 may be connected by a bus or in other manners, and the bus may include any number of interconnected buses and bridges as an example of the bus connection in fig. 4, and the bus links various circuits of one or more of the processors 401 and the memory 402 together. The bus may also link various other circuits such as peripherals, voltage regulators, power management circuits, and the like, which are well known in the art, and therefore, will not be described any further herein. The processor is responsible for managing the bus and general processing and may also provide various functions including timing, peripheral interfaces, voltage regulation, power management, and other control functions. And the memory may be used to store data used by the processor in performing operations.
Those skilled in the art can understand that all or part of the steps in the method of the foregoing embodiments may be implemented by a program to instruct related hardware, where the program is stored in a storage medium and includes several instructions to enable a device (which may be a single chip, a chip, etc.) or a processor (processor) to execute all or part of the steps of the method described in the embodiments of the present application.
EXAMPLE five
An embodiment five of the present invention provides a computer-readable storage medium, on which a computer program is stored, where the computer program, when executed by a processor, implements the container arrangement method provided in all the inventive embodiments of the present application: executing container arrangement operation according to the container arrangement demand instruction based on the system software unit; acquiring processing data corresponding to the execution of container arrangement operation based on the heterogeneous hardware unit, and acquiring container arrangement adjustment information according to the processing data; the container arrangement operation is updated based on the container arrangement adjustment information.
Any combination of one or more computer-readable media may be employed. The computer readable medium may be a computer readable signal medium or a computer readable storage medium. A computer readable storage medium may be, for example, but not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any combination of the foregoing. More specific examples (a non-exhaustive list) of the computer readable storage medium would include the following: an electrical connection having one or more wires, a portable computer diskette, a hard disk, a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing. In the context of this document, a computer readable storage medium may be any tangible medium that can contain, or store a program for use by or in connection with an instruction execution system, apparatus, or device.
A computer readable signal medium may include a propagated data signal with computer readable program code embodied therein, for example, in baseband or as part of a carrier wave. Such a propagated data signal may take any of a variety of forms, including, but not limited to, electro-magnetic, optical, or any suitable combination thereof. A computer readable signal medium may also be any computer readable medium that is not a computer readable storage medium and that can communicate, propagate, or transport a program for use by or in connection with an instruction execution system, apparatus, or device.
Program code embodied on a computer readable medium may be transmitted using any appropriate medium, including but not limited to wireless, wireline, optical fiber cable, RF, etc., or any suitable combination of the foregoing.
Computer program code for carrying out operations for aspects of the present invention may be written in any combination of one or more programming languages, including an object oriented programming language such as Java, Smalltalk, C + + or the like and conventional procedural programming languages, such as the "C" programming language or similar programming languages. The program code may execute entirely on the user's computer, partly on the user's computer, as a stand-alone software package, partly on the user's computer and partly on a remote computer or entirely on the remote computer or server. In the case of a remote computer, the remote computer may be connected to the user's computer through any type of network, including a Local Area Network (LAN) or a Wide Area Network (WAN), or the connection may be made to an external computer (for example, through the Internet using an Internet service provider).
It is to be noted that the foregoing is only illustrative of the preferred embodiments of the present invention and the technical principles employed. It will be understood by those skilled in the art that the present invention is not limited to the particular embodiments described herein, but is capable of various obvious changes, rearrangements and substitutions as will now become apparent to those skilled in the art without departing from the scope of the invention. Therefore, although the present invention has been described in greater detail by the above embodiments, the present invention is not limited to the above embodiments, and may include other equivalent embodiments without departing from the spirit of the present invention, and the scope of the present invention is determined by the scope of the appended claims.
Claims (10)
1. A container arranging method is applied to a container arranging system, and is characterized in that the container arranging system comprises: the system is formed by combining at least one server node, and each server node comprises a system software unit and a heterogeneous hardware unit;
executing container arrangement operation according to the container arrangement requirement instruction based on the system software unit;
acquiring processing data corresponding to the execution of the container arrangement operation based on the heterogeneous hardware unit, and acquiring container arrangement adjustment information according to the processing data;
the container arrangement operation is updated based on the container arrangement adjustment information;
the obtaining, based on the heterogeneous hardware unit, processing data corresponding to the execution of the container arrangement operation, and obtaining container arrangement adjustment information according to the processing data includes: acquiring container creation data corresponding to the creation of the execution container and transaction execution data corresponding to the execution of the to-be-executed transaction based on the heterogeneous hardware unit; taking the container creation data and the transaction execution data as the processing data; the controller controls the container arrangement acceleration module to classify the processing data according to a preset type to obtain at least two classification data; and obtaining the container arrangement adjustment information according to the at least two classification data.
2. The method of claim 1, wherein the performing container arrangement operations according to container arrangement requirement instructions based on the system software unit comprises:
distributing the container arrangement demand instruction to each server node according to the current load condition of each server node;
and executing the corresponding container arrangement operation based on the system software unit through each server node according to the distributed container arrangement demand instruction.
3. The method of claim 2, wherein the container orchestration requirement instruction comprises: the number of containers, the function each container has, and the transaction to be executed.
4. The method of claim 3, wherein the performing container arrangement operations according to container arrangement requirement instructions based on the system software unit comprises:
creating containers according to the number of the containers and the functions of each container based on the system software unit;
and executing the transaction to be executed according to the created container.
5. The method of claim 4, wherein the heterogeneous hardware units comprise heterogeneous devices, controllers, and container orchestration acceleration modules;
the heterogeneous equipment comprises a Central Processing Unit (CPU), a Graphics Processing Unit (GPU), a Field Programmable Gate Array (FPGA), an Application Specific Integrated Circuit (ASIC) and a Digital Signal Processor (DSP).
6. The method of claim 1, wherein said obtaining said container arrangement adjustment information from said at least two classification data comprises:
preprocessing the at least two classification data by adopting the container arrangement accelerating module to obtain at least two processed classification data;
determining an adjusting mode of container arrangement according to the at least two processed classification data;
and determining the container arrangement adjustment information according to the adjustment mode of the container arrangement.
7. The method of claim 1, wherein the container orchestration operation is updated based on the container orchestration adjustment information, comprising:
transmitting the container arrangement adjustment information to the system software unit so that the container arrangement operation running on the system software unit is updated based on the container arrangement adjustment information.
8. A container orchestration device, the device comprising:
the container arranging module is used for executing container arranging operation according to the container arranging requirement instruction based on the system software unit;
the adjustment information acquisition module is used for acquiring processing data corresponding to the execution of the container arrangement operation based on a heterogeneous hardware unit and acquiring container arrangement adjustment information according to the processing data;
the container arrangement adjustment module is used for adjusting the container arrangement adjustment information according to the container arrangement adjustment information;
the obtaining, based on the heterogeneous hardware unit, processing data corresponding to the execution of the container arrangement operation, and obtaining container arrangement adjustment information according to the processing data includes: acquiring container creation data corresponding to the creation of the execution container and transaction execution data corresponding to the execution of the to-be-executed transaction based on the heterogeneous hardware unit; taking the container creation data and the transaction execution data as the processing data; the controller controls the container arrangement acceleration module to classify the processing data according to a preset type to obtain at least two classification data; and obtaining the container arrangement adjustment information according to the at least two classification data.
9. A container orchestration device, the device comprising:
one or more processors;
storage means for storing one or more programs;
when executed by the one or more processors, cause the one or more processors to implement the method of any one of claims 1-7.
10. A computer storage medium on which a computer program is stored, which program, when being executed by a processor, carries out the method according to any one of claims 1-7.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010494825.9A CN111666156B (en) | 2020-06-03 | 2020-06-03 | Container arranging method, device, equipment and storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010494825.9A CN111666156B (en) | 2020-06-03 | 2020-06-03 | Container arranging method, device, equipment and storage medium |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN111666156A CN111666156A (en) | 2020-09-15 |
| CN111666156B true CN111666156B (en) | 2022-02-18 |
Family
ID=72385843
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202010494825.9A Active CN111666156B (en) | 2020-06-03 | 2020-06-03 | Container arranging method, device, equipment and storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN111666156B (en) |
Family Cites Families (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107395731A (en) * | 2017-07-28 | 2017-11-24 | 郑州云海信息技术有限公司 | A kind of adjusting method and device of the container cluster based on service orchestration |
| US10922096B2 (en) * | 2018-02-28 | 2021-02-16 | Vmware, Inc. | Reducing subsequent network launch time of container applications |
| CN108958882A (en) * | 2018-06-06 | 2018-12-07 | 麒麟合盛网络技术股份有限公司 | A kind of container method of adjustment, device and system |
| CN109067862B (en) * | 2018-07-23 | 2020-10-16 | 北京邮电大学 | Method and device for automatic extension and retraction of API Gateway |
| CN110377486B (en) * | 2019-07-09 | 2022-07-08 | 福建南威软件有限公司 | Kafka-based method for realizing stable high-throughput asynchronous task processing |
| CN110941495B (en) * | 2019-12-10 | 2022-04-05 | 广西大学 | Container collaborative arrangement method based on graph coloring |
| CN111147555B (en) * | 2019-12-13 | 2020-08-25 | 苏州博纳讯动软件有限公司 | Heterogeneous resource mixed arrangement method |
-
2020
- 2020-06-03 CN CN202010494825.9A patent/CN111666156B/en active Active
Also Published As
| Publication number | Publication date |
|---|---|
| CN111666156A (en) | 2020-09-15 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| EP3754495B1 (en) | Data processing method and related products | |
| KR102493449B1 (en) | Edge computing test methods, devices, electronic devices and computer-readable media | |
| JP2020537784A (en) | Machine learning runtime library for neural network acceleration | |
| US20150052530A1 (en) | Task-based modeling for parallel data integration | |
| US7685266B2 (en) | Management of tools that process data to describe a physical layout of a circuit | |
| CN109117252B (en) | Method and system for task processing based on container and container cluster management system | |
| US10977076B2 (en) | Method and apparatus for processing a heterogeneous cluster-oriented task | |
| US20210382754A1 (en) | Serverless computing architecture for artificial intelligence workloads on edge for dynamic reconfiguration of workloads and enhanced resource utilization | |
| US10970805B2 (en) | Graphics processing unit operation | |
| CN111176818B (en) | Distributed prediction method, device, system, electronic equipment and storage medium | |
| US8990294B2 (en) | File system optimization by log/metadata analysis | |
| US20230153158A1 (en) | Method, apparatus, system, and storage medium for performing eda task | |
| DE102020119519A1 (en) | METHODS AND DEVICES FOR ENABLING OUT-OF-ORDER PIPELINE EXECUTION OF STATIC REPLACEMENT OF A WORKLOAD | |
| CN115373835A (en) | Task resource adjusting method and device for Flink cluster and electronic equipment | |
| US7539992B2 (en) | Scheduling method, program product for use in such method, and task scheduling apparatus | |
| US20190163447A1 (en) | Dynamic accelerator generation and deployment | |
| CN111666156B (en) | Container arranging method, device, equipment and storage medium | |
| CN109412970B (en) | Data transfer system, data transfer method, electronic device, and storage medium | |
| CN114696888B (en) | Port task processing method, device, equipment and medium of satellite measurement, operation and control system | |
| CN106502842A (en) | Data reconstruction method and system | |
| EP4124945A1 (en) | System and method for batch and scheduler migration in an application environment migration | |
| CN111352664A (en) | Distributed machine learning task starting method, system, equipment and storage medium | |
| Warrender et al. | Job scheduling in a high performance computing environment | |
| US10824472B2 (en) | Coalescing multiple accelerators into a single accelerator | |
| Ding et al. | Implement the grid workflow scheduling for data intensive applications with csf4 |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |