CN115543548B - Configuration method, device and equipment of container group and readable storage medium - Google Patents

Configuration method, device and equipment of container group and readable storage medium Download PDF

Info

Publication number
CN115543548B
CN115543548B CN202211518323.0A CN202211518323A CN115543548B CN 115543548 B CN115543548 B CN 115543548B CN 202211518323 A CN202211518323 A CN 202211518323A CN 115543548 B CN115543548 B CN 115543548B
Authority
CN
China
Prior art keywords
configuration
container
group
initialization
application
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN202211518323.0A
Other languages
Chinese (zh)
Other versions
CN115543548A (en
Inventor
杨勇
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Suzhou Inspur Intelligent Technology Co Ltd
Original Assignee
Suzhou Inspur Intelligent Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Suzhou Inspur Intelligent Technology Co Ltd filed Critical Suzhou Inspur Intelligent Technology Co Ltd
Priority to CN202211518323.0A priority Critical patent/CN115543548B/en
Publication of CN115543548A publication Critical patent/CN115543548A/en
Application granted granted Critical
Publication of CN115543548B publication Critical patent/CN115543548B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F9/00Arrangements for program control, e.g. control units
    • G06F9/06Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
    • G06F9/44Arrangements for executing specific programs
    • G06F9/455Emulation; Interpretation; Software simulation, e.g. virtualisation or emulation of application or operating system execution engines
    • G06F9/45533Hypervisors; Virtual machine monitors
    • G06F9/45558Hypervisor-specific management and integration aspects
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F40/00Handling natural language data
    • G06F40/10Text processing
    • G06F40/166Editing, e.g. inserting or deleting
    • G06F40/186Templates
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F9/00Arrangements for program control, e.g. control units
    • G06F9/06Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
    • G06F9/44Arrangements for executing specific programs
    • G06F9/445Program loading or initiating
    • G06F9/44505Configuring for program initiating, e.g. using registry, configuration files

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Software Systems (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Health & Medical Sciences (AREA)
  • Artificial Intelligence (AREA)
  • Audiology, Speech & Language Pathology (AREA)
  • Computational Linguistics (AREA)
  • General Health & Medical Sciences (AREA)
  • Stored Programmes (AREA)

Abstract

The application relates to the technical field of containers, and particularly discloses a configuration method, a device, equipment and a readable storage medium of a container group, wherein an original service container template in a stateless controller is changed into an initialization container template and a service container template, and an adaptive parameter acquisition script is arranged in the initialization container template and is used for automatically acquiring configuration parameters and generating a configuration file of the container group to be created in the container group to be created after an initialization container is created firstly; and after the service application container is generated, acquiring the configuration file according to the path and completing application configuration according to the configuration parameters. The method and the device realize the differentiated self-adaptive configuration parameters when a single stateless controller creates the container group, so that the container group in the same stateless controller in a k8s cluster can dynamically generate and load different configuration parameters according to the position of the container group, the complexity of application deployment in k8s is reduced, and the flexibility of the container in k8s is improved.

Description

Container group configuration method, device, equipment and readable storage medium
Technical Field
The present application relates to the field of container technologies, and in particular, to a method, an apparatus, a device, and a readable storage medium for configuring a container group.
Background
Kubernetes (also called k8 s) is an open-source container cluster management system, and provides a series of complete functions such as deployment and operation, resource scheduling, service discovery, dynamic expansion and the like for containerized application on the basis of Docker technology, thereby improving the convenience of large-scale container cluster management. The k8s is also a complete distributed system support platform, and has complete cluster management capability, multi-extension and multi-level security protection and admission mechanism, multi-tenant application support capability, transparent service registration and discovery mechanism, built-in intelligent load balancer, strong fault discovery and self-repair capability, service rolling upgrade and online capacity expansion capability, expandable resource automatic scheduling mechanism and multi-granularity resource quota management capability. And meanwhile, k8s provides a perfect management tool, and covers all links including development, deployment test and operation and maintenance monitoring.
The container group (Pod) is the smallest scheduling unit in k8 s. One container group encloses one container (container) (a plurality of containers may also be enclosed). The containers in a group of containers share storage, networks, etc. That is, the entire set of containers can be viewed as a virtual machine, with each container corresponding to a process running in the virtual machine. All containers in the same container group are uniformly arranged and scheduled.
The operation Controller (Controller Manager) is a core component of k8s, is a management control center inside a k8s cluster, and is responsible for managing resources such as nodes (nodes), container group copies, service endpoints (Endpoint), namespaces (namespaces), service accounts (serviceaccounts), resource quotas (resourcequalta) and the like in the k8s cluster.
Multiple container groups may be created and managed in a production environment with multiple ones of the operational controllers. The controller may handle replication, updates, and automatic repairs in the event of a container group failure. The controller may specify the number of copies of a container group that it manages to maintain a specified number of copies at all times. For example, if a node fails, the controller may notice that the group of containers on the node has stopped working and create a new group of containers to replace the failed group of containers. The scheduler places the replacement set of containers on the healthy node. Common controllers for managing a container group include a depolyment (a stateless controller for managing stateless applications), stateful set (a stateful controller for managing stateful applications), daemonSet (a copy of a designated container group is run on a node in a daemon manner, for example, daemonSet may be used when monitoring logs on a node by the node), job (a temporary controller, which uses Job to execute tasks and ends after the execution), and the like.
The controller creates and manages a container group by a container group Template, which is a specification for creating a container group and is included in the Deployment et al controller. Each controller uses its own internal container group template to create the actual container group, the container group templates within the same controller instance being identical.
Application configuration in many production environments is complex and may require multiple combinations of configuration (config) files, command line parameters, and environment variables. When container deployment is used, the configuration should be decoupled from the application image to ensure portability of the image. A configuration map (ConfigMap) was introduced after the k8s1.2 version to handle this type of configuration data.
The ConfigMap stores general configuration variables, is similar to a configuration file, and enables a user to unify environment variables for different modules in the distributed system into one object for management; it differs from a configuration file in that it is present in the "environment" of the cluster and supports all common operational invocation patterns in k8s clusters. From a data perspective, the type of ConfigMap is simply a set of key values for storing information accessed by a set of containers. This is a departure from the concept of secret, and the main difference is that ConfigMap is not usually used to store sensitive information, but only simple text information. By binding the ConfigMap, applications within the container group can directly reference the configuration of the ConfigMap when creating the container group. Corresponding to encapsulating the configuration for the application/execution environment by using the ConfigMap. The container group uses ConfigMap, which is commonly used to set values of environment variables, set command line parameters, create configuration files.
With the continuous maturation of cloud-native technologies and cloud markets, the complexity of k8 s-managed applications will also increase. In an actual production process, for a k8s mode of creating a container group by using a stateless controller through a unified template, there is an actual scenario problem to be solved, that is, a problem of configuration of differentiated adaptive parameters of the container group.
Specifically, some programs in a container group need configuration information to be consistent with the operating environment in which the programs are located. For example, when some programs run on a multi-network card node, the network card address (ip) used needs to be configured; when some container groups run on a node with a Graphics Processing Unit (GPU), additional GPU driving information needs to be configured, which is not needed on a common node; when some container groups run on nodes with different hardware specifications, performance parameters such as thread number and over-rate ratio of the container groups need to be adjusted according to hardware configuration.
In this case, a configuration file is mounted on a single container group template provided by the stateless controller or in a k8s default ConfigMap manner for the container group, so that all container groups created by the stateless controller are mounted on the same configuration file, and differentiated adaptive parameter configuration of the container groups cannot be realized. If different configured container groups need to be created, only different stateless controllers can be used for control, for example, a common container group is controlled by using Deployment a, and a container group on a GPU node is controlled by using Deployment B, on one hand, the overall complexity of management is increased, and on the other hand, if differentiated configuration of another dimension occurs, orthogonal partitioning between different stateless controllers is difficult to achieve. Finally, with the increase of the demand of the differential configuration, for the situation of multiple copies of deployment of the same application, as for how many differential configurations, how many stateless controllers are needed for control, which is similar to the traditional scheme of performing differential distribution on designated nodes, and the advantages of k8s dynamic scheduling and unified management are lost.
If a mode of binding different configmaps for the stateless controller is adopted to implement differentiated configuration for the container group under the same stateless controller, that is, how many differentiated configurations exist, how many configmaps are bound for the stateless controller, a large number of repetitive configuration codes appear, and a user side is required to change service codes in a service application container of a created container group to bind to different configmaps, which affects service logic, and is very troublesome in implementing and managing logic. And the bound ConfigMap is also unchangeable, and the advantage of k8s dynamic scheduling is lost.
The technical problem to be solved by technical personnel in the field is to provide a scheme for parameter differentiation adaptive configuration of a single stateless controller content group in a k8s cluster, so that a container group in the same stateless controller in the k8s cluster can dynamically generate and load different configuration parameters according to the position of the container group, the complexity of application deployment in the k8s is reduced, and the flexibility of a container in the k8s is improved.
Disclosure of Invention
The application aims to provide a configuration method, a device, equipment and a readable storage medium of a container group, which are used for realizing parameter differentiation self-adaptive configuration of the container group of a single stateless controller in a k8s cluster, so that the container group in the same stateless controller in the k8s cluster can dynamically generate and load different configuration parameters according to the position of the container group, the complexity of application deployment in k8s is reduced, and the flexibility of containers in k8s is improved.
To solve the above technical problem, the present application provides a method for configuring a container group, which is applied to a node where a stateless controller is located, and includes:
after receiving a container group creation command, calling a preset initialization container template and a preset service application container template;
utilizing the initialization container template to create an initialization container for a container group, so that the initialization container runs the adaptive parameter acquisition script in the initialization container template to acquire configuration parameters and generate a configuration file of the container group;
and creating a business application container for the container group by using the business application container template so that the business application container acquires the configuration file based on the path of the configuration file mounted in the business application container template and finishes application configuration according to the configuration parameters.
Optionally, the configuration file is specifically stored in a temporary storage volume of the container group.
Optionally, the temporary storage volume is specifically stored at a back end of the node where the container group is located.
Optionally, the temporary storage volume is specifically stored in a temporary file system of the container group, and a medium field of the temporary storage volume is defined as a memory.
Optionally, the configuration file is specifically stored in a shared storage space allocated to the container group in advance.
Optionally, the acquiring, by the initialization container, the configuration parameters and generating the configuration file of the container group specifically include:
the initialization container acquires environment information of a node where the container group is located to determine a first configuration parameter;
and the initialization container generates the configuration file according to the first configuration parameter.
Optionally, the initializing container obtains environment information of a node where the container group is located to determine a first configuration parameter, specifically:
the initialization container obtains environment information of the node where the container group is located based on the system catalog of the node where the container group is located mounted in the initialization container template to determine the first configuration parameter.
Optionally, the first configuration parameter specifically includes: system small computer system interface parameter, system control group parameter, standard program design library module parameter.
Optionally, the acquiring, by the initialization container, the configuration parameters and generating the configuration file of the container group specifically include:
the initialization container acquires environment information of a node where the container group is located to determine a first configuration parameter;
the initialization container acquires an application configuration center address recorded by the script based on the self-adaptive parameters, and uploads a configuration request containing the first configuration parameters to an application configuration center;
the initialization container receives second configuration parameters distributed by the application configuration center;
and the initialization container generates the configuration file according to the first configuration parameter and the second configuration parameter.
Optionally, the second configuration parameter is specifically one of a high performance configuration parameter, a high available configuration parameter, a balanced configuration parameter, and a low power consumption configuration parameter.
Optionally, the second configuration parameter is specifically an operation policy configuration parameter configured by an administrator and corresponding to a node where the container group is located.
Optionally, the second configuration parameter is specifically an operation policy configuration parameter generated after a monitoring script is invoked to analyze an operation state of a node where the container group is located.
Optionally, the second configuration parameter is specifically an operation policy configuration parameter that is periodically issued by the application configuration center after receiving the first configuration parameter.
Optionally, the second configuration parameter is specifically an operation policy configuration parameter that is issued by the application configuration center after receiving the first configuration parameter and when the operation state parameter of the node where the container group is located is monitored to change the operation state.
Optionally, the uploading, by the initialization container, the configuration request including the first configuration parameter to the application configuration center specifically includes:
and the initialization container periodically uploads the configuration request to the application configuration center.
Optionally, the uploading, by the initialization container, the configuration request including the first configuration parameter to the application configuration center specifically includes:
and after the first configuration parameter is changed, the initialization container uploads the configuration request containing the changed first configuration parameter to the application configuration center.
Optionally, the obtaining, by the service application container, the configuration file based on the path of the configuration file mounted in the service application container template specifically includes:
and the service application container acquires the configuration file based on the path of the configuration file written in the service configuration parameters of the service application container.
In order to solve the above technical problem, the present application further provides a device for configuring a container group, including:
the calling unit is used for calling a preset initialization container template and a preset service application container template after receiving a container group creation command;
a first creating unit, configured to create an initialization container for a container group by using the initialization container template, so that the initialization container runs an adaptive parameter acquisition script in the initialization container template to acquire configuration parameters and generate a configuration file of the container group;
a second creating unit, configured to create a service application container for the container group by using the service application container template, so that the service application container obtains the configuration file based on a path of the configuration file mounted in the service application container template, and completes application configuration according to the configuration parameter.
In order to solve the above technical problem, the present application further provides a configuration device for a container group, including:
a memory for storing a computer program;
a processor for executing the computer program, when executed by the processor, implementing the steps of the method of configuring a group of containers as described in any of the above.
In order to solve the above technical problem, the present application further provides a readable storage medium, on which a computer program is stored, wherein the computer program, when executed by a processor, implements the steps of the method for configuring a container group as described in any one of the above.
The method for configuring the container group changes an original service container template in a stateless controller into an initialization container template and a service container template, wherein the initialization container template is provided with a self-adaptive parameter acquisition script, and in the container group to be created, after an initialization container is created firstly, configuration parameters are automatically acquired and a configuration file of the container group is generated; and after the service application container is generated, acquiring the configuration file according to the path, and completing application configuration according to the configuration parameters. The method and the device realize differentiated self-adaptive configuration parameters when a single stateless controller creates the container group, so that the container group in the same stateless controller in a k8s cluster can dynamically generate and load different configuration parameters according to the position of the container group, the complexity of application deployment in k8s is reduced, and the flexibility of the container in k8s is improved.
The present application further provides a configuration device, a device and a readable storage medium for a container group, which have the above beneficial effects and are not described herein again.
Drawings
In order to clearly illustrate the embodiments or technical solutions of the present application, the drawings used in the embodiments or technical solutions of the present application will be briefly described below, it is obvious that the drawings in the following description are only some embodiments of the present application, and other drawings can be obtained by those skilled in the art without creative efforts.
Fig. 1 is a flowchart of a method for configuring a container group according to an embodiment of the present disclosure;
fig. 2 is a schematic diagram of a component deployment architecture provided in an embodiment of the present application;
fig. 3 is a schematic structural diagram of a container group configuration device according to an embodiment of the present disclosure;
fig. 4 is a schematic structural diagram of a configuration device of a container group according to an embodiment of the present application.
Detailed Description
The core of the application is to provide a configuration method, a device, equipment and a readable storage medium for a container group, which are used for realizing parameter differentiation adaptive configuration of the container group of a single stateless controller in a k8s cluster, so that the container group in the same stateless controller in the k8s cluster can dynamically generate and load different configuration parameters according to the position of the container group, the complexity of application deployment in k8s is reduced, and the flexibility of a container in k8s is improved.
The technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application, and it is obvious that the described embodiments are only a part of the embodiments of the present application, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present application.
Example one
Fig. 1 is a flowchart of a method for configuring a container group according to an embodiment of the present disclosure; fig. 2 is a schematic diagram of a component deployment architecture according to an embodiment of the present application.
As shown in fig. 1, the method for configuring a container group provided in the embodiment of the present application is applied to a node where a stateless controller is located, and includes:
s101: and after receiving a container group creation command, calling a preset initialization container template and a preset service application container template.
S102: and utilizing the initialization container template to create an initialization container for the container group, so that the initialization container runs the adaptive parameter acquisition script in the initialization container template to acquire the configuration parameters and generate the configuration file of the container group.
S103: and creating a business application container for the container group by using the business application container template so that the business application container obtains the configuration file based on the path of the configuration file mounted in the business application container template and completes application configuration according to the configuration parameters.
In an implementation, the stateless controller provides the controller component for k8s, running on a physical node in the container cluster. When servicing business applications, the container groups (Pod) created by the stateless controller may also run on different physical nodes in the container cluster.
For S101, after an existing stateless controller creates a service application container by using a unified container group module, the service application container mounts a system directory required for normal operation of a service application. In this way, however, multiple business application containers created by the stateless controller can only use the same configuration file. In the configuration method for the container group provided in the embodiment of the present application, the stateless controller is changed to be provided with an initialization container template and a service application container template, where only the service application container template is originally provided, and the first created initialization container in the container cluster is used to obtain the differentiated configuration parameters and generate the configuration file for the subsequent created service application container to mount, so as to implement the differentiated configuration of different container groups, without mounting the ConfigMap, and without affecting the service application logic.
Specifically, when creating a stateless load that needs to be configured differentially, an Init-container (Init-container) mechanism of k8s is used to add an initialization container template to a container group template of a service application, where the initialization template is loaded with a directory written in a configuration file, and is also provided with an adaptive parameter acquisition script for acquiring a configuration parameter and generating the configuration file.
And meanwhile, the business application container template is changed, and a directory written in the configuration file is mounted for the business application container template, so that the created business application container can obtain a differentiated configuration file.
For S102, the initialization container is the first created container in the k8S container group mechanism, so that it can be guaranteed that the initialization container runs before the service application container. After the initialization container is created, the self-adaptive parameter acquisition script is operated, and the required configuration parameters can be acquired in a self-adaptive mode according to the logic which is written in advance. For example, initializing a container to obtain configuration parameters and generating a configuration file of a container group may specifically include: initializing a container to obtain environment information of a node where a container group is located so as to determine a first configuration parameter; the initialization container generates a configuration file according to the first configuration parameters.
The initializing container obtains environment information of a node where the container group is located to determine the first configuration parameter, which may specifically be: the initialization container acquires environment information of a node where the container group is located based on a system catalog of the node where the container group is located mounted in the initialization container template to determine a first configuration parameter.
In other words, in the initialization container template, not only the directory allocated to the configuration file in advance but also the system directory is mounted, and the running logic of the adaptive parameter acquisition script is set to determine the environment information of the node according to the system directory of the node where the container group where the initialization container is located, so as to generate the configuration file.
The directories for obtaining system information necessary for generating configuration files are pre-loaded in the initialization container template and may include/etc/iscsi (system small computer system interface directory),/sys/fs/cgroup (system control group directory),/lib/modules (standard programming library module directory), etc. The first configuration parameters thus obtained may specifically include: system small computer system interface parameters, system control group parameters, standard programming library module parameters, etc.
In order to implement the process of creating the initialization container and running the adaptive parameter acquisition script to generate the configuration file in S102, in the stateless controller, an initialization container template and a service application container template are added for a stateless load template that needs to be dynamically generated and configured, and the internal main logic of the initialization container template and the service application container template at least includes:
mounting directories necessary for dynamically generating configuration, such as/etc/iscsi (system small computer system interface directory),/sys/fs/cgroup (system control group directory),/lib/modules (standard programming library module directory), etc.;
mounting a directory which is allocated for the configuration file in advance, writing the generated configuration file, and simultaneously mounting the configuration file as a shared volume to a service application container for use;
developing service logic, and automatically generating a required configuration file according to the information of the node of the container group;
and writing the configuration file into a directory which is allocated for the configuration file in advance.
Wherein the directory pre-allocated for the configuration file may be stored in the shared storage space pre-allocated for the group of containers. The shared storage space may originate from any backend storage of the node where the container group resides, or from other storage resources that are remote.
Except that the initialization container is just created and then the adaptive parameter acquisition script is operated to generate the configuration file, the adaptive parameter acquisition script can also be designed to update the configuration parameters and update the configuration file in the operation process of the container group, if the information source for acquiring the configuration parameters changes. For example, the first configuration parameter of the attribute of the node is obtained by mounting the system directory of the node, and the first configuration parameter is adaptively changed along with the update of the parameter in the system directory, and the configuration file is updated at the same time. And after the container group is migrated, acquiring the system directory of the migrated node according to the system directory path, updating the first configuration parameter and updating the configuration file.
For S103, according to a k8S mechanism, in a container group created by the stateless controller, a service application container is created after the initialization container, and the created service application container is mounted to a directory pre-allocated for the configuration file according to a preset service application container template on which a directory pre-allocated for the configuration file is mounted, so that the configuration file created after the initialization container is started can be read through the shared volume directory, so as to configure the service application according to the configuration file.
The service application container in S103 obtains the configuration file based on the path of the configuration file mounted in the service application container template, which may specifically be: the service application container acquires the configuration file based on the path of the configuration file written in the service configuration parameters of the service application container.
Because different containers are used in the process of business application and the process of initializing the configuration file, the system directories required by the business application can be mounted respectively, the system directories mounted for generating the configuration file are not required to be mounted in the business application container, potential unauthorized access risks are prevented, the business application does not need to be modified, and the business application code is not invaded.
As shown in fig. 2, a node 201 where the stateless controller is located is denoted as node 1, a node 202 where the container group 1 created by the stateless controller is located is denoted as node 2, and a node 203 where the container group 2 created by the stateless controller is located is denoted as node 3. Suppose that node 2 is a node with 8-core 32G CPU and GPU, and node 3 is a node with 8-core 32G CPU and large page memory. By applying the configuration method of the container group provided by the embodiment of the application, the stateless controller calls the preset initialization container template and the preset service application container template after running, and creates the container group 1 and the container group 2 at the node 2 and the node 3 respectively. In the container group 1 of the node 2, an initialization container in the container group 1 is firstly created, after the initialization container is created, a self-adaptive parameter acquisition script is run on the node 2 to create a configuration file 1 according to the attribute of the node 2, then a service application container is created, the service application container and the initialization container mount a directory where the configuration file is located, and after the service application container is created, the configuration file 1 is read. In the container group 2 of the node 3, an initialization container in the container group 2 is created first, after the initialization container is created, an adaptive parameter acquisition script is run on the node 3 to create the configuration file 2 according to the attribute of the node 3, then a service application container is created, the service application container and the initialization container mount a directory where the configuration file is located, and after the service application container is created, the configuration file 2 is read. Through the differentiation of the configuration files 1 and 2, the differentiated configuration of the service application of the container group 1 and the service application of the container group 2 is realized, the characteristics of the environment to which the container group belongs can be automatically adapted, and when the container group is created or migrated again, the configuration parameters can still be obtained in a self-adaptive manner to realize the differentiated configuration.
In the configuration method for the container group provided by the embodiment of the application, an original service container template in a stateless controller is changed into an initialization container template and a service container template, the initialization container template is provided with an adaptive parameter acquisition script, and in the container group to be created, after an initialization container is created first, configuration parameters are automatically acquired and a configuration file of the container group where the initialization container is located is generated; and after the business application container is generated, acquiring the configuration file according to the path, and completing application configuration according to the configuration parameters. The method and the device realize differentiated self-adaptive configuration parameters when a single stateless controller creates the container group, so that the container group in the same stateless controller in a k8s cluster can dynamically generate and load different configuration parameters according to the position of the container group, the complexity of application deployment in k8s is reduced, and the flexibility of the container in k8s is improved.
Example two
On the basis of the foregoing embodiment, in order to facilitate container management on a configuration file and a container group, in the configuration method for a container group provided in the embodiment of the present application, a temporary storage volume (emptyDir) of the container group is used as a directory in which the configuration file is written. The configuration file is stored in the temporary storage volume of the container group in S102.
emptyDir, as the name implies, is an empty directory whose life cycle is completely consistent with the belonging group of containers. emptyDir may share files generated in a work project between different containers of the same container group. An emptyDir type Volume (Volume) is created when a container group is allocated to a node, and k8s automatically allocates a directory on the node, so that the corresponding directory file on the host node does not need to be specified. The initial contents of this directory are empty. When the container group is removed from the node, the data in emptyDir is permanently deleted. And a container crash (crashing) event will not cause the data in emptyDir to be deleted.
In the embodiment of the application, the temporary storage volume emptyDir is used for storing the configuration file generated by the container group in a self-adaptive manner, and the life cycle of the temporary storage volume emptyDir is the same as that of the container group to which the temporary storage volume emptyDir belongs, so that management is facilitated.
By default, emptyDir may use any type of back-end storage provided by the node. In the configuration method of the container group provided in the embodiment of the present application, the temporary storage volume may be stored at the back end of the node where the container group is located. In this way, the temporary storage volume occupies the memory resource of the node where the container group is located.
In special scenarios, a temporary file system (tmpfs) of the container group may also be employed as an available storage resource for emptyDir. The temporary storage volume may also be stored in a temporary file system of the container group, and an empty dir media field of the temporary storage volume is defined as a Memory. With the arrangement, the occupied volume of the volume where the configuration file is located consumes the memory share of the container, but the configuration file can be accessed externally as a temporary file, so that the configuration information of the container group is acquired to realize the monitoring function.
EXAMPLE III
On the basis of the foregoing embodiment, in order to implement configuring, by a single stateless controller, more complex configuration parameters, such as operation policy parameters, for a container group, in the configuration method for a container group provided in the embodiment of the present application, initializing a container to obtain the configuration parameters and generating a configuration file for the container group may specifically include:
initializing a container to acquire environment information of a node where a container group is located so as to determine a first configuration parameter;
the initialization container acquires an application configuration center address recorded by a script based on the self-adaptive parameters, and uploads a configuration request containing first configuration parameters to an application configuration center;
initializing a second configuration parameter which is distributed by the container receiving application configuration center;
and the initialization container generates a configuration file according to the first configuration parameter and the second configuration parameter.
In specific implementation, for a more loaded application configuration file, a service of an application configuration center can be designed, which cannot be generated by an application itself according to system information or needs more complicated logic judgment, when an initialization container is started, current information of a node where the application is located can be obtained, a request is initiated to the application configuration center as required, configuration parameters dynamically calculated by the application configuration center are obtained, a required configuration file is generated, and a directory which is allocated to the configuration file in advance is written.
And deploying the application configuration center in a container cluster in which business applications needing to be dynamically configured in a differentiated mode are located. The application configuration center can run in the node where the stateless controller is located and another node, such as a monitoring node, besides the node where the container group is located.
After the adaptive parameter acquisition script in the initialization container template is designed to acquire the attribute of the node as a first configuration parameter, the node information including the first configuration parameter is uploaded to an application configuration center to acquire a second configuration parameter distributed by the application configuration center, and the initialization container generates a configuration file according to the first configuration parameter and the second configuration parameter.
Then, in the initialization container template of the stateless controller, in addition to the internal main logic provided in the first embodiment of the present application, the method further includes:
developing a service logic, carrying node information, accessing an application configuration center of the container cluster, acquiring a second configuration parameter by the application configuration center and returning the second configuration parameter to the initialization container;
and generating a configuration file according to the first configuration parameter and the second configuration parameter, and writing the configuration file into a directory allocated for the configuration file in advance.
The first configuration parameter is mainly system information of a node where the container group is located, and specifically may include: system small computer system interface parameters, system control group parameters, standard programming library module parameters, etc.
The second configuration parameter may be an operation policy configuration parameter, that is, a configuration parameter corresponding to an operation policy divided according to an operation state of a node where the container group is located. The second configuration parameter may specifically be: one of a high performance configuration parameter, a high available configuration parameter, a balanced configuration parameter, and a low power consumption configuration parameter.
The second configuration parameter may specifically be an operation policy configuration parameter configured by an administrator and corresponding to a node where the container group is located. Because the determination of the operation policy configuration parameters is complex, the application configuration center can be only used as a platform for an administrator to manage the container groups, the first configuration parameters of the nodes where different container groups are located are displayed on the platform for the administrator to check, and the administrator allocates the second configuration parameters according to experience.
Furthermore, an interface can be developed in advance in an application configuration center, a system administrator is allowed to configure default configuration file templates of each application, such as a high-performance template, a high-availability template, a balance template, a low-power-consumption template and the like, the administrator performs policy configuration, the comprehensive level of a node where a container group is located is automatically analyzed through request information from the container group, and a proper template is selected for issuing.
It should be noted that the application configuration center needs to obtain the information of the node where the container group is located after obtaining the first configuration parameter of the node where the container group is located, and then allocates the second configuration parameter. However, according to the requirement of the node where the container group is located, after the second configuration parameter is allocated for the first time, the node where the container group is located may upload the first configuration parameter as required, and the node where the application configuration center is located may also issue the second configuration parameter according to a preset rule.
The initializing container in S102 uploads a configuration request including the first configuration parameter to the application configuration center, which may specifically be: the initialization container periodically uploads configuration requests to the application configuration center. That is, the initialization container may send a configuration request carrying the first configuration parameters to the application configuration center every first period, so as to confirm whether the second configuration parameters for the container group need to be updated by the application configuration center.
Or, the initializing the container in S102 may upload the configuration request including the first configuration parameter to the application configuration center, specifically: and after the first configuration parameters are changed, the initialization container uploads a configuration request containing the changed first configuration parameters to the application configuration center. The initialization container monitors the change condition of the first configuration parameter after acquiring the first configuration parameter just after being created, and sends a configuration request carrying the first configuration parameter to the application configuration center after finding that the first configuration parameter changes, so that the application configuration center redistributes the second configuration parameter corresponding to the updated first configuration parameter.
As shown in fig. 2, a node 204 where the application configuration center is located is denoted as a node 4, after an initialization container of a container group 1 running on the node 2 is created, a first configuration parameter of the container group 1 is uploaded to the application configuration center, the application configuration center issues a second configuration parameter to the initialization container, and the initialization container of the container group 1 generates a configuration file 1 according to the first configuration parameter and the second configuration parameter. After the initialization container of the container group 2 running in the node 3 is created, the first configuration parameter of the container group 2 is uploaded to the application configuration center, the application configuration center issues the second configuration parameter to the initialization container, and the initialization container of the container group 2 generates the configuration file 2 according to the first configuration parameter and the second configuration parameter. By applying a configuration center, further sophisticated differentiation of the container group 1 and the container group 2 is achieved.
According to the configuration method of the container group, the application configuration center is designed, the first configuration parameters acquired after the initialization container is started are uploaded to the application configuration center, the application configuration center allocates the second configuration parameters to the container group, and the initialization container generates the configuration files according to the first configuration parameters and the second configuration parameters, so that dynamic configuration can be performed according to the node running state, and the flexibility of adaptive parameter configuration of a single stateless controller content group is further improved.
Example four
On the basis of the foregoing embodiment, in the configuration method for a container group provided in the embodiment of the present application, based on an application configuration center, automatic allocation of a second configuration parameter may be implemented. Specifically, the application configuration center may be designed to automatically determine the second configuration parameter of the container group after analyzing the operation state of the node where the container group is located, which is obtained by the monitoring system. The second configuration parameter may specifically be an operation policy configuration parameter generated after the monitoring script is invoked to analyze the operation state of the node where the container group is located.
In specific implementation, an interface of an application configuration center is developed, a monitoring system of a k8s cluster is connected in a butt joint mode, the current overall load level, the service flow, the cluster scale and the like of the cluster are dynamically sensed, and reference is provided for dynamically generating a content field of a configuration file.
By docking a monitoring system of a k8s cluster, an application configuration center is combined with a first configuration parameter of a node where a container group is located uploaded by an initialization container and the running state of the node where the container group is located, which is monitored by the monitoring system, automatic comprehensive decision is carried out through richer performance parameters, and a second configuration parameter which is most suitable for the container group is dynamically generated and issued.
In the above embodiment, after the second configuration parameter is allocated for the first time, the node where the container group is located may upload the first configuration parameter as needed, and the node where the application configuration center is located may also issue the second configuration parameter according to a preset rule. In the configuration method of the container group provided in the embodiment of the present application, the second configuration parameter may specifically be an operation policy configuration parameter that is periodically issued by the application configuration center after receiving the first configuration parameter. That is, after receiving the first configuration parameter, the application configuration center synthesizes the operating state of the node where the container group is located and the first configuration parameter of the container group at every second period to generate and issue a second configuration parameter.
Or, the second configuration parameter may specifically be an operation policy configuration parameter that is issued when the operation state parameter of the node where the container group is located is monitored to change the operation state after the application configuration center receives the first configuration parameter. After receiving the first configuration parameter, the application configuration center determines whether to update the second configuration parameter allocated to the container group according to the running state of the node where the container group is located and the first configuration parameter provided by the monitoring system in real time or in real time, and then issues the second configuration parameter to the node where the container group is located after updating the second configuration parameter.
According to the configuration method of the container group, the monitoring system of the k8s cluster is connected with the application configuration center providing the operation strategy configuration parameters in a butt joint mode, the operation state of the node where the container group is located and the first configuration parameters are integrated to generate the operation strategy configuration parameters of the container group, and the intelligent level of self-adaptive parameter configuration of the single stateless controller content group is improved.
On the basis of the detailed description of the various embodiments corresponding to the container group configuration method, the application also discloses a container group configuration device, a device and a readable storage medium corresponding to the method.
EXAMPLE five
Fig. 3 is a schematic structural diagram of a container group configuration apparatus according to an embodiment of the present disclosure.
As shown in fig. 3, a configuration apparatus for a container group provided in an embodiment of the present application includes:
a calling unit 301, configured to call a preset initialization container template and a preset service application container template after receiving a container group creation command;
a first creating unit 302, configured to create an initialization container for the container group by using the initialization container template, so that the initialization container runs the adaptive parameter acquiring script in the initialization container template to acquire the configuration parameters and generate a configuration file of the container group;
a second creating unit 303, configured to create a service application container for the container group by using the service application container template, so that the service application container obtains the configuration file based on a path of the configuration file mounted in the service application container template, and completes application configuration according to the configuration parameter.
Since the embodiments of the apparatus portion and the method portion correspond to each other, please refer to the description of the embodiments of the method portion for the embodiments of the apparatus portion, which is not repeated here.
Example six
Fig. 4 is a schematic structural diagram of a configuration device of a container group according to an embodiment of the present disclosure.
As shown in fig. 4, a configuration device for a container group provided in an embodiment of the present application includes:
a memory 410 for storing a computer program 411;
a processor 420 for executing a computer program 411, the computer program 411, when executed by the processor 420, implementing the steps of the method for configuring a group of containers as described in any of the embodiments above.
Among other things, processor 420 may include one or more processing cores, such as a 3-core processor, an 8-core processor, and so forth. The processor 420 may be implemented in at least one hardware form of a Digital Signal Processing (DSP), a Field-Programmable Gate Array (FPGA), and a Programmable Logic Array (PLA). Processor 420 may also include a main processor, which is a processor for Processing data in a wake state and is also called a Central Processing Unit (CPU); a coprocessor is a low power processor for processing data in a standby state. In some embodiments, the processor 420 may be integrated with a Graphics Processing Unit (GPU), which is responsible for rendering and drawing the content that the display screen needs to display. In some embodiments, processor 420 may further include an Artificial Intelligence (AI) processor for processing computational operations related to machine learning.
Memory 410 may include one or more readable storage media, which may be non-transitory. Memory 410 may also include high-speed random access memory, as well as non-volatile memory, such as one or more magnetic disk storage devices, flash memory storage devices. In this embodiment, the memory 410 is at least used for storing the following computer program 411, wherein after the computer program 411 is loaded and executed by the processor 420, the relevant steps in the configuration method of the container group disclosed in any of the foregoing embodiments can be implemented. In addition, the resources stored by the memory 410 may also include an operating system 412, data 413, and the like, and the storage may be transient storage or permanent storage. Operating system 412 may be Windows, among others. The data 413 may include, but is not limited to, data involved in the above-described methods.
In some embodiments, the configuration device of the container group may further include a display 430, a power supply 440, a communication interface 450, an input output interface 460, a sensor 470, and a communication bus 480.
It will be appreciated by those skilled in the art that the arrangement shown in figure 4 does not constitute a limitation of the configuration device of the group of containers and may include more or fewer components than those shown.
The configuration device for a container group provided in the embodiment of the present application includes a memory and a processor, and when the processor executes a program stored in the memory, the processor can implement the above-described configuration method for a container group, and the effects are the same as above.
EXAMPLE seven
It should be noted that the above-described embodiments of the apparatus and device are merely illustrative, for example, the division of modules is only one division of logical functions, and there may be other divisions when actually implementing, for example, a plurality of modules or components may be combined or integrated into another system, or some features may be omitted or not executed. In addition, the shown or discussed coupling or direct coupling or communication connection between each other may be through some interfaces, indirect coupling or communication connection between devices or modules, and may be in an electrical, mechanical or other form. Modules described as separate parts may or may not be physically separate, and parts displayed as modules may or may not be physical modules, may be located in one place, or may be distributed on a plurality of network modules. Some or all of the modules may be selected according to actual needs to achieve the purpose of the solution of the present embodiment.
In addition, functional modules in the embodiments of the present application may be integrated into one processing module, or each module may exist alone physically, or two or more modules are integrated into one module. The integrated module can be realized in a hardware mode, and can also be realized in a software functional module mode.
The integrated module, if implemented in the form of a software functional module and sold or used as a separate product, may be stored in a readable storage medium. Based on such understanding, the technical solutions of the present application may be embodied in the form of a software product, which is stored in a storage medium and executes all or part of the steps of the methods described in the embodiments of the present application, or all or part of the technical solutions.
To this end, an embodiment of the present application further provides a readable storage medium, on which a computer program is stored, where the computer program is executed by a processor to implement the steps of the configuration method, such as the container group.
The readable storage medium may include: various media capable of storing program codes, such as a usb disk, a removable hard disk, a Read-Only Memory ROM (Read-Only Memory), a Random Access Memory RAM (Random Access Memory), a magnetic disk, or an optical disk.
The readable storage medium provided in this embodiment contains a computer program capable of implementing the steps of the method for configuring a container group as described above when executed by a processor, and the same effect is achieved.
The detailed description is provided above for a method, an apparatus, a device and a readable storage medium for configuring a container group provided in the present application. The embodiments are described in a progressive mode in the specification, the emphasis of each embodiment is on the difference from the other embodiments, and the same and similar parts among the embodiments can be referred to each other. The device, the apparatus and the readable storage medium disclosed by the embodiments correspond to the method disclosed by the embodiments, so that the description is simple, and the relevant points can be referred to the method part for description. It should be noted that, for those skilled in the art, it is possible to make several improvements and modifications to the present application without departing from the principle of the present application, and such improvements and modifications also fall within the scope of the claims of the present application.
It should also be noted that, in this specification, relational terms such as first and second, and the like are used solely to distinguish one entity or action from another entity or action without necessarily requiring or implying any actual such relationship or order between such entities or actions. Also, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrases "comprising a," "8230," "8230," or "comprising" does not exclude the presence of additional like elements in a process, method, article, or apparatus that comprises the element.

Claims (19)

1. A configuration method of a container group is applied to a node where a stateless controller is located, and comprises the following steps:
after receiving a container group creation command, calling a preset initialization container template and a preset service application container template;
utilizing the initialization container template to create an initialization container for a container group, so that the initialization container runs an adaptive parameter acquisition script in the initialization container template to acquire configuration parameters and generate a configuration file of the container group;
creating a business application container for the container group by using the business application container template so that the business application container acquires the configuration file based on the path of the configuration file mounted in the business application container template and completes application configuration according to the configuration parameters;
the acquiring, by the initialization container, the configuration parameters and generating the configuration file of the container group specifically includes:
the initialization container acquires environment information of a node where the container group is located to determine a first configuration parameter;
the initialization container acquires an application configuration center address recorded by the script based on the self-adaptive parameters, and uploads a configuration request containing the first configuration parameters to an application configuration center;
the initialization container receives second configuration parameters distributed by the application configuration center;
and the initialization container generates the configuration file according to the first configuration parameter and the second configuration parameter.
2. The configuration method according to claim 1, wherein the configuration file is specifically stored in a temporary storage volume of the container group.
3. The configuration method according to claim 2, wherein the temporary storage volume is stored in a back end of a node where the container group is located.
4. The configuration method according to claim 2, wherein the temporary storage volume is specifically stored in a temporary file system of the container group, and a medium field of the temporary storage volume is defined as a memory.
5. The configuration method according to claim 1, wherein the configuration file is stored in a shared storage space previously allocated to the container group.
6. The configuration method according to claim 1, wherein the initializing a container to obtain the configuration parameters and generate the configuration file of the container group specifically includes:
the initialization container acquires environment information of a node where the container group is located to determine a first configuration parameter;
and the initialization container generates the configuration file according to the first configuration parameter.
7. The configuration method according to claim 6, wherein the initialization container obtains environment information of a node where the container group is located to determine a first configuration parameter, specifically:
the initialization container obtains environment information of the node where the container group is located based on the system catalog of the node where the container group is located mounted in the initialization container template to determine the first configuration parameter.
8. The configuration method according to claim 6, wherein the first configuration parameter specifically comprises: system small computer system interface parameters, system control group parameters, standard programming library module parameters.
9. The configuration method according to claim 1, wherein the second configuration parameter is specifically one of a high performance configuration parameter, a high available configuration parameter, an equalization configuration parameter, and a low power consumption configuration parameter.
10. The configuration method according to claim 1, wherein the second configuration parameter is specifically an operation policy configuration parameter configured by an administrator and corresponding to a node where the container group is located.
11. The configuration method according to claim 1, wherein the second configuration parameter is specifically an operation policy configuration parameter generated after a monitoring script is invoked to analyze an operation state of a node where the container group is located.
12. The configuration method according to claim 1, wherein the second configuration parameter is specifically an operation policy configuration parameter that is periodically issued by the application configuration center after receiving the first configuration parameter.
13. The configuration method according to claim 1, wherein the second configuration parameter is specifically an operation policy configuration parameter that is issued by the application configuration center after receiving the first configuration parameter when the operation state parameter of the node where the container group is located is monitored to change the operation state.
14. The configuration method according to claim 1, wherein the initializing container uploads a configuration request including the first configuration parameter to the application configuration center, specifically:
the initialization container periodically uploads the configuration request to the application configuration center.
15. The configuration method according to claim 1, wherein the initializing container uploads a configuration request including the first configuration parameter to the application configuration center, specifically:
and after the first configuration parameter is changed, the initialization container uploads the configuration request containing the changed first configuration parameter to the application configuration center.
16. The configuration method according to claim 1, wherein the service application container obtains the configuration file based on a path of the configuration file mounted in the service application container template, specifically:
and the service application container acquires the configuration file based on the path of the configuration file written in the service configuration parameters of the service application container.
17. An apparatus for arranging groups of containers, comprising:
the calling unit is used for calling a preset initialization container template and a preset service application container template after receiving a container group creation command;
a first creating unit, configured to create an initialization container for a container group by using the initialization container template, so that the initialization container runs an adaptive parameter acquisition script in the initialization container template to acquire configuration parameters and generate a configuration file of the container group;
a second creating unit, configured to create a service application container for the container group by using the service application container template, so that the service application container obtains the configuration file based on a path of the configuration file mounted in the service application container template, and completes application configuration according to the configuration parameter;
the acquiring, by the initialization container, the configuration parameters and generating the configuration file of the container group specifically includes:
the initialization container acquires environment information of a node where the container group is located to determine a first configuration parameter;
the initialization container acquires an application configuration center address recorded by the script based on the self-adaptive parameters, and uploads a configuration request containing the first configuration parameters to an application configuration center;
the initialization container receives second configuration parameters distributed by the application configuration center;
and the initialization container generates the configuration file according to the first configuration parameter and the second configuration parameter.
18. A device for configuring a group of containers, comprising:
a memory for storing a computer program;
processor for executing the computer program, when executed by the processor, implementing the steps of the method for configuring a group of containers according to any one of claims 1 to 16.
19. A readable storage medium, on which a computer program is stored which, when being executed by a processor, carries out the steps of the method for configuring a group of containers according to any one of claims 1 to 16.
CN202211518323.0A 2022-11-30 2022-11-30 Configuration method, device and equipment of container group and readable storage medium Active CN115543548B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202211518323.0A CN115543548B (en) 2022-11-30 2022-11-30 Configuration method, device and equipment of container group and readable storage medium

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202211518323.0A CN115543548B (en) 2022-11-30 2022-11-30 Configuration method, device and equipment of container group and readable storage medium

Publications (2)

Publication Number Publication Date
CN115543548A CN115543548A (en) 2022-12-30
CN115543548B true CN115543548B (en) 2023-03-17

Family

ID=84722240

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202211518323.0A Active CN115543548B (en) 2022-11-30 2022-11-30 Configuration method, device and equipment of container group and readable storage medium

Country Status (1)

Country Link
CN (1) CN115543548B (en)

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN116225625B (en) * 2023-05-11 2023-08-08 天津金城银行股份有限公司 Application container management method, system, computer and readable storage medium

Family Cites Families (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US10540191B2 (en) * 2017-03-21 2020-01-21 Veritas Technologies Llc Systems and methods for using dynamic templates to create application containers
CN107885547A (en) * 2017-11-08 2018-04-06 江苏国泰新点软件有限公司 A kind of collocation method of application program, device, configuration equipment and storage medium
CN112783642A (en) * 2019-11-11 2021-05-11 阿里巴巴集团控股有限公司 In-container logic configuration method, device and computer readable medium
CN114567584B (en) * 2022-02-28 2023-07-21 苏州浪潮智能科技有限公司 Routing information processing method, device, computer equipment and storage medium

Also Published As

Publication number Publication date
CN115543548A (en) 2022-12-30

Similar Documents

Publication Publication Date Title
Burns et al. Kubernetes: up and running
US9459850B2 (en) Adaptive cloud aware just-in-time (JIT) compilation
US8239505B2 (en) Progressively implementing declarative models in distributed systems
CN101326489B (en) OS mini-boot for running multiple environments
US9413819B1 (en) Operating system interface implementation using network-accessible services
JP5352890B2 (en) Computer system operation management method, computer system, and computer-readable medium storing program
US20190138276A1 (en) Distributed component model
US20140136865A1 (en) Cooperatively Managing Enforcement of Energy Related Policies Between Virtual Machine and Application Runtime
US11301262B2 (en) Policy enabled application-release-management subsystem
US11467874B2 (en) System and method for resource management
US11880296B2 (en) Generating a test cluster for testing a container orchestration system
CN112596762A (en) Rolling upgrading method and device
CN114840223A (en) Resource processing method and device
JP7486575B2 (en) Correspondence between external operations on containers and mutation events
CN115543548B (en) Configuration method, device and equipment of container group and readable storage medium
US9798483B2 (en) Object storage power consumption optimization
CN114579250A (en) Method, device and storage medium for constructing virtual cluster
Nielsen et al. Private cloud configuration with metaconfig
US20220413902A1 (en) Partition migration with critical task prioritization
KR101044173B1 (en) Architecture for distributed computing system and automated design, deployment, and management of distributed applications
Mulahuwaish et al. Improving datacenter utilization through containerized service-based architecture
Parziale et al. Introduction to the new mainframe: z/vm basics
WO2024113819A1 (en) Configuration method and apparatus for pod, device, and nonvolatile readable storage medium
Shih MASS HDFS: multi-agent spatial simulation hadoop distributed file system
Petrovic Enabling flexibility of data-intensive applications on container-based systems with Node-RED in fog environments

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant