CN113568708B

CN113568708B - Platform creation method, device and equipment

Info

Publication number: CN113568708B
Application number: CN202110866666.5A
Authority: CN
Inventors: 杨光; 曾琳铖曦; 蒋宁; 吴海英; 冯仕炳; 刘德华
Original assignee: Mashang Xiaofei Finance Co Ltd
Current assignee: Mashang Xiaofei Finance Co Ltd
Priority date: 2021-07-29
Filing date: 2021-07-29
Publication date: 2022-10-04
Anticipated expiration: 2041-07-29
Also published as: CN113568708A

Abstract

The embodiment of the application provides a platform creation method, a device and equipment, which are applied to a cloud system, wherein the method comprises the following steps: receiving a platform creating request sent by a client, wherein the platform creating request comprises an identifier of a first container; acquiring configuration information of the first container according to the platform creation request, wherein the configuration information comprises file information and resource information; acquiring an operation file corresponding to the first container according to the file information, and loading the operation file to the first container to realize platform creation; allocating resources to the first container according to the resource information; generating address information corresponding to the first container, and sending the address information to the client, wherein the address information is used for the client to access the platform corresponding to the first container. By adopting the embodiment of the application, the utilization rate of resources can be improved.

Description

Platform creation method, device and equipment

Technical Field

The present application relates to the field of computer information technologies, and in particular, to a method, an apparatus, and a device for creating a platform.

Background

The physical machine can process data with higher complexity. For example, a user may perform big data analysis and model training through a physical host.

At present, the resource (such as hardware) configuration of a physical machine is high, and multiple users can share the resource in the same physical machine. For example, a physical machine may be provided with multiple platforms, and each platform may be assigned fixed resources, and multiple users may share the resources of the physical machine through the multiple platforms. However, the resources in the physical machine are fixed, and the resources allocated by the physical machine to each platform are also fixed, so that when a user does not use a platform in the physical machine, the platform still needs to consume the resources in the physical machine, thereby resulting in a low utilization rate of the resources.

Disclosure of Invention

The embodiment of the application provides a platform creation method, a platform creation device and platform creation equipment, which are used for solving the technical problem of low utilization rate of platform creation resources.

In a first aspect, an embodiment of the present application provides a platform creation method, which is applied to a cloud system, and includes:

receiving a platform creating request sent by a client, wherein the platform creating request comprises an identifier of a first container;

acquiring configuration information of the first container according to the platform creation request, wherein the configuration information comprises file information and resource information;

acquiring an operation file corresponding to the first container according to the file information, and loading the operation file to the first container to realize platform creation;

allocating resources to the first container according to the resource information;

generating address information corresponding to the first container, and sending the address information to the client, wherein the address information is used for the client to access a platform corresponding to the first container.

In a second aspect, an embodiment of the present application provides a platform creating apparatus, which is applied to a cloud system, and includes a receiving module, a first obtaining module, a second obtaining module, an allocating module, and a generating module, where:

the receiving module is used for receiving a platform creating request sent by a client, wherein the platform creating request comprises an identifier of a first container;

the first obtaining module is used for obtaining configuration information of the first container according to the platform creating request, wherein the configuration information comprises file information and resource information;

the second obtaining module is used for obtaining an operation file corresponding to the first container according to the file information and loading the operation file to the first container so as to realize platform creation;

the allocation module is used for allocating resources to the first container according to the resource information;

the generating module is configured to generate address information corresponding to the first container, and send the address information to the client, where the address information is used for the client to access a platform corresponding to the first container.

In a third aspect, an embodiment of the present application provides a platform creation device, including a processor and a memory;

the memory stores computer execution instructions;

the processor executes computer-executable instructions stored by the memory, causing the processor to perform the platform creation method of the first aspect.

In a fourth aspect, an embodiment of the present application provides a computer-readable storage medium, in which computer-executable instructions are stored, and when the computer-executable instructions are executed by a processor, the computer-readable storage medium is used for implementing the platform creation method according to the first aspect.

In a fifth aspect, an embodiment of the present application provides a computer program product, which includes a computer program, and when the computer program is executed by a processor, the computer program implements the platform creation method described in the first aspect.

It can be seen that, in the embodiment of the present application, when a cloud system receives a platform creation request sent by a client, the cloud system obtains configuration information of a first container according to an identifier of the first container in the platform creation request, obtains an operation file corresponding to the first container according to file information in the configuration information, and loads the operation file to the first container to implement platform creation, so that environments (such as a development environment, an operation environment, and the like) corresponding to the configuration information of each container can be isolated, thereby avoiding a conflict between dependencies among multiple environments, and improving compatibility of the cloud system.

Drawings

Fig. 1 is a schematic view of an application scenario provided in an embodiment of the present application;

fig. 2 is a schematic flowchart of a platform creation method according to an embodiment of the present application;

fig. 3A is a schematic diagram of a process of acquiring a run file according to an embodiment of the present application;

fig. 3B is a schematic diagram of another process for acquiring a run file according to an embodiment of the present application;

fig. 4 is a schematic flowchart of a method for generating address information according to an embodiment of the present application;

fig. 5 is a flowchart illustrating a method for releasing resources according to an embodiment of the present application;

fig. 6 is a process diagram of a platform creation method provided in an embodiment of the present application;

fig. 7 is a schematic structural diagram of a platform creation apparatus according to an embodiment of the present application;

fig. 8 is a schematic structural diagram of another platform creation apparatus provided in an embodiment of the present application;

fig. 9 is a schematic diagram of a hardware structure of the platform creation device provided in the present application.

Detailed Description

Reference will now be made in detail to the exemplary embodiments, examples of which are illustrated in the accompanying drawings. When the following description refers to the accompanying drawings, like numbers in different drawings represent the same or similar elements unless otherwise indicated. The implementations described in the following exemplary examples do not represent all implementations consistent with the present application. Rather, they are merely examples of apparatus and methods consistent with certain aspects of the present application, as detailed in the appended claims.

It should be noted that, in this document, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrases "comprising a component of' 8230; \8230;" does not exclude the presence of another like element in a process, method, article, or apparatus that comprises the element.

For ease of understanding, the following explains a concept related to the embodiments of the present application.

Kubernetes: kubernets is an open source system that automatically deploys, extends, and manages "containerized applications. Kubernets can automatically deploy, extend, and run application containers across analytics host clusters. Kubernets supports a variety of container tools such as Docker (a platform that provides a virtual environment required for applications to run through container technology) and the like.

Kubernetes Control Plane: kubernets, which is a node for configuring, managing, scheduling containers, and providing services to external API (application programming interface) services.

Kubernetes Ingress: kubernets provides a service for external routing access to internal containers.

Jupyter: jupyter is shareable text that integrates text, mathematical formulas, code, and visualization, and can be used for data cleaning and conversion, numerical simulation, statistical modeling, machine learning, and the like.

Hadoop: hadoop is a distributed system infrastructure and can utilize cluster resources to perform high-speed operation and storage.

Hive: hive is a data warehouse tool based on Hadoop, and can map structured data files into a database table and provide SQL-like query functions.

Spark: is a fast, general-purpose computing engine designed specifically for large-scale data processing.

In the related art, a physical machine may be configured with higher hardware resources, and then a plurality of users may share the hardware resources of the same physical machine. For example, the physical machine may set 2 platforms, and allocate the operating memory of the single core 8G to each platform, and 2 users may respectively use the platforms of the operating memory of the 2 single cores 8G to perform services such as model training, big data analysis, and the like. However, the resources allocated to each platform by the physical machine are fixed, and when a user does not use a platform in the physical machine, the physical machine still allocates corresponding resources to the platform, thereby resulting in a low resource utilization rate.

In order to solve the technical problem that resource utilization rate of a platform is low in the related art, an embodiment of the present application provides a platform creation method, which is applied to a cloud system, receives a platform creation request sent by a client, acquires configuration information of a first container according to an identifier of the first container in the platform creation request, determines a file path of a mirror image file corresponding to the first container according to file information in the configuration information, acquires the mirror image file of the first container according to the file path, loads the mirror image file and a mounted application program into the first container at the same time when the mirror image file has the corresponding mounted application program, and further implements creation of the platform. Therefore, the use safety of the first container can be improved, and because the mirror image file corresponding to one container is only loaded in each container, the environments corresponding to the mirror image files can be separated through the containers, the dependency conflict among a plurality of environments is avoided, and when the containers are used, the cloud system allocates corresponding resources to the containers, so that the utilization rate of the resources can be improved according to the platform creation method.

Next, the network architecture of the present application will be described with reference to fig. 1.

Fig. 1 is a schematic view of an application scenario provided in an embodiment of the present application. Please refer to fig. 1, which includes: client and cloud systems. The cloud system creates the cloud analysis host in the container A according to the instruction for creating the cloud analysis host, and the cloud system stores the image file corresponding to the cloud analysis host in the storage. When the cloud analysis host is created in the container A, the cloud system can acquire the image file corresponding to the cloud analysis host from the storage and send the image file to the container A, so that the container A loads the image file, and the cloud system creates a cloud analysis host in the container A. Based on the same method, the cloud system can create a corresponding cloud analysis host in the container B. After the cloud system creates corresponding cloud analysis hosts in container a and container B, a user may access the cloud analysis hosts in the containers through an external interface using a client. For example, after the cloud analysis host is created in the container B, the client may receive an address corresponding to the cloud analysis host, and the user inputs the address in the client, so as to access the cloud analysis host in the container B through the external interface. Therefore, environments (such as development environments, operation environments and the like) corresponding to the configuration information of each container can be isolated, the conflict caused by the dependence among a plurality of environments is avoided, the compatibility of the cloud system is improved, resources are allocated to the container where the cloud analysis host is located when the cloud analysis host is used, and the utilization rate of the resources is improved.

The following describes the technical solutions of the present application and how to solve the above technical problems with specific embodiments. These several specific embodiments may be combined with each other below, and details of the same or similar concepts or processes may not be repeated in some embodiments. Embodiments of the present application will be described below with reference to the accompanying drawings.

Fig. 2 is a flowchart illustrating a platform creation method according to an embodiment of the present disclosure. Referring to fig. 2, the method may include:

s201, receiving a platform creation request sent by a client.

The execution subject of the embodiment of the application may be a cloud system, or may be a platform creation device provided in the cloud system, and the platform creation device may be implemented by software, or may be implemented by a combination of software and hardware. Optionally, the cloud system is an operating system supported by cloud computing and cloud storage technologies. For example, the cloud system is a cloud operating system or a cloud computing system. Optionally, the client may be a mobile phone, a computer, a tablet computer, a browser of the mobile phone, a browser of the computer, or the like.

Optionally, the cloud system may be a cloud analysis host system, and the cloud analysis host system may perform big data analysis, model training, and the like. The cloud system comprises a plurality of cloud analysis hosts. For example, a cloud system may include multiple containers, with one cloud analysis host disposed in each container. Therefore, each cloud analysis host can be isolated through the container, and mutual influence among the cloud analysis hosts is avoided.

The platform creation request includes an identification of the first container. Alternatively, the platform may be a cloud analysis host in a container of the cloud system. The platform creation request is to request the cloud system to create a corresponding cloud analysis host in the first container. The identification of the first container may be a container name preset by the user. The cloud system may create a corresponding cloud analytics host in the first container according to the identification of the first container of the platform creation request.

In particular, in practical applications, the cloud system may create multiple containers based on kubernets. For example, kubernets may Control multiple containers through kubernets Control Plane, and optionally, the cloud analysis host may use a development environment of jupitter, wherein jupitter may support a web version integrated development environment of multiple development languages.

S202, acquiring configuration information of the first container according to the platform creation request.

The configuration information includes file information and resource information. The file information comprises a file path of the mirror image file. The file path is the storage address of the mirror image file. The image file is corresponding to the first container and is used for indicating the environment of the first container. For example, the environment of the first container indicated by the image file may be a development environment, a runtime environment, and the like. The environment of the first container may include applications that need to be installed in the first container, and dependencies between the applications. For example, the image file corresponding to the first container may include software that needs to be installed in the first container, a dependency relationship between the respective software (for example, the video software depends on a flash plug-in, and the flash plug-in must be installed when the video software is installed), and the like.

The resource information includes a minimum resource amount and a maximum resource amount. The minimum resource amount is a lower limit of resources allocated by the cloud system for the cloud analysis host in the first container. For example, if the minimum resource amount is the single core 8G, the cloud system allocates the operating memory of the single core 8G to the cloud analysis host in the first container. The maximum resource amount is an upper limit of resources allocated by the cloud system for the cloud analysis host in the first container. For example, if the maximum resource amount is 4 cores 24G, the cloud system may allocate the operating memory of 4 cores 24G to the cloud analysis host in the first container in the idle state. Optionally, the configuration information of the first container may be obtained in multiple preset configuration information according to the identifier of the first container in the platform creation request.

Next, a process of configuring a plurality of preset configuration information is described.

Specifically, the user may pre-configure file information and resource information corresponding to each container, and the cloud system obtains corresponding configuration information according to the identifier of the container.

When the file information is configured, the cloud subsystem may acquire a plurality of dependency packages in advance, where the dependency packages include a plurality of application programs and a dependency relationship corresponding to each application program. For example, when Python (computer programming language) is used for data analysis and a development environment of Jupyter is used, anaconda can be installed in the cloud system, wherein the Anaconda comprises dependency packages commonly used for data analysis by Python and all the development environments corresponding to Jupyter, and any two dependency relationships in the Anaconda do not have dependency conflicts, so that the time for installing and solving the dependency conflicts can be shortened, and the efficiency for configuring the image file can be improved.

And setting a plurality of pre-acquired dependency packages in the image file to complete the configuration of the image file. In an actual application process, when a plurality of cloud analysis hosts of the cloud system are used for big data analysis, the cloud system can acquire a plurality of dependency packages required by the big data analysis in advance. For example, applications such as Hadoop, hive, and Spark are included in the dependency package for big data analysis. And setting the dependence package corresponding to the big data analysis in the image file to complete the configuration of the image file corresponding to the big data analysis.

Optionally, after the configuration of the basic image file (the image file common to the big data, the Python, and the Jupyter) is completed, a plurality of customized image files corresponding to the development environment and the operating environment may be generated by customization according to the basic image file. For example, after a user inputs a dependency to be installed in a cloud system (e.g., the command for installing the Python package lightgbm is "pip install lighting gbm"), the system combines the command for constructing the base image and the command for constructing the custom image, and then constructs a new custom image by calling an Application Programming Interface (API) provided by Docker. A plurality of user-defined image files are generated through the basic image file, and the complexity of configuring the user-defined image files by a user can be reduced.

After the cloud system completes configuration of the image file, the cloud system can store at least one image file into a preset database and acquire a file path of the image file in the database. For example, the cloud analysis system may store the configured 1 base image file and a plurality of user-defined image files generated according to the base image file into a Harbor (open source implementation of a Docker image warehouse), and obtain a storage address of each image file in the Harbor.

When configuring the resource information, the minimum resource amount and the maximum resource amount corresponding to each container may be set arbitrarily. For example, the minimum resource amount corresponding to the container is 8G run memory of the single core, and the maximum resource amount corresponding to the container is 4G 24G memory of the core. Therefore, a plurality of configuration information corresponding to a plurality of containers can be rapidly configured, and the cloud system can acquire the configuration information corresponding to the platform creation request from the plurality of configuration information according to the received platform creation request.

S203, acquiring an operation file corresponding to the first container according to the file information, and loading the operation file to the first container to realize platform creation.

Optionally, the operating file includes an image file and an application program. The application program is a program mounted under the mirror image file. Optionally, the running file may include an image file, an application program, and a dependency relationship between the application programs. For example, in the process of configuring the image file, when a large number of programs in a dependency package corresponding to large data analysis acquired by a cloud system are available, and the memory of the dependency package is large, or when the dependency package is updated frequently, the cloud system can mount the dependency package corresponding to the large data analysis into the image file, so that the time for pulling the image file by a Docker container can be reduced, and since the dependency package related to the large data analysis can be updated regularly, hot update can be achieved by updating the content in the mount dependency package, thereby avoiding reconstructing the image, and then restarting the step of using the image container, thereby improving the efficiency of updating the dependency package.

The operation file corresponding to the first container may be obtained according to the following feasible implementation manners: and acquiring the mirror image file corresponding to the first container according to the file path. Optionally, the image file corresponding to the first container may be acquired in a preset storage space according to the file path, where the preset storage space includes a plurality of image files stored in advance. For example, the file path may be a storage address of the image file stored in the Habor, and the image file corresponding to the first container may be obtained in the Habor according to the file path of the image file in the configuration information of the first container.

And judging whether the mirror image file corresponds to a mounted application program. Optionally, whether the mirror image file corresponds to the mounted application program may be determined according to the following feasible implementation manner: and acquiring the mounted application program directory in the image file. Alternatively, the directory in which the application is mounted may be a directory preset by the user. For example, after the cloud system acquires the dependency package corresponding to the big data analysis, the dependency package can be uploaded to the corresponding data volume through kubernets, and the data volume is mounted in the/opt directory of the image file, so that the cloud system can judge whether the image file corresponds to the mounted application program according to the file in the/opt directory.

Optionally, if the mount application directory includes the identifier of the mount application, it is determined that the mirror image file corresponds to the mount application; and if the mounted application program directory does not comprise the identifier of the mounted application program, determining that the mounted application program does not exist in the image file. For example, when the cloud system uploads the dependency package to the corresponding data volume through Kubernetes, an identifier (such as a name) of the data volume may be added, and if the identifier of the data volume exists in the mount application directory, it indicates that the data volume is mounted in the image file, and if the identifier of the data volume does not exist in the mount application directory, it indicates that the data volume is directly added in the image file. Optionally, an application program directory for mounting may be preset, and then whether the mirror image file corresponds to the mounted application program is determined according to the application program directory for mounting. For example, a user may preset that only the mounted application program is stored in the/opt directory, if no application program or file exists in the/opt directory, it is determined that the image file does not have the mounted application program, and if the application program or file exists in the/opt directory, it is determined that the image file corresponds to the mounted application program.

Optionally, the mounted application program corresponding to the image file may include a plurality of application programs and a dependency relationship between the application programs.

If the mirror image file corresponds to the mounted application program, acquiring a loading path of the mounted application program in the mirror image file, and acquiring the mounted application program corresponding to the first container according to the loading path of the mounted application program. In this case, the operation file corresponding to the first container includes an image file corresponding to the first container and a mount application corresponding to the first container. For example, if the image file of the first container corresponds to a mounted application file, and the application file includes an application a and an application B, the running file corresponding to the first container includes the image file of the first container, the application a and the application B. Optionally, when a dependency relationship between the application programs exists between the multiple mounted application programs, the running file corresponding to the first container further includes the dependency relationship between the multiple mounted application programs.

And if the mirror image file does not have the mounted application program, determining the mirror image file corresponding to the first container as the running file corresponding to the first container. For example, if the image file of the first container does not have the application program mounted, it indicates that the image file includes all the application programs and the dependency relationships required by the first container, and therefore, the image file corresponding to the first container may be determined as the running file corresponding to the first container.

The following describes in detail a process of acquiring a run file corresponding to a first container with reference to fig. 3A to 3B.

Fig. 3A is a schematic diagram of a process of acquiring an operating file according to an embodiment of the present application. In the embodiment shown in fig. 3A, the image file corresponding to the first container does not include the mounted application, referring to fig. 3A, including: cloud systems. When the cloud system receives the platform creation request, the cloud system determines configuration information corresponding to the platform creation request in the configuration information. The platform creation request comprises the identifier of the container A, and the configuration information comprises the configuration information of the container A, the configuration information of the container B and the configuration information of the container C.

Referring to fig. 3A, the cloud system obtains the configuration information of the container a from the configuration information according to the identifier of the container a, and further obtains the address of the image file of the container a according to the file information of the configuration information of the container a. The cloud system acquires the image file of the container A from the memory according to the address of the image file of the container A, wherein the image file of the container A, the image file of the container B and the image file of the container C are stored in the memory.

Referring to fig. 3A, since the image file of the container a does not have a mount application, the cloud system determines the image file of the container a as a running file and sends the running file to the container a.

Fig. 3B is a schematic diagram of another process for acquiring a run file according to an embodiment of the present application. In the embodiment shown in fig. 3B, the image file corresponding to the first container includes the mounted application, please refer to fig. 3B, which includes: cloud system and memory a. The storage A stores the image file of the container A, the image file of the container B and the image file of the container C. The cloud system obtains the image file of the container A in the memory A.

Referring to fig. 3B, the image file of the container a includes an application a, an application B, and a mount path a, and the cloud system obtains the mount application according to the path a. For example, the cloud system determines a memory B according to the path a, and further obtains an application C and an application D in the memory B. Because the application C and the application D are mounted applications mounted in the image file of the container a, the running file corresponding to the container a includes the application a, the application B, the application C, and the application D.

When the cloud system acquires the operating file corresponding to the first container, the cloud system loads the operating file to the first container so as to achieve platform creation. For example, after the cloud system calls an API provided by the kubernets Control Plane component to create the first container provided with the cloud analysis host, the cloud system loads the running file corresponding to the first container into the first container, so that the cloud analysis host in a specific development environment (such as a big data analysis environment) can be obtained.

And S204, distributing resources for the first container according to the resource information.

After the first container loads the corresponding running file, the cloud analysis host has already been established, and the cloud system may allocate resources to the cloud analysis host in the first container. The resources may be hardware resources or software resources. For example, the resource allocated by the cloud system to the cloud analysis host may be a cpu memory, an operating system resource, or the like.

The first container may be allocated resources according to the following possible implementations: and acquiring the residual resource amount of the cloud system. For example, a cloud system includes a large number of hardware and software resources that are consumed by the cloud system when allocating the hardware and software resources to cloud analysis hosts in a container. Alternatively, the amount of remaining resources may be determined based on the allocated resources and the total resources of the cloud system. For example, if the total resource of the cloud system is 10 cores and 100G of operating memory, and 9 cores and 92G of operating memory have been configured for multiple containers, the remaining resource amount of the cloud system is a single core and 8G of memory.

And determining the first resource amount according to the minimum resource amount, the maximum resource amount and the residual resource amount. The first resource amount is greater than or equal to the minimum resource amount, and the first resource amount is less than or equal to the maximum resource amount. For example, the resource information in the configuration information of the container a is a minimum resource amount single-core 8G operating memory and a maximum resource amount 4-core 24G operating memory, and when the remaining resource amount of the cloud system is greater than the 4-core 24G operating memory, the cloud system determines that the first resource amount is the 4-core 24G operating memory, and when the remaining resource amount of the cloud system is less than the 4-core 24G operating memory and greater than the single-core 8G operating memory, the cloud system determines that the first resource amount is the single-core 8G operating memory.

Resources of a first resource amount size are allocated for the first container. For example, if the first resource amount is a single-core 8G operating memory, the cloud system allocates the single-core 8G operating memory to the cloud analysis host of the first container, and if the first resource amount is a 4-core 24G operating memory, the cloud system allocates the 4-core 24G operating memory to the cloud analysis host of the first container.

Optionally, when the remaining resources of the cloud system are greater than or equal to the first threshold, if the operating memory of the cloud analysis host in the first container is insufficient for data processing, or the data processing time is long, the cloud system may break through the maximum resource amount of the first container, and allocate resources to the first container. For example, the maximum resource amount of the first container is 4 cores and 24G running memories, and the cloud system has allocated 4 cores and 24G running memories into the first container, and if the remaining resources of the cloud system are 20 cores and 80G running memories (the remaining resources are sufficient), the cloud system may continue to allocate resources to the first container, so as to improve the processing efficiency of the cloud analysis host in the first container.

S205, generating address information corresponding to the first container, and sending the address information to the client.

And the address information is used for the client to access the platform corresponding to the first container. For example, the user may input address information corresponding to the first container in a browser, so that the user accesses the cloud analysis host in the first container through the browser.

The embodiment of the application provides a platform creation method, which is applied to a cloud system and used for receiving a platform creation request sent by a client, wherein the platform creation request comprises an identifier of a first container, configuration information of the first container is obtained according to the platform creation request, the configuration information comprises file information and resource information, the file information comprises a file path of an image file of the first container, and the resource information comprises the maximum resource amount and the minimum resource amount of the first container. In the above method, compared to a physical host. The capacity of the system can be rapidly expanded by using the cloud system, each platform is separated by the cloud system through the container, the development environment and the operation environment of the platform in each container are mutually isolated, the problem of development environment damage caused by the dependence conflict of different development environments of different platforms is solved, the compatibility of data processing is improved, and the cloud system can start the container and allocate resources to the container when the platform needs to be created, so that the resource idleness can be reduced, and the utilization rate of the resources is improved.

In addition to the embodiment shown in fig. 2, a method for generating address information corresponding to the first container and transmitting the address information to the client will be described in detail with reference to fig. 4.

Fig. 4 is a flowchart illustrating a method for generating address information according to an embodiment of the present application. Please refer to fig. 4, which includes:

s401, generating an authentication key corresponding to the first container.

The authentication key is used to start the first container. Optionally, when the user configures the configuration information of the first container in advance, the authentication key of the first container may be configured in the configuration information, and the cloud analysis host in the first container may be accessed or started only by inputting the authentication key. For example, if the authentication key corresponding to the first container is 123456, the 123456 is configured in the configuration information of the first container, and when the first container is started or accessed, the user needs to input the 123456 to access the cloud analysis host in the first container.

Alternatively, the authentication key of the first container may be set as an environment variable of the first container. The environment variable is a parameter for specifying an operating system running environment in the operating system. For example, the environment variables may be a temporary folder location and a system folder location, among others.

Optionally, an environment variable character of the first container may be added to the configuration information corresponding to the first container as an authentication key of the first container, so that when the first container is started each time, the cloud system becomes a different environment variable, and the environment variable is determined as the authentication key corresponding to the first container. For example, in a container using the Jupyter development environment, the authentication key of Jupyter may be set as an environment variable of the container. Because the authentication key corresponding to the first container is the environment information of the first container, and the environment information is determined inside the cloud system, the user cannot obtain the environment information of the first container, and therefore, by configuring an environment variable as the authentication key in the configuration information of the first container, the user is prevented from inputting the authentication key of the first container when the first container is started, the user experience is improved, and the security of the first container is improved.

S402, generating a domain name corresponding to the first container according to the identifier of the first container and the first preset character.

The domain name includes an identification of the first container and a first predetermined character. For example, the domain name may be a routing rule corresponding to the first container. Optionally, the first preset character may be a character preset by a user. For example, the first preset character may be com, jupitter, etc. The domain name comprises a first-level domain name, a second-level domain name and a third-level domain name, and the domain name corresponding to the first container is generated according to the first-level domain name, the second-level domain name and the third-level domain name. The third-level domain name may be an identifier of the first container, and the second-level domain name and the first-level domain name may be first preset characters preset by a user. For example, if the identifier of the first container is my-jupyter, and the first preset character includes jupyter and com, the my-jupyter may be used as a third-level domain name, the jupyter as a fixed second-level domain name, and the com as a first-level domain name, so as to obtain the domain name corresponding to the first container as my-jupyter.

And S403, adding an authentication key at the tail part of the domain name to obtain address information.

Optionally, an authentication key may be added to the tail of the domain name to obtain the address information of the first container. For example, if the domain name is, for example, my-jupitter.jupitter.com, and the key is 123456, the generated address is http:// my-jupitter.jupitter.comtoken =123456, wherein the token parameter is a key parameter required by jupitter authentication, so that a user can be prevented from inputting a password when accessing the first container, user experience is improved, and the use safety of the first container is improved.

After obtaining the address information, the cloud system may send the address information to the client, and access a platform corresponding to the first container through the address information by using the client. For example, when the cloud system obtains the address information of the first container, the cloud system may access the interface of the internal container through the kubernets Ingress route, where the address corresponding to the interface is the address information of the first container, and when the user obtains the address information, the user may input the address information of the first container in the browser, so as to access the first container through the external interface.

The embodiment of the application provides a method for generating address information, which includes generating an authentication key corresponding to a first container, generating a domain name corresponding to the first container according to an identifier of the first container and a first preset character, and adding the authentication key at the tail of the domain name to obtain the address information. In the method, the authentication key corresponding to the first container is an environment variable of the first container, and since the environment variable of the first container is variable when the first container is started, the authentication key of the first container is also variable, so that the use safety of the cloud analysis host in the first container is improved, and when the address information corresponding to the first container is generated, the authentication key is directly added to the tail of the domain name of the first container.

On the basis of any one of the above embodiments, the platform creation method of the present application further includes a process of releasing resources, and the following describes in detail the process of releasing resources allocated by the first container by taking the first container as an example and referring to fig. 5.

Fig. 5 is a flowchart illustrating a method for releasing resources according to an embodiment of the present application. Referring to fig. 5, the method includes:

s501, obtaining the use state of the first container in a preset time period before the current time.

Alternatively, the preset time period may be any preset time period. For example, the preset period of time may be 30 minutes, 1 hour, 3 hours, or the like. The use state of the first container is used to indicate whether the first container is used within a preset period of time before the current time. Wherein the use state of the first container is used or idle. For example, the preset time period preset by the user is 1 hour, if the first container is used within 1 hour before the current time (big data analysis, model training, etc.), the use state of the first container is used, and if the first container is not used within 1 hour between the current times, the use state of the first container is idle.

S502, if the using state is idle, deleting the first container and releasing the resource allocated to the first container.

Optionally, if the usage status of the first container is idle, the cloud system deletes the first container and releases the resource allocated to the first container. For example, the resource allocated by the cloud system to the first container is a single-core 8G operating memory, the preset time period is 1 hour, if the first container is not used within 1 hour, the use state of the first container is idle, and at this time, the cloud system may delete the first container and recycle the single-core 8G operating memory allocated to the first container. For example, if the current memory of the cloud system is the running memory of 3 cores and 24G, and the cloud system has allocated the running memory of a single core and 8G to the first container, when the cloud system deletes the first container, the cloud system may recycle the memory of the first container, and at this time, the memory of the cloud system is the memory of 4 cores and 32G.

Optionally, if the usage status of the first container is in use, the cloud system does not delete the first container, and does not recycle the resource allocated to the first container.

The embodiment of the application provides a platform creation method, which includes the steps of obtaining a use state of a first container in a preset time period before the current time, deleting the first container and releasing resources allocated to the first container if the use state is idle, so that when the first container is not used in a long time period, a cloud system can recover the resources allocated to the first container, the flexibility of resource allocation is improved, and the utilization rate of the resources is further improved.

On the basis of any of the above embodiments, the following describes the procedure of the above platform creation method with reference to fig. 6.

Fig. 6 is a process diagram of a platform creation method according to an embodiment of the present application. See fig. 6, including the browser and cloud system. The cloud system receives an instruction sent by the browser to create a platform for container a. The cloud system receives an instruction of a platform for creating the container A, acquires configuration information, and acquires the configuration information of the container A from the configuration information, wherein the configuration information comprises the container A, the configuration information and the configuration information of the container B.

Referring to fig. 6, the cloud system determines an address of the image file of the container a according to the configuration information of the container a, and obtains the image file of the container a in the corresponding memory according to the address of the image file of the container a. Wherein the memory stores therein image files of a plurality of containers. For example, the memory includes an image of container A and an image of container B. And the cloud system sends the mirror image file of the container A to the container A, and the container A loads the corresponding mirror image file to complete the creation of the platform.

Referring to fig. 6, when the container a is completely loaded, the cloud system may allocate the operating memory of the single core 8G to the container a as the operating memory of the container a platform according to the configuration information of the container a. The cloud system may generate address information for container a and send the address information for container a to the browser. After the user inputs the address information of the container A in the browser and clicks login, the user can access the container A through the browser. This is in contrast to a physical host. The capacity of the system can be rapidly expanded by using the cloud system, each platform is separated by the cloud system through the container, the development environment and the operation environment of the platform in each container are mutually isolated, the problem of development environment damage caused by the dependence conflict of different development environments of different platforms is solved, the compatibility of data processing is improved, and the cloud system can start the container and allocate resources to the container when the platform needs to be created, so that the resource idleness can be reduced, and the utilization rate of the resources is improved.

Fig. 7 is a schematic structural diagram of a platform creating apparatus according to an embodiment of the present application. Referring to fig. 7, the platform creating apparatus 10 may be disposed in a terminal device, where the platform creating apparatus 10 includes a receiving module 11, a first obtaining module 12, a second obtaining module 13, an allocating module 14, and a generating module 15, where:

the receiving module 11 is configured to receive a platform creation request sent by a client, where the platform creation request includes an identifier of a first container;

the first obtaining module 12 is configured to obtain configuration information of the first container according to the platform creation request, where the configuration information includes file information and resource information;

the second obtaining module 13 is configured to obtain an operation file corresponding to the first container according to the file information, and load the operation file to the first container, so as to implement platform creation;

the allocating module 14 is configured to allocate resources to the first container according to the resource information;

the generating module 15 is configured to generate address information corresponding to the first container, and send the address information to the client, where the address information is used for the client to access a platform corresponding to the first container.

In a possible implementation manner, the second obtaining module 13 is specifically configured to:

acquiring a mirror image file corresponding to the first container according to the file path;

judging whether the mirror image file corresponds to a mounted application program or not;

if yes, obtaining a loading path of the mounted application program in the image file, and obtaining the mounted application program corresponding to the first container according to the loading path of the mounted application program, wherein the running file comprises the image file corresponding to the first container and the mounted application program corresponding to the first container;

if not, determining the image file corresponding to the first container as the running file corresponding to the first container.

In a possible implementation manner, the second obtaining module 13 is specifically configured to: acquiring a mirror image file corresponding to the first container in a preset storage space according to the file path; the preset storage space comprises a plurality of pre-stored mirror image files.

In a possible implementation manner, the second obtaining module 13 is specifically configured to: acquiring a mounted application program directory in the mirror image file;

if the mounted application program directory comprises the identifier of the mounted application program, determining that the mirror image file corresponds to the mounted application program;

and if the mount application program directory does not comprise the identifier of the mount application program, determining that the mount application program does not exist in the image file.

In a possible implementation, the assignment module 14 is specifically configured to:

acquiring the residual resource amount of the cloud system;

determining a first resource amount according to the minimum resource amount, the maximum resource amount and the residual resource amount, wherein the first resource amount is greater than or equal to the minimum resource amount, and the first resource amount is less than or equal to the maximum resource amount;

allocating resources of the first resource amount size to the first container.

In a possible implementation, the generating module 15 is specifically configured to:

generating an authentication key corresponding to the first container;

generating a domain name corresponding to the first container according to the identifier of the first container and a first preset character, wherein the domain name comprises the identifier of the first container and the first preset character;

and adding the authentication key at the tail part of the domain name to obtain the address information.

The platform creation apparatus provided in the embodiment of the present application may execute the technical solutions shown in the above method embodiments, and the implementation principles and beneficial effects thereof are similar and will not be described herein again.

The platform creation device shown in the embodiment of the present application may be a chip, a hardware module, a processor, or the like. Of course, the platform creation device may have other forms, which is not specifically limited in this embodiment of the present application.

Fig. 8 is a schematic structural diagram of another platform creation apparatus according to an embodiment of the present application. On the basis of the embodiment shown in fig. 7, please refer to fig. 8, the platform creation apparatus 10 further includes a third obtaining module 16, where the third obtaining module 16 is configured to:

acquiring the state of the first container in a preset time period before the current moment, wherein the state is a use state or an unused state;

and if the state of the first container in a preset time period before the current time is an unused state, deleting the first container and releasing the resources allocated to the first container.

The platform creation device shown in the embodiment of the application can be a chip, a hardware module, a processor and the like. Of course, the platform creation device may have other forms, and this is not particularly limited in this embodiment of the present application.

Fig. 9 is a schematic diagram of a hardware structure of the platform creation device provided in the present application. Referring to fig. 9, the platform creating device 20 may include: a processor 21 and a memory 22, wherein the processor 21 and the memory 22 may be in communication; illustratively, the processor 21 and the memory 22 communicate via a communication bus 23, the memory 22 being configured to store program instructions, the processor 21 being configured to invoke the program instructions in the memory to perform the platform creation method illustrated in any of the method embodiments described above.

Optionally, platform creation device 20 may also include a communication interface, which may include a transmitter and/or a receiver.

Alternatively, the Processor may be a Central Processing Unit (CPU), other general-purpose Processor, a Digital Signal Processor (DSP), an Application Specific Integrated Circuit (ASIC), or the like. A general purpose processor may be a microprocessor or the processor may be any conventional processor or the like. The steps of a method disclosed in connection with the present application may be embodied directly in a hardware processor, or in a combination of the hardware and software modules in the processor.

A readable storage medium having a computer program stored thereon; the computer program is for implementing a platform creation method as described in any of the embodiments above.

An embodiment of the present application provides a computer program product, which includes instructions that, when executed, cause a computer to execute the above platform creation method.

All or a portion of the steps of implementing the above-described method embodiments may be performed by hardware associated with program instructions. The foregoing program may be stored in a readable memory. When executed, the program performs steps comprising the method embodiments described above; and the aforementioned memory (storage medium) includes: read-only memory (ROM), RAM, flash memory, hard disk, solid state disk, magnetic tape, floppy disk, optical disk, and any combination thereof.

Embodiments of the present application are described with reference to flowchart illustrations and/or block diagrams of methods, apparatus (systems), and computer program products according to embodiments of the application. It will be understood that each flow and/or block of the flow diagrams and/or block diagrams, and combinations of flows and/or blocks in the flow diagrams and/or block diagrams, can be implemented by computer program instructions. These computer program instructions may be provided to a processing unit of a general purpose computer, special purpose computer, embedded processor, or other programmable terminal device to produce a machine, such that the instructions, which execute via the processing unit of the computer or other programmable terminal device, create means for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.

These computer program instructions may also be stored in a computer-readable memory that can direct a computer or other programmable terminal equipment to function in a particular manner, such that the instructions stored in the computer-readable memory produce an article of manufacture including instruction means which implement the function specified in the flowchart flow or flows and/or block diagram block or blocks.

These computer program instructions may also be loaded onto a computer or other programmable terminal equipment to cause a series of operational steps to be performed on the computer or other programmable apparatus to produce a computer implemented process such that the instructions which execute on the computer or other programmable apparatus provide steps for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.

It will be apparent to those skilled in the art that various changes and modifications can be made in the embodiments of the present application without departing from the spirit and scope of the application. Thus, if such modifications and variations of the embodiments of the present application fall within the scope of the claims of the present application and their equivalents, the present application is also intended to encompass such modifications and variations.

In this application, the terms "include," "includes," and variations thereof may refer to non-limiting inclusions; the term "or" and variations thereof may mean "and/or". The terms "first," "second," and the like in this application are used for distinguishing between similar elements and not necessarily for describing a particular sequential or chronological order. In the present application, "a plurality" means two or more. "and/or" describes the association relationship of the associated object, indicating that there may be three relationships, for example, a and/or B, which may indicate: a exists alone, A and B exist simultaneously, and B exists alone. The character "/" generally indicates that the former and latter associated objects are in an "or" relationship.

Claims

1. A platform creation method is applied to a cloud system, the cloud system comprises a plurality of containers, and each container is provided with a cloud analysis host, and the method comprises the following steps:

receiving a platform creation request sent by a client, wherein the platform creation request comprises an identifier of a first container, and the platform creation request is used for requesting a cloud system to create a corresponding cloud analysis host in the first container;

acquiring configuration information of the first container according to the platform creation request, wherein the configuration information comprises file information and resource information; when the file information is configured, a plurality of dependency packages required by big data analysis are obtained in advance, the dependency packages comprise a plurality of application programs and a dependency relationship corresponding to each application program, and any two dependency relationships cannot generate dependency conflict; setting a plurality of pre-acquired dependency packages in the image file corresponding to the first container to complete configuration of the image file;

when the first container is used, allocating resources for the first container according to the resource information;

generating address information corresponding to the first container, and sending the address information to the client, wherein the address information is used for the client to access a platform corresponding to the first container;

the file information includes a file path of the mirror image file, and the obtaining of the running file corresponding to the first container according to the file information includes:

if yes, acquiring a loading path of the mounted application program in the mirror image file; acquiring the mounted application program corresponding to the first container according to the loading path of the mounted application program, wherein the running file comprises an image file corresponding to the first container, the mounted application program corresponding to the first container and a dependency relationship among the application programs;

2. The method according to claim 1, wherein the obtaining an image file corresponding to the first container according to the file path comprises:

acquiring an image file corresponding to the first container in a preset storage space according to the file path; the preset storage space comprises a plurality of pre-stored image files.

3. The method according to claim 1 or 2, wherein the determining whether the image file corresponds to a mounted application comprises:

acquiring a mounted application program directory in the mirror image file;

and if the mount application program directory does not comprise the identifier of the mount application program, determining that the mount application program does not exist in the mirror image file.

4. The method according to claim 1 or 2, wherein the resource information comprises a minimum resource amount and a maximum resource amount; the allocating resources to the first container according to the resource information includes:

acquiring the residual resource amount of the cloud system;

allocating resources of the first resource amount size to the first container.

5. The method according to claim 1 or 2, wherein the generating address information corresponding to the first container comprises:

generating an authentication key corresponding to the first container;

6. The method according to claim 1 or 2, wherein after allocating resources for the first container according to the resource information, the method further comprises:

acquiring the use state of the first container in a preset time period before the current moment;

and if the using state is idle, deleting the first container and releasing the resource allocated to the first container.

7. The utility model provides a platform establishing device, its characterized in that is applied to cloud system, and cloud system includes a plurality of containers, sets up a cloud analysis host computer in every container, including receiving module, first acquisition module, second acquisition module, distribution module and generation module, wherein:

the receiving module is used for receiving a platform creating request sent by a client, wherein the platform creating request comprises an identifier of a first container, and the platform creating request is used for requesting a cloud system to create a corresponding cloud analysis host in the first container;

the first obtaining module is used for obtaining configuration information of the first container according to the platform creating request, wherein the configuration information comprises file information and resource information; when the file information is configured, a plurality of dependency packages required by big data analysis are obtained in advance, the dependency packages comprise a plurality of application programs and a dependency relationship corresponding to each application program, and any two dependency relationships cannot generate dependency conflict; setting a plurality of pre-acquired dependency packages in the image file corresponding to the first container to complete the configuration of the image file;

the second obtaining module is configured to obtain an operation file corresponding to the first container according to the file information, and load the operation file to the first container to implement platform creation, where the file information includes a file path of a mirror image file;

the allocation module is used for allocating resources to the first container according to the resource information when the first container is used;

the generating module is configured to generate address information corresponding to the first container, and send the address information to the client, where the address information is used for the client to access a platform corresponding to the first container;

the second obtaining module is specifically configured to:

if yes, acquiring a loading path of the mounted application program in the mirror image file; acquiring the mounted application program corresponding to the first container according to the loading path of the mounted application program, wherein the running file comprises a mirror image file corresponding to the first container, the mounted application program corresponding to the first container and a dependency relationship among the application programs;

8. A platform creation device comprising a processor and a memory;

the memory stores computer execution instructions;

the processor executes the computer-executable instructions stored by the memory, causing the processor to perform the platform creation method of any of claims 1 to 6.

9. A computer-readable storage medium having stored therein computer-executable instructions for implementing the platform creation method of any one of claims 1 to 6 when executed by a processor.