CN114185639A - Application container extension engine platform - Google Patents

Application container extension engine platform Download PDF

Info

Publication number
CN114185639A
CN114185639A CN202111288419.8A CN202111288419A CN114185639A CN 114185639 A CN114185639 A CN 114185639A CN 202111288419 A CN202111288419 A CN 202111288419A CN 114185639 A CN114185639 A CN 114185639A
Authority
CN
China
Prior art keywords
application container
target
resource
data
unit
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202111288419.8A
Other languages
Chinese (zh)
Inventor
刘坤
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Beijing Yindun Tai'an Network Technology Co ltd
Original Assignee
Beijing Yindun Tai'an Network Technology Co ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Beijing Yindun Tai'an Network Technology Co ltd filed Critical Beijing Yindun Tai'an Network Technology Co ltd
Priority to CN202111288419.8A priority Critical patent/CN114185639A/en
Publication of CN114185639A publication Critical patent/CN114185639A/en
Pending legal-status Critical Current

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F9/00—Arrangements for program control, e.g. control units
    • G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
    • G06F9/44—Arrangements for executing specific programs
    • G06F9/455—Emulation; Interpretation; Software simulation, e.g. virtualisation or emulation of application or operating system execution engines
    • G06F9/45533—Hypervisors; Virtual machine monitors
    • G06F9/45558—Hypervisor-specific management and integration aspects
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F9/00—Arrangements for program control, e.g. control units
    • G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
    • G06F9/46—Multiprogramming arrangements
    • G06F9/50—Allocation of resources, e.g. of the central processing unit [CPU]
    • G06F9/5005—Allocation of resources, e.g. of the central processing unit [CPU] to service a request
    • G06F9/5027—Allocation of resources, e.g. of the central processing unit [CPU] to service a request the resource being a machine, e.g. CPUs, Servers, Terminals
    • G06F9/505—Allocation of resources, e.g. of the central processing unit [CPU] to service a request the resource being a machine, e.g. CPUs, Servers, Terminals considering the load
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00—Computing arrangements based on biological models
    • G06N3/02—Neural networks
    • G06N3/08—Learning methods
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00—Computing arrangements based on biological models
    • G06N3/02—Neural networks
    • G06N3/10—Interfaces, programming languages or software development kits, e.g. for simulating neural networks
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F9/00—Arrangements for program control, e.g. control units
    • G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
    • G06F9/44—Arrangements for executing specific programs
    • G06F9/455—Emulation; Interpretation; Software simulation, e.g. virtualisation or emulation of application or operating system execution engines
    • G06F9/45533—Hypervisors; Virtual machine monitors
    • G06F9/45558—Hypervisor-specific management and integration aspects
    • G06F2009/45562—Creating, deleting, cloning virtual machine instances
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F9/00—Arrangements for program control, e.g. control units
    • G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
    • G06F9/44—Arrangements for executing specific programs
    • G06F9/455—Emulation; Interpretation; Software simulation, e.g. virtualisation or emulation of application or operating system execution engines
    • G06F9/45533—Hypervisors; Virtual machine monitors
    • G06F9/45558—Hypervisor-specific management and integration aspects
    • G06F2009/4557—Distribution of virtual machine instances; Migration and load balancing
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F9/00—Arrangements for program control, e.g. control units
    • G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
    • G06F9/44—Arrangements for executing specific programs
    • G06F9/455—Emulation; Interpretation; Software simulation, e.g. virtualisation or emulation of application or operating system execution engines
    • G06F9/45533—Hypervisors; Virtual machine monitors
    • G06F9/45558—Hypervisor-specific management and integration aspects
    • G06F2009/45575—Starting, stopping, suspending or resuming virtual machine instances
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F9/00—Arrangements for program control, e.g. control units
    • G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
    • G06F9/44—Arrangements for executing specific programs
    • G06F9/455—Emulation; Interpretation; Software simulation, e.g. virtualisation or emulation of application or operating system execution engines
    • G06F9/45533—Hypervisors; Virtual machine monitors
    • G06F9/45558—Hypervisor-specific management and integration aspects
    • G06F2009/45591—Monitoring or debugging support
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F2209/00—Indexing scheme relating to G06F9/00
    • G06F2209/50—Indexing scheme relating to G06F9/50
    • G06F2209/5019—Workload prediction
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F2209/00—Indexing scheme relating to G06F9/00
    • G06F2209/50—Indexing scheme relating to G06F9/50
    • G06F2209/508—Monitor

Landscapes

  • Engineering & Computer Science (AREA)
  • Software Systems (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • Computing Systems (AREA)
  • Biophysics (AREA)
  • Biomedical Technology (AREA)
  • Computational Linguistics (AREA)
  • Data Mining & Analysis (AREA)
  • Evolutionary Computation (AREA)
  • General Health & Medical Sciences (AREA)
  • Molecular Biology (AREA)
  • Artificial Intelligence (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Mathematical Physics (AREA)
  • Health & Medical Sciences (AREA)
  • Debugging And Monitoring (AREA)

Abstract

The invention provides an application container extension engine platform, which comprises: the quantity determining module is used for acquiring the current operation load data of the server and determining the quantity of the extended copies based on the current operation load data; the expansion module is used for copying and expanding the initial application container through the expansion engine according to the expansion copy quantity to obtain a target application container; and the detection module is used for detecting the operation data of the target application container, adjusting the target application container based on the detection result and completing the expansion of the initial application container. By rapidly expanding or reducing the application container according to the load operation data of the server monitored in real time and deploying the internal resources in time, a large amount of time is saved, and the usability of the application is guaranteed.

Description

Application container extension engine platform
Technical Field
The invention relates to the technical field of application container extension, in particular to an application container extension engine platform.
Background
At present, an extension engine can split an application into a plurality of independent services with business attributes, each service runs in an independent process, and the services cooperate with each other through a lightweight communication mechanism, so that business value is provided for a terminal user;
as an open-source application container engine, the Docker container enables developers to package applications and dependent packages thereof into a portable Docker container, and then the Docker container is issued to a Linux machine in a Docker container environment;
a Docker container cluster constructed based on the existing Docker container arranging and deploying technology cannot automatically adjust resources according to the real-time Docker container load condition, and therefore the load capacity of the Docker container cluster in the operation stage is insufficient. The process of deploying the Docker container includes a series of operations such as downloading the mirror image, deploying the mirror image, and starting the Docker container. When finding that the current Docker container resource cannot meet the load requirement, the resource application is started, and the process of deploying a new Docker container is very time-consuming due to operations such as downloading mirror images, so that the availability of the application cannot be guaranteed in the time.
Therefore, the invention provides an application container expansion engine platform, which can quickly expand or reduce an application container according to real-time monitored load operation data of a server, and can timely deploy internal resources, thereby saving a large amount of time and providing guarantee for the usability of the application.
Disclosure of Invention
The invention provides an application container expansion engine platform which is used for rapidly expanding or reducing an application container according to real-time monitored load operation data of a server and deploying internal resources in time, so that a large amount of time is saved, and the usability of the application is guaranteed.
The invention provides an application container extension engine platform, which comprises:
the quantity determining module is used for acquiring the current operation load data of the server and determining the quantity of the extended copies based on the current operation load data;
the expansion module is used for copying and expanding the initial application container through the expansion engine according to the expansion copy quantity to obtain a target application container;
and the detection module is used for detecting the operation data of the target application container, adjusting the target application container based on the detection result and completing the expansion of the initial application container.
Preferably, the application container extension engine platform, the quantity determination module, includes:
the system comprises an instruction acquisition unit, a data acquisition unit and a data processing unit, wherein the instruction acquisition unit is used for acquiring a data acquisition instruction sent by a management terminal, and the data acquisition instruction comprises a target server type and a data type to be acquired;
the operation state determining unit is used for acquiring the operation state of the target server based on the data acquisition instruction and judging whether the target server normally operates or not based on the operation state;
and the data acquisition unit is used for acquiring the operation load data of the target server based on the data acquisition instruction when the target server is judged to normally operate, and otherwise, judging that the operation load data acquisition fails.
Preferably, the application container extension engine platform, the quantity determining module, further includes:
the data acquisition unit is used for acquiring current operation load data of the server and dividing the current operation load data into a test set and a training set;
the model building unit is used for building a neural network model and training the neural network model based on the training set to obtain a target neural network model;
and the load value determining unit is used for analyzing and processing the test set based on the target neural network model to obtain a load value corresponding to the test set, wherein the load value is used for representing the access amount of the current request access server.
Preferably, the application container extension engine platform, the load value determination unit, includes:
the load value comparison unit is used for acquiring the obtained load value, acquiring the maximum load value of an initial application container in the server and comparing the obtained load value with the maximum load value;
an extension determination unit configured to determine a magnitude relation between the obtained load value and the maximum load value based on a comparison result;
when the obtained load value is larger than the maximum load value, judging that the initial application container in the server needs to be expanded;
otherwise, keeping the number of the current initial application containers unchanged;
and the copy quantity calculation unit is used for determining the copy quantity to be expanded to the initial application container based on a target difference value between the obtained load value and the maximum load value when the initial application container in the server is judged to be expanded, wherein the copy quantity is used for representing the expansion quantity of the initial application container.
Preferably, the application container extension engine platform, the copy amount calculation unit, includes:
the copy quantity verification unit is used for acquiring the copy quantity for expanding the initial application container and comparing the copy quantity with a preset threshold value;
if the copy quantity is larger than the preset threshold, judging that the copy quantity for expanding the initial application container exceeds the standard, and taking the preset threshold as a target copy quantity for expanding the initial application container;
otherwise, judging that the copy quantity for expanding the initial application container is qualified.
Preferably, the application container extension engine platform, the extension module, includes:
an extended instruction obtaining unit, configured to receive, by using the extended engine, an extended instruction sent by a server, where the extended instruction is analyzed by the extended engine, so as to obtain an extended copy amount corresponding to the copy extension of the initial application container;
an extended task determining unit, configured to create an application container extended task based on the extended copy quantity, obtain a service configuration parameter of the initial application container based on the extended task, and determine a storage path after the initial application container is extended;
an extension unit, configured to extend the initial application container based on the service configuration parameter of the initial application container to obtain a target application container, and store the target application container based on the storage path, where the number of the target application containers is consistent with the number of the extended copies;
the resource deployment unit is used for acquiring resource configuration information in the initial application container and selecting a target resource deployment mode from a preset resource deployment mode library based on the resource configuration information;
the resource deployment unit is configured to deploy, in the target application container, the resource inside the initial application container based on the target resource deployment mode, where the resource in the target application container belongs to the initial application container;
the resource scheduling determining unit is used for monitoring the user access amount of the target application container after the resource deployment is completed, and judging whether the target application container needs to perform resource rescheduling or not based on the user access amount;
the resource scheduling unit is used for customizing a resource rescheduling strategy based on the user access amount when the resource rescheduling is judged to be needed, and determining a resource set of each target application container based on the resource rescheduling strategy;
and the resource scheduling unit is used for determining the target scheduling amount of each target application container to the resources based on the resource set of each target application container, and performing resource rescheduling on each target application container based on the target scheduling amount to obtain a final target application container, wherein each application container corresponds to one target scheduling amount.
Preferably, the application container extension engine platform, the resource scheduling determining unit, includes:
the resource utilization rate determining unit is used for monitoring the resource load coefficient of the target application container in real time and determining the resource utilization rate of the target application container based on the resource load coefficient;
an idle application container determining unit, configured to compare the resource utilization rate with a preset resource utilization rate, and determine that an idle application container exists in the target application container when the resource utilization rate is smaller than the preset resource utilization rate, otherwise, determine that an idle application container does not exist in the target application container;
the container reducing unit is used for determining a target idle application container based on the resource utilization rate and stopping the service process of the target idle application container when judging that the idle application container exists in the target application container;
the container reduction unit is further configured to recycle the target idle application container after the service process is stopped, so as to reduce the idle application container.
Preferably, an application container extension engine platform, the resource deployment unit, includes:
the resource detection unit is used for acquiring a target application container after resource deployment is completed, acquiring a resource layer in the target application container and generating a corresponding record file;
the resource detection unit is used for detecting the resource layers in the target application container layer by layer according to the record file based on a preset resource deployment detection method and obtaining a detection result;
the rationality judging unit is used for judging whether the resource deployment in the target container is reasonable or not based on the detection result;
if the resource deployment is judged to be reasonable, the deployment of the resources in the target application container is completed;
otherwise, the resources in the target application container are deployed again until the resources in the target application container are reasonably deployed.
Preferably, the application container extension engine platform, the detection module, includes:
the data acquisition unit is used for acquiring the operation data of the target application container, inputting the operation data into a tag value determination model and obtaining a tag value corresponding to the operation data, wherein the tag value comprises a normal tag value and an abnormal tag value;
the training data determining unit is used for dividing the operating data into a training data set and a testing data set based on the label values and training a preset data cleaning model based on the training data set;
the data cleaning model verifying unit is used for testing the trained preset data cleaning model based on the test data and judging that the preset data cleaning model is qualified when a test result meets a preset condition;
the data cleaning unit is used for processing the operation data of the target application container based on the preset data cleaning model, removing error data in the operation data and obtaining data to be analyzed, wherein the error data comprises null values and non-data type data;
the fault detection unit is used for detecting the data to be analyzed based on a preset fault detection method and judging whether the target application container has a fault or not;
the fault type detection unit is used for analyzing and processing the data to be analyzed based on a preset fault type detection model when the target application container is judged to have a fault, and determining the fault type of the target application container;
the fault processing scheme determining unit is used for judging whether the fault type is in a resolvable fault list stored in advance locally;
if the fault type is in the resolvable fault list, acquiring a target solution corresponding to the fault type, and resolving the fault of the target application container based on the target solution;
otherwise, reformulating a solution based on the failure type until resolution of the failure of the target application container is completed.
Preferably, the application container extension engine platform, the failure handling scheme determination unit, includes:
the performance inspection unit is used for detecting the performance value of the target application container in real time after the fault existing in the target application container is solved, and comparing the performance value with a preset performance value;
if the performance value is larger than or equal to the preset performance value, judging that the target application container has a fault and the solution meets the target requirement;
otherwise, judging that the fault solution of the target application container does not meet the target requirement, and re-establishing a target solution until the fault solution of the target application container is judged to meet the target requirement, and completing the solution of the fault of the target application container.
Additional features and advantages of the invention will be set forth in the description which follows, and in part will be obvious from the description, or may be learned by practice of the invention. The objectives and other advantages of the invention will be realized and attained by the structure particularly pointed out in the written description and claims hereof as well as the appended drawings.
The technical solution of the present invention is further described in detail by the accompanying drawings and embodiments.
Drawings
The accompanying drawings, which are included to provide a further understanding of the invention and are incorporated in and constitute a part of this specification, illustrate embodiments of the invention and together with the description serve to explain the principles of the invention and not to limit the invention. In the drawings:
FIG. 1 is a block diagram of an application container extension engine platform according to an embodiment of the present invention;
FIG. 2 is a diagram illustrating a first configuration of a quantity determination module in an application container extension engine platform according to an embodiment of the present invention;
fig. 3 is a second structural diagram of a quantity determination module in an application container extension engine platform according to an embodiment of the present invention.
Detailed Description
The preferred embodiments of the present invention will be described in conjunction with the accompanying drawings, and it will be understood that they are described herein for the purpose of illustration and explanation and not limitation.
Example 1:
the embodiment provides an application container extension engine platform, as shown in fig. 1, including:
the quantity determining module is used for acquiring the current operation load data of the server and determining the quantity of the extended copies based on the current operation load data;
the expansion module is used for copying and expanding the initial application container through the expansion engine according to the expansion copy quantity to obtain a target application container;
and the detection module is used for detecting the operation data of the target application container, adjusting the target application container based on the detection result and completing the expansion of the initial application container.
In this embodiment, the current operation load data refers to operation data of the current server when the server is accessed or used by the user.
In this embodiment, the expansion copy amount refers to the number of copy expansion to the initial application container according to the access amount of the user.
In this embodiment, the extension engine is set in advance for performing replication extension on the initial application container.
In this embodiment, the initial application container refers to an application container existing as a reference in the server, and exists as a replication extension source of the application container.
The beneficial effects of the above technical scheme are: by rapidly expanding or reducing the application container according to the load operation data of the server monitored in real time and deploying the internal resources in time, a large amount of time is saved, and the usability of the application is guaranteed.
Example 2:
on the basis of the foregoing embodiment 1, this embodiment provides an application container extension engine platform, as shown in fig. 2, where the quantity determining module includes:
the system comprises an instruction acquisition unit, a data acquisition unit and a data processing unit, wherein the instruction acquisition unit is used for acquiring a data acquisition instruction sent by a management terminal, and the data acquisition instruction comprises a target server type and a data type to be acquired;
the operation state determining unit is used for acquiring the operation state of the target server based on the data acquisition instruction and judging whether the target server normally operates or not based on the operation state;
and the data acquisition unit is used for acquiring the operation load data of the target server based on the data acquisition instruction when the target server is judged to normally operate, and otherwise, judging that the operation load data acquisition fails.
In this embodiment, the target server refers to a server that needs to perform application container extension operation.
In this embodiment, the operation state includes normal operation or abnormal operation of the target server.
The beneficial effects of the above technical scheme are: by determining the corresponding server type in the data acquisition instruction and the data type of the data to be acquired, the server can be conveniently and accurately acquired, so that convenience is provided for accurately determining the expansion copy quantity of the initial application container, and the application container can be conveniently and rapidly expanded or reduced.
Example 3:
on the basis of the foregoing embodiment 1, this embodiment provides an application container extension engine platform, as shown in fig. 3, the quantity determining module further includes:
the data acquisition unit is used for acquiring current operation load data of the server and dividing the current operation load data into a test set and a training set;
the model building unit is used for building a neural network model and training the neural network model based on the training set to obtain a target neural network model;
and the load value determining unit is used for analyzing and processing the test set based on the target neural network model to obtain a load value corresponding to the test set, wherein the load value is used for representing the access amount of the current request access server.
In this embodiment, the target neural network model refers to a neural network model obtained by training and testing a constructed neural network model, and the neural network model may be directly analyzed by using the operation data of the servers, so as to determine the number of currently accessed servers.
In this embodiment, the load value refers to an operation load level value of the server itself after the server currently receives the user access request, and the number of clients currently accessing the server can be accurately calculated by the load value.
The beneficial effects of the above technical scheme are: by accurately analyzing the operation load data of the server, the amount of users accessing the server is accurately determined, and convenience is provided for determining the expanded copy amount of the initial application container.
Example 4:
on the basis of the foregoing embodiment 3, this embodiment provides an application container extension engine platform, and the load value determining unit includes:
the load value comparison unit is used for acquiring the obtained load value, acquiring the maximum load value of an initial application container in the server and comparing the obtained load value with the maximum load value;
an extension determination unit configured to determine a magnitude relation between the obtained load value and the maximum load value based on a comparison result;
when the obtained load value is larger than the maximum load value, judging that the initial application container in the server needs to be expanded;
otherwise, keeping the number of the current initial application containers unchanged;
and the copy quantity calculation unit is used for determining the copy quantity to be expanded to the initial application container based on a target difference value between the obtained load value and the maximum load value when the initial application container in the server is judged to be expanded, wherein the copy quantity is used for representing the expansion quantity of the initial application container.
In this embodiment, the maximum load value of the initial application container refers to the maximum amount of access allowed by the initial application container.
In this embodiment, the determination method of the expansion copy amount may further be that a worker manually sets the number of the initial application containers to be expanded by encoding the background program.
The beneficial effects of the above technical scheme are: the maximum load value of the initial application container is compared with the load value obtained through analysis, whether the initial application container needs to be expanded or not is accurately obtained, and when the initial application container needs to be expanded, the initial application container is quickly and accurately expanded according to the quantity of the expanded copies, so that a large amount of time is saved, and the usability of the application is guaranteed.
Example 5:
on the basis of the foregoing embodiment 4, this embodiment provides an application container extension engine platform, a copy amount calculation unit, including:
the copy quantity verification unit is used for acquiring the copy quantity for expanding the initial application container and comparing the copy quantity with a preset threshold value;
if the copy quantity is larger than the preset threshold, judging that the copy quantity for expanding the initial application container exceeds the standard, and taking the preset threshold as a target copy quantity for expanding the initial application container;
otherwise, judging that the copy quantity for expanding the initial application container is qualified.
In this embodiment, the preset threshold is set in advance, and is used to measure whether the expansion amount of the initial application container exceeds the preset requirement, and if the expansion amount of the initial application container exceeds the preset threshold, it is determined that the expansion amount of the initial application container exceeds the preset requirement, which is likely to cause malicious occupation of resources.
In this embodiment, the target copy amount refers to that when the expansion amount of the initial application container is greater than a preset threshold, the preset threshold is used as the expansion amount of the initial application container.
The beneficial effects of the above technical scheme are: by checking the obtained expansion quantity of the initial application container, when the expansion quantity is greater than a preset threshold value, the preset threshold value is used as the expansion quantity of the initial application container, so that malicious occupation of resources is facilitated to be placed, and the usability of the application is improved.
Example 6:
on the basis of the foregoing embodiment 1, this embodiment provides an application container extension engine platform, including:
an extended instruction obtaining unit, configured to receive, by using the extended engine, an extended instruction sent by a server, where the extended instruction is analyzed by the extended engine, so as to obtain an extended copy amount corresponding to the copy extension of the initial application container;
an extended task determining unit, configured to create an application container extended task based on the extended copy quantity, obtain a service configuration parameter of the initial application container based on the extended task, and determine a storage path after the initial application container is extended;
an extension unit, configured to extend the initial application container based on the service configuration parameter of the initial application container to obtain a target application container, and store the target application container based on the storage path, where the number of the target application containers is consistent with the number of the extended copies;
the resource deployment unit is used for acquiring resource configuration information in the initial application container and selecting a target resource deployment mode from a preset resource deployment mode library based on the resource configuration information;
the resource deployment unit is configured to deploy, in the target application container, the resource inside the initial application container based on the target resource deployment mode, where the resource in the target application container belongs to the initial application container;
the resource scheduling determining unit is used for monitoring the user access amount of the target application container after the resource deployment is completed, and judging whether the target application container needs to perform resource rescheduling or not based on the user access amount;
the resource scheduling unit is used for customizing a resource rescheduling strategy based on the user access amount when the resource rescheduling is judged to be needed, and determining a resource set of each target application container based on the resource rescheduling strategy;
and the resource scheduling unit is used for determining the target scheduling amount of each target application container to the resources based on the resource set of each target application container, and performing resource rescheduling on each target application container based on the target scheduling amount to obtain a final target application container, wherein each application container corresponds to one target scheduling amount.
In this embodiment, the application container extension task refers to determining a corresponding extension task according to the number of extensions required when an extension instruction is received, where the extension task includes checking the number of extensions in the extension process.
In this embodiment, the service configuration parameters of the initial application container refer to the corresponding size of the initial application container, the access setting authority of the access program for the user when interfacing with the client access, and the like.
In this embodiment, the storage path is used to guide the storage location of the target application container obtained after the initial application container is expanded, so that location locking of the expanded application container is facilitated, and a user can access the storage location according to the path.
In this embodiment, the target application container refers to an initial application container in the server after being extended, where the target application container may be one or multiple.
In this embodiment, the resource configuration information refers to application-corresponding data information stored in the initial application container, for example, a storage location, a storage manner, and the like of the data in the initial application container.
In this embodiment, the preset resource deployment pattern library is set in advance, and a plurality of resource deployment patterns are stored in the preset resource deployment pattern library.
In this embodiment, the target resource deployment pattern is one or more combinations in a preset resource deployment pattern library, and is used to deploy the resource in the initial application container in the target application container.
In this embodiment, the resource rescheduling policy is used to adjust the resources in the target application container when the resources in the target application container are absent or redundant after the resource deployment is completed.
In this embodiment, the resource set refers to the number of resources stored in each target application container.
In this embodiment, the target scheduling amount refers to the amount of resource adjustment required for each target application container.
In this embodiment, the resources in the target application container belong to a part or all of the original application container.
The beneficial effects of the above technical scheme are: the number of the initial application containers needing to be expanded is determined, so that the initial application containers are quickly and accurately expanded, meanwhile, a deployment strategy when resources in a target application container are deployed is determined according to resource configuration information in the initial application containers, accurate expansion of the target application container is facilitated, the application availability is improved, simultaneously, after the resource deployment is finished, the resource operation condition in each application container is monitored in real time, and when the adjustment is needed, the resources in the target application container are scheduled in time, so that the application availability is guaranteed.
Example 7:
on the basis of the foregoing embodiment 6, this embodiment provides an application container extension engine platform, and the resource scheduling determining unit includes:
the resource utilization rate determining unit is used for monitoring the resource load coefficient of the target application container in real time and determining the resource utilization rate of the target application container based on the resource load coefficient;
an idle application container determining unit, configured to compare the resource utilization rate with a preset resource utilization rate, and determine that an idle application container exists in the target application container when the resource utilization rate is smaller than the preset resource utilization rate, otherwise, determine that an idle application container does not exist in the target application container;
the container reducing unit is used for determining a target idle application container based on the resource utilization rate and stopping the service process of the target idle application container when judging that the idle application container exists in the target application container;
the container reduction unit is further configured to recycle the target idle application container after the service process is stopped, so as to reduce the idle application container.
In this embodiment, the resource load factor is used to describe the resource deployed in the target application container, and when the user accesses the resource, the user accesses the resource in the same time period.
In this embodiment, the preset resource utilization rate is set in advance, and is used to measure whether the resource utilization rate inside the target application container meets the preset requirement.
In this embodiment, the idle application container means that the expanded application container is redundant, that is, the current user access amount cannot use the current application container number.
In this embodiment, the target idle application container refers to an application container that is idle among a plurality of target application containers.
In this embodiment, a service process refers to an application program that provides access services to an idle application container when accessed by a client.
In this embodiment, monitoring the resource load coefficient of the target application container in real time, and determining the resource utilization rate of the target application container based on the resource load coefficient includes:
acquiring client access quantity of the target application server based on a preset time interval, wherein the client access quantity is a plurality of groups;
calculating a resource load coefficient of the target application container based on the client access amount, and calculating a resource utilization rate in the target application container within a preset time period based on the resource load coefficient, wherein the specific steps comprise:
calculating a resource load factor of the target application container according to the following formula:
Figure BDA0003334059220000141
wherein the content of the first and second substances,
Figure BDA0003334059220000142
a resource load factor representing the target application container; n represents the number of groups of the acquired customer access volume; i represents the group number of the currently acquired customer access volume; q. q.siRepresenting a client access quantity value in the ith group of client access quantities; q represents the largest value of the client access quantity in the n groups of client access quantities;
calculating the resource utilization rate in the target application container in a preset time period according to the following formula:
Figure BDA0003334059220000151
wherein η represents the resource utilization rate in the target application container, and the value range is (0, 1);
Figure BDA0003334059220000152
a resource load factor representing the target application container; z represents a current user accessing the target application container, and the value of z is [1, m](ii) a m represents the maximum number of users accessing the target application container; x is the number ofzRepresents the quantity value of the z-th user needing to access the resource in the preset time period, and
Figure BDA0003334059220000153
is less than s; s represents a total amount of resources in the target application container; r represents an error coefficient, and the value range is (0.05, 0.15);
comparing the calculated resource utilization rate with a preset threshold value;
if the resource utilization rate is greater than or equal to the preset threshold value, judging that the resources in the target application container are fully utilized;
otherwise, judging that the resources in the target application containers are not fully utilized, and recording the resource utilization rate of each target application container;
and determining a target application container needing to be reduced in the target application container based on the recording result, and reducing and recycling the target application container needing to be reduced.
The preset time period is set in advance, and may be, for example, 1 hour, 2 hours, or the like.
The preset threshold is set in advance, is used for measuring whether the calculated resource utilization rate meets the requirement of expected setting, and can be manually modified.
The above formula
Figure BDA0003334059220000154
In the case that n takes a value of 3, q1Value of 5, q2Value of 6, q3Value of 2 and Q value of 6, then calculated
Figure BDA0003334059220000155
The content was 72.2%.
The above formula
Figure BDA0003334059220000156
In, if
Figure BDA0003334059220000157
The value of m is 72.2%, and the value of m is 2, x1The value is 15, x2And if the value of s is 18 and the value of s is 35, the calculated eta is 61.3 percent.
The beneficial effects of the above technical scheme are: by monitoring the resource utilization rate in the target application container in real time and judging whether an idle application container exists in the expanded application container when the resource utilization rate is not up to the standard, and reducing the expanded application container under the condition that the idle application container exists, the purpose of adjusting the application container in real time is improved, a large amount of time is saved, and the application availability is improved.
Example 8:
on the basis of the foregoing embodiment 6, this embodiment provides an application container extension engine platform, a resource deployment unit, including:
the resource detection unit is used for acquiring a target application container after resource deployment is completed, acquiring a resource layer in the target application container and generating a corresponding record file;
the resource detection unit is used for detecting the resource layers in the target application container layer by layer according to the record file based on a preset resource deployment detection method and obtaining a detection result;
the rationality judging unit is used for judging whether the resource deployment in the target container is reasonable or not based on the detection result;
if the resource deployment is judged to be reasonable, the deployment of the resources in the target application container is completed;
otherwise, the resources in the target application container are deployed again until the resources in the target application container are reasonably deployed.
In this embodiment, the resource layer refers to a data layer inside the application container for storing application data.
In this embodiment, the record file is used to record the data type and data amount of each resource layer in the application container.
In this embodiment, the preset resource deployment checking method is set in advance, and is used to check whether the resource deployment inside the container is reasonable, for example, the integrity of data may be checked according to a function to be implemented.
The beneficial effects of the above technical scheme are: by verifying the resources deployed in the application container, the normal operation of the resources in the application container is convenient to ensure, convenience is provided for ensuring that no error occurs when the application container operates, and meanwhile, guarantee is provided for ensuring the usability of the application.
Example 9:
on the basis of the foregoing embodiment 1, this embodiment provides an application container extension engine platform, and the detection module includes:
the data acquisition unit is used for acquiring the operation data of the target application container, inputting the operation data into a tag value determination model and obtaining a tag value corresponding to the operation data, wherein the tag value comprises a normal tag value and an abnormal tag value;
the training data determining unit is used for dividing the operating data into a training data set and a testing data set based on the label values and training a preset data cleaning model based on the training data set;
the data cleaning model verifying unit is used for testing the trained preset data cleaning model based on the test data and judging that the preset data cleaning model is qualified when a test result meets a preset condition;
the data cleaning unit is used for processing the operation data of the target application container based on the preset data cleaning model, removing error data in the operation data and obtaining data to be analyzed, wherein the error data comprises null values and non-data type data;
the fault detection unit is used for detecting the data to be analyzed based on a preset fault detection method and judging whether the target application container has a fault or not;
the fault type detection unit is used for analyzing and processing the data to be analyzed based on a preset fault type detection model when the target application container is judged to have a fault, and determining the fault type of the target application container;
the fault processing scheme determining unit is used for judging whether the fault type is in a resolvable fault list stored in advance locally;
if the fault type is in the resolvable fault list, acquiring a target solution corresponding to the fault type, and resolving the fault of the target application container based on the target solution;
otherwise, reformulating a solution based on the failure type until resolution of the failure of the target application container is completed.
In this embodiment, the running data refers to running parameters of the target application container obtained after the initial application container is expanded when the target application container receives user access.
In this embodiment, the tag value determination model is set in advance, and is used to determine the value size of the specific running data of the target application container during running.
In this embodiment, the tag value corresponding to the operation data refers to a specific value used for representing the operation data.
In this embodiment, the preset data cleaning model is set in advance, and is used to clean the error data in the target operation data, so as to ensure accurate analysis of the operation state of the target application container.
In this embodiment, the preset condition is set in advance, for example, the accuracy of cleaning the preset data cleaning model can be measured by the test data to reach more than 95%.
In this embodiment, the preset fault detection method is set in advance, and is used to analyze the operation data of the target application container, so as to determine whether a fault exists in the target application container, for example, the current operation data may be compared with the operation data of the target application container when the target application container has no fault, so as to determine whether the fault exists in the target application container.
In this embodiment, the preset fault type detection model is set in advance.
In this embodiment, the target solution refers to a failure solution corresponding to a failure problem existing in the target application container.
The beneficial effects of the above technical scheme are: by cleaning and analyzing the operation data of the target application container, whether a fault exists in the target application container can be accurately judged according to the operation data, and meanwhile, when the fault exists, the fault type can be accurately judged, so that a fault solution can be accurately formulated, the fault solution efficiency of the target application container is improved, and the application availability is ensured.
Example 10:
on the basis of the foregoing embodiment 9, this embodiment provides an application container extension engine platform, and the failure handling scheme determining unit includes:
the performance inspection unit is used for detecting the performance value of the target application container in real time after the fault existing in the target application container is solved, and comparing the performance value with a preset performance value;
if the performance value is larger than or equal to the preset performance value, judging that the target application container has a fault and the solution meets the target requirement;
otherwise, judging that the fault solution of the target application container does not meet the target requirement, and re-establishing a target solution until the fault solution of the target application container is judged to meet the target requirement, and completing the solution of the fault of the target application container.
In this embodiment, the performance value is used to describe the working performance of the target application container during working after the fault processing of the target application container.
In this embodiment, the preset performance value is set in advance, and is used to measure whether the working performance value of the target application container after the fault processing meets the expected requirement, and the preset performance value may be modified manually.
In this embodiment, the target requirement refers to a required value of the operating performance of the target application container after the failure existing in the target application container is resolved.
The beneficial effects of the above technical scheme are: after the fault of the target application container is solved, the working performance value of the target application container is verified, so that the problem of the target application container existing in the target solution scheme is thoroughly solved, the normal operation of the target application container obtained after the initial application container is expanded is guaranteed, and the usability of the application is guaranteed.
It will be apparent to those skilled in the art that various changes and modifications may be made in the present invention without departing from the spirit and scope of the invention. Thus, if such modifications and variations of the present invention fall within the scope of the claims of the present invention and their equivalents, the present invention is also intended to include such modifications and variations.

Claims (10)

1. An application container extension engine platform, comprising:
the quantity determining module is used for acquiring the current operation load data of the server and determining the quantity of the extended copies based on the current operation load data;
the expansion module is used for copying and expanding the initial application container through the expansion engine according to the expansion copy quantity to obtain a target application container;
and the detection module is used for detecting the operation data of the target application container, adjusting the target application container based on the detection result and completing the expansion of the initial application container.
2. The application container extension engine platform of claim 1, wherein the quantity determination module comprises:
the system comprises an instruction acquisition unit, a data acquisition unit and a data processing unit, wherein the instruction acquisition unit is used for acquiring a data acquisition instruction sent by a management terminal, and the data acquisition instruction comprises a target server type and a data type to be acquired;
the operation state determining unit is used for acquiring the operation state of the target server based on the data acquisition instruction and judging whether the target server normally operates or not based on the operation state;
and the data acquisition unit is used for acquiring the operation load data of the target server based on the data acquisition instruction when the target server is judged to normally operate, and otherwise, judging that the operation load data acquisition fails.
3. The application container extension engine platform of claim 1, wherein the quantity determination module further comprises:
the data acquisition unit is used for acquiring current operation load data of the server and dividing the current operation load data into a test set and a training set;
the model building unit is used for building a neural network model and training the neural network model based on the training set to obtain a target neural network model;
and the load value determining unit is used for analyzing and processing the test set based on the target neural network model to obtain a load value corresponding to the test set, wherein the load value is used for representing the access amount of the current request access server.
4. The application container extension engine platform as claimed in claim 3, wherein the load value determination unit comprises:
the load value comparison unit is used for acquiring the obtained load value, acquiring the maximum load value of an initial application container in the server and comparing the obtained load value with the maximum load value;
an extension determination unit configured to determine a magnitude relation between the obtained load value and the maximum load value based on a comparison result;
when the obtained load value is larger than the maximum load value, judging that the initial application container in the server needs to be expanded;
otherwise, keeping the number of the current initial application containers unchanged;
and the copy quantity calculation unit is used for determining the copy quantity to be expanded to the initial application container based on a target difference value between the obtained load value and the maximum load value when the initial application container in the server is judged to be expanded, wherein the copy quantity is used for representing the expansion quantity of the initial application container.
5. The application container extension engine platform of claim 4, wherein the copy quantity calculation unit comprises:
the copy quantity verification unit is used for acquiring the copy quantity for expanding the initial application container and comparing the copy quantity with a preset threshold value;
if the copy quantity is larger than the preset threshold, judging that the copy quantity for expanding the initial application container exceeds the standard, and taking the preset threshold as a target copy quantity for expanding the initial application container;
otherwise, judging that the copy quantity for expanding the initial application container is qualified.
6. The application container extension engine platform of claim 1, wherein the extension module comprises:
an extended instruction obtaining unit, configured to receive, by using the extended engine, an extended instruction sent by a server, where the extended instruction is analyzed by the extended engine, so as to obtain an extended copy amount corresponding to the copy extension of the initial application container;
an extended task determining unit, configured to create an application container extended task based on the extended copy quantity, obtain a service configuration parameter of the initial application container based on the extended task, and determine a storage path after the initial application container is extended;
an extension unit, configured to extend the initial application container based on the service configuration parameter of the initial application container to obtain a target application container, and store the target application container based on the storage path, where the number of the target application containers is consistent with the number of the extended copies;
the resource deployment unit is used for acquiring resource configuration information in the initial application container and selecting a target resource deployment mode from a preset resource deployment mode library based on the resource configuration information;
the resource deployment unit is configured to deploy, in the target application container, the resource inside the initial application container based on the target resource deployment mode, where the resource in the target application container belongs to the initial application container;
the resource scheduling determining unit is used for monitoring the user access amount of the target application container after the resource deployment is completed, and judging whether the target application container needs to perform resource rescheduling or not based on the user access amount;
the resource scheduling unit is used for customizing a resource rescheduling strategy based on the user access amount when the resource rescheduling is judged to be needed, and determining a resource set of each target application container based on the resource rescheduling strategy;
and the resource scheduling unit is used for determining the target scheduling amount of each target application container to the resources based on the resource set of each target application container, and performing resource rescheduling on each target application container based on the target scheduling amount to obtain a final target application container, wherein each application container corresponds to one target scheduling amount.
7. The application container extension engine platform of claim 6, wherein the resource scheduling determination unit comprises:
the resource utilization rate determining unit is used for monitoring the resource load coefficient of the target application container in real time and determining the resource utilization rate of the target application container based on the resource load coefficient;
an idle application container determining unit, configured to compare the resource utilization rate with a preset resource utilization rate, and determine that an idle application container exists in the target application container when the resource utilization rate is smaller than the preset resource utilization rate, otherwise, determine that an idle application container does not exist in the target application container;
the container reducing unit is used for determining a target idle application container based on the resource utilization rate and stopping the service process of the target idle application container when judging that the idle application container exists in the target application container;
the container reduction unit is further configured to recycle the target idle application container after the service process is stopped, so as to reduce the idle application container.
8. The application container extension engine platform of claim 6, wherein the resource deployment unit comprises:
the resource detection unit is used for acquiring a target application container after resource deployment is completed, acquiring a resource layer in the target application container and generating a corresponding record file;
the resource detection unit is used for detecting the resource layers in the target application container layer by layer according to the record file based on a preset resource deployment detection method and obtaining a detection result;
the rationality judging unit is used for judging whether the resource deployment in the target container is reasonable or not based on the detection result;
if the resource deployment is judged to be reasonable, the deployment of the resources in the target application container is completed;
otherwise, the resources in the target application container are deployed again until the resources in the target application container are reasonably deployed.
9. The application container extension engine platform of claim 1, wherein the detection module comprises:
the data acquisition unit is used for acquiring the operation data of the target application container, inputting the operation data into a tag value determination model and obtaining a tag value corresponding to the operation data, wherein the tag value comprises a normal tag value and an abnormal tag value;
the training data determining unit is used for dividing the operating data into a training data set and a testing data set based on the label values and training a preset data cleaning model based on the training data set;
the data cleaning model verifying unit is used for testing the trained preset data cleaning model based on the test data and judging that the preset data cleaning model is qualified when a test result meets a preset condition;
the data cleaning unit is used for processing the operation data of the target application container based on the preset data cleaning model, removing error data in the operation data and obtaining data to be analyzed, wherein the error data comprises null values and non-data type data;
the fault detection unit is used for detecting the data to be analyzed based on a preset fault detection method and judging whether the target application container has a fault or not;
the fault type detection unit is used for analyzing and processing the data to be analyzed based on a preset fault type detection model when the target application container is judged to have a fault, and determining the fault type of the target application container;
the fault processing scheme determining unit is used for judging whether the fault type is in a resolvable fault list stored in advance locally;
if the fault type is in the resolvable fault list, acquiring a target solution corresponding to the fault type, and resolving the fault of the target application container based on the target solution;
otherwise, reformulating a solution based on the failure type until resolution of the failure of the target application container is completed.
10. The application container extension engine platform of claim 9, wherein the failure handling scheme determining unit comprises:
the performance inspection unit is used for detecting the performance value of the target application container in real time after the fault existing in the target application container is solved, and comparing the performance value with a preset performance value;
if the performance value is larger than or equal to the preset performance value, judging that the target application container has a fault and the solution meets the target requirement;
otherwise, judging that the fault solution of the target application container does not meet the target requirement, and re-establishing a target solution until the fault solution of the target application container is judged to meet the target requirement, and completing the solution of the fault of the target application container.
CN202111288419.8A 2021-11-02 2021-11-02 Application container extension engine platform Pending CN114185639A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202111288419.8A CN114185639A (en) 2021-11-02 2021-11-02 Application container extension engine platform

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202111288419.8A CN114185639A (en) 2021-11-02 2021-11-02 Application container extension engine platform

Publications (1)

Publication Number Publication Date
CN114185639A true CN114185639A (en) 2022-03-15

Family

ID=80601805

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202111288419.8A Pending CN114185639A (en) 2021-11-02 2021-11-02 Application container extension engine platform

Country Status (1)

Country Link
CN (1) CN114185639A (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN117714453A (en) * 2024-02-05 2024-03-15 济南千寻信息科技有限公司 Intelligent device management method and system based on Internet of things card

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN117714453A (en) * 2024-02-05 2024-03-15 济南千寻信息科技有限公司 Intelligent device management method and system based on Internet of things card
CN117714453B (en) * 2024-02-05 2024-04-26 济南千寻信息科技有限公司 Intelligent device management method and system based on Internet of things card

Similar Documents

Publication Publication Date Title
US8521865B2 (en) Method and apparatus for populating a software catalog with automated use signature generation
CN109815704B (en) Safety detection method and system for Kubernetes cloud native application
US20040261070A1 (en) Autonomic software version management system, method and program product
US7894357B2 (en) Capability-based testing and evaluation of network performance
WO2022005401A1 (en) Method and apparatus for updating gateway resource, and iot control platform
CN111610989B (en) Application publishing/updating method and system for offline container cloud environment
CN110088744B (en) Database maintenance method and system
CN112084040B (en) Container resource planning system and method based on application mirror image data identification
CN111355606A (en) Web application-oriented container cluster self-adaptive expansion and contraction system and method
JP2017201470A (en) Setting support program, setting support method, and setting support device
CN111291051B (en) Freight rate data processing method and device, storage medium and electronic equipment
CN113391913A (en) Distributed scheduling method and device based on prediction
CN114185639A (en) Application container extension engine platform
CN110291505A (en) Reduce the recovery time of application
CN108268351B (en) Method and system for accurately monitoring process running state
CN114138402A (en) Container cluster deployment platform
CN111340210A (en) User position identification model construction method and user position identification method
CN112269697B (en) Equipment storage performance testing method, system and related device
CN112506791A (en) Application program testing method and device, computer equipment and storage medium
CN112527568A (en) Data flow testing method and device, electronic equipment and storage medium
CN115170097B (en) Spatial data distributed quality inspection method and system
CN115860709A (en) Software service guarantee system and method
US9201771B2 (en) Method for evaluating a production rule for a memory management analysis
WO2021096346A1 (en) A computer-implemented system for management of container logs and its method thereof
CN113360389A (en) Performance test method, device, equipment and storage medium

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination