CN110719320A - Method and equipment for generating public cloud configuration adjustment information - Google Patents

Method and equipment for generating public cloud configuration adjustment information Download PDF

Info

Publication number
CN110719320A
CN110719320A CN201910881031.5A CN201910881031A CN110719320A CN 110719320 A CN110719320 A CN 110719320A CN 201910881031 A CN201910881031 A CN 201910881031A CN 110719320 A CN110719320 A CN 110719320A
Authority
CN
China
Prior art keywords
information
resource
public cloud
observation
parameter
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN201910881031.5A
Other languages
Chinese (zh)
Other versions
CN110719320B (en
Inventor
高海峰
赵平
元鹏
章富刚
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Shanghai Lianwei Information Technology Co Ltd
Original Assignee
Shanghai Lianwei Information Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Shanghai Lianwei Information Technology Co Ltd filed Critical Shanghai Lianwei Information Technology Co Ltd
Priority to CN201910881031.5A priority Critical patent/CN110719320B/en
Publication of CN110719320A publication Critical patent/CN110719320A/en
Application granted granted Critical
Publication of CN110719320B publication Critical patent/CN110719320B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00—Network arrangements or protocols for supporting network services or applications
    • H04L67/50—Network services
    • H04L67/60—Scheduling or organising the servicing of application requests, e.g. requests for application data transmissions using the analysis and optimisation of the required network resources
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q10/00—Administration; Management
    • G06Q10/04—Forecasting or optimisation specially adapted for administrative or management purposes, e.g. linear programming or "cutting stock problem"
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L63/00—Network architectures or network communication protocols for network security
    • H04L63/08—Network architectures or network communication protocols for network security for authentication of entities
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00—Network arrangements or protocols for supporting network services or applications
    • H04L67/01—Protocols
    • H04L67/10—Protocols in which an application is distributed across nodes in the network

Landscapes

  • Engineering & Computer Science (AREA)
  • Business, Economics & Management (AREA)
  • Signal Processing (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Economics (AREA)
  • Human Resources & Organizations (AREA)
  • Strategic Management (AREA)
  • Quality & Reliability (AREA)
  • General Physics & Mathematics (AREA)
  • Operations Research (AREA)
  • Entrepreneurship & Innovation (AREA)
  • Tourism & Hospitality (AREA)
  • Physics & Mathematics (AREA)
  • General Business, Economics & Management (AREA)
  • Marketing (AREA)
  • Theoretical Computer Science (AREA)
  • Computer Hardware Design (AREA)
  • Computer Security & Cryptography (AREA)
  • Computing Systems (AREA)
  • General Engineering & Computer Science (AREA)
  • Game Theory and Decision Science (AREA)
  • Development Economics (AREA)
  • Debugging And Monitoring (AREA)

Abstract

The application aims to provide a method and equipment for generating public cloud configuration adjustment information; the method comprises the steps that a user terminal determines a plurality of public cloud account identification information corresponding to a user, sends a plurality of observation parameter requests to a plurality of network devices respectively, and receives a plurality of observation parameters in a time sequence sent by the plurality of network devices based on the observation parameter requests respectively; acquiring resource matching information corresponding to the plurality of observation parameters, and determining resource demand information of the plurality of observation parameters based on the resource matching information; generating public cloud configuration adjustment information regarding the resource demand information. The method and the device can improve the resource utilization rate and reduce the public cloud expenditure of enterprises.

Description

Method and equipment for generating public cloud configuration adjustment information
Technical Field
The application relates to the field of computer information management, in particular to a technology for generating public cloud configuration adjustment information.
Background
Cloud computing has been developed for many years and is currently in a high-speed development stage, and multiple clouds are essential stages of cloud computing development. Due to the agility and digitization of enterprises, a large number of public clouds are used. Since the public cloud of each company has its own characteristics, most enterprises are in use in a cloudy form. With the large-scale use of the public cloud of the enterprise, the expenditure of the public cloud resources is increased year by year. The public cloud has the characteristics of instant use and instant charging, and information management personnel of an enterprise can execute corresponding operation according to actual requirements when necessary to control the use of the public cloud, so that the cost is controlled.
Disclosure of Invention
An object of the present application is to provide a method and an apparatus for generating public cloud configuration adjustment information.
According to one aspect of the application, a method for generating public cloud configuration adjustment information is provided and applied to a user terminal. The method comprises the following steps:
determining identification information of a plurality of public cloud account numbers corresponding to a user;
the method comprises the steps of respectively sending a plurality of observation parameter requests to a plurality of network devices, and receiving a plurality of observation parameters in a time sequence sent by the plurality of network devices based on the observation parameter requests, wherein each observation parameter request comprises public cloud account identification information, each observation parameter comprises corresponding historical load information, and the public cloud account identification information is used for determining the access authority of a user to a corresponding public cloud account;
acquiring resource matching information corresponding to the plurality of observation parameters, and determining resource demand information of the plurality of observation parameters based on the resource matching information; and
and generating public cloud configuration adjustment information related to the resource demand information, wherein the public cloud configuration adjustment information is used for adjusting the resource quantity corresponding to the corresponding public cloud account.
According to another aspect of the present application, there is provided an apparatus for performing a target operation on target data, wherein the apparatus comprises:
a processor; and
a memory arranged to store computer executable instructions that, when executed, cause the processor to perform the operations of the above-described method.
According to another aspect of the present application, there is provided a computer-readable medium storing instructions that, when executed by a computer, cause the computer to perform the operations of the above-described method.
Compared with the prior art, the method and the device have the advantages that the demand information of the corresponding resources is determined based on the resource matching information (such as the resource optimization matching rule), the resource demand is predicted, and the corresponding public cloud configuration adjustment information is generated, so that enterprise related personnel can adjust the used resources timely and effectively, the resource utilization rate is improved, and the public cloud expenditure of the enterprise is reduced; in some embodiments, the system further adjusts resources of the public cloud based on the information, further improving the operating efficiency of the management staff and reducing the workload of the management staff.
Drawings
Other features, objects and advantages of the present application will become more apparent upon reading of the following detailed description of non-limiting embodiments thereof, made with reference to the accompanying drawings in which:
FIG. 1 illustrates a system architecture of one embodiment of the present application;
FIG. 2 shows a flow of a public cloud data processing method according to an embodiment of the present application;
FIG. 3 is an illustration of a task queue in one embodiment of the present application;
FIG. 4 is an illustration of a current task in the task queue of FIG. 3;
FIG. 5 is a diagram illustrating the transition between task execution states according to one embodiment of the present application;
FIG. 6 is a flow diagram illustrating queue task execution according to one embodiment of the present disclosure;
FIG. 7 illustrates a public cloud resource configuration information prompt interface;
FIG. 8 illustrates functional modules of an exemplary system that can be used in various embodiments of the present application.
The same or similar reference numbers in the drawings identify the same or similar elements.
Detailed Description
The present application is described in further detail below with reference to the attached figures.
In a typical configuration of the present application, the terminal, the device serving the network, and the trusted party each include one or more processors (e.g., Central Processing Units (CPUs)), input/output interfaces, network interfaces, and memory.
The Memory may include volatile Memory in a computer readable medium, Random Access Memory (RAM), and/or nonvolatile Memory such as Read Only Memory (ROM) or Flash Memory. Memory is an example of a computer-readable medium.
Computer-readable media, including both non-transitory and non-transitory, removable and non-removable media, may implement information storage by any method or technology. The information may be computer readable instructions, data structures, modules of a program, or other data. Examples of computer storage media include, but are not limited to, Phase-Change Memory (PCM), Programmable Random Access Memory (PRAM), Static Random Access Memory (SRAM), Dynamic Random Access Memory (DRAM), other types of Random Access Memory (RAM), Read-Only Memory (ROM), Electrically erasable Programmable Read-Only Memory (EEPROM), Flash Memory (Flash Memory) or other Memory technology, Compact Disc Read-Only Memory (CD-ROM), Digital Versatile Disc (Digital Versatile Disc, DVD) or other optical storage, magnetic tape or other magnetic storage media, magnetic tape or other non-magnetic storage devices, may be used to store information that may be accessed by the computing device.
The device referred to in this application includes, but is not limited to, a user device, a network device, or a device formed by integrating a user device and a network device through a network. The user equipment includes, but is not limited to, any mobile electronic product, such as a smart phone, a tablet computer, etc., capable of performing human-computer interaction with a user (e.g., human-computer interaction through a touch panel), and the mobile electronic product may employ any operating system, such as an Android operating system, an iOS operating system, etc. The network Device includes an electronic Device capable of automatically performing numerical calculation and information processing according to a preset or stored instruction, and the hardware includes, but is not limited to, a microprocessor, an Application Specific Integrated Circuit (ASIC), a Programmable Logic Device (PLD), a Field Programmable Gate Array (FPGA), a Digital Signal Processor (DSP), an embedded Device, and the like. The network device includes but is not limited to a computer, a network host, a single network server, a plurality of network server sets or a cloud of a plurality of servers; here, the Cloud is composed of a large number of computers or web servers based on Cloud Computing (Cloud Computing), which is a kind of distributed Computing, one virtual supercomputer consisting of a collection of loosely coupled computers. Including, but not limited to, the internet, a wide area Network, a metropolitan area Network, a local area Network, a VPN Network, a wireless Ad Hoc Network (Ad Hoc Network), etc. Preferably, the device may also be a program running on the user device, the network device, or a device formed by integrating the user device and the network device, the touch terminal, or the network device and the touch terminal through a network.
Of course, those skilled in the art will appreciate that the foregoing is by way of example only, and that other existing or future devices, which may be suitable for use in the present application, are also encompassed within the scope of the present application and are hereby incorporated by reference.
In the description of the present application, "a plurality" means two or more unless specifically limited otherwise.
The present application first provides a system architecture for performing a target operation on public cloud data. As shown in FIG. 1, the system adopts a B/S mode and a micro-service architecture, and is generally divided into a user layer, a middle layer, a data layer and a cloud layer. Wherein:
-a user layer: the user accesses the system through a PC computer or a third-party system.
-an intermediate layer: the expandability of the system is considered to carry out front-end and back-end separation design, distributed deployment can be carried out rapidly, a front-end page is deployed to a Web server independently, and a back-end application is deployed to an application server independently; the application service can construct cluster providing services, including unified security authentication, statistical analysis service, query service, visualization service, database access service, configuration service, timing task service and the like, the interface server provides independent services for a third party, and the user layer performs data request interaction with the middle layer through Webservices or Restful in order to prevent the third party from influencing a service system during interaction.
-a data layer: the database server can perform dual-computer hot standby, master-slave operation and the like, an independent cache server is added, and pages and common data are cached, so that the pressure of the database is relieved, the bottleneck of database reading and writing is solved, and the normal operation of the database is ensured.
-cloud layer: and self-defining a timing task, synchronizing resource data in a timed slave cloud (Alice cloud, Azure, AWS and Tencent cloud), synchronizing metadata in the slave cloud, and finishing cleaning and storing the data according to a defined rule through data cleaning service.
Based on the above architecture, in particular, the present application provides a method for performing a target operation on public cloud data. The method is applied to a user terminal and is supported by corresponding network equipment (such as a cloud server). Referring to fig. 2, the method includes step S100, step S200, step S300, and step S400. The following describes a specific embodiment of the present application by taking a user terminal as an example.
Specifically, in step S100, the user terminal determines a plurality of pieces of public cloud account identification information corresponding to the user, for example, the plurality of pieces of public cloud account identification information are obtained based on matching and corresponding to the same authentication information of the user. Subsequently, in step S200, the user terminal sends a plurality of observation parameter requests to a plurality of network devices, respectively, and receives a plurality of observation parameters in a time sequence sent by the plurality of network devices based on the observation parameter requests, respectively, where each observation parameter request includes public cloud account identification information, each observation parameter includes corresponding historical load information, and the public cloud account identification information is used to determine access rights of the user to the corresponding public cloud account. The historical load information includes, but is not limited to, processor load information, bandwidth load information, and storage load information of the network device or the cloud device, and in some embodiments, the historical load information is updated based on current load information periodically obtained by the user terminal or the cloud device, so as to ensure real-time performance of the prediction result.
In some embodiments, the user terminal first obtains the authentication information of the user, and then matches the corresponding identification information of the plurality of public cloud account numbers based on the authentication information. For example, a user (e.g., an administrator) enters his or her user identification (e.g., system account name) and authentication information (e.g., account password) at a user terminal. The user account logged in by the administrator corresponds to a plurality of public cloud accounts managed by the administrator; in some cases, different administrators may manage different public cloud accounts for the same set of systems.
The method comprises the steps that an administrator inputs a multi-cloud account into a system, sets timing synchronization frequency, automatically creates a synchronization task, automatically synchronizes resource data and monitoring data from a corresponding cloud to the local when the task reaches an execution condition, configures resource optimization rules, automatically calculates and judges resource optimization information according to the rules, and finally carries out custom statistical display on generated optimized saving data.
In order to achieve the acquisition of the resource optimization information, after the step S200, in a step S300, the user terminal acquires resource matching information corresponding to the plurality of observation parameters, and determines resource demand information of the plurality of observation parameters based on the resource matching information, where the resource demand information is used to determine a resource demand quantity corresponding to each public cloud account, and adjusts corresponding public cloud resources based on the quantity, so that system resources can be saved under the condition of meeting the resource quantity demand, and expenses required by an enterprise to maintain corresponding resources are saved; subsequently, the user terminal generates public cloud configuration adjustment information regarding the resource demand information in step S400, where the public cloud configuration adjustment information is used to prompt the user to adjust the resource configuration of the public cloud, and specifically to prompt the user to adjust the amount of resources configured by each public cloud.
Here, in some embodiments, the user terminal further sends a plurality of metadata requests to the plurality of network devices, respectively, based on the public cloud account information, so as to use the public cloud resources; each metadata request comprises public cloud account identification information, and the public cloud account identification information is used for determining corresponding access authority of a user. For example, the plurality of network devices correspond to a plurality of different cloud platforms, respectively. The access right of a user to a certain cloud account is determined by related account information provided by the user in some embodiments, for example, aristo needs to obtain fields of entering accessKeyId and accessSecret, and Azure (cloud service platform provided by amazon) needs to obtain fields of entering subscribentid and clientSecret. And after the entry is successful, verifying whether the entered account is available. Subsequently, the user terminal receives a plurality of pieces of metadata transmitted by the plurality of network devices based on the metadata request. The metadata is mainly information describing a data property (property) and is used for supporting functions such as indicating a storage location, history data, resource searching, file recording and the like. And the user terminal executes cleaning operation on the metadata to obtain a plurality of corresponding target data and determines the group information of each target data. In some embodiments, according to different data cleansing rules of the cloud platforms, the content of the metadata is cleansed into the corresponding data structure, including checking data consistency, processing invalid values and missing values, and the like. And then the user terminal responds to an operation instruction input by a user on a single interface of the user terminal, and executes corresponding target operation on corresponding target data based on at least one item of group information, wherein the operation instruction comprises the at least one item of group information. In some embodiments, the corresponding operation results are also presented in the single interface. Therefore, a user can manage a plurality of cloud accounts only in a single user interface without processing each cloud account.
In some embodiments, in step S200, the user terminal sends a plurality of observation parameter requests to the plurality of network devices respectively based on a preset time interval. For example, after the user's authentication information is acquired, the system performs the above operations at regular intervals by itself, so as to reduce the operation burden of the user and improve the real-time performance of the local data. Specifically, in some embodiments, the above step S200 includes a substep S210, a substep S220, a substep S230, and a substep S240 (all not shown). In substep S210, the user terminal creates a task queue, where the task queue includes a plurality of observation parameter request tasks corresponding to the plurality of public cloud account identification information; in substep S220, the user terminal obtains a current task in the task queue and determines an executable state of the current task; in the substep S230, if the executable state of the current task is non-executable, the user terminal moves the current task to the tail of the task queue; in sub-step S240, if the executable state of the current task is executable, the user terminal executes the current task to send a corresponding observation parameter request to the corresponding network device, and removes the current task after the current task is executed. In order to automatically execute some tasks and reduce the burden of an administrator, some tasks are provided with a cycle state, and the cycle state is used for representing whether the task needs to be automatically executed again after the task is executed at this time.
Fig. 4 shows a schematic diagram of an account task, and attributes of the account task mainly include account information, a cycle flag, a next execution time, a task state flag, and subtask information; the subtasks mainly comprise subtasks such as ECS, RDS, OSS and the like, the ECS monitoring item mainly comprises CPU percentage (CPU Utilization), system Disk total Read BPS (Disk Read BPS), system Disk total Write BPS (Disk Write BPS), and public network outgoing bandwidth (Internet Out Rate), and the RDS monitoring item mainly comprises CPU Utilization Rate (Cpu Utilization), Disk Utilization Rate (Disk Utilization), Connection Utilization Rate (Connection Utilization), and memory Utilization Rate (memory Utilization). Of course, those skilled in the art will understand that the attributes of these account tasks, and the types of subtasks, are given here by way of example only and are not intended to limit the present application in any way; other attributes of account tasks, and the types of subtasks that may be present or that may later occur, as applicable to the present application, are also included within the scope of the present application and are incorporated by reference herein.
Fig. 5 shows the transition process between the various states. Accordingly, in some embodiments, in sub-step S240, if the executable state of the current task is executable, the user terminal executes the current task to send a corresponding metadata request to a corresponding network device; if the cycle state of the current task is true, moving the current task to the tail of the task queue after the current task is executed; otherwise, the current task is removed after the current task is executed.
For example, the system manages information synchronization of various cloud account resources (basic resources, resource monitoring and the like); after the synchronization task is successfully created, the synchronization task is saved in a task queue to be executed, as shown in fig. 3. An account task in the task queue comprises a plurality of subtasks of resource information, each account task has only one state, the task state is divided into (executable, to be executed, in execution, execution completed, execution error), and the task records the next execution time and marks whether to loop the task (for example, 0-no, 1-yes). Referring to the task execution flow shown in fig. 6, the system first obtains the first task (i.e., "current task") in the queue, and determines whether it is executable; if the current task can not be executed, the current task is moved to the tail of the queue, otherwise the current task is set to be in execution (so as to avoid conflict during parallel processing), the task is put into the execution thread pool, and the task is executed through the subtask concurrent coroutine. After the current task is executed, marking the completion state of the current task as 'completed'; and checking the cycle identifier, if the current task is a cycle task, still moving the task to the tail of the queue, and otherwise, removing the task from the queue.
In some embodiments, the step S300 includes a sub-step S310 and a sub-step S320 (both not shown). In sub-step S310, the user terminal obtains resource matching information corresponding to the plurality of observation parameters, where the resource matching information includes a resource configuration factor (for example, the factor represents the importance degree of the corresponding resource, which is preset and fixed in some embodiments and adjustable by a manager as needed) and corresponding weight information of the resource corresponding to each observation parameter; in sub-step S320, the ue determines resource requirement information of the monitoring items corresponding to the plurality of observation parameters based on the resource allocation factor and the weight information. Based on the resource configuration factor and corresponding weight information, it can be determined whether a resource can be removed. For example, the sum of the product of the resource allocation factor and the weight of the observation parameter corresponding to each monitoring item is used to determine the resource requirement information of each monitoring item. In some embodiments, in step S400, the user terminal generates public cloud configuration adjustment information about the resource demand information, where the public cloud configuration adjustment information includes a removal instruction corresponding to at least one observation parameter, and the resource demand information corresponding to the at least one observation parameter satisfies a resource removal condition. FIG. 7 illustrates public cloud resource configuration information regarding forecasted resource demand information, including corresponding resource usage and subsequent operational recommendations, in one embodiment. Wherein, in some embodiments, the removal instruction is generated when the resource removal condition is satisfied for prompting the user to remove the corresponding instruction. Specifically, the sub-step S310 includes a sub-step S311 and a sub-step S312 (both not shown), in the sub-step S311, the user terminal reads initial resource matching information corresponding to the plurality of observation parameters, where the initial resource matching information includes a resource configuration factor corresponding to each observation parameter and corresponding initial weight information; in sub-step S312, the user terminal adjusts the initial weight information to determine corresponding weight information. The following examples are given.
Table 1 below shows the initialized optimized matching rule, which includes the aforementioned initial weight information.
TABLE 1
Figure BDA0002205876100000091
Figure BDA0002205876100000101
Figure BDA0002205876100000111
Reading monitoring data synchronized and persisted for a period of time according to the rules configured in the table, putting the monitoring data into a matching rule task pool, and matching each configured monitoring item one by one; by weighted averaging, the following equation:
Figure BDA0002205876100000112
wherein f is1+f2+…+fk＝k，f1,f2,…,fkCalled a weight. Calculating an average value of each monitoring item through the product of mathematics and weights, and if the average value is larger than a set value, representing that the resource is not removable; if the average value is less than the set value, it represents that the resource can be optimized, and finally persists the calculated value.
And the adjustment of the weight information is made based on unsupervised learning. In step S312, the ue determines the weight information as the initial weight information, and updates the weight information based on the change of each observation parameter. Specifically, the user terminal performs clustering iteration on the weight information based on the change of each observation parameter to update the weight information. For example, the system adopts an unsupervised learning method to realize dynamic adjustment of the weight value according to the dynamic change of the monitoring data item; the clustering algorithm finds the optimal solution for the data through multiple iterations. Where the K-means clustering algorithm is representative of the clustering algorithm.
The K-means algorithm according to an embodiment of the present application includes the following specific steps:
based on the scenario of the application, the core of the K-means clustering is to divide a given weight data set into K clusters, and to provide a cluster center point corresponding to each weight data, so as to realize dynamic adjustment of weight values and obtain a corresponding optimal solution, thereby providing an adjustment suggestion of resource quantity.
1) And (4) data preprocessing, including normalization and outlier processing.
2) Randomly selecting K cluster centers of the weight data, and recording the K cluster centers as K cluster centers
Figure BDA0002205876100000121
3) Defining a cost function:
Figure BDA0002205876100000122
4) let t be 0,1,2, … be the number of iteration steps, and the following process is repeated until J converges:
-for each weight sample xiIt is assigned to the closest cluster:
Figure BDA0002205876100000123
for each class cluster k, the center of the class cluster is recalculated:
k-means Algorithm when iterating, assuming that the current J does not reach a minimum value, the cluster center [ mu ] is fixed firstkAdjust each sample xiClass c to whichiTo let the J function decrease; then fix { ciAdjust cluster center { mu }kJ is decreased. These two processes cycle alternately, with J monotonically decreasing: when J decreases to a minimum, { μkAnd { c }andiBut also converges simultaneously.
The historical load information can be updated based on the current load information observed at regular time, so that the real-time performance of the system is improved. Accordingly, in some embodiments, the method further comprises step S500 (not shown). In step S500, the user terminal requests the plurality of network devices for corresponding current load information, and updates the corresponding observation parameters based on the current load information. Wherein the current load information includes at least one of:
processor load information such as CPU percentage, current core space occupied CPU percentage, current user space occupied CPU percentage, current CPU percentage waiting for IO operations, etc.;
bandwidth load information, such as public network ingress/egress bandwidth, private network ingress/egress bandwidth, individual egress bandwidth usage, etc.;
store load information such as disk total read BPS, system disk total write BPS, system disk read IOPS, system disk write IOPS, etc.
Wherein in some embodiments the method further comprises step S600 (not shown). In step S600, the user terminal performs a resource adjustment operation corresponding to the corresponding public cloud account based on the public cloud configuration adjustment information, so as to increase the real-time performance of the system load adjustment process, further improve the efficiency, and reduce the workload of the administrator.
For the sake of clarity, taking the syncing data of the arrhizus ECS monitoring as an example, the list of basic monitoring items is shown in table 2 below, and the operating system level monitoring items are shown in table 3 below.
TABLE 2
Figure BDA0002205876100000131
Figure BDA0002205876100000141
TABLE 3
Figure BDA0002205876100000142
Figure BDA0002205876100000151
Figure BDA0002205876100000161
Figure BDA0002205876100000171
Figure BDA0002205876100000181
Figure BDA0002205876100000191
Figure BDA0002205876100000201
The present application also provides a computer readable storage medium having stored thereon computer code which, when executed, performs a method as in any one of the preceding.
The present application also provides a computer program product, which when executed by a computer device, performs the method of any of the preceding claims.
The present application further provides a computer device, comprising:
one or more processors;
a memory for storing one or more computer programs;
the one or more computer programs, when executed by the one or more processors, cause the one or more processors to implement the method of any preceding claim.
FIG. 8 illustrates an exemplary system that can be used to implement the various embodiments described in this application.
As shown in fig. 8, in some embodiments, the system 1000 may be configured as any of the user terminal devices in the various embodiments described herein. In some embodiments, system 1000 may include one or more computer-readable media (e.g., system memory or NVM/storage 1020) having instructions and one or more processors (e.g., processor(s) 1005) coupled with the one or more computer-readable media and configured to execute the instructions to implement modules to perform the actions described herein.
For one embodiment, system control module 1010 may include any suitable interface controllers to provide any suitable interface to at least one of the processor(s) 1005 and/or to any suitable device or component in communication with system control module 1010.
The system control module 1010 may include a memory controller module 1030 to provide an interface to the system memory 1015. Memory controller module 1030 may be a hardware module, a software module, and/or a firmware module.
System memory 1015 may be used to load and store data and/or instructions, for example, for system 1000. For one embodiment, system memory 1015 may include any suitable volatile memory, such as suitable DRAM. In some embodiments, the system memory 1015 may include a double data rate type four synchronous dynamic random access memory (DDR4 SDRAM).
For one embodiment, system control module 1010 may include one or more input/output (I/O) controllers to provide an interface to NVM/storage 1020 and communication interface(s) 1025.
For example, NVM/storage 1020 may be used to store data and/or instructions. NVM/storage 1020 may include any suitable non-volatile memory (e.g., flash memory) and/or may include any suitable non-volatile storage device(s) (e.g., one or more Hard Disk drive(s) (HDD (s)), one or more Compact Disc (CD) drive(s), and/or one or more Digital Versatile Disc (DVD) drive (s)).
NVM/storage 1020 may include storage resources that are physically part of a device on which system 1000 is installed or may be accessed by the device and not necessarily part of the device. For example, NVM/storage 1020 may be accessed over a network via communication interface(s) 1025.
Communication interface(s) 1025 may provide an interface for system 1000 to communicate over one or more networks and/or with any other suitable device. System 1000 may communicate wirelessly with one or more components of a wireless network according to any of one or more wireless network standards and/or protocols.
For one embodiment, at least one of the processor(s) 1005 may be packaged together with logic for one or more controller(s) of the system control module 1010, e.g., memory controller module 1030. For one embodiment, at least one of the processor(s) 1005 may be packaged together with logic for one or more controller(s) of the system control module 1010 to form a System In Package (SiP). For one embodiment, at least one of the processor(s) 1005 may be integrated on the same die with logic for one or more controller(s) of the system control module 1010. For one embodiment, at least one of the processor(s) 1005 may be integrated on the same die with logic of one or more controllers of the system control module 1010 to form a system on a chip (SoC).
In various embodiments, system 1000 may be, but is not limited to being: a server, a workstation, a desktop computing device, or a mobile computing device (e.g., a laptop computing device, a handheld computing device, a tablet, a netbook, etc.). In various embodiments, system 1000 may have more or fewer components and/or different architectures. For example, in some embodiments, system 1000 includes one or more cameras, a keyboard, a Liquid Crystal Display (LCD) screen (including a touch screen display), a non-volatile memory port, multiple antennas, a graphics chip, an Application Specific Integrated Circuit (ASIC), and speakers.
It should be noted that the present application may be implemented in software and/or a combination of software and hardware, for example, implemented using Application Specific Integrated Circuits (ASICs), general purpose computers or any other similar hardware devices. In one embodiment, the software programs of the present application may be executed by a processor to implement the steps or functions described above. Likewise, the software programs (including associated data structures) of the present application may be stored in a computer readable recording medium, such as RAM memory, magnetic or optical drive or diskette and the like. Additionally, some of the steps or functions of the present application may be implemented in hardware, for example, as circuitry that cooperates with the processor to perform various steps or functions.
In addition, some of the present application may be implemented as a computer program product, such as computer program instructions, which when executed by a computer, may invoke or provide methods and/or techniques in accordance with the present application through the operation of the computer. Those skilled in the art will appreciate that the form in which the computer program instructions reside on a computer-readable medium includes, but is not limited to, source files, executable files, installation package files, and the like, and that the manner in which the computer program instructions are executed by a computer includes, but is not limited to: the computer directly executes the instruction, or the computer compiles the instruction and then executes the corresponding compiled program, or the computer reads and executes the instruction, or the computer reads and installs the instruction and then executes the corresponding installed program. Computer-readable media herein can be any available computer-readable storage media or communication media that can be accessed by a computer.
Communication media includes media by which communication signals, including, for example, computer readable instructions, data structures, program modules, or other data, are transmitted from one system to another. Communication media may include conductive transmission media such as cables and wires (e.g., fiber optics, coaxial, etc.) and wireless (non-conductive transmission) media capable of propagating energy waves such as acoustic, electromagnetic, RF, microwave, and infrared. Computer readable instructions, data structures, program modules, or other data may be embodied in a modulated data signal, for example, in a wireless medium such as a carrier wave or similar mechanism such as is embodied as part of spread spectrum techniques. The term "modulated data signal" means a signal that has one or more of its characteristics set or changed in such a manner as to encode information in the signal. The modulation may be analog, digital or hybrid modulation techniques.
By way of example, and not limitation, computer-readable storage media may include volatile and nonvolatile, removable and non-removable media implemented in any method or technology for storage of information such as computer-readable instructions, data structures, program modules or other data. For example, computer-readable storage media include, but are not limited to, volatile memory such as random access memory (RAM, DRAM, SRAM); and non-volatile memory such as flash memory, various read-only memories (ROM, PROM, EPROM, EEPROM), magnetic and ferromagnetic/ferroelectric memories (MRAM, FeRAM); and magnetic and optical storage devices (hard disk, tape, CD, DVD); or other now known media or later developed that can store computer-readable information/data for use by a computer system.
An embodiment according to the present application comprises an apparatus comprising a memory for storing computer program instructions and a processor for executing the program instructions, wherein the computer program instructions, when executed by the processor, trigger the apparatus to perform a method and/or a solution according to the aforementioned embodiments of the present application.
It will be evident to those skilled in the art that the present application is not limited to the details of the foregoing illustrative embodiments, and that the present application may be embodied in other specific forms without departing from the spirit or essential attributes thereof. The present embodiments are therefore to be considered in all respects as illustrative and not restrictive, the scope of the application being indicated by the appended claims rather than by the foregoing description, and all changes which come within the meaning and range of equivalency of the claims are therefore intended to be embraced therein. Any reference sign in a claim should not be construed as limiting the claim concerned. Furthermore, it is obvious that the word "comprising" does not exclude other elements or steps, and the singular does not exclude the plural. A plurality of units or means recited in the apparatus claims may also be implemented by one unit or means in software or hardware. The terms first, second, etc. are used to denote names, but not any particular order.

Claims (12)

1. A method for generating public cloud configuration adjustment information is applied to a user terminal, wherein the method comprises the following steps:
matching corresponding identification information of a plurality of public cloud account numbers based on the same identity authentication information of the user;
the method comprises the steps of respectively sending a plurality of observation parameter requests to a plurality of network devices, and receiving a plurality of observation parameters in a time sequence sent by the plurality of network devices based on the observation parameter requests, wherein each observation parameter request comprises public cloud account identification information, each observation parameter comprises corresponding historical load information, and the public cloud account identification information is used for determining the access authority of a user to a corresponding public cloud account;
acquiring resource matching information corresponding to the plurality of observation parameters, and determining resource demand information of the plurality of observation parameters based on the resource matching information;
and generating public cloud configuration adjustment information related to the resource demand information, wherein the public cloud configuration adjustment information is used for adjusting the resource quantity corresponding to the corresponding public cloud account.
2. The method of claim 1, wherein the step of sending a plurality of observed parameter requests to a plurality of network devices, respectively, comprises:
and respectively sending a plurality of observation parameter requests to a plurality of network devices based on a preset time interval.
3. The method of claim 1, wherein the step of obtaining resource matching information corresponding to the plurality of observed parameters and determining resource requirement information of the plurality of observed parameters based on the resource matching information comprises:
acquiring resource matching information corresponding to the plurality of observation parameters, wherein the resource matching information comprises resource configuration factors of resources corresponding to each observation parameter and corresponding weight information;
determining resource demand information for the plurality of observed parameters based on the resource allocation factor and the weight information.
4. The method of claim 3, wherein the step of determining resource demand information for the plurality of observed parameters based on the resource allocation factor and the weight information comprises:
determining resource demand information of resources corresponding to each observation parameter based on the weight information;
the step of generating public cloud configuration adjustment information about the resource demand information includes:
generating public cloud configuration adjustment information related to the resource demand information, wherein the public cloud configuration adjustment information comprises a removal instruction corresponding to at least one observation parameter, and the resource demand information corresponding to the at least one observation parameter meets a resource removal condition.
5. The method according to claim 3 or 4, wherein the step of obtaining resource matching information corresponding to the plurality of observation parameters, wherein the resource matching information includes a resource configuration factor and corresponding weight information of a resource corresponding to each observation parameter, includes:
reading initial resource matching information corresponding to the plurality of observation parameters, wherein the initial resource matching information comprises a resource configuration factor corresponding to each observation parameter and corresponding initial weight information;
and adjusting the initial weight information to determine corresponding weight information.
6. The method of claim 5, wherein the adjusting the initial weight information to determine the corresponding weight information comprises:
determining weight information as the initial weight information;
updating the weight information based on changes in each observed parameter.
7. The method of claim 6, wherein the step of updating the weight information based on changes in each observed parameter comprises:
and performing clustering iteration on the weight information based on the change of each observation parameter so as to update the weight information.
8. The method of claim 1, wherein the method further comprises:
and requesting corresponding current load information from the plurality of network devices, and updating corresponding observation parameters based on the current load information.
9. The method of claim 8, wherein the current load information comprises at least any one of:
processor load information;
bandwidth load information;
load information is stored.
10. The method of claim 1, wherein the method further comprises:
and executing resource adjustment operation corresponding to the corresponding public cloud account number based on the public cloud configuration adjustment information.
11. An apparatus for performing a target operation on target data, wherein the apparatus comprises:
a processor; and
a memory arranged to store computer-executable instructions that, when executed, cause the processor to perform operations according to the method of any one of claims 1 to 10.
12. A computer-readable medium storing instructions that, when executed, cause a system to perform operations of any of the methods of claims 1-10.
CN201910881031.5A 2019-09-18 2019-09-18 Method and equipment for generating public cloud configuration adjustment information Active CN110719320B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201910881031.5A CN110719320B (en) 2019-09-18 2019-09-18 Method and equipment for generating public cloud configuration adjustment information

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201910881031.5A CN110719320B (en) 2019-09-18 2019-09-18 Method and equipment for generating public cloud configuration adjustment information

Publications (2)

Publication Number Publication Date
CN110719320A true CN110719320A (en) 2020-01-21
CN110719320B CN110719320B (en) 2022-05-27

Family

ID=69210604

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201910881031.5A Active CN110719320B (en) 2019-09-18 2019-09-18 Method and equipment for generating public cloud configuration adjustment information

Country Status (1)

Country Link
CN (1) CN110719320B (en)

Cited By (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111291300A (en) * 2020-02-02 2020-06-16 郭春燕 Webpage data processing method and device, webpage system and server
CN112769782A (en) * 2020-12-29 2021-05-07 上海联蔚盘云科技有限公司 Method and equipment for multi-cloud security baseline management
CN113112139A (en) * 2021-04-07 2021-07-13 上海联蔚盘云科技有限公司 Cloud platform bill processing method and equipment
CN114124944A (en) * 2020-08-27 2022-03-01 阿里巴巴集团控股有限公司 Data processing method and device of hybrid cloud and electronic equipment
CN115242626A (en) * 2022-07-21 2022-10-25 中国建设银行股份有限公司 Cloud resource allocation estimation method, device, equipment, storage medium and program product

Citations (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102254033A (en) * 2011-08-05 2011-11-23 西安电子科技大学 Entropy weight-based global K-means clustering method
CN104168318A (en) * 2014-08-18 2014-11-26 中国联合网络通信集团有限公司 Resource service system and resource distribution method thereof
US20150373109A1 (en) * 2014-06-18 2015-12-24 Claude Lano Cox Methods and systems for virtualizing and managing cloud storage sources
WO2017054543A1 (en) * 2015-09-29 2017-04-06 中兴通讯股份有限公司 Method and device for accessing resource of cloud storage
TW201721454A (en) * 2015-12-02 2017-06-16 Chunghwa Telecom Co Ltd Resource utilization analysis prediction system of cloud environment and method therefor determining whether to automatically expand or reduce resources based on a short-term performance analysis prediction and a long-term performance analysis prediction
CN109343965A (en) * 2018-10-31 2019-02-15 北京金山云网络技术有限公司 Resource adjusting method, device, cloud platform and server
CN109491808A (en) * 2018-11-09 2019-03-19 国网山东省电力公司信息通信公司 A kind of cloud service management system
CN109525605A (en) * 2019-01-03 2019-03-26 杭州数梦工场科技有限公司 A kind of account management method, device, system and computer readable storage medium
CN110138883A (en) * 2019-06-10 2019-08-16 北京贝斯平云科技有限公司 Mixed cloud resource allocation methods and device

Patent Citations (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102254033A (en) * 2011-08-05 2011-11-23 西安电子科技大学 Entropy weight-based global K-means clustering method
US20150373109A1 (en) * 2014-06-18 2015-12-24 Claude Lano Cox Methods and systems for virtualizing and managing cloud storage sources
CN104168318A (en) * 2014-08-18 2014-11-26 中国联合网络通信集团有限公司 Resource service system and resource distribution method thereof
WO2017054543A1 (en) * 2015-09-29 2017-04-06 中兴通讯股份有限公司 Method and device for accessing resource of cloud storage
TW201721454A (en) * 2015-12-02 2017-06-16 Chunghwa Telecom Co Ltd Resource utilization analysis prediction system of cloud environment and method therefor determining whether to automatically expand or reduce resources based on a short-term performance analysis prediction and a long-term performance analysis prediction
CN109343965A (en) * 2018-10-31 2019-02-15 北京金山云网络技术有限公司 Resource adjusting method, device, cloud platform and server
CN109491808A (en) * 2018-11-09 2019-03-19 国网山东省电力公司信息通信公司 A kind of cloud service management system
CN109525605A (en) * 2019-01-03 2019-03-26 杭州数梦工场科技有限公司 A kind of account management method, device, system and computer readable storage medium
CN110138883A (en) * 2019-06-10 2019-08-16 北京贝斯平云科技有限公司 Mixed cloud resource allocation methods and device

Cited By (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111291300A (en) * 2020-02-02 2020-06-16 郭春燕 Webpage data processing method and device, webpage system and server
CN114124944A (en) * 2020-08-27 2022-03-01 阿里巴巴集团控股有限公司 Data processing method and device of hybrid cloud and electronic equipment
CN112769782A (en) * 2020-12-29 2021-05-07 上海联蔚盘云科技有限公司 Method and equipment for multi-cloud security baseline management
CN112769782B (en) * 2020-12-29 2023-06-02 上海联蔚盘云科技有限公司 Method and equipment for managing multi-cloud security base line
CN113112139A (en) * 2021-04-07 2021-07-13 上海联蔚盘云科技有限公司 Cloud platform bill processing method and equipment
CN115242626A (en) * 2022-07-21 2022-10-25 中国建设银行股份有限公司 Cloud resource allocation estimation method, device, equipment, storage medium and program product
CN115242626B (en) * 2022-07-21 2024-04-05 中国建设银行股份有限公司 Cloud resource allocation prediction method, device, equipment, storage medium and program product

Also Published As

Publication number Publication date
CN110719320B (en) 2022-05-27

Similar Documents

Publication Publication Date Title
CN110719320B (en) Method and equipment for generating public cloud configuration adjustment information
US10447806B1 (en) Workload scheduling across heterogeneous resource environments
US11204811B2 (en) Methods and systems for estimating time remaining and right sizing usable capacities of resources of a distributed computing system
CN106776005B (en) Resource management system and method for containerized application
US11086683B2 (en) Redistributing workloads across worker nodes based on policy
JP6031196B2 (en) Tuning for distributed data storage and processing systems
EP3588295B1 (en) Self-managed intelligent elastic cloud stack
WO2016040699A1 (en) Computing instance launch time
US11048577B2 (en) Automatic correcting of computing cluster execution failure
US10997113B1 (en) Method and system for a resource reallocation of computing resources in a resource pool using a ledger service
US10243819B1 (en) Template generation based on analysis
US9910881B1 (en) Maintaining versions of control plane data for a network-based service control plane
CN110727664A (en) Method and device for executing target operation on public cloud data
CN110704851A (en) Public cloud data processing method and device
US20230119552A1 (en) Resource management mechanisms for stateful serverless clusters in edge computing
US10884845B2 (en) Increasing processing capacity of processor cores during initial program load processing
US10977153B1 (en) Method and system for generating digital twins of resource pools and resource pool devices
US11663504B2 (en) Method and system for predicting resource reallocation in a resource pool
US11017417B1 (en) Using incentives to manage computing resources
US20230342177A1 (en) Methods and decentralized systems that distribute automatically learned control information to agents that employ distributed machine learning to automatically instantiate and manage distributed applications
US10635336B1 (en) Cache-based partition allocation
US9772877B2 (en) Managing I/O operations in a shared file system
CN116932156A (en) Task processing method, device and system
Cano Optimizing distributed systems using machine learning
US11381468B1 (en) Identifying correlated resource behaviors for resource allocation

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
CB02 Change of applicant information
CB02 Change of applicant information

Address after: 200231 5th floor, building 2, 188 Pingfu Road, Xuhui District, Shanghai

Applicant after: Shanghai Lianwei Digital Technology Group Co.,Ltd.

Address before: 200231 5th floor, building 2, 188 Pingfu Road, Xuhui District, Shanghai

Applicant before: Shanghai Lianwei Information Technology Co.,Ltd.

GR01 Patent grant
GR01 Patent grant