CN110233747B - Data reporting method and cloud platform - Google Patents
Data reporting method and cloud platform Download PDFInfo
- Publication number
- CN110233747B CN110233747B CN201810185457.2A CN201810185457A CN110233747B CN 110233747 B CN110233747 B CN 110233747B CN 201810185457 A CN201810185457 A CN 201810185457A CN 110233747 B CN110233747 B CN 110233747B
- Authority
- CN
- China
- Prior art keywords
- resource
- data
- type
- application
- application resource
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/22—Indexing; Data structures therefor; Storage structures
- G06F16/2282—Tablespace storage structures; Management thereof
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L41/00—Arrangements for maintenance, administration or management of data switching networks, e.g. of packet switching networks
- H04L41/02—Standardisation; Integration
- H04L41/0213—Standardised network management protocols, e.g. simple network management protocol [SNMP]
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L41/00—Arrangements for maintenance, administration or management of data switching networks, e.g. of packet switching networks
- H04L41/06—Management of faults, events, alarms or notifications
- H04L41/0631—Management of faults, events, alarms or notifications using root cause analysis; using analysis of correlation between notifications, alarms or events based on decision criteria, e.g. hierarchy, tree or time analysis
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L43/00—Arrangements for monitoring or testing data switching networks
- H04L43/08—Monitoring or testing based on specific metrics, e.g. QoS, energy consumption or environmental parameters
- H04L43/0876—Network utilisation, e.g. volume of load or congestion level
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/06—Protocols specially adapted for file transfer, e.g. file transfer protocol [FTP]
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/2866—Architectures; Arrangements
- H04L67/30—Profiles
Abstract
The embodiment of the invention provides a data reporting method and a cloud platform, which are used for solving the technical problem that the resource data reporting method on a platform side in the prior art is single.
Description
Technical Field
The invention relates to the technical field of computers, in particular to a data reporting method and a cloud platform.
Background
At present, with the rapid development of cloud computing technology, the related industries related to cloud computing are born and continuously developed, and various cloud platforms including public clouds, private clouds, government affairs clouds, enterprise clouds and the like at home and abroad are built and developed. Various application resources including Virtual machines, Virtual Private Cloud (VPC) networks, Virtual storage and the like are provided on the Cloud platform and can be conveniently purchased and used by users, and when the users use various application resources in the Cloud platform, the users can generate some Virtual resource data which can be analyzed and operated and maintained by operation and maintenance personnel, so that the operation and maintenance personnel can track and process problems related to various application resources from the users.
The method mainly includes that a platform side reports resource data to an operation and maintenance system through an active call interface, the operation and maintenance system actively calls the interface to acquire the resource data from the platform side, the platform side reports the resource data to the operation and maintenance system through message middleware such as kafka and ActiveMQ, the platform side sends an alarm to the operation and maintenance system through a Simple Network Management Protocol (SNMP), or the platform side reports the resource data to the operation and maintenance system in a file mode, and the like.
However, no matter which implementation manner is used by the platform side for reporting the resource data, all types of resource data are all overlaid on the same data reporting manner, which causes the problem that the platform side has a large data volume and a large concurrency in the process of reporting the resource data.
In summary, in the prior art, the method for reporting the resource data on the platform side is single.
Disclosure of Invention
The embodiment of the invention provides a data reporting method and a cloud platform, which are used for solving the technical problem that the resource data reporting method on the platform side in the prior art is single.
In a first aspect, an embodiment of the present invention provides a data reporting method, where a cloud platform counts actual usage amounts of each type of application resource in at least one type of application resource, then determining the resource heat value of each type of application resource according to the actual usage amount of each type of application resource, further, based on the preset corresponding relation between the resource heat value and the data reporting mode, a first data reporting mode of the resource data of the first application resource is determined, and the resource data of the first type of application resource is reported in the first data reporting mode, namely, according to the resource heat values of different application resources, different data reporting modes are correspondingly adapted and adopted, so that the limitation caused by reporting the resource data in a single data reporting mode in the prior art is solved, and the most adaptive data reporting mode is selected according to the actual situation, so that the effects of diversity, adaptability and flexibility of the data reporting mode are achieved.
In a possible implementation manner, when the actual usage amount of each type of application resource in at least one type of application resource of the cloud platform is counted, a resource data table in a resource database of the cloud platform may be scanned, and the data amount of each type of resource data in at least one type of resource data corresponding to at least one type of application resource is counted; and determining the actual usage amount of each type of application resource based on the functional relation between the data amount of each type of resource data and the usage amount of the corresponding application resource.
That is to say, the actual usage amount of each type of application resource can be represented by the data amount of the corresponding resource data, so that the actual usage condition of each type of application resource can be more intuitively reflected, and data assurance is provided for the operation and maintenance personnel at the operation and maintenance system side to analyze and operate and maintain the cloud platform.
In one possible implementation manner, the scanning resource data tables in the resource database of the cloud platform includes: if the at least one type of resource data is stored in the same resource data table, scanning the resource data table by taking the resource identifier of each type of resource data as a distinguishing parameter; or if the at least one type of resource data is stored in a sub-table, multithreading parallel scanning the resource data table.
The resource data table can be scanned in different scanning modes according to the storage condition of at least one type of resource data, and the accuracy of scanning the resource data table is improved.
In one possible implementation manner, determining the resource heat value of each type of application resource based on the actual usage amount of each type of application resource includes: matching the actual usage amount of each type of application resource with at least one preset interval, wherein one preset interval corresponds to one preset resource heat value; and if the actual usage amount of the first application resource is in a first preset interval, determining that the resource heat value of the first application resource is a preset resource heat value of the first preset interval, wherein the first preset interval is any one preset interval in the at least one preset interval.
In one possible implementation manner, the method further includes:
configuring the data reporting mode matched with each resource heat value in a configuration file; or the like, or, alternatively,
and storing the preset corresponding relation into a resource database.
In a second aspect, an embodiment of the present invention provides a cloud platform, including:
the statistical module is used for counting the actual usage amount of each type of application resource in at least one type of application resource of the cloud platform;
the determining module is used for determining a resource heat value of each type of application resource based on the actual usage amount of each type of application resource;
a reporting module, configured to determine a first data reporting manner of resource data of a first application resource based on a preset corresponding relationship between a resource heat value and a data reporting manner, and report the resource data of the first type of application resource in the first data reporting manner, where the first application resource is any type of application resource in the at least one type of application resource, and each type of resource data is data generated when a user uses a corresponding application resource.
In one possible implementation, the statistics module is configured to:
scanning a resource data table in a resource database of the cloud platform, and counting the data volume of each type of resource data in at least one type of resource data corresponding to the at least one type of application resource;
And determining the actual usage amount of each type of application resource based on the functional relation between the data amount of each type of resource data and the usage amount of the corresponding application resource.
In one possible implementation, the statistics module is configured to:
if the at least one type of resource data is stored in the same resource data table, scanning the resource data table by taking the resource identifier of each type of resource data as a distinguishing parameter; or the like, or, alternatively,
and if the at least one type of resource data is stored in the sub-tables, multithreading parallel scanning is carried out on the resource data tables.
In one possible implementation, the determining module is configured to:
matching the actual usage amount of each type of application resource with at least one preset interval, wherein one preset interval corresponds to one preset resource heat value;
and if the actual usage amount of the first application resource is in a first preset interval, determining that the resource heat value of the first application resource is a preset resource heat value of the first preset interval, wherein the first preset interval is any one preset interval in the at least one preset interval.
In one possible implementation manner, the method further includes:
the configuration module is used for configuring the data reporting mode matched with each resource heat value in a configuration file; or the like, or, alternatively,
And storing the preset corresponding relation into a resource database.
In a third aspect, an embodiment of the present invention provides a computer apparatus, including:
at least one processor, and
a memory communicatively coupled to the at least one processor, a communication interface;
wherein the memory stores instructions executable by the at least one processor, the at least one processor performing the method of the first aspect with the communication interface by executing the instructions stored by the memory.
In a fourth aspect, the present invention provides a computer-readable storage medium storing computer instructions, which, when executed on a computer, cause the computer to perform the method according to the first aspect.
Drawings
In order to more clearly illustrate the technical solutions of the embodiments of the present invention, the drawings needed to be used in the embodiments of the present invention will be briefly described below, and it is obvious that the drawings described below are only some embodiments of the present invention, and it is obvious for those skilled in the art that other drawings can be obtained according to the drawings without creative efforts.
Fig. 1 is an architecture diagram of a data reporting method according to an embodiment of the present invention;
fig. 2 is a schematic flow chart of a data reporting method in an embodiment of the present invention;
FIG. 3 is a schematic view of a scanning process of a resource data table according to an embodiment of the present invention;
FIG. 4 is a flow chart of a report implementation process for adapting to multiple data reporting modes in an embodiment of the present invention;
FIG. 5 is a block diagram of a cloud platform according to an embodiment of the present invention;
FIG. 6 is a block diagram of a computer device according to an embodiment of the present invention.
Detailed Description
In order to make the objects, technical solutions and advantages of the embodiments of the present invention clearer, the technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention.
Firstly, several common implementation manners of reporting resource data to an operation and maintenance system by a cloud platform in the prior art are introduced as follows:
(1) the platform side reports the resource data to the operation and maintenance system through an active calling interface: the method is suitable for scenes with small data volume and high real-time requirement, and mainly comprises the steps that an operation and maintenance system and a platform side mutually negotiate which data are reported, when the data are reported, what the reported data format is, what the used interface format is defined, and the like, and finally after the two parties agree with the problems, the data can be reported through a Representational State Transfer (REST) or web service interface calling mode.
(2) The operation and maintenance system actively calls an interface to obtain resource data from the platform side: this scheme is essentially identical to (1) implementation, except that the caller and callee interchange identities.
(3) The platform side reports the resource data to the operation and maintenance system through message middleware such as kafka, ActiveMQ and the like: the platform side can send the data to be reported to the receiver through the message pipeline in the appointed time, and the receiver gives a response after receiving the data and confirming that the data is correct.
(4) The platform side pushes data to the operation and maintenance system through SNMP alarm: a method for transmitting data by using network protocol, the data is mainly transmitted in message format through network, and is generally applied to management systems for monitoring operation and maintenance alarms and the like.
(5) The platform side reports the resource data to the operation and maintenance system in a file mode: the File format and specification are agreed by both the platform side and the operation and maintenance system, the platform side generates various format files such as corresponding eXtensible Markup Language (XML), text File (txt) and the like according to the reported data File specification, reports the files to directory paths such as File Transfer Protocol (FTP) servers and the like specified by both sides, and then operation and maintenance personnel periodically acquire the files from the servers and analyze the corresponding files to acquire resource data.
The above-mentioned methods (1) and (2) generally occupy a large amount of resources of the operating server, and are limited by conditions such as a memory of the server and a Central Processing Unit (CPU), and when the data size is too large, a large amount of resources such as the memory are easily consumed due to careless Processing, which causes a jam phenomenon, and are not suitable for an application scenario with a large data size.
In the above mode (3), a logical channel is established between two parties needing message transmission, and message sending is implemented by the message middleware. The message middleware can support a synchronous mode and an asynchronous mode, is a point-to-point mechanism in fact, and therefore can be well suitable for an object-oriented programming mode. However, when the data concurrency is too large, there is a performance bottleneck, which may result in message loss, and is also limited by the stability of the network environment.
The above-described method (4) is related to a network environment, and may cause a packet loss when the data amount is too large and the network is unstable, and is generally performed in terms of the supportability of data security.
The mode (5) has the defects that the file format has no unified standard and the standard is poor; and the file system authority needs to be opened, and the safety is poor. In addition, when the data volume is too large, it takes time to generate, upload and analyze the data file, and the method has low practicability.
It can be known from the above analysis that, when the amount of data is too large in a large cloud platform, in order to solve the limitation caused by the adoption of a single data reporting mode in the implementation modes listed in the prior art, the embodiment of the present invention provides a method for distinguishing data reporting modes based on resource application heat statistics in a cloud platform, which can distinguish records according to the application heat statistics of different resource data of a user, correspondingly adapt to different reporting modes, and is essentially a multi-mode adapter mode. The data reporting method in the embodiment of the invention not only solves the limitation caused by reporting data in a single mode, but also selects the most suitable data reporting mode according to the actual situation, thereby achieving the effects of diversity, adaptability and flexibility of the reporting modes.
Referring to fig. 1, which is an architecture diagram of the Data reporting method according to the embodiment of the present invention, after a resource application heat timing statistical program is started, a cloud platform may report resource Data to an operation and maintenance system by using different Data reporting modes, such as an ActiveMQ reporting mode for virtual machine resource Data adaptation shown in fig. 1, an FTP reporting mode for storage resource Data adaptation shown in fig. 1, or a VPC resource Data adaptation interface reporting mode, according to a resource heat value of each application resource in a database (Data Base, DB).
Before reporting the resource data, the cloud platform side may perform overall statistics on the application resources, and distinguish the application cold and hot degrees of the various application resources according to the actual usage amounts of the various application resources, where the application resources with higher application hot degrees may have larger corresponding resource data amounts, and the application resources with lower application hot degrees may have smaller corresponding resource data amounts.
Then, different data reporting modes are respectively adopted to report the resource data according to the application heat of various application resources, and the operation and maintenance system can also adapt to the corresponding modes of receiving and analyzing the resource data, namely, a plurality of flexible adaptive modes of reporting-analyzing are adopted, so that the single realization that all the resource data adopt the same data reporting mode is avoided, and the problems of large data volume and large concurrency which are possibly brought by the report that all the resource data are superposed in one data reporting mode are also avoided.
Preferred embodiments of the present invention will be described in detail below with reference to the accompanying drawings.
Referring to fig. 2, an embodiment of the present invention provides a data reporting method, which can be applied to various cloud platforms, including a public cloud, a private cloud, a government cloud, an enterprise cloud, and the like. The implementation process of the method can be described as follows:
S201: counting the actual usage amount of each type of application resource in at least one type of application resource of the cloud platform;
s202: determining a resource heat value of each type of application resource based on the actual usage amount of each type of application resource;
s203: and determining a first data reporting mode of the resource data of the first application resource based on the preset corresponding relation between the resource heat value and the data reporting mode, and reporting the resource data of the first type of application resource in the first data reporting mode.
In S201, the cloud platform may count, in real time or at regular time, actual usage amounts of various types of application resources in at least one type of application resources, for example, the actual usage amount of the type a application resource is 10 ten thousand, the actual usage amount of the type B application resource is 8 ten thousand, and the like.
In a possible implementation manner, in order to enable a maintainer at the operation and maintenance system side to know the use conditions of various application resources in more detail and intuitively, the cloud platform may have a program for scanning resource data of various application resources at regular time, such as 12 hours or one day.
Assuming that the resource data are reported once a day by an agreement between the cloud platform and the operation and maintenance system, the cloud platform may periodically start a timing task at a certain moment before reporting each day, then scan resource data tables of various types of resource data in a resource database of the cloud platform, and count the data amount of the resource data of each type of application resource in at least one type of application resource.
Specifically, referring to fig. 3, after the system is started, the cloud platform may start a scanning program at regular time, scan the resource data table in the database, and then write the mapping relationship between the resource heat value and the data reporting mode into the configuration file according to the scanning result returned by the database, or record the mapping relationship between the resource heat value and the application resource into the resource database.
The method for scanning the resource data table in the resource database by the cloud platform can be performed in, but is not limited to, the following two ways:
in a first manner, if at least one Type of Resource data is stored in the same Resource data table, the Resource data table may be scanned by using a Resource identifier (RT) of each Type of Resource data as a distinguishing parameter, so as to count the data amount of each Type of Resource data in the at least one Type of Resource data corresponding to the at least one Type of application Resource, where the Resource identifier may be an application Resource feature of each Type of Resource data, or may be set by a user of the cloud platform in a user-defined manner.
And secondly, if at least one type of resource data is stored in a sub-table mode, namely, each type of resource data is stored by adopting a respective resource data table, the cloud platform can scan the resource data tables in a multi-thread parallel scanning mode. For example, the resource data table 1 stores a type a resource data, the resource data table 2 stores a type B resource data, and the resource data table 3 stores a type C resource data, at this time, the cloud platform may perform parallel scanning on the resource data table 1, the resource data table 2, and the resource data table 3 at the same time, so as to count the data amount of each type of resource data in at least one type of resource data corresponding to at least one type of application resource.
It should be noted that, in addition to the two manners, the cloud platform may also adopt other manners, or the two manners may be combined to scan various resource data tables in the resource database, which is not limited in the embodiment of the present invention.
After the data amount of each type of resource data is counted, the actual usage amount of each type of application resource can be determined according to a functional relationship, such as a direct ratio relationship or an accumulation relationship, between the data amount of each type of resource data and the usage amount of the corresponding application resource. For example, if the functional relationship between the two is a direct ratio, a certain multiple is formed between the amount of each type of resource data and the usage amount of the corresponding application resource; or, if the function relationship between the two is accumulation relationship, the actual usage amount of each type of application resource may be equal to the sum of the data amounts of various data in the corresponding resource data; and so on.
That is to say, the actual usage amount of each type of application resource can be represented by the data amount of the corresponding resource data, so that the actual usage condition of each type of application resource can be more intuitively reflected, and data assurance is provided for the operation and maintenance personnel at the operation and maintenance system side to analyze and operate and maintain the cloud platform.
After the cloud platform counts the actual usage amount of each type of application resource, S202 may be executed, that is, the resource heat value of each type of application resource may be determined according to the actual usage amount of each type of application resource.
Specifically, the statistical data amount of each type of resource data and the actual usage amount of each type of application resource may be recorded in a newly created resource heat value recording table, where the resource heat value recording table may include parameters such as a resource identifier and a date of the day of scanning, and subsequently, the resource heat value of each type of application resource may be recorded in the resource heat value recording table.
Then, a corresponding relationship between the preset interval and the preset resource heat value may be set, that is, one preset interval corresponds to one preset resource heat value. For example, when the preset interval of the application resource is (15, 20) (unit: ten thousand, the same hereafter), the resource heat value is defined as hot _ top1, when the preset interval of the application resource is (10, 15), the resource heat value is defined as hot _ top2, when the preset interval of the application resource is (5, 10), the resource heat value is defined as hot _ top3, when the preset interval of the application resource is (1, 5), the resource heat value is defined as hot _ top4, and so on.
In practical application, the resource heat value may be defined as a group of distinguishable application resource heat according to the type of the data reporting mode, and may represent a heat enumeration value or a character string in the meaning of the practical application amount, each heat enumeration value or character string may specifically correspond to an interval of the practical usage amount of the application resource, and when the preset interval of the application resource is (15, 20), the resource heat value is defined as hot _ top1, etc.
And further, the actual usage amount of each type of application resource can be matched with at least one preset interval, and if the actual usage amount of the first application resource is in the first preset interval, the resource heat value of the first application resource is determined to be the preset resource heat value of the first preset interval, and the first preset interval is any one of the at least one preset interval.
For example, assuming that the statistical actual usage amount of the class a application resources is 10 ten thousand, the statistical actual usage amount of the class B application resources is 8 ten thousand, and the statistical actual usage amount of the class C application resources is 3 ten thousand, it can be seen from the above example that the resource heat value of the class a application resources is hot _ top3, the resource heat value of the class B application resources is hot _ top3, and the resource heat value of the class C application resources is hot _ top 4.
After determining the resource heat value of each type of application resource, S203 may be executed, that is, based on the preset corresponding relationship between the resource heat value and the data reporting mode, a first data reporting mode of the resource data of the first type of application resource is determined, and the resource data of the first type of application resource is reported in the first data reporting mode.
Specifically, referring to fig. 4, the cloud platform may negotiate with the operation and maintenance system about which data reporting modes are used in advance, and then according to a negotiation result, the cloud platform side may program and develop a multi-mode adaptation reporting program, and the operation and maintenance system may correspondingly implement a multi-mode adaptation data analysis program.
After the system is started, the cloud platform can construct and start a resource data reporting timing program, the resource heat values of various application resources are called from the database, the code adaptation selection data reporting mode is realized in the program according to the mapping relation among the resource heat values, the resource heat values and the data reporting mode, the cloud platform can write the data reporting mode adaptation selection program and the reporting programs into a timing task, and the program is executed at regular time every day to perform the adaptation reporting of various resource data.
The method has the advantages that the specific size of various resource data is large, the adapter which is matched with a plurality of data reporting modes needs to be made, the flexible design and implementation can be realized according to the practical situation and the statistics of the resource application heat of application resources, the service of cloud platform data reporting can be met, the flexibility and the selectivity are greatly increased, as long as the expansibility of system design is good enough, the adapter can be made to be fully automatically matched according to the resource application heat and the addition of the extensible data reporting modes can bring great convenience to the cloud platform side for the subsequent reporting of various resource data.
The data reporting mode may include at least one of a virtual machine resource data adaptation ActiveMQ reporting mode, a storage resource data adaptation File Transfer Protocol (FTP) reporting mode, a VPC resource data adaptation interface reporting mode, an SNMP push mode reporting mode, and a REST interface mode reporting mode, and certainly, the data reporting mode is not limited to the above listed ones, and the following may be extended according to actual conditions.
Then, the resource heat values and the data reporting modes can be mapped in an associated manner to establish a preset corresponding relationship, and the data reporting mode matched with each resource heat value can be configured in a configuration file, or the preset corresponding relationship can be stored in a resource database.
For example, the preset corresponding relationship between the resource heat value and the data reporting mode may include that when the resource heat value is hot _ top1, the corresponding data reporting mode is ActiveMQ message queue transmission reporting; when the heat value of the resource is hot _ top2, the corresponding data reporting mode is FTP file format reporting; when the resource heat value is hot _ top3, reporting the corresponding data in an SNMP (simple network management protocol) pushing mode; when the resource heat value is hot _ top4, reporting the corresponding data in an REST interface mode; and so on.
Further, the data reporting mode of the resource data of various application resources can be determined according to the preset corresponding relationship between the resource heat value and the data reporting mode, for example, the resource heat value of the a-type application resource is hot _ top3, and the corresponding data reporting mode is reported in an SNMP push mode; the resource heat value of the B-type application resource is hot _ top3, and the corresponding data reporting mode is an SNMP pushing mode; the resource heat value of the C-type application resource is hot _ top4, and the corresponding data reporting mode is reported in an REST interface mode; and so on.
In summary, in the prior art, most cloud platform data reporting systems adopt a single reporting mode, data types are not distinguished, and a method is adopted for reporting in a unified superposition mode, which may cause performance bottlenecks or problems of waste of server resources, poor expansibility and the like.
In order to solve the problems in the prior art, in the embodiment of the invention, different data reporting modes can be adopted to report the resource data of various application resources according to the application cold and hot degrees of various application resources according to the actual service development experience and the existing industry mode, so that the limitation of a single data reporting mode is solved, the data reporting modes are more diversified and flexibly applied to a cloud platform data reporting system, and the cloud platform data reporting system has excellent expansibility.
Based on the same inventive concept, referring to fig. 5, an embodiment of the present invention provides a cloud platform, including:
the statistical module 51 is configured to count an actual usage amount of each type of application resource in at least one type of application resource of the cloud platform;
a determining module 52, configured to determine a resource heat value of each type of application resource based on the actual usage amount of each type of application resource;
a reporting module 53, configured to determine a first data reporting manner of resource data of a first application resource based on a preset corresponding relationship between a resource heat value and a data reporting manner, and report the resource data of the first type of application resource in the first data reporting manner, where the first application resource is any type of application resource in the at least one type of application resource, and each type of resource data is data generated when a user uses a corresponding application resource.
In a possible implementation manner, the statistical module 51 is configured to:
scanning a resource data table in a resource database of the cloud platform, and counting the data volume of each type of resource data in at least one type of resource data corresponding to the at least one type of application resource;
and determining the actual usage amount of each type of application resource based on the functional relation between the data amount of each type of resource data and the usage amount of the corresponding application resource.
In one possible implementation, the statistical module 51 is configured to:
if the at least one type of resource data is stored in the same resource data table, scanning the resource data table by taking the resource identifier of each type of resource data as a distinguishing parameter; or the like, or, alternatively,
and if the at least one type of resource data is stored in the sub-tables, multithreading parallel scanning is carried out on the resource data tables.
In one possible implementation, the determining module 52 is configured to:
matching the actual usage amount of each type of application resource with at least one preset interval, wherein one preset interval corresponds to one preset resource heat value;
and if the actual usage amount of the first application resource is in a first preset interval, determining that the resource heat value of the first application resource is a preset resource heat value of the first preset interval, wherein the first preset interval is any one preset interval in the at least one preset interval.
In one possible implementation manner, the method further includes:
the configuration module is used for configuring the data reporting mode matched with each resource heat value in a configuration file; or the like, or, alternatively,
and storing the preset corresponding relation into a resource database.
Based on the same inventive concept, please refer to fig. 6, an embodiment of the present invention provides a computer apparatus, which includes at least one processor 61, and a memory 62 and a communication interface 63 communicatively connected to the at least one processor 61, wherein fig. 6 illustrates one processor 61 as an example.
Wherein the memory 62 stores instructions executable by the at least one processor 61, and the at least one processor 61 performs the method as described in the above embodiments using the communication interface 63 by executing the instructions stored by the memory 62.
Based on the same inventive concept, embodiments of the present invention provide a computer-readable storage medium storing computer instructions that, when executed on a computer, cause the computer to perform the method as described in the above embodiments.
In particular implementations, the computer-readable storage medium includes: various storage media capable of storing program codes, such as a Universal Serial Bus flash drive (USB), a removable hard disk, a Read-Only Memory (ROM), a Random Access Memory (RAM), a magnetic disk, and an optical disk.
The above-described embodiments of the apparatus are merely illustrative, wherein units/modules illustrated as separate components may or may not be physically separate, and components shown as units/modules may or may not be physical units/modules, may be located in one place, or may be distributed over a plurality of network units/modules. Some or all of the modules may be selected according to actual needs to achieve the purpose of the solution of the present embodiment. One of ordinary skill in the art can understand and implement it without inventive effort.
Through the above description of the embodiments, those skilled in the art will clearly understand that each embodiment may be implemented by software plus a necessary general hardware platform, and may also be implemented by hardware. With this understanding in mind, the above-described technical solutions may be embodied in the form of a software product, which can be stored in a computer-readable storage medium such as ROM/RAM, magnetic disk, optical disk, etc., and includes instructions for causing a computer device (which may be a personal computer, a server, or a network device, etc.) to execute the methods described in the embodiments or some parts of the embodiments.
Finally, it should be noted that: the above examples are only intended to illustrate the technical solution of the present invention, but not to limit it; although the present invention has been described in detail with reference to the foregoing embodiments, it will be understood by those of ordinary skill in the art that: the technical solutions described in the foregoing embodiments may still be modified, or some technical features may be equivalently replaced; and such modifications or substitutions do not depart from the spirit and scope of the corresponding technical solutions of the embodiments of the present invention.
Claims (10)
1. A data reporting method is characterized by comprising the following steps:
counting the actual usage amount of each type of application resource in at least one type of application resource of the cloud platform;
determining a resource heat value of each type of application resource based on the actual usage amount of each type of application resource; wherein the determining a resource heat value of each type of application resource based on the actual usage of each type of application resource comprises: matching the actual usage amount of each type of application resource with at least one preset interval, wherein one preset interval corresponds to one preset resource heat value; if the actual usage amount of the first application resource is in a first preset interval, determining that the resource heat value of the first application resource is a preset resource heat value of the first preset interval, wherein the first preset interval is any one preset interval in the at least one preset interval;
determining a first data reporting mode of resource data of a first application resource based on a preset corresponding relation between a resource heat value and the data reporting mode, and reporting the resource data of the first type of application resource in the first data reporting mode, wherein the first application resource is any one type of application resource in at least one type of application resource, and each type of resource data is data generated when a user uses a corresponding application resource.
2. The method of claim 1, wherein counting the actual usage of each of the at least one class of application resources of the cloud platform comprises:
scanning a resource data table in a resource database of the cloud platform, and counting the data volume of each type of resource data in at least one type of resource data corresponding to the at least one type of application resource;
and determining the actual usage amount of each type of application resource based on the functional relation between the data amount of each type of resource data and the usage amount of the corresponding application resource.
3. The method of claim 2, wherein the scanning resource data tables in a resource database of the cloud platform comprises:
if the at least one type of resource data is stored in the same resource data table, scanning the resource data table by taking the resource identifier of each type of resource data as a distinguishing parameter; or the like, or, alternatively,
and if the at least one type of resource data is stored in the sub-tables, multithreading parallel scanning is carried out on the resource data tables.
4. The method of any one of claims 1-3, further comprising:
configuring the data reporting mode matched with each resource heat value in a configuration file; or the like, or, alternatively,
and storing the preset corresponding relation into a resource database.
5. A cloud platform, comprising:
the statistical module is used for counting the actual usage amount of each type of application resource in at least one type of application resource of the cloud platform;
the determining module is used for determining a resource heat value of each type of application resource based on the actual usage amount of each type of application resource; wherein the determining a resource heat value of each type of application resource based on the actual usage of each type of application resource comprises: matching the actual usage amount of each type of application resource with at least one preset interval, wherein one preset interval corresponds to one preset resource heat value; if the actual usage amount of the first application resource is in a first preset interval, determining that the resource heat value of the first application resource is a preset resource heat value of the first preset interval, wherein the first preset interval is any one preset interval in the at least one preset interval;
a reporting module, configured to determine a first data reporting manner of resource data of a first application resource based on a preset corresponding relationship between a resource heat value and a data reporting manner, and report the resource data of the first type of application resource in the first data reporting manner, where the first application resource is any type of application resource in the at least one type of application resource, and each type of resource data is data generated when a user uses a corresponding application resource.
6. The cloud platform of claim 5, wherein said statistics module is to:
scanning a resource data table in a resource database of the cloud platform, and counting the data volume of each type of resource data in at least one type of resource data corresponding to the at least one type of application resource;
and determining the actual usage amount of each type of application resource based on the functional relationship between the data amount of each type of resource data and the usage amount of the corresponding application resource.
7. The cloud platform of claim 6, wherein said statistics module is to:
if the at least one type of resource data is stored in the same resource data table, scanning the resource data table by taking the resource identifier of each type of resource data as a distinguishing parameter; or the like, or a combination thereof,
and if the at least one type of resource data is stored in the sub-tables, multithreading parallel scanning is carried out on the resource data tables.
8. The cloud platform of any of claims 5-7, further comprising:
the configuration module is used for configuring the data reporting mode matched with each resource heat value in a configuration file; or the like, or a combination thereof,
and storing the preset corresponding relation into a resource database.
9. A computer device, the computer device comprising:
At least one processor, and
a memory communicatively coupled to the at least one processor, a communication interface;
wherein the memory stores instructions executable by the at least one processor, the at least one processor performing the method of any one of claims 1-4 with the communications interface by executing the instructions stored by the memory.
10. A computer-readable storage medium having stored thereon computer instructions which, when executed on a computer, cause the computer to perform the method of any one of claims 1-4.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810185457.2A CN110233747B (en) | 2018-03-06 | 2018-03-06 | Data reporting method and cloud platform |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810185457.2A CN110233747B (en) | 2018-03-06 | 2018-03-06 | Data reporting method and cloud platform |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN110233747A CN110233747A (en) | 2019-09-13 |
| CN110233747B true CN110233747B (en) | 2022-06-14 |
Family
ID=67861857
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201810185457.2A Active CN110233747B (en) | 2018-03-06 | 2018-03-06 | Data reporting method and cloud platform |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN110233747B (en) |
Families Citing this family (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112131180B (en) * | 2020-09-25 | 2024-02-06 | 京东科技控股股份有限公司 | Data reporting method, device and storage medium |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101990043A (en) * | 2009-08-06 | 2011-03-23 | 中兴通讯股份有限公司 | Method and system of allocating Voice over Internet Protocol business semi-static scheduling resource |
| WO2014168408A1 (en) * | 2013-04-11 | 2014-10-16 | 주식회사 안랩 | Device, system and method for diagnosing malware on basis of cloud |
| CN104125286A (en) * | 2014-08-03 | 2014-10-29 | 浙江网新恒天软件有限公司 | Smart cloud management system based on cloud computing for enterprise infrastructure |
| CN105516200A (en) * | 2016-01-19 | 2016-04-20 | 中国联合网络通信集团有限公司 | Cloud system security processing method and device |
| CN105656686A (en) * | 2016-02-29 | 2016-06-08 | 中国人民解放军国防信息学院 | Self-adaptive equipment management adaptation method |
| CN106126347A (en) * | 2016-08-17 | 2016-11-16 | 浪潮电子信息产业股份有限公司 | A kind of method effectively realizing mainframe cluster scheduling of resource under cloud platform |
Family Cites Families (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104683400A (en) * | 2013-11-29 | 2015-06-03 | 英业达科技有限公司 | Cloud system and cloud resource configuration method |
-
2018
- 2018-03-06 CN CN201810185457.2A patent/CN110233747B/en active Active
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101990043A (en) * | 2009-08-06 | 2011-03-23 | 中兴通讯股份有限公司 | Method and system of allocating Voice over Internet Protocol business semi-static scheduling resource |
| WO2014168408A1 (en) * | 2013-04-11 | 2014-10-16 | 주식회사 안랩 | Device, system and method for diagnosing malware on basis of cloud |
| CN104125286A (en) * | 2014-08-03 | 2014-10-29 | 浙江网新恒天软件有限公司 | Smart cloud management system based on cloud computing for enterprise infrastructure |
| CN105516200A (en) * | 2016-01-19 | 2016-04-20 | 中国联合网络通信集团有限公司 | Cloud system security processing method and device |
| CN105656686A (en) * | 2016-02-29 | 2016-06-08 | 中国人民解放军国防信息学院 | Self-adaptive equipment management adaptation method |
| CN106126347A (en) * | 2016-08-17 | 2016-11-16 | 浪潮电子信息产业股份有限公司 | A kind of method effectively realizing mainframe cluster scheduling of resource under cloud platform |
Non-Patent Citations (2)
| Title |
|---|
| "PaaS云平台自动化部署和监控的设计与实现";孙健波;《中国优秀硕士学位论文全文数据库 信息科技辑》;20160715;全文 * |
| "基于Docker的资源调度及应用容器集群管理系统设计与实现";边俊峰;《中国优秀硕士学位论文全文数据库 信息科技辑》;20170915;全文 * |
Also Published As
| Publication number | Publication date |
|---|---|
| CN110233747A (en) | 2019-09-13 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US11372669B2 (en) | System and method of cross-silo discovery and mapping of storage, hypervisors and other network objects | |
| US8014294B2 (en) | System, apparatus and method for devices tracing | |
| US6108309A (en) | SONET network element simulator | |
| US9172593B2 (en) | System and method for identifying problems on a network | |
| US20120297059A1 (en) | Automated creation of monitoring configuration templates for cloud server images | |
| US20100030785A1 (en) | Distributed capture and aggregation of dynamic application usage information | |
| CN107294808A (en) | The methods, devices and systems of interface testing | |
| WO2010072081A1 (en) | Method and system for realizing massive terminals access of a streaming media server | |
| CN108228322B (en) | Distributed link tracking and analyzing method, server and global scheduler | |
| CN111984561B (en) | IPMI command processing method, system, device and medium for BMC | |
| CN107181821A (en) | A kind of information push method and device based on SSE specifications | |
| CN110162512A (en) | A kind of log searching method, apparatus and storage medium | |
| CN112286774A (en) | Operation and maintenance monitoring data display method and device, storage medium and computing equipment | |
| CN110912751A (en) | Network equipment topological graph generation method and related device | |
| CN112073923A (en) | Communication method, device, gateway and readable storage medium compatible with multiple operators | |
| CN110233747B (en) | Data reporting method and cloud platform | |
| CN110362993A (en) | Malicious process recognition methods, terminal, server, system and storage medium | |
| US9356826B2 (en) | Connecting network management systems | |
| CN110611576B (en) | Data quality monitoring method, device, equipment and storage medium | |
| CN110740151A (en) | micro-service adjusting method, device, server and computer storage medium | |
| CN112671822B (en) | Service request processing method, device, storage medium, server and system | |
| KR100251379B1 (en) | Method for optimizing event report of telecommunication management network in switching system | |
| US20060075025A1 (en) | System and method for data tracking and management | |
| CN116126890A (en) | Positioning method and device of abnormal SQL statement, electronic equipment and storage medium | |
| CN116088853A (en) | Data processing method and device, electronic equipment and storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |