CN110233747A - A kind of data reporting method and cloud platform - Google Patents
A kind of data reporting method and cloud platform Download PDFInfo
- Publication number
- CN110233747A CN110233747A CN201810185457.2A CN201810185457A CN110233747A CN 110233747 A CN110233747 A CN 110233747A CN 201810185457 A CN201810185457 A CN 201810185457A CN 110233747 A CN110233747 A CN 110233747A
- Authority
- CN
- China
- Prior art keywords
- resource
- data
- class
- application
- application resource
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/22—Indexing; Data structures therefor; Storage structures
- G06F16/2282—Tablespace storage structures; Management thereof
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L41/00—Arrangements for maintenance, administration or management of data switching networks, e.g. of packet switching networks
- H04L41/02—Standardisation; Integration
- H04L41/0213—Standardised network management protocols, e.g. simple network management protocol [SNMP]
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L41/00—Arrangements for maintenance, administration or management of data switching networks, e.g. of packet switching networks
- H04L41/06—Management of faults, events, alarms or notifications
- H04L41/0631—Management of faults, events, alarms or notifications using root cause analysis; using analysis of correlation between notifications, alarms or events based on decision criteria, e.g. hierarchy, tree or time analysis
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L43/00—Arrangements for monitoring or testing data switching networks
- H04L43/08—Monitoring or testing based on specific metrics, e.g. QoS, energy consumption or environmental parameters
- H04L43/0876—Network utilisation, e.g. volume of load or congestion level
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/06—Protocols specially adapted for file transfer, e.g. file transfer protocol [FTP]
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/2866—Architectures; Arrangements
- H04L67/30—Profiles
Landscapes
- Engineering & Computer Science (AREA)
- Computer Networks & Wireless Communication (AREA)
- Signal Processing (AREA)
- Theoretical Computer Science (AREA)
- Environmental & Geological Engineering (AREA)
- Software Systems (AREA)
- Data Mining & Analysis (AREA)
- Databases & Information Systems (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Debugging And Monitoring (AREA)
Abstract
The embodiment of the present invention provides a kind of data reporting method and cloud platform, the single technical problem of resource data report method to solve platform side in the prior art, the actual use amount of every class application resource at least a kind of application resource of cloud platform statistics, then according to the actual use amount of every class application resource, determine the resource hot value of every class application resource, and then the default corresponding relationship based on resource hot value and data reporting schemes, determine the first data reporting schemes of the resource data of the first application resource, and the resource data of first kind application resource is reported with the first data reporting schemes.
Description
Technical field
The present invention relates to field of computer technology more particularly to a kind of data reporting method and cloud platforms.
Background technique
Now with the fast development of cloud computing technology, the whole world is related to the related industry of cloud computing and is also being born therewith and not
Disconnected development, both at home and abroad in various cloud platforms, including public cloud, private clound, government affairs cloud, enterprise's cloud etc. also establish and develop therewith
Get up.It is provided in cloud platform including virtual machine, virtual private cloud (Virtual Private Cloud, VPC) network, virtual
Various application resources including storage etc. easily carry out choosing use for user, and user is all kinds of in using cloud platform answers
With can generate some class virtual resource data when resource, and these class virtual resource data are analyzed and are transported for operation maintenance personnel
Dimension processing, so that operation maintenance personnel tracks and handles the problem related to types of applications resource from user.
For how the resource data that the user of cloud platform side uses operational system is reported to, industry has proposed more at present
Kind implementation mainly reports resource data, operational system actively to operational system by active calling interface including platform side
Calling interface obtains resource data from platform side, platform side passes through the message-oriented middlewares such as kafka, ActiveMQ on operational system
Report resource data, platform side by Simple Network Management Protocol (Simple Network Management Protocol,
SNMP it) alerts to operational system push resource data or platform side and resource data etc. is reported to operational system with file mode
Deng.
However, no matter platform side uses above-mentioned which kind of implementation enumerated to carry out reporting for resource data, it is by institute
There is the resource data of type to be added to carry out on same data reporting schemes, which results in platform sides to report resource
There is a problem of that data volume is big, concurrency is big during data.
In summary, the resource data report method of platform side is single in the prior art.
Summary of the invention
The embodiment of the present invention provides a kind of data reporting method and cloud platform, to solve platform side in the prior art
The single technical problem of resource data report method.
In a first aspect, the embodiment of the present invention provides a kind of data reporting method, at least a kind of application resource of cloud platform statistics
In the actual use amount of every class application resource determine every class application then according to the actual use amount of every class application resource
The resource hot value of resource, and then the default corresponding relationship based on resource hot value and data reporting schemes, determine the first application
First data reporting schemes of the resource data of resource, and report with the first data reporting schemes the resource of first kind application resource
Data, i.e., according to the resource hot value of different application resource, corresponding adaptation uses different data reporting schemes, solves existing
Single data reporting schemes report limitation brought by resource data in technology, and select the number being most adapted to according to the actual situation
According to reporting schemes, data reporting schemes diversity, suitability and flexibility are achieved the effect that.
In one possible implementation, the reality of every class application resource at least a kind of application resource of cloud platform is counted
When the usage amount of border, the resource data table in the resource database of cloud platform can be scanned, at least a kind of application resource of statistics is corresponding
At least a kind of resource data in every class resource data data volume；Data volume and respective application based on every class resource data provide
The functional relation of the usage amount in source determines the actual use amount of every class application resource.
That is, the actual use amount of every class application resource can be embodied by the data volume of corresponding resource data, such as
This, more can intuitively reflect the actual use situation of types of applications resource, be that the operation maintenance personnel of operational system side is flat to cloud
Platform carries out analysis and O&M processing provides data and guarantees.
In one possible implementation, the resource data table packet in the resource database of the scanning cloud platform
Include: if at least a kind of resource data store is in same resource data table, the resource identification with every class resource data is
Differentiation parameter scans the resource data table；Or, multi-threaded parallel is swept if at least a kind of resource data divides table to store
Retouch the resource data table.
Can according to the storage condition of at least a kind of resource data, using different scanning modes to resource data table into
Row scanning, improves the accuracy of scanning resource data table.
In one possible implementation, the actual use amount based on every class application resource, determines every class
The resource hot value of application resource, comprising: by the actual use amount of every class application resource and at least one pre-set interval into
Row matching, wherein the corresponding default resource hot value of a pre-set interval；If the actual use amount of first application resource
Positioned at the first pre-set interval, it is determined that the resource hot value of first application resource is the default resource heat of the first pre-set interval
Angle value, first pre-set interval are any one pre-set interval at least one described pre-set interval.
In one possible implementation, further includes:
Each matched data reporting schemes of resource hot value are configured in configuration file；Or,
The default corresponding relationship is stored in resource database.
Second aspect, the embodiment of the present invention provide a kind of cloud platform, comprising:
Statistical module, the actual use amount of every class application resource at least a kind of application resource for counting cloud platform；
Determining module determines every class application resource for the actual use amount based on every class application resource
Resource hot value；
Reporting module determines the first application for the default corresponding relationship based on resource hot value and data reporting schemes
First data reporting schemes of the resource data of resource, and the first kind application money is reported with the first data reporting schemes
The resource data in source, wherein first application resource is any sort application resource at least a kind of application resource, often
Class resource data is generated data when user uses corresponding application resource.
In one possible implementation, the statistical module is used for:
The resource data table in the resource database of the cloud platform is scanned, statistics at least a kind of application resource is corresponding
At least a kind of resource data in every class resource data data volume；
The functional relation of the usage amount of data volume based on every class resource data and respective application resource, determine described in
The actual use amount of every class application resource.
In one possible implementation, the statistical module is used for:
If at least a kind of resource data store is in same resource data table, with the resource mark of every class resource data
Knowing is differentiation parameter, scans the resource data table；Or,
If at least a kind of resource data divides table to store, multi-threaded parallel scans the resource data table.
In one possible implementation, the determining module is used for:
The actual use amount of every class application resource is matched at least one pre-set interval, wherein one pre-
If section corresponds to a default resource hot value；
If the actual use amount of first application resource is located at the first pre-set interval, it is determined that first application resource
Resource hot value be the first pre-set interval default resource hot value, first pre-set interval is that described at least one is default
Any one pre-set interval in section.
In one possible implementation, further includes:
Configuration module, for each matched data reporting schemes of resource hot value to be configured in configuration file；
Or,
The default corresponding relationship is stored in resource database.
The third aspect, the embodiment of the present invention provide a kind of computer installation, and the computer installation includes:
At least one processor, and
The memory that is connect at least one described processor communication, communication interface；
Wherein, the memory is stored with the instruction that can be executed by least one described processor, described at least one
The instruction that device is stored by executing the memory is managed, the method for communication interface execution as described in relation to the first aspect is utilized.
Fourth aspect, the embodiment of the present invention provide a kind of computer readable storage medium, the computer-readable storage medium
Matter is stored with computer instruction, when the computer instruction is run on computers, so that computer executes such as first aspect
The method.
Detailed description of the invention
In order to illustrate the technical solution of the embodiments of the present invention more clearly, will make below to required in the embodiment of the present invention
Attached drawing is briefly described, it should be apparent that, attached drawing described below is only some embodiments of the present invention, for
For those of ordinary skill in the art, without creative efforts, it can also be obtained according to these attached drawings other
Attached drawing.
Fig. 1 is the architecture diagram of data reporting method in the embodiment of the present invention；
Fig. 2 is the flow diagram of data reporting method in the embodiment of the present invention；
Fig. 3 is the scanning process schematic diagram of resource data table in the embodiment of the present invention；
Fig. 4 reports implementation flow chart according to what reporting schemes were adapted to for majority in the embodiment of the present invention；
Fig. 5 is the module diagram of cloud platform in the embodiment of the present invention；
Fig. 6 is the module diagram of computer installation in the embodiment of the present invention.
Specific embodiment
In order to keep the purposes, technical schemes and advantages of the embodiment of the present invention clearer, implement below in conjunction with the present invention
Attached drawing in example, technical scheme in the embodiment of the invention is clearly and completely described.
Firstly, resource data to be reported to the several frequently seen implementation introduction of operational system to cloud platform in the prior art
It is as follows:
(1) platform side reports resource data to operational system by active calling interface: it is less and real to be suitable for data volume
The more demanding scene of when property, mainly operational system and platform side reciprocally negotiate report which data, when report,
What the data format reported is, and how the interface format used defines etc., and above-mentioned ask will be finally agreed upon to both sides
After topic, (Representational State Transfer, REST) or web can be transmitted by declarative state
Service interface method of calling is reported.
(2) operational system active calling interface obtains resource data from platform side: essence in the program and (1) implementation
Upper almost the same, difference is only that called side and called side exchange identity.
(3) platform side reports resource data to operational system by message-oriented middlewares such as kafka, ActiveMQ: being suitable for
The scene not high to requirement of real-time, the data that platform side will can be reported within a specified time are sent to by message pipeline to be connect
Debit, recipient receive data validation it is errorless after, provide response.
(4) platform side is alerted by SNMP to operational system propelling data: a kind of side using network protocol transmission data
Formula, data are mainly transmitted with message format by network, are generally commonly applied in the management systems such as monitoring O&M alarm.
(5) platform side reports resource data to operational system with file mode: being assisted by platform side and operational system both sides
File format and specification are set, platform side generates corresponding expansible identifiable language by the data file specification reported
All kinds of formatted files such as (eXtensible Markup Language, XML), text file (txt), are reported to both sides to specify
Under the directory paths such as File Transfer Protocol (File Transfer Protocol, FTP) server, then extremely by operation maintenance personnel timing
Server, which obtains file and parses corresponding document, obtains resource data.
Aforesaid way (1) and (2), general occupancy runtime server resource is larger, and is limited to the memory of server, center
The conditions such as processor (Central Processing Unit, CPU) limitation, when data volume is excessive, if processing easily disappears accidentally
The resources such as a large amount of memories are consumed, card machine phenomenon is caused, are not suitable for the big application scenarios of data volume.
Aforesaid way (3), establishes logical channel between two sides for needing to carry out message transmission, is realized by message-oriented middleware
Message is sent.Message-oriented middleware can support the method for synchronization and asynchronous system, actually a kind of mechanism of point-to-point, thus can
To be suitable for the programming mode of object-oriented well.But when Data Concurrent amount it is excessive, have performance bottleneck, may result in
In addition information drop-out is also limited by the stability of network environment.
Aforesaid way (4), it is related with network environment, it will lead to losing for data packet when data volume is excessive and unstable networks
It loses, it is in addition general in the supportive aspect performance of data safety.
Aforesaid way (5), existing deficiency are that file format is not sought unity of standard, and standard is poor；And it needs to open
File system permission, safety are poor.In addition, can compare when data volume is excessive in generation, upload and parsing data file
Time-consuming, then this method practicability is low.
The above analysis is it is found that in large-scale cloud platform when data volume is excessive, to solve above-mentioned column in the prior art
In the implementation of act, it is all made of single data reporting schemes bring limitation, the embodiment of the present invention proposes a kind of cloud platform
In based on resource application hot statistics distinguish data reporting schemes method, can according to user's different resource data application heat
Statistical Area member record is spent, it is substantially a kind of multimode mode adapter that corresponding adaptation, which uses different reporting schemes,.The present invention
Data reporting method in embodiment not only solves single mode reported data bring limitation, while according to the actual situation
The data reporting schemes being most adapted to are selected, have achieved the effect that reporting schemes diversity, suitability and flexibility.
It referring to Figure 1, is the architecture diagram of the data reporting method of the embodiment of the present invention, in starting resource application temperature timing
After statistics program, cloud platform can be used according to the resource hot value of each application resource in database (Data Base, DB)
Different data reporting schemes, void machine resource data is adapted to ActiveMQ reporting schemes or storage resource data as shown in Figure 1
FTP reporting schemes or VPC resource data adaptable interface reporting schemes etc. are adapted to, resource data is reported to operational system.
I.e. cloud platform side can first carry out the general evaluation system of application resource, according to all kinds of before carrying out resource data and reporting
The actual use amount of application resource, distinguish types of applications resource using cold and hot degree, wherein using temperature higher application money
Source, corresponding resource data amount can be bigger, and applies the lower application resource of temperature, and corresponding resource data amount is opposite
It is smaller.
Then, different data reporting schemes progress resource datas is respectively adopted using temperature according to types of applications resource
Report, operational system can also be adapted to it is corresponding receive, the modes of resolving resource data, i.e., using it is flexible it is a variety of " report-
The adaptation pattern of parsing ", avoids the single realization that all resource datas all use same data reporting schemes, also avoids
All resource datas are added in a kind of data reporting schemes and report the problem that possible data volume is big, concurrency is big.
The preferred embodiment of the invention is described in detail with reference to the accompanying drawing.
Fig. 2 is referred to, the embodiment of the present invention provides a kind of data reporting method, it can be applied to various cloud platforms, including
Public cloud, private clound, government affairs cloud, enterprise's cloud etc..Wherein, the implementation process of method can be described as follows:
S201: the actual use amount of every class application resource at least a kind of application resource of cloud platform is counted；
S202: the actual use amount based on every class application resource determines the resource hot value of every class application resource；
S203: the default corresponding relationship based on resource hot value and data reporting schemes determines the money of the first application resource
First data reporting schemes of source data, and report with the first data reporting schemes the resource data of first kind application resource.
In S201, cloud platform real-time or timing can count the types of applications in wherein at least a kind of application resource
The actual use amount of resource, as the actual use amount of A class application resource is 100,000, the actual use amount of B class application resource is 8
Ten thousand, etc..
In one possible implementation, to make use of the maintenance personnel of operational system side to types of applications resource
Situation has specifically and gets information about, and cloud platform can have timing, such as 12 hours or one day, scans types of applications
The program of the resource data of resource.
Assuming that agreement reports first resource data daily between cloud platform and operational system, then cloud platform daily can be upper
Then certain moment start by set date timed task before report scans the resource of all kinds of resource datas in the resource database of cloud platform
Tables of data counts the data volume of the resource data of every class application resource at least a kind of application resource.
Specifically, it may refer to Fig. 3, after activation system, cloud platform can be with start by set date scanner program, scan database
In resource data table, the subsequent scanning result that can be returned according to database, by resource hot value and data reporting schemes
Mapping relations are write in configuration file, or can recorde mapping relations between resource hot value and application resource to number of resources
According in library.
Wherein, cloud platform scanning resource database in resource data table mode can by but be not limited only to following two
Kind mode carries out:
If mode one, at least a kind of resource data store, can be with every class resource datas in same resource data table
Resource identification (Resource Type, RT) be differentiation parameter, resource data table is scanned, to count at least a kind of application resource
The data volume of every class resource data in corresponding at least a kind of resource data, wherein resource identification can be all kinds of resource datas
Application resource feature, or be also possible to the user of cloud platform and carry out customized setting.
If mode two, at least a kind of resource data divide table to store, i.e., all kinds of resource datas use respective resource data table
It is stored, then cloud platform can scan resource data table by the way of multi-threaded parallel scanning.For example, resource data table 1
A class resource data is stored, resource data table 2 stores B class resource data, and resource data table 3 stores C class resource data, at this moment, cloud
Platform can carry out parallel scan to resource data table 1, resource data table 2 and resource data table 3 simultaneously, to count at least a kind of
The data volume of every class resource data in the corresponding at least a kind of resource data of application resource.
It should be noted that cloud platform can also use other modes or above-mentioned other than using above two mode
Two ways is combined and is scanned to all kinds of resource data tables in resource database, in the embodiment of the present invention with no restriction.
It, can be according to the data volume and respective application of every class resource data after the data volume for counting every class resource data
The functional relation of the usage amount of resource, such as proportional relation or cumulative relationship, determine the actual use amount of every class application resource.
For example, if the two functional relation is proportional relation, the usage amount of the quantity of every class resource data and corresponding application resource it
Between have certain multiple；Alternatively, if functional relation between the two is cumulative relationship, the actual use amount of every class application resource
The sum of the data volume of various data in respective resources data can be equal to；Etc..
That is, the actual use amount of every class application resource can be embodied by the data volume of corresponding resource data, such as
This, more can intuitively reflect the actual use situation of types of applications resource, be that the operation maintenance personnel of operational system side is flat to cloud
Platform carries out analysis and O&M processing provides data and guarantees.
After the actual use amount that cloud platform counts every class application resource, S202 can be executed, it can according to every class
The actual use amount of application resource determines the resource hot value of every class application resource.
It specifically, can be by the data volume of every class resource data of aforesaid statistical, the actual use amount of every class application resource
It is recorded in newly-built resource hot value record sheet, wherein may include resource identification, scanning in resource hot value record sheet
The parameters such as date on the same day, it is subsequent the resource hot value of every class application resource to be recorded in resource hot value record sheet,
Certainly, the content for including in resource hot value record sheet can be extended according to the actual situation, can intuitively be reacted in this way
The service condition of every class application resource.
It is then possible to the corresponding relationship of pre-set interval and default resource hot value is set, i.e. a pre-set interval corresponding one
A default resource hot value.For example, the pre-set interval of application resource be (15,20] (unit: ten thousand, rear same) when, define resource heat
Angle value is hot_top1；The pre-set interval of application resource be (10,15] when, definition resource hot value be hot_top2；Using money
The pre-set interval in source be (5,10] when, definition resource hot value be hot_top3；The pre-set interval of application resource be (1,5] when,
Definition resource hot value is hot_top4；Etc..
In practical applications, resource hot value, which can be defined as one group according to the type of data reporting schemes correspondence, to distinguish
Application resource temperature, and the temperature enumerated value or character string of practical application amount meaning, each temperature enumerated value or word can be represented
Symbol string, can specifically correspond to the section of an application resource actual use amount size, such as the preset areas of above-mentioned application resource
Between for (15,20] when, defining resource hot value is hot_top1 etc..
And then can match the actual use amount of every class application resource at least one pre-set interval, if first answers
It is located at the first pre-set interval with the actual use amount of resource, it is determined that the resource hot value of the first application resource is the first preset areas
Between default resource hot value, the first pre-set interval be at least one pre-set interval in any one pre-set interval.
As an example it is assumed that the actual use amount of the A class application resource of statistics is actually making for 100,000, B class application resource
Dosage is that the practical application amount of 80,000, C class application resource is 30,000, then by the example above it can be concluded that, the resource of A class application resource
Hot value is hot_top3, and the resource hot value of B class application resource is hot_top3, and the resource hot value of C class application resource is
hot_top4。
After the resource hot value for determining every class application resource, S203 can be executed, that is, is based on resource hot value sum number
According to the default corresponding relationship of reporting schemes, the first data reporting schemes of the resource data of the first application resource are determined, and with
One data reporting schemes report the resource data of first kind application resource.
Specifically, may refer to Fig. 4, which data reporting schemes is cloud platform can use with operational system offered,
Then according to negotiation result, cloud platform side can realize that multimode adaptation reports program with programming development, and operational system can be right
It should realize multimode adaptation data analysis program.
After activation system, cloud platform, which can construct and start resource data, reports timing routine, transfers from database each
The resource hot value of class application resource, and according to each resource hot value, the mapping relations of resource hot value and data reporting schemes,
Realize that coding adaptation chooses data reporting schemes in a program, data reporting schemes can be adapted to by cloud platform chooses program and each
It reports program to write in a timed task, periodically executes the program daily and carry out the adaptations of all kinds of resource datas and report.
Specifically all kinds of resource data amounts have much, need to be made into the adapter for being adapted to several data reporting schemes, can basis
The statistics of actual conditions and the resource application temperature of application resource carrys out flexible design realization, is not only able to satisfy cloud platform data and reports
Business, and considerably increase flexibility and washability, as long as the scalability of system design is good enough, being made into can be according to resource
It is automatically matched using temperature and the addition of expansible data reporting schemes, it will report all kinds of number of resources to cloud platform side is subsequent
According to bringing great convenience.
Wherein, data reporting schemes may include empty machine resource data adaptation ActiveMQ reporting schemes, storage resource number
According on adaptation file transport protocol (File Transfer Protocol, FTP) reporting schemes, VPC resource data adaptable interface
At least one of in report mode, SNMP push mode reporting schemes and REST interface mode reporting schemes, certainly, the data side of reporting
Formula be not limited only to it is above-mentioned enumerate it is several, it is subsequent to be extended according to the actual situation.
Then resource hot value and data reporting schemes relationship maps can be established into default corresponding relationship, it can will be every
A matched data reporting schemes of resource hot value are configured in configuration file, or default corresponding relationship is stored in resource data
Library.
For example, the default corresponding relationship of resource hot value and data reporting schemes may include that resource hot value is
When hot_top1, corresponding data reporting schemes are that the transmission of ActiveMQ message queue reports；Resource hot value is hot_top2
When, corresponding data reporting schemes are that ftp file format reports；When resource hot value is hot_top3, corresponding data are reported
Mode is that SNMP push mode reports；When resource hot value is hot_top4, corresponding data reporting schemes are the interface side REST
Formula reports；Etc..
In turn, types of applications resource can be determined according to the default corresponding relationship of resource hot value and data reporting schemes
Resource data data reporting schemes, as A class application resource resource hot value be hot_top3, the corresponding data side of reporting
Formula is that SNMP push mode reports；The resource hot value of B class application resource is hot_top3, and corresponding data reporting schemes are
SNMP push mode reports；The resource hot value of C class application resource is hot_top4, and corresponding data reporting schemes connect for REST
Mouth mode reports；Etc..
In summary, the reporting schemes that most of cloud platform reported data system uses in the prior art are single report
Mode does not distinguish data type, and unified superposition is reported using a kind of method, can bring performance bottleneck or server resource
Waste, the problems such as scalability is poor.
It, can be according to practical business development Experience in the embodiment of the present invention to solve the above-mentioned problems in the prior art
It is answered using different data reporting schemes all kinds of with existing industry mode according to types of applications resource using cold and hot degree
It is reported with the resource data of resource, not only solves the limitation of single data reporting schemes, and data are reported
Mode is more various and neatly applies in cloud platform data reporting system, has fabulous scalability.
Based on the same inventive concept, Fig. 5 is referred to, the embodiment of the present invention provides a kind of cloud platform, comprising:
Statistical module 51, the actual use of every class application resource at least a kind of application resource for counting cloud platform
Amount；
Determining module 52 determines every class application resource for the actual use amount based on every class application resource
Resource hot value；
Reporting module 53 determines that first answers for the default corresponding relationship based on resource hot value and data reporting schemes
With the first data reporting schemes of the resource data of resource, and the first kind application is reported with the first data reporting schemes
The resource data of resource, wherein first application resource is any sort application resource at least a kind of application resource,
Every class resource data is generated data when user uses corresponding application resource.
In one possible implementation, the statistical module 51 is used for:
The resource data table in the resource database of the cloud platform is scanned, statistics at least a kind of application resource is corresponding
At least a kind of resource data in every class resource data data volume；
The functional relation of the usage amount of data volume based on every class resource data and respective application resource, determine described in
The actual use amount of every class application resource.
In one possible implementation, the statistical module 51 is used for:
If at least a kind of resource data store is in same resource data table, with the resource mark of every class resource data
Knowing is differentiation parameter, scans the resource data table；Or,
If at least a kind of resource data divides table to store, multi-threaded parallel scans the resource data table.
In one possible implementation, the determining module 52 is used for:
The actual use amount of every class application resource is matched at least one pre-set interval, wherein one pre-
If section corresponds to a default resource hot value；
If the actual use amount of first application resource is located at the first pre-set interval, it is determined that first application resource
Resource hot value be the first pre-set interval default resource hot value, first pre-set interval is that described at least one is default
Any one pre-set interval in section.
In one possible implementation, further includes:
Configuration module, for each matched data reporting schemes of resource hot value to be configured in configuration file；
Or,
The default corresponding relationship is stored in resource database.
Based on the same inventive concept, Fig. 6 is referred to, a kind of computer installation is provided in the embodiment of the present invention, including at least
One processor 61, and memory 62 and communication interface 63 with the communication connection of at least one described processor 61, in Fig. 6 with
For one processor 61 is shown.
Wherein, the memory 62 is stored with the instruction that can be executed by least one described processor 61, and described at least one
The instruction that a processor 61 is stored by executing the memory 62 is executed using the communication interface 63 as in above-described embodiment
The method.
Based on the same inventive concept, the embodiment of the present invention provides a kind of computer readable storage medium, and the computer can
It reads storage medium and is stored with computer instruction, when the computer instruction is run on computers, so that computer executes such as
Method described in above-described embodiment.
In the specific implementation process, computer readable storage medium includes: general serial bus USB
(Universal Serial Bus flash drive, USB), mobile hard disk, read-only memory (Read-Only Memory,
ROM), random access memory (Random Access Memory, RAM), magnetic or disk etc. are various can store program
The storage medium of code.
The apparatus embodiments described above are merely exemplary, wherein units/modules as illustrated by the separation member
It may or may not be physically separated, the component shown as units/modules may or may not be
Physical unit/module, it can it is in one place, or may be distributed in multiple network unit/modules.It can basis
It is actual to need that some or all of the modules therein is selected to achieve the purpose of the solution of this embodiment.Ordinary skill people
Member is without paying creative labor, it can understands and implements.
Through the above description of the embodiments, those skilled in the art can be understood that each embodiment can
It realizes by means of software and necessary general hardware platform, naturally it is also possible to pass through hardware.Based on this understanding, on
Stating technical solution, substantially the part that contributes to existing technology can be embodied in the form of software products in other words, should
Computer software product may be stored in a computer readable storage medium, such as ROM/RAM, magnetic disk, CD, including several fingers
It enables and using so that a computer equipment (can be personal computer, server or the network equipment etc.) executes each implementation
Method described in certain parts of example or embodiment.
Finally, it should be noted that the above embodiments are merely illustrative of the technical solutions of the present invention, rather than its limitations；Although
Present invention has been described in detail with reference to the aforementioned embodiments, those skilled in the art should understand that: it still may be used
To modify the technical solutions described in the foregoing embodiments or equivalent replacement of some of the technical features；
And these are modified or replaceed, technical solution of various embodiments of the present invention that it does not separate the essence of the corresponding technical solution spirit and
Range.
Claims (12)
1. a kind of data reporting method characterized by comprising
Count the actual use amount of every class application resource at least a kind of application resource of cloud platform；
Based on the actual use amount of every class application resource, the resource hot value of every class application resource is determined；
Default corresponding relationship based on resource hot value and data reporting schemes determines the of the resource data of the first application resource
One data reporting schemes, and report with the first data reporting schemes the resource data of the first kind application resource, wherein
First application resource is any sort application resource at least a kind of application resource, and every class resource data makes for user
Generated data when with corresponding application resource.
2. the method as described in claim 1, which is characterized in that count every class application at least a kind of application resource of cloud platform
The actual use amount of resource, comprising:
The resource data table in the resource database of the cloud platform is scanned, statistics at least a kind of application resource is corresponding extremely
The data volume of every class resource data in few one kind resource data；
The functional relation of the usage amount of data volume and respective application resource based on every class resource data, determines every class
The actual use amount of application resource.
3. method according to claim 2, which is characterized in that the resource in the resource database of the scanning cloud platform
Tables of data includes:
If at least a kind of resource data store is in same resource data table, the resource identification with every class resource data is
Differentiation parameter scans the resource data table；Or,
If at least a kind of resource data divides table to store, multi-threaded parallel scans the resource data table.
4. the method as described in claim 1, which is characterized in that the actual use amount based on every class application resource determines
The resource hot value of every class application resource, comprising:
The actual use amount of every class application resource is matched at least one pre-set interval, wherein a preset areas
Between a corresponding default resource hot value；
If the actual use amount of first application resource is located at the first pre-set interval, it is determined that the money of first application resource
Source hot value is the default resource hot value of the first pre-set interval, and first pre-set interval is at least one described pre-set interval
In any one pre-set interval.
5. such as method of any of claims 1-4, which is characterized in that further include:
Each matched data reporting schemes of resource hot value are configured in configuration file；Or,
The default corresponding relationship is stored in resource database.
6. a kind of cloud platform characterized by comprising
Statistical module, the actual use amount of every class application resource at least a kind of application resource for counting cloud platform；
Determining module determines the resource of every class application resource for the actual use amount based on every class application resource
Hot value；
Reporting module determines the first application resource for the default corresponding relationship based on resource hot value and data reporting schemes
Resource data the first data reporting schemes, and report the first kind application resource with the first data reporting schemes
Resource data, wherein first application resource is any sort application resource at least a kind of application resource, every class money
Source data is generated data when user uses corresponding application resource.
7. cloud platform as claimed in claim 6, which is characterized in that the statistical module is used for:
The resource data table in the resource database of the cloud platform is scanned, statistics at least a kind of application resource is corresponding extremely
The data volume of every class resource data in few one kind resource data；
The functional relation of the usage amount of data volume and respective application resource based on every class resource data, determines every class
The actual use amount of application resource.
8. cloud platform as claimed in claim 7, which is characterized in that the statistical module is used for:
If at least a kind of resource data store is in same resource data table, the resource identification with every class resource data is
Differentiation parameter scans the resource data table；Or,
If at least a kind of resource data divides table to store, multi-threaded parallel scans the resource data table.
9. cloud platform as claimed in claim 6, which is characterized in that the determining module is used for:
The actual use amount of every class application resource is matched at least one pre-set interval, wherein a preset areas
Between a corresponding default resource hot value；
If the actual use amount of first application resource is located at the first pre-set interval, it is determined that the money of first application resource
Source hot value is the default resource hot value of the first pre-set interval, and first pre-set interval is at least one described pre-set interval
In any one pre-set interval.
10. the cloud platform as described in any one of claim 6-9, which is characterized in that further include:
Configuration module, for each matched data reporting schemes of resource hot value to be configured in configuration file；Or,
The default corresponding relationship is stored in resource database.
11. a kind of computer installation, the computer installation include:
At least one processor, and
The memory that is connect at least one described processor communication, communication interface；
Wherein, the memory is stored with the instruction that can be executed by least one described processor, at least one described processor
By executing the instruction of the memory storage, executed using the communication interface according to any one of claims 1 to 5
Method.
12. a kind of computer readable storage medium, the computer-readable recording medium storage has computer instruction, when the meter
When the instruction of calculation machine is run on computers, so that computer executes method according to any one of claims 1 to 5.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810185457.2A CN110233747B (en) | 2018-03-06 | 2018-03-06 | Data reporting method and cloud platform |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810185457.2A CN110233747B (en) | 2018-03-06 | 2018-03-06 | Data reporting method and cloud platform |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN110233747A true CN110233747A (en) | 2019-09-13 |
| CN110233747B CN110233747B (en) | 2022-06-14 |
Family
ID=67861857
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201810185457.2A Active CN110233747B (en) | 2018-03-06 | 2018-03-06 | Data reporting method and cloud platform |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN110233747B (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112131180A (en) * | 2020-09-25 | 2020-12-25 | 京东数字科技控股股份有限公司 | Data reporting method and device and storage medium |
Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101990043A (en) * | 2009-08-06 | 2011-03-23 | 中兴通讯股份有限公司 | Method and system of allocating Voice over Internet Protocol business semi-static scheduling resource |
| WO2014168408A1 (en) * | 2013-04-11 | 2014-10-16 | 주식회사 안랩 | Device, system and method for diagnosing malware on basis of cloud |
| CN104125286A (en) * | 2014-08-03 | 2014-10-29 | 浙江网新恒天软件有限公司 | Smart cloud management system based on cloud computing for enterprise infrastructure |
| US20150154293A1 (en) * | 2013-11-29 | 2015-06-04 | Inventec Corporation | Cloud system and cloud resource allocation method |
| CN105516200A (en) * | 2016-01-19 | 2016-04-20 | 中国联合网络通信集团有限公司 | Cloud system security processing method and device |
| CN105656686A (en) * | 2016-02-29 | 2016-06-08 | 中国人民解放军国防信息学院 | Self-adaptive equipment management adaptation method |
| CN106126347A (en) * | 2016-08-17 | 2016-11-16 | 浪潮电子信息产业股份有限公司 | A kind of method effectively realizing mainframe cluster scheduling of resource under cloud platform |
-
2018
- 2018-03-06 CN CN201810185457.2A patent/CN110233747B/en active Active
Patent Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101990043A (en) * | 2009-08-06 | 2011-03-23 | 中兴通讯股份有限公司 | Method and system of allocating Voice over Internet Protocol business semi-static scheduling resource |
| WO2014168408A1 (en) * | 2013-04-11 | 2014-10-16 | 주식회사 안랩 | Device, system and method for diagnosing malware on basis of cloud |
| US20150154293A1 (en) * | 2013-11-29 | 2015-06-04 | Inventec Corporation | Cloud system and cloud resource allocation method |
| CN104125286A (en) * | 2014-08-03 | 2014-10-29 | 浙江网新恒天软件有限公司 | Smart cloud management system based on cloud computing for enterprise infrastructure |
| CN105516200A (en) * | 2016-01-19 | 2016-04-20 | 中国联合网络通信集团有限公司 | Cloud system security processing method and device |
| CN105656686A (en) * | 2016-02-29 | 2016-06-08 | 中国人民解放军国防信息学院 | Self-adaptive equipment management adaptation method |
| CN106126347A (en) * | 2016-08-17 | 2016-11-16 | 浪潮电子信息产业股份有限公司 | A kind of method effectively realizing mainframe cluster scheduling of resource under cloud platform |
Non-Patent Citations (2)
| Title |
|---|
| 孙健波: ""PaaS云平台自动化部署和监控的设计与实现"", 《中国优秀硕士学位论文全文数据库 信息科技辑》 * |
| 边俊峰: ""基于Docker的资源调度及应用容器集群管理系统设计与实现"", 《中国优秀硕士学位论文全文数据库 信息科技辑》 * |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112131180A (en) * | 2020-09-25 | 2020-12-25 | 京东数字科技控股股份有限公司 | Data reporting method and device and storage medium |
| CN112131180B (en) * | 2020-09-25 | 2024-02-06 | 京东科技控股股份有限公司 | Data reporting method, device and storage medium |
Also Published As
| Publication number | Publication date |
|---|---|
| CN110233747B (en) | 2022-06-14 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| Blanchette | A material history of bits | |
| CN101802815B (en) | Data-driven synchronization | |
| EP3032442B1 (en) | Modeling and simulation of infrastructure architecture for big data | |
| US11150896B2 (en) | Automated generation of service definitions for message queue application clients | |
| CN102710793B (en) | Network printing system based on cloud computing and data storage method thereof | |
| US8286194B2 (en) | Coupling state aware systems | |
| CN110297944B (en) | Distributed XML data processing method and system | |
| CN110688828A (en) | File processing method and device, file processing system and computer equipment | |
| US10489179B1 (en) | Virtual machine instance data aggregation based on work definition metadata | |
| CN111949856B (en) | Web-based object storage query method and device | |
| US10574765B2 (en) | Method, device, and non-transitory computer-readable recording medium | |
| CN111274256A (en) | Resource control method, device, equipment and storage medium based on time sequence database | |
| CN110233747A (en) | A kind of data reporting method and cloud platform | |
| Yang et al. | G‐BLAST: a Grid‐based solution for mpiBLAST on computational Grids | |
| CN112631577B (en) | Model scheduling method, model scheduler and model safety test platform | |
| CN109615217A (en) | Work order generation method, device and storage medium | |
| US20220179602A1 (en) | Methods, systems, and storage media for characterizing print volume information for a printing asset | |
| CN113051333A (en) | Data processing method and device, electronic equipment and storage medium | |
| US10733002B1 (en) | Virtual machine instance data aggregation | |
| TWI702540B (en) | Load control method | |
| US20230350915A1 (en) | Application behavior based customer data migration | |
| US20240070448A1 (en) | Sample data generation for a mocking service | |
| Mukherjee et al. | Big data analytics with service-oriented architecture | |
| US11392433B1 (en) | Generation of asynchronous application programming interface specifications for messaging topics | |
| CN115756443A (en) | Script generation method and device, electronic equipment and readable storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |