CN109032914A - Resource occupation data predication method, electronic equipment, storage medium - Google Patents

Resource occupation data predication method, electronic equipment, storage medium Download PDF

Info

Publication number
CN109032914A
CN109032914A CN201811042964.7A CN201811042964A CN109032914A CN 109032914 A CN109032914 A CN 109032914A CN 201811042964 A CN201811042964 A CN 201811042964A CN 109032914 A CN109032914 A CN 109032914A
Authority
CN
China
Prior art keywords
data
resource
resource occupation
specified time
service
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201811042964.7A
Other languages
Chinese (zh)
Inventor
韩竺
邹德顺
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Ireader Technology Co Ltd
Zhangyue Technology Co Ltd
Original Assignee
Zhangyue Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Zhangyue Technology Co Ltd filed Critical Zhangyue Technology Co Ltd
Priority to CN201811042964.7A priority Critical patent/CN109032914A/en
Publication of CN109032914A publication Critical patent/CN109032914A/en
Pending legal-status Critical Current

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F11/00Error detection; Error correction; Monitoring
    • G06F11/30Monitoring
    • G06F11/34Recording or statistical evaluation of computer activity, e.g. of down time, of input/output operation ; Recording or statistical evaluation of user activity, e.g. usability assessment
    • G06F11/3447Performance evaluation by modeling
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F11/00Error detection; Error correction; Monitoring
    • G06F11/30Monitoring
    • G06F11/34Recording or statistical evaluation of computer activity, e.g. of down time, of input/output operation ; Recording or statistical evaluation of user activity, e.g. usability assessment
    • G06F11/3409Recording or statistical evaluation of computer activity, e.g. of down time, of input/output operation ; Recording or statistical evaluation of user activity, e.g. usability assessment for performance assessment
    • G06F11/3433Recording or statistical evaluation of computer activity, e.g. of down time, of input/output operation ; Recording or statistical evaluation of user activity, e.g. usability assessment for performance assessment for load management
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F9/00Arrangements for program control, e.g. control units
    • G06F9/06Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
    • G06F9/46Multiprogramming arrangements
    • G06F9/50Allocation of resources, e.g. of the central processing unit [CPU]
    • G06F9/5005Allocation of resources, e.g. of the central processing unit [CPU] to service a request
    • G06F9/5027Allocation of resources, e.g. of the central processing unit [CPU] to service a request the resource being a machine, e.g. CPUs, Servers, Terminals

Abstract

The invention discloses a kind of resource occupation data predication method, electronic equipment, storage medium, method includes: the achievement data for obtaining at least one current service operation and generating;Current achievement data is predicted, the corresponding prediction index data of the following specified time point are obtained;Prediction index data are inputted to the resource occupation training pattern pre-established, prediction resource occupation data needed for obtaining corresponding at least one service operation of the following specified time point.Prediction resource occupation data needed for getting at least one service operation of the following specified time point using the present invention, it can be convenient and understand the following specified time possible occupation condition of point in advance, carry out the reply to occupation condition, existing resource is adjusted in time, avoid the problems such as being unable to run because of service caused by inadequate resource, also avoid it is unreasonable resource is expanded caused by resource it is idle, resource utilization is provided.

Description

Resource occupation data predication method, electronic equipment, storage medium
Technical field
The present invention relates to software fields, and in particular to a kind of resource occupation data predication method, electronic equipment, storage are situated between Matter.
Background technique
It is various also increasing by the service of network operation as network is grown rapidly, it is supplied to user more just Benefit, such as browsing webpage, downloading file, online reading and online audio frequency and video, different services need to occupy the money of server Source is also different.But in view of the resource of server is limited, when the resource that service needs to occupy can be with beyond server itself When the resource of offer, the problems such as will cause server delay machine, service operation failure, the experience effect that user uses is influenced.
The prior art can carry out dilatation adjustment, such as using clothes when the service of encountering needs to occupy vast resources to server When the number of users of business largely increases, professional chief connection occupies more resource, memory dilatation, cpu are carried out to server The operation such as upgrading, to adapt to demand for services.But processing often just carries out dilatation adjustment to server after problem generation in this way, Remedial measure is just carried out after problem generation, has produced bad experience effect for a user.Therefore, it is necessary to one kind To the method that occupation condition is effectively predicted, preferably to cope with the problem of may occurring.
Summary of the invention
In view of the above problems, it proposes on the present invention overcomes the above problem or at least be partially solved in order to provide one kind State resource occupation data predication method, electronic equipment, the storage medium of problem.
According to an aspect of the invention, there is provided a kind of resource occupation data predication method comprising:
Obtain the achievement data that at least one current service operation generates;
Current achievement data is predicted, the corresponding prediction index data of the following specified time point are obtained;
Prediction index data are inputted to the resource occupation training pattern pre-established, obtain the corresponding following specified time point Prediction resource occupation data needed at least one service operation.
According to another aspect of the present invention, provide a kind of electronic equipment, comprising: processor, memory, communication interface and Communication bus, processor, memory and communication interface complete mutual communication by communication bus;
Memory makes processor execute following operation for storing an at least executable instruction, executable instruction:
Obtain the achievement data that at least one current service operation generates;
Current achievement data is predicted, the corresponding prediction index data of the following specified time point are obtained;
Prediction index data are inputted to the resource occupation training pattern pre-established, obtain the corresponding following specified time point Prediction resource occupation data needed at least one service operation.
According to another aspect of the invention, a kind of computer storage medium is provided, at least one is stored in storage medium Executable instruction, executable instruction make processor execute following operation:
Obtain the achievement data that at least one current service operation generates;
Current achievement data is predicted, the corresponding prediction index data of the following specified time point are obtained;
Prediction index data are inputted to the resource occupation training pattern pre-established, obtain the corresponding following specified time point Prediction resource occupation data needed at least one service operation.
Resource occupation data predication method, electronic equipment, the storage medium provided according to the present invention obtains current at least one The achievement data that a service operation generates;Current achievement data is predicted, it is corresponding pre- to obtain the following specified time point Survey achievement data;Prediction index data are inputted to the resource occupation training pattern pre-established, when obtaining corresponding following specified Between put at least one service operation needed for prediction resource occupation data.The following specified time point is got at least using the present invention Prediction resource occupation data needed for one service operation can be convenient the following specified time possible resource of point of understanding in advance and account for With situation, the reply to occupation condition is carried out, existing resource is adjusted in time, is avoided because produced by inadequate resource Service the problems such as being unable to run, also avoid it is unreasonable resource is expanded caused by resource it is idle, the utilization of resources is provided Rate.Further, it is trained previously according to history achievement data and history resource occupation data, obtains resource occupation training mould Type ensures and obtains the accuracy of prediction resource occupation data.
The above description is only an overview of the technical scheme of the present invention, in order to better understand the technical means of the present invention, And it can be implemented in accordance with the contents of the specification, and in order to allow above and other objects of the present invention, feature and advantage can It is clearer and more comprehensible, the followings are specific embodiments of the present invention.
Detailed description of the invention
By reading the following detailed description of the preferred embodiment, various other advantages and benefits are common for this field Technical staff will become clear.The drawings are only for the purpose of illustrating a preferred embodiment, and is not considered as to the present invention Limitation.And throughout the drawings, the same reference numbers will be used to refer to the same parts.In the accompanying drawings:
Fig. 1 shows the flow chart of according to embodiments of the present invention one resource occupation data predication method;
Fig. 2 shows the flow charts of according to embodiments of the present invention one resource occupation training pattern training method;
Fig. 3 shows the flow chart of according to embodiments of the present invention two resource occupation data predication method;
Fig. 4 shows the structural schematic diagram of according to embodiments of the present invention four a kind of electronic equipment.
Specific embodiment
Exemplary embodiments of the present disclosure are described in more detail below with reference to accompanying drawings.Although showing the disclosure in attached drawing Exemplary embodiment, it being understood, however, that may be realized in various forms the disclosure without should be by embodiments set forth here It is limited.On the contrary, these embodiments are provided to facilitate a more thoroughly understanding of the present invention, and can be by the scope of the present disclosure It is fully disclosed to those skilled in the art.
Embodiment one
Fig. 1 shows the flow chart of according to embodiments of the present invention one resource occupation data predication method, as shown in Figure 1, Resource occupation data predication method specifically comprises the following steps:
Step S101 obtains the achievement data that at least one current service operation generates.
At runtime, the various achievement datas that the quality of service operation performance can be generated according to its operation weigh for service Amount.Operation conditions based on service, the achievement data of generation also can be different.The acquisition of achievement data can be by service operation It is monitored to obtain.Such as in service operation, for the normal operation for ensureing service, daily monitoring is carried out to service operation, thus What be can be convenient gets the achievement data of service operation generation.
Achievement data includes query rate such as per second, handling capacity, number of concurrent, response time.Query rate (Query per second Per Second, qps) it is the measurement standard how many to flow handled by service at the appointed time, reflect the processing of service Efficiency;Handling capacity reflects service processing speed, ability, such as service can handle in per unit time how many a affairs, request, The ability of data etc..Corresponding different services, such as database service, handling capacity are the execution number of different SQL statements in the unit time Amount, returned data amount etc.;Network service, handling capacity are the data traffic etc. of network transmission;Number of concurrent is used to measure service concurrent The abilities such as capacity, synchronous coordination reflect the reply processing capacity serviced under concurrent situation;Response time is that service is receiving User's operation the time it takes is responded after user's operation, such as since user clicks a page operation timing, arrives this page Face shows timing completely terminates the time it takes.Response time can also be segmented are as follows: server end response time, network response Time etc..
Step S102 predicts current achievement data, obtains the corresponding prediction index number of the following specified time point According to.
By being counted to the history achievement data for servicing generation in historical time section, it can be found that service operation is produced Raw achievement data has cyclophysis, and achievement data can show cyclically-varying at any time.Such as it is supplied to user group's figure The service that book is read, 7 points to 9 points of every morning, user group can more read books on the way to work, in achievement data Qps can it is more, handling capacity is larger, number of concurrent is more, the response time can be slower etc.;It daily 9 points to 12 points, can less user group Read books, qps in achievement data can it is less, handling capacity is smaller, number of concurrent is less, the response time can be very fast etc.;Festivals or holidays The achievement data of each period and working day each period also can there are cyclically-varyings for section difference at any time.
When predicting current achievement data, the cyclophysis based on achievement data be can use preset pre- Method of determining and calculating predicts current achievement data.As utilized Smoothness Index algorithm three times, reasonably to the following specified time point It is predicted, obtains the corresponding prediction index data of the following specified time point.It herein, is the accuracy for ensureing prediction, Yi Jifang Just subsequent obtained prediction resource occupation data are monitored in real time, carry out resource arrangement etc. timely and reasonably, future is specified It is the preferred short period at time point, such as 1 hour following.
Prediction index data are inputted the resource occupation training pattern pre-established, obtain corresponding future by step S103 Prediction resource occupation data needed at least one service operation of specified time point.
Service operation needs to occupy resource, and resource occupation data include that memory source occupies data, cpu resource occupies number Data are occupied according to, disk, flow occupies data etc..Prediction index data are inputted to the resource occupation training pattern pre-established In, resource occupation training pattern can be corresponded to according to the service of input in the prediction index data of the following specified time point The following specified time point service operation needed for prediction resource occupation data.
When there are multiple services, need each service is preparatory in the prediction index data input of the following specified time point In the resource occupation training pattern of foundation, prediction resource needed for obtaining the corresponding following specified time each service operation of point is accounted for Use data.By prediction resource occupation data accumulation needed for each service operation, all service fortune of the following specified time point are obtained The required prediction resource occupation data of row.
Further, the training process of the resource occupation training pattern pre-established the following steps are included:
Step S1031, collecting sample data and sample labeled data.
Before resource occupation training pattern is trained, need to acquire the required enough sample datas and sample of training Labeled data.Wherein, sample data includes history achievement data, sample labeled data include it is corresponding with history achievement data extremely The history resource occupation data that a few service occupies.Sample above data and sample labeled data can be by daily to service It is monitored record and obtains history achievement data, recording each service, occupied resource situation obtains history resource at runtime Occupy data.As acquire over history achievement data caused by least one service operation in three months and it is corresponding extremely Few occupied history resource occupation data of a service operation.
When collecting sample data and sample labeled data, need to acquire at least one service operation of same historical time point Produced achievement data and the occupied resource occupation data of at least one corresponding service operation, for use in resource occupation instruction Practice the training of model.
Sample data is input to the output knot obtained to be trained in training pattern to training pattern by step S1032 Fruit.
The sample data of above-mentioned acquisition is input to as input data to be trained in training pattern, obtains mould to be trained The output of type is as a result, i.e. occupied resource occupation data of service operation.
Such as linear regression model (LRM) machine algorithm model can be used to training pattern, is arranged with specific reference to performance, It is not construed as limiting herein.
Step S1033 is adjusted and is joined to the weight of training pattern according to the loss between output result and sample labeled data Number obtains resource occupation training pattern until meeting preset condition.
Wherein, preset condition may include the accuracy rate as calculated output result and sample labeled data, when accuracy rate is full Foot certain threshold value such as 99%;Or preset condition is to export the small Mr. Yu's threshold value such as deviation of deviation of result and sample labeled data to be less than 5% etc..It is illustrated for being linear regression model (LRM) to training pattern, it is assumed that the linear pass between sample data and output result System, is trained according to sample data.Error is had between output result and sample labeled data, that is, there is loss, according to depositing Loss, loss function therein is optimized so that loss function minimize, thus obtain resource occupation training mould Type.
The step can execute repeatedly, constantly according to the loss between output result and sample labeled data, adjust wait instruct Practice the weight parameter of model, until meeting preset condition, to obtain resource occupation training pattern.
Further, since each service is different, when training resource occupies training pattern, it can be directed to different services, Obtain each service targetedly resource occupation training pattern.I.e. in training, referred to according to the history that each service operation generates Data occupied history resource occupation data of service operation corresponding with its are marked, is respectively trained, obtains each according to service The resource occupation training pattern of service.It is corresponding in the prediction index data input by each service in the following specified time It is input in the resource occupation training pattern pre-established for the service, obtains corresponding following specified time point service Prediction resource occupation data needed for operation.
The resource occupation data predication method provided according to the present invention obtains the finger that at least one current service operation generates Mark data;Current achievement data is predicted, the corresponding prediction index data of the following specified time point are obtained;Prediction is referred to Mark data input the resource occupation training pattern pre-established, obtain corresponding at least one service operation of the following specified time point Required prediction resource occupation data.It is got using the present invention pre- needed at least one service operation of the following specified time point Resource occupation data are surveyed, can be convenient and understand the following specified time possible occupation condition of point in advance, carry out and resource is accounted for With the reply of situation, existing resource is adjusted in time, avoids being unable to run because of service caused by inadequate resource etc. and ask Topic, also avoid it is unreasonable resource is expanded caused by resource free time, resource utilization is provided.Further, previously according to History achievement data and history resource occupation data are trained, and obtain resource occupation training pattern, and guarantee obtains prediction resource Occupy the accuracy of data.
Embodiment two
Fig. 3 shows the flow chart of according to embodiments of the present invention two resource occupation data predication method, as shown in figure 3, Resource occupation data predication method includes the following steps:
Step S301 obtains the achievement data that at least one current service operation generates.
Step S302 predicts current achievement data, obtains the corresponding prediction index number of the following specified time point According to.
Prediction index data are inputted the resource occupation training pattern pre-established, obtain corresponding future by step S303 Prediction resource occupation data needed at least one service operation of specified time point.
Above step is referring to the description of step S101-S103 in embodiment one, and details are not described herein.
Step S304 obtains the resource data available that server provides.
The resource data available that server itself provides can be obtained according to pre-configured server all data.This Place is to run each service well, and reply emergency situations that may be present, resource data available can not be clothes All resource data availables that business device itself can provide, but obtain the resource data conduct in server preset threshold range Resource data available.If threshold value is 90%, obtains the resource data for accounting for all resource datas 90% that server provides and be used as money Source data available, using 10% resource data as the resource data of reply emergency situations.
Step S305 judges the service whether resource data available can run on support server.
Each service that server is currently running is obtained, according to obtained each service in the following specified time Point runs required prediction resource occupation data, and all services run on calculation server run institute in the following specified time point The sum of the prediction resource occupation data needed.Such as server current operation service A, B, C, A, B, C will be serviced in the following specified time Prediction resource occupation data needed for point operation add up, and obtain required the sum of prediction resource occupation data.
Judge that prediction needed for whether resource data available is greater than or equal to all service operations of the following specified time point provides Source occupies the sum of data, if more than or be equal to, then illustrate that server can support the normal of all services of the following specified time point Operation;If being less than, illustrates that server can not support the normal operation of all services of the following specified time point, execute step S306。
Step S306 carries out server resource alarming processing.
When judging that server can not support the normal operation of all services of the following specified time point, also need further to judge The resource of specific shortage, such server resource alarming processing can targetedly alert the resource of shortage, such as memory Off-capacity, CPU usage are excessively high, disk size is short, flow is excessive etc., convenient to be located accordingly for specific resource Reason measure also avoids carrying out all resources the problems such as supplement causes certain resources idle.Further, server resource alerts Processing can also be alerted according to the specific value of shortage of resources, and resource can be carried out according to specific data when supplement by facilitating Supplement, avoid supplementing it is very few, cannot ensure service operate normally, also avoid supplement excessively cause resource utilization is not high to ask Topic.
Specific alarm mode can alert existing a variety of alarm modes using the alarm of such as mail, display screen, not make herein It limits.
The resource occupation data predication method provided according to the present invention obtains each service in the following specified time point in prediction After prediction resource occupation data needed for operation, it is compared with the resource data available that server can be provided, if money The service that source data available can not be run on support server, carries out server resource alarming processing, in time so as to quick It solves the problems, such as that future may occur in advance, ensures the normal operation of service.
Embodiment three
The embodiment of the present application three provides a kind of nonvolatile computer storage media, computer storage medium be stored with to The prediction of the resource occupation data in above-mentioned any means embodiment can be performed in a few executable instruction, the computer executable instructions Method.
Executable instruction specifically can be used for so that processor executes following operation:
Obtain the achievement data that at least one current service operation generates;Current achievement data is predicted, is obtained The corresponding prediction index data of following specified time point;The resource occupation training mould that the input of prediction index data is pre-established Type, prediction resource occupation data needed for obtaining corresponding at least one service operation of the following specified time point.
In a kind of optional embodiment, executable instruction further makes processor execute following operation: according to index Data cyclophysis predicts current achievement data using preset prediction algorithm, obtains the following specified time point pair The prediction index data answered.
In a kind of optional embodiment, executable instruction further makes processor execute following operation: collecting sample Data and sample labeled data;Sample data is input to be trained in training pattern, the output to training pattern is obtained As a result;According to the loss between output result and sample labeled data, the weight parameter to training pattern is adjusted, until meeting pre- If condition, resource occupation training pattern is obtained.
In a kind of optional embodiment, sample data includes history index number caused by least one service operation According to;Sample labeled data includes the history resource occupation data that at least one service corresponding with history achievement data occupies.
In a kind of optional embodiment, executable instruction further makes processor execute following operation: obtaining service The resource data available that device provides;Judge the service whether resource data available can run on support server;If it is not, carrying out Server resource alarming processing.
In a kind of optional embodiment, executable instruction further makes processor execute following operation: according to service At least one service run on device, prediction resource occupation data needed for calculating following specified time all service operations of point it With;Judge prediction resource occupation needed for whether resource data available is greater than or equal to all service operations of the following specified time point The sum of data;If it is not, carrying out server resource alarming processing.
In a kind of optional embodiment, achievement data includes query rate, handling capacity, number of concurrent and/or response per second Time;Resource occupation data include that memory source occupies data, cpu resource occupies data, disk occupies data and/or flow accounts for Use data.
Example IV
Fig. 4 shows the structural schematic diagram of according to embodiments of the present invention four a kind of electronic equipment, present invention specific implementation Example does not limit the specific implementation of electronic equipment.
As shown in figure 4, the electronic equipment may include: processor (processor) 402, communication interface (Communications Interface) 404, memory (memory) 406 and communication bus 408.
Wherein:
Processor 402, communication interface 404 and memory 406 complete mutual communication by communication bus 408.
Communication interface 404, for being communicated with the network element of other equipment such as client or other servers etc..
Processor 402 can specifically execute above-mentioned resource occupation data predication method embodiment for executing program 410 In correlation step.
Specifically, program 410 may include program code, which includes computer operation instruction.
Processor 402 may be central processor CPU or specific integrated circuit ASIC (Application Specific Integrated Circuit), or be arranged to implement the integrated electricity of one or more of the embodiment of the present invention Road.The one or more processors that server includes can be same type of processor, such as one or more CPU;It can also be with It is different types of processor, such as one or more CPU and one or more ASIC.
Memory 406, for storing program 410.Memory 406 may include high speed RAM memory, it is also possible to further include Nonvolatile memory (non-volatile memory), for example, at least a magnetic disk storage.
Program 410 specifically can be used for so that processor 402 executes following operation:
In a kind of optional embodiment, program 410 is used for so that processor 402 obtains at least one current service fortune The achievement data that row generates;Current achievement data is predicted, the corresponding prediction index number of the following specified time point is obtained According to;Prediction index data are inputted to the resource occupation training pattern pre-established, obtain the corresponding following specified time point at least Prediction resource occupation data needed for one service operation.
In a kind of optional embodiment, program 410 is used for so that processor 402 is according to achievement data cyclophysis, Current achievement data is predicted using preset prediction algorithm, obtains the corresponding prediction index number of the following specified time point According to.
In a kind of optional embodiment, program 410 is used for so that 402 collecting sample data of processor and sample mark Data;Sample data is input to the output result obtained to be trained in training pattern to training pattern;It is tied according to output Loss between fruit and sample labeled data adjusts the weight parameter to training pattern, until meeting preset condition, obtains resource Occupy training pattern.
In a kind of optional embodiment, sample data includes history index number caused by least one service operation According to;Sample labeled data includes the history resource occupation data that at least one service corresponding with history achievement data occupies.
In a kind of optional embodiment, program 410 is used for so that the resource that processor 402 obtains server offer can Use data;Judge the service whether resource data available can run on support server;If it is not, carrying out server resource alarm Processing.
In a kind of optional embodiment, program 410 is used for so that processor 402 is run at least according on server One service, the sum of prediction resource occupation data needed for calculating following specified time all service operations of point;Judge that resource can The sum of prediction resource occupation data needed for whether being greater than or equal to all service operations of the following specified time point with data;If It is no, carry out server resource alarming processing.
In a kind of optional embodiment, achievement data includes query rate, handling capacity, number of concurrent and/or response per second Time;Resource occupation data include that memory source occupies data, cpu resource occupies data, disk occupies data and/or flow accounts for Use data.
The specific implementation of each step may refer to the corresponding step in above-mentioned resource occupation data prediction embodiment in program 410 Corresponding description in rapid, this will not be repeated here.It is apparent to those skilled in the art that for the convenience and letter of description Clean, the equipment of foregoing description and the specific work process of module can refer to corresponding processes in the foregoing method embodiment description, Details are not described herein.
The scheme provided through this embodiment obtains the achievement data that at least one current service operation generates;To current Achievement data predicted, obtain the corresponding prediction index data of the following specified time point;The input of prediction index data is pre- The resource occupation training pattern first established, prediction needed for obtaining corresponding at least one service operation of the following specified time point provide Source occupies data.Prediction resource occupation number needed for getting at least one service operation of the following specified time point using the present invention According to, it can be convenient and understand the following specified time possible occupation condition of point in advance, carry out the reply to occupation condition, Existing resource is adjusted in time, avoids the problems such as being unable to run because of service caused by inadequate resource, also avoids not conforming to Reason resource is expanded caused by resource free time, resource utilization is provided.Further, previously according to history achievement data and History resource occupation data are trained, and obtain resource occupation training pattern, are ensured and are obtained the accurate of prediction resource occupation data Property.
In the instructions provided here, numerous specific details are set forth.It is to be appreciated, however, that implementation of the invention Example can be practiced without these specific details.In some instances, well known method, structure is not been shown in detail And technology, so as not to obscure the understanding of this specification.
Similarly, it should be understood that in order to simplify the disclosure and help to understand one or more of the various inventive aspects, Above in the description of exemplary embodiment of the present invention, each feature of the invention is grouped together into single implementation sometimes In example, figure or descriptions thereof.However, the disclosed method should not be interpreted as reflecting the following intention: i.e. required to protect Shield the present invention claims features more more than feature expressly recited in each claim.More precisely, such as right As claim reflects, inventive aspect is all features less than single embodiment disclosed above.Therefore, it then follows tool Thus claims of body embodiment are expressly incorporated in the specific embodiment, wherein each claim conduct itself Separate embodiments of the invention.
Those skilled in the art will understand that can be carried out adaptively to the module in the equipment in embodiment Change and they are arranged in one or more devices different from this embodiment.It can be the module or list in embodiment Member or component are combined into a module or unit or component, and furthermore they can be divided into multiple submodule or subelement or Sub-component.Other than such feature and/or at least some of process or unit exclude each other, it can use any Combination is to all features disclosed in this specification (including adjoint claim, abstract and attached drawing) and so disclosed All process or units of what method or apparatus are combined.Unless expressly stated otherwise, this specification is (including adjoint power Benefit require, abstract and attached drawing) disclosed in each feature can carry out generation with an alternative feature that provides the same, equivalent, or similar purpose It replaces.
In addition, it will be appreciated by those of skill in the art that although some embodiments described herein include other embodiments In included certain features rather than other feature, but the combination of the feature of different embodiments mean it is of the invention Within the scope of and form different embodiments.For example, in detail in the claims, embodiment claimed it is one of any Can in any combination mode come using.
It should be noted that the above-mentioned embodiments illustrate rather than limit the invention, and ability Field technique personnel can be designed alternative embodiment without departing from the scope of the appended claims.In the claims, Any reference symbol between parentheses should not be configured to limitations on claims.Word "comprising" does not exclude the presence of not Element or step listed in the claims.Word "a" or "an" located in front of the element does not exclude the presence of multiple such Element.The present invention can be by means of including the hardware of several different elements and being come by means of properly programmed computer real It is existing.The use of word first, second, and third does not indicate any sequence.These words can be construed to title.
The invention discloses: a kind of resource occupation data predication method of A1. comprising:
Obtain the achievement data that at least one current service operation generates;
Current achievement data is predicted, the corresponding prediction index data of the following specified time point are obtained;
The prediction index data are inputted to the resource occupation training pattern pre-established, when obtaining corresponding following specified Between put at least one service operation needed for prediction resource occupation data.
A2. method according to a1, wherein it is described that current achievement data is predicted, when obtaining following specified Between put corresponding prediction index data and further comprise:
According to achievement data cyclophysis, current achievement data is predicted using preset prediction algorithm, is obtained The corresponding prediction index data of following specified time point.
A3. method according to a1, wherein the training process of the resource occupation training pattern includes:
Collecting sample data and sample labeled data;
The sample data is input to the output knot obtained to be trained in training pattern Suo Shu to training pattern Fruit;
According to the loss between the output result and the sample labeled data, the adjustment weight to training pattern Parameter obtains the resource occupation training pattern until meeting preset condition.
A4. method according to a3, wherein the sample data includes history caused by least one service operation Achievement data;The sample labeled data includes the history money that at least one service corresponding with the history achievement data occupies Source occupies data.
A5. the method according to any one of A1-A4, wherein input the prediction index data in advance described The resource occupation training pattern of foundation, prediction resource needed for obtaining corresponding at least one service operation of the following specified time point After occupying data, the method also includes:
Obtain the resource data available that server provides;
Judge the service whether the resource data available can run on support server;
If it is not, carrying out server resource alarming processing.
A6. method according to a5, wherein described to judge whether the resource data available be on support server The service of operation further comprises:
According at least one service run on server, calculate pre- needed for following specified time all service operations of point Survey the sum of resource occupation data;
It is pre- needed for all service operations of the following specified time point to judge whether the resource data available is greater than or equal to Survey the sum of resource occupation data;
If it is not, carrying out server resource alarming processing.
A7. method according to a1, wherein the achievement data include query rate per second, handling capacity, number of concurrent and/ Or the response time;The resource occupation data include that memory source occupies data, cpu resource occupies data, disk occupies data And/or flow occupies data.
The invention also discloses: B8. a kind of electronic equipment, comprising: processor, memory, communication interface and communication bus, The processor, the memory and the communication interface complete mutual communication by the communication bus;
For the memory for storing an at least executable instruction, it is following that the executable instruction executes the processor Operation:
Obtain the achievement data that at least one current service operation generates;
Current achievement data is predicted, the corresponding prediction index data of the following specified time point are obtained;
The prediction index data are inputted to the resource occupation training pattern pre-established, when obtaining corresponding following specified Between put at least one service operation needed for prediction resource occupation data.
B9. the electronic equipment according to B8, the executable instruction further make the processor execute following operation:
According to achievement data cyclophysis, current achievement data is predicted using preset prediction algorithm, is obtained The corresponding prediction index data of following specified time point.
B10. the electronic equipment according to B8, the executable instruction further make the processor execute following behaviour Make:
Collecting sample data and sample labeled data;
The sample data is input to the output knot obtained to be trained in training pattern Suo Shu to training pattern Fruit;
According to the loss between the output result and the sample labeled data, the adjustment weight to training pattern Parameter obtains the resource occupation training pattern until meeting preset condition.
B11. electronic equipment according to b10, the sample data include going through caused by least one service operation History achievement data;The sample labeled data includes the history that at least one service corresponding with the history achievement data occupies Resource occupation data.
B12. the electronic equipment according to any one of B8-B10, the executable instruction further make the processor Execute following operation:
Obtain the resource data available that server provides;
Judge the service whether the resource data available can run on support server;
If it is not, carrying out server resource alarming processing.
B13. electronic equipment according to b12, the executable instruction further make the processor execute following behaviour Make:
According at least one service run on server, calculate pre- needed for following specified time all service operations of point Survey the sum of resource occupation data;
It is pre- needed for all service operations of the following specified time point to judge whether the resource data available is greater than or equal to Survey the sum of resource occupation data;
If it is not, carrying out server resource alarming processing.
B14. the electronic equipment according to B8, the achievement data include query rate per second, handling capacity, number of concurrent and/ Or the response time;The resource occupation data include that memory source occupies data, cpu resource occupies data, disk occupies data And/or flow occupies data.
The invention also discloses a kind of computer storage medium of C15., being stored at least one in the storage medium can be held Row instruction, the executable instruction make processor execute following operation:
Obtain the achievement data that at least one current service operation generates;
Current achievement data is predicted, the corresponding prediction index data of the following specified time point are obtained;
The prediction index data are inputted to the resource occupation training pattern pre-established, when obtaining corresponding following specified Between put at least one service operation needed for prediction resource occupation data.
C16. the computer storage medium according to C15, it is following that the executable instruction further executes processor Operation:
According to achievement data cyclophysis, current achievement data is predicted using preset prediction algorithm, is obtained The corresponding prediction index data of following specified time point.
C17. the computer storage medium according to C15, it is following that the executable instruction further executes processor Operation:
Collecting sample data and sample labeled data;
The sample data is input to the output knot obtained to be trained in training pattern Suo Shu to training pattern Fruit;
According to the loss between the output result and the sample labeled data, the adjustment weight to training pattern Parameter obtains the resource occupation training pattern until meeting preset condition.
C18. the computer storage medium according to C17, the sample data include that at least one service operation is produced Raw history achievement data;The sample labeled data includes that at least one service corresponding with the history achievement data occupies History resource occupation data.
C19. the computer storage medium according to any one of C15-C18, the executable instruction further make to locate It manages device and executes following operation:
Obtain the resource data available that server provides;
Judge the service whether the resource data available can run on support server;
If it is not, carrying out server resource alarming processing.
C20. the computer storage medium according to C19, it is following that the executable instruction further executes processor Operation:
According at least one service run on server, calculate pre- needed for following specified time all service operations of point Survey the sum of resource occupation data;
It is pre- needed for all service operations of the following specified time point to judge whether the resource data available is greater than or equal to Survey the sum of resource occupation data;
If it is not, carrying out server resource alarming processing.
C21. the computer storage medium according to C15, the achievement data include query rate per second, handling capacity, simultaneously Send out number and/or response time;The resource occupation data include that memory source occupies data, cpu resource occupies data, disk accounts for Data are occupied with data and/or flow.

Claims (10)

1. a kind of resource occupation data predication method comprising:
Obtain the achievement data that at least one current service operation generates;
Current achievement data is predicted, the corresponding prediction index data of the following specified time point are obtained;
The prediction index data are inputted to the resource occupation training pattern pre-established, obtain the corresponding following specified time point Prediction resource occupation data needed at least one service operation.
2. it is described that current achievement data is predicted according to the method described in claim 1, wherein, it obtains following specified Time point, corresponding prediction index data further comprised:
According to achievement data cyclophysis, current achievement data is predicted using preset prediction algorithm, obtains future The corresponding prediction index data of specified time point.
3. according to the method described in claim 1, wherein, the training process of the resource occupation training pattern includes:
Collecting sample data and sample labeled data;
The sample data is input to the output result obtained to be trained in training pattern Suo Shu to training pattern;
According to the loss between the output result and the sample labeled data, the adjustment weight to training pattern is joined Number obtains the resource occupation training pattern until meeting preset condition.
4. according to the method described in claim 3, wherein, the sample data includes going through caused by least one service operation History achievement data;The sample labeled data includes the history that at least one service corresponding with the history achievement data occupies Resource occupation data.
5. method according to any of claims 1-4, wherein input the prediction index data in advance described The resource occupation training pattern of foundation, prediction resource needed for obtaining corresponding at least one service operation of the following specified time point After occupying data, the method also includes:
Obtain the resource data available that server provides;
Judge the service whether the resource data available can run on support server;
If it is not, carrying out server resource alarming processing.
6. described to judge whether the resource data available support server according to the method described in claim 5, wherein The service of upper operation further comprises:
According at least one service run on server, prediction needed for calculating following specified time all service operations of point is provided Source occupies the sum of data;
Judge that prediction needed for whether the resource data available is greater than or equal to all service operations of the following specified time point provides Source occupies the sum of data;
If it is not, carrying out server resource alarming processing.
7. according to the method described in claim 1, wherein, the achievement data includes query rate per second, handling capacity, number of concurrent And/or the response time;The resource occupation data include that memory source occupies data, cpu resource occupies data, disk occupies number According to and/or flow occupy data.
8. a kind of electronic equipment, comprising: processor, memory, communication interface and communication bus, the processor, the storage Device and the communication interface complete mutual communication by the communication bus;
The memory makes the processor execute following behaviour for storing an at least executable instruction, the executable instruction Make:
Obtain the achievement data that at least one current service operation generates;
Current achievement data is predicted, the corresponding prediction index data of the following specified time point are obtained;
The prediction index data are inputted to the resource occupation training pattern pre-established, obtain the corresponding following specified time point Prediction resource occupation data needed at least one service operation.
9. electronic equipment according to claim 8, the executable instruction further makes the processor execute following behaviour Make:
According to achievement data cyclophysis, current achievement data is predicted using preset prediction algorithm, obtains future The corresponding prediction index data of specified time point.
10. a kind of computer storage medium, an at least executable instruction, the executable instruction are stored in the storage medium Processor is set to execute following operation:
Obtain the achievement data that at least one current service operation generates;
Current achievement data is predicted, the corresponding prediction index data of the following specified time point are obtained;
The prediction index data are inputted to the resource occupation training pattern pre-established, obtain the corresponding following specified time point Prediction resource occupation data needed at least one service operation.
CN201811042964.7A 2018-09-06 2018-09-06 Resource occupation data predication method, electronic equipment, storage medium Pending CN109032914A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201811042964.7A CN109032914A (en) 2018-09-06 2018-09-06 Resource occupation data predication method, electronic equipment, storage medium

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201811042964.7A CN109032914A (en) 2018-09-06 2018-09-06 Resource occupation data predication method, electronic equipment, storage medium

Publications (1)

Publication Number Publication Date
CN109032914A true CN109032914A (en) 2018-12-18

Family

ID=64624458

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201811042964.7A Pending CN109032914A (en) 2018-09-06 2018-09-06 Resource occupation data predication method, electronic equipment, storage medium

Country Status (1)

Country Link
CN (1) CN109032914A (en)

Cited By (20)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109766244A (en) * 2019-01-04 2019-05-17 中国银行股份有限公司 A kind of distributed system CPU method for detecting abnormality, device and storage medium
CN109857550A (en) * 2019-01-07 2019-06-07 平安科技(深圳)有限公司 Resource allocation method, device, equipment and storage medium based on machine learning
CN109885469A (en) * 2019-02-27 2019-06-14 深信服科技股份有限公司 A kind of expansion method, prediction model creation method, device, equipment and medium
CN110502336A (en) * 2019-07-05 2019-11-26 深圳壹账通智能科技有限公司 A kind of starting method, apparatus, equipment and the readable storage medium storing program for executing of server
CN111143161A (en) * 2019-12-09 2020-05-12 东软集团股份有限公司 Log file processing method and device, storage medium and electronic equipment
WO2020140369A1 (en) * 2019-01-04 2020-07-09 平安科技(深圳)有限公司 Data recovery control method, server and storage medium
CN111475393A (en) * 2020-04-08 2020-07-31 拉扎斯网络科技(上海)有限公司 Service performance prediction method and device, electronic equipment and readable storage medium
CN111490886A (en) * 2019-01-25 2020-08-04 北京数安鑫云信息技术有限公司 Network data processing method and system
CN111507554A (en) * 2019-01-31 2020-08-07 北京嘀嘀无限科技发展有限公司 Service resource scheduling method, device, equipment and storage medium
CN111782386A (en) * 2020-03-17 2020-10-16 新浪网技术(中国)有限公司 Historical service flow-based database scheduling method and system
CN111858267A (en) * 2020-07-29 2020-10-30 中国工商银行股份有限公司 Early warning method and device, electronic equipment and storage medium
CN112446734A (en) * 2020-11-30 2021-03-05 上海寻梦信息技术有限公司 Method, device, equipment and storage medium for providing installation resources
CN112685280A (en) * 2019-10-17 2021-04-20 上海博泰悦臻电子设备制造有限公司 Vehicle-mounted machine new project evaluation method and system and computer-readable storage medium
CN112988371A (en) * 2019-12-13 2021-06-18 天翼电子商务有限公司 Machine room resource prediction method and device based on large-scale distributed operation and maintenance system
CN113220552A (en) * 2021-05-12 2021-08-06 湖北亿咖通科技有限公司 Method and electronic equipment for limiting application operation number in vehicle-mounted information entertainment system
CN113242149A (en) * 2021-05-21 2021-08-10 中国农业银行股份有限公司 Long connection configuration method, device, equipment, storage medium and program product
CN113778778A (en) * 2020-08-25 2021-12-10 北京沃东天骏信息技术有限公司 Early warning method and device
CN113900827A (en) * 2021-12-08 2022-01-07 北京广通优云科技股份有限公司 Memory adjustment prediction method based on multi-factor association in intelligent operation and maintenance system
CN114189482A (en) * 2021-12-14 2022-03-15 郑州阿帕斯数云信息科技有限公司 Control method, device and system for cluster resources
CN116610270A (en) * 2023-07-21 2023-08-18 湖南马栏山视频先进技术研究院有限公司 Video processing calculation and separation method and video calculation and separation system

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101639793A (en) * 2009-08-19 2010-02-03 南京邮电大学 Grid load predicting method based on support vector regression machine
CN102004671A (en) * 2010-11-15 2011-04-06 北京航空航天大学 Resource management method of data center based on statistic model in cloud computing environment
CN102799512A (en) * 2012-07-04 2012-11-28 南京邮电大学 Virtual machine monitoring method in vector-autoregression-based cloud computing
CN103425535A (en) * 2013-06-05 2013-12-04 浙江大学 Agile elastic telescoping method in cloud environment
CN107943579A (en) * 2017-11-08 2018-04-20 深圳前海微众银行股份有限公司 Resource bottleneck Forecasting Methodology, equipment, system and readable storage medium storing program for executing

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101639793A (en) * 2009-08-19 2010-02-03 南京邮电大学 Grid load predicting method based on support vector regression machine
CN102004671A (en) * 2010-11-15 2011-04-06 北京航空航天大学 Resource management method of data center based on statistic model in cloud computing environment
CN102799512A (en) * 2012-07-04 2012-11-28 南京邮电大学 Virtual machine monitoring method in vector-autoregression-based cloud computing
CN103425535A (en) * 2013-06-05 2013-12-04 浙江大学 Agile elastic telescoping method in cloud environment
CN107943579A (en) * 2017-11-08 2018-04-20 深圳前海微众银行股份有限公司 Resource bottleneck Forecasting Methodology, equipment, system and readable storage medium storing program for executing

Cited By (27)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2020140369A1 (en) * 2019-01-04 2020-07-09 平安科技(深圳)有限公司 Data recovery control method, server and storage medium
CN109766244A (en) * 2019-01-04 2019-05-17 中国银行股份有限公司 A kind of distributed system CPU method for detecting abnormality, device and storage medium
CN109857550A (en) * 2019-01-07 2019-06-07 平安科技(深圳)有限公司 Resource allocation method, device, equipment and storage medium based on machine learning
CN111490886A (en) * 2019-01-25 2020-08-04 北京数安鑫云信息技术有限公司 Network data processing method and system
CN111507554A (en) * 2019-01-31 2020-08-07 北京嘀嘀无限科技发展有限公司 Service resource scheduling method, device, equipment and storage medium
CN111507554B (en) * 2019-01-31 2022-07-22 北京骑胜科技有限公司 Service resource scheduling method, device, equipment and storage medium
CN109885469A (en) * 2019-02-27 2019-06-14 深信服科技股份有限公司 A kind of expansion method, prediction model creation method, device, equipment and medium
CN109885469B (en) * 2019-02-27 2022-09-30 深信服科技股份有限公司 Capacity expansion method, prediction model creation method, device, equipment and medium
CN110502336A (en) * 2019-07-05 2019-11-26 深圳壹账通智能科技有限公司 A kind of starting method, apparatus, equipment and the readable storage medium storing program for executing of server
CN112685280A (en) * 2019-10-17 2021-04-20 上海博泰悦臻电子设备制造有限公司 Vehicle-mounted machine new project evaluation method and system and computer-readable storage medium
CN111143161B (en) * 2019-12-09 2024-04-09 东软集团股份有限公司 Log file processing method and device, storage medium and electronic equipment
CN111143161A (en) * 2019-12-09 2020-05-12 东软集团股份有限公司 Log file processing method and device, storage medium and electronic equipment
CN112988371A (en) * 2019-12-13 2021-06-18 天翼电子商务有限公司 Machine room resource prediction method and device based on large-scale distributed operation and maintenance system
CN111782386A (en) * 2020-03-17 2020-10-16 新浪网技术(中国)有限公司 Historical service flow-based database scheduling method and system
CN111475393A (en) * 2020-04-08 2020-07-31 拉扎斯网络科技(上海)有限公司 Service performance prediction method and device, electronic equipment and readable storage medium
CN111858267B (en) * 2020-07-29 2024-01-05 中国工商银行股份有限公司 Early warning method, early warning device, electronic equipment and storage medium
CN111858267A (en) * 2020-07-29 2020-10-30 中国工商银行股份有限公司 Early warning method and device, electronic equipment and storage medium
CN113778778A (en) * 2020-08-25 2021-12-10 北京沃东天骏信息技术有限公司 Early warning method and device
CN112446734A (en) * 2020-11-30 2021-03-05 上海寻梦信息技术有限公司 Method, device, equipment and storage medium for providing installation resources
CN113220552A (en) * 2021-05-12 2021-08-06 湖北亿咖通科技有限公司 Method and electronic equipment for limiting application operation number in vehicle-mounted information entertainment system
CN113242149A (en) * 2021-05-21 2021-08-10 中国农业银行股份有限公司 Long connection configuration method, device, equipment, storage medium and program product
CN113242149B (en) * 2021-05-21 2024-02-02 中国农业银行股份有限公司 Long connection configuration method, apparatus, device, storage medium, and program product
CN113900827A (en) * 2021-12-08 2022-01-07 北京广通优云科技股份有限公司 Memory adjustment prediction method based on multi-factor association in intelligent operation and maintenance system
CN113900827B (en) * 2021-12-08 2022-03-15 北京广通优云科技股份有限公司 Memory adjustment prediction method based on multi-factor association in intelligent operation and maintenance system
CN114189482A (en) * 2021-12-14 2022-03-15 郑州阿帕斯数云信息科技有限公司 Control method, device and system for cluster resources
CN116610270A (en) * 2023-07-21 2023-08-18 湖南马栏山视频先进技术研究院有限公司 Video processing calculation and separation method and video calculation and separation system
CN116610270B (en) * 2023-07-21 2023-10-03 湖南马栏山视频先进技术研究院有限公司 Video processing calculation and separation method and video calculation and separation system

Similar Documents

Publication Publication Date Title
CN109032914A (en) Resource occupation data predication method, electronic equipment, storage medium
US11586692B2 (en) Streaming data processing
US20230049579A1 (en) Executing commands from a distributed execution model
US20220327149A1 (en) Dynamic partition allocation for query execution
US11636105B2 (en) Generating a subquery for an external data system using a configuration file
US11604795B2 (en) Distributing partial results from an external data system between worker nodes
US11580107B2 (en) Bucket data distribution for exporting data to worker nodes
US11615104B2 (en) Subquery generation based on a data ingest estimate of an external data system
US11232100B2 (en) Resource allocation for multiple datasets
US10726009B2 (en) Query processing using query-resource usage and node utilization data
US11416528B2 (en) Query acceleration data store
US11126632B2 (en) Subquery generation based on search configuration data from an external data system
US11461334B2 (en) Data conditioning for dataset destination
US11586627B2 (en) Partitioning and reducing records at ingest of a worker node
US11314753B2 (en) Execution of a query received from a data intake and query system
US11663227B2 (en) Generating a subquery for a distinct data intake and query system
US11243963B2 (en) Distributing partial results to worker nodes from an external data system
US10795884B2 (en) Dynamic resource allocation for common storage query
US10698897B2 (en) Executing a distributed execution model with untrusted commands
US20190147085A1 (en) Converting and modifying a subquery for an external data system
US20180089259A1 (en) External dataset capability compensation
AU2013221760B2 (en) Providing configurable workflow capabilities
AU2023241398A1 (en) Continuous data sensing of functional states of networked computing devices to determine efficiency metrics for servicing electronic messages asynchronously
WO2020027867A1 (en) Generating a subquery for a distinct data intake and query system
CN109831478A (en) Rule-based and model distributed processing intelligent decision system and method in real time

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
RJ01 Rejection of invention patent application after publication

Application publication date: 20181218

RJ01 Rejection of invention patent application after publication