CN117573376B - Data center resource scheduling monitoring management method and system - Google Patents
Data center resource scheduling monitoring management method and system Download PDFInfo
- Publication number
- CN117573376B CN117573376B CN202410057239.6A CN202410057239A CN117573376B CN 117573376 B CN117573376 B CN 117573376B CN 202410057239 A CN202410057239 A CN 202410057239A CN 117573376 B CN117573376 B CN 117573376B
- Authority
- CN
- China
- Prior art keywords
- access
- demand
- requirement
- users
- data
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000012544 monitoring process Methods 0.000 title claims abstract description 20
- 238000007726 management method Methods 0.000 title claims abstract description 17
- 238000012216 screening Methods 0.000 claims abstract description 65
- 238000000034 method Methods 0.000 claims abstract description 32
- 238000013468 resource allocation Methods 0.000 claims abstract description 23
- 238000012545 processing Methods 0.000 claims abstract description 15
- 238000011156 evaluation Methods 0.000 claims description 123
- 238000004590 computer program Methods 0.000 claims description 6
- 230000004044 response Effects 0.000 description 4
- 230000009286 beneficial effect Effects 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 238000012986 modification Methods 0.000 description 2
- 230000008569 process Effects 0.000 description 2
- 230000004075 alteration Effects 0.000 description 1
- 238000010586 diagram Methods 0.000 description 1
- 230000006872 improvement Effects 0.000 description 1
- 238000010606 normalization Methods 0.000 description 1
- 230000000750 progressive effect Effects 0.000 description 1
Classifications
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
- Y02D—CLIMATE CHANGE MITIGATION TECHNOLOGIES IN INFORMATION AND COMMUNICATION TECHNOLOGIES [ICT], I.E. INFORMATION AND COMMUNICATION TECHNOLOGIES AIMING AT THE REDUCTION OF THEIR OWN ENERGY USE
- Y02D10/00—Energy efficient computing, e.g. low power processors, power management or thermal management
Landscapes
- Management, Administration, Business Operations System, And Electronic Commerce (AREA)
Abstract
The invention provides a data center resource scheduling monitoring management method and system, which belong to the technical field of data processing and specifically comprise the following steps: the method comprises the steps of determining access requirements of different edge servers through running logs of different edge servers of a data center, performing requirement assessment of different access requirements and determination of screening access requirements according to access data amounts of different access requirements and access user data, taking the screening access requirements as assessment access requirements when the number of idle dates of the screening access requirements in preset time meets requirements, determining requirement fluctuation amounts of the assessment access requirements through fluctuation conditions of the idle assessment amounts among different adjacent dates and distribution data of the idle dates, and performing resource allocation of the edge servers of the data center through the requirement assessment amounts of the access requirements, the idle assessment amounts of different dates, the number of the idle dates and the requirement fluctuation amounts, so that processing efficiency of the access requirements is improved.
Description
Technical Field
The invention belongs to the technical field of data processing, and particularly relates to a data center resource scheduling monitoring management method and system.
Background
In order to solve the problem of reducing the response time of a server of a user, in the prior art, a part of traffic is unloaded through a mobile edge operation (Mobile Edge Computing, MEC) server, and is directly processed and responded to the user, specifically, in a load balancing and scheduling method for mobile edge operation of patent CN202110676139.8, the user equipment is clustered through the use of a K-means algorithm, and then a service copy of the user equipment is deployed on an edge server closest to a cluster center, so as to reduce the distance between the user equipment and an edge node, thereby reducing the response time of the service, but the following technical problems exist:
the access flow requirements of different user equipment are not fixed, and meanwhile, the requirements of the access flow requirements in a certain area are different to a certain extent, so that if the monitoring analysis results of the factors cannot be comprehensively considered to schedule and manage the data center resources, timeliness and reliability of processing of the access requirements of the user cannot be realized.
The invention provides a data center resource scheduling monitoring management method and system aiming at the technical problems.
Disclosure of Invention
In order to achieve the purpose of the invention, the invention adopts the following technical scheme:
according to one aspect of the invention, a data center resource scheduling monitoring management method is provided.
The data center resource scheduling monitoring management method is characterized by comprising the following steps of:
s1, determining access requirements of different edge servers through running logs of the different edge servers of a data center, and performing requirement assessment of different access requirements and determination of screening access requirements according to access data amounts of the different access requirements and access user data;
s2, carrying out access demand evaluation of screening access demands in different time periods of different dates and determination of idle time periods based on access users in different time periods of different dates and access data amounts of the access users in preset time, carrying out idle evaluation of screening access demands in different dates and determination of idle date in the preset time in combination with the access users in different dates and the access data amounts of the access users, and taking the screening access demands as evaluation access demands when the quantity of idle dates of the screening access demands in the preset time meets the requirements;
s3, determining the demand fluctuation amount of the access demand through the fluctuation situation of the idle evaluation amount between different adjacent dates and the distribution data of the idle dates, and carrying out resource allocation of the edge server of the data center through the demand evaluation amount of the access demand, the idle evaluation amount of different dates, the quantity of the idle dates and the demand fluctuation amount.
The invention has the beneficial effects that:
1. the access data quantity of different access requirements and the access user data are used for carrying out the requirement assessment of the different access requirements and the determination of screening the access requirements, so that the difference of the access data quantity of the unused access requirements and the access user is fully considered, the screening of the screened access requirements with larger requirement quantity is realized, and a foundation is laid for further targeted screening of the access requirements for unloading processing.
2. The method has the advantages that the access demand evaluation quantity, the idle time period, the access users with different dates and the access data quantity of the access users are combined to carry out idle evaluation quantity and idle date determination of screening access demands with different dates within preset time, the difference of idle conditions of different dates caused by the difference of idle time periods of different screening access demands is considered, meanwhile, the accurate evaluation of idle conditions of screening access demands with different dates is realized by further combining the access users with different dates and the access data quantity of the access users, and a foundation is laid for further realizing screening of evaluation access demands.
3. The resource allocation of the edge server of the data center is carried out by evaluating the demand evaluation quantity of the access demands, the idle evaluation quantity of different dates, the quantity of idle dates and the demand fluctuation quantity, so that the resource allocation of the edge server of the data center is carried out on the fluctuation condition of the demands of different dates and the demand condition of the data center for evaluating the access demands, the allocation reliability of the data center is improved, and the response processing efficiency of users is further reduced.
The further technical scheme is that the access requirement is determined according to the data types of the access data of the access users of different edge servers.
A further technical solution is that the value of the demand evaluation of the access demand ranges from 0 to 1, wherein the larger the demand evaluation of the access demand is, the larger the service demand of the access demand is.
Further, when the requirement evaluation value of the access requirement is greater than a preset evaluation value threshold, it is determined that the access requirement belongs to a screening access requirement.
Further, when the number of idle dates of the screening access requirement in the preset time does not meet the requirement, it is determined that the screening access requirement does not belong to the evaluation access requirement, and unloading processing of the screening access requirement is not needed.
The further technical scheme is that the method for determining the resource allocation of the edge server of the data center comprises the following steps:
determining the comprehensive demand evaluation amount of the access demand through idle evaluation amounts, the number of idle dates and the demand evaluation amount of the access demand, and determining the resource allocation demand evaluation amount of the access demand by combining the demand fluctuation amount of the access demand;
and determining the resource allocation space of the edge server for evaluating the access demand through the resource allocation demand evaluation quantity for evaluating the access demand.
In a second aspect, the present invention provides a computer system comprising: a communicatively coupled memory and processor, and a computer program stored on the memory and capable of running on the processor, characterized by: and executing the data center resource scheduling monitoring management method when the processor runs the computer program.
Additional features and advantages of the invention will be set forth in the description which follows, and in part will be apparent from the description, or may be learned by practice of the invention as set forth hereinafter.
In order to make the above objects, features and advantages of the present invention more comprehensible, preferred embodiments accompanied with figures are described in detail below.
Drawings
The above and other features and advantages of the present invention will become more apparent by describing in detail exemplary embodiments thereof with reference to the attached drawings;
FIG. 1 is a flow chart of a method of data center resource scheduling monitoring management;
FIG. 2 is a flow chart of a method of determining a demand assessment of an access demand;
FIG. 3 is a flow chart of a method of determining an access demand assessment of a period;
FIG. 4 is a flow chart of a method of determining an idle assessment of a date;
FIG. 5 is a flow chart of a method of evaluating a determination of a demand fluctuation amount of an access demand;
FIG. 6 is a block diagram of a computer system.
Detailed Description
In order to make the technical solutions in the present specification better understood by those skilled in the art, the technical solutions in the embodiments of the present specification will be clearly and completely described below with reference to the drawings in the embodiments of the present specification, and it is obvious that the described embodiments are only some embodiments of the present specification, not all embodiments. All other embodiments, which can be made by one of ordinary skill in the art based on the embodiments herein without making any inventive effort, shall fall within the scope of the present disclosure.
The mobile edge operation (Mobile Edge Computing, MEC) server of the data center unloads a part of traffic, directly processes and responds to the user, so that the processing efficiency of the user is further improved, and as different access requirements have certain differences, how to combine the differences of the access requirements of the data center to realize the resource scheduling processing of the edge server becomes a technical problem to be solved urgently.
In order to solve the technical problems, the following technical scheme is adopted:
determining the access requirements of different edge servers through the operation logs of different edge servers of a data center, performing the requirement assessment of different access requirements and the determination of screening access requirements according to the access data quantity of different access requirements and the access user data, specifically, determining the requirement assessment quantity by the ratio of the access data quantity to the preset data quantity and the ratio of the number of access users to the preset access user quantity, and taking the access requirement with larger requirement assessment quantity as the screening access requirement;
then, based on the access users in different time periods of different dates and the access data amount of the access users in preset time, carrying out screening on access requirement evaluation amounts of the access requirements in different time periods of different dates and determination of idle time periods, specifically, carrying out determination on access requirement evaluation amounts of different time periods by the number of the access users with the access data amount larger than a preset access data amount threshold, taking fewer access requirement evaluation amounts as idle time periods, carrying out screening on idle evaluation amounts of different dates of the access requirements in the preset time and determination on idle date by combining the access users with the access data amount of the access users in different dates, specifically, carrying out normalization processing on the number of the access users with the access data amount larger than the preset access data amount threshold and the number of the space time periods and carrying out determination on idle evaluation amounts of different dates, taking the date with the larger idle evaluation amount as idle date, and taking the screening access requirement as the access requirement when the number of idle dates of the screening access requirements in the preset time is smaller;
and finally, determining the demand fluctuation quantity of the access demand through the fluctuation situation of the idle assessment quantity among different adjacent dates and the distribution data of the idle dates, specifically determining the demand fluctuation quantity through the quantity ratio of the dates with the idle fluctuation quantity larger than a preset fluctuation quantity threshold, performing the resource allocation of the edge server of the data center through the demand assessment quantity of the access demand, the idle assessment quantity of different dates, the quantity of the idle dates and the demand fluctuation quantity, specifically determining the comprehensive demand quantity of different assessment access demands through the quantity ratio of the idle dates, the average value of the idle assessment quantity and the product of the demand assessment quantity of the access demand, and then determining the space of the resource allocation of the edge server of the data center according to the product of the comprehensive demand quantity and the demand fluctuation quantity.
The following will be elaborated from both a method class and a system class.
In order to solve the above problem, according to one aspect of the present invention, as shown in fig. 1, there is provided a data center resource scheduling monitoring management method, which is characterized by specifically including:
s1, determining access requirements of different edge servers through running logs of the different edge servers of a data center, and performing requirement assessment of different access requirements and determination of screening access requirements according to access data amounts of the different access requirements and access user data;
it should be noted that the access requirement is determined according to the data types of the access data of the access users of different edge servers.
In a possible embodiment, as shown in fig. 2, the method for determining the requirement assessment amount of the access requirement in the step S1 is:
s11, acquiring the access data volume of the access requirement, judging whether the access data volume of the access requirement is larger than a preset data volume, if so, entering a step S13, and if not, entering a next step;
s12, determining the number of access users of the access requirement through the access user data of the access requirement, judging whether the number of access users of the access requirement is larger than the preset number of users, if so, entering the next step, and if not, determining that the access requirement does not belong to the screening access requirement;
s13, determining the number of the dates of which the access data amount does not meet the requirements in the preset time through the access data amounts of the access requirements in different dates in the preset time, and determining an access data amount evaluation value of the access requirements by combining the average value of the access data amounts of the dates of which the access data amount does not meet the requirements in the preset time and the average value of the access data amounts of the different dates in the preset time;
in a possible embodiment, the determination of the access data amount evaluation value of the access requirement is performed by a product of a number of dates where the access data amount does not meet the requirement, a ratio of a mean value of the access data amounts of the dates where the different access data amounts do not meet the requirement within the preset time to a mean value of the access data amounts of the different dates within the preset time.
S14, determining the number of the access users of which the number of the access users does not meet the requirement in the preset time based on the number of the access users of which the number of the access users does not meet the requirement in the preset time, and determining a user number evaluation value of the access requirement according to the average value of the number of the access users of which the number of the access users does not meet the requirement in the preset time and the average value of the number of the access users of which the number of the access users does not meet the requirement in the preset time;
in a further possible embodiment, the determination of the user number evaluation value of the access demand is performed by a product of a ratio of the number of dates where the number of access users in the preset time does not meet the demand to the number of times, a mean of the number of access users where the number of different access users in the preset time does not meet the demand to the mean of the number of access users in the different dates in the preset time.
S15, acquiring the access data quantity of the access requirement and the quantity of access users, and determining the requirement assessment quantity of the access requirement by combining the access data quantity assessment value and the user quantity assessment value of the access requirement.
It will be appreciated that the demand assessment of the access demand has a value ranging from 0 to 1, wherein the greater the demand assessment of the access demand, the greater the traffic demand of the access demand.
In another possible embodiment, the method for determining the requirement assessment amount of the access requirement in the step S1 is:
acquiring the access data volume of the access requirement, and determining that the access requirement does not belong to the screening access requirement when the access data volume of the access requirement does not meet the requirement;
when the amount of access data of the access requirement meets the requirement,
determining the number of the dates when the access data amount does not meet the requirement according to the access data amount of the access requirement in different dates in preset time, determining the access data amount evaluation value of the access requirement according to the average value of the access data amounts of the dates when the access data amount does not meet the requirement in the preset time and the average value of the access data amounts of the different dates in the preset time, judging whether the access data amount evaluation value of the access requirement meets the requirement, if yes, entering the next step, and if no, determining that the access requirement does not belong to the screening access requirement;
determining the number of the access users with the number which does not meet the requirement in the preset time based on the number of the access users with the different dates in the preset time, determining the user number evaluation value of the access requirement according to the average value of the number of the access users with the number which does not meet the requirement in the preset time and the average value of the number of the access users with the different dates in the preset time, judging whether the user number evaluation value of the access requirement meets the requirement, if yes, entering the next step, and if no, determining that the access requirement does not belong to the screening access requirement; the method comprises the steps of carrying out a first treatment on the surface of the
And acquiring the access data quantity of the access requirement and the quantity of the access users, and determining the requirement assessment quantity of the access requirement by combining the access data quantity assessment value and the user quantity assessment value of the access requirement.
It should be further noted that, when the requirement evaluation value of the access requirement is greater than a preset evaluation threshold value, it is determined that the access requirement belongs to the screening access requirement.
S2, carrying out access demand evaluation of screening access demands in different time periods of different dates and determination of idle time periods based on access users in different time periods of different dates and access data amounts of the access users in preset time, carrying out idle evaluation of screening access demands in different dates and determination of idle date in the preset time in combination with the access users in different dates and the access data amounts of the access users, and taking the screening access demands as evaluation access demands when the quantity of idle dates of the screening access demands in the preset time meets the requirements;
in a possible embodiment, as shown in fig. 3, the method for determining the access requirement assessment amount of the period in the step S2 is as follows:
dividing the access users of the period into frequent users and other users based on the access data amount of the access users of the period, and determining the access demand assessment amount of the frequent users and the access demand assessment amount of the other users according to the access data amount of the frequent users and the number of the frequent users, the access data amount of the other users and the number of the other users respectively;
and determining the weight value of the access demand assessment value of the frequent user and the weight value of the access demand assessment value of the other user according to the access data quantity of the frequent user and the access data quantity of the other user, and determining the access demand assessment value of the period according to the access demand assessment value of the frequent user and the access demand assessment value of the other user.
In a possible embodiment, as shown in fig. 4, the method for determining the idle evaluation amount of the date in the step S2 is as follows:
s21, determining a basic idle evaluation quantity of the date according to the screening access requirement on the access data quantity of the date, the number of access users and the access data quantity of different access users, judging the basic idle evaluation quantity of the date to determine whether the date belongs to a suspected idle date, if so, entering a next step, and if not, entering a step S24;
s22, acquiring the number of idle time periods of the date, determining whether the date belongs to the idle date or not by combining the time period proportion of the idle time periods of the date, if so, determining that the date belongs to the idle date, determining the idle evaluation of the date through the basic idle evaluation of the date, and if not, entering the next step;
s23, determining the number of time periods in which the access demand evaluation value of the date is larger than a preset access demand threshold value through the access demand evaluation values of different time periods of the date, combining the number of the access demand evaluation values of the time periods in which the access demand evaluation value of the date is larger than the preset access demand threshold value with the determination of the access busyness of the date, determining whether the date belongs to an idle date through the access busyness of the date, if yes, determining that the date belongs to the idle date, determining the idle evaluation value of the date through the basis idle evaluation value of the date, and if no, entering the next step;
s24, determining the average value and the maximum value of the access demand evaluation values of the different time periods of the date through the access demand evaluation values of the different time periods of the date, and determining the time period idle evaluation value of the date by combining the number of idle time periods of the date and the average value of the access demand evaluation values of the different idle time periods;
s25, taking the time period when the access demand evaluation value is larger than the preset access demand threshold value as a peak time period, determining the longest duration of different peak time periods and the average value of the duration based on the time corresponding to the peak time period, and correcting the basic idle evaluation value of the date by combining the access busyness and the time idle evaluation value of the date to obtain the idle evaluation value of the date.
In another possible embodiment, the method for determining the idle evaluation amount of the date in the step S2 is as follows:
determining a basic idle evaluation amount of the date according to the access data amount, the number of access users and the access data amount of different access users of the screening access requirement on the date, determining whether the date belongs to a suspected idle date or not based on the idle evaluation amount of the date, if so, determining the idle evaluation amount of the date according to the basic idle evaluation amount of the date, and if not, entering the next step;
taking the time period when the access demand evaluation quantity is larger than the preset access demand threshold value as a peak time period, determining the longest duration of the continuous peak time period and the average value of the duration based on the time corresponding to the peak time period, and determining the comprehensive idle evaluation quantity of the peak time period of the date by combining the number of the continuous peak time periods, the number of the access users in different continuous peak time periods and the access data quantity of the access users in different continuous peak time periods;
determining the average value and the maximum value of the access demand evaluation values of different time periods of the date according to the access demand evaluation values of different time periods of the date, and determining the time period idle evaluation value of the date by combining the number of idle time periods of the date and the average value of the access demand evaluation values of different idle time periods;
and acquiring the number of the peak periods of the date and the idle evaluation values of different peak periods, and correcting the basic idle evaluation value of the date by combining the comprehensive idle evaluation value and the time period idle evaluation value of the peak period of the date to obtain the idle evaluation value of the date.
It can be appreciated that when the number of idle dates of the screening access requirement in the preset time does not meet the requirement, it is determined that the screening access requirement does not belong to the evaluation access requirement, and unloading processing of the screening access requirement is not required.
S3, determining the demand fluctuation amount of the access demand through the fluctuation situation of the idle evaluation amount between different adjacent dates and the distribution data of the idle dates, and carrying out resource allocation of the edge server of the data center through the demand evaluation amount of the access demand, the idle evaluation amount of different dates, the quantity of the idle dates and the demand fluctuation amount.
In a possible embodiment, as shown in fig. 5, the method for determining the requirement fluctuation amount of the access requirement in the step S3 is:
determining fluctuation amounts of idle evaluation amounts among different adjacent dates according to fluctuation conditions of the idle evaluation amounts among the different adjacent dates, determining the quantity of fluctuation dates in preset time based on the fluctuation amounts, judging whether the quantity of the fluctuation dates in the preset time meets requirements, if yes, entering the next step, and if not, determining the demand fluctuation amounts of the evaluation access demands according to the quantity of the fluctuation dates;
determining the comprehensive fluctuation amount of the fluctuation date of the estimated access demand in the preset time according to the quantity of the fluctuation dates and the fluctuation amounts of the idle estimated values of different fluctuation dates, judging whether the comprehensive fluctuation amount of the fluctuation date of the estimated access demand in the preset time meets the requirement, if so, entering the next step, and if not, determining the demand fluctuation amount of the estimated access demand according to the comprehensive fluctuation amount;
determining the interval time among different idle dates by using the distribution data of the idle dates in the preset time, determining the number of the idle dates, of which the interval time is smaller than the preset interval time, in the preset time by using the interval time, and determining the distribution uniformity of the idle dates by combining the average value of the interval time of the different idle dates;
the method comprises the steps of determining fluctuation amounts of access demand evaluation measures of different time periods of different dates according to the access demand evaluation measures of the different time periods of the different dates, determining comprehensive fluctuation amounts of the different time periods based on the fluctuation amounts of the access demand evaluation measures of the different time periods of the different dates, and determining the demand fluctuation amounts of the evaluation access demands according to the comprehensive fluctuation amounts of the different time periods, the distribution uniformity of idle dates and the comprehensive fluctuation amounts of fluctuation dates in preset time.
In a possible embodiment, the method for determining the resource allocation of the edge server of the data center in the step S3 is as follows:
determining the comprehensive demand evaluation amount of the access demand through idle evaluation amounts, the number of idle dates and the demand evaluation amount of the access demand, and determining the resource allocation demand evaluation amount of the access demand by combining the demand fluctuation amount of the access demand;
and determining the resource allocation space of the edge server for evaluating the access demand through the resource allocation demand evaluation quantity for evaluating the access demand.
In another aspect, as shown in FIG. 6, the present invention provides a computer system comprising: a communicatively coupled memory and processor, and a computer program stored on the memory and capable of running on the processor, characterized by: and executing the data center resource scheduling monitoring management method when the processor runs the computer program.
The data center resource scheduling monitoring management method specifically comprises the following steps:
determining access requirements of different edge servers through operation logs of different edge servers of a data center, acquiring access data volume of the access requirements, and determining that the access requirements do not belong to screening access requirements when the access data volume of the access requirements does not meet the requirements;
when the amount of access data of the access requirement meets the requirement,
determining the number of the dates when the access data amount does not meet the requirement according to the access data amount of the access requirement in different dates in preset time, determining the access data amount evaluation value of the access requirement according to the average value of the access data amounts of the dates when the access data amount does not meet the requirement in the preset time and the average value of the access data amounts of the different dates in the preset time, judging whether the access data amount evaluation value of the access requirement meets the requirement, if yes, entering the next step, and if no, determining that the access requirement does not belong to the screening access requirement;
determining the number of the access users with the number which does not meet the requirement in the preset time based on the number of the access users with the different dates in the preset time, determining the user number evaluation value of the access requirement according to the average value of the number of the access users with the number which does not meet the requirement in the preset time and the average value of the number of the access users with the different dates in the preset time, judging whether the user number evaluation value of the access requirement meets the requirement, if yes, entering the next step, and if no, determining that the access requirement does not belong to the screening access requirement;
acquiring the access data quantity of the access requirement and the quantity of access users, and determining the requirement assessment quantity of the access requirement by combining the access data quantity assessment value and the user quantity assessment value of the access requirement;
the method comprises the steps that access requirement evaluation amounts and idle time periods of screening access requirements in different time periods of different dates are determined based on access users in different time periods of different dates and access data amounts of the access users in preset time, idle evaluation amounts and idle time periods of the screening access requirements in different dates of different dates are determined by combining the access users in different dates and the access data amounts of the access users, and when the number of the idle time periods of the screening access requirements in the preset time meets requirements, the screening access requirements are used as evaluation access requirements;
determining fluctuation amounts of idle evaluation amounts among different adjacent dates according to fluctuation conditions of the idle evaluation amounts among the different adjacent dates, determining the quantity of fluctuation dates in preset time based on the fluctuation amounts, judging whether the quantity of the fluctuation dates in the preset time meets requirements, if yes, entering the next step, and if not, determining the demand fluctuation amounts of the evaluation access demands according to the quantity of the fluctuation dates;
determining the comprehensive fluctuation amount of the fluctuation date of the estimated access demand in the preset time according to the quantity of the fluctuation dates and the fluctuation amounts of the idle estimated values of different fluctuation dates, judging whether the comprehensive fluctuation amount of the fluctuation date of the estimated access demand in the preset time meets the requirement, if so, entering the next step, and if not, determining the demand fluctuation amount of the estimated access demand according to the comprehensive fluctuation amount;
determining the interval time among different idle dates by using the distribution data of the idle dates in the preset time, determining the number of the idle dates, of which the interval time is smaller than the preset interval time, in the preset time by using the interval time, and determining the distribution uniformity of the idle dates by combining the average value of the interval time of the different idle dates;
the method comprises the steps of determining fluctuation amounts of access demand assessment amounts of different time periods of different dates according to the access demand assessment amounts of different time periods of different dates, determining comprehensive fluctuation amounts of different time periods based on the fluctuation amounts of the access demand assessment amounts of different time periods of different dates, determining the demand fluctuation amounts of the access demand assessment amounts through the comprehensive fluctuation amounts of different time periods, distribution uniformity of idle dates and the comprehensive fluctuation amounts of fluctuation dates in preset time, and performing resource allocation of an edge server of the data center through the demand assessment amounts of the access demand assessment amounts, the idle assessment amounts of different dates and the quantity of idle dates and the demand fluctuation amounts.
Through the above embodiments, the present invention has the following beneficial effects:
1. the access data quantity of different access requirements and the access user data are used for carrying out the requirement assessment of the different access requirements and the determination of screening the access requirements, so that the difference of the access data quantity of the unused access requirements and the access user is fully considered, the screening of the screened access requirements with larger requirement quantity is realized, and a foundation is laid for further targeted screening of the access requirements for unloading processing.
2. The method has the advantages that the access demand evaluation quantity, the idle time period, the access users with different dates and the access data quantity of the access users are combined to carry out idle evaluation quantity and idle date determination of screening access demands with different dates within preset time, the difference of idle conditions of different dates caused by the difference of idle time periods of different screening access demands is considered, meanwhile, the accurate evaluation of idle conditions of screening access demands with different dates is realized by further combining the access users with different dates and the access data quantity of the access users, and a foundation is laid for further realizing screening of evaluation access demands.
3. The resource allocation of the edge server of the data center is carried out by evaluating the demand evaluation quantity of the access demands, the idle evaluation quantity of different dates, the quantity of idle dates and the demand fluctuation quantity, so that the resource allocation of the edge server of the data center is carried out on the fluctuation condition of the demands of different dates and the demand condition of the data center for evaluating the access demands, the allocation reliability of the data center is improved, and the response processing efficiency of users is further reduced.
In this specification, each embodiment is described in a progressive manner, and identical and similar parts of each embodiment are all referred to each other, and each embodiment mainly describes differences from other embodiments. In particular, for apparatus, devices, non-volatile computer storage medium embodiments, the description is relatively simple, as it is substantially similar to method embodiments, with reference to the section of the method embodiments being relevant.
The foregoing describes specific embodiments of the present disclosure. Other embodiments are within the scope of the following claims. In some cases, the actions or steps recited in the claims can be performed in a different order than in the embodiments and still achieve desirable results. In addition, the processes depicted in the accompanying figures do not necessarily require the particular order shown, or sequential order, to achieve desirable results. In some embodiments, multitasking and parallel processing are also possible or may be advantageous.
The foregoing is merely one or more embodiments of the present description and is not intended to limit the present description. Various modifications and alterations to one or more embodiments of this description will be apparent to those skilled in the art. Any modification, equivalent replacement, improvement, or the like, which is within the spirit and principles of one or more embodiments of the present description, is intended to be included within the scope of the claims of the present description.
Claims (7)
1. The data center resource scheduling monitoring management method is characterized by comprising the following steps of:
determining the access requirements of different edge servers through the operation logs of the different edge servers of the data center, and performing the requirement assessment of different access requirements and the determination of screening the access requirements according to the access data quantity of the different access requirements and the access user data;
the method comprises the steps that access requirement evaluation amounts and idle time periods of screening access requirements in different time periods of different dates are determined based on access users in different time periods of different dates and access data amounts of the access users in preset time, idle evaluation amounts and idle time periods of the screening access requirements in different dates of different dates are determined by combining the access users in different dates and the access data amounts of the access users, and when the number of the idle time periods of the screening access requirements in the preset time meets requirements, the screening access requirements are used as evaluation access requirements;
determining the demand fluctuation amount of the access demand through the change condition of idle assessment values among different adjacent dates and the distribution data of the idle dates, and carrying out resource allocation of an edge server of the data center through the demand assessment values of the access demand, the idle assessment values of different dates, the number of the idle dates and the demand fluctuation amount;
determining access demand assessment amounts of different time periods through the number of access users with access data amounts larger than a preset access data amount threshold, determining idle time periods according to the access demand assessment amounts, and screening the idle assessment amounts and the idle date determinations of different dates of the access demands in preset time according to the access users with different dates and the access data amounts of the access users;
the method for determining the demand assessment amount of the access demand comprises the following steps:
s11, acquiring the access data volume of the access requirement, judging whether the access data volume of the access requirement is larger than a preset data volume, if so, entering a step S13, and if not, entering a next step;
s12, determining the number of access users of the access requirement through the access user data of the access requirement, judging whether the number of access users of the access requirement is larger than the preset number of users, if so, entering the next step, and if not, determining that the access requirement does not belong to the screening access requirement;
s13, determining the number of the dates of which the access data amount does not meet the requirements in the preset time through the access data amounts of the access requirements in different dates in the preset time, and determining an access data amount evaluation value of the access requirements by combining the average value of the access data amounts of the dates of which the access data amount does not meet the requirements in the preset time and the average value of the access data amounts of the different dates in the preset time;
s14, determining the number of the access users of which the number of the access users does not meet the requirement in the preset time based on the number of the access users of which the number of the access users does not meet the requirement in the preset time, and determining a user number evaluation value of the access requirement according to the average value of the number of the access users of which the number of the access users does not meet the requirement in the preset time and the average value of the number of the access users of which the number of the access users does not meet the requirement in the preset time;
s15, acquiring the access data quantity of the access requirement and the number of access users, and determining the requirement assessment quantity of the access requirement by combining the access data quantity assessment value and the user quantity assessment value of the access requirement;
the method for determining the access demand assessment amount of the time period comprises the following steps:
dividing the access users of the period into frequent users and other users based on the access data amount of the access users of the period, and determining the access demand assessment amount of the frequent users and the access demand assessment amount of the other users according to the access data amount of the frequent users and the number of the frequent users, the access data amount of the other users and the number of the other users respectively;
and determining the weight value of the access demand assessment value of the frequent user and the weight value of the access demand assessment value of the other user according to the access data quantity of the frequent user and the access data quantity of the other user, and determining the access demand assessment value of the period according to the access demand assessment value of the frequent user and the access demand assessment value of the other user.
2. The data center resource scheduling monitoring management method according to claim 1, wherein the access requirements are determined according to data types of access data of access users of different edge servers.
3. The data center resource scheduling monitoring management method according to claim 1, wherein the value of the demand evaluation amount of the access demand ranges from 0 to 1, wherein the larger the demand evaluation amount of the access demand is, the larger the service demand of the access demand is.
4. The data center resource scheduling monitoring management method according to claim 1, wherein when the demand evaluation of the access demand is greater than a preset evaluation threshold, it is determined that the access demand belongs to a screening access demand.
5. The method for monitoring and managing resource scheduling of data center according to claim 1, wherein when the number of idle dates of the screening access requirement in a preset time does not meet the requirement, it is determined that the screening access requirement does not belong to the evaluation access requirement, and unloading processing of the screening access requirement is not required.
6. The method for monitoring and managing the resource scheduling of the data center according to claim 1, wherein the method for determining the resource allocation of the edge server of the data center comprises the following steps:
determining the comprehensive demand evaluation amount of the access demand through idle evaluation amounts, the number of idle dates and the demand evaluation amount of the access demand, and determining the resource allocation demand evaluation amount of the access demand by combining the demand fluctuation amount of the access demand;
and determining the resource allocation space of the edge server for evaluating the access demand through the resource allocation demand evaluation quantity for evaluating the access demand.
7. A computer system, comprising: a communicatively coupled memory and processor, and a computer program stored on the memory and capable of running on the processor, characterized by: the processor, when executing the computer program, performs a data center resource scheduling monitoring management method as claimed in any one of claims 1 to 6.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202410057239.6A CN117573376B (en) | 2024-01-16 | 2024-01-16 | Data center resource scheduling monitoring management method and system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202410057239.6A CN117573376B (en) | 2024-01-16 | 2024-01-16 | Data center resource scheduling monitoring management method and system |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN117573376A CN117573376A (en) | 2024-02-20 |
| CN117573376B true CN117573376B (en) | 2024-04-05 |
Family
ID=89862735
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202410057239.6A Active CN117573376B (en) | 2024-01-16 | 2024-01-16 | Data center resource scheduling monitoring management method and system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN117573376B (en) |
Families Citing this family (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN117857555B (en) * | 2024-03-05 | 2024-05-14 | 浙江万雾信息科技有限公司 | Data sharing method and system based on edge calculation |
Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113822456A (en) * | 2020-06-18 | 2021-12-21 | 复旦大学 | Service combination optimization deployment method based on deep reinforcement learning in cloud and mist mixed environment |
| CN114302374A (en) * | 2022-01-17 | 2022-04-08 | 长江师范学院 | Dynamic load balancing method based on prediction in CoMP (coordinated Multi-point) scene of 5G (third Generation) internet of vehicles |
| CN114615333A (en) * | 2020-11-25 | 2022-06-10 | 贵州白山云科技股份有限公司 | Resource access request processing method, device, equipment and medium |
| CN115988462A (en) * | 2023-03-17 | 2023-04-18 | 中电建市政建设集团山东工程有限公司 | Debugging method of edge computing module based on vehicle-road cooperation |
| KR20230069490A (en) * | 2021-11-12 | 2023-05-19 | 한국전자기술연구원 | Method for applying workload prediction model by operation service in micro data center |
| CN116828515A (en) * | 2023-06-15 | 2023-09-29 | 浙江大学 | Edge server load prediction method based on space-time diagram convolution under Internet of vehicles |
| CN117255368A (en) * | 2023-11-17 | 2023-12-19 | 广东工业大学 | Edge dynamic integration method for vehicle-mounted edge server and cooperative fixed edge server |
-
2024
- 2024-01-16 CN CN202410057239.6A patent/CN117573376B/en active Active
Patent Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113822456A (en) * | 2020-06-18 | 2021-12-21 | 复旦大学 | Service combination optimization deployment method based on deep reinforcement learning in cloud and mist mixed environment |
| CN114615333A (en) * | 2020-11-25 | 2022-06-10 | 贵州白山云科技股份有限公司 | Resource access request processing method, device, equipment and medium |
| KR20230069490A (en) * | 2021-11-12 | 2023-05-19 | 한국전자기술연구원 | Method for applying workload prediction model by operation service in micro data center |
| CN114302374A (en) * | 2022-01-17 | 2022-04-08 | 长江师范学院 | Dynamic load balancing method based on prediction in CoMP (coordinated Multi-point) scene of 5G (third Generation) internet of vehicles |
| CN115988462A (en) * | 2023-03-17 | 2023-04-18 | 中电建市政建设集团山东工程有限公司 | Debugging method of edge computing module based on vehicle-road cooperation |
| CN116828515A (en) * | 2023-06-15 | 2023-09-29 | 浙江大学 | Edge server load prediction method based on space-time diagram convolution under Internet of vehicles |
| CN117255368A (en) * | 2023-11-17 | 2023-12-19 | 广东工业大学 | Edge dynamic integration method for vehicle-mounted edge server and cooperative fixed edge server |
Non-Patent Citations (1)
| Title |
|---|
| 基于流动性感知机制的大数据资源稳定评估算法研究;范海峰;;重庆科技学院学报(自然科学版);20200815(第04期);87-91 * |
Also Published As
| Publication number | Publication date |
|---|---|
| CN117573376A (en) | 2024-02-20 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN117573376B (en) | Data center resource scheduling monitoring management method and system | |
| US9135074B2 (en) | Evaluating performance of workload manager based on QoS to representative workload and usage efficiency of shared resource for plurality of minCPU and maxCPU allocation values | |
| Andreolini et al. | Dynamic load management of virtual machines in cloud architectures | |
| US7356602B2 (en) | Method and apparatus for dynamically adjusting resources assigned to plurality of customers, for meeting service level agreements (SLAs) with minimal resources, and allowing common pools of resources to be used across plural customers on a demand basis | |
| US8112756B2 (en) | System and method for evaluating a workload and its impact on performance of a workload manager | |
| US8392927B2 (en) | System and method for determining a partition of a consumer's resource access demands between a plurality of different classes of service | |
| US8336054B2 (en) | System and method for allocating capacity of shared resources to a workload | |
| JP3172423B2 (en) | Apparatus and method for managing processor resources | |
| US9405588B2 (en) | Cloud resource allocation system and method | |
| CN108770017B (en) | Dynamic equalization method and system for wireless resources | |
| CN111752706B (en) | Resource allocation method, device and storage medium | |
| CN117196351B (en) | Intelligent building energy consumption monitoring method and system based on Internet of things | |
| CN114461389A (en) | Load balancing method and device of server cluster and electronic equipment | |
| CN111176840A (en) | Distributed task allocation optimization method and device, storage medium and electronic device | |
| Hoyer et al. | Statistical static capacity management in virtualized data centers supporting fine grained QoS specification | |
| CN116346740A (en) | Load balancing method and device | |
| CN117573373B (en) | CPU virtualization scheduling method and system based on cloud computing | |
| CN115576856B (en) | Energy consumption evaluation method and device | |
| CN116248676A (en) | Edge cloud node combination determination method and device | |
| CN116546028A (en) | Service request processing method and device, storage medium and electronic equipment | |
| CN116566696A (en) | Security assessment system and method based on cloud computing | |
| Lili et al. | A Markov chain based resource prediction in computational grid | |
| CN115994029A (en) | Container resource scheduling method and device | |
| CN108595265A (en) | Intelligent distribution method and system for computing resources | |
| CN115470006A (en) | Load balancing method based on microkernel |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |