CN115202890A - Data element production resource space distribution method, system and equipment - Google Patents
Data element production resource space distribution method, system and equipment Download PDFInfo
- Publication number
- CN115202890A CN115202890A CN202211112378.1A CN202211112378A CN115202890A CN 115202890 A CN115202890 A CN 115202890A CN 202211112378 A CN202211112378 A CN 202211112378A CN 115202890 A CN115202890 A CN 115202890A
- Authority
- CN
- China
- Prior art keywords
- data
- preset
- resource
- data element
- production
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F9/00—Arrangements for program control, e.g. control units
- G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
- G06F9/46—Multiprogramming arrangements
- G06F9/50—Allocation of resources, e.g. of the central processing unit [CPU]
- G06F9/5005—Allocation of resources, e.g. of the central processing unit [CPU] to service a request
- G06F9/5011—Allocation of resources, e.g. of the central processing unit [CPU] to service a request the resources being hardware resources other than CPUs, Servers and Terminals
- G06F9/5016—Allocation of resources, e.g. of the central processing unit [CPU] to service a request the resources being hardware resources other than CPUs, Servers and Terminals the resource being the memory
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F9/00—Arrangements for program control, e.g. control units
- G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
- G06F9/46—Multiprogramming arrangements
- G06F9/50—Allocation of resources, e.g. of the central processing unit [CPU]
- G06F9/5005—Allocation of resources, e.g. of the central processing unit [CPU] to service a request
- G06F9/5027—Allocation of resources, e.g. of the central processing unit [CPU] to service a request the resource being a machine, e.g. CPUs, Servers, Terminals
Abstract
The invention discloses a method, a system and equipment for distributing data element production resource space, wherein the method comprises the following steps: acquiring the data volume and the resource consumption in unit time used in the development process of the data element; executing a pre-production process on the developed data elements based on the real sample data, and acquiring the data volume and the resource consumption in unit time used in the pre-production process of the data elements; acquiring the relation between the data volume and the resource consumption in unit time; calculating the resource consumption per unit time in the actual production process of the data element according to the relation between the data volume and the resource consumption per unit time based on the data volume of real data used in the actual production process of the data element; and calculating the actual distribution value of the production resource space of the data element based on the resource consumption of the data element in unit time in the actual production process and by combining the preset resource elasticity coefficient and the preset production duration. The invention can improve the efficiency and the precision of resource allocation in the production process of the data element.
Description
Technical Field
The present invention relates to the field of computer technologies, and in particular, to a method, a system, and a device for allocating a production resource space of a data element.
Background
Data elements are receiving more and more attention as a new state that stimulates new vitality of data elements. The data element is a primary data product after processing the data resource according to a specific rule, and has the basic characteristics of controllability, quantifiability, pricing and the like. The data element can solve the problem that the data resource circulation is not safe. The data element is composed of two parts of an element model and an element result. The element model is a data processing model formed by certain algorithm construction according to certain business logic. The element result is an output result of the data resource after being processed by the element model. The component model and the component result are closely related and indispensable, the component result must be generated by the component model acting on the data resource, and the component model must represent the business value through the component result. The two are organically combined to form a data element together, and the data element becomes an information carrier in data circulation. The data element, as an "intermediate state" connecting both ends of the supply and demand of data, has the following basic characteristics: a) A data primary product between the data resource and the application; b) As a trading subject in a data trading market; c) An information carrier for near source data; d) A basic unit of data asset metering and pricing.
For the whole resource requirement of the data element production operation, in the related art, a user is required to monitor the actual operation condition of the data element and then manually adjust the resource space of the data element. This method has problems of adjustment lag, low efficiency, and poor accuracy.
Disclosure of Invention
The embodiment of the invention provides a method, a system and equipment for allocating a data element production resource space, which are used for solving the problem of low efficiency of the data element production resource space allocation method in the prior art.
The data element production resource space allocation method according to the embodiment of the invention comprises the following steps:
collecting operation data of a data element in a development process completed based on false data to obtain the data volume and the resource consumption per unit time used in the development process of the data element;
executing a pre-production process on the developed data elements based on real sample data, and collecting operation data in the pre-production process of the data elements to obtain the data volume and the resource consumption in unit time used in the pre-production process of the data elements;
acquiring a relation between the data volume and the resource consumption per unit time based on the data volume and the resource consumption per unit time used in the data element development process and the data volume and the resource consumption per unit time used in the data element pre-production process;
calculating the resource consumption per unit time in the actual production process of the data element according to the relation between the data volume and the resource consumption per unit time based on the data volume of real data used in the actual production process of the data element;
calculating a data element production resource space actual allocation value m according to formula 1 based on the resource consumption per unit time during the actual production of said data element,
m = l (1+h)/t formula 1,
wherein l represents the resource consumption per unit time in the actual production process of the data element, h represents a preset resource elasticity coefficient, and t represents a preset production duration.
According to some embodiments of the invention, the resource consumption per unit time comprises a resource consumption per unit time of a CPU and a resource consumption per unit time of a memory.
According to some embodiments of the invention, the predetermined resource elastic modulus h is greater than or equal to 0.1 and less than or equal to 0.5.
According to some embodiments of the invention, the method further comprises:
dynamically adjusting the preset resource elasticity coefficient h according to a preset rule;
the preset rules include:
when the time length of the data element entering the actual production process is less than or equal to n preset production time lengths, setting the preset resource elasticity coefficient h to be 0.5;
when the time length of the data element entering the actual production process is more than n preset production time lengths, executing the following steps:
counting all data elements of an element developer to which the data elements belong, wherein the time length of entering the actual production process is longer than n preset production time lengths, and defining the data elements as first data elements;
for each first data element, calculating a predicted distribution value corresponding to each preset production time length in n preset production time lengths before the current time according to formula 2,
a = l/t formula 2,
wherein, a represents a predictive allocation value;
calculating the difference between the sum of the predicted distribution values of all the first data elements corresponding to each preset production time length and the actual resource consumption total value in the corresponding preset production time length, and acquiring the maximum value of the difference;
calculating the sum of the predicted distribution values of all the first data elements corresponding to the first preset production time after the current moment;
calculating the ratio of the maximum difference value to the sum of the predicted distribution values of all the first data elements corresponding to the first preset production time after the current moment;
and when the ratio is less than or equal to 0.5, setting the preset resource elasticity coefficient as the ratio, and when the ratio is more than 0.5, setting the preset resource elasticity coefficient h as 0.5.
A data element production resource space allocation system according to an embodiment of the invention comprises:
the collecting module is used for collecting operation data of a data element in a development process completed based on the false data so as to obtain the data volume and the resource consumption in unit time used in the development process of the data element;
the pre-production module is used for executing a pre-production process on the developed data elements based on real sample data and collecting operation data in the pre-production process of the data elements so as to obtain the data volume and the resource consumption in unit time used in the pre-production process of the data elements;
the statistical module is used for acquiring the relation between the data volume and the resource consumption per unit time based on the data volume and the resource consumption per unit time used in the data element development process and the data volume and the resource consumption per unit time used in the data element pre-production process;
the calculation module is used for calculating the resource consumption per unit time in the actual production process of the data element according to the relation between the data volume and the resource consumption per unit time based on the data volume of real data used in the actual production process of the data element; and calculating an actual allocation value m of a data element production resource space according to formula 1 based on the resource consumption per unit time in the actual production process of the data element,
m = l (1+h)/t formula 1,
wherein l represents the resource consumption per unit time in the actual production process of the data element, h represents a preset resource elasticity coefficient, and t represents a preset production duration.
According to some embodiments of the invention, the resource consumption per unit time includes resource consumption per unit time of CPU and resource consumption per unit time of memory.
According to some embodiments of the invention, the predetermined resource elastic coefficient h is greater than or equal to 0.1 and less than or equal to 0.5.
According to some embodiments of the invention, the system further comprises:
the detection updating module is used for dynamically adjusting the preset resource elasticity coefficient h according to a preset rule;
the preset rules include:
when the time length of the data element entering the actual production process is less than or equal to n preset production time lengths, setting the preset resource elasticity coefficient h to be 0.5;
when the time length of the data element entering the actual production process is longer than n preset production time lengths, executing the following steps:
counting all data elements of an element developer to which the data elements belong, wherein the time length of the data elements entering the actual production process is longer than n preset production time lengths, and defining the data elements as first data elements;
for each first data element, calculating a predicted distribution value corresponding to each preset production time length in n preset production time lengths before the current time according to formula 2,
a = l/t formula 2,
wherein, a represents a predictive allocation value;
calculating the difference between the sum of the predicted distribution values of all the first data elements corresponding to each preset production time length and the actual resource consumption total value in the corresponding preset production time length, and acquiring the maximum value of the difference;
calculating the sum of the predicted distribution values of all the first data elements corresponding to the first preset production time after the current moment;
calculating the ratio of the maximum difference value to the sum of the predicted distribution values of all the first data elements corresponding to the first preset production time after the current moment;
and when the ratio is less than or equal to 0.5, setting the preset resource elasticity coefficient as the ratio, and when the ratio is more than 0.5, setting the preset resource elasticity coefficient h as 0.5.
A data element production resource space allocation apparatus according to an embodiment of the present invention includes: a memory, a processor and a computer program stored on the memory and executable on the processor, the computer program when executed by the processor implementing the steps of the data element production resource space allocation method as described above.
According to the computer readable storage medium of the embodiment of the invention, the computer readable storage medium stores the implementation program of information transfer, and the program is executed by the processor to realize the steps of the data element production resource space allocation method.
By adopting the embodiment of the invention, aiming at the processing characteristics of the data element, the data element pre-production process is introduced, the data of the two stages are fully utilized, the basic guidance is provided for the resource allocation of the production, and the efficiency and the precision of the resource allocation in the production process are improved.
The foregoing description is only an overview of the technical solutions of the present invention, and the embodiments of the present invention are described below in order to make the technical means of the present invention more clearly understood and to make the above and other objects, features, and advantages of the present invention more clearly understandable.
Drawings
Various other advantages and benefits will become apparent to those of ordinary skill in the art upon reading the following detailed description of the embodiments. The drawings are only for purposes of illustrating the preferred embodiments and are not to be construed as limiting the invention. In the drawings:
FIG. 1 is a flow chart of a method for allocating data element production resource space according to an embodiment of the present invention.
Detailed Description
Exemplary embodiments of the present invention will be described in more detail below with reference to the accompanying drawings. While exemplary embodiments of the invention are shown in the drawings, it should be understood that the invention can be embodied in various forms and should not be limited to the embodiments set forth herein. Rather, these embodiments are provided so that this disclosure will be thorough and complete, and will fully convey the scope of the invention to those skilled in the art. Additionally, in some instances, well-known methods, structures and techniques have not been shown in detail in order not to obscure an understanding of this description.
Referring to fig. 1, a method for allocating data element production resource space according to an embodiment of the present invention includes:
s1, collecting operation data of a data element in a development process completed based on false data to obtain the data volume and the resource consumption in unit time used in the development process of the data element;
it should be explained that the term "dummy data" as used herein is understood to mean either dummy data or true data after desensitization. The data element is proposed to protect the original real data, so the data used in the data element development process is "dummy data".
The method comprises the steps of collecting operation data of each operation of a data element, counting the data volume, the operation time length and the total consumption amount of resources of virtual data used in each operation process, and calculating the resource consumption amount per unit time based on the operation time length and the total consumption amount of the resources. For example, if the resource consumption per unit time is in units of hourly resource consumption and the data element operates for 2 hours, consuming a total of 2 resources, then 4 resources are required if the operation is to be completed within one hour, i.e. the resource consumption per unit time is 4.
S2, based on real sample data, executing a pre-production process on the developed data element, and collecting operation data in the pre-production process of the data element to obtain the data volume and the resource consumption in unit time used in the pre-production process of the data element;
since the data element development process is based on the operation of the spurious data, unlike the real data, the operation of the real data (i.e., the real data) cannot be accurately evaluated. Therefore, the method and the device increase the pre-production process, and perform one-time operation through a set of data elements which are input and developed by real sample data. The process can more accurately reflect the operation condition of the data element in the actual production process.
Similarly, by collecting operation data in the data element preproduction process, the amount of data used in the data element preproduction process and the amount of resource consumption per unit time are counted.
S3, acquiring the relation between the data volume and the resource consumption per unit time based on the data volume and the resource consumption per unit time used in the development process of the data elements and the data volume and the resource consumption per unit time used in the pre-production process of the data elements;
by integrating the data volume and the resource consumption per unit time used in the development process of the data element and the data volume and the resource consumption per unit time used in the pre-production process, the relationship between the data volume and the resource consumption per unit time can be accurately reflected.
In the actual operation process, an x-y rectangular coordinate system can be established, wherein the x axis represents the data volume, and the y axis represents the resource consumption per unit time. The data volume and the resource consumption per unit time counted in the development process and the pre-production process are taken as coordinate points in a rectangular coordinate system to be drawn, and then the coordinate points are connected by a straight line, and the straight line reflects the relation between the data volume and the resource consumption per unit time.
When the relation between the data volume and the resource consumption in unit time is determined, the data in the development process of the data element and the data in the pre-production process are combined, so that the characteristic that the data volume is large in the development process can be utilized, and the characteristic that the data volume is closer to the production process in the pre-production process is combined, so that the obtained relation is more accurate.
S4, calculating the resource consumption per unit time in the actual production process of the data element according to the relation between the data volume and the resource consumption per unit time based on the data volume of real data used in the actual production process of the data element;
s5, calculating the actual allocation value m of the data element production resource space according to the formula 1 based on the resource consumption per unit time in the actual production process of the data element,
m = l (1+h)/t formula 1,
wherein l represents the resource consumption per unit time in the actual production process of the data element, h represents a preset resource elasticity coefficient, and t represents a preset production duration.
In the actual production process, in order to ensure that the data element can stably operate, on the basis of calculating and obtaining the resource consumption per unit time in the actual production process of the data element, the resource elasticity is designed for the data element, wherein h is larger than zero, which is equivalent to additionally allocating an elasticity space for the data element.
In addition, by presetting the production time length, the actual distribution value of the production resource space of the data element can be dynamically adjusted according to the required production time of the data element, so that the work can be completed within the required completion time, and the intelligence of the production process is improved.
By adopting the embodiment of the invention, aiming at the processing characteristics of the data element, the data element pre-production process is introduced, the data of the two stages are fully utilized, basic guidance is provided for the resource allocation of production, the efficiency and the precision of the resource allocation in the production process are improved, the data can be used as the basis for allocating resources to element developers, and the resource contention condition of different element developers is effectively relieved.
On the basis of the above-described embodiment, modified embodiments are further proposed, and it is to be noted here that, in order to make the description brief, only the differences from the above-described embodiment are described in each modified embodiment.
According to some embodiments of the present invention, in collecting operation data in a development process of a data element completed based on dummy data to obtain a data amount and a resource consumption amount per unit time used in the development process of the data element, operation data in a plurality of operation processes may be obtained, so that a data amount and a resource consumption amount per unit time used in a plurality of sets of data element development processes may be obtained. In the process of determining the relationship between the data amount and the resource consumption per unit time, the plurality of sets of data amount and resource consumption per unit time can be used as a plurality of coordinate points, and a smooth line is used to connect the plurality of coordinate points and a coordinate point corresponding to the data in the pre-production process, so that a curve or a straight line reflecting the relationship between the data amount and the resource consumption per unit time is formed.
Of course, the data size and the resource consumption per unit time used in the development of the plurality of sets of data elements may be averaged to obtain a set of average data size and average resource consumption per unit time. In the process of determining the relationship between the data amount and the resource consumption per unit time, the set of average data amount and average resource consumption per unit time can be used as a coordinate point, and a straight line is used to connect the coordinate point and a coordinate point corresponding to the data in the pre-production process, so that a straight line reflecting the linear relationship between the data amount and the resource consumption per unit time is formed.
According to some embodiments of the invention, the resource consumption per unit time comprises a resource consumption per unit time of a CPU and a resource consumption per unit time of a memory. It is understood that, in the embodiment of the present invention, the data element production resource space allocation method involves allocation to a CPU and allocation to a memory.
Therefore, in the production process of the data element, the use of both the CPU and the memory can be comprehensively and automatically distributed. When the resource consumption per unit time is calculated based on the operation duration and the total consumption amount of the resources, if the data element operates for 2 hours and 2 CPUs are needed in the operation process, and a 32G memory is needed, the resource consumption per unit time is a CPU:4; memory: and 64G.
According to some embodiments of the invention, the predetermined resource elastic coefficient h is greater than or equal to 0.1 and less than or equal to 0.5. For example, the preset resource elastic coefficient h may be set to 0.3 according to an empirical design.
According to some embodiments of the invention, the method further comprises:
dynamically adjusting the preset resource elasticity coefficient h according to a preset rule;
the preset rules comprise:
when the time length of the data element entering the actual production process is less than or equal to n preset production time lengths, setting the preset resource elasticity coefficient h to be 0.5;
when the time length of the data element entering the actual production process is more than n preset production time lengths, executing the following steps:
counting all data elements of an element developer to which the data elements belong, wherein the time length of the data elements entering the actual production process is longer than n preset production time lengths, and defining the data elements as first data elements;
for each first data element, according to formula 2, calculating a predicted allocation value corresponding to each preset production time length within n preset production time lengths before the current time,
a = l/t formula 2,
wherein, a represents a predictive allocation value;
calculating the difference between the sum of the predicted distribution values of all the first data elements corresponding to each preset production time length and the actual resource consumption total value in the corresponding preset production time length, and acquiring the maximum value of the difference;
calculating the sum of the predicted distribution values of all the first data elements corresponding to the first preset production time after the current moment;
calculating the ratio of the maximum difference value to the sum of the predicted distribution values of all the first data elements corresponding to the first preset production time after the current moment;
and when the ratio is less than or equal to 0.5, setting the preset resource elasticity coefficient as the ratio, and when the ratio is greater than 0.5, setting the preset resource elasticity coefficient h as 0.5.
It is understood that after the data element is actually produced for n preset production periods, for example, after the production period exceeds seven days, the data element is adjusted by the preset resource elasticity coefficient h together with all the data elements before the element developer. All data elements before the element developer are data elements with a production duration exceeding n preset production durations. The specific adjustment scheme is as follows: and calculating the difference between the sum of the predicted allocation values of all the data elements in each production process (each preset production time corresponds to one production process) in the time interval and the sum of the actually consumed resources according to the time interval of the n preset production times which are backward pushed at the current moment, so as to obtain n difference values in total. And comparing the n differences to obtain the maximum value, namely the maximum value of the differences. The sum of the predicted allocation values of all the data elements for the first preset production time after the current time is then calculated. The ratio of the maximum difference to the sum of the predicted allocation values of all the data elements for the first predetermined production time period after the current time is calculated.
When the ratio is less than or equal to 0.5, the preset resource elasticity coefficient is adjusted to be the ratio, when the ratio is more than 0.5, the preset resource elasticity coefficient h is still set to be 0.5, and the rest is done in turn to realize the dynamic adjustment of the initial elasticity coefficient.
According to some embodiments of the invention, the method further comprises:
dynamically adjusting the preset resource elasticity coefficient h according to a preset rule;
the preset rules comprise:
when the time length of the data element entering the actual production process is less than or equal to n preset production time lengths, setting the preset resource elasticity coefficient h to be 0.5; for example, if the preset production time is one day, n is equal to seven, and the preset resource elasticity coefficient h is 0.5 in the first seven days of the production of the data element.
When the time length of the data element entering the actual production process is longer than n preset production time lengths, counting the difference value between the predicted allocation value calculated by the data element in each preset production time length in the n preset production time lengths before the current moment and the corresponding actual resource consumption value, acquiring the maximum value of the difference value, and calculating the ratio of the maximum value of the difference value to the predicted allocation value calculated by the first preset production time length after the current moment;
when the ratio is less than or equal to 0.5, the preset resource elasticity coefficient is adjusted to be the ratio, when the ratio is more than 0.5, the preset resource elasticity coefficient h is still set to be 0.5, and the rest is done in turn to realize the dynamic adjustment of the initial elasticity coefficient. According to some embodiments of the invention, performing a pre-production process on the developed data element based on the real sample data comprises:
and executing a pre-production process on the developed data element according to the preset production duration based on the real sample data. It will be appreciated that the pre-production process is designed to be completed within a pre-set production time period. Therefore, the pre-production process can be closer to the actual production process, and data in the pre-production process is closer to the production stage.
A data element production resource space allocation apparatus according to an embodiment of the present invention includes: a memory, a processor and a computer program stored on the memory and executable on the processor, the computer program when executed by the processor implementing the steps of the data element production resource space allocation method according to any of the embodiments above.
According to the computer readable storage medium of the embodiment of the invention, the computer readable storage medium stores the implementation program of information transfer, and the program is executed by the processor to implement the steps of the data element production resource space allocation method as described in any one of the above embodiments.
It should be noted that the computer-readable storage medium in this embodiment includes, but is not limited to: ROM, RAM, magnetic or optical disks, and the like. The processor can be a mobile phone, a computer, a server, an air conditioner, or a network device.
A data element production resource space allocation system according to an embodiment of the present invention includes:
the collecting module is used for collecting operation data of a data element in a development process completed based on false data so as to obtain the data volume and the resource consumption amount in unit time used in the development process of the data element;
the pre-production module is used for executing a pre-production process on the developed data elements based on real sample data and collecting operation data in the pre-production process of the data elements so as to obtain the data volume and the resource consumption in unit time used in the pre-production process of the data elements;
the statistical module is used for acquiring the relation between the data volume and the resource consumption per unit time based on the data volume and the resource consumption per unit time used in the data element development process and the data volume and the resource consumption per unit time used in the data element pre-production process;
the calculation module is used for calculating the resource consumption per unit time in the actual production process of the data element according to the relation between the data volume and the resource consumption per unit time based on the data volume of real data used in the actual production process of the data element; and calculating an actual allocation value m of a data element production resource space according to formula 1 based on the resource consumption per unit time in the actual production process of the data element,
m = l (1+h)/t formula 1,
wherein l represents the resource consumption per unit time in the actual production process of the data element, h represents a preset resource elasticity coefficient, and t represents a preset production time.
According to some embodiments of the invention, the resource consumption per unit time includes resource consumption per unit time of CPU and resource consumption per unit time of memory.
According to some embodiments of the invention, the predetermined resource elastic coefficient h is greater than or equal to 0.1 and less than or equal to 0.5.
According to some embodiments of the invention, the system further comprises:
the detection updating module is used for dynamically adjusting the preset resource elasticity coefficient h according to a preset rule;
the preset rules comprise:
when the time length of the data element entering the actual production process is less than or equal to n preset production time lengths, setting the preset resource elasticity coefficient h to be 0.5;
when the time length of the data element entering the actual production process is longer than n preset production time lengths, executing the following steps:
counting all data elements of an element developer to which the data elements belong, wherein the time length of the data elements entering the actual production process is longer than n preset production time lengths, and defining the data elements as first data elements;
for each first data element, according to formula 2, calculating a predicted allocation value corresponding to each preset production time length within n preset production time lengths before the current time,
a = l/t formula 2,
wherein, a represents a predictive allocation value;
calculating the difference between the sum of the predicted distribution values of all the first data elements corresponding to each preset production time length and the actual resource consumption total value in the corresponding preset production time length, and acquiring the maximum value of the difference;
calculating the sum of the predicted distribution values of all the first data elements corresponding to the first preset production time after the current moment;
calculating the ratio of the maximum difference value to the sum of the predicted distribution values of all the first data elements corresponding to the first preset production time after the current moment;
and when the ratio is less than or equal to 0.5, setting the preset resource elasticity coefficient as the ratio, and when the ratio is more than 0.5, setting the preset resource elasticity coefficient h as 0.5.
According to some embodiments of the invention, the system further comprises:
the adjusting module is used for dynamically adjusting the preset resource elasticity coefficient h according to a preset rule;
the preset rules comprise:
when the time length of the data element entering the actual production process is less than or equal to n preset production time lengths, setting the preset resource elasticity coefficient h to be 0.5; for example, if the predetermined production time is one day and n is equal to seven days, the predetermined resource elastic modulus h is 0.5 in the first seven days of the data element production.
When the time length of the data element entering the actual production process is longer than n preset production time lengths, counting the difference value between the predicted allocation value calculated by the data element in each preset production time length in n preset production time lengths before the current moment and the corresponding actual resource consumption value, acquiring the maximum value of the difference value, and calculating the ratio of the maximum value of the difference value to the predicted allocation value calculated by the first preset production time length after the current moment;
when the ratio is less than or equal to 0.5, the preset resource elasticity coefficient is adjusted to be the ratio, when the ratio is greater than 0.5, the preset resource elasticity coefficient h is still set to be 0.5, and the rest is repeated, so that the dynamic adjustment of the initial elasticity coefficient is realized.
Those skilled in the art will appreciate that the various modules or steps of the invention described above can be implemented using a general purpose computing device, that they can be centralized on a single computing device or distributed across a network of computing devices, and that they can alternatively be implemented using program code executable by a computing device, such that the steps illustrated and described herein can be performed by a computing device stored in a memory device and, in some cases, performed in an order different than that used herein, or separately fabricated into various integrated circuit modules, or multiple modules or steps thereof, and implemented as a single integrated circuit module. Thus, the present invention is not limited to any specific combination of hardware and software.
In the above-described embodiments of the invention, combinations of features of different embodiments are meant to be within the scope of the invention and to form different embodiments. The particular features, structures, or characteristics described may be combined in any suitable manner in any one or more embodiments or examples.
The terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising a … …" does not exclude the presence of another identical element in a process, method, article, or apparatus that comprises the element.
Claims (10)
1. A method for allocating production resource space of a data element, comprising:
collecting operation data of a data element in a development process completed based on false data to obtain the data volume and the resource consumption per unit time used in the development process of the data element;
executing a pre-production process on the developed data elements based on real sample data, and collecting operation data in the pre-production process of the data elements to obtain the data volume and the resource consumption in unit time used in the pre-production process of the data elements;
acquiring a relation between the data quantity and the resource consumption per unit time based on the data quantity and the resource consumption per unit time used in the data element development process and the data quantity and the resource consumption per unit time used in the data element pre-production process;
calculating the resource consumption per unit time in the actual production process of the data element according to the relation between the data volume and the resource consumption per unit time based on the data volume of real data used in the actual production process of the data element;
calculating a data element production resource space actual allocation value m according to formula 1 based on the resource consumption per unit time during the actual production of said data element,
m = l (1+h)/t formula 1,
wherein l represents the resource consumption per unit time in the actual production process of the data element, h represents a preset resource elasticity coefficient, and t represents a preset production duration.
2. The method of claim 1, wherein the resource consumption per unit time includes a CPU resource consumption per unit time and a memory resource consumption per unit time.
3. The method of claim 1, wherein the predetermined resource elastic modulus h is greater than or equal to 0.1 and less than or equal to 0.5.
4. The method of claim 3, wherein the method further comprises:
dynamically adjusting the preset resource elasticity coefficient h according to a preset rule;
the preset rules include:
when the time length of the data element entering the actual production process is less than or equal to n preset production time lengths, setting the preset resource elasticity coefficient h to be 0.5;
when the time length of the data element entering the actual production process is longer than n preset production time lengths, executing the following steps:
counting all data elements of an element developer to which the data elements belong, wherein the time length of the data elements entering the actual production process is longer than n preset production time lengths, and defining the data elements as first data elements;
for each first data element, according to formula 2, calculating a predicted allocation value corresponding to each preset production time length within n preset production time lengths before the current time,
a = l/t formula 2,
wherein a represents a predicted allocation value;
calculating the difference between the sum of the predicted distribution values of all the first data elements corresponding to each preset production time length and the actual resource consumption total value in the corresponding preset production time length, and acquiring the maximum value of the difference;
calculating the sum of the predicted distribution values of all the first data elements corresponding to the first preset production time after the current moment;
calculating the ratio of the maximum difference value to the sum of the predicted distribution values of all the first data elements corresponding to the first preset production time after the current moment;
and when the ratio is less than or equal to 0.5, setting the preset resource elasticity coefficient as the ratio, and when the ratio is more than 0.5, setting the preset resource elasticity coefficient h as 0.5.
5. A data element production resource space allocation system, comprising:
the collecting module is used for collecting operation data of a data element in a development process completed based on false data so as to obtain the data volume and the resource consumption amount in unit time used in the development process of the data element;
the pre-production module is used for executing a pre-production process on the developed data elements based on real sample data and collecting operation data in the pre-production process of the data elements so as to obtain the data volume and the resource consumption in unit time used in the pre-production process of the data elements;
the statistical module is used for acquiring the relation between the data volume and the resource consumption per unit time based on the data volume and the resource consumption per unit time used in the data element development process and the data volume and the resource consumption per unit time used in the data element pre-production process;
the calculation module is used for calculating the resource consumption per unit time in the actual production process of the data element according to the relation between the data volume and the resource consumption per unit time based on the data volume of real data used in the actual production process of the data element; and calculating an actual allocation value m of a data element production resource space according to formula 1 based on the resource consumption per unit time in the actual production process of the data element,
m = l (1+h)/t formula 1,
wherein l represents the resource consumption per unit time in the actual production process of the data element, h represents a preset resource elasticity coefficient, and t represents a preset production duration.
6. The system of claim 5, wherein the resource consumption per unit time includes a CPU resource consumption per unit time and a memory resource consumption per unit time.
7. The system of claim 5, wherein the predetermined resource elastic modulus h is greater than or equal to 0.1 and less than or equal to 0.5.
8. The system of claim 7, wherein the system further comprises:
the detection updating module is used for dynamically adjusting the preset resource elasticity coefficient h according to a preset rule;
the preset rules include:
when the time length of the data element entering the actual production process is less than or equal to n preset production time lengths, setting the preset resource elasticity coefficient h to be 0.5;
when the time length of the data element entering the actual production process is longer than n preset production time lengths, executing the following steps:
counting all data elements of an element developer to which the data elements belong, wherein the time length of the data elements entering the actual production process is longer than n preset production time lengths, and defining the data elements as first data elements;
for each first data element, according to formula 2, calculating a predicted allocation value corresponding to each preset production time length within n preset production time lengths before the current time,
a = l/t formula 2,
wherein a represents a predicted allocation value;
calculating the difference between the sum of the predicted distribution values of all the first data elements corresponding to each preset production time length and the actual resource consumption total value in the corresponding preset production time length, and acquiring the maximum value of the difference;
calculating the sum of the predicted distribution values of all the first data elements corresponding to the first preset production time after the current moment;
calculating the ratio of the maximum difference value to the sum of the predicted distribution values of all the first data elements corresponding to the first preset production time after the current moment;
and when the ratio is less than or equal to 0.5, setting the preset resource elasticity coefficient as the ratio, and when the ratio is more than 0.5, setting the preset resource elasticity coefficient h as 0.5.
9. A data element production resource space allocation apparatus, comprising: memory, a processor and a computer program stored on the memory and executable on the processor, the computer program when executed by the processor implementing the steps of the data element production resource space allocation method of any one of claims 1 to 4.
10. A computer-readable storage medium, characterized in that, the computer-readable storage medium has stored thereon a program for implementing information transfer, which program, when being executed by a processor, implements the steps of the data element production resource space allocation method according to any one of claims 1 to 4.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202211112378.1A CN115202890B (en) | 2022-09-14 | 2022-09-14 | Data element production resource space distribution method, system and equipment |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202211112378.1A CN115202890B (en) | 2022-09-14 | 2022-09-14 | Data element production resource space distribution method, system and equipment |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN115202890A true CN115202890A (en) | 2022-10-18 |
| CN115202890B CN115202890B (en) | 2022-12-16 |
Family
ID=83572344
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202211112378.1A Active CN115202890B (en) | 2022-09-14 | 2022-09-14 | Data element production resource space distribution method, system and equipment |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN115202890B (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN115599555A (en) * | 2022-11-21 | 2023-01-13 | 中国电子信息产业集团有限公司（Cn） | Method for adapting resource space of data element |
Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20140201477A1 (en) * | 2011-12-27 | 2014-07-17 | Michael R. Greenfield | Methods and apparatus to manage workload memory allocation |
| CN108491638A (en) * | 2018-03-26 | 2018-09-04 | 福州大学 | Contactor real running environment semi-physical object simulating system based on data model component library |
| CN110532086A (en) * | 2018-05-23 | 2019-12-03 | 阿里巴巴集团控股有限公司 | Resource multiplexing method, equipment, system and storage medium |
| CN113434854A (en) * | 2021-08-26 | 2021-09-24 | 中国电子信息产业集团有限公司 | Method for generating data element based on sandbox environment and storage medium |
| CN113656174A (en) * | 2021-08-18 | 2021-11-16 | 河北幸福消费金融股份有限公司 | Resource allocation method, system, computer device and storage medium |
| CN114625523A (en) * | 2020-12-10 | 2022-06-14 | 中国移动通信有限公司研究院 | Resource allocation method, device and computer readable storage medium |
| CN114638468A (en) * | 2022-02-09 | 2022-06-17 | 中国电子信息产业集团有限公司 | Method for evaluating data value |
| CN115033657A (en) * | 2022-08-10 | 2022-09-09 | 广东美的暖通设备有限公司 | Inquiry method, device and equipment based on knowledge graph and storage medium |
-
2022
- 2022-09-14 CN CN202211112378.1A patent/CN115202890B/en active Active
Patent Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20140201477A1 (en) * | 2011-12-27 | 2014-07-17 | Michael R. Greenfield | Methods and apparatus to manage workload memory allocation |
| CN108491638A (en) * | 2018-03-26 | 2018-09-04 | 福州大学 | Contactor real running environment semi-physical object simulating system based on data model component library |
| CN110532086A (en) * | 2018-05-23 | 2019-12-03 | 阿里巴巴集团控股有限公司 | Resource multiplexing method, equipment, system and storage medium |
| CN114625523A (en) * | 2020-12-10 | 2022-06-14 | 中国移动通信有限公司研究院 | Resource allocation method, device and computer readable storage medium |
| CN113656174A (en) * | 2021-08-18 | 2021-11-16 | 河北幸福消费金融股份有限公司 | Resource allocation method, system, computer device and storage medium |
| CN113434854A (en) * | 2021-08-26 | 2021-09-24 | 中国电子信息产业集团有限公司 | Method for generating data element based on sandbox environment and storage medium |
| CN114638468A (en) * | 2022-02-09 | 2022-06-17 | 中国电子信息产业集团有限公司 | Method for evaluating data value |
| CN115033657A (en) * | 2022-08-10 | 2022-09-09 | 广东美的暖通设备有限公司 | Inquiry method, device and equipment based on knowledge graph and storage medium |
Non-Patent Citations (1)
| Title |
|---|
| 牛福强等: "多阶段多目标动态测试资源分配算法", 《计算机工程与设计》 * |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN115599555A (en) * | 2022-11-21 | 2023-01-13 | 中国电子信息产业集团有限公司（Cn） | Method for adapting resource space of data element |
Also Published As
| Publication number | Publication date |
|---|---|
| CN115202890B (en) | 2022-12-16 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN110705705B (en) | Convolutional neural network model synchronous training method, cluster and readable storage medium | |
| CN108399564B (en) | Credit scoring method and device | |
| EP3825861A2 (en) | Method and apparatus of user clustering, computer device | |
| CN115202890B (en) | Data element production resource space distribution method, system and equipment | |
| CN109087136A (en) | A kind of method of adjustment and device of advertising resource value | |
| CN111274531A (en) | Commodity sales amount prediction method, commodity sales amount prediction device, computer equipment and storage medium | |
| US8139065B2 (en) | Machine-implemented method and electronic device for presenting a dual-axis graph | |
| Canbolat et al. | A stochastic competitive R&D race where “winner takes all” | |
| CN111915340B (en) | Method, device, equipment and storage medium for identifying merchant type | |
| CN111325572B (en) | Data processing method and device | |
| Bottazzi et al. | Drift criteria for persistence of discretestochastic processes on the line with examples of application | |
| Jiang et al. | Bidding with limited statistical knowledge in online auctions | |
| CN112767032A (en) | Information processing method and device, electronic equipment and storage medium | |
| CN111144634A (en) | Method and device for predicting power price | |
| CN113256422B (en) | Method and device for identifying bin account, computer equipment and storage medium | |
| KR102102788B1 (en) | Artificial intelligence based financial product ordering system and method | |
| CN109472454B (en) | Activity evaluation method, activity evaluation device, electronic equipment and storage medium | |
| CN111932191A (en) | Shelf scheduling method and device, electronic equipment and computer readable medium | |
| US20210334311A1 (en) | Method, apparatus, device and storage medium for determining a central vertex in a social network | |
| CN111127114A (en) | Method and device for determining power load declaration data | |
| CN111221878B (en) | Knowledge point correlation value determining method and device in knowledge space, computer equipment and storage medium | |
| CN110248372A (en) | A kind of method, apparatus, storage medium and the computer equipment of simulator detection | |
| CN117635254A (en) | Product recommendation method, system, computer equipment and storage medium | |
| CN115482112A (en) | Data processing method, data processing device, computer equipment and storage medium | |
| CN116362361A (en) | Object customer complaint information prediction method and device, electronic equipment and storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |