CN106992901A - Method and apparatus for scheduling of resource simulated pressure - Google Patents
Method and apparatus for scheduling of resource simulated pressure Download PDFInfo
- Publication number
- CN106992901A CN106992901A CN201610038140.7A CN201610038140A CN106992901A CN 106992901 A CN106992901 A CN 106992901A CN 201610038140 A CN201610038140 A CN 201610038140A CN 106992901 A CN106992901 A CN 106992901A
- Authority
- CN
- China
- Prior art keywords
- resource
- request
- user
- sequence
- request sequence
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L43/00—Arrangements for monitoring or testing data switching networks
- H04L43/08—Monitoring or testing based on specific metrics, e.g. QoS, energy consumption or environmental parameters
- H04L43/0805—Monitoring or testing based on specific metrics, e.g. QoS, energy consumption or environmental parameters by checking availability
- H04L43/0817—Monitoring or testing based on specific metrics, e.g. QoS, energy consumption or environmental parameters by checking availability by checking functioning
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/10—Protocols in which an application is distributed across nodes in the network
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/50—Network services
- H04L67/60—Scheduling or organising the servicing of application requests, e.g. requests for application data transmissions using the analysis and optimisation of the required network resources
Landscapes
- Engineering & Computer Science (AREA)
- Computer Networks & Wireless Communication (AREA)
- Signal Processing (AREA)
- Environmental & Geological Engineering (AREA)
- Management, Administration, Business Operations System, And Electronic Commerce (AREA)
Abstract
The purpose of the application is to provide a kind of method and apparatus for Resource Scheduler simulated pressure, the resource request sequence that resource request sequence generator is submitted is obtained by Resource Scheduler, then, a resource node is searched, and asks the User Resource Management device for dispatching the resource node to parse the resource request sequence;The resource request sequence analysis is some user resources request units and sends some user resources request units and respective resources to the Resource Scheduler by User Resource Management device;Received some user resources request units and respective resources are distributed to one or more resource nodes and carry out simulated pressure processing by Resource Scheduler;Finally, the Resource Calculation analog subscriber that User Resource Management device is distributed according to Resource Scheduler using the user resources request unit calculate the time of needs.Resource Scheduler is operated in from User Resource Management device on different physical nodes, so as to realize the scalability of pressure simulation device.
Description
Technical field
The application is related to computer realm, more particularly to a kind of technology for scheduling of resource simulated pressure.
Background technology
Under distributed system, Resource Scheduler not only needs thousands of of management cluster to operate in physics
Resource node on node, while also needing to undertake the resource scheduling request of up to ten thousand times per second, and needs
Made a policy in the case where Millisecond other time is complicated.So special to the behavior of Resource Scheduler under stress
The O&A levied just seems extremely important.
Because the current other cluster scale of technical grade has reached more than 5000, so if desired
Resource Scheduler is run under the physical node of such scale, it is not only difficult very big, and from safeguarding into
Originally saw it is very high.So it is real big to need one kind to be simulated on small-scale physical node
The technological means of scale resource node.
At present, scheduler load simulator (the Scheduler Load in distributed system Hadoop
Simulator, SLS) it is a kind of unit modeling scheme, main purpose is to simulate real cluster
Environment is designed the pressure of the function formation task of different schedulers;By Resource Scheduler and all
The resource node of simulation be all placed in a physical machine, and use the resource request sequence of set form
As input, pressure input simulator.This scheme is in technology realization, scheduler and simulator
Operate in same physical machine so that distribution can not be realized, the pressure of simulator can not also be expanded to
On multiple physical nodes, therefore the true cluster scale that it can simulate is caused to be limited;In addition, SLS is only
A kind of pressure sequence data of set form can be received so that the data of separate sources need to pre-process
The daily record data and manually generated data format that cluster on SLS, such as line can just be inputed to be often
It is different, therefore limit its flexibility.
The content of the invention
The purpose of the application is to provide a kind of method and apparatus for scheduling of resource simulated pressure, passes through
Limited physical node simulation builds large-scale resource node set, and Resource Scheduler is entered with facilitating
The index of row each side is investigated, while realizing the scalability of simulator and improving its flexibility.
Scheduling of resource mould is used at Resource Scheduler end there is provided one kind according to the one side of the application
The method of pseudopressure, including:
Obtain the resource request sequence that resource request sequence generator is submitted;
One resource node is searched based on the resource request sequence, and asks to dispatch the use of the resource node
Family explorer parses the resource request sequence;
Obtain some user resources that the User Resource Management device is parsed based on the resource request sequence
Request unit;
Some user resources request units and respective resources are distributed into one or more resource nodes to enter
The processing of row simulated pressure.
According to the one side of the application, additionally provide one kind and adjusted at User Resource Management device end for resource
The method of simulated pressure is spent, including:
Obtain the resource request sequence of Resource Scheduler institute request analysis;
It is some user resources request units based on the resource request sequence analysis;
Some user resources request units and respective resources are sent to the Resource Scheduler.
According to the one side of the application, additionally provide one kind and adjusted at User Resource Management device end for resource
The method of simulated pressure is spent, including:
Obtain one or more user resources request units and respective resources that Resource Scheduler is distributed;
Carry out calculating needs using the user resources request unit using the Resource Calculation analog subscriber
Time.
According to the one side of the application, additionally provide one kind is used to give birth at resource request sequence generator end
Into the method for resource request sequence, including:
Resource request sequence is obtained, wherein, the resource request sequence includes the time series and money of request
Source request description file, wherein, the resource request describes file please including the resource that user task needs
Ask element number information, the resource node positional information of each resource request unit and each resource request list
The required central processing unit information of member and memory information;
The resource request sequence is converted into the resource request sequence of unified form;
Resource request sequence after the conversion is submitted to Resource Scheduler.
According to the another aspect of the application, a kind of resource for scheduling of resource simulated pressure is additionally provided
Scheduler, including:
Request sequence acquisition device, the resource request sequence for obtaining the submission of resource request sequence generator;
Dispatching device, for searching a resource node based on the resource request sequence, and asks to dispatch institute
The User Resource Management device for stating resource node parses the resource request sequence;
Request unit acquisition device, the resource request sequence is based on for obtaining the User Resource Management device
Arrange some user resources request units parsed;
Distributor, for by some user resources request units and respective resources distribute to one or
Multiple resource nodes carry out simulated pressure processing.
According to the another aspect of the application, additionally provide a kind of user for scheduling of resource simulated pressure and provide
Source manager, including:
Obtain sequence device, the resource request sequence for obtaining Resource Scheduler institute request analysis;
Resolver, for being some user resources request units based on the resource request sequence analysis;
Dispensing device, for some user resources request units and respective resources to be sent to the money
Source scheduler.
According to the another aspect of the application, additionally provide a kind of user for scheduling of resource simulated pressure and provide
Source manager, including:
Resource devices are obtained, for obtaining one or more user resources request that Resource Scheduler is distributed
Unit and respective resources;
Computing device, for using the user resources request unit using the Resource Calculation analog subscriber
Calculate the time of needs.
According to the another aspect of the application, additionally providing a kind of resource for being used to generate resource request sequence please
Sequence generator is sought, wherein, the resource request sequence generator includes:
Acquisition device, for obtaining resource request sequence, wherein, the resource request sequence includes request
Time series and resource request file is described, wherein, the resource request describe file include user appoint
Be engaged in need resource request unit quantity information, the resource node positional information of each resource request unit and
Central processing unit information and memory information needed for each resource request unit;
Conversion equipment, the resource request sequence for the resource request sequence to be converted into unified form;
Issuing means, for the resource request sequence after the conversion to be submitted to Resource Scheduler.
According to the another further aspect of the application, additionally provide and a kind of be for Resource Scheduler simulated pressure
System, the system includes foregoing Resource Scheduler and User Resource Management device.
According to the another aspect of the application, additionally provide and a kind of be for Resource Scheduler simulated pressure
System, the system includes foregoing Resource Scheduler, User Resource Management device and resource request sequence
Maker.
Compared with prior art, according to embodiments herein methods described and equipment, resource request sequence
Column-generation device obtains the resource request sequence of different-format and is converted into the resource of unified form please
Sequence is sought, then, the resource request sequence after the conversion Resource Scheduler is submitted to;So, no
Resource request sequence with form converted inputs to Resource Scheduler, institute under the distributed environment of simulation
The pressure type variation of input, improves the flexibility of pressure simulation device.Further, scheduling of resource
Device is based on the resource request sequence and searches a resource node, and asks to dispatch the user of the resource node
Explorer parses the resource request sequence;User Resource Management device is by the resource request sequence solution
Analyse as some user resources request units and send some user resources request units and respective resources
To the Resource Scheduler;Resource Scheduler is by received some user resources request units and accordingly
Resource allocation carries out simulated pressure processing to one or more resource nodes;Finally, User Resource Management device
The Resource Calculation analog subscriber distributed according to Resource Scheduler uses the user resources request unit
Calculate the time of needs.Above-mentioned Resource Scheduler is distributed in different physics from User Resource Management device
The User Resource Management device parsed on node and to resource request sequence is with receiving distributed money
The User Resource Management device that source is handled can be same or difference, reach the expansible of pressure simulation device
Purpose, can be deployed on any number of physical node, facilitate various varying environments deployment and then
The convenient index that each side is carried out to Resource Scheduler is investigated.
Brief description of the drawings
By reading the detailed description made to non-limiting example made with reference to the following drawings, this Shen
Other features, objects and advantages please will become more apparent upon:
Fig. 1 shows to be adjusted according to a kind of resource for scheduling of resource simulated pressure of the application one side
Spend the structural representation of device 1;
Fig. 2 shows to be adjusted according to a kind of resource for scheduling of resource simulated pressure of the application one side
Spend device 1 and the structural representation of the cooperation of User Resource Management device 2 and User Resource Management device 3;
Fig. 3 shows to be provided according to a kind of user for scheduling of resource simulated pressure of the application one side
The structural representation of source manager 2;
Fig. 4 shows to be provided according to a kind of user for scheduling of resource simulated pressure of the application one side
The structural representation of source manager 3;
Fig. 5 shows to be provided according to a kind of user for scheduling of resource simulated pressure of the application one side
Another structural representation of source manager 3;
Fig. 6 shows the User Resource Management device 3 of a preferred embodiment according to the application one side
Implementation process schematic diagram;
Fig. 7 shows to be adjusted according to a kind of resource for scheduling of resource simulated pressure of the application one side
Spend device 1 ', User Resource Management device 2 ' and User Resource Management device 3 ' and resource request sequence generator 4
Cooperation structural representation;
Fig. 8 is shown please according to a kind of resource for scheduling of resource simulated pressure of the application one side
Seek the structural representation of sequence generator 4;
Fig. 9 shows to be generated according to the resource request sequence of the another preferred embodiment of the application one side
The principle schematic that device is realized;
Figure 10 shows the system architecture schematic diagram of a preferred embodiment according to the application one side;
Figure 11 shows to be adjusted for resource at Resource Scheduler end according to a kind of of the application another aspect
Spend the schematic flow sheet of the method for simulated pressure;
Figure 12 shows a kind of resource for scheduling of resource simulated pressure according to the application one side
Scheduler 1 interacts schematic diagram with the cooperation of User Resource Management device 2 and User Resource Management device 3;
Figure 13 shows at the end of User Resource Management device 2 to be used for according to one kind of the application another aspect
The schematic flow sheet of the method for scheduling of resource simulated pressure;
Figure 14 show according to the application another aspect another the end of User Resource Management device 3 use
In the schematic flow sheet of the method for scheduling of resource simulated pressure;
Figure 15 show according to the application another aspect another the end of User Resource Management device 3 use
Also include the schematic flow sheet of other method in scheduling of resource simulated pressure;
Figure 16 shows a kind of resource for scheduling of resource simulated pressure according to the application one side
Scheduler 1 ', User Resource Management device 2 ' and User Resource Management device 3 ' and resource request sequence generator
The interaction schematic diagram of 4 cooperation;
Figure 17 shows to be used at resource request sequence generator end according to a kind of of the application another aspect
In the schematic flow sheet of the method for scheduling of resource simulated pressure.
Same or analogous reference represents same or analogous part in accompanying drawing.
Embodiment
The application is described in further detail below in conjunction with the accompanying drawings.
Fig. 1 shows to be adjusted according to a kind of resource for scheduling of resource simulated pressure of the application one side
Spend the structural representation of device 1.The Resource Scheduler 1 includes request sequence acquisition device 11, scheduling
Device 12, request unit acquisition device 13 and distributor 14;Wherein, the request sequence obtains dress
Put the resource request sequence of 11 acquisition resource request sequence generators submission;The dispatching device 12 is based on
The resource request sequence searches a resource node, and asks to dispatch the user resources pipe of the resource node
Manage device and parse the resource request sequence;The request unit acquisition device 13 obtains the user resources pipe
Some user resources request units that reason device is parsed based on the resource request sequence;Distributor 14 will
Some user resources request units and respective resources are distributed to one or more resource nodes and simulated
Pressure treatment.
The Resource Scheduler 1 can be that the network equipment or the network equipment are mutually collected with touch terminal by network
Shell script into the equipment constituted, wherein, the network equipment can be according to prior including one kind
Setting or the instruction of storage, the automatic electronic equipment for carrying out numerical computations and information processing, its hardware include
But be not limited to microprocessor, application specific integrated circuit (ASIC), programmable gate array (FPGA), numeral at
Manage device (DSP), embedded device etc..The network includes but is not limited to internet, wide area network, metropolitan area
Net, LAN, VPN, wireless self-organization network (Ad Hoc networks) etc..Certainly, ability
Field technique personnel will be understood that above-mentioned Resource Scheduler is only for example, and other are existing or are likely to occur from now on
Resource Scheduler be such as applicable to the application, should also be included within the application protection domain, and herein
It is incorporated herein by reference.
Specifically, the request sequence acquisition device 11 obtains the resource that resource request sequence generator is submitted
Request sequence.
Here, also request sequence while the resource request sequence of resource request sequence generator submission
Corresponding task has submitted to Resource Scheduler, and Resource Scheduler is production rank, it is ensured that resource
The authenticity of request sequence, it is ensured that the behavioral indicator for the Resource Scheduler that can be seen all is the code of production
Showed.Resource Scheduler is used to manage all resource nodes of whole cluster in a distributed system
Unit.It can be seen that the resource of whole all resource nodes of cluster, and sent according to user CPU,
Memory request is scheduled.The resource request may issue resource in different time points by multiple users and adjust
Device is spent, each request is the CPU and internal memory that specific user wants, and these resource requests are finally to divide
It is fitted on specific resource node.
Specifically, the dispatching device 12 is based on the resource request sequence and searches a resource node, and please
The User Resource Management device for dispatching the resource node is asked to parse the resource request sequence.
In one embodiment, after Resource Scheduler 1 receives a user task, carry out searching a money
Source node to dispatch a User Resource Management device, wherein, carry out search resource node be scheduled user
Explorer can be searched according to certain specific algorithm, such as according to the idle shape of Current resource node
State is ranked up, and most idle resource node is first found during lookup;Also can be inclined according to the position of resource node
It is good to carry out, such as search nearest resource node.Find and corresponding user's money is scheduled after resource node
Source manager carries out resolving resource request sequence, now it should be noted that resource node and user resources
Manager is deployed on same physical node.The resource node is that Resource Scheduler see one is true
Schedulable resource unit, have CPU and internal memory that oneself is independent, be a complete resource, true
It is a physical server in real environment, is an analog node in simulator.The physical node is
One real physical server, there is independent CPU and memory source.It is a money in true environment
Source node, is the carrier of analog node operation in simulated environment.
Specifically, the request unit acquisition device 13 obtains the User Resource Management device and is based on the money
Some user resources request unit (not shown) that source request sequence is parsed.
Wherein, the user resources request unit includes:The resource request unit quantity that user task needs
Information, the resource node positional information of each resource request unit, element resources amount and each resource request
Central processing unit information and memory information needed for unit.
Here, User Resource Management device carries out parsing user resources request unit, the true row of analog subscriber
For resource request unit can be inquired at which by the resource node positional information of each resource request unit
Can be cluster specify or whole on part resource node.User Resource Management device will be provided
Source request unit is with the communications protocol lattice between certain form such as User Resource Management device and Resource Scheduler
Formula is sent to Resource Scheduler.
Specifically, the distributor 14 distributes some user resources request units and respective resources
Simulated pressure processing is carried out to one or more resource nodes.
Here, user resources request unit of the Resource Scheduler 1 after parsing is received, is scheduled,
Generation is needed to dispatch behavioral indicator, and one or more resource nodes are searched in resource node list, will be received
To resource request unit carry out being handed down to the corresponding User Resource Management device of resource node, form is at which
How many resource request units are distributed on a little resource nodes, User Resource Management device after these distribution are received,
The behavior that series of computation analog subscriber uses these resource request units can be carried out.
Got by Resource Scheduler 1 and carry out searching resource section after the resource request sequence that user submits
Put to dispatch User Resource Management device and incited somebody to action according to the user resources request unit after the parsing got
Resource allocation gives some User Resource Management devices, realizes and builds big rule by limited physical node simulation
The resource node set of mould more easily carries out the index investigation of each side to realize to Resource Scheduler 1;
Further, the input of Resource Scheduler 1 is the resource request sequence of different-format, realizes simulation
To the function of scheduling of resource and considering for performance indications under distributed environment.
Fig. 2 shows to be adjusted according to a kind of resource for scheduling of resource simulated pressure of the application one side
Spend device 1 and the structural representation of the cooperation of User Resource Management device 2 and User Resource Management device 3.Institute
State Resource Scheduler 1 and obtain dress including request sequence acquisition device 11, dispatching device 12, request unit
Put 13 and distributor 14;The User Resource Management device 2 includes obtaining sequence device 21, parsing dress
Put 22 and dispensing device 23;The User Resource Management device 3 includes obtaining resource devices 31 and calculating filling
Put 32.
Those skilled in the art are it should be understood that with Resource Scheduler 1 and User Resource Management device 2
System, or with Resource Scheduler 1, User Resource Management device 2 and User Resource Management device 3
System, to realize that the scheme of scheduling of resource of pressure simulation is both contained in the claimed scope of the application
Within.
Here, the Resource Scheduler 1 can be with multiple User Resource Management device cooperatings, the money
Source scheduler 1 can select different User Resource Management devices according to strategy and complete user resources shown in Fig. 2
The work of manager 2 or User Resource Management device 3.Request sequence acquisition device in Resource Scheduler 1
11, which get dispatching device 12 after resource request sequence, is based on the resource request sequence one resource section of lookup
Point, and ask the User Resource Management device 2 for dispatching the resource node to parse the resource request sequence;
Acquisition sequence device 21 in User Resource Management device 2 gets the money of 1 request analysis of Resource Scheduler
The resource request sequence analysis is some user resources request units by source request sequence, resolver 22,
Dispensing device 23 sends some user resources request units and respective resources to the scheduling of resource
Device 1;Request unit acquisition device 13 in Resource Scheduler 1 obtains the base of User Resource Management device 2
Some user resources request units parsed in the resource request sequence, if distributor 14 will be described
Dry user resources request unit and respective resources are distributed to one or more resource nodes and carried out at simulated pressure
Reason;Acquisition resource devices 31 in User Resource Management device 3 obtain one that Resource Scheduler distributed or
Computing device 32 is simulated using the Resource Calculation and used after multiple user resources request units and respective resources
Family using the user resources request unit calculate the time of needs.
In Resource Scheduler 1 and the coupled system of User Resource Management device 2 and User Resource Management device 3
In, Resource Scheduler 1 is distributed in from User Resource Management device on different physical nodes, reaches pressure mould
Intend the expansible purpose of device, can be deployed on any number of physical node, facilitate various different rings
The deployment in border and then the index investigation that each side is conveniently carried out to Resource Scheduler.
It should be noted that above-mentioned User Resource Management device 2 and User Resource Management device 3 can be same
User Resource Management device, parsing money is carried out before having been allocated resources to during the distribution resource of Resource Scheduler 1
The User Resource Management device of source request sequence;User Resource Management device 2 and User Resource Management device 3 also may be used
For different User Resource Management devices, User Resource Management device 2 sent after resolving resource request sequence
To Resource Scheduler 1, Resource Scheduler 1 distributes to resource and User Resource Management according to certain rule
The different other User Resource Management devices of device 2.
Fig. 3 shows to be provided according to a kind of user for scheduling of resource simulated pressure of the application one side
The structural representation of source manager 2.The User Resource Management device 2 includes:Acquisition sequence device 21,
Resolver 22 and dispensing device 23;Wherein, the acquisition sequence device 21 obtains Resource Scheduler institute
The resource request sequence of request analysis;Resolver 22 is based on the resource request sequence analysis and used to be some
Family resource request unit;Dispensing device 23 sends some user resources request units and respective resources
To the Resource Scheduler.
Specifically, the resource request sequence that sequence device 21 obtains Resource Scheduler institute request analysis is obtained.
In one embodiment, Resource Scheduler is received after user task, searches a resource node
A User Resource Management device 2 is dispatched, scheduled User Resource Management device 2 obtains Resource Scheduler
The resource request sequence of institute's request analysis, that is, obtain the time series of the corresponding resource request of user task
File is described with resource request.
Specifically, it is that some user resources ask list that resolver 22, which is based on the resource request sequence analysis,
Member.
Connect precedent, User Resource Management device 2 is got after resource request sequence enters one by resource request sequence
Step parses resource request unit, that is, request unit the quantity, (request of resource node preference are obtained after parsing
Cell distribution on which resource node, can be specify may also be whole cluster), and unit money
Source amount, central processing unit and internal memory.
Specifically, dispensing device 23 sends some user resources request units and respective resources to institute
State Resource Scheduler.
Continue to connect precedent, the User Resource Management device 2 for carrying out resolving resource request sequence can analog subscriber
Real behavior, modelling customer behavior operate when produce resource request, if User Resource Management device 2 will
Dry user resources request unit and corresponding resource are sent to Resource Scheduler 1, Resource Scheduler 1
Scheduling of resource is carried out according to the request received and produces the scheduling behavioral indicator of needs.
Fig. 4 show according to the application one side another be used for scheduling of resource simulated pressure user
The structural representation of explorer 3;The User Resource Management device 3 includes:Obtain resource devices
31 and computing device 32, wherein, the resource devices 31 that obtain obtain what Resource Scheduler 1 was distributed
One or more user resources request units and respective resources;The computing device 32 utilizes the resource meter
Calculate the time that analog subscriber using the user resources request unit calculate needs.
Specifically, resource devices 31 are obtained and obtain one or more user resources that Resource Scheduler is distributed
Request unit and respective resources.
In one embodiment, User Resource Management device 3 carries out obtaining resource tune during modelling customer behavior first
User resources request unit and corresponding resource that one or more users that degree device 1 is distributed need, example
Such as, allocate resources on the more resource node of idle condition and dispatch successively according to idle condition
Corresponding User Resource Management device, so that User Resource Management device gets the resource request list needed for user
Member and respective resources.
Specifically, computing device 32 please using the user resources using the Resource Calculation analog subscriber
Unit is asked calculate the time of needs.
Precedent is connect, User Resource Management device 3 receives resource request unit and the phase that Resource Scheduler 1 is issued
Answer after resource, the behavior that series of computation analog subscriber uses these resource request units can be carried out, true
It is to start physics process using the resource of distribution and calculate in real cluster.For example, statistical using some
The user that method is obtained calculates the time of needs to simulate, and such as obtaining user using timing queue takes resource
The time of the process operation started afterwards is so as to carry out the behavior that analog subscriber uses these resources.
Preferably, the User Resource Management device 3 also includes:The (not shown) of return mechanism 33, which is worked as, to be not required to
The resource is wanted, then the corresponding resource is returned into the Resource Scheduler 1.
Here, Resource Scheduler 1 needs to know which resource is which user does not need, and by its point
Dispensing others user task, this is also the important indicator for considering the handling capacity of Resource Scheduler 1, so with
Family explorer 3 is also needed to judge which resource is unwanted, and these unwanted resources are returned
Back to Resource Scheduler 1.
Preferably, as shown in figure 5, the User Resource Management device 3 also includes:Starter 34, enter
Array device 35, time set 36 and dequeue device 37;Wherein, the starter 34 utilizes institute
State resource and start physics process;The physics process is put into timing queue by array apparatus 35 of joining the team;Timing
The corresponding physics process is then put into out in group sequence by device 36 when the physics process is gone to;
Dequeue device 37 goes out team when the physics process, then the corresponding resource is returned into the resource
Scheduler.
In one embodiment, user, which gets, carries out a series of calculating simulation user after distributed resource
Using the behavior of resource, then by paying close attention to using the run time for starting physics process during resource, to determine
When used resource is no longer needed, and unwanted resource is returned into Resource Scheduler.Specifically
The implementation process schematic diagram of the User Resource Management device of a process preferred embodiment as shown in Figure 6;
First, start User Resource Management device analysis resource request sequence generation resource request unit, will analyze
Result after parsing issues Resource Scheduler, Resource Scheduler money by user resources request unit and accordingly
User Resource Management device is distributed in source, and User Resource Management device is received after resource, puts resources into meter
When queue in, using timing queue calculate statistics generation time in resource using whether have timed, out,
If so, the resource that then will no longer be required to returns Resource Scheduler, if it is not, then continuing to judge that resource is used
Situation.It should be noted that each element in timing queue represents one of user using distribution money
The physics process in source, timing queue can be put into out element then in group sequence, once there is element to go out
Team, just represents its resource used and has not needed, it is necessary to which the unwanted resource of institute is returned into resource
Scheduler.In addition, carrying out the user resources pipe of analysis parsing user resources request unit in above-mentioned flow
Manage the device resource distributed with being received simulate calculating User Resource Management device be it is same,
User Resource Management device that is existing and being likely to occur progress analysis parsing user resources request unit from now on
The User Resource Management device that the resource distributed with being received carries out simulation calculating can be identical or not
Together, if being applicable the application, adducible mode is contained in the application.
Fig. 7 shows to be adjusted according to a kind of resource for scheduling of resource simulated pressure of the application one side
Spend device 1 ', User Resource Management device 2 ' and User Resource Management device 3 ' and resource request sequence generator 4
Cooperation structural representation.Wherein, the Resource Scheduler 1 ' and the Resource Scheduler 1 in Fig. 2
It is same or similar;The User Resource Management device 2 ' it is identical with the User Resource Management device 2 in Fig. 2 or
It is similar;The User Resource Management device 3 ' and User Resource Management device 3 in Fig. 2 are same or similar;Institute
Stating resource request sequence generator 4 includes acquisition device 41, conversion equipment 42 and issuing means 43.
Those skilled in the art are it should be understood that with Resource Scheduler 1 ' and User Resource Management device 2 '
System, or with Resource Scheduler 1 ', User Resource Management device 2 ' and User Resource Management device 3 ',
Or with Resource Scheduler 1 ', User Resource Management device 2 ', User Resource Management device 3 ' and resource
The system of request sequence maker 4, to realize that the scheme of scheduling of resource of pressure simulation is both contained in this
Within the scope of being claimed.
Here, the Resource Scheduler 1 ' can be with multiple User Resource Management device cooperatings, the money
Source scheduler 1 ' can select different User Resource Management devices according to strategy and complete user resources shown in Fig. 7
The work of manager 2 ', User Resource Management device 3 ' or resource request sequence generator 4.The resource please
The acquisition device 41 in sequence generator 4 is asked to obtain resource request sequence, wherein, the resource request sequence
The time series and resource request that row include asking describe file, and conversion equipment 42 is by the resource request sequence
Row are converted into the resource request sequence of unified form, and issuing means 43 is the resource request sequence after the conversion
Row submit to Resource Scheduler 1 ';Then, the dispatching device 12 ' in Resource Scheduler 1 ' is based on the resource
Request sequence searches a resource node, and asks to dispatch the User Resource Management device parsing of the resource node
The resource request sequence;Acquisition sequence device 21 ' in User Resource Management device 2 ' gets scheduling of resource
The resource request sequence analysis is some by the resource request sequence of device institute request analysis, resolver 22 '
User resources request unit, dispensing device 23 ' sends out some user resources request units and respective resources
Deliver to the Resource Scheduler 1 ';Request unit acquisition device 13 ' in Resource Scheduler 1 ' obtains described use
Some user resources request units that family explorer 2 ' is parsed based on the resource request sequence, point
Some user resources request units and respective resources are distributed into one or more resources with device 14
Node carries out simulated pressure processing;Acquisition resource devices 31 ' in User Resource Management device 3 ' obtain resource and adjusted
Computing device 32 ' is utilized after one or more user resources request units and respective resources that degree device is distributed
The Resource Calculation analog subscriber using the user resources request unit calculate the time of needs.
In above-mentioned Resource Scheduler 1 ', User Resource Management device 2 ' and User Resource Management device 3 ' and resource
In the coupled system of request sequence maker 4, realize different-format resource request sequence it is converted
Resource Scheduler is inputed under the distributed environment of simulation, so that, the pressure type variation inputted,
Improve the flexibility of pressure simulation device.
Fig. 8 is shown please according to a kind of resource for scheduling of resource simulated pressure of the application one side
Seek the structural representation of sequence generator 4;The resource request sequence generator 4 includes:Acquisition device
41st, conversion equipment 42 and issuing means 43, wherein, the acquisition device 41 obtains resource request sequence,
Wherein, the time series and resource request that the resource request sequence includes asking describe file, wherein,
The resource request describes resource request unit quantity information, the Mei Gezi that file needs including user task
Central processing unit information needed for the resource node positional information and each resource request unit of source request unit
And memory information;The resource request sequence is converted into the resource request sequence of unified form by conversion equipment 42
Row;Resource request sequence after the conversion is submitted to Resource Scheduler by issuing means 43.
Specifically, acquisition device 41 obtains resource request sequence, wherein, the resource request sequence includes
The time series and resource request of request describe file, wherein, the resource request, which describes file, includes use
The resource request unit quantity information of family task needs, the resource node position letter of each resource request unit
Central processing unit information and memory information needed for breath and each resource request unit.
Here, by operation maintenance personnel on Consumer's Experience personnel or line using producing on automated tool or line
The resource request sequence that true request is built, is input to the life of simulator resource request sequence in a different format
Grow up to be a useful person module, wherein, the form of artificial constructed sequence shows as fixed code, such as JSON
Protocol buffer (agreement buffering area) in (JavaScript Notation) data format, google;
The Format Series Lines produced on line is journal format.In addition, artificial constructed resource request sequence can be set
It is scheduled under a certain scene according to certain rule, such as is carried out in an interval that can set the time using automatic
The resource request sequence built on tools build resource request sequence, line has scalability, resource request
Sequence is the sequence on time dimension, and the pressure produced between from 0 point to 3 points is zoomed into 0 point to 2 points
Between the pressure that produces, i.e., should be that the pressure of the resource request sequence just produced between 0 point to 3 points exists
Just it there occurs between 0 point to 2 points so that the time interval for producing certain pressure is shortened, to institute on line
The scaling processing of the resource request sequence of structure can investigate the performance indications of simulator, if wanting to judge is used to provide
The stability of the simulator of the pressure simulation of source scheduling, then by the time of the resource request sequence produced on line
Extension, such as extends to the pressure produced between from 0 point to 3 points the pressure produced between 0 point to 5 points.
Specifically, the resource request sequence is converted into the resource request sequence of unified form by conversion equipment 42
Row.The conversion equipment 42 includes resolution unit (not shown), acquiring unit (not shown) and conversion
Unit (not shown);Wherein, resolution unit resolving resource request configuration file or resource request sequence daily record;
Interval of the acquiring unit based on the configuration file or the resource request sequence log acquisition request sequence and
Resource request describes file;Converting unit describes the interval of the request sequence of the acquisition and resource request
File is converted into the resource request sequence of unified form.
In one embodiment, the resource request sequence generator 4 of simulator is receiving outside input
The sequence received is converted into the money of unified form after the data of the resource request sequence of different-format
Source request sequence, this sequence includes two major parts:The time series of request and real resource
Request description file, namely user task need specific resource unit number, the resource of each unit
CPU and internal memory that node location preference and each unit need.Wherein, time series is used to simulate
The task that user concurrently submits in different time points and same time point;Used on Resource Description File and line
The task form that family is submitted is consistent, so as to reach that allow Resource Scheduler to be received asks with real resource
Ask same or similar, reach the purpose of simulation.
Fig. 9 shows to be generated according to the resource request sequence of the another preferred embodiment of the application one side
The principle schematic that device is realized is uml diagram (the Unified Model of resource request sequence generator
Language), it was found from figure, resource sequence maker has two subclasses:Manual resource request sequence
Class (QA) is generated, manually generated resource request configuration file can be parsed, and please as generation resource
Ask the input of the two interfaces of description file and resource request interval;And resource sequence generates class on line,
Real production daily record on the line that operation maintenance personnel is obtained can be parsed, and is used as generation resource request description text
The input of the two interfaces of part and resource request interval.Resource sequence request class includes generation resource request
File and resource request interval are described, the uml diagram of resource request sequence generator also includes a base
Class, for filling, agreement is unified, and the resource request sequence of different-format is converted to the money of unified form
Source request sequence.Wherein, the interval of request sequence is that maker will be obtained after each interval is arrived
User resources describe file, and submit to Resource Scheduler as a real user task.
Specifically, the resource request sequence after the conversion is submitted to Resource Scheduler by issuing means 43.
Precedent is connect, after the resource request sequence of above-mentioned unified form is generated, the generation of resource request sequence
Device is responsible for resource request sequence to submit to Resource Scheduler, wherein, resource request sequence has its corresponding
User task, corresponding user task is also have submitted when resource request sequence is submitted.
Figure 10 shows the system architecture schematic diagram of a preferred embodiment according to the application one side.
Dotted arrow shown in figure represents network communication, and the equipment in the system includes simulator resource request
The User Resource Management device of sequence generator, Resource Scheduler and some simulations.The interaction of each equipment
The pressure simulation for scheduling of resource is allowed the system to, plays a part of pressure simulation device.Below
Interaction to each equipment is illustrated:
Acquisition device 41 in resource request sequence generator 4 is used to obtain resource request sequence, by
Operation maintenance personnel uses the true request produced on automated tool or line on Consumer's Experience personnel or line
The resource request sequence of structure, in a different format input simulator resource request sequence generator.Turn
Changing device 42 is used for the resource request sequence that the resource request sequence is converted into unified form, simulation
Resource request sequence generator receive outside input different-format resource request sequence data,
The resource request sequence that the simulation real user of unified form is submitted is converted into, dress is submitted afterwards
Put 43 and the corresponding task of resource request sequence after conversion is submitted into Resource Scheduler.Scheduling of resource
Dispatching device 12 in device receive one simulation real user task after, inquiry one resource node with
Dispatch a User Resource Management device.After the User Resource Management device for starting simulation, the user resources pipe
Further parsing user resources request sequence gets resource request unit to resolver 22 in reason device,
The real behavior of User Resource Management device analog subscriber, dispensing device 23 is by resource request unit with one
Fixed communications protocol is sent to Resource Scheduler.Resource Scheduler receives the request of analog subscriber real resources
Afterwards, distributor 14 allocates resources to the resource node of one or several simulations to dispatch accordingly
The User Resource Management device of simulation, User Resource Management device receives computing device 32 after distributed resource
The behavior that series of computation analog subscriber uses these resources is carried out, meanwhile, User Resource Management device is sentenced
Which resource of breaking no longer is needed, and unwanted resource is returned into Resource Scheduler.Wherein, scheduling of resource
Device from simulate User Resource Management device be deployed on different physical nodes, the resource node of simulation with
The User Resource Management device of simulation is on same physical node, it is seen that a physical node
The resource node of multiple simulations can be corresponded to, so as to reach the purpose for expanding amplification ratio.The resource section of simulation
Point need to carry out resource report to Resource Scheduler, and resource report just has when being launching process, can the cycle
The report resource node position preference of property, corresponding CPU and internal memory idle condition etc..
Realized by the said equipment on the cluster of a small-scale physical node, pass through the side of software
Method truly simulates the cluster of extensive resource node so that Resource Scheduler logic is this small-scale
It can be seen that the resource and number of nodes of real data center, amplification ratio can reach on the cluster of node
To 1:1000 (1 physical node can simulate 1000 resource nodes);It is possible to further solve
Cluster resource request within certain period in the artificial constructed resource request sequence of analysis, or real line
Sequence, is inputted to Resource Scheduler, reaches that index is considered under various scenes to Resource Scheduler
With the target of evaluation, the New function of Resource Scheduler can be not only investigated in different pressure request sequences
Under effect, its performance indications in scalable true line under request sequence can also be commented
Sentence.
Figure 11 shows to be adjusted for resource at the end of Resource Scheduler 1 according to a kind of of the application one side
Spend the method flow schematic diagram of simulated pressure.Methods described includes step S11, step S12, step
S13 and step S14;Wherein, in step s 11, the resource that resource request sequence generator is submitted is obtained
Request sequence;In step s 12, a resource node is searched based on the resource request sequence, and asked
The User Resource Management device for dispatching the resource node parses the resource request sequence;In step s 13,
Obtain some user resources request that the User Resource Management device is parsed based on the resource request sequence
Unit;In step S14, some user resources request units and respective resources are distributed to one
Or multiple resource nodes carry out simulated pressure processing.
Specifically, in step s 11, the resource request sequence that resource request sequence generator is submitted is obtained.
Here, also request sequence while the resource request sequence of resource request sequence generator submission
Corresponding task has submitted to Resource Scheduler, and Resource Scheduler is production rank, it is ensured that resource
The authenticity of request sequence, it is ensured that the behavioral indicator for the Resource Scheduler that can be seen all is the code of production
Showed.Resource Scheduler is used to manage all resource nodes of whole cluster in a distributed system
Unit.It can be seen that the resource of whole all resource nodes of cluster, and sent according to user CPU,
Memory request is scheduled.The resource request may issue resource in different time points by multiple users and adjust
Device is spent, each request is the CPU and internal memory that specific user wants, and these resource requests are finally to divide
It is fitted on specific resource node.
Specifically, in step s 12, a resource node is searched based on the resource request sequence, and please
The User Resource Management device for dispatching the resource node is asked to parse the resource request sequence.
In one embodiment, after Resource Scheduler 1 receives a user task, carry out searching a money
Source node to dispatch a User Resource Management device, wherein, carry out search resource node be scheduled user
Explorer can be searched according to certain specific algorithm, such as according to the idle shape of Current resource node
State is ranked up, and most idle resource node is first found during lookup;Also can be inclined according to the position of resource node
It is good to carry out, such as search nearest resource node.Find and corresponding user's money is scheduled after resource node
Source manager carries out resolving resource request sequence, now it should be noted that resource node and user resources
Manager is deployed on same physical node.The resource node is that Resource Scheduler see one is true
Schedulable resource unit, have CPU and internal memory that oneself is independent, be a complete resource, true
It is a physical server in real environment, is an analog node in simulator.The physical node is
One real physical server, there is independent CPU and memory source.It is a money in true environment
Source node, is the carrier of analog node operation in simulated environment.
Specifically, in step s 13, obtain the User Resource Management device and be based on the resource request sequence
Arrange some user resources request units parsed.
Wherein, the user resources request unit includes:The resource request unit quantity that user task needs
Information, the resource node positional information of each resource request unit, element resources amount and each resource request
Central processing unit information and memory information needed for unit.
Here, User Resource Management device carries out parsing user resources request unit, the true row of analog subscriber
For resource request unit can be inquired at which by the resource node positional information of each resource request unit
Can be cluster specify or whole on part resource node.User Resource Management device will be provided
Source request unit is with the communications protocol lattice between certain form such as User Resource Management device and Resource Scheduler
Formula is sent to Resource Scheduler.
Specifically, in step S14, some user resources request units and respective resources are distributed
Simulated pressure processing is carried out to one or more resource nodes.
Here, user resources request unit of the Resource Scheduler 1 after parsing is received, is scheduled,
Generation is needed to dispatch behavioral indicator, and one or more resource nodes are searched in resource node list, will be received
To resource request unit carry out being handed down to the corresponding User Resource Management device of resource node, form is at which
How many resource request units are distributed on a little resource nodes, User Resource Management device after these distribution are received,
The behavior that series of computation analog subscriber uses these resource request units can be carried out.
Got by Resource Scheduler 1 and carry out searching resource section after the resource request sequence that user submits
Put to dispatch User Resource Management device and incited somebody to action according to the user resources request unit after the parsing got
Resource allocation gives some User Resource Management devices, realizes and builds big rule by limited physical node simulation
The resource node set of mould more easily carries out the index investigation of each side to realize to Resource Scheduler 1;
Further, the input of Resource Scheduler 1 is the resource request sequence of different-format, realizes simulation
To the function of scheduling of resource and considering for performance indications under distributed environment.
Figure 12 shows a kind of resource for scheduling of resource simulated pressure according to the application one side
Scheduler 1 and the interaction flow of the cooperation of User Resource Management device 2 and User Resource Management device 3 are illustrated
Figure.
Those skilled in the art are it should be understood that with Resource Scheduler 1 and User Resource Management device 2
System, or with Resource Scheduler 1, User Resource Management device 2 and User Resource Management device 3
System, to realize that the scheme of scheduling of resource of pressure simulation is both contained in the claimed scope of the application
Within.
Here, the Resource Scheduler 1 can be with multiple User Resource Management device cooperatings, the money
Source scheduler 1 can select different User Resource Management devices according to strategy and complete user resources shown in Figure 12
The work of manager 2 or User Resource Management device 3.At the end of Resource Scheduler 1, step S11:Obtain
To resource request sequence, step S12:One resource node is searched based on the resource request sequence, and please
The User Resource Management device 2 for dispatching the resource node is asked to parse the resource request sequence;In user's money
The end of source manager 2, step S21:The resource request sequence of 1 request analysis of Resource Scheduler is got,
Step S22:It is some user resources request units, step S23 based on the resource request sequence analysis:
Some user resources request units and respective resources are sent to the Resource Scheduler 1;In resource
The end of scheduler 1, step S13:Obtain the User Resource Management device 2 and be based on the resource request sequence
Some user resources request units parsed, step S14:By some user resources request units
And respective resources distribute to one or more resource nodes and carry out simulated pressure processing;In User Resource Management
The end of device 3, step S31:Obtain one or more user resources request units that Resource Scheduler is distributed
And respective resources, step S32:Asked using the Resource Calculation analog subscriber using the user resources
Unit calculate the time of needs.
In Resource Scheduler 1 and the coupled system of User Resource Management device 2 and User Resource Management device 3
In, Resource Scheduler 1 is distributed in from User Resource Management device on different physical nodes, reaches pressure mould
Intend the expansible purpose of device, can be deployed on any number of physical node, facilitate various different rings
The deployment in border and then the index investigation that each side is conveniently carried out to Resource Scheduler.
It should be noted that above-mentioned User Resource Management device 2 and User Resource Management device 3 can be same
User Resource Management device, parsing money is carried out before having been allocated resources to during the distribution resource of Resource Scheduler 1
The User Resource Management device of source request sequence;User Resource Management device 2 and User Resource Management device 3 also may be used
For different User Resource Management devices, User Resource Management device 2 sent after resolving resource request sequence
To Resource Scheduler 1, Resource Scheduler 1 distributes to resource and User Resource Management according to certain rule
The different other User Resource Management devices of device 2.
Figure 13 shows to be used to provide at the end of User Resource Management device 2 according to a kind of of the application one side
The method flow schematic diagram of source dispatching simulation pressure.Methods described includes:Step S21, step S22 and
Step S23;Wherein, in the step s 21, the resource request sequence of Resource Scheduler institute request analysis is obtained
Row;It is some user resources request units based on the resource request sequence analysis in step S22;
In step S23, some user resources request units and respective resources are sent to the resource and adjusted
Spend device.
Specifically, in the step s 21, the resource request sequence of Resource Scheduler institute request analysis is obtained.
In one embodiment, Resource Scheduler is received after user task, searches a resource node
A User Resource Management device 2 is dispatched, scheduled User Resource Management device 2 obtains Resource Scheduler
The resource request sequence of institute's request analysis, that is, obtain the time series of the corresponding resource request of user task
File is described with resource request.
Specifically, please for some user resources based on the resource request sequence analysis in step S22
Seek unit.
Connect precedent, User Resource Management device 2 is got after resource request sequence enters one by resource request sequence
Step parses resource request unit, that is, request unit the quantity, (request of resource node preference are obtained after parsing
Cell distribution on which resource node, can be specify may also be whole cluster), and unit money
Source amount, central processing unit and internal memory.
Specifically, in step S23, some user resources request units and respective resources are sent
To the Resource Scheduler.
Continue to connect precedent, the User Resource Management device 2 for carrying out resolving resource request sequence can analog subscriber
Real behavior, modelling customer behavior operate when produce resource request, if User Resource Management device 2 will
Dry user resources request unit and corresponding resource are sent to Resource Scheduler 1, Resource Scheduler 1
Scheduling of resource is carried out according to the request received and produces the scheduling behavioral indicator of needs.
Figure 14 shows to be used to provide at the end of User Resource Management device 3 according to a kind of of the application one side
The method flow schematic diagram of source dispatching simulation pressure;Methods described includes:Step S31 and step S32,
Wherein, in step S31, one or more user resources request that Resource Scheduler 1 is distributed is obtained
Unit and respective resources;In the step 32, provided using the Resource Calculation analog subscriber using the user
Source request unit calculate the time of needs.
Specifically, in step S31, one or more user resources that Resource Scheduler is distributed are obtained
Request unit and respective resources.
In one embodiment, User Resource Management device 3 carries out obtaining resource tune during modelling customer behavior first
User resources request unit and corresponding resource that one or more users that degree device 1 is distributed need, example
Such as, allocate resources on the more resource node of idle condition and dispatch successively according to idle condition
Corresponding User Resource Management device, so that User Resource Management device gets the resource request list needed for user
Member and respective resources.
Specifically, in step s 32, the user resources are used using the Resource Calculation analog subscriber
Request unit calculate the time of needs.
Precedent is connect, User Resource Management device 3 receives resource request unit and the phase that Resource Scheduler 1 is issued
Answer after resource, the behavior that series of computation analog subscriber uses these resource request units can be carried out, true
It is to start physics process using the resource of distribution and calculate in real cluster.For example, statistical using some
The user that method is obtained calculates the time of needs to simulate, and such as obtaining user using timing queue takes resource
The time of the process operation started afterwards is so as to carry out the behavior that analog subscriber uses these resources.
Preferably, methods described also includes:Step S33 (not shown), when not needing the resource, then
The corresponding resource is returned into the Resource Scheduler 1.
Here, Resource Scheduler 1 needs to know which resource is which user does not need, and by its point
Dispensing others user task, this is also the important indicator for considering the handling capacity of Resource Scheduler 1, so with
Family explorer 3 is also needed to judge which resource is unwanted, and these unwanted resources are returned
Back to Resource Scheduler 1.
Preferably, as shown in figure 15, methods described also includes:Step S34, step S35, step S36
With step S37;Wherein, in step S34, physics process is started using the resource;In step S35
In, the physics process is put into timing queue;In step S36, when the physics process is performed
Then, then the corresponding physics process is put into out in group sequence;In step S37, when the physics
Process goes out team, then the corresponding resource is returned into the Resource Scheduler.
In one embodiment, user, which gets, carries out a series of calculating simulation user after distributed resource
Using the behavior of resource, then by paying close attention to using the run time for starting physics process during resource, to determine
When used resource is no longer needed, and unwanted resource is returned into Resource Scheduler.Specifically
The implementation process schematic diagram of the User Resource Management device of a process preferred embodiment as shown in Figure 6;
First, start User Resource Management device analysis resource request sequence generation resource request unit, will analyze
Result after parsing issues Resource Scheduler, Resource Scheduler money by user resources request unit and accordingly
User Resource Management device is distributed in source, and User Resource Management device is received after resource, puts resources into meter
When queue in, using timing queue calculate statistics generation time in resource using whether have timed, out,
If so, the resource that then will no longer be required to returns Resource Scheduler, if it is not, then continuing to judge that resource is used
Situation.It should be noted that each element in timing queue represents one of user using distribution money
The physics process in source, timing queue can be put into out element then in group sequence, once there is element to go out
Team, just represents its resource used and has not needed, it is necessary to which the unwanted resource of institute is returned into resource
Scheduler.In addition, carrying out the user resources pipe of analysis parsing user resources request unit in above-mentioned flow
Manage the device resource distributed with being received simulate calculating User Resource Management device be it is same,
User Resource Management device that is existing and being likely to occur progress analysis parsing user resources request unit from now on
The User Resource Management device that the resource distributed with being received carries out simulation calculating can be identical or not
Together, if being applicable the application, adducible mode is contained in the application.
Figure 16 shows a kind of resource for scheduling of resource simulated pressure according to the application one side
Scheduler 1 ', User Resource Management device 2 ' and User Resource Management device 3 ' and resource request sequence generator
The interaction flow schematic diagram of 4 cooperation.Wherein, the Resource Scheduler 1 ' is adjusted with the resource in Figure 12
Spend device 1 same or similar;The User Resource Management device 2 ' and the User Resource Management device 2 in Figure 12
It is same or similar;The User Resource Management device 3 ' it is identical with the User Resource Management device 3 in Figure 12 or
It is similar;At the end of resource request sequence generator 4, methods described includes step S41, step S42
With step S43.
Those skilled in the art are it should be understood that in Resource Scheduler 1 ' and User Resource Management device 2 '
The systems approach at end, or in Resource Scheduler 1 ', User Resource Management device 2 ' and User Resource Management device
3 ', or with Resource Scheduler 1 ', User Resource Management device 2 ', User Resource Management device 3 ' and
The systems approach at the end of resource request sequence generator 4, with the scheme for the scheduling of resource for realizing pressure simulation
It is both contained within the scope of the application is claimed.
Here, the Resource Scheduler 1 ' can be with multiple User Resource Management device cooperatings, the money
Source scheduler 1 ' can select different User Resource Management devices according to strategy and complete user resources shown in Figure 16
The work of manager 2 ', User Resource Management device 3 ' or resource request sequence generator 4.In the resource
The end of request sequence maker 4, step S41:Resource request sequence is obtained, wherein, the resource request
The time series and resource request that sequence includes request describe file, step S42:By the resource request
Sequence is converted into the resource request sequence of unified form, step S43:The resource request after the conversion
Sequence submits to Resource Scheduler 1 ';Then, held in Resource Scheduler 1 ', step S12 ':Based on described
Resource request sequence searches a resource node, and asks to dispatch the User Resource Management device of the resource node
Parse the resource request sequence;Held in User Resource Management device 2 ', step S21 ':Get resource tune
Spend the resource request sequence of device institute request analysis, step S22 ':If being by the resource request sequence analysis
Dry user resources request unit, step S23 ':By some user resources request units and respective resources
Send to the Resource Scheduler 1 ';Held in Resource Scheduler 1 ', step S13 ':Obtain user's money
Some user resources request units that source manager 2 ' is parsed based on the resource request sequence, step S14:
Some user resources request units and respective resources are distributed into one or more resource nodes and carry out mould
Pseudopressure processing;Held in User Resource Management device 3 ', step S31 ':Obtain what Resource Scheduler was distributed
One or more user resources request units and respective resources, step S32 ':Utilize the Resource Calculation mould
Intend the time that user using the user resources request unit calculate needs.
In above-mentioned Resource Scheduler 1 ', User Resource Management device 2 ' and User Resource Management device 3 ' and resource
In the coupled system method at the end of request sequence maker 4, the resource request sequence warp of different-format is realized
Conversion inputs to Resource Scheduler under the distributed environment of simulation, so that, the pressure type inputted is more
Sample, improves the flexibility of pressure simulation device.
Figure 17 shows to be used at the end of resource request sequence generator 4 according to a kind of of the application one side
In the method flow schematic diagram of scheduling of resource simulated pressure;Methods described includes:Step S41, step
S42 and step S43;Wherein, in the step S41, resource request sequence is obtained, wherein, it is described
The time series and resource request that resource request sequence includes request describe file, wherein, the resource please
Description file is asked to include resource request unit quantity information, each resource request unit that user task needs
Resource node positional information and each resource request unit needed for central processing unit information and memory information;
In step S42, the resource request sequence is converted into the resource request sequence of unified form;In step
In rapid S43, the resource request sequence after the conversion is submitted to Resource Scheduler.
Specifically, in step S41, resource request sequence is obtained, wherein, the resource request sequence
Time series and resource request including request describe file, wherein, the resource request describes file bag
Include resource request unit quantity information, the resource node position of each resource request unit of user task needs
Confidence ceases and the central processing unit information and memory information needed for each resource request unit.
Here, by operation maintenance personnel on Consumer's Experience personnel or line using producing on automated tool or line
The resource request sequence that true request is built, is input to the life of simulator resource request sequence in a different format
Grow up to be a useful person module, wherein, the form of artificial constructed sequence shows as fixed code, such as JSON
Protocol buffer (agreement buffering area) in (JavaScript Notation) data format, google;
The Format Series Lines produced on line is journal format.In addition, artificial constructed resource request sequence can be set
It is scheduled under a certain scene according to certain rule, such as is carried out in an interval that can set the time using automatic
The resource request sequence built on tools build resource request sequence, line has scalability, resource request
Sequence is the sequence on time dimension, and the pressure produced between from 0 point to 3 points is zoomed into 0 point to 2 points
Between the pressure that produces, i.e., should be that the pressure of the resource request sequence just produced between 0 point to 3 points exists
Just it there occurs between 0 point to 2 points so that the time interval for producing certain pressure is shortened, to institute on line
The scaling processing of the resource request sequence of structure can investigate the performance indications of simulator, if wanting to judge is used to provide
The stability of the simulator of the pressure simulation of source scheduling, then by the time of the resource request sequence produced on line
Extension, such as extends to the pressure produced between from 0 point to 3 points the pressure produced between 0 point to 5 points.
Specifically, in step S42, the resource that the resource request sequence is converted into unified form please
Seek sequence.Preferably, resolving resource request configuration file or resource request sequence daily record;Then, it is based on
The configuration file or the interval of the resource request sequence log acquisition request sequence and resource request description
File;Then, the interval of the request sequence of the acquisition and resource request are described into file and is converted into unification
The resource request sequence of form.
In one embodiment, the resource request sequence generator 4 of simulator is receiving outside input
The sequence received is converted into the money of unified form after the data of the resource request sequence of different-format
Source request sequence, this sequence includes two major parts:The time series of request and real resource
Request description file, namely user task need specific resource unit number, the resource of each unit
CPU and internal memory that node location preference and each unit need.Wherein, time series is used to simulate
The task that user concurrently submits in different time points and same time point;Used on Resource Description File and line
The task form that family is submitted is consistent, so as to reach that allow Resource Scheduler to be received asks with real resource
Ask same or similar, reach the purpose of simulation.
Fig. 9 shows to be generated according to the resource request sequence of the another preferred embodiment of the application one side
The principle schematic that device is realized is uml diagram (the Unified Model of resource request sequence generator
Language), it was found from figure, resource sequence maker has two subclasses:Manual resource request sequence
Class (QA) is generated, manually generated resource request configuration file can be parsed, and please as generation resource
Ask the input of the two interfaces of description file and resource request interval;And resource sequence generates class on line,
Real production daily record on the line that operation maintenance personnel is obtained can be parsed, and is used as generation resource request description text
The input of the two interfaces of part and resource request interval.Resource sequence request class includes generation resource request
File and resource request interval are described, the uml diagram of resource request sequence generator also includes a base
Class, for filling, agreement is unified, and the resource request sequence of different-format is converted to the money of unified form
Source request sequence.Wherein, the interval of request sequence is that maker will be obtained after each interval is arrived
User resources describe file, and submit to Resource Scheduler as a real user task.
Specifically, in step S43, the resource request sequence after the conversion is submitted to scheduling of resource
Device.
Precedent is connect, after the resource request sequence of above-mentioned unified form is generated, the generation of resource request sequence
Device is responsible for resource request sequence to submit to Resource Scheduler, wherein, resource request sequence has its corresponding
User task, corresponding user task is also have submitted when resource request sequence is submitted.
Figure 10 shows the system architecture schematic diagram of a preferred embodiment according to the application one side.
Dotted arrow shown in figure represents network communication, in the systems approach, is included in simulator resource
The method at the User Resource Management device end of request sequence maker, Resource Scheduler and some simulations.
The interaction of each equipment end causes the systems approach to can be used in the pressure simulation of scheduling of resource, plays pressure
The effect of power simulator.The interaction in each equipment end is illustrated below:
At the end of resource request sequence generator 4, step S41:Resource request sequence is obtained, by user
Operation maintenance personnel uses the true request produced on automated tool or line to build on experience personnel or line
Resource request sequence, input simulator resource request sequence generator in a different format.Step S42:
Resource request sequence for the resource request sequence to be converted into unified form, the resource request of simulation
Sequence generator receives the data of the resource request sequence of the different-format of outside input, and they are changed
The resource request sequence submitted into the simulation real user of unified form, step S43:After conversion
The corresponding task of resource request sequence submits to Resource Scheduler.At Resource Scheduler end, step S12:
Receive after a simulation real user task, inquire about a resource node to dispatch a user resources pipe
Manage device.After the User Resource Management device for starting simulation, at User Resource Management device end, step S22:
Further parsing user resources request sequence gets resource request unit, the simulation of User Resource Management device
The real behavior of user, step S23:Resource request unit is sent to money with certain communications protocol
Source scheduler.Resource Scheduler is received after the request of analog subscriber real resources, step S14:By resource
The User Resource Management device that the resource node of one or several simulations is simulated accordingly to dispatch is distributed to,
User Resource Management device receives distributed resource, step S32:Carry out series of computation analog subscriber
Using the behavior of these resources, meanwhile, User Resource Management device judges which resource no longer needs, will
Unwanted resource returns Resource Scheduler.Wherein, Resource Scheduler and the User Resource Management of simulation
Device is deployed on different physical nodes, and the resource node and the User Resource Management device of simulation of simulation exist
On same physical node, it is seen that a physical node can correspond to the resource section of multiple simulations
Point, so as to reach the purpose for expanding amplification ratio.The resource node of simulation need to be provided to Resource Scheduler
Source is reported, and resource report just has when being launching process, can periodically report resource node position inclined
It is good, corresponding CPU and internal memory idle condition etc..
Realized by above-mentioned systems approach on the cluster of a small-scale physical node, by soft
The method of part truly simulates the cluster of extensive resource node so that Resource Scheduler logic is this
It can be seen that the resource and number of nodes of real data center, amplification ratio on the cluster of small-scale node
1 can be reached:1000 (1 physical node can simulate 1000 resource nodes);Further,
Cluster in artificial constructed resource request sequence, or real line can be parsed domestic-investment in certain period
Source request sequence, is inputted to Resource Scheduler, reaches and Resource Scheduler is referred under various scenes
The target considered and evaluated is marked, the New function that can not only investigate Resource Scheduler please in different pressure
The effect under sequence is sought, can also be to its performance indications in scalable true line under request sequence
Judged.
It should be noted that the application can be carried out in the assembly of software and/or software and hardware, example
Such as, it can be set using application specific integrated circuit (ASIC), general purpose computer or any other similar hardware
It is standby to realize.In one embodiment, the software program of the application can be realized by computing device
Steps described above or function.Similarly, the software program (including related data structure) of the application
Can be stored in computer readable recording medium storing program for performing, for example, RAM memory, magnetically or optically driver or
Floppy disc and similar devices.In addition, some steps or function of the application can employ hardware to realize, example
Such as, as coordinating with processor so as to performing the circuit of each step or function.
In addition, the part of the application can be applied to computer program product, such as computer journey
Sequence is instructed, and when it is computer-executed, by the operation of the computer, can be called or be provided
According to the present processes and/or technical scheme.And the programmed instruction of the present processes is called, can
It can be stored in fixed or moveable recording medium, and/or be held by broadcast or other signals
Carry the data flow in media and be transmitted, and/or be stored in the meter according to described program instruction operation
In the working storage for calculating machine equipment.Here, including a dress according to one embodiment of the application
Put, the device includes being used to store the memory of computer program instructions and for execute program instructions
Processor, wherein, when the computer program instructions are by the computing device, trigger the device
The methods and/or techniques scheme based on foregoing multiple embodiments according to the application of operation.
It is obvious to a person skilled in the art that the application is not limited to the thin of above-mentioned one exemplary embodiment
Section, and in the case of without departing substantially from spirit herein or essential characteristic, can be with other specific
Form realizes the application.Therefore, no matter from the point of view of which point, embodiment all should be regarded as exemplary
, and be nonrestrictive, scope of the present application is limited by appended claims rather than described above
It is fixed, it is intended that all changes fallen in the implication and scope of the equivalency of claim are included
In the application.The right that any reference in claim should not be considered as involved by limitation will
Ask.Furthermore, it is to be understood that the word of " comprising " one is not excluded for other units or step, odd number is not excluded for plural number.Dress
Software can also be passed through by a unit or device by putting the multiple units stated in claim or device
Or hardware is realized.The first, the second grade word is used for representing title, and is not offered as any specific
Order.
Claims (18)
1. a kind of be used for the method for scheduling of resource simulated pressure at Resource Scheduler end, wherein, methods described
Including:
Obtain the resource request sequence that resource request sequence generator is submitted;
One resource node is searched based on the resource request sequence, and asks to dispatch the use of the resource node
Family explorer parses the resource request sequence;
Obtain some user resources that the User Resource Management device is parsed based on the resource request sequence
Request unit;
Some user resources request units and respective resources are distributed into one or more resource nodes to enter
The processing of row simulated pressure.
2. according to the method described in claim 1, wherein, the user resources request unit includes:With
The resource request unit quantity information of family task needs, the resource node position letter of each resource request unit
Central processing unit information and memory information needed for breath, element resources amount and each resource request unit.
3. a kind of be used for the method for scheduling of resource simulated pressure at User Resource Management device end, wherein, it is described
Method includes:
Obtain the resource request sequence of Resource Scheduler institute request analysis;
It is some user resources request units based on the resource request sequence analysis;
Some user resources request units and respective resources are sent to the Resource Scheduler.
4. a kind of be used for the method for scheduling of resource simulated pressure at User Resource Management device end, wherein, it is described
Method includes:
Obtain one or more user resources request units and respective resources that Resource Scheduler is distributed;
Carry out calculating needs using the user resources request unit using the Resource Calculation analog subscriber
Time.
5. method according to claim 4, wherein, methods described also includes:
When not needing the resource, then the corresponding resource is returned into the Resource Scheduler.
6. method according to claim 5, wherein, methods described also includes:
Start physics process using the resource;
The physics process is put into timing queue;
When the physics process is gone to, then the corresponding physics process is put into out in group sequence;
When the physics process goes out team, then the corresponding resource is returned into the Resource Scheduler.
7. a kind of method for being used to generate resource request sequence at resource request sequence generator end, wherein,
Methods described includes:
Resource request sequence is obtained, wherein, the resource request sequence includes the time series and money of request
Source request description file, wherein, the resource request describes file please including the resource that user task needs
Ask element number information, the resource node positional information of each resource request unit and each resource request list
The required central processing unit information of member and memory information;
The resource request sequence is converted into the resource request sequence of unified form;
Resource request sequence after the conversion is submitted to Resource Scheduler.
8. method according to claim 7, described that the resource request sequence is converted into unified lattice
The resource request sequence of formula includes:
Resolving resource asks configuration file or resource request sequence daily record;
Interval and resource based on the configuration file or the resource request sequence log acquisition request sequence
Request description file;
The interval of the request sequence of the acquisition and resource request are described into the money that file is converted into unified form
Source request sequence.
9. a kind of Resource Scheduler for scheduling of resource simulated pressure, wherein, the Resource Scheduler bag
Include:
Request sequence acquisition device, the resource request sequence for obtaining the submission of resource request sequence generator;
Dispatching device, for searching a resource node based on the resource request sequence, and asks to dispatch institute
The User Resource Management device for stating resource node parses the resource request sequence;
Request unit acquisition device, the resource request sequence is based on for obtaining the User Resource Management device
Arrange some user resources request units parsed;
Distributor, for by some user resources request units and respective resources distribute to one or
Multiple resource nodes carry out simulated pressure processing.
10. Resource Scheduler according to claim 9, wherein, the user resources request unit
Including:Resource request unit quantity information, the resource section of each resource request unit of user task needs
Central processing unit information and internal memory needed for dot position information, element resources amount and each resource request unit
Information.
11. a kind of User Resource Management device for scheduling of resource simulated pressure, wherein, user's money
Source manager includes:
Obtain sequence device, the resource request sequence for obtaining Resource Scheduler institute request analysis;
Resolver, for being some user resources request units based on the resource request sequence analysis;
Dispensing device, for some user resources request units and respective resources to be sent to the money
Source scheduler.
12. a kind of User Resource Management device for scheduling of resource simulated pressure, wherein, user's money
Source manager includes:
Resource devices are obtained, for obtaining one or more user resources request that Resource Scheduler is distributed
Unit and respective resources;
Computing device, for using the user resources request unit using the Resource Calculation analog subscriber
Calculate the time of needs.
13. User Resource Management device according to claim 12, wherein, the User Resource Management
Device also includes:
Return mechanism, for when not needing the resource, then the corresponding resource being returned into the resource
Scheduler.
14. User Resource Management device according to claim 13, wherein, the User Resource Management
Device also includes:
Starter, for starting physics process using the resource;
Join the team array apparatus, for the physics process to be put into timing queue;
Time set, for when the physics process is gone to, being then put into the corresponding physics process
Go out in group sequence;
Dequeue device, for going out team when the physics process, then returns to the corresponding resource
The Resource Scheduler.
15. a kind of resource request sequence generator for being used to generate resource request sequence, wherein, the money
Source request sequence maker includes:
Acquisition device, for obtaining resource request sequence, wherein, the resource request sequence includes request
Time series and resource request file is described, wherein, the resource request describe file include user appoint
Be engaged in need resource request unit quantity information, the resource node positional information of each resource request unit and
Central processing unit information and memory information needed for each resource request unit;
Conversion equipment, the resource request sequence for the resource request sequence to be converted into unified form;
Issuing means, for the resource request sequence after the conversion to be submitted to Resource Scheduler.
16. resource request sequence generator according to claim 15, wherein, the conversion equipment
Including:
Resolution unit, configuration file or resource request sequence daily record are asked for resolving resource;
Acquiring unit, for based on the configuration file or resource request sequence log acquisition request sequence
The interval of row and resource request describe file;
Converting unit, for the interval of the request sequence of the acquisition and resource request to be described into file conversion
Into the resource request sequence of unified form.
17. a kind of system for scheduling of resource simulated pressure, wherein, the system is adjusted including resource
Device and User Resource Management device are spent, wherein,
The Resource Scheduler includes:
Request sequence acquisition device, the resource request sequence for obtaining the submission of resource request sequence generator;
Dispatching device, for searching a resource node based on the resource request sequence, and asks to dispatch institute
The User Resource Management device for stating resource node parses the resource request sequence;
Request unit acquisition device, the resource request sequence is based on for obtaining the User Resource Management device
Arrange some user resources request units parsed;
Distributor, for by some user resources request units and respective resources distribute to one or
Multiple resource nodes carry out simulated pressure processing;
The User Resource Management device includes:
Obtain sequence device, the resource request sequence for obtaining Resource Scheduler institute request analysis;
Resolver, for being some user resources request units based on the resource request sequence analysis;
Dispensing device, for some user resources request units and respective resources to be sent to the money
Source scheduler;
The User Resource Management device includes:
Resource devices are obtained, for obtaining one or more user resources request that Resource Scheduler is distributed
Unit and respective resources;
Computing device, for using the user resources request unit using the Resource Calculation analog subscriber
Calculate the time of needs.
18. a kind of system for scheduling of resource simulated pressure, wherein, the system includes scheduling of resource
Device, User Resource Management device and resource request sequence generator, wherein,
The Resource Scheduler includes:
Request sequence acquisition device, the resource request sequence for obtaining the submission of resource request sequence generator;
Dispatching device, for searching a resource node based on the resource request sequence, and asks to dispatch institute
The User Resource Management device for stating resource node parses the resource request sequence;
Request unit acquisition device, the resource request sequence is based on for obtaining the User Resource Management device
Arrange some user resources request units parsed;
Distributor, for by some user resources request units and respective resources distribute to one or
Multiple resource nodes carry out simulated pressure processing;
The User Resource Management device includes:
Obtain sequence device, the resource request sequence for obtaining Resource Scheduler institute request analysis;
Resolver, for being some user resources request units based on the resource request sequence analysis;
Dispensing device, for some user resources request units and respective resources to be sent to the money
Source scheduler;
The User Resource Management device includes:
Resource devices are obtained, for obtaining one or more user resources request that Resource Scheduler is distributed
Unit and respective resources;
Computing device, for using the user resources request unit using the Resource Calculation analog subscriber
Calculate the time of needs;
The resource request sequence generator includes:
Acquisition device, for obtaining resource request sequence, wherein, the resource request sequence includes request
Time series and resource request file is described, wherein, the resource request describe file include user appoint
Be engaged in need resource request unit quantity information, the resource node positional information of each resource request unit and
Central processing unit information and memory information needed for each resource request unit;
Conversion equipment, the resource request sequence for the resource request sequence to be converted into unified form;
Issuing means, for the resource request sequence after the conversion to be submitted to Resource Scheduler.
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201610038140.7A CN106992901B (en) | 2016-01-20 | 2016-01-20 | Method and apparatus for resource scheduling analog pressure |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201610038140.7A CN106992901B (en) | 2016-01-20 | 2016-01-20 | Method and apparatus for resource scheduling analog pressure |
Publications (2)
Publication Number | Publication Date |
---|---|
CN106992901A true CN106992901A (en) | 2017-07-28 |
CN106992901B CN106992901B (en) | 2020-08-18 |
Family
ID=59413847
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN201610038140.7A Active CN106992901B (en) | 2016-01-20 | 2016-01-20 | Method and apparatus for resource scheduling analog pressure |
Country Status (1)
Country | Link |
---|---|
CN (1) | CN106992901B (en) |
Cited By (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN107463356A (en) * | 2017-08-17 | 2017-12-12 | 北京云纵信息技术有限公司 | The execution method and apparatus of flow of task |
CN111324445A (en) * | 2018-12-14 | 2020-06-23 | 中国科学院深圳先进技术研究院 | Task scheduling simulation system |
WO2022262167A1 (en) * | 2021-06-15 | 2022-12-22 | 上海商汤科技开发有限公司 | Cluster resource scheduling method and apparatus, electronic device and storage medium |
Citations (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
WO2014210443A1 (en) * | 2013-06-28 | 2014-12-31 | Pepperdata, Inc. | Systems, methods, and devices for dynamic resource monitoring and allocation in a cluster system |
CN104536804A (en) * | 2014-12-23 | 2015-04-22 | 西安电子科技大学 | Virtual resource dispatching system for related task requests and dispatching and distributing method for related task requests |
-
2016
- 2016-01-20 CN CN201610038140.7A patent/CN106992901B/en active Active
Patent Citations (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
WO2014210443A1 (en) * | 2013-06-28 | 2014-12-31 | Pepperdata, Inc. | Systems, methods, and devices for dynamic resource monitoring and allocation in a cluster system |
CN104536804A (en) * | 2014-12-23 | 2015-04-22 | 西安电子科技大学 | Virtual resource dispatching system for related task requests and dispatching and distributing method for related task requests |
Non-Patent Citations (2)
Title |
---|
THE APACHE SOFTWARE FOUNDATION: "Yarn Scheduler Load Simulator", 《HTTP://HADOOP.APACHE.ORG/DOCS/R2.4.1/HADOOP-LS/SCHEDULERLOADSIMULATOR.HTML》 * |
董春涛: "Hadoop YARN大数据计算框架及其资源调度机制研究", 《信息通信技术》 * |
Cited By (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN107463356A (en) * | 2017-08-17 | 2017-12-12 | 北京云纵信息技术有限公司 | The execution method and apparatus of flow of task |
CN111324445A (en) * | 2018-12-14 | 2020-06-23 | 中国科学院深圳先进技术研究院 | Task scheduling simulation system |
CN111324445B (en) * | 2018-12-14 | 2024-04-02 | 中国科学院深圳先进技术研究院 | Task scheduling simulation system |
WO2022262167A1 (en) * | 2021-06-15 | 2022-12-22 | 上海商汤科技开发有限公司 | Cluster resource scheduling method and apparatus, electronic device and storage medium |
Also Published As
Publication number | Publication date |
---|---|
CN106992901B (en) | 2020-08-18 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
Sfrent et al. | Asymptotic scheduling for many task computing in big data platforms | |
Nie et al. | A GEP-based reactive scheduling policies constructing approach for dynamic flexible job shop scheduling problem with job release dates | |
CN104871154B (en) | system-level query optimization | |
JP6384065B2 (en) | Information processing apparatus, learning method, and program | |
Kianfar et al. | Study of stochastic sequence-dependent flexible flow shop via developing a dispatching rule and a hybrid GA | |
CN103886047A (en) | Distributed on-line recommending method orientated to stream data | |
US20150278309A1 (en) | Random number generator in a parallel processing database | |
CN102567312A (en) | Machine translation method based on distributive parallel computation framework | |
Pooranian et al. | New hybrid algorithm for task scheduling in grid computing to decrease missed task | |
Marichelvam et al. | Performance evaluation of an improved hybrid genetic scatter search (IHGSS) algorithm for multistage hybrid flow shop scheduling problems with missing operations | |
Yan et al. | Efficient selection of a set of good enough designs with complexity preference | |
CN110825522A (en) | Spark parameter self-adaptive optimization method and system | |
CN106992901A (en) | Method and apparatus for scheduling of resource simulated pressure | |
Sigman | Exact simulation of the stationary distribution of the FIFO M/G/c queue: the general case for ρ< c | |
WO2020036810A1 (en) | System and method for facilitating an objective-oriented data structure and an objective via the data structure | |
Li et al. | A production scheduling problem with sequence-dependent changeover costs | |
CN115618532A (en) | Network system simulation method and related device | |
Shahoud et al. | A meta learning approach for automating model selection in big data environments using microservice and container virtualization technologies | |
Casale et al. | Tools for performance evaluation of computer systems: historical evolution and perspectives | |
Huang et al. | An efficient parallel method for batched OS-ELM training using MapReduce | |
Nematpour et al. | Enhanced genetic algorithm with some heuristic principles for task graph scheduling | |
Sankaran et al. | Genetic algorithm based task reordering to improve the performance of batch scheduled massively parallel scientific applications | |
Azadeh et al. | A hybrid artificial neural network: computer simulation approach for scheduling a flow shop with multiple processors | |
CN111836274B (en) | Service processing method and device | |
García-Nájera et al. | A multi-objective genetic algorithm for the software project scheduling problem |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PB01 | Publication | ||
PB01 | Publication | ||
SE01 | Entry into force of request for substantive examination | ||
SE01 | Entry into force of request for substantive examination | ||
GR01 | Patent grant | ||
GR01 | Patent grant |