CN106992901A - Method and apparatus for scheduling of resource simulated pressure - Google Patents

Method and apparatus for scheduling of resource simulated pressure Download PDF

Info

Publication number
CN106992901A
CN106992901A CN201610038140.7A CN201610038140A CN106992901A CN 106992901 A CN106992901 A CN 106992901A CN 201610038140 A CN201610038140 A CN 201610038140A CN 106992901 A CN106992901 A CN 106992901A
Authority
CN
China
Prior art keywords
resource
request
user
sequence
request sequence
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN201610038140.7A
Other languages
Chinese (zh)
Other versions
CN106992901B (en
Inventor
欧阳晋
冯亦挥
李临川
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Alibaba Group Holding Ltd
Original Assignee
Alibaba Group Holding Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Alibaba Group Holding Ltd filed Critical Alibaba Group Holding Ltd
Priority to CN201610038140.7A priority Critical patent/CN106992901B/en
Publication of CN106992901A publication Critical patent/CN106992901A/en
Application granted granted Critical
Publication of CN106992901B publication Critical patent/CN106992901B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L43/00Arrangements for monitoring or testing data switching networks
    • H04L43/08Monitoring or testing based on specific metrics, e.g. QoS, energy consumption or environmental parameters
    • H04L43/0805Monitoring or testing based on specific metrics, e.g. QoS, energy consumption or environmental parameters by checking availability
    • H04L43/0817Monitoring or testing based on specific metrics, e.g. QoS, energy consumption or environmental parameters by checking availability by checking functioning
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00Network arrangements or protocols for supporting network services or applications
    • H04L67/01Protocols
    • H04L67/10Protocols in which an application is distributed across nodes in the network
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00Network arrangements or protocols for supporting network services or applications
    • H04L67/50Network services
    • H04L67/60Scheduling or organising the servicing of application requests, e.g. requests for application data transmissions using the analysis and optimisation of the required network resources

Landscapes

  • Engineering & Computer Science (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Signal Processing (AREA)
  • Environmental & Geological Engineering (AREA)
  • Management, Administration, Business Operations System, And Electronic Commerce (AREA)

Abstract

The purpose of the application is to provide a kind of method and apparatus for Resource Scheduler simulated pressure, the resource request sequence that resource request sequence generator is submitted is obtained by Resource Scheduler, then, a resource node is searched, and asks the User Resource Management device for dispatching the resource node to parse the resource request sequence;The resource request sequence analysis is some user resources request units and sends some user resources request units and respective resources to the Resource Scheduler by User Resource Management device;Received some user resources request units and respective resources are distributed to one or more resource nodes and carry out simulated pressure processing by Resource Scheduler;Finally, the Resource Calculation analog subscriber that User Resource Management device is distributed according to Resource Scheduler using the user resources request unit calculate the time of needs.Resource Scheduler is operated in from User Resource Management device on different physical nodes, so as to realize the scalability of pressure simulation device.

Description

Method and apparatus for scheduling of resource simulated pressure
Technical field
The application is related to computer realm, more particularly to a kind of technology for scheduling of resource simulated pressure.
Background technology
Under distributed system, Resource Scheduler not only needs thousands of of management cluster to operate in physics Resource node on node, while also needing to undertake the resource scheduling request of up to ten thousand times per second, and needs Made a policy in the case where Millisecond other time is complicated.So special to the behavior of Resource Scheduler under stress The O&A levied just seems extremely important.
Because the current other cluster scale of technical grade has reached more than 5000, so if desired Resource Scheduler is run under the physical node of such scale, it is not only difficult very big, and from safeguarding into Originally saw it is very high.So it is real big to need one kind to be simulated on small-scale physical node The technological means of scale resource node.
At present, scheduler load simulator (the Scheduler Load in distributed system Hadoop Simulator, SLS) it is a kind of unit modeling scheme, main purpose is to simulate real cluster Environment is designed the pressure of the function formation task of different schedulers;By Resource Scheduler and all The resource node of simulation be all placed in a physical machine, and use the resource request sequence of set form As input, pressure input simulator.This scheme is in technology realization, scheduler and simulator Operate in same physical machine so that distribution can not be realized, the pressure of simulator can not also be expanded to On multiple physical nodes, therefore the true cluster scale that it can simulate is caused to be limited;In addition, SLS is only A kind of pressure sequence data of set form can be received so that the data of separate sources need to pre-process The daily record data and manually generated data format that cluster on SLS, such as line can just be inputed to be often It is different, therefore limit its flexibility.
The content of the invention
The purpose of the application is to provide a kind of method and apparatus for scheduling of resource simulated pressure, passes through Limited physical node simulation builds large-scale resource node set, and Resource Scheduler is entered with facilitating The index of row each side is investigated, while realizing the scalability of simulator and improving its flexibility.
Scheduling of resource mould is used at Resource Scheduler end there is provided one kind according to the one side of the application The method of pseudopressure, including:
Obtain the resource request sequence that resource request sequence generator is submitted;
One resource node is searched based on the resource request sequence, and asks to dispatch the use of the resource node Family explorer parses the resource request sequence;
Obtain some user resources that the User Resource Management device is parsed based on the resource request sequence Request unit;
Some user resources request units and respective resources are distributed into one or more resource nodes to enter The processing of row simulated pressure.
According to the one side of the application, additionally provide one kind and adjusted at User Resource Management device end for resource The method of simulated pressure is spent, including:
Obtain the resource request sequence of Resource Scheduler institute request analysis;
It is some user resources request units based on the resource request sequence analysis;
Some user resources request units and respective resources are sent to the Resource Scheduler.
According to the one side of the application, additionally provide one kind and adjusted at User Resource Management device end for resource The method of simulated pressure is spent, including:
Obtain one or more user resources request units and respective resources that Resource Scheduler is distributed;
Carry out calculating needs using the user resources request unit using the Resource Calculation analog subscriber Time.
According to the one side of the application, additionally provide one kind is used to give birth at resource request sequence generator end Into the method for resource request sequence, including:
Resource request sequence is obtained, wherein, the resource request sequence includes the time series and money of request Source request description file, wherein, the resource request describes file please including the resource that user task needs Ask element number information, the resource node positional information of each resource request unit and each resource request list The required central processing unit information of member and memory information;
The resource request sequence is converted into the resource request sequence of unified form;
Resource request sequence after the conversion is submitted to Resource Scheduler.
According to the another aspect of the application, a kind of resource for scheduling of resource simulated pressure is additionally provided Scheduler, including:
Request sequence acquisition device, the resource request sequence for obtaining the submission of resource request sequence generator;
Dispatching device, for searching a resource node based on the resource request sequence, and asks to dispatch institute The User Resource Management device for stating resource node parses the resource request sequence;
Request unit acquisition device, the resource request sequence is based on for obtaining the User Resource Management device Arrange some user resources request units parsed;
Distributor, for by some user resources request units and respective resources distribute to one or Multiple resource nodes carry out simulated pressure processing.
According to the another aspect of the application, additionally provide a kind of user for scheduling of resource simulated pressure and provide Source manager, including:
Obtain sequence device, the resource request sequence for obtaining Resource Scheduler institute request analysis;
Resolver, for being some user resources request units based on the resource request sequence analysis;
Dispensing device, for some user resources request units and respective resources to be sent to the money Source scheduler.
According to the another aspect of the application, additionally provide a kind of user for scheduling of resource simulated pressure and provide Source manager, including:
Resource devices are obtained, for obtaining one or more user resources request that Resource Scheduler is distributed Unit and respective resources;
Computing device, for using the user resources request unit using the Resource Calculation analog subscriber Calculate the time of needs.
According to the another aspect of the application, additionally providing a kind of resource for being used to generate resource request sequence please Sequence generator is sought, wherein, the resource request sequence generator includes:
Acquisition device, for obtaining resource request sequence, wherein, the resource request sequence includes request Time series and resource request file is described, wherein, the resource request describe file include user appoint Be engaged in need resource request unit quantity information, the resource node positional information of each resource request unit and Central processing unit information and memory information needed for each resource request unit;
Conversion equipment, the resource request sequence for the resource request sequence to be converted into unified form;
Issuing means, for the resource request sequence after the conversion to be submitted to Resource Scheduler.
According to the another further aspect of the application, additionally provide and a kind of be for Resource Scheduler simulated pressure System, the system includes foregoing Resource Scheduler and User Resource Management device.
According to the another aspect of the application, additionally provide and a kind of be for Resource Scheduler simulated pressure System, the system includes foregoing Resource Scheduler, User Resource Management device and resource request sequence Maker.
Compared with prior art, according to embodiments herein methods described and equipment, resource request sequence Column-generation device obtains the resource request sequence of different-format and is converted into the resource of unified form please Sequence is sought, then, the resource request sequence after the conversion Resource Scheduler is submitted to;So, no Resource request sequence with form converted inputs to Resource Scheduler, institute under the distributed environment of simulation The pressure type variation of input, improves the flexibility of pressure simulation device.Further, scheduling of resource Device is based on the resource request sequence and searches a resource node, and asks to dispatch the user of the resource node Explorer parses the resource request sequence;User Resource Management device is by the resource request sequence solution Analyse as some user resources request units and send some user resources request units and respective resources To the Resource Scheduler;Resource Scheduler is by received some user resources request units and accordingly Resource allocation carries out simulated pressure processing to one or more resource nodes;Finally, User Resource Management device The Resource Calculation analog subscriber distributed according to Resource Scheduler uses the user resources request unit Calculate the time of needs.Above-mentioned Resource Scheduler is distributed in different physics from User Resource Management device The User Resource Management device parsed on node and to resource request sequence is with receiving distributed money The User Resource Management device that source is handled can be same or difference, reach the expansible of pressure simulation device Purpose, can be deployed on any number of physical node, facilitate various varying environments deployment and then The convenient index that each side is carried out to Resource Scheduler is investigated.
Brief description of the drawings
By reading the detailed description made to non-limiting example made with reference to the following drawings, this Shen Other features, objects and advantages please will become more apparent upon:
Fig. 1 shows to be adjusted according to a kind of resource for scheduling of resource simulated pressure of the application one side Spend the structural representation of device 1;
Fig. 2 shows to be adjusted according to a kind of resource for scheduling of resource simulated pressure of the application one side Spend device 1 and the structural representation of the cooperation of User Resource Management device 2 and User Resource Management device 3;
Fig. 3 shows to be provided according to a kind of user for scheduling of resource simulated pressure of the application one side The structural representation of source manager 2;
Fig. 4 shows to be provided according to a kind of user for scheduling of resource simulated pressure of the application one side The structural representation of source manager 3;
Fig. 5 shows to be provided according to a kind of user for scheduling of resource simulated pressure of the application one side Another structural representation of source manager 3;
Fig. 6 shows the User Resource Management device 3 of a preferred embodiment according to the application one side Implementation process schematic diagram;
Fig. 7 shows to be adjusted according to a kind of resource for scheduling of resource simulated pressure of the application one side Spend device 1 ', User Resource Management device 2 ' and User Resource Management device 3 ' and resource request sequence generator 4 Cooperation structural representation;
Fig. 8 is shown please according to a kind of resource for scheduling of resource simulated pressure of the application one side Seek the structural representation of sequence generator 4;
Fig. 9 shows to be generated according to the resource request sequence of the another preferred embodiment of the application one side The principle schematic that device is realized;
Figure 10 shows the system architecture schematic diagram of a preferred embodiment according to the application one side;
Figure 11 shows to be adjusted for resource at Resource Scheduler end according to a kind of of the application another aspect Spend the schematic flow sheet of the method for simulated pressure;
Figure 12 shows a kind of resource for scheduling of resource simulated pressure according to the application one side Scheduler 1 interacts schematic diagram with the cooperation of User Resource Management device 2 and User Resource Management device 3;
Figure 13 shows at the end of User Resource Management device 2 to be used for according to one kind of the application another aspect The schematic flow sheet of the method for scheduling of resource simulated pressure;
Figure 14 show according to the application another aspect another the end of User Resource Management device 3 use In the schematic flow sheet of the method for scheduling of resource simulated pressure;
Figure 15 show according to the application another aspect another the end of User Resource Management device 3 use Also include the schematic flow sheet of other method in scheduling of resource simulated pressure;
Figure 16 shows a kind of resource for scheduling of resource simulated pressure according to the application one side Scheduler 1 ', User Resource Management device 2 ' and User Resource Management device 3 ' and resource request sequence generator The interaction schematic diagram of 4 cooperation;
Figure 17 shows to be used at resource request sequence generator end according to a kind of of the application another aspect In the schematic flow sheet of the method for scheduling of resource simulated pressure.
Same or analogous reference represents same or analogous part in accompanying drawing.
Embodiment
The application is described in further detail below in conjunction with the accompanying drawings.
Fig. 1 shows to be adjusted according to a kind of resource for scheduling of resource simulated pressure of the application one side Spend the structural representation of device 1.The Resource Scheduler 1 includes request sequence acquisition device 11, scheduling Device 12, request unit acquisition device 13 and distributor 14;Wherein, the request sequence obtains dress Put the resource request sequence of 11 acquisition resource request sequence generators submission;The dispatching device 12 is based on The resource request sequence searches a resource node, and asks to dispatch the user resources pipe of the resource node Manage device and parse the resource request sequence;The request unit acquisition device 13 obtains the user resources pipe Some user resources request units that reason device is parsed based on the resource request sequence;Distributor 14 will Some user resources request units and respective resources are distributed to one or more resource nodes and simulated Pressure treatment.
The Resource Scheduler 1 can be that the network equipment or the network equipment are mutually collected with touch terminal by network Shell script into the equipment constituted, wherein, the network equipment can be according to prior including one kind Setting or the instruction of storage, the automatic electronic equipment for carrying out numerical computations and information processing, its hardware include But be not limited to microprocessor, application specific integrated circuit (ASIC), programmable gate array (FPGA), numeral at Manage device (DSP), embedded device etc..The network includes but is not limited to internet, wide area network, metropolitan area Net, LAN, VPN, wireless self-organization network (Ad Hoc networks) etc..Certainly, ability Field technique personnel will be understood that above-mentioned Resource Scheduler is only for example, and other are existing or are likely to occur from now on Resource Scheduler be such as applicable to the application, should also be included within the application protection domain, and herein It is incorporated herein by reference.
Specifically, the request sequence acquisition device 11 obtains the resource that resource request sequence generator is submitted Request sequence.
Here, also request sequence while the resource request sequence of resource request sequence generator submission Corresponding task has submitted to Resource Scheduler, and Resource Scheduler is production rank, it is ensured that resource The authenticity of request sequence, it is ensured that the behavioral indicator for the Resource Scheduler that can be seen all is the code of production Showed.Resource Scheduler is used to manage all resource nodes of whole cluster in a distributed system Unit.It can be seen that the resource of whole all resource nodes of cluster, and sent according to user CPU, Memory request is scheduled.The resource request may issue resource in different time points by multiple users and adjust Device is spent, each request is the CPU and internal memory that specific user wants, and these resource requests are finally to divide It is fitted on specific resource node.
Specifically, the dispatching device 12 is based on the resource request sequence and searches a resource node, and please The User Resource Management device for dispatching the resource node is asked to parse the resource request sequence.
In one embodiment, after Resource Scheduler 1 receives a user task, carry out searching a money Source node to dispatch a User Resource Management device, wherein, carry out search resource node be scheduled user Explorer can be searched according to certain specific algorithm, such as according to the idle shape of Current resource node State is ranked up, and most idle resource node is first found during lookup;Also can be inclined according to the position of resource node It is good to carry out, such as search nearest resource node.Find and corresponding user's money is scheduled after resource node Source manager carries out resolving resource request sequence, now it should be noted that resource node and user resources Manager is deployed on same physical node.The resource node is that Resource Scheduler see one is true Schedulable resource unit, have CPU and internal memory that oneself is independent, be a complete resource, true It is a physical server in real environment, is an analog node in simulator.The physical node is One real physical server, there is independent CPU and memory source.It is a money in true environment Source node, is the carrier of analog node operation in simulated environment.
Specifically, the request unit acquisition device 13 obtains the User Resource Management device and is based on the money Some user resources request unit (not shown) that source request sequence is parsed.
Wherein, the user resources request unit includes:The resource request unit quantity that user task needs Information, the resource node positional information of each resource request unit, element resources amount and each resource request Central processing unit information and memory information needed for unit.
Here, User Resource Management device carries out parsing user resources request unit, the true row of analog subscriber For resource request unit can be inquired at which by the resource node positional information of each resource request unit Can be cluster specify or whole on part resource node.User Resource Management device will be provided Source request unit is with the communications protocol lattice between certain form such as User Resource Management device and Resource Scheduler Formula is sent to Resource Scheduler.
Specifically, the distributor 14 distributes some user resources request units and respective resources Simulated pressure processing is carried out to one or more resource nodes.
Here, user resources request unit of the Resource Scheduler 1 after parsing is received, is scheduled, Generation is needed to dispatch behavioral indicator, and one or more resource nodes are searched in resource node list, will be received To resource request unit carry out being handed down to the corresponding User Resource Management device of resource node, form is at which How many resource request units are distributed on a little resource nodes, User Resource Management device after these distribution are received, The behavior that series of computation analog subscriber uses these resource request units can be carried out.
Got by Resource Scheduler 1 and carry out searching resource section after the resource request sequence that user submits Put to dispatch User Resource Management device and incited somebody to action according to the user resources request unit after the parsing got Resource allocation gives some User Resource Management devices, realizes and builds big rule by limited physical node simulation The resource node set of mould more easily carries out the index investigation of each side to realize to Resource Scheduler 1; Further, the input of Resource Scheduler 1 is the resource request sequence of different-format, realizes simulation To the function of scheduling of resource and considering for performance indications under distributed environment.
Fig. 2 shows to be adjusted according to a kind of resource for scheduling of resource simulated pressure of the application one side Spend device 1 and the structural representation of the cooperation of User Resource Management device 2 and User Resource Management device 3.Institute State Resource Scheduler 1 and obtain dress including request sequence acquisition device 11, dispatching device 12, request unit Put 13 and distributor 14;The User Resource Management device 2 includes obtaining sequence device 21, parsing dress Put 22 and dispensing device 23;The User Resource Management device 3 includes obtaining resource devices 31 and calculating filling Put 32.
Those skilled in the art are it should be understood that with Resource Scheduler 1 and User Resource Management device 2 System, or with Resource Scheduler 1, User Resource Management device 2 and User Resource Management device 3 System, to realize that the scheme of scheduling of resource of pressure simulation is both contained in the claimed scope of the application Within.
Here, the Resource Scheduler 1 can be with multiple User Resource Management device cooperatings, the money Source scheduler 1 can select different User Resource Management devices according to strategy and complete user resources shown in Fig. 2 The work of manager 2 or User Resource Management device 3.Request sequence acquisition device in Resource Scheduler 1 11, which get dispatching device 12 after resource request sequence, is based on the resource request sequence one resource section of lookup Point, and ask the User Resource Management device 2 for dispatching the resource node to parse the resource request sequence; Acquisition sequence device 21 in User Resource Management device 2 gets the money of 1 request analysis of Resource Scheduler The resource request sequence analysis is some user resources request units by source request sequence, resolver 22, Dispensing device 23 sends some user resources request units and respective resources to the scheduling of resource Device 1;Request unit acquisition device 13 in Resource Scheduler 1 obtains the base of User Resource Management device 2 Some user resources request units parsed in the resource request sequence, if distributor 14 will be described Dry user resources request unit and respective resources are distributed to one or more resource nodes and carried out at simulated pressure Reason;Acquisition resource devices 31 in User Resource Management device 3 obtain one that Resource Scheduler distributed or Computing device 32 is simulated using the Resource Calculation and used after multiple user resources request units and respective resources Family using the user resources request unit calculate the time of needs.
In Resource Scheduler 1 and the coupled system of User Resource Management device 2 and User Resource Management device 3 In, Resource Scheduler 1 is distributed in from User Resource Management device on different physical nodes, reaches pressure mould Intend the expansible purpose of device, can be deployed on any number of physical node, facilitate various different rings The deployment in border and then the index investigation that each side is conveniently carried out to Resource Scheduler.
It should be noted that above-mentioned User Resource Management device 2 and User Resource Management device 3 can be same User Resource Management device, parsing money is carried out before having been allocated resources to during the distribution resource of Resource Scheduler 1 The User Resource Management device of source request sequence;User Resource Management device 2 and User Resource Management device 3 also may be used For different User Resource Management devices, User Resource Management device 2 sent after resolving resource request sequence To Resource Scheduler 1, Resource Scheduler 1 distributes to resource and User Resource Management according to certain rule The different other User Resource Management devices of device 2.
Fig. 3 shows to be provided according to a kind of user for scheduling of resource simulated pressure of the application one side The structural representation of source manager 2.The User Resource Management device 2 includes:Acquisition sequence device 21, Resolver 22 and dispensing device 23;Wherein, the acquisition sequence device 21 obtains Resource Scheduler institute The resource request sequence of request analysis;Resolver 22 is based on the resource request sequence analysis and used to be some Family resource request unit;Dispensing device 23 sends some user resources request units and respective resources To the Resource Scheduler.
Specifically, the resource request sequence that sequence device 21 obtains Resource Scheduler institute request analysis is obtained.
In one embodiment, Resource Scheduler is received after user task, searches a resource node A User Resource Management device 2 is dispatched, scheduled User Resource Management device 2 obtains Resource Scheduler The resource request sequence of institute's request analysis, that is, obtain the time series of the corresponding resource request of user task File is described with resource request.
Specifically, it is that some user resources ask list that resolver 22, which is based on the resource request sequence analysis, Member.
Connect precedent, User Resource Management device 2 is got after resource request sequence enters one by resource request sequence Step parses resource request unit, that is, request unit the quantity, (request of resource node preference are obtained after parsing Cell distribution on which resource node, can be specify may also be whole cluster), and unit money Source amount, central processing unit and internal memory.
Specifically, dispensing device 23 sends some user resources request units and respective resources to institute State Resource Scheduler.
Continue to connect precedent, the User Resource Management device 2 for carrying out resolving resource request sequence can analog subscriber Real behavior, modelling customer behavior operate when produce resource request, if User Resource Management device 2 will Dry user resources request unit and corresponding resource are sent to Resource Scheduler 1, Resource Scheduler 1 Scheduling of resource is carried out according to the request received and produces the scheduling behavioral indicator of needs.
Fig. 4 show according to the application one side another be used for scheduling of resource simulated pressure user The structural representation of explorer 3;The User Resource Management device 3 includes:Obtain resource devices 31 and computing device 32, wherein, the resource devices 31 that obtain obtain what Resource Scheduler 1 was distributed One or more user resources request units and respective resources;The computing device 32 utilizes the resource meter Calculate the time that analog subscriber using the user resources request unit calculate needs.
Specifically, resource devices 31 are obtained and obtain one or more user resources that Resource Scheduler is distributed Request unit and respective resources.
In one embodiment, User Resource Management device 3 carries out obtaining resource tune during modelling customer behavior first User resources request unit and corresponding resource that one or more users that degree device 1 is distributed need, example Such as, allocate resources on the more resource node of idle condition and dispatch successively according to idle condition Corresponding User Resource Management device, so that User Resource Management device gets the resource request list needed for user Member and respective resources.
Specifically, computing device 32 please using the user resources using the Resource Calculation analog subscriber Unit is asked calculate the time of needs.
Precedent is connect, User Resource Management device 3 receives resource request unit and the phase that Resource Scheduler 1 is issued Answer after resource, the behavior that series of computation analog subscriber uses these resource request units can be carried out, true It is to start physics process using the resource of distribution and calculate in real cluster.For example, statistical using some The user that method is obtained calculates the time of needs to simulate, and such as obtaining user using timing queue takes resource The time of the process operation started afterwards is so as to carry out the behavior that analog subscriber uses these resources.
Preferably, the User Resource Management device 3 also includes:The (not shown) of return mechanism 33, which is worked as, to be not required to The resource is wanted, then the corresponding resource is returned into the Resource Scheduler 1.
Here, Resource Scheduler 1 needs to know which resource is which user does not need, and by its point Dispensing others user task, this is also the important indicator for considering the handling capacity of Resource Scheduler 1, so with Family explorer 3 is also needed to judge which resource is unwanted, and these unwanted resources are returned Back to Resource Scheduler 1.
Preferably, as shown in figure 5, the User Resource Management device 3 also includes:Starter 34, enter Array device 35, time set 36 and dequeue device 37;Wherein, the starter 34 utilizes institute State resource and start physics process;The physics process is put into timing queue by array apparatus 35 of joining the team;Timing The corresponding physics process is then put into out in group sequence by device 36 when the physics process is gone to; Dequeue device 37 goes out team when the physics process, then the corresponding resource is returned into the resource Scheduler.
In one embodiment, user, which gets, carries out a series of calculating simulation user after distributed resource Using the behavior of resource, then by paying close attention to using the run time for starting physics process during resource, to determine When used resource is no longer needed, and unwanted resource is returned into Resource Scheduler.Specifically The implementation process schematic diagram of the User Resource Management device of a process preferred embodiment as shown in Figure 6; First, start User Resource Management device analysis resource request sequence generation resource request unit, will analyze Result after parsing issues Resource Scheduler, Resource Scheduler money by user resources request unit and accordingly User Resource Management device is distributed in source, and User Resource Management device is received after resource, puts resources into meter When queue in, using timing queue calculate statistics generation time in resource using whether have timed, out, If so, the resource that then will no longer be required to returns Resource Scheduler, if it is not, then continuing to judge that resource is used Situation.It should be noted that each element in timing queue represents one of user using distribution money The physics process in source, timing queue can be put into out element then in group sequence, once there is element to go out Team, just represents its resource used and has not needed, it is necessary to which the unwanted resource of institute is returned into resource Scheduler.In addition, carrying out the user resources pipe of analysis parsing user resources request unit in above-mentioned flow Manage the device resource distributed with being received simulate calculating User Resource Management device be it is same, User Resource Management device that is existing and being likely to occur progress analysis parsing user resources request unit from now on The User Resource Management device that the resource distributed with being received carries out simulation calculating can be identical or not Together, if being applicable the application, adducible mode is contained in the application.
Fig. 7 shows to be adjusted according to a kind of resource for scheduling of resource simulated pressure of the application one side Spend device 1 ', User Resource Management device 2 ' and User Resource Management device 3 ' and resource request sequence generator 4 Cooperation structural representation.Wherein, the Resource Scheduler 1 ' and the Resource Scheduler 1 in Fig. 2 It is same or similar;The User Resource Management device 2 ' it is identical with the User Resource Management device 2 in Fig. 2 or It is similar;The User Resource Management device 3 ' and User Resource Management device 3 in Fig. 2 are same or similar;Institute Stating resource request sequence generator 4 includes acquisition device 41, conversion equipment 42 and issuing means 43.
Those skilled in the art are it should be understood that with Resource Scheduler 1 ' and User Resource Management device 2 ' System, or with Resource Scheduler 1 ', User Resource Management device 2 ' and User Resource Management device 3 ', Or with Resource Scheduler 1 ', User Resource Management device 2 ', User Resource Management device 3 ' and resource The system of request sequence maker 4, to realize that the scheme of scheduling of resource of pressure simulation is both contained in this Within the scope of being claimed.
Here, the Resource Scheduler 1 ' can be with multiple User Resource Management device cooperatings, the money Source scheduler 1 ' can select different User Resource Management devices according to strategy and complete user resources shown in Fig. 7 The work of manager 2 ', User Resource Management device 3 ' or resource request sequence generator 4.The resource please The acquisition device 41 in sequence generator 4 is asked to obtain resource request sequence, wherein, the resource request sequence The time series and resource request that row include asking describe file, and conversion equipment 42 is by the resource request sequence Row are converted into the resource request sequence of unified form, and issuing means 43 is the resource request sequence after the conversion Row submit to Resource Scheduler 1 ';Then, the dispatching device 12 ' in Resource Scheduler 1 ' is based on the resource Request sequence searches a resource node, and asks to dispatch the User Resource Management device parsing of the resource node The resource request sequence;Acquisition sequence device 21 ' in User Resource Management device 2 ' gets scheduling of resource The resource request sequence analysis is some by the resource request sequence of device institute request analysis, resolver 22 ' User resources request unit, dispensing device 23 ' sends out some user resources request units and respective resources Deliver to the Resource Scheduler 1 ';Request unit acquisition device 13 ' in Resource Scheduler 1 ' obtains described use Some user resources request units that family explorer 2 ' is parsed based on the resource request sequence, point Some user resources request units and respective resources are distributed into one or more resources with device 14 Node carries out simulated pressure processing;Acquisition resource devices 31 ' in User Resource Management device 3 ' obtain resource and adjusted Computing device 32 ' is utilized after one or more user resources request units and respective resources that degree device is distributed The Resource Calculation analog subscriber using the user resources request unit calculate the time of needs.
In above-mentioned Resource Scheduler 1 ', User Resource Management device 2 ' and User Resource Management device 3 ' and resource In the coupled system of request sequence maker 4, realize different-format resource request sequence it is converted Resource Scheduler is inputed under the distributed environment of simulation, so that, the pressure type variation inputted, Improve the flexibility of pressure simulation device.
Fig. 8 is shown please according to a kind of resource for scheduling of resource simulated pressure of the application one side Seek the structural representation of sequence generator 4;The resource request sequence generator 4 includes:Acquisition device 41st, conversion equipment 42 and issuing means 43, wherein, the acquisition device 41 obtains resource request sequence, Wherein, the time series and resource request that the resource request sequence includes asking describe file, wherein, The resource request describes resource request unit quantity information, the Mei Gezi that file needs including user task Central processing unit information needed for the resource node positional information and each resource request unit of source request unit And memory information;The resource request sequence is converted into the resource request sequence of unified form by conversion equipment 42 Row;Resource request sequence after the conversion is submitted to Resource Scheduler by issuing means 43.
Specifically, acquisition device 41 obtains resource request sequence, wherein, the resource request sequence includes The time series and resource request of request describe file, wherein, the resource request, which describes file, includes use The resource request unit quantity information of family task needs, the resource node position letter of each resource request unit Central processing unit information and memory information needed for breath and each resource request unit.
Here, by operation maintenance personnel on Consumer's Experience personnel or line using producing on automated tool or line The resource request sequence that true request is built, is input to the life of simulator resource request sequence in a different format Grow up to be a useful person module, wherein, the form of artificial constructed sequence shows as fixed code, such as JSON Protocol buffer (agreement buffering area) in (JavaScript Notation) data format, google; The Format Series Lines produced on line is journal format.In addition, artificial constructed resource request sequence can be set It is scheduled under a certain scene according to certain rule, such as is carried out in an interval that can set the time using automatic The resource request sequence built on tools build resource request sequence, line has scalability, resource request Sequence is the sequence on time dimension, and the pressure produced between from 0 point to 3 points is zoomed into 0 point to 2 points Between the pressure that produces, i.e., should be that the pressure of the resource request sequence just produced between 0 point to 3 points exists Just it there occurs between 0 point to 2 points so that the time interval for producing certain pressure is shortened, to institute on line The scaling processing of the resource request sequence of structure can investigate the performance indications of simulator, if wanting to judge is used to provide The stability of the simulator of the pressure simulation of source scheduling, then by the time of the resource request sequence produced on line Extension, such as extends to the pressure produced between from 0 point to 3 points the pressure produced between 0 point to 5 points.
Specifically, the resource request sequence is converted into the resource request sequence of unified form by conversion equipment 42 Row.The conversion equipment 42 includes resolution unit (not shown), acquiring unit (not shown) and conversion Unit (not shown);Wherein, resolution unit resolving resource request configuration file or resource request sequence daily record; Interval of the acquiring unit based on the configuration file or the resource request sequence log acquisition request sequence and Resource request describes file;Converting unit describes the interval of the request sequence of the acquisition and resource request File is converted into the resource request sequence of unified form.
In one embodiment, the resource request sequence generator 4 of simulator is receiving outside input The sequence received is converted into the money of unified form after the data of the resource request sequence of different-format Source request sequence, this sequence includes two major parts:The time series of request and real resource Request description file, namely user task need specific resource unit number, the resource of each unit CPU and internal memory that node location preference and each unit need.Wherein, time series is used to simulate The task that user concurrently submits in different time points and same time point;Used on Resource Description File and line The task form that family is submitted is consistent, so as to reach that allow Resource Scheduler to be received asks with real resource Ask same or similar, reach the purpose of simulation.
Fig. 9 shows to be generated according to the resource request sequence of the another preferred embodiment of the application one side The principle schematic that device is realized is uml diagram (the Unified Model of resource request sequence generator Language), it was found from figure, resource sequence maker has two subclasses:Manual resource request sequence Class (QA) is generated, manually generated resource request configuration file can be parsed, and please as generation resource Ask the input of the two interfaces of description file and resource request interval;And resource sequence generates class on line, Real production daily record on the line that operation maintenance personnel is obtained can be parsed, and is used as generation resource request description text The input of the two interfaces of part and resource request interval.Resource sequence request class includes generation resource request File and resource request interval are described, the uml diagram of resource request sequence generator also includes a base Class, for filling, agreement is unified, and the resource request sequence of different-format is converted to the money of unified form Source request sequence.Wherein, the interval of request sequence is that maker will be obtained after each interval is arrived User resources describe file, and submit to Resource Scheduler as a real user task.
Specifically, the resource request sequence after the conversion is submitted to Resource Scheduler by issuing means 43.
Precedent is connect, after the resource request sequence of above-mentioned unified form is generated, the generation of resource request sequence Device is responsible for resource request sequence to submit to Resource Scheduler, wherein, resource request sequence has its corresponding User task, corresponding user task is also have submitted when resource request sequence is submitted.
Figure 10 shows the system architecture schematic diagram of a preferred embodiment according to the application one side. Dotted arrow shown in figure represents network communication, and the equipment in the system includes simulator resource request The User Resource Management device of sequence generator, Resource Scheduler and some simulations.The interaction of each equipment The pressure simulation for scheduling of resource is allowed the system to, plays a part of pressure simulation device.Below Interaction to each equipment is illustrated:
Acquisition device 41 in resource request sequence generator 4 is used to obtain resource request sequence, by Operation maintenance personnel uses the true request produced on automated tool or line on Consumer's Experience personnel or line The resource request sequence of structure, in a different format input simulator resource request sequence generator.Turn Changing device 42 is used for the resource request sequence that the resource request sequence is converted into unified form, simulation Resource request sequence generator receive outside input different-format resource request sequence data, The resource request sequence that the simulation real user of unified form is submitted is converted into, dress is submitted afterwards Put 43 and the corresponding task of resource request sequence after conversion is submitted into Resource Scheduler.Scheduling of resource Dispatching device 12 in device receive one simulation real user task after, inquiry one resource node with Dispatch a User Resource Management device.After the User Resource Management device for starting simulation, the user resources pipe Further parsing user resources request sequence gets resource request unit to resolver 22 in reason device, The real behavior of User Resource Management device analog subscriber, dispensing device 23 is by resource request unit with one Fixed communications protocol is sent to Resource Scheduler.Resource Scheduler receives the request of analog subscriber real resources Afterwards, distributor 14 allocates resources to the resource node of one or several simulations to dispatch accordingly The User Resource Management device of simulation, User Resource Management device receives computing device 32 after distributed resource The behavior that series of computation analog subscriber uses these resources is carried out, meanwhile, User Resource Management device is sentenced Which resource of breaking no longer is needed, and unwanted resource is returned into Resource Scheduler.Wherein, scheduling of resource Device from simulate User Resource Management device be deployed on different physical nodes, the resource node of simulation with The User Resource Management device of simulation is on same physical node, it is seen that a physical node The resource node of multiple simulations can be corresponded to, so as to reach the purpose for expanding amplification ratio.The resource section of simulation Point need to carry out resource report to Resource Scheduler, and resource report just has when being launching process, can the cycle The report resource node position preference of property, corresponding CPU and internal memory idle condition etc..
Realized by the said equipment on the cluster of a small-scale physical node, pass through the side of software Method truly simulates the cluster of extensive resource node so that Resource Scheduler logic is this small-scale It can be seen that the resource and number of nodes of real data center, amplification ratio can reach on the cluster of node To 1:1000 (1 physical node can simulate 1000 resource nodes);It is possible to further solve Cluster resource request within certain period in the artificial constructed resource request sequence of analysis, or real line Sequence, is inputted to Resource Scheduler, reaches that index is considered under various scenes to Resource Scheduler With the target of evaluation, the New function of Resource Scheduler can be not only investigated in different pressure request sequences Under effect, its performance indications in scalable true line under request sequence can also be commented Sentence.
Figure 11 shows to be adjusted for resource at the end of Resource Scheduler 1 according to a kind of of the application one side Spend the method flow schematic diagram of simulated pressure.Methods described includes step S11, step S12, step S13 and step S14;Wherein, in step s 11, the resource that resource request sequence generator is submitted is obtained Request sequence;In step s 12, a resource node is searched based on the resource request sequence, and asked The User Resource Management device for dispatching the resource node parses the resource request sequence;In step s 13, Obtain some user resources request that the User Resource Management device is parsed based on the resource request sequence Unit;In step S14, some user resources request units and respective resources are distributed to one Or multiple resource nodes carry out simulated pressure processing.
Specifically, in step s 11, the resource request sequence that resource request sequence generator is submitted is obtained.
Here, also request sequence while the resource request sequence of resource request sequence generator submission Corresponding task has submitted to Resource Scheduler, and Resource Scheduler is production rank, it is ensured that resource The authenticity of request sequence, it is ensured that the behavioral indicator for the Resource Scheduler that can be seen all is the code of production Showed.Resource Scheduler is used to manage all resource nodes of whole cluster in a distributed system Unit.It can be seen that the resource of whole all resource nodes of cluster, and sent according to user CPU, Memory request is scheduled.The resource request may issue resource in different time points by multiple users and adjust Device is spent, each request is the CPU and internal memory that specific user wants, and these resource requests are finally to divide It is fitted on specific resource node.
Specifically, in step s 12, a resource node is searched based on the resource request sequence, and please The User Resource Management device for dispatching the resource node is asked to parse the resource request sequence.
In one embodiment, after Resource Scheduler 1 receives a user task, carry out searching a money Source node to dispatch a User Resource Management device, wherein, carry out search resource node be scheduled user Explorer can be searched according to certain specific algorithm, such as according to the idle shape of Current resource node State is ranked up, and most idle resource node is first found during lookup;Also can be inclined according to the position of resource node It is good to carry out, such as search nearest resource node.Find and corresponding user's money is scheduled after resource node Source manager carries out resolving resource request sequence, now it should be noted that resource node and user resources Manager is deployed on same physical node.The resource node is that Resource Scheduler see one is true Schedulable resource unit, have CPU and internal memory that oneself is independent, be a complete resource, true It is a physical server in real environment, is an analog node in simulator.The physical node is One real physical server, there is independent CPU and memory source.It is a money in true environment Source node, is the carrier of analog node operation in simulated environment.
Specifically, in step s 13, obtain the User Resource Management device and be based on the resource request sequence Arrange some user resources request units parsed.
Wherein, the user resources request unit includes:The resource request unit quantity that user task needs Information, the resource node positional information of each resource request unit, element resources amount and each resource request Central processing unit information and memory information needed for unit.
Here, User Resource Management device carries out parsing user resources request unit, the true row of analog subscriber For resource request unit can be inquired at which by the resource node positional information of each resource request unit Can be cluster specify or whole on part resource node.User Resource Management device will be provided Source request unit is with the communications protocol lattice between certain form such as User Resource Management device and Resource Scheduler Formula is sent to Resource Scheduler.
Specifically, in step S14, some user resources request units and respective resources are distributed Simulated pressure processing is carried out to one or more resource nodes.
Here, user resources request unit of the Resource Scheduler 1 after parsing is received, is scheduled, Generation is needed to dispatch behavioral indicator, and one or more resource nodes are searched in resource node list, will be received To resource request unit carry out being handed down to the corresponding User Resource Management device of resource node, form is at which How many resource request units are distributed on a little resource nodes, User Resource Management device after these distribution are received, The behavior that series of computation analog subscriber uses these resource request units can be carried out.
Got by Resource Scheduler 1 and carry out searching resource section after the resource request sequence that user submits Put to dispatch User Resource Management device and incited somebody to action according to the user resources request unit after the parsing got Resource allocation gives some User Resource Management devices, realizes and builds big rule by limited physical node simulation The resource node set of mould more easily carries out the index investigation of each side to realize to Resource Scheduler 1; Further, the input of Resource Scheduler 1 is the resource request sequence of different-format, realizes simulation To the function of scheduling of resource and considering for performance indications under distributed environment.
Figure 12 shows a kind of resource for scheduling of resource simulated pressure according to the application one side Scheduler 1 and the interaction flow of the cooperation of User Resource Management device 2 and User Resource Management device 3 are illustrated Figure.
Those skilled in the art are it should be understood that with Resource Scheduler 1 and User Resource Management device 2 System, or with Resource Scheduler 1, User Resource Management device 2 and User Resource Management device 3 System, to realize that the scheme of scheduling of resource of pressure simulation is both contained in the claimed scope of the application Within.
Here, the Resource Scheduler 1 can be with multiple User Resource Management device cooperatings, the money Source scheduler 1 can select different User Resource Management devices according to strategy and complete user resources shown in Figure 12 The work of manager 2 or User Resource Management device 3.At the end of Resource Scheduler 1, step S11:Obtain To resource request sequence, step S12:One resource node is searched based on the resource request sequence, and please The User Resource Management device 2 for dispatching the resource node is asked to parse the resource request sequence;In user's money The end of source manager 2, step S21:The resource request sequence of 1 request analysis of Resource Scheduler is got, Step S22:It is some user resources request units, step S23 based on the resource request sequence analysis: Some user resources request units and respective resources are sent to the Resource Scheduler 1;In resource The end of scheduler 1, step S13:Obtain the User Resource Management device 2 and be based on the resource request sequence Some user resources request units parsed, step S14:By some user resources request units And respective resources distribute to one or more resource nodes and carry out simulated pressure processing;In User Resource Management The end of device 3, step S31:Obtain one or more user resources request units that Resource Scheduler is distributed And respective resources, step S32:Asked using the Resource Calculation analog subscriber using the user resources Unit calculate the time of needs.
In Resource Scheduler 1 and the coupled system of User Resource Management device 2 and User Resource Management device 3 In, Resource Scheduler 1 is distributed in from User Resource Management device on different physical nodes, reaches pressure mould Intend the expansible purpose of device, can be deployed on any number of physical node, facilitate various different rings The deployment in border and then the index investigation that each side is conveniently carried out to Resource Scheduler.
It should be noted that above-mentioned User Resource Management device 2 and User Resource Management device 3 can be same User Resource Management device, parsing money is carried out before having been allocated resources to during the distribution resource of Resource Scheduler 1 The User Resource Management device of source request sequence;User Resource Management device 2 and User Resource Management device 3 also may be used For different User Resource Management devices, User Resource Management device 2 sent after resolving resource request sequence To Resource Scheduler 1, Resource Scheduler 1 distributes to resource and User Resource Management according to certain rule The different other User Resource Management devices of device 2.
Figure 13 shows to be used to provide at the end of User Resource Management device 2 according to a kind of of the application one side The method flow schematic diagram of source dispatching simulation pressure.Methods described includes:Step S21, step S22 and Step S23;Wherein, in the step s 21, the resource request sequence of Resource Scheduler institute request analysis is obtained Row;It is some user resources request units based on the resource request sequence analysis in step S22; In step S23, some user resources request units and respective resources are sent to the resource and adjusted Spend device.
Specifically, in the step s 21, the resource request sequence of Resource Scheduler institute request analysis is obtained.
In one embodiment, Resource Scheduler is received after user task, searches a resource node A User Resource Management device 2 is dispatched, scheduled User Resource Management device 2 obtains Resource Scheduler The resource request sequence of institute's request analysis, that is, obtain the time series of the corresponding resource request of user task File is described with resource request.
Specifically, please for some user resources based on the resource request sequence analysis in step S22 Seek unit.
Connect precedent, User Resource Management device 2 is got after resource request sequence enters one by resource request sequence Step parses resource request unit, that is, request unit the quantity, (request of resource node preference are obtained after parsing Cell distribution on which resource node, can be specify may also be whole cluster), and unit money Source amount, central processing unit and internal memory.
Specifically, in step S23, some user resources request units and respective resources are sent To the Resource Scheduler.
Continue to connect precedent, the User Resource Management device 2 for carrying out resolving resource request sequence can analog subscriber Real behavior, modelling customer behavior operate when produce resource request, if User Resource Management device 2 will Dry user resources request unit and corresponding resource are sent to Resource Scheduler 1, Resource Scheduler 1 Scheduling of resource is carried out according to the request received and produces the scheduling behavioral indicator of needs.
Figure 14 shows to be used to provide at the end of User Resource Management device 3 according to a kind of of the application one side The method flow schematic diagram of source dispatching simulation pressure;Methods described includes:Step S31 and step S32, Wherein, in step S31, one or more user resources request that Resource Scheduler 1 is distributed is obtained Unit and respective resources;In the step 32, provided using the Resource Calculation analog subscriber using the user Source request unit calculate the time of needs.
Specifically, in step S31, one or more user resources that Resource Scheduler is distributed are obtained Request unit and respective resources.
In one embodiment, User Resource Management device 3 carries out obtaining resource tune during modelling customer behavior first User resources request unit and corresponding resource that one or more users that degree device 1 is distributed need, example Such as, allocate resources on the more resource node of idle condition and dispatch successively according to idle condition Corresponding User Resource Management device, so that User Resource Management device gets the resource request list needed for user Member and respective resources.
Specifically, in step s 32, the user resources are used using the Resource Calculation analog subscriber Request unit calculate the time of needs.
Precedent is connect, User Resource Management device 3 receives resource request unit and the phase that Resource Scheduler 1 is issued Answer after resource, the behavior that series of computation analog subscriber uses these resource request units can be carried out, true It is to start physics process using the resource of distribution and calculate in real cluster.For example, statistical using some The user that method is obtained calculates the time of needs to simulate, and such as obtaining user using timing queue takes resource The time of the process operation started afterwards is so as to carry out the behavior that analog subscriber uses these resources.
Preferably, methods described also includes:Step S33 (not shown), when not needing the resource, then The corresponding resource is returned into the Resource Scheduler 1.
Here, Resource Scheduler 1 needs to know which resource is which user does not need, and by its point Dispensing others user task, this is also the important indicator for considering the handling capacity of Resource Scheduler 1, so with Family explorer 3 is also needed to judge which resource is unwanted, and these unwanted resources are returned Back to Resource Scheduler 1.
Preferably, as shown in figure 15, methods described also includes:Step S34, step S35, step S36 With step S37;Wherein, in step S34, physics process is started using the resource;In step S35 In, the physics process is put into timing queue;In step S36, when the physics process is performed Then, then the corresponding physics process is put into out in group sequence;In step S37, when the physics Process goes out team, then the corresponding resource is returned into the Resource Scheduler.
In one embodiment, user, which gets, carries out a series of calculating simulation user after distributed resource Using the behavior of resource, then by paying close attention to using the run time for starting physics process during resource, to determine When used resource is no longer needed, and unwanted resource is returned into Resource Scheduler.Specifically The implementation process schematic diagram of the User Resource Management device of a process preferred embodiment as shown in Figure 6; First, start User Resource Management device analysis resource request sequence generation resource request unit, will analyze Result after parsing issues Resource Scheduler, Resource Scheduler money by user resources request unit and accordingly User Resource Management device is distributed in source, and User Resource Management device is received after resource, puts resources into meter When queue in, using timing queue calculate statistics generation time in resource using whether have timed, out, If so, the resource that then will no longer be required to returns Resource Scheduler, if it is not, then continuing to judge that resource is used Situation.It should be noted that each element in timing queue represents one of user using distribution money The physics process in source, timing queue can be put into out element then in group sequence, once there is element to go out Team, just represents its resource used and has not needed, it is necessary to which the unwanted resource of institute is returned into resource Scheduler.In addition, carrying out the user resources pipe of analysis parsing user resources request unit in above-mentioned flow Manage the device resource distributed with being received simulate calculating User Resource Management device be it is same, User Resource Management device that is existing and being likely to occur progress analysis parsing user resources request unit from now on The User Resource Management device that the resource distributed with being received carries out simulation calculating can be identical or not Together, if being applicable the application, adducible mode is contained in the application.
Figure 16 shows a kind of resource for scheduling of resource simulated pressure according to the application one side Scheduler 1 ', User Resource Management device 2 ' and User Resource Management device 3 ' and resource request sequence generator The interaction flow schematic diagram of 4 cooperation.Wherein, the Resource Scheduler 1 ' is adjusted with the resource in Figure 12 Spend device 1 same or similar;The User Resource Management device 2 ' and the User Resource Management device 2 in Figure 12 It is same or similar;The User Resource Management device 3 ' it is identical with the User Resource Management device 3 in Figure 12 or It is similar;At the end of resource request sequence generator 4, methods described includes step S41, step S42 With step S43.
Those skilled in the art are it should be understood that in Resource Scheduler 1 ' and User Resource Management device 2 ' The systems approach at end, or in Resource Scheduler 1 ', User Resource Management device 2 ' and User Resource Management device 3 ', or with Resource Scheduler 1 ', User Resource Management device 2 ', User Resource Management device 3 ' and The systems approach at the end of resource request sequence generator 4, with the scheme for the scheduling of resource for realizing pressure simulation It is both contained within the scope of the application is claimed.
Here, the Resource Scheduler 1 ' can be with multiple User Resource Management device cooperatings, the money Source scheduler 1 ' can select different User Resource Management devices according to strategy and complete user resources shown in Figure 16 The work of manager 2 ', User Resource Management device 3 ' or resource request sequence generator 4.In the resource The end of request sequence maker 4, step S41:Resource request sequence is obtained, wherein, the resource request The time series and resource request that sequence includes request describe file, step S42:By the resource request Sequence is converted into the resource request sequence of unified form, step S43:The resource request after the conversion Sequence submits to Resource Scheduler 1 ';Then, held in Resource Scheduler 1 ', step S12 ':Based on described Resource request sequence searches a resource node, and asks to dispatch the User Resource Management device of the resource node Parse the resource request sequence;Held in User Resource Management device 2 ', step S21 ':Get resource tune Spend the resource request sequence of device institute request analysis, step S22 ':If being by the resource request sequence analysis Dry user resources request unit, step S23 ':By some user resources request units and respective resources Send to the Resource Scheduler 1 ';Held in Resource Scheduler 1 ', step S13 ':Obtain user's money Some user resources request units that source manager 2 ' is parsed based on the resource request sequence, step S14: Some user resources request units and respective resources are distributed into one or more resource nodes and carry out mould Pseudopressure processing;Held in User Resource Management device 3 ', step S31 ':Obtain what Resource Scheduler was distributed One or more user resources request units and respective resources, step S32 ':Utilize the Resource Calculation mould Intend the time that user using the user resources request unit calculate needs.
In above-mentioned Resource Scheduler 1 ', User Resource Management device 2 ' and User Resource Management device 3 ' and resource In the coupled system method at the end of request sequence maker 4, the resource request sequence warp of different-format is realized Conversion inputs to Resource Scheduler under the distributed environment of simulation, so that, the pressure type inputted is more Sample, improves the flexibility of pressure simulation device.
Figure 17 shows to be used at the end of resource request sequence generator 4 according to a kind of of the application one side In the method flow schematic diagram of scheduling of resource simulated pressure;Methods described includes:Step S41, step S42 and step S43;Wherein, in the step S41, resource request sequence is obtained, wherein, it is described The time series and resource request that resource request sequence includes request describe file, wherein, the resource please Description file is asked to include resource request unit quantity information, each resource request unit that user task needs Resource node positional information and each resource request unit needed for central processing unit information and memory information; In step S42, the resource request sequence is converted into the resource request sequence of unified form;In step In rapid S43, the resource request sequence after the conversion is submitted to Resource Scheduler.
Specifically, in step S41, resource request sequence is obtained, wherein, the resource request sequence Time series and resource request including request describe file, wherein, the resource request describes file bag Include resource request unit quantity information, the resource node position of each resource request unit of user task needs Confidence ceases and the central processing unit information and memory information needed for each resource request unit.
Here, by operation maintenance personnel on Consumer's Experience personnel or line using producing on automated tool or line The resource request sequence that true request is built, is input to the life of simulator resource request sequence in a different format Grow up to be a useful person module, wherein, the form of artificial constructed sequence shows as fixed code, such as JSON Protocol buffer (agreement buffering area) in (JavaScript Notation) data format, google; The Format Series Lines produced on line is journal format.In addition, artificial constructed resource request sequence can be set It is scheduled under a certain scene according to certain rule, such as is carried out in an interval that can set the time using automatic The resource request sequence built on tools build resource request sequence, line has scalability, resource request Sequence is the sequence on time dimension, and the pressure produced between from 0 point to 3 points is zoomed into 0 point to 2 points Between the pressure that produces, i.e., should be that the pressure of the resource request sequence just produced between 0 point to 3 points exists Just it there occurs between 0 point to 2 points so that the time interval for producing certain pressure is shortened, to institute on line The scaling processing of the resource request sequence of structure can investigate the performance indications of simulator, if wanting to judge is used to provide The stability of the simulator of the pressure simulation of source scheduling, then by the time of the resource request sequence produced on line Extension, such as extends to the pressure produced between from 0 point to 3 points the pressure produced between 0 point to 5 points.
Specifically, in step S42, the resource that the resource request sequence is converted into unified form please Seek sequence.Preferably, resolving resource request configuration file or resource request sequence daily record;Then, it is based on The configuration file or the interval of the resource request sequence log acquisition request sequence and resource request description File;Then, the interval of the request sequence of the acquisition and resource request are described into file and is converted into unification The resource request sequence of form.
In one embodiment, the resource request sequence generator 4 of simulator is receiving outside input The sequence received is converted into the money of unified form after the data of the resource request sequence of different-format Source request sequence, this sequence includes two major parts:The time series of request and real resource Request description file, namely user task need specific resource unit number, the resource of each unit CPU and internal memory that node location preference and each unit need.Wherein, time series is used to simulate The task that user concurrently submits in different time points and same time point;Used on Resource Description File and line The task form that family is submitted is consistent, so as to reach that allow Resource Scheduler to be received asks with real resource Ask same or similar, reach the purpose of simulation.
Fig. 9 shows to be generated according to the resource request sequence of the another preferred embodiment of the application one side The principle schematic that device is realized is uml diagram (the Unified Model of resource request sequence generator Language), it was found from figure, resource sequence maker has two subclasses:Manual resource request sequence Class (QA) is generated, manually generated resource request configuration file can be parsed, and please as generation resource Ask the input of the two interfaces of description file and resource request interval;And resource sequence generates class on line, Real production daily record on the line that operation maintenance personnel is obtained can be parsed, and is used as generation resource request description text The input of the two interfaces of part and resource request interval.Resource sequence request class includes generation resource request File and resource request interval are described, the uml diagram of resource request sequence generator also includes a base Class, for filling, agreement is unified, and the resource request sequence of different-format is converted to the money of unified form Source request sequence.Wherein, the interval of request sequence is that maker will be obtained after each interval is arrived User resources describe file, and submit to Resource Scheduler as a real user task.
Specifically, in step S43, the resource request sequence after the conversion is submitted to scheduling of resource Device.
Precedent is connect, after the resource request sequence of above-mentioned unified form is generated, the generation of resource request sequence Device is responsible for resource request sequence to submit to Resource Scheduler, wherein, resource request sequence has its corresponding User task, corresponding user task is also have submitted when resource request sequence is submitted.
Figure 10 shows the system architecture schematic diagram of a preferred embodiment according to the application one side. Dotted arrow shown in figure represents network communication, in the systems approach, is included in simulator resource The method at the User Resource Management device end of request sequence maker, Resource Scheduler and some simulations. The interaction of each equipment end causes the systems approach to can be used in the pressure simulation of scheduling of resource, plays pressure The effect of power simulator.The interaction in each equipment end is illustrated below:
At the end of resource request sequence generator 4, step S41:Resource request sequence is obtained, by user Operation maintenance personnel uses the true request produced on automated tool or line to build on experience personnel or line Resource request sequence, input simulator resource request sequence generator in a different format.Step S42: Resource request sequence for the resource request sequence to be converted into unified form, the resource request of simulation Sequence generator receives the data of the resource request sequence of the different-format of outside input, and they are changed The resource request sequence submitted into the simulation real user of unified form, step S43:After conversion The corresponding task of resource request sequence submits to Resource Scheduler.At Resource Scheduler end, step S12: Receive after a simulation real user task, inquire about a resource node to dispatch a user resources pipe Manage device.After the User Resource Management device for starting simulation, at User Resource Management device end, step S22: Further parsing user resources request sequence gets resource request unit, the simulation of User Resource Management device The real behavior of user, step S23:Resource request unit is sent to money with certain communications protocol Source scheduler.Resource Scheduler is received after the request of analog subscriber real resources, step S14:By resource The User Resource Management device that the resource node of one or several simulations is simulated accordingly to dispatch is distributed to, User Resource Management device receives distributed resource, step S32:Carry out series of computation analog subscriber Using the behavior of these resources, meanwhile, User Resource Management device judges which resource no longer needs, will Unwanted resource returns Resource Scheduler.Wherein, Resource Scheduler and the User Resource Management of simulation Device is deployed on different physical nodes, and the resource node and the User Resource Management device of simulation of simulation exist On same physical node, it is seen that a physical node can correspond to the resource section of multiple simulations Point, so as to reach the purpose for expanding amplification ratio.The resource node of simulation need to be provided to Resource Scheduler Source is reported, and resource report just has when being launching process, can periodically report resource node position inclined It is good, corresponding CPU and internal memory idle condition etc..
Realized by above-mentioned systems approach on the cluster of a small-scale physical node, by soft The method of part truly simulates the cluster of extensive resource node so that Resource Scheduler logic is this It can be seen that the resource and number of nodes of real data center, amplification ratio on the cluster of small-scale node 1 can be reached:1000 (1 physical node can simulate 1000 resource nodes);Further, Cluster in artificial constructed resource request sequence, or real line can be parsed domestic-investment in certain period Source request sequence, is inputted to Resource Scheduler, reaches and Resource Scheduler is referred under various scenes The target considered and evaluated is marked, the New function that can not only investigate Resource Scheduler please in different pressure The effect under sequence is sought, can also be to its performance indications in scalable true line under request sequence Judged.
It should be noted that the application can be carried out in the assembly of software and/or software and hardware, example Such as, it can be set using application specific integrated circuit (ASIC), general purpose computer or any other similar hardware It is standby to realize.In one embodiment, the software program of the application can be realized by computing device Steps described above or function.Similarly, the software program (including related data structure) of the application Can be stored in computer readable recording medium storing program for performing, for example, RAM memory, magnetically or optically driver or Floppy disc and similar devices.In addition, some steps or function of the application can employ hardware to realize, example Such as, as coordinating with processor so as to performing the circuit of each step or function.
In addition, the part of the application can be applied to computer program product, such as computer journey Sequence is instructed, and when it is computer-executed, by the operation of the computer, can be called or be provided According to the present processes and/or technical scheme.And the programmed instruction of the present processes is called, can It can be stored in fixed or moveable recording medium, and/or be held by broadcast or other signals Carry the data flow in media and be transmitted, and/or be stored in the meter according to described program instruction operation In the working storage for calculating machine equipment.Here, including a dress according to one embodiment of the application Put, the device includes being used to store the memory of computer program instructions and for execute program instructions Processor, wherein, when the computer program instructions are by the computing device, trigger the device The methods and/or techniques scheme based on foregoing multiple embodiments according to the application of operation.
It is obvious to a person skilled in the art that the application is not limited to the thin of above-mentioned one exemplary embodiment Section, and in the case of without departing substantially from spirit herein or essential characteristic, can be with other specific Form realizes the application.Therefore, no matter from the point of view of which point, embodiment all should be regarded as exemplary , and be nonrestrictive, scope of the present application is limited by appended claims rather than described above It is fixed, it is intended that all changes fallen in the implication and scope of the equivalency of claim are included In the application.The right that any reference in claim should not be considered as involved by limitation will Ask.Furthermore, it is to be understood that the word of " comprising " one is not excluded for other units or step, odd number is not excluded for plural number.Dress Software can also be passed through by a unit or device by putting the multiple units stated in claim or device Or hardware is realized.The first, the second grade word is used for representing title, and is not offered as any specific Order.

Claims (18)

1. a kind of be used for the method for scheduling of resource simulated pressure at Resource Scheduler end, wherein, methods described Including:
Obtain the resource request sequence that resource request sequence generator is submitted;
One resource node is searched based on the resource request sequence, and asks to dispatch the use of the resource node Family explorer parses the resource request sequence;
Obtain some user resources that the User Resource Management device is parsed based on the resource request sequence Request unit;
Some user resources request units and respective resources are distributed into one or more resource nodes to enter The processing of row simulated pressure.
2. according to the method described in claim 1, wherein, the user resources request unit includes:With The resource request unit quantity information of family task needs, the resource node position letter of each resource request unit Central processing unit information and memory information needed for breath, element resources amount and each resource request unit.
3. a kind of be used for the method for scheduling of resource simulated pressure at User Resource Management device end, wherein, it is described Method includes:
Obtain the resource request sequence of Resource Scheduler institute request analysis;
It is some user resources request units based on the resource request sequence analysis;
Some user resources request units and respective resources are sent to the Resource Scheduler.
4. a kind of be used for the method for scheduling of resource simulated pressure at User Resource Management device end, wherein, it is described Method includes:
Obtain one or more user resources request units and respective resources that Resource Scheduler is distributed;
Carry out calculating needs using the user resources request unit using the Resource Calculation analog subscriber Time.
5. method according to claim 4, wherein, methods described also includes:
When not needing the resource, then the corresponding resource is returned into the Resource Scheduler.
6. method according to claim 5, wherein, methods described also includes:
Start physics process using the resource;
The physics process is put into timing queue;
When the physics process is gone to, then the corresponding physics process is put into out in group sequence;
When the physics process goes out team, then the corresponding resource is returned into the Resource Scheduler.
7. a kind of method for being used to generate resource request sequence at resource request sequence generator end, wherein, Methods described includes:
Resource request sequence is obtained, wherein, the resource request sequence includes the time series and money of request Source request description file, wherein, the resource request describes file please including the resource that user task needs Ask element number information, the resource node positional information of each resource request unit and each resource request list The required central processing unit information of member and memory information;
The resource request sequence is converted into the resource request sequence of unified form;
Resource request sequence after the conversion is submitted to Resource Scheduler.
8. method according to claim 7, described that the resource request sequence is converted into unified lattice The resource request sequence of formula includes:
Resolving resource asks configuration file or resource request sequence daily record;
Interval and resource based on the configuration file or the resource request sequence log acquisition request sequence Request description file;
The interval of the request sequence of the acquisition and resource request are described into the money that file is converted into unified form Source request sequence.
9. a kind of Resource Scheduler for scheduling of resource simulated pressure, wherein, the Resource Scheduler bag Include:
Request sequence acquisition device, the resource request sequence for obtaining the submission of resource request sequence generator;
Dispatching device, for searching a resource node based on the resource request sequence, and asks to dispatch institute The User Resource Management device for stating resource node parses the resource request sequence;
Request unit acquisition device, the resource request sequence is based on for obtaining the User Resource Management device Arrange some user resources request units parsed;
Distributor, for by some user resources request units and respective resources distribute to one or Multiple resource nodes carry out simulated pressure processing.
10. Resource Scheduler according to claim 9, wherein, the user resources request unit Including:Resource request unit quantity information, the resource section of each resource request unit of user task needs Central processing unit information and internal memory needed for dot position information, element resources amount and each resource request unit Information.
11. a kind of User Resource Management device for scheduling of resource simulated pressure, wherein, user's money Source manager includes:
Obtain sequence device, the resource request sequence for obtaining Resource Scheduler institute request analysis;
Resolver, for being some user resources request units based on the resource request sequence analysis;
Dispensing device, for some user resources request units and respective resources to be sent to the money Source scheduler.
12. a kind of User Resource Management device for scheduling of resource simulated pressure, wherein, user's money Source manager includes:
Resource devices are obtained, for obtaining one or more user resources request that Resource Scheduler is distributed Unit and respective resources;
Computing device, for using the user resources request unit using the Resource Calculation analog subscriber Calculate the time of needs.
13. User Resource Management device according to claim 12, wherein, the User Resource Management Device also includes:
Return mechanism, for when not needing the resource, then the corresponding resource being returned into the resource Scheduler.
14. User Resource Management device according to claim 13, wherein, the User Resource Management Device also includes:
Starter, for starting physics process using the resource;
Join the team array apparatus, for the physics process to be put into timing queue;
Time set, for when the physics process is gone to, being then put into the corresponding physics process Go out in group sequence;
Dequeue device, for going out team when the physics process, then returns to the corresponding resource The Resource Scheduler.
15. a kind of resource request sequence generator for being used to generate resource request sequence, wherein, the money Source request sequence maker includes:
Acquisition device, for obtaining resource request sequence, wherein, the resource request sequence includes request Time series and resource request file is described, wherein, the resource request describe file include user appoint Be engaged in need resource request unit quantity information, the resource node positional information of each resource request unit and Central processing unit information and memory information needed for each resource request unit;
Conversion equipment, the resource request sequence for the resource request sequence to be converted into unified form;
Issuing means, for the resource request sequence after the conversion to be submitted to Resource Scheduler.
16. resource request sequence generator according to claim 15, wherein, the conversion equipment Including:
Resolution unit, configuration file or resource request sequence daily record are asked for resolving resource;
Acquiring unit, for based on the configuration file or resource request sequence log acquisition request sequence The interval of row and resource request describe file;
Converting unit, for the interval of the request sequence of the acquisition and resource request to be described into file conversion Into the resource request sequence of unified form.
17. a kind of system for scheduling of resource simulated pressure, wherein, the system is adjusted including resource Device and User Resource Management device are spent, wherein,
The Resource Scheduler includes:
Request sequence acquisition device, the resource request sequence for obtaining the submission of resource request sequence generator;
Dispatching device, for searching a resource node based on the resource request sequence, and asks to dispatch institute The User Resource Management device for stating resource node parses the resource request sequence;
Request unit acquisition device, the resource request sequence is based on for obtaining the User Resource Management device Arrange some user resources request units parsed;
Distributor, for by some user resources request units and respective resources distribute to one or Multiple resource nodes carry out simulated pressure processing;
The User Resource Management device includes:
Obtain sequence device, the resource request sequence for obtaining Resource Scheduler institute request analysis;
Resolver, for being some user resources request units based on the resource request sequence analysis;
Dispensing device, for some user resources request units and respective resources to be sent to the money Source scheduler;
The User Resource Management device includes:
Resource devices are obtained, for obtaining one or more user resources request that Resource Scheduler is distributed Unit and respective resources;
Computing device, for using the user resources request unit using the Resource Calculation analog subscriber Calculate the time of needs.
18. a kind of system for scheduling of resource simulated pressure, wherein, the system includes scheduling of resource Device, User Resource Management device and resource request sequence generator, wherein,
The Resource Scheduler includes:
Request sequence acquisition device, the resource request sequence for obtaining the submission of resource request sequence generator;
Dispatching device, for searching a resource node based on the resource request sequence, and asks to dispatch institute The User Resource Management device for stating resource node parses the resource request sequence;
Request unit acquisition device, the resource request sequence is based on for obtaining the User Resource Management device Arrange some user resources request units parsed;
Distributor, for by some user resources request units and respective resources distribute to one or Multiple resource nodes carry out simulated pressure processing;
The User Resource Management device includes:
Obtain sequence device, the resource request sequence for obtaining Resource Scheduler institute request analysis;
Resolver, for being some user resources request units based on the resource request sequence analysis;
Dispensing device, for some user resources request units and respective resources to be sent to the money Source scheduler;
The User Resource Management device includes:
Resource devices are obtained, for obtaining one or more user resources request that Resource Scheduler is distributed Unit and respective resources;
Computing device, for using the user resources request unit using the Resource Calculation analog subscriber Calculate the time of needs;
The resource request sequence generator includes:
Acquisition device, for obtaining resource request sequence, wherein, the resource request sequence includes request Time series and resource request file is described, wherein, the resource request describe file include user appoint Be engaged in need resource request unit quantity information, the resource node positional information of each resource request unit and Central processing unit information and memory information needed for each resource request unit;
Conversion equipment, the resource request sequence for the resource request sequence to be converted into unified form;
Issuing means, for the resource request sequence after the conversion to be submitted to Resource Scheduler.
CN201610038140.7A 2016-01-20 2016-01-20 Method and apparatus for resource scheduling analog pressure Active CN106992901B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201610038140.7A CN106992901B (en) 2016-01-20 2016-01-20 Method and apparatus for resource scheduling analog pressure

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201610038140.7A CN106992901B (en) 2016-01-20 2016-01-20 Method and apparatus for resource scheduling analog pressure

Publications (2)

Publication Number Publication Date
CN106992901A true CN106992901A (en) 2017-07-28
CN106992901B CN106992901B (en) 2020-08-18

Family

ID=59413847

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201610038140.7A Active CN106992901B (en) 2016-01-20 2016-01-20 Method and apparatus for resource scheduling analog pressure

Country Status (1)

Country Link
CN (1) CN106992901B (en)

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107463356A (en) * 2017-08-17 2017-12-12 北京云纵信息技术有限公司 The execution method and apparatus of flow of task
CN111324445A (en) * 2018-12-14 2020-06-23 中国科学院深圳先进技术研究院 Task scheduling simulation system
WO2022262167A1 (en) * 2021-06-15 2022-12-22 上海商汤科技开发有限公司 Cluster resource scheduling method and apparatus, electronic device and storage medium

Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2014210443A1 (en) * 2013-06-28 2014-12-31 Pepperdata, Inc. Systems, methods, and devices for dynamic resource monitoring and allocation in a cluster system
CN104536804A (en) * 2014-12-23 2015-04-22 西安电子科技大学 Virtual resource dispatching system for related task requests and dispatching and distributing method for related task requests

Patent Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2014210443A1 (en) * 2013-06-28 2014-12-31 Pepperdata, Inc. Systems, methods, and devices for dynamic resource monitoring and allocation in a cluster system
CN104536804A (en) * 2014-12-23 2015-04-22 西安电子科技大学 Virtual resource dispatching system for related task requests and dispatching and distributing method for related task requests

Non-Patent Citations (2)

* Cited by examiner, † Cited by third party
Title
THE APACHE SOFTWARE FOUNDATION: "Yarn Scheduler Load Simulator", 《HTTP://HADOOP.APACHE.ORG/DOCS/R2.4.1/HADOOP-LS/SCHEDULERLOADSIMULATOR.HTML》 *
董春涛: "Hadoop YARN大数据计算框架及其资源调度机制研究", 《信息通信技术》 *

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107463356A (en) * 2017-08-17 2017-12-12 北京云纵信息技术有限公司 The execution method and apparatus of flow of task
CN111324445A (en) * 2018-12-14 2020-06-23 中国科学院深圳先进技术研究院 Task scheduling simulation system
CN111324445B (en) * 2018-12-14 2024-04-02 中国科学院深圳先进技术研究院 Task scheduling simulation system
WO2022262167A1 (en) * 2021-06-15 2022-12-22 上海商汤科技开发有限公司 Cluster resource scheduling method and apparatus, electronic device and storage medium

Also Published As

Publication number Publication date
CN106992901B (en) 2020-08-18

Similar Documents

Publication Publication Date Title
Sfrent et al. Asymptotic scheduling for many task computing in big data platforms
Nie et al. A GEP-based reactive scheduling policies constructing approach for dynamic flexible job shop scheduling problem with job release dates
CN104871154B (en) system-level query optimization
JP6384065B2 (en) Information processing apparatus, learning method, and program
Kianfar et al. Study of stochastic sequence-dependent flexible flow shop via developing a dispatching rule and a hybrid GA
CN103886047A (en) Distributed on-line recommending method orientated to stream data
US20150278309A1 (en) Random number generator in a parallel processing database
CN102567312A (en) Machine translation method based on distributive parallel computation framework
Pooranian et al. New hybrid algorithm for task scheduling in grid computing to decrease missed task
Marichelvam et al. Performance evaluation of an improved hybrid genetic scatter search (IHGSS) algorithm for multistage hybrid flow shop scheduling problems with missing operations
Yan et al. Efficient selection of a set of good enough designs with complexity preference
CN110825522A (en) Spark parameter self-adaptive optimization method and system
CN106992901A (en) Method and apparatus for scheduling of resource simulated pressure
Sigman Exact simulation of the stationary distribution of the FIFO M/G/c queue: the general case for ρ< c
WO2020036810A1 (en) System and method for facilitating an objective-oriented data structure and an objective via the data structure
Li et al. A production scheduling problem with sequence-dependent changeover costs
CN115618532A (en) Network system simulation method and related device
Shahoud et al. A meta learning approach for automating model selection in big data environments using microservice and container virtualization technologies
Casale et al. Tools for performance evaluation of computer systems: historical evolution and perspectives
Huang et al. An efficient parallel method for batched OS-ELM training using MapReduce
Nematpour et al. Enhanced genetic algorithm with some heuristic principles for task graph scheduling
Sankaran et al. Genetic algorithm based task reordering to improve the performance of batch scheduled massively parallel scientific applications
Azadeh et al. A hybrid artificial neural network: computer simulation approach for scheduling a flow shop with multiple processors
CN111836274B (en) Service processing method and device
García-Nájera et al. A multi-objective genetic algorithm for the software project scheduling problem

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant