CN110489238A - Nodal test method, apparatus, electronic equipment and storage medium - Google Patents
Nodal test method, apparatus, electronic equipment and storage medium Download PDFInfo
- Publication number
- CN110489238A CN110489238A CN201910777845.4A CN201910777845A CN110489238A CN 110489238 A CN110489238 A CN 110489238A CN 201910777845 A CN201910777845 A CN 201910777845A CN 110489238 A CN110489238 A CN 110489238A
- Authority
- CN
- China
- Prior art keywords
- business
- node
- coefficient
- variation
- treating capacity
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/30—Monitoring
- G06F11/3003—Monitoring arrangements specially adapted to the computing system or computing system component being monitored
- G06F11/3006—Monitoring arrangements specially adapted to the computing system or computing system component being monitored where the computing system is distributed, e.g. networked systems, clusters, multiprocessor systems
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F9/00—Arrangements for program control, e.g. control units
- G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
- G06F9/46—Multiprogramming arrangements
- G06F9/50—Allocation of resources, e.g. of the central processing unit [CPU]
- G06F9/5083—Techniques for rebalancing the load in a distributed system
Abstract
This application discloses a kind of nodal test method, apparatus, electronic equipment and storage mediums, are related to big data field.The specific implementation of nodal test method are as follows: according to the quantity of traffic assignments total amount and node, obtain the business average treatment amount of each node;The business of each node is obtained respectively with respect to treating capacity;According to the business average treatment amount and business of each node with respect to treating capacity, the coefficient of variation is obtained;Whether the business for being determined as each node distribution according to the coefficient of variation is balanced.By above embodiment, the coefficient of variation is obtained using the business average treatment amount and opposite treating capacity of service node, to detect the equilibrium situation of each node according to the dynamic change of the coefficient of variation.The load balancing of distributed computing is verified.
Description
Technical field
This application involves a kind of field of computer technology more particularly to a kind of big data fields.
Background technique
Under big data background, distributed (Distributed) is calculated, storage becomes the main of raising device service efficiency
Means.Load balancing is the main policies for solving big data under distributed computing.Common load balancing may include
Poll (RoundRobin), random (Random) and Hash (Hash) algorithm etc..It, then can be according to different applications in practical application
Scene takes suitable load balancing.But it there is no whether effective scheme detection load balancing succeeds at present.
Summary of the invention
The embodiment of the present application proposes a kind of nodal test method, apparatus, electronic equipment and storage medium, existing at least to solve
There is the above technical problem in technology.
In a first aspect, the embodiment of the present application provides a kind of nodal test method, comprising:
According to the quantity of traffic assignments total amount and node, the business average treatment amount of each node is obtained;
The business of each node is obtained respectively with respect to treating capacity;
According to the business average treatment amount and business of each node with respect to treating capacity, the coefficient of variation is obtained;
Whether the business for being determined as each node distribution according to the coefficient of variation is balanced.
By above embodiment, variation lines are obtained using the business average treatment amount and opposite treating capacity of service node
Number, to detect the equilibrium situation of each node according to the dynamic change of the coefficient of variation.To the load balancing of distributed computing
It is verified.
In one embodiment, the business of each node is obtained respectively with respect to treating capacity, comprising:
According to traffic assignments total amount and the traffic assignments weight of each node, the business of each node is obtained with respect to treating capacity.
In one embodiment, each section is obtained with respect to treating capacity according to the business average treatment amount and business of each node
The coefficient of variation of point, comprising:
According to the business average treatment amount and business of each node with respect to treating capacity, the business of each node is obtained with respect to treating capacity
Standard deviation;
By the ratio of standard deviation and business average treatment amount, as the coefficient of variation.
By above embodiment, according to node traffic with respect to the standard deviation for the treatment of capacity and the business average treatment amount of node
Ratio as the coefficient of variation.Ideally, convergence state can be presented in the coefficient of variation, finally level off to 0.By to variation lines
The case where number value, so that it may accurately judge whether egress is balanced.
In one embodiment, whether the business for being determined as each node distribution according to the coefficient of variation is balanced, comprising:
In the case where the coefficient of variation does not restrain and is greater than the first stable threshold, determine that the business of each node distribution is uneven
Weighing apparatus.
By above embodiment, can inquire in time to the identical IP address of prefix, or to access time etc.
In the case of business with distribution character carries out Hash balance policy, the problem of most traffic assignments are to same node is caused.
In one embodiment, whether the business for being determined as each node distribution according to the coefficient of variation is balanced, comprising:
In the case where the coefficient of variation restrains and is greater than the second stable threshold, it is determined as each node distribution
Business is unbalanced.
By above embodiment, can inquire in time in the case where using Stochastic Equilibrium strategy to business, due to section
Point self performance decline will lead to that processing speed is slack-off, eventually lead to the traffic backlog of node and to generate distribution business unbalanced
Situation.
One embodiment in above-mentioned application have the following advantages that or the utility model has the advantages that only need to the business to each node averagely locate
Reason amount and business are counted with respect to treating capacity, then the load to distributed computing can be realized in the ratio by calculating the two
Balance policy is verified.Calculation amount is small, and verifying speed is fast.Because using the business average treatment amount and phase that utilize service node
The coefficient of variation is obtained to treating capacity, according to coefficient of variation detection node distribute business whether Jun Heng technological means, so overcoming
The technical issues of can only carrying out the harmonious distribution of load balancing, and harmony distribution can not being detected, in turn
Reach only need to business average treatment amount to each node and business counted with respect to treating capacity, then the ratio by both calculating
Value, which can be realized, verifies the load balancing of distributed computing.Calculation amount is small, the fast technical effect of verifying speed.
Second aspect, the embodiment of the present application provide a kind of nodal test device, comprising:
Business average treatment amount obtains module and obtains each node for the quantity according to traffic assignments total amount and node
Business average treatment amount;
Business obtains module with respect to treating capacity, for obtaining the business of each node respectively with respect to treating capacity;
The coefficient of variation obtains module, for the business average treatment amount and business according to each node with respect to treating capacity, obtains
The coefficient of variation;
Whether balanced determining module, the business for being determined as each node distribution according to the coefficient of variation are balanced.
In one embodiment, which obtains module with respect to treating capacity, comprising:
Business is with respect to treating capacity acquisition submodule, for according to the traffic assignments amount of each node and the business of each node
Weight is distributed, obtains the business of each node with respect to treating capacity.
In one embodiment, which obtains module, comprising:
Standard deviation acquisition submodule is obtained for the business average treatment amount and business according to each node with respect to treating capacity
Standard deviation of the business of each node with respect to treating capacity;
The coefficient of variation obtains implementation sub-module, for by the ratio of standard deviation and business average treatment amount, as variation lines
Number.
In one embodiment, the equilibrium determining module, comprising:
First it is balanced determine implementation sub-module, for not restrained in the coefficient of variation, and the case where be greater than the first stable threshold
Under, determine that the business of each node distribution is unbalanced.
In one embodiment, the equilibrium determining module, comprising:
Second balanced determining implementation sub-module, is used in the case where the coefficient of variation restrains and is greater than the second stable threshold,
The business for being determined as each node distribution is unbalanced.
The third aspect, the application provide a kind of electronic equipment, and the function of the electronic equipment can be by hardware realization, can also
To execute corresponding software realization by hardware.The hardware or software include one or more moulds corresponding with above-mentioned function
Block.
It include processor and memory in the structure of the device, the memory is for storing in a possible design
The device is supported to execute the program that mentioned above searching results show method, which is configurable for executing and deposit in the memory
The program of storage.The device can also include communication interface, be used for and other equipment or communication.
Fourth aspect, the embodiment of the invention provides a kind of non-instantaneous computer-readable storages for being stored with computer instruction
Medium, for storing computer software instructions used in search result display device comprising for executing above-mentioned image procossing
Method involved in program.
Above-mentioned general introduction is merely to illustrate that the purpose of book, it is not intended to be limited in any way.Except foregoing description
Schematical aspect, except embodiment and feature, by reference to attached drawing and the following detailed description, the present invention is further
Aspect, embodiment and feature, which will be, to be readily apparent that.
Detailed description of the invention
Attached drawing does not constitute the restriction to the application for more fully understanding this programme.Wherein:
Fig. 1 is the schematic diagram according to the application first embodiment;
Fig. 2 is the load balancing schematic diagram for storing scene;
Fig. 3 is the load balancing schematic diagram for calculating scene;
Fig. 4 is the load balancing schematic diagram of application service scene;
Fig. 5 is the schematic diagram according to the application first embodiment;
Fig. 6 is the schematic diagram according to the application second embodiment;
Fig. 7 is the schematic diagram according to the application second embodiment;
Fig. 8 is the block diagram for the electronic equipment for realizing the nodal test method of the embodiment of the present application.
Specific embodiment
It explains below in conjunction with exemplary embodiment of the attached drawing to the application, including the various of the embodiment of the present application
Details should think them only exemplary to help understanding.Therefore, those of ordinary skill in the art should recognize
It arrives, it can be with various changes and modifications are made to the embodiments described herein, without departing from the scope and spirit of the present application.Together
Sample, for clarity and conciseness, descriptions of well-known functions and structures are omitted from the following description.
In one embodiment, Fig. 1 shows the flow chart of the nodal test method according to the embodiment of the present application.Such as Fig. 1
Shown, the nodal test method of the embodiment of the present application may comprise steps of:
S101: according to the quantity of traffic assignments total amount and node, the business average treatment amount of each node is obtained.
S102: the business of each node is obtained respectively with respect to treating capacity.
S103: according to the business average treatment amount and business of each node with respect to treating capacity, the coefficient of variation is obtained.
S104: whether the business for being determined as each node distribution according to the coefficient of variation is balanced.
Main controlled node (Master) obtains current total business volume (SUM) and service node (slave) to be allocated in real time
Quantity.Business may include data or task.
For example, business may include data under storage scene as shown in Figure 2.Main controlled node is according to external storage
Request, assigning data to different memory nodes using allocation strategy, (memory node 1~memory node n) carries out data and deposits
Storage.
In another example business may include data under calculating scene shown in Fig. 3.Main controlled node allocation strategy is by data
Distributing to different calculate nodes, (calculate node 1~calculate node n) carries out data calculating.
Further for example, business may include task under application service scene shown in Fig. 4.Main controlled node utilizes distribution plan
External task requests are slightly distributed to each service node (1~service node of service node) to handle task.Task can
To include inquiry, access etc..
The acquisition of service node quantity can be obtained by the communication between main controlled node and each service node, can also be led to
Pre-set mode is crossed to obtain.According to formula (1) can calculate each service node business average treatment amount (ART,
Average Relative Throughput)。
In formula (1), SUM indicates current total business volume to be allocated, and N indicates the quantity of service node.
Main controlled node can calculate the number of services for distributing to service node according to the weight of each service node, by this
Business opposite treating capacity of the number of services as each service node.The business of each service node can use RT with respect to treating capacity1、
RT2、......、RTNIt indicates.
According to the business average treatment amount and business of each service node with respect to treating capacity, the mark of available each service node
It is quasi- poor.It can be using the ratio of the standard deviation and business average treatment amount as the coefficient of variation.
With the accumulation of time, the total traffic that main controlled node distributed will be continuously increased.It is distributed to respectively in main controlled node
In the case that the portfolio of service node is balanced, the coefficient of variation will constantly restrain.Ideally, the coefficient of variation will converge to 0.
Conversely, if the coefficient of variation does not restrain, and in the case where being greater than preset value, it can indicate that main controlled node distributes to each service node
Portfolio it is unbalanced.
In one embodiment, step S102 may include:
According to traffic assignments total amount and the traffic assignments weight of each node, the business of each node is obtained with respect to treating capacity.
Corresponding traffic assignments weight can be set according to the traffic handing capacity of service node.Such as service node A
CPU is the single core processor of dominant frequency 1GHz.The CPU of service node B is the dual core processor of dominant frequency 2GHz, then business can be set
The traffic assignments weight of node B is 2 times of the traffic assignments weight of service node A.
The opposite treating capacity RT for distributing to each service node can be calculated according to formula (2)i。
In formula (2), PiIt indicates in the total service node for being N, the weight of i-th of service node.
In addition, main controlled node can calculate the portfolio for distributing to each service node according to traffic assignments strategy.Example
Such as, it according to the IP address of user, is calculated using Hash load balancing and the service request of user is distributed into corresponding industry
Business node.If the service request of user distributes to service node A, main controlled node carries out the portfolio of service node A tired
Add calculating.
By the above-mentioned means, the available practical business treating capacity to each service node of main controlled node.Main controlled node root
It, can be with the weight of dynamic adjustment business node according to the practical business treating capacity of each service node and the standard deviation of opposite treating capacity.
Adjustment weight can make the business of each service node with respect to maximization of throughput, and can be carried out according to business with respect to treating capacity
Traffic assignments, so that the portfolio for distributing to each service node is balanced.
As shown in figure 5, in one embodiment, step S103 may include:
S1031: according to the business average treatment amount and business of each node with respect to treating capacity, the business for obtaining each node is opposite
The standard deviation for the treatment of capacity.
S1032: by the ratio of standard deviation and business average treatment amount, as the coefficient of variation.
Standard deviation sigma of the business with respect to treating capacity of each service node can be calculated according to formula (3),
Coefficient of variation c can be calculated according to formula (4),
In one embodiment, step S104 may include:
In the case where the coefficient of variation does not restrain and is greater than the first stable threshold, determine that the business of each node distribution is uneven
Weighing apparatus.
For example, the IP address of each user typically appears as the consistent distribution characteristics of prefix under intranet environment.Main controlled node
Operation can be carried out using IP address of the Hash balance policy to each user, and traffic assignments are carried out according to operation result.Hash
Balance policy may include: that a numerical value is calculated by hash function in the corresponding character string of IP address, with the numerical value pair
The quantity of service node carries out modulus, and obtained result is the service node serial number to be distributed.In these cases, master control section
Point may will be in most traffic assignments to the same service node.What is presented on other service nodes is that deviation business is flat
Equal treating capacity.For as described above, request portfolio constantly increase, the coefficient of variation and not shown convergence, but constantly increase.
In the case where the numerical value of the coefficient of variation is greater than the first stable threshold, illustrate that relatively large deviation occurs in equilibrium.Above situation means
Equilibrium failure.First stable threshold can be empirical value, be also possible to the dynamic value according to concrete scene.
For example, IP sections have 200 for the user volume of 192.1.168.xxx.IP sections have for the user volume of 192.1.169.xxx
10.The identical service node of weight has 2, including No. 0 service node and No. 1 service node are (due to there is 2 business sections
2) point, the modulus value of hash algorithm are.210 users are simultaneously emitted by service request, and according to hash algorithm, IP sections are
192.1.168.xxx the hash algorithm calculated result of 200 users is 0.Calculating process may include: to convert IP character string
For bit: the xxxxxxxx of 192.1.168.xxx → 11,000,000 00,000,001 10101000;By bit bitwise shift left 8:
11000000 00000001 10101000 xxxxxxxx→00000000 11000000 00000001 10101000;Conversion
For new integer: 00,000,000 11,000,000 00,000,001 10101000 → 12583336;Modulus calculates: 12583336 →
12583336%2=0.
Similarly, IP sections be 192.1.169.xxx the hash algorithm calculated result of 10 users be 1.Hash algorithm calculates
As a result the business for 0 200 users can be assigned to No. 0 service node.10 users that hash algorithm calculated result is 1
Business can be assigned to No. 1 service node.In the identical situation of distribution weight of two service nodes, the coefficient of variation will
Increase.In the case where the coefficient of variation is greater than the first setting value, Hash balance policy shows the non-uniform result of traffic assignments.
If in the case where the access of some IP malice high frequency, it is possible to it is unbalanced and super negative because distributing service node occur
Lotus operation, eventually leads to denied access.The other users for being so assigned to identical services node also will be unable to access the business
Node.
In another example main controlled node can carry out operation using access time of the Hash strategy to user, and according to operation knot
Fruit carries out traffic assignments.Hash algorithm operation is carried out according to IP address with main controlled node, and business point is carried out according to operation result
The principle matched is identical.Since the Format Prefix of access time is also all identical, such as 2019-08-19-19:00,2019-08-19-
19:01 etc., it is also possible to occur the situation in most traffic assignments to the same service node.
In one embodiment, step S104 can also include:
In the case where the coefficient of variation restrains and is greater than the second stable threshold, the business for being determined as each node distribution is uneven
Weighing apparatus.
In the case where main controlled node uses Stochastic Equilibrium strategy, main controlled node can be according to the machine of service node
Can, dynamic adjustment is carried out to the balance policy of each service node.For example, a byte point can be (physics) server.
For resources such as the central processing units, memory or disk that make full use of service node.Some answer can be additionally disposed to service node
Use program.These application programs will will affect the query rate per second (QPS, Query Per Second) of service node, business section
The query rate per second of point can react the traffic handing capacity of service node.Service node query rate per second by apply journey
In the case where the influence of sequence, the business that will lead to service node declines with respect to treating capacity.
Main controlled node obtain service node query rate per second may include: main controlled node in a manner of poll to business section
Point sends test request.Service node sends feedback information to main controlled node according to the test request.Main controlled node is according to one
The quantity of the feedback information received in the section time obtains the query rate per second of service node.
In the case where main controlled node does not adjust the traffic assignments amount of service node, although can be made by Stochastic Equilibrium strategy
Convergence state is presented in the coefficient of variation, but since business is with respect to treating capacity decline, the coefficient of variation is caused to be consistently higher than a value.It can be with
By the second stable threshold of setting as judgment basis.It is restrained in the coefficient of variation, and be greater than the second stable threshold of the setting
In the case of, it can determine that the variation due to each service node query rate per second causes the business distributed for each node unbalanced.
The above embodiment of the application can apply the development phase in distributed computing, or apply and count in distribution
The test phase of calculation.
In the development phase of distributed computing, analog simulation can be carried out to distributed structure/architecture.Analog simulation may include
The simulation of simulation and node to business.The simulation of business may include obtaining real time business or history service, will acquire
Business carry out random screening.For example, only retaining 10% portfolio after screening.The simulation of distributed structure/architecture may include setting
1 main controlled node and at least two service node.Finally the equilibrium situation of each service node of analog simulation is tested.
In the test phase of distributed computing, actual services can be directly utilized, the equilibrium to true each service node
Situation is tested.
Fig. 6 shows the nodal test apparatus structure schematic diagram according to the embodiment of the present application.As shown in fig. 6, the device includes:
Business average treatment amount obtains module 601, for the quantity according to traffic assignments total amount and node, obtains each described
The business average treatment amount of node.
Business obtains module 602 with respect to treating capacity, for obtaining the business of each node respectively with respect to treating capacity.
The coefficient of variation obtains module 603, for opposite according to the business average treatment amount and business of each node
Treating capacity obtains the coefficient of variation.
Whether balanced determining module 604, the business for being determined as each node distribution according to the coefficient of variation are equal
Weighing apparatus.
In one embodiment, which obtains module 602 with respect to treating capacity, comprising:
Business is with respect to treating capacity acquisition submodule, for according to the traffic assignments amount of each node and the business of each node
Weight is distributed, obtains the business of each node with respect to treating capacity.
As shown in fig. 7, in one embodiment, which obtains module 603, comprising:
Standard deviation acquisition submodule 6031, for according to the business average treatment amount and business of each node with respect to treating capacity,
Obtain standard deviation of the business with respect to treating capacity of each node.
The coefficient of variation obtains implementation sub-module 6032, for by the ratio of standard deviation and business average treatment amount, as change
Different coefficient.
In one embodiment, the equilibrium determining module, comprising:
First it is balanced determine implementation sub-module, for not restrained in the coefficient of variation, and the case where be greater than the first stable threshold
Under, determine that the business of each node distribution is unbalanced.
In one embodiment, the equilibrium determining module, comprising:
Second balanced determining implementation sub-module, is used in the case where the coefficient of variation restrains and is greater than the second stable threshold,
The business for being determined as each node distribution is unbalanced.
According to an embodiment of the present application, present invention also provides a kind of electronic equipment and a kind of readable storage medium storing program for executing.
As shown in figure 8, being the block diagram according to the electronic equipment of the method for the nodal test of the embodiment of the present application.Electronic equipment
It is intended to indicate that various forms of digital computers, such as, laptop computer, desktop computer, workbench, individual digital help
Reason, server, blade server, mainframe computer and other suitable computer.Electronic equipment also may indicate that various shapes
The mobile device of formula, such as, personal digital assistant, cellular phone, smart phone, wearable device and other similar calculating dresses
It sets.Component, their connection and relationship shown in this article and their function are merely exemplary, and are not intended to limit
The realization of described herein and/or requirement the application.
As shown in figure 8, the electronic equipment includes: one or more processors 810, memory 820, and each for connecting
The interface of component, including high-speed interface and low-speed interface.All parts are interconnected using different buses, and can be pacified
It installs in other ways on public mainboard or as needed.Processor can to the instruction executed in electronic equipment into
Row processing, including storage in memory or on memory (such as, to be coupled to interface in external input/output device
Display equipment) on show graphic user interface (Graphical User Interface, GUI) graphical information instruction.In
In other embodiment, if desired, can be by multiple processors and/or multiple bus and multiple memories and multiple memories one
It rises and uses.It is also possible to connect multiple electronic equipments, each equipment provides the necessary operation in part (for example, as server battle array
Column, one group of blade server or multicomputer system).In Fig. 8 by taking a processor 810 as an example.
Memory 820 is non-transitory computer-readable storage medium provided herein.Wherein, the memory is deposited
The instruction that can be executed by least one processor is contained, so that at least one described processor executes node provided herein
Detection method.The non-transitory computer-readable storage medium of the application stores computer instruction, and the computer instruction is based on making
Calculation machine executes nodal test method provided herein.
Memory 820 is used as a kind of non-transitory computer-readable storage medium, can be used for storing non-instantaneous software program, non-
Instantaneous computer executable program and module, such as the corresponding program instruction/mould of nodal test method in the embodiment of the present application
Block is (for example, attached business average treatment amount shown in fig. 6, which obtains module 601, business, obtains module 602, variation lines with respect to treating capacity
Number obtains module 603 and balanced determining module 604).Processor 810 is stored in non-instantaneous soft in memory 820 by operation
Part program, instruction and module, thereby executing the various function application and data processing of server, i.e. the realization above method is real
Apply the nodal test method in example.
Memory 820 may include storing program area and storage data area, wherein storing program area can store operation system
Application program required for system, at least one function;Storage data area can be stored according to the electronic equipment of nodal test method
Use created data etc..In addition, memory 820 may include high-speed random access memory, it can also include non-instantaneous
Memory, for example, at least a disk memory, flush memory device or other non-instantaneous solid-state memories.In some implementations
In example, optional memory 820 includes the memory remotely located relative to processor 810, these remote memories can pass through
It is connected to the network to the electronic equipment of nodal test method.The example of above-mentioned network include but is not limited to internet, intranet,
Local area network, mobile radio communication and combinations thereof.
The electronic equipment of nodal test method can also include: input unit 830 and output device 840.Processor 810,
Memory 820, input unit 830 and output device 840 can be connected by bus or other modes, by total in Fig. 8
For line connection.
Input unit 830 can receive the number or character information of input, and generates and set with the electronics of nodal test method
The related key signals input of standby user setting and function control, such as touch screen, keypad, mouse, track pad, touch
The input units such as plate, indicating arm, one or more mouse button, trace ball, control stick.Output device 840 may include showing
Show equipment, auxiliary lighting apparatus (for example, LED) and haptic feedback devices (for example, vibrating motor) etc..The display equipment can wrap
It includes but is not limited to, liquid crystal display (Liquid Crystal Display, LCD), light emitting diode (Light Emitting
Diode, LED) display and plasma scope.In some embodiments, display equipment can be touch screen.
The various embodiments of system and technology described herein can be in digital electronic circuitry, integrated circuit system
System, is consolidated specific integrated circuit (Application Specific Integrated Circuits, ASIC), computer hardware
It is realized in part, software, and/or their combination.These various embodiments may include: to implement in one or more calculating
In machine program, which can hold in programmable system containing at least one programmable processor
Row and/or explain, which can be dedicated or general purpose programmable processors, can from storage system, at least
One input unit and at least one output device receive data and instruction, and data and instruction is transmitted to the storage system
System, at least one input unit and at least one output device.
These calculation procedures (also referred to as program, software, software application or code) include the machine of programmable processor
Instruction, and can use programming language, and/or the compilation/machine language of level process and/or object-oriented to implement these
Calculation procedure.As used herein, term " machine readable media " and " computer-readable medium " are referred to for referring to machine
It enables and/or data is supplied to any computer program product, equipment, and/or the device of programmable processor (for example, disk, light
Disk, memory, programmable logic device (programmable logic device, PLD)), including, receiving can as machine
The machine readable media of the machine instruction of read signal.Term " machine-readable signal " is referred to for by machine instruction and/or number
According to any signal for being supplied to programmable processor.
In order to provide the interaction with user, system and technology described herein, the computer can be implemented on computers
Include for user show information display device (for example, CRT (Cathode Ray Tube, cathode-ray tube) or
LCD (liquid crystal display) monitor);And keyboard and indicator device (for example, mouse or trace ball), user can be by this
Keyboard and the indicator device provide input to computer.The device of other types can be also used for providing the friendship with user
Mutually;For example, the feedback for being supplied to user may be any type of sensory feedback (for example, visual feedback, audio feedback or
Touch feedback);And it can be received with any form (including vocal input, voice input or tactile input) from user
Input.
System described herein and technology can be implemented including the computing system of background component (for example, as data
Server) or the computing system (for example, application server) including middleware component or the calculating including front end component
System is (for example, the subscriber computer with graphic user interface or web browser, user can pass through graphical user circle
Face or the web browser to interact with the embodiment of system described herein and technology) or including this backstage portion
In any combination of computing system of part, middleware component or front end component.Any form or the number of medium can be passed through
Digital data communicates (for example, communication network) and is connected with each other the component of system.The example of communication network includes: local area network
(Local Area Network, LAN), wide area network (Wide Area Network, WAN) and internet.
Computer system may include client and server.Client and server is generally off-site from each other and usually logical
Communication network is crossed to interact.By being run on corresponding computer and each other with the meter of client-server relation
Calculation machine program generates the relationship of client and server.
According to the technical solution of the embodiment of the present application, the business of each node is distributed to by the coefficient of variation judgement got
It is whether balanced.Realize the verifying to the load balancing of distributed computing.
It should be understood that various forms of processes illustrated above can be used, rearrangement increases or deletes step.Example
Such as, each step recorded in the application of this hair can be performed in parallel or be sequentially performed the order that can also be different and execute,
As long as it is desired as a result, being not limited herein to can be realized technical solution disclosed in the present application.
Above-mentioned specific embodiment does not constitute the limitation to the application protection scope.Those skilled in the art should be bright
White, according to design requirement and other factors, various modifications can be carried out, combination, sub-portfolio and substitution.It is any in the application
Spirit and principle within made modifications, equivalent substitutions and improvements etc., should be included within the application protection scope.
Claims (12)
1. a kind of nodal test method characterized by comprising
According to the quantity of traffic assignments total amount and node, the business average treatment amount of each node is obtained;
The business of each node is obtained respectively with respect to treating capacity;
According to the business average treatment amount of each node and business with respect to treating capacity, the coefficient of variation is obtained;
Whether the business for being determined as each node distribution according to the coefficient of variation is balanced.
2. being handled the method according to claim 1, wherein the business for obtaining each node respectively is opposite
Amount, comprising:
According to the traffic assignments total amount and the traffic assignments weight of each node, the business phase of each node is obtained
To treating capacity.
3. the method according to claim 1, wherein the business average treatment according to each node
Amount and business obtain the coefficient of variation of each node with respect to treating capacity, comprising:
According to the business average treatment amount of each node and business with respect to treating capacity, the opposite place of business of each node is obtained
The standard deviation of reason amount;
By the ratio of the standard deviation and the business average treatment amount, as the coefficient of variation.
4. the method according to claim 1, wherein described be determined as each node according to the coefficient of variation
Whether the business of distribution is balanced, comprising:
In the case where the coefficient of variation does not restrain and is greater than the first stable threshold, the business of each node distribution is determined
It is unbalanced.
5. the method according to claim 1, wherein described be determined as each node according to the coefficient of variation
Whether the business of distribution is balanced, comprising:
In the case where the coefficient of variation restrains and is greater than the second stable threshold, it is determined as the business of each node distribution
It is unbalanced.
6. a kind of nodal test device characterized by comprising
Business average treatment amount obtains module and obtains each node for the quantity according to traffic assignments total amount and node
Business average treatment amount;
Business obtains module with respect to treating capacity, for obtaining the business of each node respectively with respect to treating capacity;
The coefficient of variation obtains module, for according to the business average treatment amount and business of each node with respect to treating capacity,
Obtain the coefficient of variation;
Whether balanced determining module, the business for being determined as each node distribution according to the coefficient of variation are balanced.
7. device according to claim 6, which is characterized in that the business obtains module with respect to treating capacity, comprising:
Business is with respect to treating capacity acquisition submodule, for according to the traffic assignments amount of each node and each node
Traffic assignments weight obtains the business of each node with respect to treating capacity.
8. device according to claim 6, which is characterized in that the coefficient of variation obtains module, comprising:
Standard deviation acquisition submodule is obtained for the business average treatment amount and business according to each node with respect to treating capacity
Standard deviation of the business of each node with respect to treating capacity;
The coefficient of variation obtains implementation sub-module, for by the ratio of the standard deviation and the business average treatment amount, as change
Different coefficient.
9. device according to claim 6, which is characterized in that the equilibrium determining module, comprising:
First it is balanced determine implementation sub-module, for not restrained in the coefficient of variation, and the case where be greater than the first stable threshold
Under, determine that the business of each node distribution is unbalanced.
10. device according to claim 6, which is characterized in that the equilibrium determining module, comprising:
Second balanced determining implementation sub-module, is used in the case where the coefficient of variation restrains and is greater than the second stable threshold,
The business for being determined as each node distribution is unbalanced.
11. a kind of electronic equipment characterized by comprising
At least one processor;And
The memory being connect at least one described processor communication;Wherein,
The memory is stored with the instruction that can be executed by least one described processor, and described instruction is by described at least one
It manages device to execute, so that at least one described processor is able to carry out method of any of claims 1-5.
12. a kind of non-transitory computer-readable storage medium for being stored with computer instruction, which is characterized in that the computer refers to
It enables for making the computer perform claim require method described in any one of 1-5.
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201910777845.4A CN110489238A (en) | 2019-08-21 | 2019-08-21 | Nodal test method, apparatus, electronic equipment and storage medium |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201910777845.4A CN110489238A (en) | 2019-08-21 | 2019-08-21 | Nodal test method, apparatus, electronic equipment and storage medium |
Publications (1)
Publication Number | Publication Date |
---|---|
CN110489238A true CN110489238A (en) | 2019-11-22 |
Family
ID=68552937
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN201910777845.4A Pending CN110489238A (en) | 2019-08-21 | 2019-08-21 | Nodal test method, apparatus, electronic equipment and storage medium |
Country Status (1)
Country | Link |
---|---|
CN (1) | CN110489238A (en) |
Cited By (6)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN110968895A (en) * | 2019-11-29 | 2020-04-07 | 北京百度网讯科技有限公司 | Data processing method and device, electronic equipment and storage medium |
CN111651329A (en) * | 2020-06-08 | 2020-09-11 | 中国工商银行股份有限公司 | Health check method and device for application, computer system and storage medium |
CN112214447A (en) * | 2020-10-10 | 2021-01-12 | 中科声龙科技发展(北京)有限公司 | Dynamic reconstruction method, system and device for workload certification operation chip cluster data |
CN112541038A (en) * | 2020-12-01 | 2021-03-23 | 杭州海康威视数字技术股份有限公司 | Time series data management method, system, computing device and storage medium |
CN113010285A (en) * | 2021-03-12 | 2021-06-22 | 北京百度网讯科技有限公司 | Method, apparatus, device, medium and product for processing data |
CN113556397A (en) * | 2021-07-21 | 2021-10-26 | 山东建筑大学 | Cloud service resource scheduling method facing gateway of Internet of things |
Citations (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US7730086B1 (en) * | 2002-02-11 | 2010-06-01 | Louisiana Tech University Foundation, Inc. | Data set request allocations to computers |
US20140129715A1 (en) * | 2012-11-07 | 2014-05-08 | Yahoo! Inc. | Method and system for work load balancing |
CN106506657A (en) * | 2016-11-21 | 2017-03-15 | 黑龙江省科学院自动化研究所 | One kind distributes method of adjustment based on multiobject cloud computing virtual machine |
CN107357652A (en) * | 2017-06-16 | 2017-11-17 | 北京邮电大学 | A kind of cloud computing method for scheduling task based on segmentation sequence and standard deviation Dynamic gene |
CN108733475A (en) * | 2018-05-22 | 2018-11-02 | 哈尔滨工业大学(威海) | A kind of dynamical feedback dispatching method |
-
2019
- 2019-08-21 CN CN201910777845.4A patent/CN110489238A/en active Pending
Patent Citations (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US7730086B1 (en) * | 2002-02-11 | 2010-06-01 | Louisiana Tech University Foundation, Inc. | Data set request allocations to computers |
US20140129715A1 (en) * | 2012-11-07 | 2014-05-08 | Yahoo! Inc. | Method and system for work load balancing |
CN106506657A (en) * | 2016-11-21 | 2017-03-15 | 黑龙江省科学院自动化研究所 | One kind distributes method of adjustment based on multiobject cloud computing virtual machine |
CN107357652A (en) * | 2017-06-16 | 2017-11-17 | 北京邮电大学 | A kind of cloud computing method for scheduling task based on segmentation sequence and standard deviation Dynamic gene |
CN108733475A (en) * | 2018-05-22 | 2018-11-02 | 哈尔滨工业大学(威海) | A kind of dynamical feedback dispatching method |
Non-Patent Citations (2)
Title |
---|
宋素芳: "《生物统计附试验设计》", 31 August 2007 * |
李洪: "视频监控系统中VOD负载均衡改进算法", 《开发研究与工程应用》 * |
Cited By (9)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN110968895A (en) * | 2019-11-29 | 2020-04-07 | 北京百度网讯科技有限公司 | Data processing method and device, electronic equipment and storage medium |
CN111651329A (en) * | 2020-06-08 | 2020-09-11 | 中国工商银行股份有限公司 | Health check method and device for application, computer system and storage medium |
CN111651329B (en) * | 2020-06-08 | 2023-08-01 | 中国工商银行股份有限公司 | Health check method and device for application, computer system and storage medium |
CN112214447A (en) * | 2020-10-10 | 2021-01-12 | 中科声龙科技发展(北京)有限公司 | Dynamic reconstruction method, system and device for workload certification operation chip cluster data |
CN112541038A (en) * | 2020-12-01 | 2021-03-23 | 杭州海康威视数字技术股份有限公司 | Time series data management method, system, computing device and storage medium |
CN113010285A (en) * | 2021-03-12 | 2021-06-22 | 北京百度网讯科技有限公司 | Method, apparatus, device, medium and product for processing data |
CN113010285B (en) * | 2021-03-12 | 2023-08-04 | 北京百度网讯科技有限公司 | Method, apparatus, device, medium, and article for processing data |
CN113556397A (en) * | 2021-07-21 | 2021-10-26 | 山东建筑大学 | Cloud service resource scheduling method facing gateway of Internet of things |
CN113556397B (en) * | 2021-07-21 | 2022-05-06 | 山东建筑大学 | Cloud service resource scheduling method facing gateway of Internet of things |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
CN110489238A (en) | Nodal test method, apparatus, electronic equipment and storage medium | |
US11082357B2 (en) | Facilitating dynamic hierarchical management of queue resources in an on-demand services environment | |
CN107196869B (en) | The adaptive load balancing method, apparatus and system of Intrusion Detection based on host actual loading | |
US9270521B2 (en) | Provisioning and managing a cluster deployed on a cloud | |
US10671975B2 (en) | Smart streaming of data between external systems and service providers in an on-demand environment | |
US9880885B2 (en) | Method and system to rebalance constrained services in a cloud using a genetic algorithm | |
CA2964461C (en) | Composite partition functions | |
CN110365752A (en) | Processing method, device, electronic equipment and the storage medium of business datum | |
CN109408205A (en) | Method for scheduling task and device based on hadoop cluster | |
CN106959894A (en) | Resource allocation methods and device | |
CN106817432A (en) | The method of virtual resource elastic stretch, system and equipment under cloud computing environment | |
CN108510213A (en) | Task is sequentially allocated to the method, apparatus, equipment and medium of task groups | |
CN109117252A (en) | Method, system and the container cluster management system of task processing based on container | |
US20230388388A1 (en) | Methods and apparatus for user identification via community detection | |
CN105630683A (en) | Cloud testing architecture | |
CN111666130A (en) | Container balanced deployment method and device, electronic equipment and storage medium | |
CN107003947B (en) | It generates for sharing the approximate using measurement of cache memory system | |
Wang et al. | MetaOJ: A massive distributed online judge system | |
CN109327555A (en) | Distributed hair system, method and device | |
WO2023088462A1 (en) | Method and apparatus for processing data, device, and storage medium | |
CN115115292B (en) | Power generation distribution information generation method, device, apparatus, medium, and program product | |
CN108810130B (en) | Method and device for planning distribution request | |
US10033817B2 (en) | Stateless technique for distributing data uploads | |
CN111416860B (en) | Transaction processing method and device based on block chain, electronic equipment and medium | |
CN112241319A (en) | Method, electronic device and computer program product for balancing load |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PB01 | Publication | ||
PB01 | Publication | ||
SE01 | Entry into force of request for substantive examination | ||
SE01 | Entry into force of request for substantive examination | ||
RJ01 | Rejection of invention patent application after publication |
Application publication date: 20191122 |
|
RJ01 | Rejection of invention patent application after publication |