CN111338917A - Dynamic control method and device for determining server service capability - Google Patents

Dynamic control method and device for determining server service capability Download PDF

Info

Publication number
CN111338917A
CN111338917A CN201811557218.1A CN201811557218A CN111338917A CN 111338917 A CN111338917 A CN 111338917A CN 201811557218 A CN201811557218 A CN 201811557218A CN 111338917 A CN111338917 A CN 111338917A
Authority
CN
China
Prior art keywords
server
service
stand
determining
alone type
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN201811557218.1A
Other languages
Chinese (zh)
Other versions
CN111338917B (en
Inventor
黄麟
杨雪莹
王康
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Guizhou Baishancloud Technology Co Ltd
Original Assignee
Guizhou Baishancloud Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Guizhou Baishancloud Technology Co Ltd filed Critical Guizhou Baishancloud Technology Co Ltd
Priority to CN201811557218.1A priority Critical patent/CN111338917B/en
Publication of CN111338917A publication Critical patent/CN111338917A/en
Application granted granted Critical
Publication of CN111338917B publication Critical patent/CN111338917B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F11/00Error detection; Error correction; Monitoring
    • G06F11/30Monitoring
    • G06F11/34Recording or statistical evaluation of computer activity, e.g. of down time, of input/output operation ; Recording or statistical evaluation of user activity, e.g. usability assessment
    • G06F11/3409Recording or statistical evaluation of computer activity, e.g. of down time, of input/output operation ; Recording or statistical evaluation of user activity, e.g. usability assessment for performance assessment
    • G06F11/3433Recording or statistical evaluation of computer activity, e.g. of down time, of input/output operation ; Recording or statistical evaluation of user activity, e.g. usability assessment for performance assessment for load management
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F11/00Error detection; Error correction; Monitoring
    • G06F11/30Monitoring
    • G06F11/34Recording or statistical evaluation of computer activity, e.g. of down time, of input/output operation ; Recording or statistical evaluation of user activity, e.g. usability assessment
    • G06F11/3409Recording or statistical evaluation of computer activity, e.g. of down time, of input/output operation ; Recording or statistical evaluation of user activity, e.g. usability assessment for performance assessment
    • G06F11/3414Workload generation, e.g. scripts, playback

Landscapes

  • Engineering & Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Computer Hardware Design (AREA)
  • Quality & Reliability (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Computer And Data Communications (AREA)

Abstract

The invention discloses a dynamic control method and a dynamic control device for determining the service capability of a server. The disclosed method comprises: determining the type of the single machine of the server according to a preset classification standard; when the single type appears for the first time, the maximum service capability test is carried out on the single type server, the maximum service capability of the single type server is determined through the test, the single type server and the maximum service capability of the single type server are stored, and when the single type does not appear for the first time, the maximum service capability of the single type server is determined through searching historical storage information. The disclosed technical solution enables to accurately determine the actual service capacity of each server.

Description

Dynamic control method and device for determining server service capability
Technical Field
The invention relates to the field of server management and service scheduling, in particular to a dynamic control method and a dynamic control device for determining server service capacity.
Background
In order to meet the increasing access demands of customers, CDN networks are evolving, and CDN network providers usually need to set a very large number of servers in operator networks in each region.
When providing network access service for a customer, a CDN network provider needs to consider its own operation cost on the premise of guaranteeing customer access quality. To reduce costs, CDN network providers typically employ various approaches to increase the serving capacity of a single machine (i.e., each server). For example, the actual service capability of each individual machine can be improved by manually setting individual machine service capability threshold or standard (e.g., individual machine bandwidth carrying capacity threshold or standard, individual machine concurrent request number threshold or standard, individual machine delay threshold or standard, etc.), and performing an automated scheduling method based on the individual machine service capability threshold or standard (e.g., the bandwidth carrying capacity of the individual machine with bandwidth carrying capacity greater than the individual machine bandwidth carrying capacity threshold or standard can be adjusted to other individual machines with bandwidth carrying capacity less than the individual machine bandwidth carrying capacity threshold or standard). Furthermore, in the prior art, to simplify operations, the same stand-alone service capability threshold or criteria is typically set for each server within the same server cluster.
However, the actual service capabilities of each server may be different for the following reasons:
1. the actual service capability of the server is related to the hardware type of the server, the type of client access traffic of the specific access, and the like.
2. Some CDN nodes use multiple servers with the same hardware type to form a server cluster to serve users in a certain region together, and although the (hardware) standards of individual servers in the cluster are the same at this time, the hardware (e.g., hard disk, cache) of individual servers may also fail, so that the actual service capabilities of individual servers with the (hardware) standards that are originally the same may be different as the service time increases.
3. Some clients use software to increase the maximum service capacity of individual servers when accessing.
For example, the hardware configuration is the same for the same server cluster (including network card, hard disk, memory, CPU, etc.), so the prior art sets the service capability threshold or standard of the single machine to a data transmission rate of 6Gbps according to the results obtained from experience or manual tests. Because the types of the client services served by the server cluster and the proportions of different services may vary, and different servers may have different degrees of hardware damage during the service process, when the server cluster needs to serve other clients (for example, when the client file is small and the request number is large), the single-machine bandwidth carrying capacity may not reach 6Gbps (that is, actually smaller than the set single-machine bandwidth carrying capacity threshold or standard, resulting in scheduling deviation).
For example, when a hard disk of a certain server is broken, because load (service) scheduling is adopted in a server cluster, the scheduling magnitude also needs to be manually set, for example, if the actual service capability of the server with the lowest performance is taken as a unified standard, other servers will reduce the service standard, and only when the access amount is mostly the clients of a specific file type, the stand-alone performance can be improved through software (a method for improving stand-alone performance developed for the clients of the specific type), and the service types accessed by the clients and the clients are changed, so that many stand-alone machines cannot know when the stand-alone performance can be improved through the software.
At this time, if the load (service) scheduling is performed on each server based on the same and/or fixed stand-alone service capability threshold or standard, the actual service capability of each server when hardware failure occurs and/or software acceleration is adopted cannot be accurately and dynamically reflected, so that the scheduling deviation occurs, which causes problems such as reduction of customer service quality and increase of service cost.
In addition, the manual testing of the stand-alone service capability adopted in the prior art, and the mode of performing load (service) scheduling on the whole server cluster based on a fixed stand-alone service capability threshold or standard set once, not only easily cause quality problems or cost waste, but also need a large amount of manual participation and have low efficiency.
Therefore, new technical solutions are needed to solve the above problems.
Disclosure of Invention
The dynamic control method for determining the service capability of the server comprises the following steps:
determining the type of the single machine of the server according to a preset classification standard;
when the single type appears for the first time, the maximum service capability test is carried out on the single type server, the maximum service capability of the single type server is determined through the test, the single type server and the maximum service capability of the single type server are stored, and when the single type does not appear for the first time, the maximum service capability of the single type server is determined through searching historical storage information.
According to the dynamic control method for determining the service capability of the server, the step of determining the stand-alone type of the server according to the preset classification standard comprises the following steps:
determining the type of the single machine according to at least one subcategory criterion of at least one of the following predetermined classification criteria: the hardware condition of the server, the software deployment condition on the server, the number of concurrent requests supported by the server, the service information supported by the server,
the maximum service capability includes at least one of: the maximum available bandwidth carrying capacity and the maximum available concurrent request number of the server, and the specific index for determining the maximum service capability includes at least one of the following: server performance, client quality, download speed, first frame delay, cost.
According to the dynamic control method for determining the service capability of the server, the step of determining the stand-alone type of the server according to the preset classification standard comprises the following steps:
automatically determining the stand-alone type of each server in each node according to user instructions or timing; and/or, the method further comprises:
and performing service scheduling on the server according to the determined stand-alone type and the maximum service capability.
According to the dynamic control method for determining the service capability of the server, the step of scheduling the service of the server according to the determined stand-alone type and the maximum service capability comprises the following steps:
and adjusting the service scheduling hit probability or weight when the server receives the service request according to the determined single machine type and the service standard set according to the maximum service capability.
According to the dynamic control method for determining the service capability of the server, the step of adjusting the service scheduling hit probability or weight when the server receives the service request comprises the following steps:
when the maximum service capacity of the server is lower than the predetermined service capacity, the service scheduling hit probability or weight at the time the server receives the service request is reduced by a predetermined percentage.
The dynamic control device for determining the service capability of the server comprises the following components:
the stand-alone type determining module is used for determining the stand-alone type of the server according to a preset classification standard;
the service capability determining module is used for testing the maximum service capability of the stand-alone type server when the stand-alone type appears for the first time, determining the maximum service capability of the stand-alone type server through testing, storing the stand-alone type and the maximum service capability of the stand-alone type server, and determining the maximum service capability of the stand-alone type server by searching historical storage information when the stand-alone type does not appear for the first time.
According to the dynamic control device for determining the service capability of the server, the stand-alone type determining module is further used for:
determining the type of the single machine according to at least one subcategory criterion of at least one of the following predetermined classification criteria: the hardware condition of the server, the software deployment condition on the server, the number of concurrent requests supported by the server, the service information supported by the server,
the maximum service capability includes at least one of: the maximum available bandwidth carrying capacity and the maximum available concurrent request number of the server, and the specific index for determining the maximum service capability includes at least one of the following: server performance, client quality, download speed, first frame delay, cost.
According to the dynamic control device for determining the service capability of the server, the stand-alone type determining module is further used for:
automatically determining the stand-alone type of each server in each node according to user instructions or timing, and/or
The device still includes:
and the service scheduling module is used for performing service scheduling on the server according to the determined stand-alone type and the maximum service capability.
According to the dynamic control device for determining the service capability of the server, the service scheduling module is further used for:
and adjusting the service scheduling hit probability or weight when the server receives the service request according to the determined single machine type and the service standard set according to the maximum service capability.
According to the dynamic control device for determining the service capability of the server, the service scheduling module is further used for:
when the maximum service capacity of the server is lower than the predetermined service capacity, the service scheduling hit probability or weight at the time the server receives the service request is reduced by a predetermined percentage.
According to the technical scheme of the invention, the actual service capacity of each server can be accurately determined.
Drawings
The accompanying drawings, which are incorporated in and constitute a part of the specification, illustrate embodiments of the invention and together with the description, serve to explain the principles of the invention. In the drawings, like reference numerals are used to indicate like elements. The drawings in the following description are directed to some, but not all embodiments of the invention. For a person skilled in the art, other figures can be derived from these figures without inventive effort.
Fig. 1 schematically shows a schematic flow chart of a dynamic control method for determining server service capabilities according to the present invention.
Fig. 2 schematically shows a block schematic of a dynamic control arrangement for determining server service capabilities according to the present invention.
Fig. 3 schematically shows a specific embodiment of the dynamic control means for determining server service capabilities according to the present invention.
Detailed Description
In order to make the objects, technical solutions and advantages of the embodiments of the present invention clearer, the technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are some, but not all, embodiments of the present invention. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention. It should be noted that the embodiments and features of the embodiments in the present application may be arbitrarily combined with each other without conflict.
Fig. 1 schematically shows a schematic flow chart of a dynamic control method for determining server service capabilities according to the present invention.
As shown in the solid line box of fig. 1, the dynamic control method for determining the service capability of the server according to the present invention includes:
step S102: determining the type of the single machine of the server according to a preset classification standard;
step S104: when the single type appears for the first time, the maximum service capability test is carried out on the single type server, the maximum service capability of the single type server is determined through the test, the single type server and the maximum service capability of the single type server are stored, and when the single type does not appear for the first time, the maximum service capability of the single type server is determined through searching historical storage information.
Optionally, step S102 includes:
determining the type of the single machine according to at least one subcategory criterion of at least one of the following predetermined classification criteria: the hardware condition of the server, the software deployment condition on the server, the number of concurrent requests supported by the server, the service information supported by the server,
the maximum service capability includes at least one of: the maximum available bandwidth carrying capacity and the maximum available concurrent request number of the server, and the specific index for determining the maximum service capability includes at least one of the following: server performance, client quality, download speed, first frame delay, cost.
For example, the server includes each server in a server cluster.
For example, the sub-classification criteria corresponding to the hardware status of the server include SSD (number, capacity), CPU (number, master frequency), and memory (number, capacity). The sub-classification criteria corresponding to the software deployment situation on the server include whether the hotspot migration software is installed, and the version and/or performance of the installed hotspot migration software. The sub-classification criteria corresponding to the number of concurrent requests supported by the server include the type of request connection (TCP, UDP). The sub-classification criteria corresponding to the service information supported by the server include a transmission rate of service data, a size of a service file, and a domain name ratio (i.e., a ratio of domain names of different levels corresponding to the service, for example, the service of an important client may be preferentially scheduled to a server with a higher ratio of domain names of higher levels (i.e., domain names with smaller delay)).
Optionally, step S102 includes:
automatically determining the stand-alone type of each server in each node according to user instructions or timing; and/or, as shown in the dashed box of fig. 1, the method further includes:
step S106: and performing service scheduling on the server according to the determined stand-alone type and the maximum service capability.
Optionally, step S106 includes:
and adjusting the service scheduling hit probability or weight when the server receives the service request according to the determined single machine type and the service standard set according to the maximum service capability.
Optionally, the step of adjusting the service scheduling hit probability or weight when the server receives the service request includes:
when the maximum service capacity of the server is lower than the predetermined service capacity, the service scheduling hit probability or weight at the time the server receives the service request is reduced by a predetermined percentage.
Fig. 2 schematically shows a block schematic of a dynamic control arrangement for determining server service capabilities according to the present invention.
As shown in the solid line box of fig. 2, the dynamic control apparatus 200 for determining server service capability according to the present invention includes:
a stand-alone type determining module 201, configured to determine a stand-alone type of the server according to a predetermined classification standard;
the service capability determining module 203 is configured to perform a maximum service capability test on the stand-alone type server when the stand-alone type appears for the first time, determine the maximum service capability of the stand-alone type server through the test, store the stand-alone type and the maximum service capability of the stand-alone type server, and determine the maximum service capability of the stand-alone type server by searching the historical storage information when the stand-alone type does not appear for the first time.
Optionally, the stand-alone type determining module 201 is further configured to:
determining the type of the single machine according to at least one subcategory criterion of at least one of the following predetermined classification criteria: the hardware condition of the server, the software deployment condition on the server, the number of concurrent requests supported by the server, the service information supported by the server,
the maximum service capability includes at least one of: the maximum available bandwidth carrying capacity and the maximum available concurrent request number of the server, and the specific index for determining the maximum service capability includes at least one of the following: server performance, client quality, download speed, first frame delay, cost.
Optionally, the stand-alone type determining module 201 is further configured to:
automatically determining the stand-alone type of each server in each node according to user instructions or timing, and/or
As shown in the dashed line box of fig. 2, the dynamic control apparatus 200 for determining the server service capability further includes:
and the service scheduling module 205 is used for performing service scheduling on the server according to the determined stand-alone type and the maximum service capability.
Optionally, the service scheduling module 205 is further configured to:
and adjusting the service scheduling hit probability or weight when the server receives the service request according to the determined single machine type and the service standard set according to the maximum service capability.
Optionally, the service scheduling module 205 is further configured to:
when the maximum service capacity of the server is lower than the predetermined service capacity, the service scheduling hit probability or weight at the time the server receives the service request is reduced by a predetermined percentage.
For example, the service scheduling module 205 may implement service scheduling by:
the service capability standards and weights of the servers in each group are dynamically set according to the difference of the maximum service capability of the servers in each server cluster (group).
The technical scheme can be used for accurately scheduling to a single server level, and the problem that the type of a certain server or a plurality of servers in a group is different, so that the stand-alone standard (namely, the service standard) of the whole group is reduced is solved.
Most groups have basically the same machine-related types, are different from each other for a few parts, and may have different hardware and software types with the change of time, and when the stand-alone type of one machine is changed to cause the stand-alone standard to be reduced, the automatic adjustment of the service scheduling weight is performed according to the previously set rule.
For example, the rules for automatic adjustment of the service scheduling weights may be set as: and the weight of the service scheduling hit of the single machine is reduced by 5% every time the bandwidth of the single machine is reduced by 1G.
In order that those skilled in the art will more clearly understand the technical solutions according to the present invention, the following description will be given with reference to specific embodiments.
Fig. 3 schematically shows a specific embodiment of the dynamic control means for determining server service capabilities according to the present invention.
As shown in the solid line box of fig. 3, this embodiment (i.e., the dynamic control apparatus 300 that determines the server service capability) includes:
a type collection module 301, configured to collect all stand-alone types (excluding redundant information) corresponding to online servers (e.g., in a cache server cluster), and optionally store each stand-alone type and server information;
a testing module 303 (corresponding to the service capability determining module 203) configured to, when a stand-alone type first appears, obtain status information (e.g., request number and/or file percentage) related to (corresponding to) a server based on the specific stand-alone type of the server, automatically generate a pressure traffic (i.e., bandwidth carrying capacity), and perform an automatic test to determine a maximum service capability of the server of the stand-alone type, and optionally, when the stand-alone type does not first appear, determine the maximum service capability of the server of the stand-alone type by searching for history storage information;
a quality criteria module 305 for storing various quality criteria;
and a stand-alone type identification module 307, configured to automatically identify a stand-alone type of the server.
For example, the stand-alone types may be classified according to at least one of the following classification criteria:
the hardware condition of the server, the software deployment condition on the server, the number of concurrent requests supported by the server, and the service information supported by the server.
For example, the hardware of the server includes at least one of the following hardware: SSD, CPU, internal memory. The hardware condition includes at least one of the following information: the number and/or size of the SSD, the number and/or size of the CPUs, the number and/or size of the memories, and the service time of each component in the server.
For example, the deployment scenario of the software on the server includes at least one of the following information: whether each server (in a server cluster, i.e., within a server group) has hotspot migration software installed, a version and/or performance of the hotspot migration software installed.
For example, the service information supported by the server includes at least one of the following information: the transmission rate of the service data, the size of the service file, and the domain name ratio (i.e., the ratio of domain names of different classes corresponding to the service, for example, the service of an important client may be scheduled preferentially to a server with a higher ratio of domain names of higher classes (i.e., domain names with smaller delay)).
The stand-alone type of the server can be dynamically divided periodically according to the four categories of information (for example, at least one of the 4 categories can be selected as a division standard of the stand-alone type).
For example, the types of all servers throughout the network may be dynamically evaluated based on the length of usage.
For example, a certain type of desktop Y may correspond to the following specific information: two SSDs, 64G, CPU model Intel Core 2Duo E7200, hot spot migration software (one for improving stand-alone service capability), and large number of requests (e.g., greater than 10)10Times/s) and the large file proportion is 80 percent (the file size can be set by self).
Optionally, the type collection module 301 is further configured to: automatically collecting the type of the on-line server according to the set type of the single machine,
wherein each stand-alone type corresponds to a specific sub-type (e.g., stand-alone type Y) corresponding to at least one of the 4 types.
Optionally, the type collection module 301 is further configured to: new servers and/or stand-alone types are automatically detected, added.
For example, the test module 303 may perform testing of various stand-alone types of servers by:
1. in the order of the pressure flow from bottom to top, every 500M is provided with a level (which can be modified by itself), and the pressure flow is performed from low to high for a plurality of times according to the level.
2. The server under test is monitored for changes in quality (e.g., processing delays) at different pressure flows and/or concurrent requests.
3. And taking the corresponding pressure flow and/or the number of concurrent requests as the service capacity corresponding to each server of the single machine type under the condition that the periodic or continuous tests in a certain time period all meet the quality requirements, averaging the maximum service capacity of all the servers of the single machine type to obtain the average service capacity of the servers of the single machine type, and storing the average service capacity in a database.
4. Various stand-alone types can be tested according to the above steps 1-3, so that the (average) stand-alone service capability of each stand-alone type is automatically obtained.
The specific index for determining the quality requirement may be set as needed, and may include at least one of the following, for example: various indexes such as server performance, client quality, download speed, first frame delay, cost, etc.
For example, corresponding to the above-mentioned server performance index, if the load (e.g., CPU and/or memory usage) of 80% of the servers of stand-alone type Y is higher than 30% when the pressure traffic reaches 7G bandwidth, and the load is less than 20% when the pressure traffic reaches 6G bandwidth, if the load is less than 20% within the acceptable range of the CDN network service provider, the stand-alone standard of stand-alone type Y is set to 6G bandwidth.
For example, the above-mentioned stand-alone type information, server information, various quality standards may be stored in a database.
For example, MySQL may be used as the underlying database, a stand-alone type, stand-alone standard may be used as the unique identifier, a primary key "(corresponding to one or more server clusters) node" may be set within the table, and the following fields may be included: time, unique identification, test results, quality criteria, (cluster) weights, test results, conclusions, verification results, etc. The database supports data synchronization operation, and content in the data can be synchronously modified when a new use case is changed. The data can be stored for a long time, and the fault reason can be inquired from the database when needed at the later stage, so that data recovery operations such as fault disk recovery and the like can be carried out.
Optionally, as shown by the dashed box in fig. 3, this embodiment further includes:
a service scheduling module 309, configured to perform service scheduling.
For example, the service scheduling module 309 may perform service scheduling by:
the service scheduling proportion is adjusted accordingly by the standards corresponding to the individual (i.e. the standards corresponding to the maximum service capacity of each server, e.g. maximum service capacity-70% of the maximum available bandwidth carrying capacity, maximum available number of concurrent requests, etc.).
Optionally, after the balance ratio (i.e., the service scheduling hit probability or weight) is adjusted, the testing module 303 may continue to perform the pressure test, record the actual pressure flow and the service quality, continuously determine whether the set service quality standard is met, and automatically feed back (e.g., send a notification message) the type and standard of the single machine to the corresponding responsible person to add other sub-types that may exist if the set service quality standard cannot be met.
For example, if the hard disk is used for a long time, the hard disk can be used, but the maximum service capacity of the server may be reduced, so that the service standard may be reduced. Therefore, the duration of the hard disk can be used as a division label used by the type collection module for the division of the single machine type.
Using the embodiment shown in fig. 3, the following specific operational steps can be performed:
1. the type collection module 301 can collect the single machine types from the whole network to obtain the single machine types of all the servers on the line; new servers and/or stand-alone types may be automatically detected, added.
2. Various quality standards are stored by the quality standard module 305.
3. The type test is performed by the test module 303 to test the maximum single machine standard meeting the specified quality standard.
4. The stand-alone types of all servers are automatically identified by the stand-alone type identification module 307.
5. Alternatively, corresponding to the above step S106, the service scheduling module 309 may be used to perform service scheduling on the servers in the server cluster (composed of several machines).
The embodiment can automatically test the stand-alone service capability according to the change of the hardware, and/or software, and/or service type of the server.
Alternatively, the embodiment may also be capable of automatically determining a stand-alone service capability threshold or criteria and then performing service scheduling based on the determined stand-alone service capability threshold or criteria.
According to the technical scheme of the invention, the stand-alone service capability can be automatically tested according to the hardware types of different servers, and/or software which is developed by different clients and improves the stand-alone service capability, and/or the change of the client file types at different moments, the stand-alone service capability standard (namely, the stand-alone service capability threshold value or standard) can be dynamically set, the corresponding stand-alone service capability standard can be set according to each server in the server cluster, the stand-alone service capability is maximized on the premise of not influencing the access quality, and the manual operation is greatly reduced.
According to the technical scheme of the invention, the stand-alone service quality can be automatically tested aiming at the service type and the server hardware and software indexes (for example, the stand-alone carrying capacity is obtained). The stand-alone load capacity standard can be dynamically set, the standard in the server group is accurate to the stand-alone, and the stand-alone standard is improved to the maximum extent under the condition of not influencing the quality. And the dynamic adjustment of the weight in the group can be carried out, so that the load (service) scheduling is more balanced.
According to the technical scheme of the invention, the method also has the following advantages:
1. the actual service capabilities of each server can be accurately determined.
2. Service criteria can be further determined based on the dynamically determined actual service capabilities of each server, and service scheduling can be performed for each server based on the determined service criteria. And the stand-alone standard is maximally improved on the premise of meeting the service quality. The service scheduling mode of the cluster is dynamically adjusted according to the stand-alone standard, and the change of the stand-alone type of a certain server does not cause the service quality of the whole server cluster to be reduced. The deviation in the balanced scheduling is reduced, the service quality of customers is improved, and the service cost is reduced.
3. For example, when the stand-alone type classification standard includes a hardware status, a software status, and service information provided for a customer, the stand-alone type may be automatically changed according to the hardware status, the software status, and the service change, and the stand-alone standard may also be automatically changed, thereby ensuring that the service quality is not affected by the service change, and maximally reducing manual intervention. Does not need a large amount of manual participation and has high efficiency.
4. The single machine can be classified and automatically tested, the type of each single machine has a corresponding single machine standard, and when the types of the single machines are increased, the standards can be automatically tested and updated.
5. And the dynamic adjustment of the weight in the group can be carried out, so that the load (service) scheduling is more balanced.
The above-described aspects may be implemented individually or in various combinations, and such variations are within the scope of the present invention.
It will be understood by those of ordinary skill in the art that all or some of the steps of the methods, systems, functional modules/units in the devices disclosed above may be implemented as software, firmware, hardware, and suitable combinations thereof. In a hardware implementation, the division between functional modules/units mentioned in the above description does not necessarily correspond to the division of physical components; for example, one physical component may have multiple functions, or one function or step may be performed by several physical components in cooperation. Some or all of the components may be implemented as software executed by a processor, such as a digital signal processor or microprocessor, or as hardware, or as an integrated circuit, such as an application specific integrated circuit. Such software may be distributed on computer readable media, which may include computer storage media (or non-transitory media) and communication media (or transitory media). The term computer storage media includes volatile and nonvolatile, removable and non-removable media implemented in any method or technology for storage of information such as computer readable instructions, data structures, program modules or other data, as is well known to those of ordinary skill in the art. Computer storage media includes, but is not limited to, RAM, ROM, EEPROM, flash memory or other memory technology, CD-ROM, Digital Versatile Disks (DVD) or other optical disk storage, magnetic cassettes, magnetic tape, magnetic disk storage or other magnetic storage devices, or any other medium which can be used to store the desired information and which can accessed by a computer. In addition, communication media typically embodies computer readable instructions, data structures, program modules or other data in a modulated data signal such as a carrier wave or other transport mechanism and includes any information delivery media as known to those skilled in the art.
Finally, it should be noted that: the above examples are only for illustrating the technical solutions of the present invention, and are not limited thereto. Although the present invention has been described in detail with reference to the foregoing embodiments, it will be understood by those of ordinary skill in the art that: the technical solutions described in the foregoing embodiments may still be modified, or some technical features may be equivalently replaced; and such modifications or substitutions do not depart from the spirit and scope of the corresponding technical solutions of the embodiments of the present invention.

Claims (10)

1. A dynamic control method for determining server service capabilities, comprising:
determining the type of the single machine of the server according to a preset classification standard;
when the stand-alone type appears for the first time, the maximum service capability test is carried out on the stand-alone type server, the maximum service capability of the stand-alone type server is determined through the test, the stand-alone type and the maximum service capability of the stand-alone type server are stored, and when the stand-alone type does not appear for the first time, the maximum service capability of the stand-alone type server is determined through searching historical storage information.
2. The dynamic control method for determining server service capabilities according to claim 1, wherein said step of determining a stand-alone type of server according to predetermined classification criteria comprises:
determining the stand-alone type according to at least one sub-classification criterion of at least one of the following predetermined classification criteria: the hardware condition of the server, the software deployment condition on the server, the number of concurrent requests supported by the server, the service information supported by the server,
the maximum service capability comprises at least one of: the maximum available bandwidth carrying capacity and the maximum available concurrent request number of the server, and the specific index for determining the maximum service capability includes at least one of the following: server performance, client quality, download speed, first frame delay, cost.
3. The dynamic control method for determining server service capabilities according to claim 1, wherein said step of determining a stand-alone type of server according to predetermined classification criteria comprises:
automatically determining the stand-alone type of each server in each node according to user instructions or timing; and/or, the method further comprises:
and performing service scheduling on the server according to the determined stand-alone type and the maximum service capability.
4. The dynamic control method for determining server service capabilities of claim 3, wherein the step of scheduling the service to the server based on the determined stand-alone type and maximum service capabilities comprises:
and adjusting the service scheduling hit probability or weight when the server receives the service request according to the determined single machine type and the service standard set according to the maximum service capability.
5. The dynamic control method for determining server service capability of claim 4, wherein the step of adjusting the service scheduling hit probability or weight when the server receives the service request comprises:
when the maximum service capacity of the server is lower than the predetermined service capacity, the service scheduling hit probability or weight at the time the server receives the service request is reduced by a predetermined percentage.
6. A dynamic control apparatus for determining server service capabilities, comprising:
the stand-alone type determining module is used for determining the stand-alone type of the server according to a preset classification standard;
and the service capability determining module is used for testing the maximum service capability of the stand-alone type server when the stand-alone type appears for the first time, determining the maximum service capability of the stand-alone type server through testing, storing the stand-alone type and the maximum service capability of the stand-alone type server, and determining the maximum service capability of the stand-alone type server by searching historical storage information when the stand-alone type does not appear for the first time.
7. The dynamic control for determining server service capabilities of claim 6, wherein said stand-alone type determination module is further for:
determining the stand-alone type according to at least one sub-classification criterion of at least one of the following predetermined classification criteria: the hardware condition of the server, the software deployment condition on the server, the number of concurrent requests supported by the server, the service information supported by the server,
the maximum service capability comprises at least one of: the maximum available bandwidth carrying capacity and the maximum available concurrent request number of the server, and the specific index for determining the maximum service capability includes at least one of the following: server performance, client quality, download speed, first frame delay, cost.
8. The dynamic control for determining server service capabilities of claim 6, wherein said stand-alone type determination module is further for:
automatically determining the stand-alone type of each server in each node according to user instructions or timing, and/or
The device further comprises:
and the service scheduling module is used for performing service scheduling on the server according to the determined stand-alone type and the maximum service capability.
9. The dynamic control apparatus for determining server service capabilities of claim 8, wherein said service scheduling module is further for:
and adjusting the service scheduling hit probability or weight when the server receives the service request according to the determined single machine type and the service standard set according to the maximum service capability.
10. The dynamic control apparatus for determining server service capabilities of claim 9, wherein said service scheduling module is further for:
when the maximum service capacity of the server is lower than the predetermined service capacity, the service scheduling hit probability or weight at the time the server receives the service request is reduced by a predetermined percentage.
CN201811557218.1A 2018-12-19 2018-12-19 Dynamic control method and device for determining server service capability Active CN111338917B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201811557218.1A CN111338917B (en) 2018-12-19 2018-12-19 Dynamic control method and device for determining server service capability

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201811557218.1A CN111338917B (en) 2018-12-19 2018-12-19 Dynamic control method and device for determining server service capability

Publications (2)

Publication Number Publication Date
CN111338917A true CN111338917A (en) 2020-06-26
CN111338917B CN111338917B (en) 2023-03-28

Family

ID=71185022

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201811557218.1A Active CN111338917B (en) 2018-12-19 2018-12-19 Dynamic control method and device for determining server service capability

Country Status (1)

Country Link
CN (1) CN111338917B (en)

Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20020010518A1 (en) * 2000-02-25 2002-01-24 Reid Drew A. Energy management system
CN101267269A (en) * 2008-02-27 2008-09-17 中兴通讯股份有限公司 Load balance implementation method and system in interactive network TV system
CN101707543A (en) * 2009-11-30 2010-05-12 北京中科大洋科技发展股份有限公司 Enterprise media bus system supporting multi-task type and enterprise media bus method supporting multi-task type
CN106255128A (en) * 2016-09-23 2016-12-21 杭州华三通信技术有限公司 Method and device for optimizing wireless network
CN107872402A (en) * 2017-11-15 2018-04-03 北京奇艺世纪科技有限公司 The method, apparatus and electronic equipment of global traffic scheduling
WO2018095298A1 (en) * 2016-11-23 2018-05-31 腾讯科技(深圳)有限公司 Information processing method and device and computer storage medium
US20180227648A1 (en) * 2015-10-29 2018-08-09 Le Holdings (Beijing) Co., Ltd. Method for live broadcast based on hls protocol and electronic device
CN109039795A (en) * 2017-06-12 2018-12-18 贵州白山云科技股份有限公司 A kind of Cloud Server resource monitoring method and system

Patent Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20020010518A1 (en) * 2000-02-25 2002-01-24 Reid Drew A. Energy management system
CN101267269A (en) * 2008-02-27 2008-09-17 中兴通讯股份有限公司 Load balance implementation method and system in interactive network TV system
CN101707543A (en) * 2009-11-30 2010-05-12 北京中科大洋科技发展股份有限公司 Enterprise media bus system supporting multi-task type and enterprise media bus method supporting multi-task type
US20180227648A1 (en) * 2015-10-29 2018-08-09 Le Holdings (Beijing) Co., Ltd. Method for live broadcast based on hls protocol and electronic device
CN106255128A (en) * 2016-09-23 2016-12-21 杭州华三通信技术有限公司 Method and device for optimizing wireless network
WO2018095298A1 (en) * 2016-11-23 2018-05-31 腾讯科技(深圳)有限公司 Information processing method and device and computer storage medium
CN109039795A (en) * 2017-06-12 2018-12-18 贵州白山云科技股份有限公司 A kind of Cloud Server resource monitoring method and system
CN107872402A (en) * 2017-11-15 2018-04-03 北京奇艺世纪科技有限公司 The method, apparatus and electronic equipment of global traffic scheduling

Non-Patent Citations (2)

* Cited by examiner, † Cited by third party
Title
JIEXI ZHA 等: "Research on load balance of Service Capability Interaction Management", 《2010 3RD IEEE INTERNATIONAL CONFERENCE ON BROADBAND NETWORK AND MULTIMEDIA TECHNOLOGY (IC-BNMT)》 *
韩晓梅 等: "基于SDN的CDN体系架构及关键技术研究", 《互联网天地》 *

Also Published As

Publication number Publication date
CN111338917B (en) 2023-03-28

Similar Documents

Publication Publication Date Title
US10664499B2 (en) Content delivery network analytics management via edge stage collectors
US10289473B2 (en) Situation analysis
CN112506659B (en) Management method of edge equipment and related device
CN105099988B (en) Method, access method and device and system for supporting gray scale to issue
US8200842B1 (en) Automatic traffic control using dynamic DNS update
CN112769976B (en) Domain name resolution method and system
CN103607424B (en) Server connection method and server system
CN110740146B (en) Method and device for scheduling cache nodes and computer network system
CN107105013B (en) File processing method, server, terminal and system
US11032358B2 (en) Monitoring web applications including microservices
CN108874502B (en) Resource management method, device and equipment of cloud computing cluster
US11228490B1 (en) Storage management for configuration discovery data
CN111600807A (en) Flow control method and system based on API gateway equipment
CN110838932A (en) Network current limiting method and device and electronic equipment
CN111556135A (en) Request scheduling method, system and device and electronic equipment
CN110401552A (en) A kind of CDN business automated tuning method and device
CN113676511A (en) Cloud storage method, system, equipment and storage medium
CN113242297A (en) Service system and service state adjusting method
CN108616896B (en) Operator identification method and device and internet access system
CN106708648B (en) A kind of the storage method of calibration and system of text data
CN111338917B (en) Dynamic control method and device for determining server service capability
CN109245943B (en) Fault positioning method and device
CN112887224A (en) Traffic scheduling processing method and device, electronic equipment and storage medium
CN110266741B (en) Method and device for automatically scheduling client service in content distribution network
CN116010450A (en) Method, apparatus, electronic device and computer readable medium for resource allocation

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant