CN114528109A

CN114528109A - Resource request method, device and system

Info

Publication number: CN114528109A
Application number: CN202210156095.0A
Authority: CN
Inventors: 梁威; 岳晓敏; 韩金魁
Original assignee: Beijing Jingdong Qianshi Technology Co Ltd
Current assignee: Beijing Jingdong Qianshi Technology Co Ltd
Priority date: 2022-02-21
Filing date: 2022-02-21
Publication date: 2022-05-24

Abstract

The application provides a resource request method, device and system. The method comprises the following steps: the message processing platform can periodically count the processing condition of the message. The processing conditions may include the amount of reception of messages and the amount of processing of messages. The message processing platform can periodically use the message receiving amount and the message processing amount to calculate the target resource amount after monitoring and obtaining the message receiving amount and the message processing amount in each period in the preset time period. The message processing platform can calculate according to the resource parameters of the message processing platform and the target resource amount to obtain the resource amount required by the demand. The message processing platform can generate resource acquisition requests according to the number of the messages. The message processing platform may send the resource acquisition request to the resource management platform, so that the resource management platform allocates resources to the message processing platform according to the resource acquisition request. The method increases the message processing efficiency and avoids the backlog of the messages.

Description

Resource request method, device and system

Technical Field

The present application relates to the field of computers, and in particular, to a method, an apparatus, and a system for requesting resources.

Background

In a network platform with a large amount of message interaction, timely processing of messages is an important factor for ensuring the reliability and stability of the platform. Currently, a network platform can realize the transfer of messages through a middleware system. And when the front end sends the message to the background, the message is forwarded to the corresponding message processing platform.

When the message amount is too large, the message processing platform may have a problem that the messages cannot be processed in time, thereby resulting in message backlog. In the prior art, when detecting that the message of the message processing platform is overstocked, the resource management platform allocates resources to the message processing platform according to the overstocked message amount, so that the message processing platform can process the overstocked message in time.

However, this resource allocation method has a problem of hysteresis, which easily causes a problem of untimely message processing.

Disclosure of Invention

The application provides a resource request method, device and system, which are used for solving the problem that in the prior art, message processing is not timely easily caused.

In a first aspect, the present application provides a resource request method, applied to a message processing platform, including:

periodically counting the message receiving quantity and the message processing quantity of the message processing platform;

calculating to obtain a target resource amount according to the message receiving amount, the message processing amount and a preset algorithm in each period in a preset time period;

and generating and sending a resource acquisition request according to the target resource amount and the resource parameters of the message processing platform, wherein the resource acquisition request is used for requesting resources from a resource management platform.

Optionally, the calculating to obtain the target resource amount according to the message receiving amount, the message processing amount, and a preset algorithm in each cycle within a preset time period includes:

determining an average message processing speed according to the message processing amount and the cycle duration in each cycle within a preset time period;

determining an average message backlog according to the message receiving amount and the message processing amount in each period in a preset time period;

and determining the target resource amount according to the average message processing speed and the average message backlog amount.

Optionally, the generating a resource obtaining request according to the target resource amount and the resource parameter of the message processing platform includes:

determining the quantity of required resources according to the target resource quantity and the resource parameters;

and generating the resource acquisition request according to the resource quantity.

Optionally, when the message processing platform is deployed by adopting a containerization technology, the resource quantity is a copy quantity, and the resource obtaining request is used for requesting the resource management platform to increase the copy quantity of the message processing platform.

Optionally, when the message processing platform is deployed by using a non-containerization technology, the resource quantity is an interface quantity, and the resource obtaining request is used for requesting the resource management platform to increase the interface quantity of the message processing platform.

Optionally, before the target resource amount is calculated according to the message receiving amount, the message processing amount, and a preset algorithm in each cycle within a preset time period, the method further includes:

determining the queuing ratio in each period according to the message receiving amount and the message processing amount in each period;

counting the backlog times that the queuing occupation ratio is greater than the occupation ratio threshold value within a preset time period;

and when the backlog times are smaller than a time threshold value, determining the target resource amount according to a preset value.

Optionally, the determining a queuing ratio in each period according to the message receiving amount and the message processing amount in each period includes:

determining message queuing quantity according to the difference value between the message receiving quantity and the message processing quantity;

and determining the queuing ratio according to the ratio of the message queuing amount to the message receiving amount.

determining the current message processing speed according to the message processing amount and the period duration in the current period;

determining message backlog probability according to the current message processing speed and the message receiving quantity in the current period;

and when the message backlog probability is smaller than a probability threshold, determining the target resource amount according to a preset value.

Optionally, the determining a message backlog probability according to the current message processing speed and the message receiving amount in the current period includes:

determining actual processing time consumption according to the ratio of the message receiving amount to the current message processing speed;

and determining the message backlog probability according to the ratio of the actual processing time consumption to the period duration.

Optionally, the method further comprises:

acquiring historical message receiving quantity corresponding to the next period from the historical record of the message processing platform;

determining the time consumed by historical processing according to the ratio of the historical message receiving amount to the current message processing speed;

determining historical backlog probability according to the ratio of the historical processing time consumption to the period duration;

and updating the message backlog probability according to the weighted sum of the message backlog probability and the historical backlog probability.

In a second aspect, the present application provides a resource request device applied to a message processing platform, including:

the acquisition module is used for periodically counting the message receiving quantity and the message processing quantity of the message processing platform;

the processing module is used for calculating to obtain a target resource amount according to the message receiving amount, the message processing amount and a preset algorithm in each period in a preset time period; and generating and sending a resource acquisition request according to the target resource amount and the resource parameters of the message processing platform, wherein the resource acquisition request is used for requesting resources from a resource management platform.

Optionally, the processing module is specifically configured to:

Optionally, the processing module is further configured to:

determining the queue proportion in each period according to the message receiving amount and the message processing amount in each period;

Optionally, the processing module is specifically configured to:

Optionally, the processing module is further configured to:

Optionally, the processing module is specifically configured to:

In a third aspect, the present application provides a message processing system, including: the system comprises a resource management platform and at least one message processing platform, wherein the resource management platform is used for managing resources in the message processing system, each message processing platform is used for processing a type of message, each message processing platform corresponds to at least one server, and a container copy or an interface is deployed in each server.

In a fourth aspect, the present application provides a readable storage medium, in which a computer program is stored, and when the computer program is executed by at least one processor of a message processing platform, the message processing platform executes the resource request method in any one of the possible designs of the first aspect and the first aspect.

In a fifth aspect, the present application provides a computer program product comprising a computer program which, when executed by at least one processor of a message processing platform, causes the message processing platform to perform the method for requesting resources in any one of the possible designs of the first aspect and the first aspect.

The resource request method provided by the application periodically counts the processing condition of the message, wherein the processing condition comprises the receiving quantity and the processing quantity of the message; after monitoring and obtaining the message receiving quantity and the message processing quantity in each period in a preset time period, periodically using the message receiving quantity and the message processing quantity to calculate and obtain a target resource quantity; calculating according to the resource parameters and the target resource quantity to obtain the resource quantity of the demand request; generating a resource acquisition request according to the number of the messages; the resource acquisition request is sent to the resource management platform, so that the resource management platform is a means for allocating resources according to the resource acquisition request, the processing efficiency of the resource processing platform is improved, overstock is avoided through message distribution, and the waste effect of resources in the resource management platform is avoided.

Drawings

In order to more clearly illustrate the technical solutions in the present application or the prior art, the drawings needed for the description of the embodiments or the prior art will be briefly introduced below, and it is obvious that the drawings in the following description are some embodiments of the present application, and it is obvious for those skilled in the art to obtain other drawings based on these drawings without creative efforts.

Fig. 1 is a schematic flow chart of a system for requesting resources according to an embodiment of the present application;

fig. 2 is a flowchart of a resource request method according to an embodiment of the present application;

fig. 3 is a flowchart of a resource request method according to an embodiment of the present application;

fig. 4 is a flowchart of a resource request method according to an embodiment of the present application;

fig. 5 is a schematic structural diagram of a resource request apparatus according to an embodiment of the present application;

fig. 6 is a schematic structural diagram of a message processing system according to an embodiment of the present application.

Detailed Description

To make the purpose, technical solutions and advantages of the present application clearer, the technical solutions in the present application will be clearly and completely described below with reference to the drawings in the present application, and it is obvious that the described embodiments are some, but not all embodiments of the present application. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present application.

The terms "first," "second," "third," "fourth," and the like in the description and in the claims of the present application and in the above-described drawings are used for distinguishing between similar elements and not necessarily for describing a particular sequential or chronological order. It will be appreciated that the data so used may be interchanged where appropriate. For example, first information may also be referred to as second information, and similarly, second information may also be referred to as first information, without departing from the scope herein.

The word "if" as used herein may be interpreted as "at … …" or "when … …" or "in response to a determination", depending on the context.

Also, as used herein, the singular forms "a", "an" and "the" are intended to include the plural forms as well, unless the context indicates otherwise.

It will be further understood that the terms "comprises," "comprising," "includes" and/or "including," when used in this specification, specify the presence of stated features, steps, operations, elements, components, items, species, and/or groups, but do not preclude the presence, or addition of one or more other features, steps, operations, elements, components, species, and/or groups thereof.

The terms "or" and/or "as used herein are to be construed as inclusive or meaning any one or any combination. Thus, "A, B or C" or "A, B and/or C" means "any of the following: a; b; c; a and B; a and C; b and C; A. b and C ". An exception to this definition will occur only when a combination of elements, functions, steps or operations are inherently mutually exclusive in some way.

In a network platform with a large amount of message interaction, timely processing of messages is an important factor for ensuring the reliability and stability of the platform. Currently, a network platform can implement message relay through middleware. In a message processing system, the middleware may forward a message to a corresponding message processing platform when a front end sends the message to a back end. JMQ is a message middleware system with high availability and high reliability. The middleware system is widely applied to scenes such as order generation, payment processing and storehouse management.

In actual use, the amount of messages in a message processing system is constantly changing. The processing efficiency of each message processing platform in the message processing system is fixed. I.e. the consuming power of the message consumer is fixed. At this time, as the amount of messages increases, a situation may occur in which the message processing platform cannot process the messages in time. This situation may further lead to problems such as backlog of messages, abnormal message handling, etc.

In the prior art, when detecting that a message of a message processing platform is backlogged, a resource management platform may send a message reminder to remind an administrator to process the message backlogged condition. After receiving the message prompt, the administrator can evaluate the message backlog according to the message backlog and generate a resource acquisition request according to the evaluation result. The resource acquisition request may request the resource management platform to allocate resources to the message processing platform, so as to implement resource expansion of the message processing platform when the message is backlogged. Or, the message processing platform may further generate the resource acquisition request according to the backlogged message amount when detecting that the message of the message processing platform generates the backlog.

However, there is typically a hysteresis in acquiring resources using this approach. A message processing platform typically requests resources after a backlog of messages has occurred. This approach easily causes the problem of untimely message processing, may cause loss to the user, or may bring a poor user experience to the user.

In order to solve the above problems, the present application provides a resource request method. The method and the device realize the periodic statistics of the message receiving quantity and the message processing quantity of the message processing platform by arranging the plug-in the message processing platform. The plug-in can also judge whether the message processing platform is likely to generate message backlog according to the message receiving quantity and the message processing quantity in each period in a preset time period. If the plug-in considers that the message processing platform is likely to generate message backlog, the plug-in can calculate the target resource amount according to the message receiving amount, the message processing amount and the preset algorithm in each period. The target amount of resources is used to indicate resources that the plug-in expects to have completed processing a potentially backlogged message. In the message processing platform, resource parameters are typically associated with the program that processes the message. When a program for processing a message runs in a copy of a container, the resource parameter of the message processing platform is used to indicate the amount of resources included in one copy. Otherwise, when the program for processing the message obtains the message through the interface, the resource parameter of the message processing platform is used for indicating the number of resources included in one interface. The plug-in may obtain the resource parameters of the message processing platform. The plug-in can also determine the quantity of resources required to be requested according to the target quantity of resources and the resource parameters. The plug-in may generate a resource acquisition request according to the amount of resources that need to be requested. The plug-in may send the resource acquisition request to a resource management platform.

According to the method, the resources are automatically and timely increased when the influence is exerted on the enlargement of the seedling heads, the message processing efficiency is improved, and the message overstock is avoided. The method can effectively prevent damage from being enlarged and avoid immeasurable loss. The method can also improve the user experience and the system processing efficiency, and reduce the labor cost and the time cost of maintenance.

The technical solution of the present application will be described in detail below with specific examples. The following several specific embodiments may be combined with each other, and details of the same or similar concepts or processes may not be repeated in some embodiments.

Fig. 1 shows a system flow diagram of a resource request according to an embodiment of the present application. The consumption end is a message processing platform and is used for processing messages. The message processing platform can realize monitoring of itself by installing the plug-in. The message processing platform can obtain the processing capacity of the message processing platform according to the monitoring result. The message processing platform can also determine the message enqueue condition in the message queue according to the monitoring result. The message processing platform may be pre-stored with backlog processing rules. When the message processing queue judgment condition meets the backlog processing rule, the message processing platform can trigger backlog processing. During the backlog process, the message processing platform may calculate the amount of resources required. The message processing platform may apply for resources from the resource management platform. And when the message processing platform receives the resources distributed by the resource management platform, the message processing platform can expand the resources.

In one example, the resource allocated by the resource management platform for the message processing platform may be a dynamic resource. The message processing platform may use the resource within a certain time after acquiring the resource. And when the time exceeds the certain time, the resource quantity of the message processing platform is recovered to the initial resource quantity. The resources allocated by the resource management platform to the message processing platform are released. The resource management platform may again allocate the resource to a message management platform.

In one example, the message processing platform may include a management server having a plug-in installed therein. The management server can acquire all messages needed by the message processing platform and send the messages to other servers of the message processing platform for processing. The plug-in the management server can realize the statistics of the messages of the message processing platform.

In another example, a statistics plug-in may be installed in each server in the message processing platform. The statistical plug-in can be used for counting the enqueue condition and the processing condition of the message in each server. The message processing platform can also be provided with a management plug-in. The management plug-in is used for summarizing the statistical results of all the statistical plug-ins of the message processing platform.

In the present application, a message processing platform is used as an execution subject to execute the resource request method of the following embodiments. Specifically, the execution body may be a hardware device of the message processing platform, or a software application in the message processing platform, or a computer-readable storage medium installed with the software application implementing the following embodiment, or code of the software application implementing the following embodiment.

Fig. 2 shows a flowchart of a resource request method according to an embodiment of the present application. On the basis of the embodiment shown in fig. 1, as shown in fig. 2, with a message processing platform as an execution subject, the method of this embodiment may include the following steps:

s101, periodically counting the message receiving quantity and the message processing quantity of the message processing platform.

In this embodiment, a plug-in may be installed in the message processing platform. The plug-in may be java-java: messagebacklog. The plug-in is used to monitor messages in the message processing platform. The plug-in is typically introduced to the message processing platform in a start-up script fashion or in a hard-coded fashion. The message processing platform can realize the scanning of the coding and decoding of the service system of the message processing platform through the plug-in. The compiled code of the service system may be class bytecode. After the scanning is finished, the plug-in can also automatically add byte codes in a message consumption method in a service system of the message processing platform. The message consumption method refers to a function/method/class code and the like used for realizing a specific consumption process of a message in the message processing platform. Wherein the bytecode is used to add logic functions. For example, after adding the bytecode, statistical logic can be added before and after the service function in the service system performs the consumption of the message. That is, the message processing platform may perform statistics on the received messages before message processing. The message processing platform can also perform statistics on processed messages after message processing.

For example, for project A, multiple message types, topic1, topic2, etc., may be included. Wherein, different types of messages can be distributed to different message processing service platforms for processing. Wherein a message processing platform may be configured to process messages of at least one message type.

The message processing platform can periodically count the processing condition of the message. The processing conditions may include the amount of reception of messages and the amount of processing of messages. For example, as shown in table 1, the message processing conditions in a plurality of periods are counted by the message processing platform when the period duration is 5 minutes.

TABLE 1

Starting time	Enqueuing	Treatment of	End time
				2021/8/24 14:05	3000	2500	2021/8/24 14:10
2021/8/24 14:10	3500	3200	2021/8/25 14:15
				2021/8/24 14:15	2000	1300	2021/8/26 14:20
2021/8/24 14:25	3000	2500	2021/8/27 14:30

And S102, calculating to obtain the target resource amount according to the message receiving amount, the message processing amount and the preset algorithm in each period in the preset time period.

In this embodiment, the message processing platform may calculate the target resource amount when the message is backlogged or when it is estimated that the message may be backlogged. The target amount of resources is used to indicate an amount of resources required to process messages that have been backlogged or messages for which backlogs are expected to occur. The message processing platform can periodically use the message receiving amount and the message processing amount to calculate the target resource amount after monitoring and obtaining the message receiving amount and the message processing amount in each period in the preset time period.

In one example, the calculation process of the target resource amount may specifically include the following steps:

step 1, the message processing platform determines the average message processing speed according to the message processing amount and the cycle duration in each cycle in a preset time period.

In this step, the message processing platform may determine the message processing speed in each period by calculating a ratio of the message processing amount in each period to the period duration in the preset time period. For example, as shown in table 1, the message processing speed is 2500/5-500 in a period from 2021/8/2414: 05 to 2021/8/2414: 10. The message processing platform can calculate the average value of the message processing speeds in each period in the preset time period to obtain the average message processing speed. For example, as shown in table 1, the message processing speeds in the respective periods are 500, 640, 260, 500 for the preset time periods 2021/8/2414: 05 to 2021/8/2414: 25, respectively. The average message processing speed may be (500+640+260+500)/4 ═ 475.

Or, the message processing platform may also determine the average message processing speed by counting the total message processing amount in the preset time period, and calculating a ratio of the total message processing amount to the duration of the preset time period. For example, as shown in table 1, the total message throughput is 9500 for the preset time period 2021/8/2414: 05 to 2021/8/2414: 25. The average message processing speed is 475 from 9500/20.

And 2, determining the average message backlog by the message processing platform according to the message receiving amount and the message processing amount in each period in a preset time period.

In this step, the message processing platform may determine the message backlog amount in each period by calculating a difference between the message receiving amount and the message processing amount in each period in the preset time period. For example, as shown in table 1, the message backlog amount is 3000-. The message processing platform can calculate the average message backlog by calculating the message backlog in each period in the preset time period and calculating the average value of the message backlog. For example, as shown in table 1, the message backlog amounts in the respective periods are 500, 300, 700, 500 in the preset time periods 2021/8/2414: 05 to 2021/8/2414: 25, respectively. The average message backlog may be (500+300+700+ 500)/4-500.

Or, the message processing platform may calculate the total message backlog according to the difference value after counting the total message receiving amount and the total message processing amount in the preset time period. For example, as shown in table 1, the total message reception amount is 11500 and the total message processing amount is 9500 for the preset time period 2021/8/2414: 05 to 2021/8/2414: 25. The message processing platform can calculate the total message backlog amount to be 11500-. The average message backlog may be 2000/4-500.

And 3, determining the target resource amount by the message processing platform according to the average message processing speed and the average message backlog amount.

In this step, the message processing platform may calculate the target resource amount according to the average message processing speed and the average message backlog amount respectively calculated in the above two steps. The calculation formula of the target resource amount may be:

target resource amount-average message backlog/average message processing speed

The target amount of resources may be understood as the processing time required for the current resources of the message processing platform to process the backlog message.

S103, generating and sending a resource acquisition request according to the target resource amount and the resource parameters of the message processing platform, wherein the resource acquisition request is used for requesting resources from the resource management platform.

In this embodiment, since the message processing platform is always in the working state, the message processing platform cannot process the backlog messages. In order to process these backlogged messages, the resource management server needs to allocate resources for the message processing platform to increase the processing capacity of the message processing platform. The message processing platform can calculate according to the resource parameters of the message processing platform and the target resource amount to obtain the resource amount required by the demand. The message processing platform can generate resource acquisition requests according to the number of the messages. The message processing platform may send the resource acquisition request to a resource management platform. And the resource management platform allocates resources to the message processing platform according to the resource acquisition request.

In one example, the specific step of the message processing platform generating the resource obtaining request according to the target resource amount and the resource parameter may include:

step 1, the message processing platform determines the quantity of the required resources according to the target resource quantity and the resource parameters.

In this step, the target resource amount may be understood as a time required for processing the backlog message using the current resource of the message processing platform. When the duration is the unit duration, the resources required for processing the backlog message in the unit duration can be calculated according to the target resource amount.

In one implementation, when the containerization technique is employed in a message processing platform, the minimum unit of resources in the message processing platform is a copy. The number of resources may be described using the number of replicas. The resource parameters are used to describe the resources in each copy. The message processing platform may determine the amount of resources that need to be added based on a ratio of resources required to process the backlog message within a unit time to a resource parameter. The resource quantity is the copy quantity. That is, when the number of copies of a resource is increased in the message processing platform, the backlog message can be processed in a unit time.

In another implementation, when the message processing platform is deployed by using a non-containerization technology, the minimum unit of resources in the message processing platform is an interface. The number of resources may be described using the number of interfaces. The resource parameters are used to describe the resources in each interface. The message processing platform may determine the amount of resources that need to be added based on a ratio of resources required to process the backlog message within a unit time to a resource parameter. The number of resources is the number of interfaces. When the number of interfaces of the resource quantity is increased in the message processing platform, the backlog message can be processed in unit time.

And 2, the message processing platform generates a resource acquisition request according to the quantity of the resources.

In this step, the message processing platform may generate a resource acquisition request according to the number of resources calculated in the previous step.

In one implementation, when a containerization technology is used for deployment in a message processing platform, a resource acquisition request is used to request a resource management platform to increase the number of copies of the message processing platform.

In another implementation, when the message processing platform is deployed by using a non-containerization technology, the resource acquisition request is used for requesting the resource management platform to increase the number of interfaces of the message processing platform.

In one example, when deployed in a containerization technique in a message processing platform, at least one container may run in each server. At least one copy is deployed in each container. When some idle resources exist in the message processing platform, the message processing platform can increase the resources which can be used for message processing in the message processing platform by increasing the number of copies. For example, the message processing platform may implement resource number promotion in a rolling upgrade manner through the following instructions.

kubectl scale deployment nginx-deployment--replicas 5

Wherein the instruction is to indicate a number of copies in the modification container. Where-replicas 5 is used to indicate that the number of copies is modified to 5. -deployment file for indicating the project corresponding to the message processing platform.

In another example, when the message processing platform is deployed by a non-containerization technology, at least one interface program can run in each server. The message processing platform may enable the use of an interface by running an interface program. The resource management platform may send the address of the newly allocated server to the message processing platform. The message processing platform may enable linking to the server by remote control code and storing local information in the server.

scp-P 22remote@www.test.com:/usr/local/test.jar/home/export

The message processing platform may be linked to a server www.test.com, and store local information under the/usr/local/test. Wherein, the scp-P22 remote is a remote control command. The above operations are used to implement remote deployment of the newly allocated server. When deployment is complete, in the server

After the remote deployment of the local file is completed, the message processing platform can realize the starting of the interface through a script instruction/start.

According to the resource request method, the message processing platform can periodically count the processing condition of the message. The processing conditions may include the amount of reception of messages and the amount of processing of messages. The message processing platform can periodically use the message receiving amount and the message processing amount to calculate the target resource amount after monitoring and obtaining the message receiving amount and the message processing amount in each period in the preset time period. The message processing platform can calculate according to the resource parameters of the message processing platform and the target resource amount to obtain the resource amount required by the demand. The message processing platform can generate resource acquisition requests according to the number of the messages. The message processing platform may send the resource acquisition request to a resource management platform. And the resource management platform allocates resources to the message processing platform according to the resource acquisition request. In the application, the resource quantity is increased for the resource processing platform when the backlog occurs to the message, so that the processing efficiency of the resource processing platform is improved, the backlog is avoided by shunting the message, and the waste of resources in the resource management platform is avoided.

Fig. 3 shows a flowchart of a resource request method according to an embodiment of the present application. On the basis of the embodiment of fig. 2, as shown in fig. 3, with a message processing platform as an execution subject, the method of this embodiment may include the following steps:

s201, periodically counting the message receiving quantity and the message processing quantity of the message processing platform.

Step S201 is similar to the step S101 in the embodiment of fig. 2, and this embodiment is not described herein again.

S202, determining the queuing ratio in each period according to the message receiving amount and the message processing amount in each period.

In this embodiment, after the message processing platform counts the message receiving amount and the message processing amount obtained in each period, the queue occupation ratio in the period may be calculated according to the message receiving amount and the message processing amount in the period. The queue occupancy may be used to indicate the ratio of messages that have not been processed at the end of the period to messages enqueued for the period.

In one example, the process of calculating the queue proportion specifically includes the following steps:

step 1, the message processing platform determines the message queuing amount according to the difference value between the message receiving amount and the message processing amount.

And 2, determining a queuing ratio by the message processing platform according to the ratio of the message queuing amount to the message receiving amount.

And S203, counting the backlog times of the queue occupancy which is greater than the occupancy threshold value in a preset time period.

In this embodiment, some statistical rules may be preset in the message processing platform. These statistical rules may be used to determine whether a message backlog condition is present or likely to occur. For example, the statistical rule may be used to count the number of backlogs for which the queuing duty is greater than a duty threshold within a preset time period. The statistical rule may also be preset with a time threshold. The message processing platform can judge whether the message backlog condition occurs or not by comparing the backlog times with the time threshold. When the backlog number is less than the number threshold, the message processing platform may continue to perform step S204. When the message backlog number is greater than or equal to the number threshold, the message processing platform may continue to perform step S205. For example, the number threshold may be 2, 3, etc. Wherein the preset time period can be determined according to the system precision. The preset time period may be 2 minutes when the system needs to maintain a high degree of accuracy and stability. The preset time period may be 5 minutes when the system may use a lower degree of precision and stability.

And S204, when the backlog times are smaller than a time threshold value, determining a target resource amount according to a preset value.

In this embodiment, when the backlog number is less than the preset number, it may be considered that the message in the message processing platform is not backlogged. Thus, the message processing voucher may determine that the target amount of resources is a preset value. The preset value may be a parameter such as 0, -1, etc. for indicating that the message processing voucher does not need to request resources in this case. When this step is performed, the calculation of the period ends.

And S205, when the message backlog times are larger than or equal to the time threshold, calculating to obtain the target resource amount according to the message receiving amount, the message processing amount and the preset algorithm in each period in the preset time period.

S206, according to the target resource amount and the resource parameters of the message processing platform, a resource acquisition request is generated and sent, and the resource acquisition request is used for requesting resources from the resource management platform.

Steps S205 and S206 are similar to steps S102 and S103 in the embodiment of fig. 2, and are not described again in this embodiment.

According to the resource request method, the message processing platform can periodically count the processing condition of the message. The processing conditions may include the amount of reception of messages and the amount of processing of messages. The message processing platform can determine the queuing ratio in each period according to the message receiving amount and the message processing amount in each period. The message processing platform can count the backlog times that the queue occupation ratio is greater than the occupation ratio threshold value in a preset time period. When the backlog number is less than the number threshold, the message processing platform may end the calculation of the period. When the message backlog probability is greater than or equal to the probability threshold, the message processing platform may calculate the target resource amount according to the message receiving amount, the message processing amount, and the preset algorithm in each period within the preset time period. The message processing platform can calculate according to the resource parameters of the message processing platform and the target resource amount to obtain the resource amount required by the demand. The message processing platform can generate resource acquisition requests according to the number of the messages. In the application, the resource quantity is increased for the resource processing platform when the backlog occurs to the message, so that the processing efficiency of the resource processing platform is improved, and the backlog is avoided by shunting the message. In the application, the resource processing platform can also realize timely resource request when backlog occurs by judging whether backlog occurs, so that the resource waste in the resource management platform is avoided.

Fig. 4 shows a flowchart of a resource request method according to an embodiment of the present application. On the basis of the embodiments of fig. 2 and fig. 3, as shown in fig. 4, with a message processing platform as an execution subject, the method of this embodiment may include the following steps:

s301, periodically counting the message receiving quantity and the message processing quantity of the message processing platform.

Step S301 is similar to the step S101 in the embodiment of fig. 2, and this embodiment is not described herein again.

S302, determining the current message processing speed according to the message processing amount and the cycle duration in the current cycle.

In this embodiment, the message processing platform may count the message processing amount in the current period. The message processing platform can determine the current message processing speed in the current period according to the ratio of the message processing amount to the period duration.

S303, determining the message backlog probability according to the current message processing speed and the message receiving amount in the current period.

In this embodiment, the message processing platform may also count the message receiving amount in the current period. The message processing platform may determine the actual processing time according to the ratio of the current message processing speed of the current period to the message receiving amount in the current period. The message processing platform can also determine the message backlog probability according to the ratio of the actual processing time consumption to the period duration. When the message processing platform can process all messages in a period, the message backlog probability is a value less than or equal to 1. When the message processing platform cannot process a complete message in a cycle, the message backlog probability is a value greater than 1.

In one example, the message processing platform may further obtain a historical message receiving amount corresponding to a next cycle of the current cycle. For example, when the current period is 2021/8/2414: 05 to 2021/8/2414: 10. The next cycle of the current cycle is 2021/8/2414: 10 to 2021/8/2414: 15. The historical message receipt may be 2021/8/2314: 10 to 2021/8/2314: 15 messages received in one cycle. The message processing platform can determine the time consumed by the historical processing according to the ratio of the historical message receiving amount to the current message processing speed. The message processing platform can determine the historical backlog probability according to the ratio of the historical processing time consumption to the cycle time length. When the historical backlog probability is greater than 1, the message processing platform cannot process all messages enqueued in the period within the period duration. When the historical backlog probability is less than 1, the message processing platform can process all messages enqueued in the period within the period duration. The message processing platform can be preset with the weights of the message backlog probability and the historical backlog probability. The message processing platform can calculate to obtain a new message backlog probability according to the weighted sum of the message backlog probability and the historical backlog probability.

In another example, the message processing platform may also obtain a plurality of historical message receipt amounts over a plurality of historical time periods. The message processing platform can calculate a plurality of historical processing time consumption according to the historical message receiving amount. The message processing platform can calculate the average historical processing time consumption and the average historical backlog probability according to the historical processing time consumption. The message processing platform can calculate to obtain a new message backlog probability according to the weighted sum of the message backlog probability and the average historical backlog probability. A probability threshold may also be stored in the message processing platform. When the message backlog probability is less than the probability threshold, the message processing platform may continue with step S304. When the message backlog probability is greater than or equal to the probability threshold, the message processing platform may continue to perform step S305. For example, the probability threshold may be 1.2, 1.3, etc.

And S304, when the message backlog probability is smaller than the probability threshold, determining the target resource amount according to a preset value.

In this embodiment, when the message backlog probability is smaller than the probability threshold, it may be considered that no backlog occurs to the message in the message processing platform. Thus, the message processing voucher may determine that the target amount of resources is a preset value. The preset value may be a parameter such as 0, -1, etc. for indicating that the message processing voucher does not need to request resources in this case. When this step is performed, the calculation of the period ends.

S305, when the message backlog probability is larger than or equal to the probability threshold, calculating to obtain a target resource amount according to the message receiving amount, the message processing amount and the preset algorithm in each period in a preset time period.

S306, according to the target resource amount and the resource parameters of the message processing platform, a resource acquisition request is generated and sent, and the resource acquisition request is used for requesting resources from the resource management platform.

Steps S305 and S306 are similar to steps S102 and S103 in the embodiment of fig. 2, and are not described again in this embodiment.

According to the resource request method, the message processing platform can periodically count the processing condition of the message. The processing conditions may include the amount of reception of messages and the amount of processing of messages. The message processing platform can count the message processing amount in the current period. The message processing platform can determine the current message processing speed in the current period according to the ratio of the message processing amount to the period duration. The message processing platform can also count the message receiving amount in the current period. The message processing platform may determine the actual processing time according to the ratio of the current message processing speed of the current period to the message receiving amount in the current period. The message processing platform can also determine the message backlog probability according to the ratio of the actual processing time consumption to the period duration. When the message backlog probability is less than the probability threshold, the message processing platform may end the calculation of the period. When the message backlog probability is greater than or equal to the probability threshold, the message processing platform may calculate the target resource amount according to the message receiving amount, the message processing amount, and the preset algorithm in each period within the preset time period. The message processing platform can calculate according to the resource parameters of the message processing platform and the target resource amount to obtain the resource amount required by the demand. The message processing platform can generate resource acquisition requests according to the number of the messages. In the application, the resource quantity is increased for the resource processing platform when the backlog occurs to the message, so that the processing efficiency of the resource processing platform is improved, and the backlog is avoided by shunting the message. In the application, the resource processing platform can also realize timely resource request when backlog occurs by judging whether backlog occurs, so that the waste of resources in the resource management platform is avoided.

Fig. 5 shows a schematic structural diagram of a resource request device according to an embodiment of the present application, and as shown in fig. 5, a resource request device 10 according to this embodiment is used to implement an operation corresponding to a message processing platform in any of the method embodiments described above, where the resource request device 10 according to this embodiment includes:

the obtaining module 11 is configured to periodically count a message receiving amount and a message processing amount of the message processing platform.

And the processing module 12 is configured to calculate a target resource amount according to the message receiving amount, the message processing amount, and a preset algorithm in each period within a preset time period. And generating and sending a resource acquisition request according to the target resource amount and the resource parameters of the message processing platform, wherein the resource acquisition request is used for requesting resources from the resource management platform.

In one example, the processing module 12 is specifically configured to:

and in a preset time period, determining the average message processing speed according to the message processing amount and the cycle duration in each cycle.

And in a preset time period, determining the average message backlog according to the message receiving amount and the message processing amount in each period.

In one example, the processing module 12 is specifically configured to:

and determining the quantity of the required resources according to the target resource quantity and the resource parameters.

And generating a resource acquisition request according to the quantity of the resources.

In one example, when the message processing platform is deployed by using a containerization technique, the resource quantity is a copy quantity, and the resource acquisition request is used for requesting the resource management platform to increase the copy quantity of the message processing platform.

In one example, when the message processing platform is deployed by using a non-containerization technology, the resource quantity is the interface quantity, and the resource obtaining request is used for requesting the resource management platform to increase the interface quantity of the message processing platform.

In one example, the processing module 12 is further configured to:

and determining the queuing ratio in each period according to the message receiving amount and the message processing amount in each period.

And counting the backlog times of which the queue occupation ratio is greater than the occupation ratio threshold value in a preset time period.

And when the backlog times are smaller than the time threshold value, determining the target resource amount according to a preset value.

In one example, the processing module 12 is specifically configured to:

and determining the message queuing amount according to the difference value of the message receiving amount and the message processing amount.

In one example, the processing module 12 is further configured to:

and determining the current message processing speed according to the message processing amount and the cycle duration in the current cycle.

And determining the message backlog probability according to the current message processing speed and the message receiving quantity in the current period.

And when the message backlog probability is smaller than the probability threshold, determining the target resource amount according to a preset value.

In one example, the processing module 12 is specifically configured to:

and determining the actual processing time consumption according to the ratio of the message receiving amount to the current message processing speed.

In one example, the processing module 12 is specifically configured to:

and acquiring the historical message receiving amount corresponding to the next period from the historical record of the message processing platform.

And determining the time consumed by the historical processing according to the ratio of the historical message receiving amount to the current message processing speed.

And determining the historical backlog probability according to the ratio of the historical processing time consumption to the period duration.

The resource request apparatus 10 provided in the embodiment of the present application may implement the method embodiment, and for details of the implementation principle and the technical effect, reference may be made to the method embodiment, which is not described herein again.

Fig. 6 shows a schematic structural diagram of a message processing system according to an embodiment of the present application. As shown in fig. 6, the message processing system 20 may include: a resource management platform 21 and at least one message processing platform 22.

Wherein one message processing system may correspond to one application scenario. For example, the message processing system may be a message processing system of a shopping mall. As another example, the message processing system may be a message processing system of a short video website.

A resource management platform 21 may be included in a message processing system 20. The resource management platform 21 is used to manage all the resources in the message processing system 20. The resource management platform 21 may correspond to a dedicated server. Alternatively, the resource management platform 21 may be a program running on a server. The program may be accessible through an interface.

At least one message processing platform 22 may be included in a message processing system 20. Each message processing platform 22 may be configured to process at least one type of message. For example, a first message processing platform may be used to process order generated messages. The second message processing platform may be for processing payment related messages. A third message handling platform may be used to handle inventory related messages. At least one server may be included in each message processing platform 22. When the minimum unit of the resource is a copy in a container, at least one copy of the container may be run in each server. When the minimum unit of the resource is an interface, at least one interface program can run in each server.

In one example, a message forwarding platform may also be included in the message processing system 20. The client may send the message to a message forwarding platform. The message forwarding platform may distribute the message to the message processing platform 22 accordingly, depending on the message type. When a message processing platform 22 includes multiple interfaces or copies, the message forwarding platform may distribute messages evenly among the multiple interfaces or copies of the message processing platform 22.

The message processing platform provided in this embodiment may be configured to execute the resource request method, and the implementation manner and the technical effect thereof are similar, and details are not described here.

The present application also provides a computer-readable storage medium, in which a computer program is stored, and the computer program is used for implementing the methods provided by the above-mentioned various embodiments when being executed by a processor.

The computer-readable storage medium may be a computer storage medium or a communication medium. Communication media includes any medium that facilitates transfer of a computer program from one place to another. Computer storage media may be any available media that can be accessed by a general purpose or special purpose computer. For example, a computer readable storage medium is coupled to the processor such that the processor can read information from, and write information to, the computer readable storage medium. Of course, the computer readable storage medium may also be integral to the processor. The processor and the computer-readable storage medium may reside in an Application Specific Integrated Circuit (ASIC). Additionally, the ASIC may reside in user equipment. Of course, the processor and the computer-readable storage medium may also reside as discrete components in a communication device.

In particular, the computer-readable storage medium may be implemented by any type of volatile or non-volatile Memory device or combination thereof, such as Static Random-Access Memory (SRAM), Electrically-Erasable Programmable Read-Only Memory (EEPROM), Erasable Programmable Read-Only Memory (EPROM), Programmable Read-Only Memory (PROM), Read-Only Memory (ROM), magnetic Memory, flash Memory, magnetic disk, or optical disk. A storage media may be any available media that can be accessed by a general purpose or special purpose computer.

The present application also provides a computer program product comprising a computer program stored in a computer readable storage medium. The computer program can be read by at least one processor of the device from a computer-readable storage medium, and execution of the computer program by the at least one processor causes the device to implement the methods provided by the various embodiments described above.

In the several embodiments provided in the present application, it should be understood that the disclosed apparatus and method may be implemented in other manners. For example, the above-described apparatus embodiments are merely illustrative, and for example, a division of modules is merely a division of logical functions, and an actual implementation may have another division, for example, a plurality of modules may be combined or may be integrated into another system, or some features may be omitted, or not executed. In addition, the shown or discussed coupling or direct coupling or communication connection between each other may be through some interfaces, indirect coupling or communication connection between devices or modules, and may be in an electrical, mechanical or other form.

Wherein the modules may be physically separated, e.g. mounted at different locations of one device, or mounted on different devices, or distributed over multiple network elements, or distributed over multiple processors. The modules may also be integrated, for example, in the same device, or in a set of codes. The respective modules may exist in the form of hardware, or may also exist in the form of software, or may also be implemented in the form of software plus hardware. The method and the device can select part or all of the modules according to actual needs to achieve the purpose of the scheme of the embodiment.

When the respective modules are implemented as integrated modules in the form of software functional modules, they may be stored in a computer-readable storage medium. The software functional module is stored in a storage medium and includes several instructions to enable a computer device (which may be a personal computer, a platform, or a network device) or a processor to execute some steps of the methods according to the embodiments of the present application.

It should be understood that, although the respective steps in the flowcharts in the above-described embodiments are sequentially shown as indicated by arrows, the steps are not necessarily performed sequentially as indicated by the arrows. The steps are not performed in the exact order shown and may be performed in other orders unless explicitly stated herein. Moreover, at least some of the steps in the figures may include multiple sub-steps or multiple stages that are not necessarily performed at the same time, but may be performed at different times, in different orders, and may be performed alternately or at least partially with respect to other steps or sub-steps of other steps.

Finally, it should be noted that: the above embodiments are only used to illustrate the technical solutions of the present application, and not to limit the same. Although the present application has been described in detail with reference to the foregoing embodiments, it should be understood by those of ordinary skill in the art that: it is also possible to modify the solutions described in the previous embodiments or to substitute some or all of them with equivalents. And the modifications or the substitutions do not make the essence of the corresponding technical solutions depart from the scope of the technical solutions of the embodiments of the present application.

Claims

1. A resource request method is applied to a message processing platform, and comprises the following steps:

2. The method according to claim 1, wherein the calculating a target resource amount according to the message receiving amount, the message processing amount and a preset algorithm in each cycle within a preset time period comprises:

3. The method of claim 1, wherein generating a resource acquisition request according to the target resource amount and the resource parameter of the message processing platform comprises:

determining the required resource quantity according to the target resource quantity and the resource parameter;

4. The method according to claim 3, wherein when the containerization technology is adopted for deployment in the message processing platform, the resource quantity is a copy quantity, and the resource acquisition request is used for requesting the resource management platform to increase the copy quantity of the message processing platform; or, when the message processing platform is deployed by adopting a non-containerization technology, the resource quantity is the interface quantity, and the resource acquisition request is used for requesting the resource management platform to increase the interface quantity of the message processing platform.

5. The method according to any one of claims 1-4, wherein before calculating a target resource amount based on the message reception amount, the message processing amount, and a preset algorithm in each cycle for a preset time period, the method further comprises:

counting the backlog times that the queue occupancy is greater than an occupancy threshold value within a preset time period;

6. The method of claim 5, wherein determining the queue fraction in each cycle based on the message received and processed in each cycle comprises:

7. The method according to any one of claims 1-4, wherein before calculating a target resource amount based on the message reception amount, the message processing amount, and a preset algorithm in each cycle for a preset time period, the method further comprises:

determining the current message processing speed according to the message processing amount and the cycle duration in the current cycle;

8. The method of claim 7, wherein determining a message backlog probability based on the current message processing speed and the message receipt amount in the current period comprises:

9. The method of claim 8, further comprising:

10. A message processing system, the system comprising: the system comprises a resource management platform and at least one message processing platform, wherein the resource management platform is used for managing resources of the message processing platforms, each message processing platform is used for processing a type of messages, each message processing platform corresponds to at least one server, and a container copy or an interface is deployed in each server.

11. A computer-readable storage medium, in which a computer program is stored which, when being executed by a processor, is adapted to carry out the method of resource request according to any one of claims 1-9.