WO2015043528A1

WO2015043528A1 - Parallel multi-thread message processing method and device

Info

Publication number: WO2015043528A1
Application number: PCT/CN2014/087733
Authority: WO
Inventors: 张欢; 沈伟锋; 李纪先
Original assignee: 华为技术有限公司
Priority date: 2013-09-30
Filing date: 2014-09-29
Publication date: 2015-04-02
Also published as: CN104518987A

Abstract

Provided is a parallel multi-thread processing method. The method comprises: acquiring a first token number of each thread which is respectively requested to be extracted from a token bucket, wherein the thread is a thread received by the token bucket at the current time, and the first token number indicates one or more tokens; next, determining the number of available tokens in the token bucket at the current time; and then, comparing the number of available tokens with the first token number requested to be extracted by each thread respectively, and determining whether the number of available tokens is greater than or equal to the first token number; if so, extracting tokens with the first token number from the token bucket, and allocating same to the thread; otherwise, not conducting a token allocation operation on the thread. Parallel processing on a plurality of threads is realized while a token bucket receives the plurality of threads at the same time, thereby improving the system performance.

Description

Parallel multi-threaded message processing method and device

Technical field

The present invention relates to communication technologies, and in particular, to a method and apparatus for parallel multi-threaded message processing.

Background technique

In modern communication, people use the token bucket algorithm to control the data traffic on the network, that is, to limit the traffic of data in the network by extracting the token from the token bucket to send data.

In the prior art, when a data packet requiring m bytes arrives, if the current number of tokens in the token bucket is greater than or equal to m tokens, then m tokens are taken out from the token bucket. In the sending of the data packet, if the current number of tokens in the token bucket is less than m tokens, the data packet is discarded.

However, in the case where multiple threads access the same token bucket at the same time, the token bucket locking method can be used to avoid data errors caused by data competition, for example, when a thread uses the token bucket, the token is used. The bucket is locked. At this time, only the thread can access the token bucket. If other threads access the token bucket, they must temporarily suspend until the thread finishes accessing the token bucket and unlock the token bucket, but this will make the original Parallel computing data is processed serially, greatly reducing system performance.

Summary of the invention

The present invention provides a method and apparatus for parallel multi-threaded message processing to improve system performance.

In a first aspect, an embodiment of the present invention provides a parallel multi-thread processing method, including:

Obtaining a first token amount that each thread needs to extract from the token bucket request, where the thread is a thread that is received by the token bucket at a current time;

Determining an amount of usable tokens of the token bucket at the current moment;

Determining the first token that is extracted with each of the thread requests The quantity is compared to determine whether the usable token amount is greater than or equal to the first token amount;

If yes, the token of the first token amount is extracted from the token bucket and allocated to the thread.

In a first possible implementation manner, the determining, by the token bucket, the amount of usable tokens at the current moment includes:

Comparing the accumulated token amount of the token bucket with the token consumption amount of the current time to obtain the usable token amount of the token bucket at the current moment, the token consumption amount a token consumption amount of the token bucket for all the threads from an initial time to a current duration of the current time, the accumulated token amount being received by the token bucket within the first duration The result of adding the token amount to the initial value of the token bucket.

With reference to the first aspect or the first possible implementation manner of the first aspect, in a second possible implementation manner, the acquiring, each thread, respectively, needs to request the first extracted from the token bucket Before the amount of tokens, it also includes:

A counter is set for the thread, and the counter is configured to record the number of tokens in the token bucket consumed by the thread in the first duration.

With reference to any one of the first aspect to the second possible implementation of the first aspect, in a third possible implementation, the taking the first from the token bucket After the token token, it also includes:

The first amount of tokens is increased in the token consumption recorded by the counter.

With reference to any one of the third aspect, the third possible implementation manner of the first aspect, in the fourth possible implementation, the acquiring each thread separately needs to be from the token bucket After the first token amount is requested to be extracted, or before the acquiring the first token amount that each thread needs to extract from the token bucket respectively, the method further includes:

Adding an increased token amount to be issued to the token bucket and adding the first token to the usable token amount to obtain a first sum;

Determining whether the first sum is greater than or equal to the token bucket depth;

If greater than, the difference between the token bucket depth and the usable token amount is increased in the token bucket;

If less than, the amount of the added token is increased in the token bucket.

In a second aspect, an embodiment of the present invention provides a parallel multi-thread processing apparatus, including:

An acquiring module, configured to acquire a first token quantity that each thread needs to extract from the token bucket request, where the thread is a thread that is received by the token bucket at a current time;

a determining module, configured to determine an amount of usable tokens of the token bucket at the current moment;

a comparison module, configured to compare the usable token amount with the first token amount extracted by each of the thread requests, and determine whether the usable token amount is greater than or equal to the first order Amount of card

And an allocating module, configured to: after the comparing module determines to be, extract the token of the first token amount from the token bucket, and allocate the token to the thread.

In a first possible implementation manner, the comparing module is configured to compare the accumulated token amount of the token bucket with the token consumption amount of the current moment, to obtain the token bucket in the The amount of the token that can be used at the current time, the token consumption being a token consumption amount of the token bucket for all the threads from the initial time to the current time of the current time, The accumulated token amount is a result of adding the amount of the added token received by the token bucket within the first duration to the initial value of the token bucket.

In combination with the second aspect or the first possible implementation manner of the second aspect, in a second possible implementation manner, the method further includes: a recording module;

The recording module is configured to record the number of tokens in the token bucket consumed by the thread in the first duration.

With reference to any one of the second aspect to the second possible implementation of the second aspect, in a third possible implementation, the recording module is further configured to: The amount of cards is increased in the amount of token consumption recorded by the counter.

With reference to any one of the third aspect to the third possible implementation of the second aspect, in a fourth possible implementation, the determining module is further configured to prepare the The amount of the added token issued by the card bucket is added to the amount of the usable token to obtain a first sum; determining whether the first sum is greater than or equal to the depth of the token bucket; if greater than, the The difference between the token bucket depth and the usable token amount is increased in the token bucket; if less, the increased token amount is added in the token bucket.

The method and device for processing the parallel multi-threaded message provided by the embodiment of the present invention obtains the first token amount that each thread needs to extract from the token bucket, and the thread is the thread that the token bucket receives at the current time. The first token number is one or more tokens, and then the token token is determined at the current moment, and then the token amount is used separately with each token The first number of tokens requested by the process is compared to determine whether the amount of available tokens is greater than or equal to the first token amount; if yes, the token of the first token amount is extracted from the token bucket and allocated to the token Thread. It realizes the parallel processing of multiple threads when the token bucket receives multiple threads at the same time, thus improving the performance of the system.

DRAWINGS

In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, a brief description of the drawings used in the embodiments or the prior art description will be briefly described below. Obviously, the drawings in the following description It is a certain embodiment of the present invention, and other drawings can be obtained from those skilled in the art without any inventive labor.

FIG. 1 is a flowchart of a parallel multi-thread processing method according to an embodiment of the present invention;

2 is a flowchart of a parallel multi-thread processing method according to another embodiment of the present invention;

FIG. 3 is a schematic diagram of simulation results of a parallel multi-thread processing method according to an embodiment of the present invention; FIG.

FIG. 4 is a schematic diagram of simulation results of a parallel multi-thread processing method according to another embodiment of the present invention; FIG.

FIG. 5 is a schematic structural diagram of a parallel multi-thread processing apparatus according to an embodiment of the present invention;

FIG. 6 is a schematic structural diagram of a parallel multi-thread processing apparatus according to another embodiment of the present invention;

FIG. 7 is a schematic structural diagram of a parallel multi-thread processing device according to an embodiment of the present invention.

detailed description

The technical solutions in the embodiments of the present invention will be clearly and completely described in conjunction with the drawings in the embodiments of the present invention. It is a partial embodiment of the invention, and not all of the embodiments. All other embodiments obtained by those skilled in the art based on the embodiments of the present invention without creative efforts are within the scope of the present invention.

The parallel multi-thread processing method provided by the embodiment of the present invention can be specifically applied to a process of assigning tokens to different threads when the token bucket receives the access of multiple threads at the same time. The parallel multi-thread processing method provided in this embodiment may be specifically implemented by a parallel multi-thread processing device. The parallel multi-thread processing device can be integrated in a switch or a router, etc., and needs to control the number of network elements sent to the network. The parallel multi-thread processing device can be implemented in software and/or hardware. The parallel multi-thread processing method and apparatus provided in this embodiment will be described in detail below.

FIG. 1 is a flowchart of a parallel multi-thread processing method according to an embodiment of the present invention; as shown in FIG. 1 , the method in this embodiment includes:

Step 101: Acquire a first token quantity that each thread needs to extract from the token bucket, where the thread is a thread that the token bucket receives at the current time.

Specifically, in the multi-core multi-thread environment, at the current moment, when multiple threads access the token bucket at the same time, the parallel multi-thread processing device may determine that the token bucket receives at least one thread at the current time.

It should be noted that each thread in this embodiment corresponds to one core, that is, a central processing unit (CPU).

Step 102: Determine the amount of usable tokens of the token bucket at the current moment.

In this embodiment, the parallel multi-thread processing device acquires the usable token amount of the token bucket at the current moment, and at least includes the following two implementation manners:

In a first implementation manner, the parallel multi-thread processing device can obtain the usable token amount of the token bucket itself by using the token bucket's own counting device.

In a second implementation manner, the parallel multi-thread processing device can obtain the usable token amount of the current time of the token bucket by comparing the accumulated token amount of the token bucket with the token consumption of the current time, wherein the token The consumption is the token consumption of the token bucket in the first time period from the initial time to the current time of all the threads, and the accumulated token amount is the increased token amount and the token bucket received by the token bucket in the first duration. The result of the initial value addition, wherein the increase in the token amount is the product of the first duration and the issued token rate.

Step 103: Compare the usable token amount with the first token amount that each thread requests to extract, and determine whether the usable token amount is greater than or equal to the first token amount.

Specifically, when the token bucket receives the access of the multiple threads at the same time, the first token amount that each thread needs to extract from the token bucket may be separately compared to determine whether the available token amount is greater than or equal to The first token amount, if yes, step 104 is performed, and if no, step 105 is performed.

For example, the token bucket receives two threads of access at the same time, wherein the first thread needs The amount of the first token to be extracted from the token bucket is N, and the amount of the first token that the second thread needs to extract from the token bucket is N+1, and then the amount of token that can be used is separately from each thread that needs to be The first token amount extracted in the token bucket is compared, that is, when the token amount 2N at the current time of the token bucket is greater than the first token amount that the first thread needs to extract from the token bucket is N, then The N tokens are taken out from the token bucket and allocated to the first thread. Meanwhile, the token amount 2N of the current token bucket is greater than the first token amount that the second thread needs to extract from the token bucket is N+. At 1 o'clock, N+1 tokens are taken from the token bucket and assigned to the second thread.

It should be noted that after the token bucket allocates 2N+1 tokens to 2 threads at the current time, there is no token in the token bucket, and a token on the pre-borrow is also assigned to the thread. The token bucket needs to wait for its own number of tokens to reach the token amount at the next moment, and then perform the next allocation.

Step 104: Extract the token of the first token amount from the token bucket, and allocate the token to the thread.

In this embodiment, the token of the first token number taken out in the token bucket is allocated to the thread for transmitting the data packet in the thread.

Step 105: The token allocation operation is not performed on the thread.

In this embodiment, if the token amount of the token bucket at the current time is less than the first token amount, the token allocation operation may not be performed on the thread first, that is, the operation of the thread may be considered as the allowed traffic restriction. In addition, the token is not assigned to the thread. Further, the data packet may be discarded or discharged in a queue to be transmitted when the token bucket has accumulated enough tokens, or continue to be sent but marked with special marks, and these special markers are added when the network is overloaded. The packet is dropped.

The parallel multi-thread processing method provided by the embodiment of the present invention obtains a first token amount that each thread needs to extract from the token bucket, and the thread is a thread that the token bucket receives at the current time, the first token. The number is one or more tokens, and then, the token amount of the token bucket at the current moment is determined, and then the token token amount is respectively compared with the first token number requested by each thread to determine The amount of tokens that can be used is greater than or equal to the first token amount; if so, the token of the first token amount is extracted from the token bucket and assigned to the thread. It realizes the parallel processing of multiple threads when the token bucket receives multiple threads at the same time, thus improving the performance of the system.

It should be noted that, before step 101, the method may further include:

Set a counter for each thread that is used to accumulate records for each of the first durations The token consumption of threads.

Further, on the basis of the foregoing embodiment, after step 104, the method may further include:

The first token amount is increased in the token consumption recorded by the counter, wherein the counter is used to record the number of tokens in the token bucket consumed by the thread within the first duration.

2 is a flowchart of a parallel multi-thread processing method according to another embodiment of the present invention; as shown in FIG. 2, before the step 101 of the foregoing embodiment, or after the step 101, the method in this embodiment may further include:

Step 201: Add the increased token amount to be issued to the token bucket and the available token amount to obtain the first sum.

The increase of the token amount in this embodiment may issue the above-mentioned increase token amount to the token bucket by program timing.

Step 202: Determine whether the first sum is greater than or equal to the token bucket depth.

The token bucket depth in this embodiment is the maximum number of tokens that can be stored in the token bucket.

Specifically, the parallel multi-thread processing device determines whether the first sum is greater than or equal to the token bucket depth. If yes, step 203 is performed, and if no, step 204 is performed.

Step 203: Add a difference between the token bucket depth and the usable token amount in the token bucket.

Step 204: Increase the amount of the added token in the token bucket.

The parallel multi-thread processing method provided by the embodiment of the present invention obtains the first sum by adding the increased token amount to be added in the token bucket and the usable token amount; and then determining the first sum Whether the token bucket depth is greater than or equal to; if greater than, the difference between the token bucket depth and the usable token amount is increased in the token bucket; if less, the increasing token amount is increased in the token bucket. The operation of adding a token in a token bucket without locking is implemented.

FIG. 3 is a schematic diagram of a simulation result of a parallel multi-thread processing method according to an embodiment of the present invention; as shown in FIG. 3, on the basis of the parallel multi-thread processing method provided by the foregoing embodiment, simulating parallel multi-threading, Specifically, the upper limit of the counter processing data is set to 7Kpps, and 7 streams are simultaneously played, that is, the simulation performs data processing on 7 parallel threads simultaneously, and the rate of each stream is 1 Kpps. According to the simulation result of FIG. 3, according to the simulation result, according to In the method of the foregoing embodiment, in the case that multiple threads are simultaneously processed, the data packet can be effectively limited.

4 is a schematic diagram of simulation results of a parallel multi-thread processing method according to another embodiment of the present invention; as shown in FIG. 4, the basis of the parallel multi-thread processing method provided by the foregoing embodiment On the other hand, the parallel multi-thread processing is simulated. Specifically, the upper limit of the counter processing data is set to 7Kpps, and 7 streams are simultaneously played, that is, the simulation simultaneously performs data processing on 7 parallel threads, and the rate of each stream is 2Kpps, that is, 14 Kpps is required for data processing of 7 parallel threads at the same time. According to the simulation result of FIG. 4, the method according to the embodiment of the present invention can be used in a short time in the case of simultaneous processing by multiple threads. The traffic shaping of the data packet is controlled, and the data can be effectively limited.

FIG. 5 is a schematic structural diagram of a parallel multi-thread processing apparatus according to an embodiment of the present invention; as shown in FIG. 5, the parallel multi-thread processing apparatus includes: an obtaining module 51, a determining module 52, a comparing module 53, and an allocating module 54. among them,

The obtaining module 51 is configured to obtain a first token quantity that each thread needs to extract from the token bucket request, and the thread is a thread that the token bucket receives at the current time;

a determining module 52, configured to determine an amount of usable tokens of the token bucket at the current moment;

The comparing module 53 is configured to compare the usable token amount with the first token amount that each thread requests to extract, and determine whether the usable token amount is greater than or equal to the first token amount;

The allocating module 54 is configured to extract the token of the first token amount from the token bucket after the comparison module determines to be yes, and allocate the token to the thread.

On the basis of the foregoing embodiment, the comparison module 53 is configured to compare the accumulated token amount of the token bucket with the token consumption amount of the current time, and obtain the usable token amount of the token bucket at the current moment, The card consumption is the token consumption of the token bucket within the first time period from the initial time to the current time of all the threads, and the accumulated token amount is the increased token amount and the token bucket received by the token bucket within the first time duration. The initial values are added together.

FIG. 6 is a schematic structural diagram of a parallel multi-thread processing apparatus according to another embodiment of the present invention; as shown in FIG. 6, on the basis of the foregoing embodiment, the parallel multi-thread processing apparatus may further The recording module 55 is configured to record the number of tokens in the token bucket in the first time duration.

Further, based on the foregoing embodiment, the recording module 55 is further configured to increase the first token amount in the token consumption recorded by the counter.

On the basis of the foregoing embodiment, the determining module 52 is further configured to add the increased token amount to be issued to the token bucket and the usable token amount to obtain the first sum; determine whether the first sum is greater than Or equal to the token bucket depth; if greater than, the difference between the token bucket depth and the usable token amount is increased in the token bucket; if less, the increased token amount is added in the token bucket.

FIG. 7 is a schematic structural diagram of a parallel multi-thread processing device according to an embodiment of the present invention; as shown in FIG. 7, the parallel multi-thread processing device includes: an acquirer 71 and a processor 72. among them,

The acquirer 71 is configured to acquire a first token quantity that each thread needs to extract from the token bucket request, and the thread is a thread that the token bucket receives at the current time;

The processor 72 is configured to determine a usable token amount of the token bucket at the current moment; and compare the usable token amount with the first token amount that each thread requests to extract, and determine whether the available token amount is The first token amount is greater than or equal to; if yes, the token of the first token amount is extracted from the token bucket and allocated to the thread.

On the basis of the foregoing embodiment, the processor 72 is specifically configured to compare the accumulated token amount of the token bucket with the token consumption amount of the current time, and obtain the usable token amount of the token bucket at the current moment, The card consumption is the token consumption amount of the token bucket in the first time period from the initial time to the current time of all the threads, and the accumulated token amount is the increased token amount received by the token bucket in the first time duration. The result of adding the initial value of the token bucket.

On the basis of the foregoing embodiment, the processor 72 is further configured to record the first time duration The thread consumes the number of tokens in the token bucket.

Further, based on the foregoing embodiment, the processor 72 is further configured to increase the first token amount in the token consumption recorded by the counter.

On the basis of the foregoing embodiment, the processor 72 is further configured to add the increased token amount to be issued to the token bucket and the usable token amount to obtain a first sum; determine whether the first sum is greater than Or equal to the token bucket depth; if greater than, the difference between the token bucket depth and the usable token amount is increased in the token bucket; if less, the increased token amount is added in the token bucket.

One of ordinary skill in the art will appreciate that all or part of the steps to implement the various method embodiments described above may be accomplished by hardware associated with the program instructions. The aforementioned program can be stored in a computer readable storage medium. The program, when executed, performs the steps including the foregoing method embodiments; and the foregoing storage medium includes various media that can store program codes, such as a ROM, a RAM, a magnetic disk, or an optical disk.

Finally, it should be noted that the above embodiments are merely illustrative of the technical solutions of the present invention, and are not intended to be limiting; although the present invention has been described in detail with reference to the foregoing embodiments, those skilled in the art will understand that The technical solutions described in the foregoing embodiments may be modified, or some or all of the technical features may be equivalently replaced; and the modifications or substitutions do not deviate from the technical solutions of the embodiments of the present invention. range.

Claims

A parallel multi-thread processing method, comprising:

Obtaining a first token amount that each thread needs to extract from the token bucket request, where the thread is a thread that is received by the token bucket at a current time;

Determining an amount of usable tokens of the token bucket at the current moment;

Comparing the usable token amount with the first token amount extracted by each of the thread requests, and determining whether the usable token amount is greater than or equal to the first token amount;

If yes, the token of the first token amount is extracted from the token bucket and allocated to the thread.
The method according to claim 1, wherein the determining the amount of usable tokens of the token bucket at the current moment comprises:

Comparing the accumulated token amount of the token bucket with the token consumption amount of the current time to obtain the usable token amount of the token bucket at the current moment, the token consumption amount a token consumption amount of the token bucket for all the threads from an initial time to a current duration of the current time, the accumulated token amount being received by the token bucket within the first duration The result of adding the token amount to the initial value of the token bucket.
The method according to claim 1 or 2, wherein before the acquiring the first token amount that each thread needs to extract from the token bucket, the method further includes:

A counter is set for the thread, and the counter is configured to record the number of tokens in the token bucket consumed by the thread in the first duration.
The method according to any one of claims 1-3, wherein after the taking out the token of the first token amount from the token bucket, the method further comprises:

The first amount of tokens is increased in the token consumption recorded by the counter.
The method according to any one of claims 1 to 4, wherein the acquiring each thread requires a first token amount to be extracted from the token bucket, or acquiring each thread Before requesting the first token amount to be extracted from the token bucket respectively, the method further includes:

Adding an increased token amount to be issued to the token bucket and adding the first token to the usable token amount to obtain a first sum;

Determining whether the first sum is greater than or equal to the token bucket depth;

If greater than, the difference between the token bucket depth and the usable token amount is increased. a token bucket;

If less than, the amount of the added token is increased in the token bucket.
A parallel multi-thread processing device, comprising:

An acquiring module, configured to acquire a first token quantity that each thread needs to extract from the token bucket request, where the thread is a thread that is received by the token bucket at a current time;

a determining module, configured to determine an amount of usable tokens of the token bucket at the current moment;

a comparison module, configured to compare the usable token amount with the first token amount extracted by each of the thread requests, and determine whether the usable token amount is greater than or equal to the first order Amount of card

And an allocating module, configured to: after the comparing module determines to be, extract the token of the first token amount from the token bucket, and allocate the token to the thread.
The device according to claim 6, wherein the comparing module is configured to compare the accumulated token amount of the token bucket with the token consumption of the current moment to obtain the token. The amount of the usable token of the bucket at the current moment, the token consumption being a token consumption amount of the token bucket within a first duration of all the threads from an initial moment to the current moment The cumulative token amount is a result of adding the amount of the increased token received by the token bucket within the first duration to the initial value of the token bucket.
The device according to claim 6 or 7, further comprising: a recording module;

The recording module is configured to record the number of tokens in the token bucket consumed by the thread in the first duration.
The apparatus according to any one of claims 6-8, wherein the recording module is further configured to increase the first token amount in the token consumption amount recorded by the counter.
The device according to any one of claims 6-9, wherein the determining module is further configured to: compare an amount of increased tokens to be issued to the token bucket with the amount of usable tokens Adding, obtaining a first sum; determining whether the first sum is greater than or equal to the token bucket depth; if greater than, increasing a difference between the token bucket depth and the usable token amount The token bucket; if less than, adds the increased token amount in the token bucket.