CN107105015A - The shunt method and device of a kind of data flow - Google Patents

The shunt method and device of a kind of data flow Download PDF

Info

Publication number
CN107105015A
CN107105015A CN201710208790.6A CN201710208790A CN107105015A CN 107105015 A CN107105015 A CN 107105015A CN 201710208790 A CN201710208790 A CN 201710208790A CN 107105015 A CN107105015 A CN 107105015A
Authority
CN
China
Prior art keywords
processing system
pressure parameter
end processing
data flow
currency
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN201710208790.6A
Other languages
Chinese (zh)
Other versions
CN107105015B (en
Inventor
吴成成
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Beijing QIYI Century Science and Technology Co Ltd
Original Assignee
Beijing QIYI Century Science and Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Beijing QIYI Century Science and Technology Co Ltd filed Critical Beijing QIYI Century Science and Technology Co Ltd
Priority to CN201710208790.6A priority Critical patent/CN107105015B/en
Publication of CN107105015A publication Critical patent/CN107105015A/en
Application granted granted Critical
Publication of CN107105015B publication Critical patent/CN107105015B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00Network arrangements or protocols for supporting network services or applications
    • H04L67/01Protocols
    • H04L67/10Protocols in which an application is distributed across nodes in the network
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L43/00Arrangements for monitoring or testing data switching networks
    • H04L43/16Threshold monitoring
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00Network arrangements or protocols for supporting network services or applications
    • H04L67/50Network services
    • H04L67/60Scheduling or organising the servicing of application requests, e.g. requests for application data transmissions using the analysis and optimisation of the required network resources

Abstract

The embodiments of the invention provide a kind of shunt method of data flow and device, applied to server, methods described includes step:Obtain the currency of the pressure parameter of back-end processing system;Judge to whether there is goal pressure parameter in the pressure parameter, wherein, the goal pressure parameter is:Currency is not less than the pressure parameter of predetermined threshold value;If, it would be desirable to send to the data flow of the back-end processing system and carry out shunting processing.Using scheme provided in an embodiment of the present invention, prevent flow is excessive from causing processing system to be overloaded, it is ensured that back-end processing system stability.

Description

The shunt method and device of a kind of data flow
Technical field
The present invention relates to server current limiting technique field, the shunt method and device of more particularly to a kind of data flow.
Background technology
Task processing system can include front-end processing system and back-end processing system, and front-end processing system can be agency Server, for receiving the request of user and request being distributed into back-end processing system.Proxy server can receive substantial amounts of User is asked, and the data of substantial amounts of user request composition, which flow through proxy server and are sent to back-end processing system, to be handled.
In the prior art, all data flows for being sent to proxy server, back-end processing system can be transmitted in time, at certain One moment, the request that may produce user explodes, and disposal ability is limited for back-end processing system, big in data flow The request of amount can not obtain processing in time and cause request stacking;Rear end may be exceeded by receiving simultaneously and handling these data flows The ability to bear of reason system, causes processing system to overload, and serious meeting causes processing system to collapse, therefore, and prior art can not Ensure the stability of processing system.
The content of the invention
The purpose of the embodiment of the present invention is the shunt method and device for providing a kind of data flow, draws to prevent fluid stopping amount is excessive Play processing system overload, it is ensured that back-end processing system stability.Concrete technical scheme is as follows:
A kind of shunt method of data flow, applied to server, methods described includes step:
The currency of the pressure parameter of back-end processing system is obtained, wherein, the pressure parameter is the reaction rear end Reason system handles the parameter of task ability;
Judge to whether there is goal pressure parameter in the pressure parameter, wherein, the goal pressure parameter is:Currency Not less than the pressure parameter of predetermined threshold value;
If, it would be desirable to send to the data flow of the back-end processing system and carry out shunting processing.
Optionally, it is described to need to send to the data flow of the back-end processing system to carry out shunting processing, including:
According to the currency of each goal pressure parameter and the corresponding predetermined threshold value of each goal pressure parameter, it would be desirable to send out The data flow for delivering to the back-end processing system carries out shunting processing.
Optionally, the currency and the corresponding default threshold of each goal pressure parameter according to each goal pressure parameter Value, it would be desirable to send to the data flow of the back-end processing system and carry out shunting processing, including:
According to the currency of each goal pressure parameter and the corresponding predetermined threshold value of each goal pressure parameter, it is determined that needing Send to the shunt ratio of the data flow of the back-end processing system;
According to the shunt ratio, it would be desirable to send to the data flow of the back-end processing system and carry out shunting processing.
Optionally, the currency and the corresponding default threshold of each goal pressure parameter according to each goal pressure parameter Value, it is determined that need to send to the shunt ratio of the data flow of the back-end processing system, including:
Calculate the ratio of the predetermined threshold value of each goal pressure parameter and the currency of the goal pressure parameter;
The minimum value in the ratio is obtained, and any one value not less than the minimum value is defined as shunt ratio.
Optionally, methods described also includes:
Transmission data flow of target accounting into the data flow of the back-end processing system will be needed to send to default response Machine is handled, wherein, the target accounting is:Shunt ratio described in 1-.
Optionally, the pressure parameter includes:The response time of the back-end processing system, the back-end processing system Ask in instantaneous number of concurrent, the memory usage of the back-end processing system, the cpu load value of the back-end processing system extremely Few one kind.
A kind of part flow arrangement of data flow, applied to server, described device includes:
Acquisition module, the currency of the pressure parameter for obtaining back-end processing system, wherein, the pressure parameter is anti- The back-end processing system is answered to handle the parameter of task ability;
Judge module, for judging to whether there is goal pressure parameter in the pressure parameter, wherein, the goal pressure Parameter is:Currency is not less than the pressure parameter of predetermined threshold value;
Diverter module, in the judged result of the judge module in the case of being, it would be desirable to send to after described The data flow of processing system is held to carry out shunting processing.
Optionally, the diverter module, specifically for:
According to the currency of each goal pressure parameter and the corresponding predetermined threshold value of each goal pressure parameter, it would be desirable to send out The data flow for delivering to the back-end processing system carries out shunting processing.
Optionally, the diverter module, including:
Determination sub-module, it is corresponding pre- for the currency according to each goal pressure parameter and each goal pressure parameter If threshold value, it is determined that needing to send to the shunt ratio of the data flow of the back-end processing system;
Submodule is shunted, for according to the shunt ratio, it would be desirable to send to the data flow of the back-end processing system Carry out shunting processing.
Optionally, the determination sub-module, including:
Computing unit, for calculating the predetermined threshold value of each goal pressure parameter and the currency of the goal pressure parameter Ratio;
Determining unit, for obtaining the minimum value in the ratio, and any one is true not less than the value of the minimum value It is set to shunt ratio.
Optionally, described device also includes:
Sending submodule, for the data flow of transmission target accounting into the data flow of the back-end processing system will to be needed Send to default answering machine and handled, wherein, the target accounting is:Shunt ratio described in 1-.
Optionally, the pressure parameter includes:The response time of the back-end processing system, the back-end processing system Ask in instantaneous number of concurrent, the memory usage of the back-end processing system, the cpu load value of the back-end processing system extremely Few one kind.
The shunt method and device of data flow provided in an embodiment of the present invention, the back-end processing that server is obtained by judgement When there is goal pressure parameter in the pressure parameter of system, to needing to be sent at the progress shunting of the data flow of back-end processing system Reason, it is to avoid data flow is directly sent to back-end processing system by server in the prior art, is likely to result in beyond rear end The ability to bear of reason system and the problem of produce overload.Processing system is caused to be overloaded it is therefore prevented that flow is excessive, after ensure that Hold processing system stability.
Brief description of the drawings
In order to illustrate more clearly about the embodiment of the present invention or technical scheme of the prior art, below will be to embodiment or existing There is the accompanying drawing used required in technology description to be briefly described, it should be apparent that, drawings in the following description are only this Some embodiments of invention, for those of ordinary skill in the art, on the premise of not paying creative work, can be with Other accompanying drawings are obtained according to these accompanying drawings.
Fig. 1 is a kind of schematic flow sheet of the shunt method of data flow provided in an embodiment of the present invention;
Fig. 2 is a kind of structural representation of the part flow arrangement of data flow provided in an embodiment of the present invention.
Embodiment
Below in conjunction with the accompanying drawing in the embodiment of the present invention, the technical scheme in the embodiment of the present invention is carried out clear, complete Site preparation is described, it is clear that described embodiment is only a part of embodiment of the invention, rather than whole embodiments.It is based on Embodiment in the present invention, it is every other that those of ordinary skill in the art are obtained under the premise of creative work is not made Embodiment, belongs to the scope of protection of the invention.
To solve prior art problem, the embodiments of the invention provide a kind of shunt method of data flow and device, below It is described in detail respectively.
It should be noted that a kind of executive agent of the shunt method of data flow provided in an embodiment of the present invention can be clothes Business device, specifically, can also be proxy server.
Fig. 1 is a kind of schematic flow sheet of the shunt method of data flow provided in an embodiment of the present invention, applied to server, Methods described includes step:
S101, obtains the currency of the pressure parameter of back-end processing system, wherein, after the pressure parameter is reacts described Processing system is held to handle the parameter of task ability.
It is understood that server can obtain the currency of the pressure parameter of back-end processing system, specifically, can be with It is that back-end processing system is transmitted directly to server;Can also be that server actively stores pressure parameter from back-end processing system The position of currency is directly obtained;Another equipment, the equipment can also be set between back-end processing system and server To be obtained from back-end processing system after pressure parameter currency, server is transmitted to, back-end processing system achieved above What the mode of pressure parameter currency was merely exemplary, do not constitute the specific restriction to the embodiment of the present invention.
It should be noted that pressure parameter is the parameter that task ability is handled for reacting back-end processing system, server Obtain the currency of pressure parameter, you can know that back-end processing system handles the situation of task at present.Specifically, pressure parameter can Think response time, the instantaneous number of concurrent of request, the back-end processing of the back-end processing system of the back-end processing system At least one of the memory usage of system, cpu load value of the back-end processing system.
It is understood that the cpu load value and the memory usage of back-end processing system of back-end processing system, are reactions The running status of back-end processing system itself, in the case that back-end processing system overloads, cpu load value and memory usage meeting Very big, exemplary, cpu load value can be expressed as a percentage, at a time, the cpu load value of back-end processing system Currency is that the currency of the memory usage of 75%, back-end processing system is 60%.The response time energy of back-end processing system Enough reaction back-end processing system from request is received to time for handling it of request, the request of back-end processing system is instantaneous simultaneously Hair number represents the quantity of at a time all requests;Exemplary, the response time of a certain moment back-end processing system works as Preceding value is 8ms, and the currency of the instantaneous number of concurrent of request of back-end processing system is 1210.Specifically, back-end processing system may be used also With comprising other pressure parameter, as long as the ability that back-end system handles task can be reacted, the embodiment of the present invention is herein not It is specifically limited.
In the embodiment of the present invention, by rear end can processing system response time, ask instantaneous number of concurrent, memory usage, At least one of cpu load value, can be from the self-operating of back-end processing system as the pressure parameter of back-end processing system State or the responding ability to task, accurately reflect the ability of the currently processed task of back-end system.
S102, judges to whether there is goal pressure parameter in the pressure parameter, wherein, the goal pressure parameter is: Currency is not less than the pressure parameter of predetermined threshold value;If it is, performing S103.
It is understood that according to the currency of the pressure parameter of back-end processing system, judging whether deposited in pressure parameter In goal pressure parameter.Specifically, a predetermined threshold value, e.g., back-end processing system can be set to each class pressure parameter in advance The predetermined threshold value of the response time of system be 11ms, the predetermined threshold value of the instantaneous number of concurrent of request of back-end processing system be 1200, after The predetermined threshold value for holding the memory usage of processing system is that the predetermined threshold value of the cpu load value of 70%, back-end processing system is 60%.Exemplary, the currency of the response time of back-end processing system is 8ms, the request of back-end processing system is instantaneously concurrent Several currencys is that the currency of the memory usage of 1210, back-end processing system is the cpu load of 60%, back-end processing system The currency of value is 75%;Because the predetermined threshold value 11ms of response time is more than currency 8ms, the predetermined threshold value of memory usage 70% is more than currency 60%, so the response time of back-end processing system and memory usage are not goal pressure parameters;By In, ask the currency 1210 of instantaneous number of concurrent to be more than predetermined threshold value 1200, and the currency 75% of cpu load value is more than in advance If threshold value 60%, so there is goal pressure parameter in pressure parameter, i.e. the instantaneous number of concurrent of request of back-end processing system and Cpu load value is goal pressure parameter.What currency and preset value were merely exemplary, do not constitute the limit to the embodiment of the present invention It is fixed.
In another implementation, it can unify to set a predetermined threshold value.It is exemplary, set the predetermined threshold value to be 800, the predetermined threshold value of the response time of back-end processing system is 800 μ s, the instantaneous number of concurrent of request of back-end processing system it is pre- If the predetermined threshold value that threshold value is the memory usage of 800, back-end processing system is the cpu load value of 800 ‰, back-end processing system Predetermined threshold value be 800 ‰.Exemplary, the currency of the response time of back-end processing system is 900 μ s, back-end processing system The currency of the instantaneous number of concurrent of request be that the currency of memory usage of 600, back-end processing system is 650 ‰, rear end The currency of the cpu load value of reason system is 750 ‰;Because, the instantaneous number of concurrent of request of back-end processing system, back-end processing system The predetermined threshold value of the memory usage of system and the cpu load value of back-end processing system is all higher than currency, so not being target Pressure parameter;The currency of the response time of back-end processing system is the 800 μ s that 900 μ s are more than predetermined threshold value, so rear end The response time of reason system is goal pressure parameter.
S103, it would be desirable to send to the data flow of the back-end processing system and carry out shunting processing.
It should be noted that when there is goal pressure parameter, can show that the ability of the processing task of server declines Or server process task is excessive, so needing to send to the data flow progress shunting processing of back-end processing system by original. Such as, a part of data flow can be sent to back-end processing system, another part data flow is sent to other task processing systems System.
Using the embodiment described in Fig. 1 of the present invention, server passes through the pressure parameter for the back-end processing system for judging to obtain When there is goal pressure parameter, shunting processing is carried out to the data flow for needing to be sent to back-end processing system, it is to avoid existing Data flow is directly sent to back-end processing system by server in technology, is likely to result in and is born energy beyond back-end processing system Power and the problem of produce overload.Cause processing system to be overloaded it is therefore prevented that flow is excessive, ensure that back-end processing system is stable Property.
In the embodiment shown in Fig. 1 of the present invention, directly to needing to send to the data flow of back-end processing system in S103 Shunting processing is carried out, an accurate shunting scheme is not provided, it is more likely that back-end processing system is sent to after shunting Disposal ability of the data flow still above back-end processing system;If the very few of distribution gives back-end processing system, can cause again after Hold the resource utilization of processing system relatively low.In order to solve the above technical problems, the embodiments of the invention provide following technical side Case.
In the embodiment of the present invention, it would be desirable to send to the data flow of back-end processing system and carry out shunting processing, can use Implementation be:, will according to the currency of each goal pressure parameter and the corresponding predetermined threshold value of each goal pressure parameter Need to send to the data flow of the back-end processing system and carry out shunting processing.
In one implementation, it can delimit and send extremely according to the currency of goal pressure parameter and the difference of predetermined threshold value The value of the data flow of back-end processing system, except sending to the data flow of back-end processing system, the data flows of other parts can be with Send to default processing system.Exemplary, as shown in table 1, difference 1 to difference 4 represents corresponding pressure parameter respectively Currently and preset value difference, send to the value of the data flow of back-end processing system represent to send in the case of corresponding difference to The size of the data flow of back-end processing system.Specifically, transmission to the value of the data flow of back-end processing system can be according to experiment Or it is empirically determined, what the numerical value of the embodiment of the present invention was merely exemplary, the specific restriction to the embodiment of the present invention is not constituted.
It should be noted that when target component is a pressure parameter, according to the currency of goal pressure parameter and in advance If the difference of threshold value, the value of corresponding data flow is directly selected to send to back-end processing system from table 1.Exemplary, When goal pressure parameter is the response time, when the currency of response time and the difference of predetermined threshold value are 150 μ s, after being sent to The data stream size for holding processing system is 10M.When goal pressure parameter is more than one pressure parameter, it can be joined according to pressure Several currencys and the difference of predetermined threshold value do not select to need to send to the value of the data flow of back-end processing system, then from selection Data flow value in determine minimum value, as send to back-end processing system data flow value.Exemplary, when Goal pressure parameter to ask when instantaneous number of concurrent and cpu load value, ask instantaneous number of concurrent currency and predetermined threshold value it Difference is 120, corresponding to send to the value 5M of the data flow of back-end processing system;The currency and predetermined threshold value of cpu load value it Difference be 12%, send to back-end processing system data flow value 7M because 7M be more than 5M, by 5M data flow send to Back-end processing system.Provided in an embodiment of the present invention send to the size of the data flow of back-end processing system is merely exemplary , the restriction to the embodiment of the present invention is not constituted.
Table 1
, can be according to the currency and each goal pressure parameter of each goal pressure parameter in another implementation Corresponding predetermined threshold value, it is determined that needing to send to the shunt ratio of the data flow of the back-end processing system;According to the shunting Ratio, it would be desirable to send to the data flow of the back-end processing system and carry out shunting processing.
Specifically, according to the currency of each goal pressure parameter and the corresponding predetermined threshold value of each goal pressure parameter, It is determined that needs transmission to the implementation of the shunt ratio of the data flow of the back-end processing system can be:Calculate each target The predetermined threshold value of pressure parameter and the ratio of the currency of the goal pressure parameter;The minimum value in the ratio is obtained, and will Any one is defined as shunt ratio not less than the value of the minimum value.Exemplary, when goal pressure parameter is instantaneous simultaneously for request Send out number and cpu load value, and the currency of the instantaneous number of concurrent of request is 1200 and predetermined threshold value is the current of 900, cpu load value It is worth for 75% and predetermined threshold value 60%.Due to 900/1200=0.75,60%/75%=0.8, the minimum value in ratio is 0.75, any one value between 0-0.75 can be set to shunt ratio, exemplary, and the shunt ratio of setting is 0.7。
, can be according to the current of the goal pressure parameter of back-end system using technical scheme provided in an embodiment of the present invention Value, obtains the value accurately sent to the shunt ratio of back-end processing system or the data flow for sending back-end processing system, from And the stability of back-end processing system can be further ensured that.
, can be according to the currency and the ratio of corresponding predetermined threshold value of goal pressure parameter in another implementation Value, it would be desirable to send to the data flow of back-end processing system and carry out shunting processing.Exemplary, when ratio is more than 1.5, by two / mono- data flow is sent to back-end processing system, and 1/2nd data flow is sent to other processing systems in addition.This Outside, the ratio of different phase can also be set, the currency of goal pressure parameter and the ratio of corresponding predetermined threshold value are such as set (do not include 1 in 1-1.4, during comprising between 1.4), 2/3rds data flow is sent to back-end processing system, in addition three points One of data flow be sent to other processing systems;In the currency and the ratio of corresponding predetermined threshold value of goal pressure parameter (do not include 1.4 in 1.4-1.6, during comprising between 1.6), 1/2nd data flow is sent to back-end processing system, in addition / 2nd data flow is sent to other processing systems;In the currency and corresponding predetermined threshold value of goal pressure parameter Ratio 1.6-2.0 (do not include 1.6, during comprising between 2.0), 1/3rd data flow sent to back-end processing system, Other 2/3rds data flow is sent to other processing systems, etc..
It is understood that in order to ensure the shunting processing to back-end processing system, playing after maximized mitigation The purpose of task processing system task treating capacity is held, when goal pressure parameter is more than one pressure parameter, mesh can be chosen The corresponding shunting mode of maximum in the currency of pressure parameter and the ratio of corresponding predetermined threshold value is marked to be shunted.It is exemplary , when goal pressure parameter is response time and cpu load value, when the currency of response time and the ratio of predetermined threshold value are 1.2, when the currency of cpu load value and the ratio of predetermined threshold value are 1.8, choose the current of goal pressure parameter cpu load value Value and predetermined threshold value ratio 1.8, its corresponding ratio range be 1.6-2.0 between, so by 1/3rd data flow send out Back-end processing system is delivered to, 2/3rds data flow is sent to other processing systems in addition.Sent in the embodiment of the present invention Value to the data flow of back-end processing system is merely exemplary.
In embodiments of the present invention, it can also use:It will need to send the mesh into the data flow of the back-end processing system The data flow of mark accounting, which is sent to default answering machine, to be handled, wherein, the target accounting is:Shunt ratio described in 1-.Tool Body, default answering machine can be advertisement blank machine.For example, can be used for when user watches video, the meeting in playing process It is automatic to send the request broken for commercialsy.When the substantial amounts of request that breaks for commercialsy is sent to server, beyond server process scope When, directly accounting is sent to advertisement blank machine for the data flow of (1- shunt ratios) part, directly made by advertisement blank machine The response of advertisement.Exemplary, when shunt ratio is 1/3, then target accounting is (1-1/3)=2/3, so being by accounting 2/3 data flow is sent to advertisement blank machine, realizes automatic-answering back device.This component requests can quickly obtain ad result, client End can persistently be played out.
Therefore, it is possible to avoid in the process range beyond back-end processing system, other requests not yet handled in time according to So waiting in line the processing of back-end processing system, the slack experience of video-see can be caused for user terminal.Therefore, should With the embodiment of the present invention, while ensure that the stability of back-end processing system, additionally it is possible to ensure user terminal viewing video It is smooth.
Fig. 2 is a kind of structural representation of the part flow arrangement of data flow provided in an embodiment of the present invention, applied to server, Described device includes:Obtain module 201, judge module 202, diverter module 203;Wherein,
Acquisition module 201, the currency of the pressure parameter for obtaining back-end processing system, wherein, the pressure parameter To react the parameter that the back-end processing system handles task ability;
Judge module 202, for judging to whether there is goal pressure parameter in the pressure parameter, wherein, the target Pressure parameter is:Currency is not less than the pressure parameter of predetermined threshold value;
Diverter module 203, in the case of being in the judged result of the judge module, it would be desirable to send to described The data flow of back-end processing system carries out shunting processing.
Specifically, the diverter module 203, can be used for:
According to the currency of each goal pressure parameter and the corresponding predetermined threshold value of each goal pressure parameter, it would be desirable to send out The data flow for delivering to the back-end processing system carries out shunting processing.
Specifically, the diverter module 203, can include:Determination sub-module and shunting submodule;Wherein,
Determination sub-module, it is corresponding pre- for the currency according to each goal pressure parameter and each goal pressure parameter If threshold value, it is determined that needing to send to the shunt ratio of the data flow of the back-end processing system;
Submodule is shunted, for according to the shunt ratio, it would be desirable to send to the data flow of the back-end processing system Carry out shunting processing.
Specifically, the determination sub-module, can include:Computing unit and determining unit;Wherein,
Computing unit, for calculating the predetermined threshold value of each goal pressure parameter and the currency of the goal pressure parameter Ratio;
Determining unit, for obtaining the minimum value in the ratio, and any one is true not less than the value of the minimum value It is set to shunt ratio.
Specifically, described device can also include:
Sending submodule, for the data flow of transmission target accounting into the data flow of the back-end processing system will to be needed Send to default answering machine and handled, wherein, the target accounting is:Shunt ratio described in 1-.
Specifically, the pressure parameter includes:The response time of the back-end processing system, the back-end processing system Ask in instantaneous number of concurrent, the memory usage of the back-end processing system, the cpu load value of the back-end processing system extremely Few one kind.
Using the embodiment shown in Fig. 2 of the present invention, server passes through the pressure parameter for the back-end processing system for judging to obtain When there is goal pressure parameter, shunting processing is carried out to the data flow for needing to be sent to back-end processing system, it is to avoid existing Data flow is directly sent to back-end processing system by server in technology, is likely to result in and is born energy beyond back-end processing system Power and the problem of produce overload.Cause processing system to be overloaded it is therefore prevented that flow is excessive, ensure that back-end processing system is stable Property.
It should be noted that herein, such as first and second or the like relational terms are used merely to a reality Body or operation make a distinction with another entity or operation, and not necessarily require or imply these entities or deposited between operating In any this actual relation or order.Moreover, term " comprising ", "comprising" or its any other variant are intended to Nonexcludability is included, so that process, method, article or equipment including a series of key elements not only will including those Element, but also other key elements including being not expressly set out, or also include being this process, method, article or equipment Intrinsic key element.In the absence of more restrictions, the key element limited by sentence "including a ...", it is not excluded that Also there is other identical element in process, method, article or equipment including the key element.
Each embodiment in this specification is described by the way of related, identical similar portion between each embodiment Divide mutually referring to what each embodiment was stressed is the difference with other embodiment.It is real especially for system Apply for example, because it is substantially similar to embodiment of the method, so description is fairly simple, related part is referring to embodiment of the method Part explanation.
The foregoing is merely illustrative of the preferred embodiments of the present invention, is not intended to limit the scope of the present invention.It is all Any modification, equivalent substitution and improvements made within the spirit and principles in the present invention etc., are all contained in protection scope of the present invention It is interior.

Claims (12)

1. a kind of shunt method of data flow, it is characterised in that applied to server, methods described includes step:
The currency of the pressure parameter of back-end processing system is obtained, wherein, the pressure parameter is the reaction back-end processing system The parameter of system processing task ability;
Judge to whether there is goal pressure parameter in the pressure parameter, wherein, the goal pressure parameter is:Currency is not small In the pressure parameter of predetermined threshold value;
If, it would be desirable to send to the data flow of the back-end processing system and carry out shunting processing.
2. according to the method described in claim 1, it is characterised in that described to need to send to the number of the back-end processing system Shunting processing is carried out according to stream, including:
According to the currency of each goal pressure parameter and the corresponding predetermined threshold value of each goal pressure parameter, it would be desirable to send extremely The data flow of the back-end processing system carries out shunting processing.
3. method according to claim 2, it is characterised in that the currency according to each goal pressure parameter and every The corresponding predetermined threshold value of one goal pressure parameter, it would be desirable to send to the data flow of the back-end processing system and carry out at shunting Reason, including:
According to the currency of each goal pressure parameter and the corresponding predetermined threshold value of each goal pressure parameter, it is determined that needing to send To the shunt ratio of the data flow of the back-end processing system;
According to the shunt ratio, it would be desirable to send to the data flow of the back-end processing system and carry out shunting processing.
4. method according to claim 3, it is characterised in that the currency according to each goal pressure parameter and every The corresponding predetermined threshold value of one goal pressure parameter, it is determined that needing to send to the split ratio of the data flow of the back-end processing system Example, including:
Calculate the ratio of the predetermined threshold value of each goal pressure parameter and the currency of the goal pressure parameter;
The minimum value in the ratio is obtained, and any one value not less than the minimum value is defined as shunt ratio.
5. method according to claim 3, it is characterised in that methods described also includes:
Transmission data flow of target accounting into the data flow of the back-end processing system will be needed to send to default answering machine Row processing, wherein, the target accounting is:Shunt ratio described in 1-.
6. the method according to claim any one of 1-5, it is characterised in that the pressure parameter includes:The rear end The response time of reason system, the instantaneous number of concurrent of request of the back-end processing system, the EMS memory occupation of the back-end processing system At least one of rate, cpu load value of the back-end processing system.
7. a kind of part flow arrangement of data flow, it is characterised in that applied to server, described device includes:
Acquisition module, the currency of the pressure parameter for obtaining back-end processing system, wherein, the pressure parameter is reaction institute State the parameter that back-end processing system handles task ability;
Judge module, for judging to whether there is goal pressure parameter in the pressure parameter, wherein, the goal pressure parameter For:Currency is not less than the pressure parameter of predetermined threshold value;
Diverter module, in the case of being in the judged result of the judge module, it would be desirable to send to the rear end The data flow of reason system carries out shunting processing.
8. device according to claim 7, it is characterised in that the diverter module, specifically for:
According to the currency of each goal pressure parameter and the corresponding predetermined threshold value of each goal pressure parameter, it would be desirable to send extremely The data flow of the back-end processing system carries out shunting processing.
9. device according to claim 8, it is characterised in that the diverter module, including:
Determination sub-module, for the currency according to each goal pressure parameter and the corresponding default threshold of each goal pressure parameter Value, it is determined that needing to send to the shunt ratio of the data flow of the back-end processing system;
Submodule is shunted, for according to the shunt ratio, it would be desirable to send to the data flow of the back-end processing system and carry out Shunting is handled.
10. device according to claim 9, it is characterised in that the determination sub-module, including:
Computing unit, the ratio for calculating the predetermined threshold value of each goal pressure parameter and the currency of the goal pressure parameter Value;
Determining unit, is defined as obtaining the minimum value in the ratio, and by any one value not less than the minimum value Shunt ratio.
11. device according to claim 9, it is characterised in that described device also includes:
Sending submodule, for the data flow for sending the target accounting into the data flow of the back-end processing system will to be needed to send Handled to default answering machine, wherein, the target accounting is:Shunt ratio described in 1-.
12. the device according to claim any one of 7-11, it is characterised in that the pressure parameter includes:The rear end The response time of processing system, the instantaneous number of concurrent of request of the back-end processing system, the internal memory of the back-end processing system are accounted for With at least one of rate, the cpu load value of the back-end processing system.
CN201710208790.6A 2017-03-31 2017-03-31 Data stream shunting method and device Active CN107105015B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201710208790.6A CN107105015B (en) 2017-03-31 2017-03-31 Data stream shunting method and device

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201710208790.6A CN107105015B (en) 2017-03-31 2017-03-31 Data stream shunting method and device

Publications (2)

Publication Number Publication Date
CN107105015A true CN107105015A (en) 2017-08-29
CN107105015B CN107105015B (en) 2020-11-27

Family

ID=59676051

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201710208790.6A Active CN107105015B (en) 2017-03-31 2017-03-31 Data stream shunting method and device

Country Status (1)

Country Link
CN (1) CN107105015B (en)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN108173938A (en) * 2017-12-28 2018-06-15 泰康保险集团股份有限公司 Server load shunt method and device
WO2021258696A1 (en) * 2020-06-24 2021-12-30 珠海格力电器股份有限公司 Communication data processing method and apparatus, computer device and storage medium

Citations (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101124598A (en) * 2004-07-30 2008-02-13 奥弗图尔服务公司 Platform for advertising data integration and aggregation
CN101217491A (en) * 2008-01-04 2008-07-09 杭州华三通信技术有限公司 A method of rectification processing unit load allocation method and device
CN101340388A (en) * 2008-08-13 2009-01-07 华为技术有限公司 Method, apparatus and system for network flow control
CN101867580A (en) * 2010-06-03 2010-10-20 北京蓝汛通信技术有限责任公司 Method for allocating network flow and device
CN102497601A (en) * 2011-12-13 2012-06-13 曙光信息产业(北京)有限公司 Adaptive data splitting method
CN104038358A (en) * 2013-03-06 2014-09-10 中兴通讯股份有限公司 Content scheduling method and content scheduling device
CN104753805A (en) * 2013-12-31 2015-07-01 腾讯科技(深圳)有限公司 Distributed flow control method, server and system
CN105100904A (en) * 2014-05-09 2015-11-25 深圳市快播科技有限公司 Video advertisement blocking method, device and browser
CN105450716A (en) * 2014-09-25 2016-03-30 阿里巴巴集团控股有限公司 Dynamic business distribution method and dynamic business distribution system
CN105992272A (en) * 2015-01-27 2016-10-05 中国移动通信集团公司 Data transmitting and receiving method, device and data transmission system

Patent Citations (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101124598A (en) * 2004-07-30 2008-02-13 奥弗图尔服务公司 Platform for advertising data integration and aggregation
CN101217491A (en) * 2008-01-04 2008-07-09 杭州华三通信技术有限公司 A method of rectification processing unit load allocation method and device
CN101340388A (en) * 2008-08-13 2009-01-07 华为技术有限公司 Method, apparatus and system for network flow control
CN101867580A (en) * 2010-06-03 2010-10-20 北京蓝汛通信技术有限责任公司 Method for allocating network flow and device
CN102497601A (en) * 2011-12-13 2012-06-13 曙光信息产业(北京)有限公司 Adaptive data splitting method
CN104038358A (en) * 2013-03-06 2014-09-10 中兴通讯股份有限公司 Content scheduling method and content scheduling device
CN104753805A (en) * 2013-12-31 2015-07-01 腾讯科技(深圳)有限公司 Distributed flow control method, server and system
CN105100904A (en) * 2014-05-09 2015-11-25 深圳市快播科技有限公司 Video advertisement blocking method, device and browser
CN105450716A (en) * 2014-09-25 2016-03-30 阿里巴巴集团控股有限公司 Dynamic business distribution method and dynamic business distribution system
CN105992272A (en) * 2015-01-27 2016-10-05 中国移动通信集团公司 Data transmitting and receiving method, device and data transmission system

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN108173938A (en) * 2017-12-28 2018-06-15 泰康保险集团股份有限公司 Server load shunt method and device
CN108173938B (en) * 2017-12-28 2021-01-29 泰康保险集团股份有限公司 Server load distribution method and device
WO2021258696A1 (en) * 2020-06-24 2021-12-30 珠海格力电器股份有限公司 Communication data processing method and apparatus, computer device and storage medium

Also Published As

Publication number Publication date
CN107105015B (en) 2020-11-27

Similar Documents

Publication Publication Date Title
CN109936511B (en) Token obtaining method, device, server, terminal equipment and medium
CN106411774A (en) Method and device for controlling transaction data volume
CN104426694B (en) A kind of method and apparatus of adjustment resources of virtual machine
US20100235845A1 (en) Sub-task processor distribution scheduling
CN101610209A (en) A kind of Network method for stream processing and equipment of multi-core parallel concurrent
CN103294728B (en) A kind of data processing method and system
CN104092650A (en) Service distributing request method and device
CN108228363A (en) A kind of message method and device
CN110276184A (en) A kind of cloud computing resources authorization method and device
CN107105015A (en) The shunt method and device of a kind of data flow
CN107291544A (en) Method and device, the distributed task scheduling execution system of task scheduling
CN104901989A (en) Field service providing system and method
CN109361762A (en) A kind of document transmission method, apparatus and system
CN108495136A (en) A kind of method and system that direct broadcast service is provided
CN108681481A (en) The processing method and processing device of service request
CN105635124B (en) Flow control methods and device
CN104901902B (en) A kind of flow control methods and device
CN104301241B (en) A kind of SOA dynamic load distributing methods and system
CN106933671A (en) A kind of methods, devices and systems for carrying out flexible treatment
CN111385328B (en) Service request processing method, system and electronic equipment
CN108111567A (en) Realize the uniform method and system of server load
CN109347982A (en) A kind of dispatching method and device of data center
EP3975596A1 (en) Method, device and system for implementing edge computing
CN105429967B (en) Permission determines method and device
CN111343290A (en) Cloud platform system with load balancing function

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant