CN106933673A - Adjust the method and device of component logic number of threads - Google Patents

Adjust the method and device of component logic number of threads Download PDF

Info

Publication number
CN106933673A
CN106933673A CN201511021180.2A CN201511021180A CN106933673A CN 106933673 A CN106933673 A CN 106933673A CN 201511021180 A CN201511021180 A CN 201511021180A CN 106933673 A CN106933673 A CN 106933673A
Authority
CN
China
Prior art keywords
logic thread
logic
component
thread
increase
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN201511021180.2A
Other languages
Chinese (zh)
Other versions
CN106933673B (en
Inventor
方孝健
刘键
王逸
伍翀
封仲淹
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Alibaba Group Holding Ltd
Original Assignee
Alibaba Group Holding Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Alibaba Group Holding Ltd filed Critical Alibaba Group Holding Ltd
Priority to CN201511021180.2A priority Critical patent/CN106933673B/en
Priority to PCT/CN2016/110251 priority patent/WO2017114180A1/en
Priority to JP2018534546A priority patent/JP2019500700A/en
Priority to EP16880970.5A priority patent/EP3399413B1/en
Publication of CN106933673A publication Critical patent/CN106933673A/en
Priority to US16/024,539 priority patent/US10783005B2/en
Application granted granted Critical
Publication of CN106933673B publication Critical patent/CN106933673B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F9/00Arrangements for program control, e.g. control units
    • G06F9/06Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
    • G06F9/46Multiprogramming arrangements
    • G06F9/50Allocation of resources, e.g. of the central processing unit [CPU]
    • G06F9/5005Allocation of resources, e.g. of the central processing unit [CPU] to service a request
    • G06F9/5027Allocation of resources, e.g. of the central processing unit [CPU] to service a request the resource being a machine, e.g. CPUs, Servers, Terminals
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F9/00Arrangements for program control, e.g. control units
    • G06F9/06Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
    • G06F9/46Multiprogramming arrangements
    • G06F9/50Allocation of resources, e.g. of the central processing unit [CPU]
    • G06F9/5005Allocation of resources, e.g. of the central processing unit [CPU] to service a request
    • G06F9/5027Allocation of resources, e.g. of the central processing unit [CPU] to service a request the resource being a machine, e.g. CPUs, Servers, Terminals
    • G06F9/505Allocation of resources, e.g. of the central processing unit [CPU] to service a request the resource being a machine, e.g. CPUs, Servers, Terminals considering the load
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F9/00Arrangements for program control, e.g. control units
    • G06F9/06Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
    • G06F9/46Multiprogramming arrangements
    • G06F9/50Allocation of resources, e.g. of the central processing unit [CPU]
    • G06F9/5083Techniques for rebalancing the load in a distributed system
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F2209/00Indexing scheme relating to G06F9/00
    • G06F2209/50Indexing scheme relating to G06F9/50
    • G06F2209/5018Thread allocation
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F2209/00Indexing scheme relating to G06F9/00
    • G06F2209/50Indexing scheme relating to G06F9/50
    • G06F2209/503Resource availability

Landscapes

  • Engineering & Computer Science (AREA)
  • Software Systems (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Data Exchanges In Wide-Area Networks (AREA)
  • Debugging And Monitoring (AREA)

Abstract

The embodiment of the present application discloses a kind of method and device for adjusting component logic number of threads, and methods described includes:Obtain multiple logic threads that a component can be called;The utilization rate of queue is processed according to each logic thread corresponding data, the load condition of each logic thread is determined, the load condition includes normal load state and abnormal load conditions;According to the load condition of the component logic thread, judge whether the component needs to adjust logic thread quantity;If desired, adjusting the quantity of the component logic thread according to judged result;Using method and device disclosed in the present application, on the premise of can in real time being calculated data are ensured, the utilization rate of resource is improved.

Description

Adjust the method and device of component logic number of threads
Technical field
The application is related to the field of internet, more particularly to a kind of method and device for adjusting component logic number of threads.
Background technology
In distributed real time computation system, it will usually which a computer cluster is set, can be realized using the computer cluster The real-time calculating of data.In the cluster, a main equipment and multiple slave units, main equipment memory storage can be typically set There is real-time calculation procedure, when there are data to process (i.e. when distributed real time computation system incoming external data), master sets Real-time calculation procedure in standby will call the resource in slave unit, and data are calculated.
In actual applications, real-time calculation procedure is made up of multiple components, and each component performs specific task;And from Equipment can provide multiple logic thread resources and be called for main equipment.Therefore, usual main equipment is in advance in real-time calculation procedure The fixed logic thread resource of each component distribution, and when there is data to process, each group in real-time calculation procedure Part will call pre-assigned logic thread resource, perform task, the calculating of complete paired data.
Because in real time computation system, the data volume of outer input data is not fixed, and is that each component is distributed Logic thread resource is fixed, then, when the data volume of outer input data is larger, the task amount of each component compared with Greatly, and if the logic thread resource now distributed by a component in advance is less, then can cause the component performs effect Rate is low, influences the real-time calculating of data;Similarly, if the data volume of outer input data is smaller, and it is in advance one group The logic thread resource that part is distributed is more, then can cause the waste of resource.Therefore, in the prior art, one is needed badly The method and device of adjustment component logic number of threads is planted, on the premise of being calculated in real time in guarantee data, raising resource Utilization rate.
Application content
A kind of method and device for adjusting component logic number of threads is provided in the embodiment of the present application, to ensure data reality When calculate on the premise of, improve resource utilization rate.
In order to solve the above-mentioned technical problem, the embodiment of the present application discloses following technical scheme:
On the one hand, this application discloses a kind of method for adjusting component logic number of threads, including:
Obtain multiple logic threads that a component can be called;
The utilization rate of queue is processed according to each logic thread corresponding data, the load condition of each logic thread, institute is determined Stating load condition includes normal load state and abnormal load conditions;
According to the load condition of the component logic thread, judge whether the component needs to adjust logic thread quantity;
If desired, adjusting the quantity of the component logic thread according to judged result.
Optionally, the quantity that the component logic thread is adjusted according to judged result, including:
The logic thread quantity of the component is adjusted to:The component current logic number of threads * dispensing devices hair per second Data volume/component data volume for receiving data per second of data is sent, the dispensing device is to send data to the component Device.
Optionally, the abnormal load conditions include high load condition and low-load state, the utilization rate=message queue The predistribution memory space of space/message queue that middle data storage takes;It is described according to each logic thread corresponding data at The utilization rate of queue is managed, the load condition of each logic thread is determined, including:
Judge that a logic thread corresponding data processes the utilization rate of queue, if more than the first predetermined threshold value;
If greater than the first predetermined threshold value, determine that the logic thread is high load condition;
If no more than the first predetermined threshold value, judge that current logic thread corresponding data processes the utilization rate of queue, if small In the second predetermined threshold value;
If less than the second predetermined threshold value, determine that the logic thread is low-load state.
Optionally, according to the load condition of all logic threads in the component, judge whether the component needs to adjust logic Number of threads, including:
In counting all logic threads that the component can be called respectively, the quantity of high load condition logic thread and low negative Carry the quantity of state logic thread;
High capacity probability calculation formula and low-load probability calculation formula are utilized respectively, the high capacity probability of the component is calculated With low-load probability, all energy of quantity/current component of the high capacity probability calculation formula=high load condition logic thread The quantity of enough calling logic threads, the quantity/current group of the low-load probability calculation formula=low-load state logic thread The all quantity for being capable of calling logic thread of part;
Judge at least one of high capacity probability and low-load probability of the component, if more than the described 3rd default threshold Value;
If at least one of the high capacity probability and low-load probability, more than the 3rd predetermined threshold value, institute is determined Stating component need to adjust logic thread quantity.
Optionally, the logic thread is run in operation process, and methods described also includes:
The quantity of logic thread and the quantity of current logic thread need to be adjusted according to the component, determines that the component needs to increase Logic thread need to delete logic thread;
If logic thread need to be increased, judge that logic line can be increased in the operation process that current logic thread is associated Journey;
If it can, in the associated operation process, increasing logic thread;
If it could not, determining that the quantity of operation process need to be increased;
If logic thread need to be deleted, in the operation process, corresponding logic thread is deleted.
Optionally, judge that logic thread can be increased in the operation process that current logic thread is associated, including:
Determine the associated multiple operation processes of current logic thread;
According to default increase formula, determine that each operation process can increase the quantity of logic thread, the increase formula For:Operation process can increase the quantity=(predistribution total resources/operation process operation logic of operation process of logic thread The preset values -1 of resource * the 4th shared by thread) * current operation process operation logic threads quantity;
Count all associated operation processes, by increasing capacitance it is possible to increase the total quantity of logic thread;
Whether the total quantity that judgement can increase logic thread is more than or equal to the quantity that the component need to increase logic thread;
If can increase the total quantity of logic thread need to increase the quantity of logic thread more than or equal to the component, it is determined that In operations associated process, by increasing capacitance it is possible to increase logic thread.
Optionally, the determination need to increase the quantity of operation process, including:
Operations associated process is obtained in default load threshold, is capable of the quantity Q of operation logic thread;
Using process computing formula is operated, calculating need to increase the quantity of operation process, and the operation process computing formula is: Increase quantity=(the N-T)/Q+1 of operation process, the N is the quantity that the component need to increase logic thread, the T The quantity of logic thread can be increased for operations associated process, described T, N and Q are positive integer.
Optionally, methods described also includes:
Every Preset Time, determine that the first logic thread that the upstream component of a component can call and downstream components can be adjusted Second logic thread;
Set up the 3rd logic thread and the first logic thread that current component can be called, and the 3rd logic thread and second The communication connection of logic thread.
Optionally, methods described also includes:
Judge successively in each associated operation process of current component, if there is logic thread;
If it does not, deleting the operation process.
On the other hand, the application is also disclosed a kind of device for adjusting component logic number of threads, including:
Acquisition module, for obtaining multiple logic threads that a component can be called;
First determining module, the utilization rate for processing queue according to each logic thread corresponding data, determines each logic The load condition of thread, the load condition includes normal load state and abnormal load conditions;
First judge module, for the load condition according to the component logic thread, judges whether the component needs adjustment Logic thread quantity;
Adjusting module, for when adjustment logic thread quantity is needed, the component logic thread being adjusted according to judged result Quantity.
Optionally, the adjusting module includes:
Adjustment unit, for the logic thread quantity of the component to be adjusted to:The component current logic number of threads * Dispensing device data volume/component the data volume for receiving data per second for sending data per second, the dispensing device is transmission Data to the component device.
Optionally, the abnormal load conditions include high load condition and low-load state, the utilization rate=message queue The predistribution memory space of space/message queue that middle data storage takes;The determining module, including:
First judging unit, for judging that a logic thread corresponding data processes the utilization rate of queue, if pre- more than first If threshold value;
High load condition determining unit, for when the utilization rate is more than the first predetermined threshold value, determining the logic thread It is high load condition;
Second judging unit, for when the utilization rate is less than or equal to the first predetermined threshold value, judging current logic thread pair Answer the utilization rate of data handling queues, if less than the second predetermined threshold value;
Low-load status determining unit, for being less than the second predetermined threshold value when the utilization rate, determines that the logic thread is Low-load state.
Optionally, the judge module includes:
First statistic unit, for counting all logic threads that the component can be called respectively in, high load condition is patrolled Collect the quantity of thread and the quantity of low-load state logic thread;
First computing unit, for being utilized respectively high capacity probability calculation formula and low-load probability calculation formula, calculates institute State the high capacity probability and low-load probability of component, the number of the high capacity probability calculation formula=high load condition logic thread The all quantity for being capable of calling logic thread of amount/current component, the low-load probability calculation formula=low-load state logic The all quantity for being capable of calling logic thread of quantity/current component of thread;
3rd judging unit, at least one of high capacity probability and low-load probability for judging the component, if More than the 3rd predetermined threshold value;
First determining unit, for when at least one of the high capacity probability and low-load probability, more than the described 3rd During predetermined threshold value, determine that the component need to adjust logic thread quantity.
Optionally, described device also includes:
Second determining module, for the quantity of logic thread and the quantity of current logic thread need to be adjusted according to the component, Determine that the component need to increase logic thread or need to delete logic thread;
Second judge module, for the operation for when logic thread need to be increased, judging be associated in current logic thread In process, increase logic thread;
Increase module, for when logic thread can be increased in the operation process that current logic thread is associated, in institute State in associated operation process, increase logic thread;
3rd determining module, logic thread can not be increased for working as in the operation process that current logic thread is associated When, it is determined that the quantity of operation process need to be increased;
Removing module, for when that need to delete logic thread, in the operation process, deletes corresponding logic thread.
Optionally, the second judge module includes:
Second determining unit, the multiple operation processes associated for determining current logic thread;
3rd determining unit, for according to default increase formula, determining that each operation process can increase logic thread Quantity, the increase formula is:Operation process can increase quantity=(the predistribution total resources of operation process of logic thread The preset values -1 of resource * the 4th shared by/operation process operation logic thread) * current operations process institute operation logic thread Quantity;
Second statistic unit, for counting all associated operation processes, by increasing capacitance it is possible to increase the total quantity of logic thread;
4th judging unit, for judging whether the total quantity that can increase logic thread needs to increase more than or equal to the component The quantity of logic thread;
3rd determining unit, for logic line need to be increased more than or equal to the component when the total quantity that can increase logic thread The quantity of journey, it is determined that in operations associated process, by increasing capacitance it is possible to increase logic thread.
Optionally, the 3rd determining unit includes:
Subelement is obtained, for obtaining operations associated process in default load threshold, is capable of the number of operation logic thread Amount Q;
Computation subunit, for using process computing formula is operated, calculating the quantity for increasing operation process, it is described operate into Journey computing formula is:Increase quantity=(the N-T)/Q+1 of operation process, the N need to increase logic thread for the component Quantity, the T is that operations associated process can increase the quantity of logic thread, and described T, N and Q are just whole Number.
Optionally, described device also includes:
4th determining module, for every Preset Time, determining the first logic line that the upstream component of a component can be called The second logic thread that journey and downstream components can be called;
Module is set up, for setting up the 3rd logic thread and the first logic thread that current component can be called, and the 3rd The communication connection of logic thread and the second logic thread.
Optionally, described device also includes:
3rd judge module, in each operation process associated for judging current component successively, if there is logic line Journey;
Removing module, for when not existing logic thread in the operation process, deleting the operation process.
From above technical scheme, in the embodiment of the present application, team is processed according to each logic thread corresponding data first The utilization rate of row, determines the load condition of each logic thread, and the load condition includes normal load state and exception Load condition;Then, according to the load condition of component logic thread, determine whether component needs to adjust the quantity of logic thread; Finally, if it is desired, the quantity of the component logic thread is adjusted according to judged result;Due in the embodiment of the present application, Can be according to the load condition of logic thread, adjusting a component can call the quantity of logic thread, so as to can avoid the component can The quantity of calling logic thread is excessive, or very few, and then can improve logic line on the premise of generating date is ensured The utilization rate of Cheng Ziyuan.
Brief description of the drawings
In order to illustrate more clearly of the embodiment of the present application or technical scheme of the prior art, below will be to embodiment or existing The accompanying drawing to be used needed for technology description is briefly described, it should be apparent that, for those of ordinary skill in the art Speech, without having to pay creative labor, can also obtain other accompanying drawings according to these accompanying drawings.
Fig. 1 is a schematic flow sheet of the method for the adjustment component logic number of threads disclosed in the embodiment of the present application;
Fig. 2 is the schematic diagram of the data handling queues disclosed in the embodiment of the present application;
Fig. 3 is the schematic diagram of the logic thread disclosed in the embodiment of the present application;
Fig. 4 is a schematic flow sheet of the method for the adjustment component logic number of threads disclosed in the embodiment of the present application;
Fig. 5 is a schematic flow sheet of the method for the adjustment component logic number of threads disclosed in the embodiment of the present application;
Fig. 6 is a schematic flow sheet of the method for the adjustment component logic number of threads disclosed in the embodiment of the present application;
Fig. 7 is a schematic flow sheet of the method for the adjustment component logic number of threads disclosed in the embodiment of the present application;
Fig. 8 is a schematic flow sheet of the method for the adjustment component logic number of threads disclosed in the embodiment of the present application;
Fig. 9 is a module diagram of the device of the adjustment component logic number of threads disclosed in the embodiment of the present application.
Specific embodiment
Below in conjunction with the accompanying drawing in the embodiment of the present application, the technical scheme in the embodiment of the present application is carried out clear, complete Ground description, it is clear that described embodiment is only some embodiments of the present application, rather than whole embodiments.Base Embodiment in the application, it is all that those of ordinary skill in the art are obtained under the premise of creative work is not made Other embodiment, belongs to the scope of the application protection.
This application discloses a kind of method for adjusting component logic number of threads, as shown in figure 1, the method at least includes:
Step S11:Obtain multiple logic threads that a component can be called;
Step S12:The utilization rate of queue is processed according to each logic thread corresponding data, the negative of each logic thread is determined Load state, the load condition includes normal load state and abnormal load conditions;
In the embodiment of the present application, a data handling queues, the data handling queues are equipped with inside each logic thread For storing the data that respective logic thread need to be processed;In the embodiment of the present application, the data handling queues can specifically such as Shown in Fig. 2, and dash area represents the space that the treatment queue institute data storage has taken.
Space/message queue that data storage takes in the embodiment of the present application, the utilization rate=message queue of message queue Predistribution memory space, and according to the utilization rate of message queue, you can determine the load condition of counterlogic thread, i.e., just Normal load condition and abnormal load conditions;And abnormal load conditions may particularly include the too high high load condition of utilization rate and profit With the too low low-load state of rate;And in high load condition, logic thread is low it cannot be guaranteed that to the real-time processing of data Under load condition, it is the logic thread resource of component distribution that will waste.
Step S13:According to the load condition of the component logic thread, judge whether the component needs to adjust logic thread Quantity;If desired, performing step S14, otherwise, terminate flow;
In the embodiment of the present application, in can calling logic thread with specific reference to a component, normal load state or abnormal negative The logic thread of load state accounts for the ratio of all logic threads to determine whether the component needs to adjust logic thread quantity.Than Such as, during a component can call logic thread, the logic thread of normal load state accounts for 80% ratio, then can determine that this Component need not adjust logic thread quantity;And if the logic thread of abnormal load conditions accounts for 80% ratio, then it is determined that should Component need to adjust logic thread quantity.
Step S14:The quantity of the component logic thread is adjusted according to judged result;
In the embodiment of the present application, specifically the logic thread quantity of the component can be adjusted to:The component current logic The number of threads * dispensing devices data volume/component data volume for receiving data per second for sending data per second, the transmission Device is the device for sending data to the component.
In the embodiment of the present application, real-time calculation procedure, typically by Spout (message source) components and Blot (message Reason) component composition, and multiple component can iterative processing data, as shown in figure 3, such as one real-time calculation procedure is by a Spout Component and 2 Bolt components compositions, and 2 Blot components are respectively a Blot components and the 2nd Blot components. In the embodiment of the present application, Spout components can receive the data sent from message source, and call the logic line of default distribution After the completion of journey processing data, and treatment, Spout components send data to the as downstream components as upstream component One Blot components, similarly, after the completion of a Blot components are to data processing, will send data to work as upstream component It is the 2nd Blot components of downstream components.In the embodiment of the present application, if current component is Spout components, then institute It can be message source apparatus to state dispensing device, and if current component is Blot components, then dispensing device is the component Upstream component.
From above technical scheme, in the embodiment of the present application, team is processed according to each logic thread corresponding data first The utilization rate of row, determines the load condition of each logic thread, and the load condition includes normal load state and exception Load condition;Then, according to the load condition of component logic thread, determine whether component needs to adjust the quantity of logic thread; Finally, if it is desired, the quantity of the component logic thread is adjusted according to judged result;Due in the embodiment of the present application, Can be according to the load condition of logic thread, adjusting a component can call the quantity of logic thread, so as to can avoid the component can The quantity of calling logic thread is excessive, or very few, and then can improve logic line on the premise of generating date is ensured The utilization rate of Cheng Ziyuan.
In another possible embodiments of the application, as shown in figure 4, the step S12 in above-mentioned all embodiments, can wrap Include:
Step S41:Judge that a logic thread corresponding data processes the utilization rate of queue, if more than the first predetermined threshold value;Such as Fruit is more than, and performs step S42;Otherwise, step S43 is performed;
In the embodiment of the present application, user can be preferable one according to the size of the predetermined threshold value of self-demand sets itself first In embodiment, the first predetermined threshold value is 80%.
Step S42:Determine that the logic thread is high load condition;
In the embodiment of the present application, when a logic thread corresponding data processes the utilization rate of queue, more than the first predetermined threshold value When, illustrate that the logic thread there are more data pending, fail real-time processing data, determine that the logic thread is high capacity State;
Step S43:Judge that current logic thread corresponding data processes the utilization rate of queue, if less than the second predetermined threshold value, If it is lower, performing step S44;Otherwise, step S45 is performed;
In the embodiment of the present application, user also can according to the size of the predetermined threshold value of self-demand sets itself second, one compared with In good embodiment, the first predetermined threshold value is 20%.
Step S44:Determine that the logic thread is low-load state;
In the embodiment of the present application, the utilization rate that a logic thread corresponding data processes queue can be worked as, less than the second default threshold During value, illustrate that the logic thread is more idle, compared with waste of resource, determine that the logic thread is low-load state.
Step S45:Determine that the logic thread is normal load state;
In the embodiment of the present application, the utilization rate that a logic thread corresponding data processes queue can be worked as, more than or equal to second Predetermined threshold value, during less than or equal to the first predetermined threshold value, illustrate the logic thread can normal process data, that is, can guarantee that data Real-time processing, and non-waste of resource determines that the logic thread is normal load state.
Therefore, using the method in the embodiment of the present application, it may be determined that the load condition of a logic thread, and then can be true Determining component can call the load condition of all logic threads.
In another possible embodiments of the application, as shown in figure 5, the step S13 in above-mentioned all embodiments may include:
Step S51:In counting all logic threads that the component can be called respectively, the number of high load condition logic thread The quantity of amount and low-load state logic thread;
Step S52:High capacity probability calculation formula and low-load probability calculation formula are utilized respectively, the component is calculated High capacity probability and low-load probability, the quantity of the high capacity probability calculation formula=high load condition logic thread/current The all quantity for being capable of calling logic thread of component, the number of the low-load probability calculation formula=low-load state logic thread The all quantity for being capable of calling logic thread of amount/current component;
In the embodiment of the present application, in order to improve accuracy, can own in current component of collection every Preset Time The load condition of logic thread;After preset times are gathered, the quantity and low-load of high load condition logic thread are counted The quantity of state logic line thread, then calculates and utilizes following formula, calculates the high capacity probability of the component and low negative Probability is carried, the quantity/current component of high capacity probability calculation formula=high load condition logic thread is all being capable of calling logic The quantity * preset times of thread, the quantity/current component of the low-load probability calculation formula=low-load state logic thread All quantity * preset times for being capable of calling logic thread.
Step S53:Judge at least one of high capacity probability and low-load probability of the component, if more than described Three predetermined threshold values;If it does, performing step S54;Otherwise, step S55 is performed;
In the embodiment of the present application, user can be according to self-demand, the size of the predetermined threshold value of setting themselves the 3rd, at In preferred embodiment, it is 80% that the 3rd predetermined threshold value can be set.
In the embodiment of the present application, when the high capacity probability that can work as the component is more than three predetermined threshold values, step is performed S54;Also when the low-load probability that the component can be worked as is more than three predetermined threshold values, step S54 is performed;Also described group can be worked as When the high capacity probability and low-load probability of part are all higher than three predetermined threshold values, step S54 is performed.
Step S54:Determine that the component need to adjust logic thread quantity;
Step S55:Determine that the component need not adjust logic thread quantity.
Therefore, in the embodiment of the present application, it may be determined that whether a component needs to adjust logic thread quantity.
In another possible embodiments of the application, the logic thread in above-mentioned all embodiments runs on operation process It is interior, as shown in fig. 6, the method in above-mentioned all embodiments, may also include:
Step S61:The quantity of logic thread and the quantity of current logic thread need to be adjusted according to the component, described group is determined Part need to increase logic thread or need to delete logic thread;
In the embodiment of the present application, it is assumed that by the above method, calculating need to be adjusted to the quantity of a component logic thread 3, and the quantity of the component current logic thread is 5, then can determine that current component need to delete 2 logic threads.
Step S62:If logic thread need to be increased, judge to increase in the operation process that current logic thread is associated Plus logic thread;If it can, performing step S63;Otherwise, step S64 is performed;
In the embodiment of the present application, the associated operation process of current logic thread computer collection where current logic thread All operation processes in interior.
Step S63:In associated operation process, increase logic thread;
Step S64:It is determined that the quantity of operation process need to be increased;
Step S65:If logic thread need to be deleted, in the operation process, corresponding logic thread is deleted.
Due in the embodiment of the present application, the rank all same of all logic threads of a component, therefore, implement in the application In example, can be according to component current logic number of threads and the difference for adjusting logic thread quantity, it is determined that logic thread need to be deleted Quantity, then, any logic thread for deleting respective numbers in current component.
Upper visible, in the embodiment of the present application, can specifically increase the logic thread of current component or delete current component Logic thread.
In another possible embodiments of the application, as shown in fig. 7, the step S62 in above-mentioned all embodiments may include:
Step S71:Determine the associated multiple operation processes of current logic thread;
In the embodiment of the present application, preceding to have addressed, associated multiple operation processes are component place computer cluster Interior all operation processes.
Step S72:According to default increase formula, determine that each operation process can increase the quantity of logic thread, institute Stating increase formula is:Operation process can increase the quantity of logic thread=(predistribution total resources of operation process/operate into The preset values -1 of resource * the 4th shared by journey operation logic thread) * current operations process institute operation logic thread quantity;
In the embodiment of the present application, it is in advance the cpu resource of operation course allocation that the predistribution total resources of operation process can be Or memory space, and it can be shared by operation process operation logic thread to operate the resource shared by process operation logic thread Cpu resource or memory space;
In the embodiment of the present application, user can be according to self-demand, the size of the predetermined threshold value of setting themselves the 3rd, at In preferred embodiment, it is 80% that the 3rd predetermined threshold value can be set.
Step S73:Count all associated operation processes, by increasing capacitance it is possible to increase the total quantity of logic thread;
In the embodiment of the present application, it is assumed that there are 3 operation processes in computer cluster where current component, respectively the One operation process, the second operation process and the 3rd operation process, and the method provided by above-mentioned steps S72, really Fixed first operation process can increase logic thread 2, and the second operation process can increase logic thread 3, the 3rd operate into Journey can increase logic thread 3, then whole computer cluster can increased logic thread total quantity be 8=2+3+3.
Step S74:Whether the total quantity that judgement can increase logic thread need to increase logic thread more than or equal to the component Quantity, if it is, performing step S75;Otherwise, step S76 is performed;
Step S75:It is determined that in associated operation process, by increasing capacitance it is possible to increase logic thread;
Step S76:It is determined that in associated operation process, it is impossible to enough increase logic thread.
Therefore, in the embodiment of the present application, it may be determined that in the operation process that current component is associated, if increase Current component needs increased logic thread.
In the another possible embodiments of the application, as shown in figure 8, the step S64 in above-mentioned all embodiments, it may include:
Step S81:Operations associated process is obtained in default load threshold, is capable of the quantity Q of operation logic thread;
In the embodiment of the present application, the default load threshold can be specially the 80% of operation process load limit.
Step S82:Using process computing formula is operated, calculating need to increase the quantity of operation process, and the operation process is calculated Formula is:Increase quantity=(the N-T)/Q+1 of operation process, the N is the quantity that the component need to increase logic thread, The T is the quantity that operations associated process can increase logic thread, and described T, N and Q are positive integer.
Therefore, using the above method, it may be determined that the quantity of operation process need to be increased.
In the another possible embodiments of the application, when first assembly and the second component transmit data, above-mentioned all implementations Method in example may also include:
Every Preset Time, determine that the first logic thread that the upstream component of a component can call and downstream components can be adjusted Second logic thread;
Set up the 3rd logic thread and the first logic thread that current component can be called, and the 3rd logic thread and second The communication connection of logic thread.
Preceding to have discussed, a component may include upstream component and downstream components, and use the method in the embodiment of the present application, often The quantity of the logic thread that individual component can be called is change, using method disclosed in the present application, it may be determined that upstream and downstream group The normal data transfer of logic thread between part.
In the another possible embodiments of the application, the method in above-mentioned all embodiments may also include:
Judge successively in each associated operation process of current component, if there is logic thread;
If it does not, deleting the operation process.
In the embodiment of the present application, when the operation for deleting logic thread is performed, may result in and do not deposited in certain operation process In logic thread, now the operation process does not perform any task, and uses method disclosed in the present application, can be timely Discharge the resource shared by the operation process.
The description of the embodiment of the method more than, it is apparent to those skilled in the art that the application can Realized by the mode of software plus required general hardware platform, naturally it is also possible to by hardware, but in many cases before Person is more preferably implementation method.Based on such understanding, the technical scheme of the application is substantially done to prior art in other words The part for going out contribution can be embodied in the form of software product, and the computer software product is stored in a storage medium In, including some instructions are used to so that a computer equipment (can be personal computer, server, or network sets It is standby etc.) perform all or part of step of each embodiment methods described of the application.And foregoing storage medium includes:Only Reading memory (ROM), random access memory (RAM), magnetic disc or CD etc. are various can be with Jie of store program codes Matter.
Embodiment of the method with the adjustment component logic number of threads that the application is provided is corresponding, present invention also provides one kind The device of component logic number of threads is adjusted, as shown in figure 9, described device includes:
Acquisition module 91, for obtaining multiple logic threads that a component can be called;
First determining module 92, the utilization rate for processing queue according to each logic thread corresponding data, determines that each is patrolled The load condition of thread is collected, the load condition includes normal load state and abnormal load conditions;
First judge module 93, for the load condition according to the component logic thread, judges whether the component needs to adjust Whole logic thread quantity;
Adjusting module 94, for when adjustment logic thread quantity is needed, the component logic line being adjusted according to judged result The quantity of journey.
In the embodiment of the present application, the function of adjusting module 94 can specifically by adjustment unit realize, the adjustment unit, For the logic thread quantity of the component to be adjusted to:The component current logic number of threads * dispensing devices transmission per second The data volume of data/component data volume for receiving data per second, the dispensing device is to send data to the component Device.
From above technical scheme, in the embodiment of the present application, team is processed according to each logic thread corresponding data first The utilization rate of row, determines the load condition of each logic thread, and the load condition includes normal load state and exception Load condition;Then, according to the load condition of component logic thread, determine whether component needs to adjust the quantity of logic thread; Finally, if it is desired, the quantity of the component logic thread is adjusted according to judged result;Due in the embodiment of the present application, Can be according to the load condition of logic thread, adjusting a component can call the quantity of logic thread, so as to can avoid the component can The quantity of calling logic thread is excessive, or very few, and then can improve logic line on the premise of generating date is ensured The utilization rate of Cheng Ziyuan.
In another possible embodiments of the application, the abnormal load conditions in above-mentioned all embodiments include high load condition With low-load state, the predistribution storage of space/message queue that data storage takes is empty in the utilization rate=message queue Between;The determining module, including:
First judging unit, for judging that a logic thread corresponding data processes the utilization rate of queue, if pre- more than first If threshold value;
High load condition determining unit, for when the utilization rate is more than the first predetermined threshold value, determining the logic thread It is high load condition;
Second judging unit, for when the utilization rate is less than or equal to the first predetermined threshold value, judging current logic thread pair Answer the utilization rate of data handling queues, if less than the second predetermined threshold value;
Low-load status determining unit, for being less than the second predetermined threshold value when the utilization rate, determines that the logic thread is Low-load state.
Therefore, in the embodiment of the present application, it may be determined that the load condition of a logic thread.
In the another possible embodiments of the application, the judge module in above-mentioned all embodiments includes:
First statistic unit, for counting all logic threads that the component can be called respectively in, high load condition is patrolled Collect the quantity of thread and the quantity of low-load state logic thread;
First computing unit, for being utilized respectively high capacity probability calculation formula and low-load probability calculation formula, calculates institute State the high capacity probability and low-load probability of component, the number of the high capacity probability calculation formula=high load condition logic thread The all quantity for being capable of calling logic thread of amount/current component, the low-load probability calculation formula=low-load state logic The all quantity for being capable of calling logic thread of quantity/current component of thread;
3rd judging unit, at least one of high capacity probability and low-load probability for judging the component, if More than the 3rd predetermined threshold value;
First determining unit, for when at least one of the high capacity probability and low-load probability, more than the described 3rd During predetermined threshold value, determine that the component need to adjust logic thread quantity.
Therefore, in the embodiment of the present application, it may be determined that whether a component needs to adjust logic thread quantity.
In the another possible embodiments of the application, the device in above-mentioned all embodiments may also include:
Second determining module, for the quantity of logic thread and the quantity of current logic thread need to be adjusted according to the component, Determine that the component need to increase logic thread or need to delete logic thread;
Second judge module, for the operation for when logic thread need to be increased, judging be associated in current logic thread In process, increase logic thread;
Increase module, for when logic thread can be increased in the operation process that current logic thread is associated, in institute State in associated operation process, increase logic thread;
3rd determining module, logic thread can not be increased for working as in the operation process that current logic thread is associated When, it is determined that the quantity of operation process need to be increased;
Removing module, for when that need to delete logic thread, in the operation process, deletes corresponding logic thread.
Therefore, in the embodiment of the present application, by increasing capacitance it is possible to increase or delete logic thread.
In another possible embodiments of the application, the second judge module in above-mentioned all embodiments includes:
Second determining unit, the multiple operation processes associated for determining current logic thread;
3rd determining unit, for according to default increase formula, determining that each operation process can increase logic thread Quantity, the increase formula is:Operation process can increase quantity=(the predistribution total resources of operation process of logic thread The preset values -1 of resource * the 4th shared by/operation process operation logic thread) * current operations process institute operation logic thread Quantity;
Second statistic unit, for counting all associated operation processes, by increasing capacitance it is possible to increase the total quantity of logic thread;
4th judging unit, for judging whether the total quantity that can increase logic thread needs to increase more than or equal to the component The quantity of logic thread;
3rd determining unit, for logic line need to be increased more than or equal to the component when the total quantity that can increase logic thread The quantity of journey, it is determined that in operations associated process, by increasing capacitance it is possible to increase logic thread.
Therefore, in the embodiment of the present application, it may be determined that in operations associated process, logic thread can be increased.
In another possible embodiments of the application, the 3rd determining unit in above-mentioned all embodiments includes:
Subelement is obtained, for obtaining operations associated process in default load threshold, is capable of the number of operation logic thread Amount Q;
Computation subunit unit, for using process computing formula is operated, calculating the quantity for increasing operation process, Increase quantity=(the N-T)/Q+1 of operation process, the N is the quantity that the component need to increase logic thread, the T The quantity of logic thread can be increased for operations associated process, described T, N and Q are positive integer.
Therefore, in the embodiment of the present application, it may be determined that the quantity of newly-increased operation process.
In another possible embodiments of the application, the device in above-mentioned all embodiments also includes:
4th determining module, for every Preset Time, determining the first logic line that the upstream component of a component can be called The second logic thread that journey and downstream components can be called;
Module is set up, for setting up the 3rd logic thread and the first logic thread that current component can be called, and the 3rd The communication connection of logic thread and the second logic thread.
Therefore, in the embodiment of the present application, it is ensured that the proper communication of upstream and downstream component.
In another possible embodiments of the application, the device in above-mentioned all embodiments also includes:
3rd judge module, in each operation process associated for judging current component successively, if there is logic line Journey;
Removing module, for when not existing logic thread in the operation process, deleting the operation process.
Therefore, in the embodiment of the present application, the operation process of sky can be deleted.
It should be noted that herein, the relational terms of such as " first " and " second " or the like be used merely to by One entity or operation make a distinction with another entity or operation, and not necessarily require or imply these entities or behaviour There is any this actual relation or order between work.And, term " including ", "comprising" or its is any Other variants are intended to including for nonexcludability so that process, method, article including a series of key elements or Equipment not only includes those key elements, but also other key elements including being not expressly set out, or also includes being this mistake Journey, method, article or the intrinsic key element of equipment.In the absence of more restrictions, by sentence " including It is individual ... " limit key element, it is not excluded that also exist in the process including the key element, method, article or equipment Other identical element.
The above is only the specific embodiment of the application, is made skilled artisans appreciate that or realizing this Shen Please.Various modifications to these embodiments will be apparent to one skilled in the art, defined herein General Principle can in other embodiments be realized in the case where spirit herein or scope is not departed from.Therefore, The application is not intended to be limited to the embodiments shown herein, and is to fit to and principles disclosed herein and novelty The consistent scope most wide of feature.

Claims (18)

1. it is a kind of adjust component logic number of threads method, it is characterised in that including:
Obtain multiple logic threads that a component can be called;
The utilization rate of queue is processed according to each logic thread corresponding data, the load condition of each logic thread, institute is determined Stating load condition includes normal load state and abnormal load conditions;
According to the load condition of the component logic thread, judge whether the component needs to adjust logic thread quantity;
If desired, adjusting the quantity of the component logic thread according to judged result.
2. method according to claim 1, it is characterised in that described that the component logic is adjusted according to judged result The quantity of thread, including:
The logic thread quantity of the component is adjusted to:The component current logic number of threads * dispensing devices transmission per second The data volume of data/component data volume for receiving data per second, the dispensing device is to send data to the component Device.
3. method according to claim 1 and 2, it is characterised in that the abnormal load conditions include high capacity shape State and low-load state, the predistribution storage of space/message queue that data storage takes in the utilization rate=message queue Space;The utilization rate that queue is processed according to each logic thread corresponding data, determines the load shape of each logic thread State, including:
Judge that a logic thread corresponding data processes the utilization rate of queue, if more than the first predetermined threshold value;
If greater than the first predetermined threshold value, determine that the logic thread is high load condition;
If no more than the first predetermined threshold value, judge that current logic thread corresponding data processes the utilization rate of queue, if small In the second predetermined threshold value;
If less than the second predetermined threshold value, determine that the logic thread is low-load state.
4. method according to claim 3, it is characterised in that according to the load of all logic threads in the component State, judges whether the component needs to adjust logic thread quantity, including:
In counting all logic threads that the component can be called respectively, the quantity of high load condition logic thread and low negative Carry the quantity of state logic thread;
High capacity probability calculation formula and low-load probability calculation formula are utilized respectively, the high capacity probability of the component is calculated With low-load probability, all energy of quantity/current component of the high capacity probability calculation formula=high load condition logic thread The quantity of enough calling logic threads, the quantity/current group of the low-load probability calculation formula=low-load state logic thread The all quantity for being capable of calling logic thread of part;
Judge at least one of high capacity probability and low-load probability of the component, if more than the described 3rd default threshold Value;
If at least one of the high capacity probability and low-load probability, more than the 3rd predetermined threshold value, institute is determined Stating component need to adjust logic thread quantity.
5. the method according to any one of claim 1,2,4, it is characterised in that the logic thread runs on behaviour Make in process, methods described also includes:
The quantity of logic thread and the quantity of current logic thread need to be adjusted according to the component, determines that the component needs to increase Logic thread need to delete logic thread;
If logic thread need to be increased, judge that logic line can be increased in the operation process that current logic thread is associated Journey;
If it can, in the associated operation process, increasing logic thread;
If it could not, determining that the quantity of operation process need to be increased;
If logic thread need to be deleted, in the operation process, corresponding logic thread is deleted.
6. method according to claim 5, it is characterised in that judge the behaviour that can be associated in current logic thread Make in process, increase logic thread, including:
Determine the associated multiple operation processes of current logic thread;
According to default increase formula, determine that each operation process can increase the quantity of logic thread, the increase formula For:Operation process can increase the quantity=(predistribution total resources/operation process operation logic of operation process of logic thread The preset values -1 of resource * the 4th shared by thread) * current operation process operation logic threads quantity;
Count all associated operation processes, by increasing capacitance it is possible to increase the total quantity of logic thread;
Whether the total quantity that judgement can increase logic thread is more than or equal to the quantity that the component need to increase logic thread;
If can increase the total quantity of logic thread need to increase the quantity of logic thread more than or equal to the component, it is determined that In operations associated process, by increasing capacitance it is possible to increase logic thread.
7. method according to claim 6, it is characterised in that the determination need to increase the quantity of operation process, bag Include:
Operations associated process is obtained in default load threshold, is capable of the quantity Q of operation logic thread;
Using process computing formula is operated, calculating need to increase the quantity of operation process, and the operation process computing formula is: Increase quantity=(the N-T)/Q+1 of operation process, the N is the quantity that the component need to increase logic thread, the T The quantity of logic thread can be increased for operations associated process, described T, N and Q are positive integer.
8. the method according to any one of claim 1,2,4,6,7, it is characterised in that methods described also includes:
Every Preset Time, determine that the first logic thread that the upstream component of a component can call and downstream components can be adjusted Second logic thread;
Set up the 3rd logic thread and the first logic thread that current component can be called, and the 3rd logic thread and second The communication connection of logic thread.
9. the method according to any one of claim 1,2,4,6,7, it is characterised in that methods described also includes:
Judge successively in each associated operation process of current component, if there is logic thread;
If it does not, deleting the operation process.
10. it is a kind of adjust component logic number of threads device, it is characterised in that including:
Acquisition module, for obtaining multiple logic threads that a component can be called;
First determining module, the utilization rate for processing queue according to each logic thread corresponding data, determines each logic The load condition of thread, the load condition includes normal load state and abnormal load conditions;
First judge module, for the load condition according to the component logic thread, judges whether the component needs adjustment Logic thread quantity;
Adjusting module, for when adjustment logic thread quantity is needed, the component logic thread being adjusted according to judged result Quantity.
11. methods according to claim 10, it is characterised in that the adjusting module includes:
Adjustment unit, for the logic thread quantity of the component to be adjusted to:The component current logic number of threads * Dispensing device data volume/component the data volume for receiving data per second for sending data per second, the dispensing device is transmission Data to the component device.
12. device according to claim 10 or 11, it is characterised in that the abnormal load conditions include high negative Load state and low-load state, the predistribution of space/message queue that data storage takes in the utilization rate=message queue Memory space;The determining module, including:
First judging unit, for judging that a logic thread corresponding data processes the utilization rate of queue, if pre- more than first If threshold value;
High load condition determining unit, for when the utilization rate is more than the first predetermined threshold value, determining that the logic thread is High load condition;
Second judging unit, for when the utilization rate is less than or equal to the first predetermined threshold value, judging current logic thread correspondence The utilization rate of data handling queues, if less than the second predetermined threshold value;
Low-load status determining unit, for being less than the second predetermined threshold value when the utilization rate, determines that the logic thread is Low-load state.
13. devices according to claim 12, it is characterised in that the judge module includes:
First statistic unit, for counting all logic threads that the component can be called respectively in, high load condition is patrolled Collect the quantity of thread and the quantity of low-load state logic thread;
First computing unit, for being utilized respectively high capacity probability calculation formula and low-load probability calculation formula, calculates institute State the high capacity probability and low-load probability of component, the number of the high capacity probability calculation formula=high load condition logic thread The all quantity for being capable of calling logic thread of amount/current component, the low-load probability calculation formula=low-load state logic The all quantity for being capable of calling logic thread of quantity/current component of thread;
3rd judging unit, at least one of high capacity probability and low-load probability for judging the component, if More than the 3rd predetermined threshold value;
First determining unit, for when at least one of the high capacity probability and low-load probability, more than the described 3rd During predetermined threshold value, determine that the component need to adjust logic thread quantity.
14. method according to any one of claim 10,11,13, it is characterised in that described device also includes:
Second determining module, for the quantity of logic thread and the quantity of current logic thread need to be adjusted according to the component, Determine that the component need to increase logic thread or need to delete logic thread;
Second judge module, for the operation for when logic thread need to be increased, judging be associated in current logic thread In process, increase logic thread;
Increase module, for when logic thread can be increased in the operation process that current logic thread is associated, in institute State in associated operation process, increase logic thread;
3rd determining module, for when can not current logic thread be associated operation process in increase logic thread when, It is determined that the quantity of operation process need to be increased;
Removing module, for when that need to delete logic thread, in the operation process, deletes corresponding logic thread.
15. devices according to claim 14, it is characterised in that the second judge module includes:
Second determining unit, the multiple operation processes associated for determining current logic thread;
3rd determining unit, for according to default increase formula, determining that each operation process can increase logic thread Quantity, the increase formula is:Operation process can increase quantity=(the predistribution total resources of operation process of logic thread The preset values -1 of resource * the 4th shared by/operation process operation logic thread) * current operations process institute operation logic thread Quantity;
Second statistic unit, for counting all associated operation processes, by increasing capacitance it is possible to increase the total quantity of logic thread;
4th judging unit, for judging whether the total quantity that can increase logic thread needs to increase more than or equal to the component The quantity of logic thread;
3rd determining unit, for logic line need to be increased more than or equal to the component when the total quantity that can increase logic thread The quantity of journey, it is determined that in operations associated process, by increasing capacitance it is possible to increase logic thread.
16. devices according to claim 15, it is characterised in that the 3rd determining unit includes:
Subelement is obtained, for obtaining operations associated process in default load threshold, is capable of the number of operation logic thread Amount Q;
Computation subunit, for using process computing formula is operated, calculating the quantity for increasing operation process, it is described operate into Journey computing formula is:Increase quantity=(the N-T)/Q+1 of operation process, the N need to increase logic thread for the component Quantity, the T is that operations associated process can increase the quantity of logic thread, and described T, N and Q are just whole Number.
17. device according to any one of claim 10,11,13,15,16, it is characterised in that described device Also include:
4th determining module, for every Preset Time, determining the first logic line that the upstream component of a component can be called The second logic thread that journey and downstream components can be called;
Module is set up, for setting up the 3rd logic thread and the first logic thread that current component can be called, and the 3rd The communication connection of logic thread and the second logic thread.
18. device according to any one of claim 10,11,13,15,16, it is characterised in that described device Also include:
3rd judge module, in each operation process associated for judging current component successively, if there is logic line Journey;
Removing module, for when not existing logic thread in the operation process, deleting the operation process.
CN201511021180.2A 2015-12-30 2015-12-30 Method and device for adjusting number of logical threads of component Active CN106933673B (en)

Priority Applications (5)

Application Number Priority Date Filing Date Title
CN201511021180.2A CN106933673B (en) 2015-12-30 2015-12-30 Method and device for adjusting number of logical threads of component
PCT/CN2016/110251 WO2017114180A1 (en) 2015-12-30 2016-12-16 Component logical threads quantity adjustment method and device
JP2018534546A JP2019500700A (en) 2015-12-30 2016-12-16 Method and device for adjusting component logical thread amount
EP16880970.5A EP3399413B1 (en) 2015-12-30 2016-12-16 Component logical threads quantity adjustment method and device
US16/024,539 US10783005B2 (en) 2015-12-30 2018-06-29 Component logical threads quantity adjustment method and device

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201511021180.2A CN106933673B (en) 2015-12-30 2015-12-30 Method and device for adjusting number of logical threads of component

Publications (2)

Publication Number Publication Date
CN106933673A true CN106933673A (en) 2017-07-07
CN106933673B CN106933673B (en) 2020-11-27

Family

ID=59225931

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201511021180.2A Active CN106933673B (en) 2015-12-30 2015-12-30 Method and device for adjusting number of logical threads of component

Country Status (5)

Country Link
US (1) US10783005B2 (en)
EP (1) EP3399413B1 (en)
JP (1) JP2019500700A (en)
CN (1) CN106933673B (en)
WO (1) WO2017114180A1 (en)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN108897876A (en) * 2018-06-29 2018-11-27 中科鼎富(北京)科技发展有限公司 A kind of data cut-in method and device
CN113138772A (en) * 2020-01-19 2021-07-20 北京京东振世信息技术有限公司 Method and device for constructing data processing platform, electronic equipment and storage medium

Families Citing this family (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US11467877B2 (en) 2020-01-31 2022-10-11 Salesforce, Inc. Throttling and limiting thread resources of service computing platform
KR102307641B1 (en) * 2021-04-30 2021-10-01 나무기술 주식회사 Parallel processing control system for cloud operation data analysis

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101256515A (en) * 2008-03-11 2008-09-03 浙江大学 Method for implementing load equalization of multicore processor operating system
US20110219246A1 (en) * 2010-03-04 2011-09-08 Hiroki Arai Information processing unit including smt-enabled cpu and its power consumption reduction method
CN102591721A (en) * 2011-12-30 2012-07-18 北京新媒传信科技有限公司 Method and system for distributing thread execution task
US20140143789A1 (en) * 2009-08-25 2014-05-22 Netapp, Inc. Adjustment of threads for execution based on over-utilization of a domain in a multi-processor system

Family Cites Families (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7237242B2 (en) * 2002-12-31 2007-06-26 International Business Machines Corporation Dynamic thread pool tuning techniques
US7162571B2 (en) * 2003-12-09 2007-01-09 Emc Corporation Methods and apparatus for parsing a content address to facilitate selection of a physical storage location in a data storage system
US7681196B2 (en) * 2004-11-18 2010-03-16 Oracle International Corporation Providing optimal number of threads to applications performing multi-tasking using threads
CA2620337C (en) * 2008-02-04 2012-11-27 Omnivex Corporation Digital signage network
JP5843459B2 (en) * 2011-03-30 2016-01-13 インターナショナル・ビジネス・マシーンズ・コーポレーションInternational Business Machines Corporation Information processing system, information processing apparatus, scaling method, program, and recording medium
CN102866922B (en) * 2012-08-31 2014-10-22 河海大学 Load balancing method used in massive data multithread parallel processing
CN103677997B (en) * 2012-09-21 2017-04-12 宏达国际电子股份有限公司 Multi-core device and multi-thread scheduling method thereof
WO2015069222A1 (en) * 2013-11-05 2015-05-14 Hewlett Packard Development Company, L.P. Forum inspection based on correlation rating of response poster
WO2015071008A1 (en) * 2013-11-14 2015-05-21 Alcatel Lucent Distributed computing unit, system and respective method
JP6237318B2 (en) * 2014-02-19 2017-11-29 富士通株式会社 Management device, workload distribution management method, and workload distribution management program
US9722945B2 (en) * 2014-03-31 2017-08-01 Microsoft Technology Licensing, Llc Dynamically identifying target capacity when scaling cloud resources

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101256515A (en) * 2008-03-11 2008-09-03 浙江大学 Method for implementing load equalization of multicore processor operating system
US20140143789A1 (en) * 2009-08-25 2014-05-22 Netapp, Inc. Adjustment of threads for execution based on over-utilization of a domain in a multi-processor system
US20110219246A1 (en) * 2010-03-04 2011-09-08 Hiroki Arai Information processing unit including smt-enabled cpu and its power consumption reduction method
CN102591721A (en) * 2011-12-30 2012-07-18 北京新媒传信科技有限公司 Method and system for distributing thread execution task

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN108897876A (en) * 2018-06-29 2018-11-27 中科鼎富(北京)科技发展有限公司 A kind of data cut-in method and device
CN113138772A (en) * 2020-01-19 2021-07-20 北京京东振世信息技术有限公司 Method and device for constructing data processing platform, electronic equipment and storage medium
CN113138772B (en) * 2020-01-19 2023-12-05 北京京东振世信息技术有限公司 Construction method and device of data processing platform, electronic equipment and storage medium

Also Published As

Publication number Publication date
WO2017114180A1 (en) 2017-07-06
JP2019500700A (en) 2019-01-10
EP3399413B1 (en) 2021-05-05
US20180307536A1 (en) 2018-10-25
US10783005B2 (en) 2020-09-22
EP3399413A1 (en) 2018-11-07
EP3399413A4 (en) 2019-08-07
CN106933673B (en) 2020-11-27

Similar Documents

Publication Publication Date Title
CN106933673A (en) Adjust the method and device of component logic number of threads
CN101350869B (en) Method and apparatus for removing repeat of telecom charging based on index and hash
EP3852420A1 (en) Method and device for determining load threshold
CN109981744B (en) Data distribution method and device, storage medium and electronic equipment
CN109542512A (en) A kind of data processing method, device and storage medium
CN107317864A (en) The data balancing method and device of a kind of storage device
CN113010576A (en) Method, device, equipment and storage medium for capacity evaluation of cloud computing system
CN109800204A (en) Data distributing method and Related product
CN106899643A (en) A kind of user journal storage method and equipment
CN107426055A (en) Abnormal flow monitoring method, device and computer-readable recording medium
CN107682316B (en) Method for generating dynamic password sending strategy and method for sending dynamic password
CN107196949A (en) The system for limiting same user account registration terminal quantity
CN105404554B (en) Method and apparatus for Storm stream calculation frame
CN101707789A (en) Method and system for controlling flow
CN112887407A (en) Job flow control method and device for distributed cluster
CN109697117A (en) Terminal control method, device and computer readable storage medium
CN105608050B (en) Date storage method and system
CN107102799A (en) A kind of method and its intelligent terminal for adjusting the screen time of going out
CN107770296A (en) Method and device for allocating addresses
CN114827033B (en) Data flow control method, device, equipment and computer readable storage medium
CN106997310A (en) The apparatus and method of load balancing
CN102821423A (en) Method and device for receiving messages
CN109144666A (en) A kind of method for processing resource and system across cloud platform
CN103391580A (en) User state transition method and system based on business volume
CN112685169B (en) Load control method, device, server and readable storage medium

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant