CN102360310B - Multitask process monitoring method in distributed system environment - Google Patents
Multitask process monitoring method in distributed system environment Download PDFInfo
- Publication number
- CN102360310B CN102360310B CN201110302232.9A CN201110302232A CN102360310B CN 102360310 B CN102360310 B CN 102360310B CN 201110302232 A CN201110302232 A CN 201110302232A CN 102360310 B CN102360310 B CN 102360310B
- Authority
- CN
- China
- Prior art keywords
- thread
- task
- message
- execution
- identification
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Landscapes
- Debugging And Monitoring (AREA)
Abstract
The invention discloses a multitask process monitoring method in the distributed system environment. The method comprises the following steps that: five states of the task execution process of each task execution terminal in the distributed system environment are monitored; an XML (eXtensible markup language) format description file is transported to a task collecting and processing server, the task execution conditions after filtration are written in a database and simultaneously task change information is sent to notify a task scheduling center; the task scheduling center directly submits the information to a task scheduling module after receiving the task change information and the task scheduling module adds the received information to information waiting queues; a scheduling control unit searches for a thread index table for threads of execution of the task and gives the threads of execution to the threads to be executed; and a thread control module monitors a plurality of threads in a work thread pool in real time in the system operation process. The invention also discloses a multitask process monitoring system. The system comprises a plurality of distributed task execution terminals, the task collecting and processing server and the task scheduling center.
Description
Technical field
The present invention relates to multitask process supervision method and multitask process surveillance under a kind of task process surveillance technology, particularly a kind of distributed system environment.
Background technology
Ripe and development along with modern computer and communication network technique, the building mode of contemporary information systems and architecture also change to more efficient distributed structure/architecture from the original mode that simply focuses on, this trend causes turning to the integrated of complication system function more from focusing on program design, and how each aspect business module is assembled, make its collaborative work.
The business process management system of processing based on distributed task scheduling is a kind of infosystem of Process-Oriented, and main mode Network Based realizes that information transmission, data are synchronous, the functions such as sustainable management optimization of flow monitoring and operation flow.The proposition of BPM has avoided workflow to be solidificated in the application program of customization, supports the transformation from program design to application assembling, supports in addition Process-Oriented, flow process to design again and organizes growth (organic growth).
Use at present operation procedure management system widely to have Staffware, MQSeries and COSA, case disposal system FLOWer, ERP system also provides the module of Work Process Management, and the workflow engine of SAP, Baan, PeopleSoft, Oracle and JD Edwards also can be regarded as integrated business process management system.Yet to the monitoring of workflow just as single module integration in system, flow monitoring under varying environment lacks unified standard, what have does not still possess flow monitoring ability, more it's a pity that most Workflow Management Systems are used multilingual and concept based on different examples (paradigms), the use-pattern of all kinds of Tool Rooms there are differences, and makes like this expansion of its corresponding function and ease for use be restricted.The present invention proposes a kind of flow monitoring system general outside business process management system that is based upon, make it depart from the restriction between each operation procedure management system, proposed a kind of multi-task scheduling strategy simultaneously, made its real-time monitoring problem to magnanimity flow of task under large-scale distributed task processing environment that a kind of effective solution is provided.
Summary of the invention
The object of the present invention is to provide multitask process supervision method and surveillance under a kind of distributed system environment, by the automatic collection to each task status of distributed terminal, through multithreading task scheduling strategy, computational resource is reasonably distributed, thereby realize the quick response that multitask process monitors.
The invention discloses a kind of multitask process supervision method under distributed system environment, comprise the following steps:
The first step, monitors five kinds of states of the tasks carrying process of each tasks carrying terminal under distributed system environment, and that described five kinds of states comprise is ready, wait for, hang up, create, disappear five kinds; According to tasks carrying state of a process, sequentially the tasks carrying situation of each tasks execution phases is correspondingly defined as to five classes: task preparation, task wait, tasks interrupt, tasks carrying, task finish; The tasks carrying situation that process supervision is got is preserved by the XML description document of format;
Second step, the XML description document of described format is transferred to task collects the check that gathers that processing server carries out data, filter out redundancy and abnormal data, tasks carrying situation write into Databasce by after filtering sends job change message informing task scheduling center simultaneously;
The 3rd step, task scheduling center is directly submitted to task scheduling modules by these message after receiving job change message, task scheduling modules adds Messages-Waiting queue by the message of receiving, scheduling controlling unit carries out real time scan to message waiting list and according to the principle of first in first out, responds after discovery message;
The 4th step, scheduling controlling cell response is after task change message, searching thread concordance list obtains the worker thread of this task and transfers to this thread execution, as inquired worker thread corresponding to this task in thread concordance list, according to task grade, do not add the distribution of Messages-Waiting queue wait thread in scheduling controlling unit to, and the task of distributing thread execution is sent to worker thread pond and carries out;
The 5th step, thread control module monitors the multithreading in worker thread pond in real time in system operational process, and thread pool thread quantity is carried out increasing and decreasing and making computational resource reach optimum load balance accordingly by capacity regulating unit according to current system load condition, long-time unenforced thread is deleted simultaneously, the thread of operation irregularity is reclaimed simultaneously.
In the present invention, scheduling controlling unit is carried out following steps and is realized task scheduling:
The task change message parse that step 1.1, basis receive goes out the task identification of this task, according to task identification traversal thread concordance list, obtains this task worker thread of correspondence with it, forwards step 1.5 to; If do not inquire the worker thread of this task, forward step 1.2 to;
Step 1.2, traversal thread concordance list, thus by each task identification in thread concordance list is longitudinally traveled through to the idle thread of obtaining unallocated task, forward step 1.5 to; If available free worker thread, does not forward step 1.3 to yet;
Step 1.3, this message is added to the Messages-Waiting queue in scheduling controlling unit, and according to the grading line ordering of task dispatching, task grade computing formula is as follows:
Wherein: R represents task priority, span 1～9;
J represents the criticality of tasks execution phases, span 1～9;
the criticality of expression task priority and tasks execution phases is weights separately;
P represents the task grade calculating;
Step 1.4, scheduling controlling unit real time scan waiting list, and return to step 1.2;
The execution information and sending of this task of task identification editor in the worker thread sign that step 1.5, basis are assigned to and task change message is carried out to worker thread pond, and task scheduling finishes.
In the present invention, thread pool is carried out following steps:
Step 2.1, building work thread pool, according to default thread pool capacity, create the worker thread of respective numbers, for each worker thread is opened up corresponding with it message queue, in thread operational process, this message queue of real time scan obtains task parameters and completes data calculating and data display operation simultaneously;
Step 2.2, establishment thread concordance list, thread concordance list is preserved the corresponding relation of task identification, thread identification, downstream site address and thread message queue with chain sheet form, and traversal worker thread pond adds each thread identification and corresponding message queue in thread concordance list;
The tasks carrying message that scheduling controlling unit is sent in step 2.3, worker thread pond here is obtained the thread identification that will be sent to execution through resolving, and according to thread identification, obtains this node address in thread concordance list;
The node address that step 2.4, basis are obtained, is sent to this chained list node message queue pointed by tasks carrying message and waits for thread execution, revises the task identification of this chained list node simultaneously;
Step 2.5, in thread message queue all message complete after, task identification in this node is emptied and is restPosed, tasks carrying finishes.
Utilize multithreading to create system works thread pool and thread concordance list, and the mission bit stream real-time update thread concordance list performed according to each worker thread, when task monitor message is sent to the distribution of worker thread pond wait thread, according to the criticality of the priority of executing the task, supervision node, treat to execute the task and carry out classification and set up task waiting list by principle from high to low, in waiting list during tasks carrying, thread concordance list is traveled through to worker thread that determine to carry out this task, and it is pending to be sent to the message queue etc. of its respective thread.
In the present invention, described capacity regulating unit is carried out following steps and is realized capacity regulating:
Step 3.1, calculate certain time period CPU working time and calculate CPU usage:
For monokaryon CPU computing formula, be: (T-I)/T*100%, wherein, T represents certain time period, I is illustrated in the time of CPU in idle condition in this time period;
For multi-core CPU computing formula, be: (T*N-I)/T*N*100%, wherein, T represents certain time period, I be illustrated in this time period whole core cpus total free time and, N represents that CPU is to core amounts;
Monitor CPU usage in real time capacity regulating unit, if monitor a section CPU usage sometime, is greater than 50% always, thinks that the overweight need of system load reduce thread pool capacity execution step 3.3; If a monitoring sometime section CPU usage is less than 30% always, thinking that system load kicks the beam need to increase thread pool capacity elevator system processing power execution step 3.2; CPU usage is thought between remaining on 30%～50% that system works is more stable thread pool capacity is not operated.
Step 3.2, increase thread pool capacity, building work thread and corresponding thread response queue increase responsive node according to thread identification simultaneously in thread concordance list;
Step 3.3, reduce thread pool capacity, discharge in thread pool idle thread and by this thread place knot removal in thread concordance list.
The invention also discloses a kind of multitask process surveillance, comprise that a plurality of distributed task schedulings are carried out terminal, task is collected processing server and task scheduling center;
Described distributed task scheduling carries out terminal and task is collected between processing server by XML format description file transmission task implementation status;
Described task scheduling center comprises task scheduling modules, worker thread pond and thread control module;
Described task scheduling modules collects for receiving described task the task change message that processing server transmits, and it comprises task control unit and Messages-Waiting buffer zone; Described Messages-Waiting buffer zone is used for depositing message; Described task control unit is used for scanning message and makes response;
Described worker thread pond is for the treatment of task, and it comprises thread concordance list, Thread control unit, task control unit and task executing units; Described thread concordance list comprises task identification, thread identification, downstream site address and thread message queue; Described Thread control unit is used for the establishment of each worker thread and release; Described task control unit is for scanning the corresponding thread message queue of each thread of thread concordance list and the message of obtaining being sent to task executing units and carrying out; Described task executing units responds for the task change message to sending to and tasks carrying situation data is encoded and are finally sent to the demonstration of display of visually process monitoring terminal;
Described thread control module is for monitoring the multithreading in worker thread pond in real time, and it comprises capacity regulating unit, and thread monitor unit and thread are intervened unit; Described capacity regulating unit is monitored system performance and is regulated worker thread quantity in thread pool according to monitoring result; Described thread monitor unit, for worker thread pond worker thread is monitored, records long-time free time and the long-time thread interrupting preserve with daily record form; Described thread is intervened unit and is discharged and redistribute for the abnormal thread that thread monitor unit is recorded.
The present invention has set up distributed task scheduling and has carried out information acquiring technology, and each tasks carrying terminal of physical dispersion is carried out to task status collection; The task scheduling strategy of foundation based on multithreading, reasonably distributes execution thread according to the criticality of the priority level of executing the task, supervision node, realizes multitask efficient parallel and processes; Set up multithreading self-adaptation regulation technology, to distributing thread to carry out dynamic management, and make running efficiency of system reach optimal value according to the adaptive adjustment number of threads of the processing power of system.
The XML file of the present invention by format and tasks carrying terminal are carried out the finish the work automatic collection of implementation status of data interaction, and the result collecting is aggregated into task by network collects server, carry out the check that gathers of data, filter out redundancy and abnormal data, finally the tasks carrying situation warehouse-in after filtering is preserved.
In system operational process of the present invention, in real time the multithreading in worker thread pond is monitored, and pass through to regulate worker thread pond thread quantity according to current system load condition, make system effectiveness reach optimum load balance, the thread of operation irregularity is reclaimed simultaneously.
Beneficial effect: the present invention compared with prior art, its remarkable advantage: (1) carries out information acquiring technology by distributed task scheduling, can reliable and effective each tasks carrying terminal to physical dispersion carry out task status collection, and utilize ripe database technology effectively to manage historical image data.(2) utilize multithreading the management of multitask flow process and supervision to be carried out to the reasonable distribution of computational resource, realize the efficient parallel processing of multitask.(3) set up multithreading task scheduling strategy, according to the criticality of the priority level of executing the task, supervision node, execution thread is reasonably distributed.(4), by multithreading self-adaptation regulation technology, to distributing thread to carry out dynamic management, and make running efficiency of system reach optimal value according to the adaptive adjustment number of threads of the processing power of system.
Accompanying drawing explanation
Below in conjunction with the drawings and specific embodiments, the present invention is done further and illustrated, above-mentioned and/or otherwise advantage of the present invention will become apparent.
Fig. 1 is the process flow diagram of multitask process supervision method.
Fig. 2 is the schematic diagram of distributed task scheduling implementation status data acquisition.
Fig. 3 is multithreading task scheduling centric architecture block diagram.
Fig. 4 is thread concordance list structural drawing.
Embodiment
Multitask process supervision method under distributed system environment of the present invention as shown in Figure 1, step is as follows:
The first step, due to each tasks execution phases under distributed execution environment by physical dispersion in each tasks carrying terminal, as shown in Figure 2, the present invention utilizes existing process surveillance technology (ready to five kinds of states of the tasks carrying process of each tasks carrying terminal, wait for, hang up, create, disappear) thus the concrete implementation status of determining this tasks execution phases monitored, according to tasks carrying state of a process, the tasks carrying situation of each tasks execution phases is correspondingly defined as to five classes: ready → task is prepared, wait → task is waited for, hang-up → tasks interrupt, establishment → tasks carrying, disappearance → task finishes.Finally process is monitored to the tasks carrying situation getting is preserved by the XML description document of format and the automatic collection of the implementation status of finishing the work.Criticality and the task priority of wherein arranging tasks execution phases are 1～9 grade from low to high;
Second step, the XML description document collecting is carried out to parsing and the check of data by Internet Transmission to task junction reason server, filter out redundancy and abnormal data, finally, by the task data write into Databasce after filtering, transmission task simultaneously changes message informing task scheduling center;
The 3rd step, task scheduling center are directly submitted to multithreading task scheduling modules after receiving task change message, multithreading task scheduling modules adds Messages-Waiting queue by the message of receiving, scheduling controlling unit carries out real time scan to message waiting list and according to the principle of first in first out, responds after discovery message;
The 4th step, scheduling controlling cell response are after task change message, according to the content in thread concordance list, determine the worker thread be sent to, thread concordance list forms each thread information and Messages-Waiting queue corresponding to each thread as shown in Figure 4 and preserves with the form of two-dimensional chain table.By the traversal of thread concordance list is determined whether to exist idle thread, if all thread is occupied in worker thread pond, the strategy that adopts high priority first to carry out according to task grade is dispatched, and scheduling controlling cell operation detailed step is as follows:
The task change message parse that step 1, basis receive goes out the task identification of this task, according to task identification traversal thread concordance list, obtains this task worker thread of correspondence with it, forwards step 5 to.If do not inquire the worker thread of this task, forward step 2 to.
Step 2, traversal thread concordance list, thus by each task identification in thread concordance list is longitudinally traveled through to the idle thread of obtaining unallocated task, forward step 5 to.If available free worker thread, does not forward step 3 to yet.
Step 3, this message is added to the Messages-Waiting queue in scheduling controlling unit, and according to the grading line ordering of task dispatching, task grade computing formula is as follows:
Wherein: R represents task priority, span 1～9;
J represents the criticality of tasks execution phases, span 1～9;
P represents the task grade calculating;
Step 4, scheduling controlling unit real time scan waiting list, and message is sent to step 2 successively and carries out.
The execution information and sending of this task of task identification editor in the worker thread sign that step 5, basis are assigned to and task change message is carried out to worker thread pond, and task scheduling finishes.
Worker thread pond receives after the tasks carrying message of sending here scheduling controlling unit, through resolving, is retrieved as the execution thread sign that this task is distributed, the guiding of finishing the work by thread concordance list, and the execution of finally finishing the work, thread pool work detailed step is as follows:
Step 1, building work thread pool, according to default thread pool capacity, create the worker thread of respective numbers, for each worker thread is opened up corresponding with it message queue, in thread operational process, this message queue of real time scan obtains inter-related task parameter and completes the operations such as data calculating and data demonstration simultaneously.
Step 2, establishment thread concordance list, as mistake! Do not find Reference source.Shown in, thread concordance list is preserved the corresponding relation of task identification, thread identification and thread message queue with chain sheet form, traversal worker thread pond adds each worker thread sign and corresponding message queue in thread concordance list, and chained list length arranges according to thread pool capacity.
The tasks carrying message that scheduling controlling unit is sent in step 3, worker thread pond here is obtained the thread identification that will be sent to execution through resolving, and according to thread identification, obtains this node address in thread concordance list.
The node address that step 4, basis are obtained, is sent to this chained list node message queue pointed by tasks carrying message and waits for thread execution, revises the task identification of this chained list node simultaneously.
Step 5, in thread message queue all message complete after, task identification in this node is emptied and is restPosed, tasks carrying finishes.
When the 5th step, system operation, thread control module is responsible for worker thread to manage, thread monitor unit is monitored and when noting abnormalities thread, is notified thread intervention module to stop this thread worker thread in real time, unenforced task message in Thread Messages response queue is returned to task scheduling modules simultaneously and carry out redistributing of thread, capacity regulating unit is monitored system performance and is regulated worker thread quantity in thread pool according to monitoring result, and detailed step is as follows:
Step 1, calculate certain time period CPU working time and calculate CPU usage:
For monokaryon CPU computing formula, be: (T-I)/T*100%, wherein, T represents certain time period, I is illustrated in the time of CPU in idle condition in this time period;
For multi-core CPU computing formula, be: (T*N-I)/T*N*100%, wherein, T represents certain time period, I be illustrated in this time period whole core cpus total free time and, N represents that CPU is to core amounts;
Monitor CPU usage in real time capacity regulating unit, if monitor a section CPU usage sometime, is greater than 50% always, thinks that the overweight need of system load reduce thread pool capacity execution step 3; If a monitoring sometime section CPU usage is less than 30% always, thinking that system load kicks the beam need to increase thread pool capacity elevator system processing power execution step 2; CPU usage is thought between remaining on 30%～50% that system works is more stable thread pool capacity is not operated.
Step 2, increase thread pool capacity, building work thread and corresponding thread response queue increase responsive node according to thread identification simultaneously in thread concordance list;
Step 3, reduce thread pool capacity, discharge in thread pool idle thread and by this thread place knot removal in thread concordance list.
Multitask process surveillance described in the present embodiment, comprises that a plurality of distributed task schedulings are carried out terminal, task is collected processing server and task scheduling center;
Distributed task scheduling implementation status data collecting model is composed as follows as shown in Figure 2:
Described distributed task scheduling carries out terminal and task is collected between processing server by XML format description file transmission task implementation status;
Described tasks carrying situation gatherer process is collected tasks carrying process status in each tasks carrying terminal, and preserves by the XML description document of format;
Described data transfer layer collects processing server for XML format description files through network is transferred to task;
Described task is collected processing server for receiving XML format description file, and resolves and filter out redundancy and abnormal data, finally by the tasks carrying situation write into Databasce after filtering;
Multithreading task scheduling centric architecture is composed as follows as shown in Figure 3:
Described task scheduling center comprises task scheduling modules, worker thread pond and thread control module;
Described task scheduling modules collects for receiving described task the task change message that processing server transmits, and it comprises task control unit and Messages-Waiting buffer zone; Described Messages-Waiting buffer zone is used for depositing message; Described task control unit is used for scanning message and makes response;
Described worker thread pond is for the treatment of task, and it comprises thread concordance list, Thread control unit, task control unit and task executing units; Described thread concordance list comprises task identification, thread identification, downstream site address and thread message queue; Described Thread control unit is used for the establishment of each worker thread and release; Described task control unit is for scanning the corresponding thread message queue of each thread of thread concordance list and the message of obtaining being sent to task executing units and carrying out; Described task executing units responds for the task change message to sending to and tasks carrying situation data is encoded and are finally sent to the demonstration of display of visually process monitoring terminal;
Described thread control module is for monitoring the multithreading in worker thread pond in real time, and it comprises capacity regulating unit, and thread monitor unit and thread are intervened unit; Described capacity regulating unit is monitored system performance and is regulated worker thread quantity in thread pool according to monitoring result; Described thread monitor unit, for worker thread pond worker thread is monitored, records long-time free time and the long-time thread interrupting preserve with daily record form; Described thread is intervened unit and is discharged and redistribute for the abnormal thread that thread monitor unit is recorded.
Thread concordance list structure is composed as follows as shown in Figure 4:
Described thread concordance list comprises task identification, thread identification, downstream site address and thread message queue;
Described task identification is sent to for preserving the task unique identification that thread pool is carried out; Described thread identification is for preserving the thread identification of carrying out corresponding task, and it is mutually corresponding that this is identified in task identification; The execution message of described thread message queue for preserving corresponding task identification, travels through this message queue and carries out corresponding operating according to getting tasks carrying message in thread operational process; Described downstream site address can obtain lower DBMS and preserve address when carrying out chained list traversing operation, as to get downstream site address be that sky shows that this node has been chained list bottom.
The present embodiment, by the collection to each task status of distributed terminal, reasonably distributes computational resource through multithreading task scheduling strategy, thereby realizes the quick response that multitask process monitors.
The invention provides a kind of multitask process supervision method under distributed system environment and the thinking of surveillance; method and the approach of this technical scheme of specific implementation are a lot; the above is only the preferred embodiment of the present invention; should be understood that; for those skilled in the art; under the premise without departing from the principles of the invention, can also make some improvements and modifications, these improvements and modifications also should be considered as protection scope of the present invention.In the present embodiment not clear and definite each ingredient all available prior art realized.
Claims (4)
1. the multitask process supervision method under a distributed system environment, is characterized in that, comprises the following steps:
The first step, monitors five kinds of states of the tasks carrying process of each tasks carrying terminal under distributed system environment, and that described five kinds of states comprise is ready, wait for, hang up, create, disappear five kinds; According to tasks carrying state of a process, sequentially the tasks carrying situation of each tasks execution phases is correspondingly defined as to five classes: task preparation, task wait, tasks interrupt, tasks carrying, task finish; The tasks carrying situation that process supervision is got is preserved by the XML description document of format;
Second step, the XML description document of described format is transferred to task collects the check that gathers that processing server carries out data, filter out redundancy and abnormal data, tasks carrying situation write into Databasce by after filtering sends job change message informing task scheduling center simultaneously;
The 3rd step, task scheduling center is directly submitted to task scheduling modules by these message after receiving job change message, task scheduling modules adds Messages-Waiting queue by the message of receiving, scheduling controlling unit carries out real time scan to message waiting list and according to the principle of first in first out, responds after discovery message;
The 4th step, scheduling controlling cell response is after task change message, searching thread concordance list obtains the worker thread of this task and transfers to this thread execution, as inquired worker thread corresponding to this task in thread concordance list, according to task grade, do not add the distribution of Messages-Waiting queue wait thread in scheduling controlling unit to, and the task of distributing thread execution is sent to worker thread pond and carries out;
The 5th step, thread control module monitors the multithreading in worker thread pond in real time in system operational process, and thread pool thread quantity is carried out increasing and decreasing and making computational resource reach optimum load balance accordingly by capacity regulating unit according to current system load condition, long-time unenforced thread is deleted simultaneously, the thread of operation irregularity is reclaimed simultaneously.
2. the multitask process supervision method under distributed system environment according to claim 1, is characterized in that, scheduling controlling unit is carried out following steps and realized task scheduling:
The task change message parse that step 1.1, basis receive goes out the task identification of this task, according to task identification traversal thread concordance list, obtains this task worker thread of correspondence with it, forwards step 1.5 to; If do not inquire the worker thread of this task, forward step 1.2 to;
Step 1.2, traversal thread concordance list, thus by each task identification in thread concordance list is longitudinally traveled through to the idle thread of obtaining unallocated task, forward step 1.5 to; If available free worker thread, does not forward step 1.3 to yet;
Step 1.3, this message is added to the Messages-Waiting queue in scheduling controlling unit, and according to the grading line ordering of task dispatching, task grade computing formula is as follows:
Wherein: R represents task priority, span 1～9;
J represents the criticality of tasks execution phases, span 1～9;
P represents the task grade calculating;
Step 1.4, scheduling controlling unit real time scan waiting list, and return to step 1.2;
The execution information and sending of this task of task identification editor in the worker thread sign that step 1.5, basis are assigned to and task change message is carried out to worker thread pond, and task scheduling finishes.
3. the multitask process supervision method under distributed system environment according to claim 2, is characterized in that, thread pool is carried out following steps:
Step 2.1, building work thread pool, according to default thread pool capacity, create the worker thread of respective numbers, for each worker thread is opened up corresponding with it message queue, in thread operational process, this message queue of real time scan obtains task parameters and completes data calculating and data display operation simultaneously;
Step 2.2, establishment thread concordance list, thread concordance list is preserved the corresponding relation of task identification, thread identification, downstream site address and thread message queue with chain sheet form, and traversal worker thread pond adds each thread identification and corresponding message queue in thread concordance list;
The tasks carrying message that scheduling controlling unit is sent in step 2.3, worker thread pond here is obtained the thread identification that will be sent to execution through resolving, and according to thread identification, obtains this node address in thread concordance list;
The node address that step 2.4, basis are obtained, is sent to this chained list node message queue pointed by tasks carrying message and waits for thread execution, revises the task identification of this chained list node simultaneously;
Step 2.5, in thread message queue all message complete after, task identification in this node is emptied and is restPosed, tasks carrying finishes.
4. the multitask process supervision method under distributed system environment according to claim 3, is characterized in that, described capacity regulating unit is carried out following steps and realized capacity regulating:
Step 3.1, calculate certain time period CPU working time and calculate CPU usage:
For monokaryon CPU computing formula, be: (T-I)/T*100%, wherein, T represents certain time period, I is illustrated in the time of CPU in idle condition in this time period;
For multi-core CPU computing formula, be: (T*N-I)/T*N*100%, wherein, T represents certain time period, I be illustrated in this time period whole core cpus total free time and, N represents the core amounts of CPU;
Monitor CPU usage in real time capacity regulating unit, if CPU usage is greater than 50% in one time period of monitoring always, the overweight need of decision-making system load reduce thread pool capacity, carries out following steps 3.3;
If CPU usage is less than 30% in one time period of monitoring always, decision-making system underload need increase thread pool capacity elevator system processing power, carries out following steps 3.2;
If CPU usage remains on 30%～50% in one time period of monitoring, decision-making system working stability, does not operate thread pool capacity;
Step 3.2, increase thread pool capacity, building work thread and corresponding thread response queue increase responsive node according to thread identification simultaneously in thread concordance list;
Step 3.3, reduce thread pool capacity, discharge in thread pool idle thread and by this thread place knot removal in thread concordance list.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201110302232.9A CN102360310B (en) | 2011-09-28 | 2011-09-28 | Multitask process monitoring method in distributed system environment |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201110302232.9A CN102360310B (en) | 2011-09-28 | 2011-09-28 | Multitask process monitoring method in distributed system environment |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN102360310A CN102360310A (en) | 2012-02-22 |
| CN102360310B true CN102360310B (en) | 2014-03-26 |
Family
ID=45585642
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201110302232.9A Active CN102360310B (en) | 2011-09-28 | 2011-09-28 | Multitask process monitoring method in distributed system environment |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN102360310B (en) |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107818016A (en) * | 2017-11-22 | 2018-03-20 | 苏州麦迪斯顿医疗科技股份有限公司 | Server application design method, request event processing method and processing device |
| CN110737534A (en) * | 2019-10-29 | 2020-01-31 | 京东数字科技控股有限公司 | Task processing method and device and server |
Families Citing this family (83)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US9507638B2 (en) * | 2011-11-08 | 2016-11-29 | Nvidia Corporation | Compute work distribution reference counters |
| CN102629220A (en) * | 2012-03-08 | 2012-08-08 | 北京神州数码思特奇信息技术股份有限公司 | Dynamic task allocation and management method |
| CN103377096B (en) * | 2012-04-20 | 2016-03-23 | 苏州富欣智能交通控制有限公司 | The task scheduling verification method that granularity is adjustable |
| CN102831016B (en) * | 2012-08-01 | 2014-10-01 | 浪潮(北京)电子信息产业有限公司 | Physical machine recycle method of cloud computing and device thereof |
| CN103294534B (en) * | 2012-11-01 | 2017-02-08 | 北京安天电子设备有限公司 | Task management system and method of distributed system |
| CN103019854A (en) * | 2012-11-20 | 2013-04-03 | 北京思特奇信息技术股份有限公司 | Distributed dynamic process management method and system |
| CN103888279A (en) * | 2012-12-20 | 2014-06-25 | 阿里巴巴集团控股有限公司 | Resource pool dynamic management method and system based on feedback control cycle |
| CN103268567B (en) * | 2013-03-25 | 2016-12-28 | 中国科学院沈阳自动化研究所 | The efficient mass incident detecting of Facing to Manufacturing trade management system and processing method |
| CN103336574A (en) * | 2013-07-23 | 2013-10-02 | 北京百度网讯科技有限公司 | Energy-saving control method and device of data center |
| CN104598425B (en) * | 2013-10-31 | 2018-03-13 | 中国石油天然气集团公司 | A kind of general multiprocessing parallel calculation method and system |
| CN104618681B (en) * | 2013-11-01 | 2019-03-26 | 南京中兴力维软件有限公司 | Multi-channel video concentration method and device thereof |
| CN103679392B (en) * | 2013-12-26 | 2018-01-09 | 拉卡拉支付股份有限公司 | A kind of task scheduling processing method and system |
| CN103902646B (en) * | 2013-12-27 | 2017-04-19 | 北京天融信软件有限公司 | Distributed task managing system and method |
| CN104780144B (en) * | 2014-01-13 | 2019-03-01 | 北京兆维电子(集团)有限责任公司 | Intelligent stream medium data distribution method and device |
| CN104811415B (en) * | 2014-01-23 | 2018-07-24 | 杭州迪普科技股份有限公司 | Distributed Scans system load balancing method and device |
| CN103873293B (en) * | 2014-03-05 | 2018-06-12 | 新华三技术有限公司 | A kind of healthprobe device and method |
| CN104156261A (en) * | 2014-08-11 | 2014-11-19 | 浪潮(北京)电子信息产业有限公司 | Method and device for processing tasks among multiple controllers |
| CN105577410A (en) * | 2014-10-16 | 2016-05-11 | 中兴通讯股份有限公司 | Real-time terminal state refreshing method and apparatus thereof |
| CN105701109B (en) * | 2014-11-26 | 2019-12-03 | 深圳市腾讯计算机系统有限公司 | The method and device that file multichannel is sent |
| CN104731635B (en) * | 2014-12-17 | 2018-10-19 | 华为技术有限公司 | A kind of virtual machine access control method and virtual machine access control system |
| CN104572277B (en) * | 2014-12-17 | 2018-04-27 | 大唐移动通信设备有限公司 | A kind of thread flow control method and device |
| CN104881483B (en) * | 2015-06-05 | 2018-01-09 | 南京大学 | Automatic detection evidence collecting method for the attack of Hadoop platform leaking data |
| CN104991824B (en) * | 2015-08-03 | 2019-09-13 | 上海斐讯数据通信技术有限公司 | A kind of method and system in switching at runtime application data source |
| CN106528065B (en) * | 2015-09-14 | 2019-11-08 | 阿里巴巴集团控股有限公司 | A kind of thread acquisition methods and equipment |
| TWI564807B (en) * | 2015-11-16 | 2017-01-01 | 財團法人工業技術研究院 | Scheduling method and processing device using the same |
| CN105550411B (en) * | 2015-12-07 | 2019-08-27 | 中车青岛四方机车车辆股份有限公司 | A kind of flow events monitor method and device that bullet train quickly designs |
| CN107357639B (en) | 2016-05-09 | 2019-09-17 | 腾讯科技（深圳）有限公司 | A kind of distributed processing system(DPS), data processing method and apparatus |
| CN107515784B (en) * | 2016-06-16 | 2021-07-06 | 阿里巴巴集团控股有限公司 | Method and equipment for calculating resources in distributed system |
| CN106341231A (en) * | 2016-08-22 | 2017-01-18 | 北京信安世纪科技有限公司 | Information processing method and electronic equipment |
| CN106773805A (en) * | 2016-11-15 | 2017-05-31 | 努比亚技术有限公司 | Task message processing system and method |
| CN106526427B (en) * | 2016-11-28 | 2018-11-06 | 河南理工大学 | A kind of coalmine high-voltage power network short circuit current parallel calculating method based on load balancing |
| CN106775990A (en) * | 2016-12-31 | 2017-05-31 | 中国移动通信集团江苏有限公司 | Request scheduling method and device |
| CN107423620B (en) * | 2017-03-12 | 2020-11-24 | 苏州浪潮智能科技有限公司 | Management method and device for storage server service process |
| CN107220033A (en) * | 2017-07-05 | 2017-09-29 | 百度在线网络技术（北京）有限公司 | Method and apparatus for controlling thread pool thread quantity |
| CN107562538B (en) * | 2017-08-22 | 2020-01-07 | 中国铁道科学研究院电子计算技术研究所 | Data extraction multitask management method and system in railway transportation statistics |
| CN107621978A (en) * | 2017-09-29 | 2018-01-23 | 郑州云海信息技术有限公司 | A kind of High Availabitity task processing Controlling model under parallel computation environment |
| CN107798111B (en) * | 2017-11-01 | 2021-04-06 | 四川长虹电器股份有限公司 | Method for exporting data in large batch in distributed environment |
| CN107942753B (en) * | 2017-12-07 | 2020-08-25 | 惠州市德赛西威汽车电子股份有限公司 | Communication framework and communication method for software of robot and terminal equipment |
| CN107920136B (en) * | 2017-12-29 | 2019-09-17 | Oppo广东移动通信有限公司 | Data synchronization control method, device and server |
| CN108874533A (en) * | 2018-01-08 | 2018-11-23 | 深圳市铱硙医疗科技有限公司 | Handle the server distribution method and device of MRI image |
| CN108509260B (en) * | 2018-01-31 | 2021-08-13 | 深圳市万普拉斯科技有限公司 | Thread identification processing method and device, computer equipment and storage medium |
| CN108446171B (en) * | 2018-02-01 | 2022-07-08 | 平安科技（深圳）有限公司 | Electronic device, distributed system execution task allocation method and storage medium |
| CN108595282A (en) * | 2018-05-02 | 2018-09-28 | 广州市巨硅信息科技有限公司 | A kind of implementation method of high concurrent message queue |
| CN108762725B (en) * | 2018-05-31 | 2021-01-01 | 飞天诚信科技股份有限公司 | Distributed random number generation and detection method and system |
| CN108874550A (en) * | 2018-07-18 | 2018-11-23 | 郑州云海信息技术有限公司 | A kind of method, apparatus, storage medium and computer equipment adjusting thread pool |
| CN109189726B (en) * | 2018-08-08 | 2020-12-22 | 奇安信科技集团股份有限公司 | Processing method and device for read-write log |
| CN113407633A (en) * | 2018-09-13 | 2021-09-17 | 华东交通大学 | Distributed data source heterogeneous synchronization method |
| CN109582445A (en) * | 2018-09-29 | 2019-04-05 | 阿里巴巴集团控股有限公司 | Message treatment method, device, electronic equipment and computer readable storage medium |
| CN111124625B (en) * | 2018-10-30 | 2024-03-26 | 阿里云计算有限公司 | Task queue processing method and device and storage medium |
| CN110086688A (en) * | 2019-04-18 | 2019-08-02 | 上海锵戈科技有限公司 | It is a kind of to monitor the efficient end the IP performance monitoring dispatching method of task multiple target and system more |
| CN111045797A (en) * | 2019-10-31 | 2020-04-21 | 华控清交信息科技(北京)有限公司 | Task scheduling execution method, related device and medium |
| CN111026543B (en) * | 2019-10-31 | 2023-06-16 | 北京浪潮数据技术有限公司 | Method, device, equipment and medium for forwarding data by storage system |
| CN110825512B (en) * | 2019-11-08 | 2024-05-24 | 东南数字经济发展研究院 | Universal distributed system design and C++ implementation thereof |
| CN110765663A (en) * | 2019-11-25 | 2020-02-07 | 中冶赛迪重庆信息技术有限公司 | Concurrent processing method and system based on parametric simulation |
| CN110888726A (en) * | 2019-11-25 | 2020-03-17 | 中冶赛迪重庆信息技术有限公司 | Multitask concurrent processing method and system |
| CN110928664B (en) * | 2019-12-02 | 2022-08-16 | 南京甄视智能科技有限公司 | Distributed face searching method and system based on multiple message threads |
| CN111010313B (en) * | 2019-12-05 | 2021-03-19 | 深圳联想懂的通信有限公司 | Batch processing state monitoring method, server and storage medium |
| CN111124651B (en) * | 2019-12-27 | 2023-05-23 | 中通服公众信息产业股份有限公司 | Method for concurrently scheduling multiple threads in distributed environment |
| CN111240857B (en) * | 2020-01-03 | 2023-02-21 | 上海瀚之友信息技术服务有限公司 | Remote service calling system and method |
| CN111399951A (en) * | 2020-03-05 | 2020-07-10 | 北京云族佳科技有限公司 | Computer working data acquisition, analysis and display method and device and electronic equipment |
| CN111338803B (en) * | 2020-03-16 | 2024-01-09 | 北京达佳互联信息技术有限公司 | Thread processing method and device |
| CN113535251A (en) * | 2020-04-13 | 2021-10-22 | 华为技术有限公司 | Thread management method and device |
| CN111488214B (en) * | 2020-04-17 | 2022-07-12 | 上海智殷自动化科技有限公司 | Communication method between multiple tasks under real-time system |
| CN111651789B (en) * | 2020-06-05 | 2023-04-14 | 北京明朝万达科技股份有限公司 | Multithreading safety batch feedback method and device based on scanning system |
| CN111757145B (en) * | 2020-07-31 | 2022-03-04 | 四川巧夺天工信息安全智能设备有限公司 | Method for processing monitoring videos with balanced multipath loads in batch |
| CN112328388B (en) * | 2020-09-17 | 2022-03-08 | 北京中数科技术有限公司 | Parallel computing method and system fusing multithreading and distributed technology |
| CN112148493A (en) * | 2020-09-30 | 2020-12-29 | 武汉中科通达高新技术股份有限公司 | Streaming media task management method and device and data server |
| CN112882903A (en) * | 2020-12-23 | 2021-06-01 | 沈阳世纪高通科技有限公司 | Distributed monitoring method |
| CN112865311B (en) * | 2021-01-15 | 2022-11-01 | 北京科东电力控制系统有限责任公司 | Method and device for monitoring message bus of power system |
| CN112817762A (en) * | 2021-01-29 | 2021-05-18 | 中汽创智科技有限公司 | Dispatching system based on adaptive automobile open system architecture standard and dispatching method thereof |
| CN113238843B (en) * | 2021-05-13 | 2024-07-16 | 北京京东振世信息技术有限公司 | Task execution method, device, equipment and storage medium |
| CN113259632A (en) * | 2021-06-23 | 2021-08-13 | 国网智能科技股份有限公司 | Distributed concurrent inspection system and method for video equipment of transformer substation |
| CN113238854B (en) * | 2021-07-07 | 2021-11-19 | 苏州浪潮智能科技有限公司 | Method, device and equipment for automatically adjusting thread number and readable medium |
| CN113485811B (en) * | 2021-07-23 | 2024-06-25 | 平安科技（深圳）有限公司 | Computing task management method, device, computer equipment and storage medium |
| CN113608965B (en) * | 2021-08-09 | 2024-07-19 | 安徽创新软件集团有限公司 | Multithreading data monitoring method based on Internet of things technology |
| CN114579012B (en) * | 2022-03-03 | 2024-03-29 | 北京天智鲲鹏技术有限公司 | Cross-application workflow arrangement and scheduling method |
| CN114691375B (en) * | 2022-06-02 | 2022-08-26 | 青岛展诚科技有限公司 | Integrated circuit resistance extraction method based on parallel algorithm |
| CN114896295B (en) * | 2022-07-12 | 2022-10-04 | 云启智慧科技有限公司 | Data desensitization method, desensitization device and desensitization system in big data scene |
| CN115934365B (en) * | 2023-03-10 | 2023-05-23 | 深圳华龙讯达信息技术股份有限公司 | Task scheduling coupling system applied to CPU |
| CN116954927B (en) * | 2023-09-07 | 2023-12-01 | 建信住房服务有限责任公司 | Distributed heterogeneous data acquisition method, storage medium and electronic equipment |
| CN116909780B (en) * | 2023-09-12 | 2023-11-17 | 天津卓朗昆仑云软件技术有限公司 | Memory-based local distributed queue plug-in, system and queue processing method |
| CN116932335B (en) * | 2023-09-18 | 2024-02-13 | 中国电子科技集团公司第十五研究所 | Task flow monitoring method and system based on network transmission in domestic environment |
| CN118377635B (en) * | 2024-06-24 | 2024-08-30 | 北京久佳信通科技有限公司 | Message rapid processing method based on high concurrency scene |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101135981A (en) * | 2007-08-29 | 2008-03-05 | 中兴通讯股份有限公司 | Method and device for realizing batch report generation |
| CN101599027A (en) * | 2009-06-30 | 2009-12-09 | 中兴通讯股份有限公司 | A kind of thread pool management method and system thereof |
| CN101777008A (en) * | 2009-12-31 | 2010-07-14 | 中兴通讯股份有限公司 | Method and device for realizing mobile terminal system thread pool |
Family Cites Families (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US7693628B2 (en) * | 2005-01-04 | 2010-04-06 | Gm Global Technology Operations, Inc. | Controller with communication of multi-source tasks |
-
2011
- 2011-09-28 CN CN201110302232.9A patent/CN102360310B/en active Active
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101135981A (en) * | 2007-08-29 | 2008-03-05 | 中兴通讯股份有限公司 | Method and device for realizing batch report generation |
| CN101599027A (en) * | 2009-06-30 | 2009-12-09 | 中兴通讯股份有限公司 | A kind of thread pool management method and system thereof |
| CN101777008A (en) * | 2009-12-31 | 2010-07-14 | 中兴通讯股份有限公司 | Method and device for realizing mobile terminal system thread pool |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107818016A (en) * | 2017-11-22 | 2018-03-20 | 苏州麦迪斯顿医疗科技股份有限公司 | Server application design method, request event processing method and processing device |
| CN110737534A (en) * | 2019-10-29 | 2020-01-31 | 京东数字科技控股有限公司 | Task processing method and device and server |
Also Published As
| Publication number | Publication date |
|---|---|
| CN102360310A (en) | 2012-02-22 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN102360310B (en) | Multitask process monitoring method in distributed system environment | |
| CN102063336B (en) | Distributed computing multiple application function asynchronous concurrent scheduling method | |
| CN101692208B (en) | Task scheduling method for processing real-time traffic information | |
| CN104298550B (en) | A kind of dynamic dispatching method towards Hadoop | |
| CN102118261B (en) | Method and device for data acquisition, and network management equipment | |
| CN106202346B (en) | A kind of data load cleaning engine, scheduling and storage system | |
| CN105302638B (en) | MPP cluster task dispatching method based on system load | |
| CN102193832B (en) | Cloud computing resource scheduling method and applied system | |
| CN102043675B (en) | Thread pool management method based on task quantity of task processing request | |
| CN111813502B (en) | Computing resource management scheduling method for industrial edge node | |
| CN108874524A (en) | Big data distributed task dispatching system | |
| CN104156255B (en) | A kind of virtual machine migration method, virtual machine (vm) migration device and source physical host | |
| CN101694709A (en) | Service-oriented distributed work flow management system | |
| CN102096603A (en) | Task decomposition control method in MapReduce system and scheduling node equipment | |
| CN101652750A (en) | Data processing device, distributed processing system, data processing method, and data processing program | |
| CN108009258A (en) | It is a kind of can Configuration Online data collection and analysis platform | |
| CN101086711A (en) | Mission management method of multiple-mission operation system | |
| CN109831316A (en) | Massive logs real-time analyzer, real-time analysis method and readable storage medium storing program for executing | |
| JPWO2018097058A1 (en) | Analysis node, resource management method, and program recording medium | |
| CN110287006A (en) | A kind of data dispatching method and system | |
| DE102020132469A1 (en) | QUEUE WITH CUSTOM MEASURED PRIORITY | |
| CN109144693A (en) | A kind of power adaptive method for scheduling task and system | |
| CN107066318A (en) | A kind of data dispatching method suitable for stream calculation | |
| CN116389591A (en) | Cross-domain-based distributed processing system and scheduling optimization method | |
| CN112445590A (en) | Computing resource access and scheduling system and method |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |