CN102360310A - Multitask process monitoring method and system in distributed system environment - Google Patents
Multitask process monitoring method and system in distributed system environment Download PDFInfo
- Publication number
- CN102360310A CN102360310A CN2011103022329A CN201110302232A CN102360310A CN 102360310 A CN102360310 A CN 102360310A CN 2011103022329 A CN2011103022329 A CN 2011103022329A CN 201110302232 A CN201110302232 A CN 201110302232A CN 102360310 A CN102360310 A CN 102360310A
- Authority
- CN
- China
- Prior art keywords
- task
- thread
- message
- execution
- identification
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Images
Abstract
The invention discloses a multitask process monitoring method in the distributed system environment. The method comprises the following steps that: five states of the task execution process of each task execution terminal in the distributed system environment are monitored; an XML (eXtensible markup language) format description file is transported to a task collecting and processing server, the task execution conditions after filtration are written in a database and simultaneously task change information is sent to notify a task scheduling center; the task scheduling center directly submits the information to a task scheduling module after receiving the task change information and the task scheduling module adds the received information to information waiting queues; a scheduling control unit searches for a thread index table for threads of execution of the task and gives the threads of execution to the threads to be executed; and a thread control module monitors a plurality of threads in a work thread pool in real time in the system operation process. The invention also discloses a multitask process monitoring system. The system comprises a plurality of distributed task execution terminals, the task collecting and processing server and the task scheduling center.
Description
Technical field
The present invention relates to a kind of task process surveillance technology, multitask process method for monitoring under particularly a kind of distributed system environment and multitask process surveillance.
Background technology
Ripe and development along with modern computer and communication network technique; The building mode of contemporary information systems and architecture also change to distributed structure/architecture more efficiently from the original mode that simply focuses on; This trend causes turning to the integrated of complication system function more from paying attention to program design; And how to assemble each aspect business module, make its collaborative work.
The business process management system of handling based on distributed task scheduling is a kind of infosystem towards flow process, the functions such as sustainable management optimization of the transmission of main mode realization information Network Based, data sync, flow monitoring and operation flow.The proposition of BPM has been avoided being solidificated in workflow in the application program of customization, supports the transformation from program design to the application assembling, and seating surface designs and organize growth (organic growth) again to flow process, flow process in addition.
Using widely at present, operation procedure management system has Staffware, MQSeries and COSA; Case disposal system FLOWer; ERP system also provides the module of Work Process Management, and the workflow engine of SAP, Baan, PeopleSoft, Oracle and JD Edwards also can be regarded as integrated business process management system.Yet the monitoring to workflow just is integrated in the system as single module; The standard of the flow monitoring lack of uniform under varying environment; What have does not still possess the flow monitoring ability; It's a pity that most Workflow Management Systems use multilingual and notion based on different examples (paradigms), the use-pattern of all kinds of Tool Rooms there are differences, and the expansion of its corresponding function and ease for use are restricted.The present invention proposes a kind of flow monitoring system general outside the business process management system that is based upon; Make it break away from the restriction between each operation procedure management system; Proposed a kind of multi-task scheduling strategy simultaneously, made its real-time monitoring problem that a kind of effective solution is provided magnanimity flow of task under the large-scale distributed task processing environment.
Summary of the invention
The object of the present invention is to provide multitask process method for monitoring and surveillance under a kind of distributed system environment; Through automatic collection to each task status of distributed terminal; Through the multithreading task scheduling strategy computational resource is reasonably distributed, thereby realize the quick response that multitask process is kept watch on.
The invention discloses the multitask process method for monitoring under a kind of distributed system environment, may further comprise the steps:
The first step is carried out five kinds of states of the task executive process at terminal and is kept watch on to each task under the distributed system environment, that said five kinds of states comprise is ready, wait for, hang up, create, disappear five kinds; According to the sequence of states of task executive process ground the task implementation status of each tasks execution phases is defined as five types with it accordingly: task preparation, task waiting, tasks interrupt, task are carried out, task termination; Process is kept watch on the task implementation status that gets access to preserves through formative XML description document;
Second step, said XML format description file transfer is managed server to the task junction carry out the check that gathers of data; Filter out redundancy and abnormal data; Task implementation status after filtering is write database, send job change message informing task scheduling center simultaneously;
The 3rd step; The task scheduling center directly is submitted to task scheduling modules with these message after receiving job change message; Task scheduling modules adds the Messages-Waiting formation with the message of receiving, the scheduling controlling unit carries out real time scan principle according to first in first out after finding message to the message waiting list and responds;
The 4th step; The scheduling controlling cell response is after the task change message; Searching the thread concordance list obtains this task executions thread and transfers to this thread execution; Then do not add the distribution of Messages-Waiting formation wait thread in the scheduling controlling unit to as in the thread concordance list, inquiring the corresponding execution thread of this task, and will distribute the task of thread execution to be sent to the execution of worker thread pond according to the task grade;
The 5th step; Thread control module is kept watch on the multithreading in the worker thread pond in system's operational process in real time; And number of threads in the thread pool is increased and decreased accordingly through the capacity regulating unit according to current system load state and to make computational resource reach optimum load balance; Simultaneously long-time unenforced thread is deleted, the thread to operation irregularity reclaims simultaneously.
Among the present invention, the scheduling controlling unit is carried out following steps and is realized task scheduling:
The task change message parse that step 1, basis receive goes out the task identification of this task, obtains the corresponding with it worker thread of this task according to task identification traversal thread index chained list, forwards step 5 to; If do not inquire the worker thread of this task, forward step 2 to;
Step 2, traversal thread concordance list, thus through each task identification in the thread concordance list is vertically traveled through the idle thread of obtaining unallocated task, forward step 5 to; If idle worker thread is not arranged yet, forwards step 3 to;
Step 3, this message is added the Messages-Waiting formation in scheduling controlling unit, and according to the progressive line ordering of task dispatching, task grade computing formula is following:
Wherein: R representes task priority, span 1～9;
J representes the criticality of tasks execution phases, span 1～9;
P representes the task grade that calculates;
Step 4, scheduling controlling unit real time scan waiting list, and return step 2;
Carry out in this task executions information and sending of task identification editor to worker thread pond in worker thread sign that step 5, basis are assigned to and the task change message, and task scheduling finishes.
Among the present invention, thread pool is carried out following steps:
Step 1, building work thread pool; Create the worker thread of respective numbers according to preset thread pool capacity; Open up corresponding with it message queue for each worker thread simultaneously, this message queue of real time scan obtains task parameters and accomplishes operations such as data computation and data presentation in the thread operational process;
Step 2, establishment thread concordance list; The thread concordance list is preserved the corresponding relation of task identification, thread identification, downstream site address and thread message queue with the chain sheet form, and traversal worker thread pond adds each thread identification and corresponding message queue in the thread concordance list;
The task that the scheduling controlling unit is sent in step 3, worker thread pond here is carried out message and is obtained the thread identification that will be sent to execution through parsing, obtains this node address in the thread index chained list according to thread identification;
The node address that step 4, basis are obtained is carried out message with task and is sent to this chained list node message queue wait thread execution pointed, revises the task identification of this chained list node simultaneously;
Step 5, after all message in the thread message queue are complete, task identification in this node emptied restPose, task is carried out and is finished.
Utilize multithreading to create system works thread pool and thread concordance list; And the mission bit stream real-time update thread concordance list performed according to each worker thread; When the task monitor message is sent to the worker thread pond and waits for that thread distributes, treat to execute the task and carry out grade and confirm and set up the task waiting formation by principle from high to low according to the criticality of the priority of executing the task, monitor node; When task in the waiting list is carried out; The thread concordance list is traveled through the worker thread of confirming to carry out this task, and be sent to the message queue wait execution of its respective thread.
Among the present invention, said capacity regulating unit is carried out following steps and is realized capacity regulating:
Step 1, calculate certain time period CPU working time and calculate CPU usage:
For monokaryon CPU computing formula be: (T-I)/T*100%, wherein, T representes certain time period, and I is illustrated in the time that CPU in this time period is in idle condition;
For the multi-core CPU computing formula be: (T*N-I)/T*N*100%, wherein, T representes certain time period, I be illustrated in this time period whole total free time of core cpus with, N representes that CPU is to core amounts;
Monitor CPU usage in real time the capacity regulating unit, if monitoring sometime the section CPU usage always greater than 50% then think that the overweight need of system load reduce thread pool capacity execution in step 3; If monitoring sometime the section CPU usage always less than 30% then think that system load kicks the beam and need to increase thread pool capacity elevator system processing power execution in step 2; Thinking then between CPU usage remains on 30%～50% system works is more stable, the thread pool capacity is not operated.
Step 2, increase thread pool capacity, building work thread and corresponding thread response queue increase responsive node according to thread identification simultaneously in the thread concordance list;
Step 3, reduce the thread pool capacity, discharge in the thread pool idle thread and this thread place knot removal in the thread concordance list.
The invention also discloses a kind of multitask process surveillance, comprise that a plurality of distributed task schedulings are carried out the terminal, task is compiled processing server and task scheduling center;
Said distributed task scheduling carries out the terminal and task is compiled between the processing server through XML format description file transmission task implementation status;
Said task scheduling center comprises task scheduling modules, worker thread pond and thread control module;
Said task scheduling modules is used to receive said task and compiles the task change message that processing server transmits, and it comprises task control unit and Messages-Waiting buffer zone; Said Messages-Waiting buffer zone is used to deposit message; Said task control unit is used to scan message and makes response;
Said worker thread pond is used for Processing tasks, and it comprises the thread concordance list, thread control module, task control unit and task executing units; Said thread concordance list comprises task identification, thread identification, downstream site address and thread message queue; Said thread control module is used for establishment and the release to each worker thread; Said task control unit is used for the pairing thread message queue of each thread of thread concordance list is scanned and the message of obtaining is sent to task executing units carries out; Said task executing units is used for the task of sending to change message responded and task implementation status data are encoded being sent to display of visually process monitoring terminal at last and showing;
Said thread control module is used in real time the multithreading in worker thread pond being kept watch on, and it comprises the capacity regulating unit, and thread monitor unit and thread are intervened the unit; Said capacity regulating unit is monitored system performance and is regulated worker thread quantity in the thread pool according to monitoring result; Said thread monitor unit is used for worker thread pond worker thread is kept watch on, and long-time free time and the long-time thread that interrupts are write down and preserve with the daily record form; Said thread is intervened the unit and is used for the unusual thread that the thread monitor unit is write down is discharged and redistributes.
The present invention has set up distributed task scheduling and has carried out information acquiring technology, and the task status collection is carried out at each task execution terminal that physics disperses; Foundation is based on the task scheduling strategy of multithreading, according to the criticality of the priority level of executing the task, monitor node execution thread reasonably distributed, and realizes that the multitask efficient parallel handles; Set up multithreading self-adaptation regulation technology, carry out dynamic management to distributing thread, and make running efficiency of system reach optimal value according to the adaptive adjustment number of threads of the processing power of system.
The present invention carries out the terminal through formative XML file and task and carries out the finish the work automatic collection of implementation status of data interaction; And the result that will collect is aggregated into task through network and compiles server; Carry out the check that gathers of data; Filter out redundancy and abnormal data, the task implementation status warehouse-in after will filtering is at last preserved.
In real time the multithreading in the worker thread pond is kept watch in the system of the present invention operational process; And according to current system load state through regulating number of threads in the worker thread pond; Make system effectiveness reach optimum load balance, the thread to operation irregularity reclaims simultaneously.
Beneficial effect: the present invention compared with prior art; Its remarkable advantage: information acquiring technology is carried out through distributed task scheduling in (1); Can carry out the task status collection in reliable and effective each task execution terminal that physics is disperseed, and utilize ripe database technology that historical image data is effectively managed.(2) reasonable distribution of utilizing multithreading that computational resource is carried out in the management and the supervision of multitask flow process realizes multitask parallel processing efficiently.(3) set up the multithreading task scheduling strategy, execution thread is reasonably distributed according to the criticality of the priority level of executing the task, monitor node.(4), carry out dynamic management to distributing thread, and make running efficiency of system reach optimal value according to the adaptive adjustment number of threads of the processing power of system through multithreading self-adaptation regulation technology.
Description of drawings
Below in conjunction with accompanying drawing and embodiment the present invention is done specifying further, above-mentioned and/or otherwise advantage of the present invention will become apparent.
Fig. 1 is the process flow diagram of multitask process method for monitoring.
Fig. 2 is the synoptic diagram of distributed task scheduling implementation status data acquisition.
Fig. 3 is a multithreading task scheduling centric architecture block diagram.
Fig. 4 is a thread concordance list structural drawing.
Embodiment
Multitask process method for monitoring under the distributed system environment of the present invention as shown in Figure 1, step is following:
The first step, since under distributed execution environment each tasks execution phases be dispersed in each task by physics and carry out terminal; As shown in Figure 2; Thereby the present invention utilizes existing process surveillance technology that each task is carried out five kinds of states (ready, wait for, hang up, create, disappear) of the task executive process at terminal keeps watch on the concrete implementation status of confirming this tasks execution phases, according to the state of task executive process the task implementation status of each tasks execution phases is defined as five types with it accordingly: ready → task preparations, wait → task waiting, hang-up → tasks interrupt, establishment → task execution, disappearance → task termination.At last process is kept watch on that the task implementation status get access to is preserved through formative XML description document and the automatic collection of the implementation status of finishing the work.The criticality and the task priority of wherein arranging tasks execution phases are 1～9 grade from low to high;
Second step, the XML description document that collects is managed server through Network Transmission to the task junction carry out the parsing and the check of data; Filter out redundancy and abnormal data; Task data after will filtering at last writes database, the change of transmission task simultaneously message informing task scheduling center;
The 3rd step, task scheduling center directly are submitted to the multithreading task scheduling modules after receiving task change message; The multithreading task scheduling modules adds the Messages-Waiting formation with the message of receiving, the scheduling controlling unit carries out real time scan principle according to first in first out after finding message to the message waiting list and responds;
The 4th step, scheduling controlling cell response are after the task change message; Confirm the worker thread that is sent to according to the content in the thread concordance list, the thread concordance list constitute each thread information as shown in Figure 4 with each thread corresponding Messages-Waiting formation preserve with the form of two-dimensional chain table.Determine whether to exist idle thread through the traversal to the thread concordance list, if all threads are occupied then dispatch according to the strategy that the task grade adopts high priority to carry out earlier in the worker thread pond, scheduling controlling cell operation detailed step is following:
The task change message parse that step 1, basis receive goes out the task identification of this task, obtains the corresponding with it worker thread of this task according to task identification traversal thread index chained list, forwards step 5 to.If do not inquire the worker thread of this task, forward step 2 to.
Step 2, traversal thread concordance list, thus through each task identification in the thread concordance list is vertically traveled through the idle thread of obtaining unallocated task, forward step 5 to.If idle worker thread is not arranged yet, forwards step 3 to.
Step 3, this message is added the Messages-Waiting formation in scheduling controlling unit, and according to the progressive line ordering of task dispatching, task grade computing formula is following:
Wherein: R representes task priority, span 1～9;
J representes the criticality of tasks execution phases, span 1～9;
P representes the task grade that calculates;
Step 4, scheduling controlling unit real time scan waiting list, and message is sent to step 2 successively carries out.
Carry out in this task executions information and sending of task identification editor to worker thread pond in worker thread sign that step 5, basis are assigned to and the task change message, and task scheduling finishes.
After the worker thread pond receives the task execution message of sending here the scheduling controlling unit, through resolving the execution thread sign that is retrieved as this Task Distribution, through the guiding that the thread concordance list is finished the work, the execution of finally finishing the work, thread pool work detailed step is following:
Step 1, building work thread pool; Create the worker thread of respective numbers according to preset thread pool capacity; Open up corresponding with it message queue for each worker thread simultaneously, this message queue of real time scan obtains the inter-related task parameter and accomplishes operations such as data computation and data presentation in the thread operational process.
Step 2, establishment thread concordance list are like mistake! Do not find Reference source.Shown in; The thread concordance list is preserved the corresponding relation of task identification, thread identification and thread message queue with the chain sheet form; Traversal worker thread pond adds each worker thread sign and corresponding message queue in the thread concordance list, and chained list length is provided with according to the thread pool capacity.
The task that the scheduling controlling unit is sent in step 3, worker thread pond here is carried out message and is obtained the thread identification that will be sent to execution through parsing, obtains this node address in the thread index chained list according to thread identification.
The node address that step 4, basis are obtained is carried out message with task and is sent to this chained list node message queue wait thread execution pointed, revises the task identification of this chained list node simultaneously.
Step 5, after all message in the thread message queue are complete, task identification in this node emptied restPose, task is carried out and is finished.
The 5th step, system's when operation thread control module are responsible for worker thread is managed; The thread monitor unit is monitored this thread of notice thread intervention module termination when noting abnormalities thread to worker thread in real time; Simultaneously unenforced task message in the Thread Messages response queue is returned task scheduling modules and carry out redistributing of thread; The capacity regulating unit is monitored system performance and is regulated worker thread quantity in the thread pool according to monitoring result, and detailed step is following:
Step 1, calculate certain time period CPU working time and calculate CPU usage:
For monokaryon CPU computing formula be: (T-I)/T*100%, wherein, T representes certain time period, and I is illustrated in the time that CPU in this time period is in idle condition;
For the multi-core CPU computing formula be: (T*N-I)/T*N*100%, wherein, T representes certain time period, I be illustrated in this time period whole total free time of core cpus with, N representes that CPU is to core amounts;
Monitor CPU usage in real time the capacity regulating unit, if monitoring sometime the section CPU usage always greater than 50% then think that the overweight need of system load reduce thread pool capacity execution in step 3; If monitoring sometime the section CPU usage always less than 30% then think that system load kicks the beam and need to increase thread pool capacity elevator system processing power execution in step 2; Thinking then between CPU usage remains on 30%～50% system works is more stable, the thread pool capacity is not operated.
Step 2, increase thread pool capacity, building work thread and corresponding thread response queue increase responsive node according to thread identification simultaneously in the thread concordance list;
Step 3, reduce the thread pool capacity, discharge in the thread pool idle thread and this thread place knot removal in the thread concordance list.
The described multitask process surveillance of present embodiment comprises that a plurality of distributed task schedulings are carried out the terminal, task is compiled processing server and task scheduling center;
Distributed task scheduling implementation status data collecting model as shown in Figure 2 is formed as follows:
Said distributed task scheduling carries out the terminal and task is compiled between the processing server through XML format description file transmission task implementation status;
Said task implementation status gatherer process is collected task executive process state in each task execution terminal, and preserves through formative XML description document;
Said data transfer layer is used for XML format description file is managed server through Network Transmission to the task junction;
Said task is compiled processing server and is used to receive XML format description file, and resolves and filter out redundancy and abnormal data, and the task implementation status after will filtering at last writes database;
Multithreading task scheduling centric architecture as shown in Figure 3 is formed as follows:
Said task scheduling center comprises task scheduling modules, worker thread pond and thread control module;
Said task scheduling modules is used to receive said task and compiles the task change message that processing server transmits, and it comprises task control unit and Messages-Waiting buffer zone; Said Messages-Waiting buffer zone is used to deposit message; Said task control unit is used to scan message and makes response;
Said worker thread pond is used for Processing tasks, and it comprises the thread concordance list, thread control module, task control unit and task executing units; Said thread concordance list comprises task identification, thread identification, downstream site address and thread message queue; Said thread control module is used for establishment and the release to each worker thread; Said task control unit is used for the pairing thread message queue of each thread of thread concordance list is scanned and the message of obtaining is sent to task executing units carries out; Said task executing units is used for the task of sending to change message responded and task implementation status data are encoded being sent to display of visually process monitoring terminal at last and showing;
Said thread control module is used in real time the multithreading in worker thread pond being kept watch on, and it comprises the capacity regulating unit, and thread monitor unit and thread are intervened the unit; Said capacity regulating unit is monitored system performance and is regulated worker thread quantity in the thread pool according to monitoring result; Said thread monitor unit is used for worker thread pond worker thread is kept watch on, and long-time free time and the long-time thread that interrupts are write down and preserve with the daily record form; Said thread is intervened the unit and is used for the unusual thread that the thread monitor unit is write down is discharged and redistributes.
Thread concordance list structure as shown in Figure 4 is formed as follows:
Said thread concordance list comprises task identification, thread identification, downstream site address and thread message queue;
Said task identification is used to preserve the task unique identification that is sent to the thread pool execution; Said thread identification is used to preserve the thread identification of carrying out corresponding task, and it is corresponding each other that this is identified in task identification; Said thread message queue is used to preserve the execution message of corresponding task identification, and this message queue of traversal also carries out corresponding operating according to getting access to task execution message in the thread operational process; Said downstream site address can obtain down grade data and preserve the address when carrying out the chained list traversing operation, as to get access to the downstream site address be that sky shows that then this node has been the chained list bottom.
Present embodiment reasonably distributes computational resource through the multithreading task scheduling strategy through the collection to each task status of distributed terminal, thereby realizes the quick response that multitask process is kept watch on.
The invention provides multitask process method for monitoring and the thinking of surveillance under a kind of distributed system environment; The method and the approach of concrete this technical scheme of realization are a lot, and the above only is a preferred implementation of the present invention, should be understood that; For those skilled in the art; Under the prerequisite that does not break away from the principle of the invention, can also make some improvement and retouching, these improvement and retouching also should be regarded as protection scope of the present invention.The all available prior art of each ingredient not clear and definite in the present embodiment realizes.
Claims (5)
1. the multitask process method for monitoring under the distributed system environment is characterized in that, may further comprise the steps:
The first step is carried out five kinds of states of the task executive process at terminal and is kept watch on to each task under the distributed system environment, that said five kinds of states comprise is ready, wait for, hang up, create, disappear five kinds; According to the sequence of states of task executive process ground the task implementation status of each tasks execution phases is defined as five types with it accordingly: task preparation, task waiting, tasks interrupt, task are carried out, task termination; Process is kept watch on the task implementation status that gets access to preserves through formative XML description document;
Second step, said XML format description file transfer is managed server to the task junction carry out the check that gathers of data; Filter out redundancy and abnormal data; Task implementation status after filtering is write database, send job change message informing task scheduling center simultaneously;
The 3rd step; The task scheduling center directly is submitted to task scheduling modules with these message after receiving job change message; Task scheduling modules adds the Messages-Waiting formation with the message of receiving, the scheduling controlling unit carries out real time scan principle according to first in first out after finding message to the message waiting list and responds;
The 4th step; The scheduling controlling cell response is after the task change message; Searching the thread concordance list obtains this task executions thread and transfers to this thread execution; Then do not add the distribution of Messages-Waiting formation wait thread in the scheduling controlling unit to as in the thread concordance list, inquiring the corresponding execution thread of this task, and will distribute the task of thread execution to be sent to the execution of worker thread pond according to the task grade;
The 5th step; Thread control module is kept watch on the multithreading in the worker thread pond in system's operational process in real time; And number of threads in the thread pool is increased and decreased accordingly through the capacity regulating unit according to current system load state and to make computational resource reach optimum load balance; Simultaneously long-time unenforced thread is deleted, the thread to operation irregularity reclaims simultaneously.
2. the multitask process method for monitoring under the distributed system environment according to claim 1 is characterized in that, the scheduling controlling unit is carried out following steps and realized task scheduling:
The task change message parse that step 1, basis receive goes out the task identification of this task, obtains the corresponding with it worker thread of this task according to task identification traversal thread index chained list, forwards step 5 to; If do not inquire the worker thread of this task, forward step 2 to;
Step 2, traversal thread concordance list, thus through each task identification in the thread concordance list is vertically traveled through the idle thread of obtaining unallocated task, forward step 5 to; If idle worker thread is not arranged yet, forwards step 3 to;
Step 3, this message is added the Messages-Waiting formation in scheduling controlling unit, and according to the progressive line ordering of task dispatching, task grade computing formula is following:
Wherein: R representes task priority, span 1～9;
J representes the criticality of tasks execution phases, span 1～9;
P representes the task grade that calculates;
Step 4, scheduling controlling unit real time scan waiting list, and return step 2;
Carry out in this task executions information and sending of task identification editor to worker thread pond in worker thread sign that step 5, basis are assigned to and the task change message, and task scheduling finishes.
3. the multitask process method for monitoring under the distributed system environment according to claim 2 is characterized in that, thread pool is carried out following steps:
Step 1, building work thread pool; Create the worker thread of respective numbers according to preset thread pool capacity; Open up corresponding with it message queue for each worker thread simultaneously, this message queue of real time scan obtains task parameters and accomplishes operations such as data computation and data presentation in the thread operational process;
Step 2, establishment thread concordance list; The thread concordance list is preserved the corresponding relation of task identification, thread identification, downstream site address and thread message queue with the chain sheet form, and traversal worker thread pond adds each thread identification and corresponding message queue in the thread concordance list;
The task that the scheduling controlling unit is sent in step 3, worker thread pond here is carried out message and is obtained the thread identification that will be sent to execution through parsing, obtains this node address in the thread index chained list according to thread identification;
The node address that step 4, basis are obtained is carried out message with task and is sent to this chained list node message queue wait thread execution pointed, revises the task identification of this chained list node simultaneously;
Step 5, after all message in the thread message queue are complete, task identification in this node emptied restPose, task is carried out and is finished.
4. the multitask process method for monitoring under the distributed system environment according to claim 3 is characterized in that, said capacity regulating unit is carried out following steps and realized capacity regulating:
Step 1, calculate certain time period CPU working time and calculate CPU usage:
For monokaryon CPU computing formula be: (T-I)/T*100%, wherein, T representes certain time period, and I is illustrated in the time that CPU in this time period is in idle condition;
For the multi-core CPU computing formula be: (T*N-I)/T*N*100%, wherein, T representes certain time period, I be illustrated in this time period whole total free time of core cpus with, N representes that CPU is to core amounts;
Monitor CPU usage in real time the capacity regulating unit, and CPU usage is always greater than 50% in the time period if monitor, and then the overweight need of decision-making system load reduce the thread pool capacity, execution in step 3;
CPU usage is always less than 30% in the time period if monitor, and then the decision-making system underload need increase thread pool capacity elevator system processing power, execution in step 2;
CPU usage remains on 30%～50% in the time period if monitor, and then the decision-making system working stability is not operated the thread pool capacity;
Step 2, increase thread pool capacity, building work thread and corresponding thread response queue increase responsive node according to thread identification simultaneously in the thread concordance list;
Step 3, reduce the thread pool capacity, discharge in the thread pool idle thread and this thread place knot removal in the thread concordance list.
5. a multitask process surveillance that realizes the said method of claim 1 is characterized in that, comprises that a plurality of distributed task schedulings are carried out the terminal, task is compiled processing server and task scheduling center;
Said distributed task scheduling carries out the terminal and task is compiled between the processing server through XML format description file transmission task implementation status;
Said task scheduling center comprises task scheduling modules, worker thread pond and thread control module;
Said task scheduling modules is used to receive said task and compiles the task change message that processing server transmits, and it comprises task control unit and Messages-Waiting buffer zone; Said Messages-Waiting buffer zone is used to deposit message; Said task control unit is used to scan message and makes response;
Said worker thread pond is used for Processing tasks, and it comprises the thread concordance list, thread control module, task control unit and task executing units; Said thread concordance list comprises task identification, thread identification, downstream site address and thread message queue; Said thread control module is used for establishment and the release to each worker thread; Said task control unit is used for the pairing thread message queue of each thread of thread concordance list is scanned and the message of obtaining is sent to task executing units carries out; Said task executing units is used for the task of sending to change message responded and task implementation status data are encoded being sent to display of visually process monitoring terminal at last and showing;
Said thread control module is used in real time the multithreading in worker thread pond being kept watch on, and it comprises the capacity regulating unit, and thread monitor unit and thread are intervened the unit; Said capacity regulating unit is monitored system performance and is regulated worker thread quantity in the thread pool according to monitoring result; Said thread monitor unit is used for worker thread pond worker thread is kept watch on, and long-time free time and the long-time thread that interrupts are write down and preserve with the daily record form; Said thread is intervened the unit and is used for the unusual thread that the thread monitor unit is write down is discharged and redistributes.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201110302232.9A CN102360310B (en) | 2011-09-28 | 2011-09-28 | Multitask process monitoring method in distributed system environment |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201110302232.9A CN102360310B (en) | 2011-09-28 | 2011-09-28 | Multitask process monitoring method in distributed system environment |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN102360310A true CN102360310A (en) | 2012-02-22 |
| CN102360310B CN102360310B (en) | 2014-03-26 |
Family
ID=45585642
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201110302232.9A Active CN102360310B (en) | 2011-09-28 | 2011-09-28 | Multitask process monitoring method in distributed system environment |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN102360310B (en) |
Cited By (80)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102629220A (en) * | 2012-03-08 | 2012-08-08 | 北京神州数码思特奇信息技术股份有限公司 | Dynamic task allocation and management method |
| CN102831016A (en) * | 2012-08-01 | 2012-12-19 | 浪潮(北京)电子信息产业有限公司 | Physical machine recycle method of cloud computing and device thereof |
| CN103019854A (en) * | 2012-11-20 | 2013-04-03 | 北京思特奇信息技术股份有限公司 | Distributed dynamic process management method and system |
| CN103176848A (en) * | 2011-11-08 | 2013-06-26 | 辉达公司 | Compute work distribution reference counters |
| CN103294534A (en) * | 2012-11-01 | 2013-09-11 | 北京安天电子设备有限公司 | Task management system and method of distributed system |
| CN103336574A (en) * | 2013-07-23 | 2013-10-02 | 北京百度网讯科技有限公司 | Energy-saving control method and device of data center |
| CN103377096A (en) * | 2012-04-20 | 2013-10-30 | 苏州富欣智能交通控制有限公司 | Granularity-adjustable task scheduling validation method |
| CN103679392A (en) * | 2013-12-26 | 2014-03-26 | 拉卡拉支付有限公司 | Task scheduling processing method and system |
| CN103873293A (en) * | 2014-03-05 | 2014-06-18 | 杭州华三通信技术有限公司 | Health detection device and method |
| CN103888279A (en) * | 2012-12-20 | 2014-06-25 | 阿里巴巴集团控股有限公司 | Resource pool dynamic management method and system based on feedback control cycle |
| CN103902646A (en) * | 2013-12-27 | 2014-07-02 | 北京天融信软件有限公司 | Distributed task managing system and method |
| CN104156261A (en) * | 2014-08-11 | 2014-11-19 | 浪潮(北京)电子信息产业有限公司 | Method and device for processing tasks among multiple controllers |
| CN104572277A (en) * | 2014-12-17 | 2015-04-29 | 大唐移动通信设备有限公司 | Thread flow control method and thread flow control device |
| CN104598425A (en) * | 2013-10-31 | 2015-05-06 | 中国石油天然气集团公司 | General multiprocessor parallel calculation method and system |
| CN104618681A (en) * | 2013-11-01 | 2015-05-13 | 南京中兴力维软件有限公司 | Method and device for multi-channel video condensation |
| CN104731635A (en) * | 2014-12-17 | 2015-06-24 | 华为技术有限公司 | Virtual machine access control method and virtual machine access control system |
| CN104780144A (en) * | 2014-01-13 | 2015-07-15 | 北京兆维电子(集团)有限责任公司 | Intelligent streaming media data distribution method and intelligent streaming media data distribution device |
| CN104811415A (en) * | 2014-01-23 | 2015-07-29 | 杭州迪普科技有限公司 | Method and device for balancing loads of distributed scanning system |
| CN104881483A (en) * | 2015-06-05 | 2015-09-02 | 南京大学 | Automatic detecting and evidence-taking method for Hadoop platform data leakage attack |
| CN104991824A (en) * | 2015-08-03 | 2015-10-21 | 上海斐讯数据通信技术有限公司 | Method and system for dynamically switching application program data sources |
| CN105550411A (en) * | 2015-12-07 | 2016-05-04 | 南车青岛四方机车车辆股份有限公司 | Rapid design process event monitoring method and device of high speed train |
| CN105577410A (en) * | 2014-10-16 | 2016-05-11 | 中兴通讯股份有限公司 | Real-time terminal state refreshing method and apparatus thereof |
| CN105701109A (en) * | 2014-11-26 | 2016-06-22 | 深圳市腾讯计算机系统有限公司 | File multiplex sending method and device |
| CN103268567B (en) * | 2013-03-25 | 2016-12-28 | 中国科学院沈阳自动化研究所 | The efficient mass incident detecting of Facing to Manufacturing trade management system and processing method |
| TWI564807B (en) * | 2015-11-16 | 2017-01-01 | 財團法人工業技術研究院 | Scheduling method and processing device using the same |
| CN106341231A (en) * | 2016-08-22 | 2017-01-18 | 北京信安世纪科技有限公司 | Information processing method and electronic equipment |
| CN106528065A (en) * | 2015-09-14 | 2017-03-22 | 阿里巴巴集团控股有限公司 | Thread obtaining method and device |
| CN106526427A (en) * | 2016-11-28 | 2017-03-22 | 河南理工大学 | Parallel calculation method for short-circuit current of coal mine high-voltage power grid based on load balancing |
| CN106773805A (en) * | 2016-11-15 | 2017-05-31 | 努比亚技术有限公司 | Task message processing system and method |
| CN106775990A (en) * | 2016-12-31 | 2017-05-31 | 中国移动通信集团江苏有限公司 | Request scheduling method and device |
| CN107220033A (en) * | 2017-07-05 | 2017-09-29 | 百度在线网络技术（北京）有限公司 | Method and apparatus for controlling thread pool thread quantity |
| WO2017193873A1 (en) * | 2016-05-09 | 2017-11-16 | 腾讯科技（深圳）有限公司 | Distributed processing system, data processing method, and control node apparatus |
| CN107423620A (en) * | 2017-03-12 | 2017-12-01 | 郑州云海信息技术有限公司 | The management method and device of storage server service processes |
| CN107515784A (en) * | 2016-06-16 | 2017-12-26 | 阿里巴巴集团控股有限公司 | A kind of method and apparatus of computing resource in a distributed system |
| CN107562538A (en) * | 2017-08-22 | 2018-01-09 | 中国铁道科学研究院电子计算技术研究所 | Data pick-up multitask management process and system in railway traffic statistics |
| CN107621978A (en) * | 2017-09-29 | 2018-01-23 | 郑州云海信息技术有限公司 | A kind of High Availabitity task processing Controlling model under parallel computation environment |
| CN107798111A (en) * | 2017-11-01 | 2018-03-13 | 四川长虹电器股份有限公司 | A kind of method that data are in high volume exported in distributed environment |
| CN107920136A (en) * | 2017-12-29 | 2018-04-17 | 广东欧珀移动通信有限公司 | data synchronization control method, device and server |
| CN107942753A (en) * | 2017-12-07 | 2018-04-20 | 惠州市德赛西威汽车电子股份有限公司 | The communication frame and the means of communication of the software of robot and terminal device |
| CN108509260A (en) * | 2018-01-31 | 2018-09-07 | 深圳市万普拉斯科技有限公司 | Thread identifying processing method, apparatus, computer equipment and storage medium |
| CN108595282A (en) * | 2018-05-02 | 2018-09-28 | 广州市巨硅信息科技有限公司 | A kind of implementation method of high concurrent message queue |
| CN108762725A (en) * | 2018-05-31 | 2018-11-06 | 飞天诚信科技股份有限公司 | A kind of method and system that distributed random number is generated and detected |
| CN108874550A (en) * | 2018-07-18 | 2018-11-23 | 郑州云海信息技术有限公司 | A kind of method, apparatus, storage medium and computer equipment adjusting thread pool |
| CN108874533A (en) * | 2018-01-08 | 2018-11-23 | 深圳市铱硙医疗科技有限公司 | Handle the server distribution method and device of MRI image |
| CN109189726A (en) * | 2018-08-08 | 2019-01-11 | 北京奇安信科技有限公司 | A kind of processing method and processing device for reading and writing log |
| CN109582445A (en) * | 2018-09-29 | 2019-04-05 | 阿里巴巴集团控股有限公司 | Message treatment method, device, electronic equipment and computer readable storage medium |
| CN110086688A (en) * | 2019-04-18 | 2019-08-02 | 上海锵戈科技有限公司 | It is a kind of to monitor the efficient end the IP performance monitoring dispatching method of task multiple target and system more |
| WO2019148728A1 (en) * | 2018-02-01 | 2019-08-08 | 平安科技（深圳）有限公司 | Electronic device, execution task assignment method for distributed system, and storage medium |
| CN110765663A (en) * | 2019-11-25 | 2020-02-07 | 中冶赛迪重庆信息技术有限公司 | Concurrent processing method and system based on parametric simulation |
| CN110825512A (en) * | 2019-11-08 | 2020-02-21 | 东南数字经济发展研究院 | Universal distributed system design and C + + implementation thereof |
| CN110888726A (en) * | 2019-11-25 | 2020-03-17 | 中冶赛迪重庆信息技术有限公司 | Multitask concurrent processing method and system |
| CN110928664A (en) * | 2019-12-02 | 2020-03-27 | 南京甄视智能科技有限公司 | Distributed face searching method and system based on multiple message threads |
| CN111010313A (en) * | 2019-12-05 | 2020-04-14 | 深圳联想懂的通信有限公司 | Batch processing state monitoring method, server and storage medium |
| CN111026543A (en) * | 2019-10-31 | 2020-04-17 | 北京浪潮数据技术有限公司 | Method, device, equipment and medium for forwarding data in storage system |
| CN111045797A (en) * | 2019-10-31 | 2020-04-21 | 华控清交信息科技(北京)有限公司 | Task scheduling execution method, related device and medium |
| CN111124651A (en) * | 2019-12-27 | 2020-05-08 | 中通服公众信息产业股份有限公司 | Method for multithreading concurrent scheduling in distributed environment |
| CN111124625A (en) * | 2018-10-30 | 2020-05-08 | 阿里巴巴集团控股有限公司 | Processing method and device of task queue and storage medium |
| CN111240857A (en) * | 2020-01-03 | 2020-06-05 | 上海瀚之友信息技术服务有限公司 | Remote service calling system and method |
| CN111338803A (en) * | 2020-03-16 | 2020-06-26 | 北京达佳互联信息技术有限公司 | Thread processing method and device |
| CN111399951A (en) * | 2020-03-05 | 2020-07-10 | 北京云族佳科技有限公司 | Computer working data acquisition, analysis and display method and device and electronic equipment |
| CN111488214A (en) * | 2020-04-17 | 2020-08-04 | 上海智殷自动化科技有限公司 | Communication method between multiple tasks under real-time system |
| CN111651789A (en) * | 2020-06-05 | 2020-09-11 | 北京明朝万达科技股份有限公司 | Multithreading safety batch feedback method and device based on scanning system |
| CN111757145A (en) * | 2020-07-31 | 2020-10-09 | 四川巧夺天工信息安全智能设备有限公司 | Method for processing monitoring videos with balanced multipath loads in batch |
| CN112148493A (en) * | 2020-09-30 | 2020-12-29 | 武汉中科通达高新技术股份有限公司 | Streaming media task management method and device and data server |
| CN112328388A (en) * | 2020-09-17 | 2021-02-05 | 北京中数科技术有限公司 | Parallel computing method and system fusing multithreading and distributed technology |
| CN112817762A (en) * | 2021-01-29 | 2021-05-18 | 中汽创智科技有限公司 | Dispatching system based on adaptive automobile open system architecture standard and dispatching method thereof |
| CN112865311A (en) * | 2021-01-15 | 2021-05-28 | 北京科东电力控制系统有限责任公司 | Method and device for monitoring message bus of power system |
| CN112882903A (en) * | 2020-12-23 | 2021-06-01 | 沈阳世纪高通科技有限公司 | Distributed monitoring method |
| CN113238854A (en) * | 2021-07-07 | 2021-08-10 | 苏州浪潮智能科技有限公司 | Method, device and equipment for automatically adjusting thread number and readable medium |
| CN113259632A (en) * | 2021-06-23 | 2021-08-13 | 国网智能科技股份有限公司 | Distributed concurrent inspection system and method for video equipment of transformer substation |
| CN113407633A (en) * | 2018-09-13 | 2021-09-17 | 华东交通大学 | Distributed data source heterogeneous synchronization method |
| CN113485811A (en) * | 2021-07-23 | 2021-10-08 | 平安科技（深圳）有限公司 | Computing task management method and device, computer equipment and storage medium |
| WO2021208786A1 (en) * | 2020-04-13 | 2021-10-21 | 华为技术有限公司 | Thread management method and apparatus |
| CN114579012A (en) * | 2022-03-03 | 2022-06-03 | 北京天智鲲鹏技术有限公司 | Cross-application workflow arrangement and scheduling method |
| CN114691375A (en) * | 2022-06-02 | 2022-07-01 | 青岛展诚科技有限公司 | Integrated circuit resistance extraction method based on parallel algorithm |
| CN114896295A (en) * | 2022-07-12 | 2022-08-12 | 云启智慧科技有限公司 | Data desensitization method, desensitization device and desensitization system in big data scene |
| CN115934365A (en) * | 2023-03-10 | 2023-04-07 | 深圳华龙讯达信息技术股份有限公司 | Task scheduling coupling system applied to CPU |
| CN116909780A (en) * | 2023-09-12 | 2023-10-20 | 天津卓朗昆仑云软件技术有限公司 | Memory-based local distributed queue plug-in, system and queue processing method |
| CN116932335A (en) * | 2023-09-18 | 2023-10-24 | 中国电子科技集团公司第十五研究所 | Task flow monitoring method and system based on network transmission in domestic environment |
| CN116954927A (en) * | 2023-09-07 | 2023-10-27 | 建信住房服务有限责任公司 | Distributed heterogeneous data acquisition method, storage medium and electronic equipment |
Families Citing this family (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107818016A (en) * | 2017-11-22 | 2018-03-20 | 苏州麦迪斯顿医疗科技股份有限公司 | Server application design method, request event processing method and processing device |
| CN110737534B (en) * | 2019-10-29 | 2021-05-25 | 京东数字科技控股有限公司 | Task processing method and device and server |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101135981A (en) * | 2007-08-29 | 2008-03-05 | 中兴通讯股份有限公司 | Method and device for realizing batch report generation |
| CN101599027A (en) * | 2009-06-30 | 2009-12-09 | 中兴通讯股份有限公司 | A kind of thread pool management method and system thereof |
| CN101777008A (en) * | 2009-12-31 | 2010-07-14 | 中兴通讯股份有限公司 | Method and device for realizing mobile terminal system thread pool |
| US20110046840A1 (en) * | 2005-01-04 | 2011-02-24 | Gm Global Technology Operations, Inc. | Method and apparatus for communication within control systems |
-
2011
- 2011-09-28 CN CN201110302232.9A patent/CN102360310B/en active Active
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20110046840A1 (en) * | 2005-01-04 | 2011-02-24 | Gm Global Technology Operations, Inc. | Method and apparatus for communication within control systems |
| CN101135981A (en) * | 2007-08-29 | 2008-03-05 | 中兴通讯股份有限公司 | Method and device for realizing batch report generation |
| CN101599027A (en) * | 2009-06-30 | 2009-12-09 | 中兴通讯股份有限公司 | A kind of thread pool management method and system thereof |
| CN101777008A (en) * | 2009-12-31 | 2010-07-14 | 中兴通讯股份有限公司 | Method and device for realizing mobile terminal system thread pool |
Cited By (116)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103176848A (en) * | 2011-11-08 | 2013-06-26 | 辉达公司 | Compute work distribution reference counters |
| CN102629220A (en) * | 2012-03-08 | 2012-08-08 | 北京神州数码思特奇信息技术股份有限公司 | Dynamic task allocation and management method |
| CN103377096A (en) * | 2012-04-20 | 2013-10-30 | 苏州富欣智能交通控制有限公司 | Granularity-adjustable task scheduling validation method |
| CN103377096B (en) * | 2012-04-20 | 2016-03-23 | 苏州富欣智能交通控制有限公司 | The task scheduling verification method that granularity is adjustable |
| CN102831016A (en) * | 2012-08-01 | 2012-12-19 | 浪潮(北京)电子信息产业有限公司 | Physical machine recycle method of cloud computing and device thereof |
| CN102831016B (en) * | 2012-08-01 | 2014-10-01 | 浪潮(北京)电子信息产业有限公司 | Physical machine recycle method of cloud computing and device thereof |
| CN103294534A (en) * | 2012-11-01 | 2013-09-11 | 北京安天电子设备有限公司 | Task management system and method of distributed system |
| CN103019854A (en) * | 2012-11-20 | 2013-04-03 | 北京思特奇信息技术股份有限公司 | Distributed dynamic process management method and system |
| CN103888279A (en) * | 2012-12-20 | 2014-06-25 | 阿里巴巴集团控股有限公司 | Resource pool dynamic management method and system based on feedback control cycle |
| CN103268567B (en) * | 2013-03-25 | 2016-12-28 | 中国科学院沈阳自动化研究所 | The efficient mass incident detecting of Facing to Manufacturing trade management system and processing method |
| CN103336574A (en) * | 2013-07-23 | 2013-10-02 | 北京百度网讯科技有限公司 | Energy-saving control method and device of data center |
| CN104598425A (en) * | 2013-10-31 | 2015-05-06 | 中国石油天然气集团公司 | General multiprocessor parallel calculation method and system |
| CN104618681B (en) * | 2013-11-01 | 2019-03-26 | 南京中兴力维软件有限公司 | Multi-channel video concentration method and device thereof |
| CN104618681A (en) * | 2013-11-01 | 2015-05-13 | 南京中兴力维软件有限公司 | Method and device for multi-channel video condensation |
| CN103679392A (en) * | 2013-12-26 | 2014-03-26 | 拉卡拉支付有限公司 | Task scheduling processing method and system |
| CN103679392B (en) * | 2013-12-26 | 2018-01-09 | 拉卡拉支付股份有限公司 | A kind of task scheduling processing method and system |
| CN103902646B (en) * | 2013-12-27 | 2017-04-19 | 北京天融信软件有限公司 | Distributed task managing system and method |
| CN103902646A (en) * | 2013-12-27 | 2014-07-02 | 北京天融信软件有限公司 | Distributed task managing system and method |
| CN104780144B (en) * | 2014-01-13 | 2019-03-01 | 北京兆维电子(集团)有限责任公司 | Intelligent stream medium data distribution method and device |
| CN104780144A (en) * | 2014-01-13 | 2015-07-15 | 北京兆维电子(集团)有限责任公司 | Intelligent streaming media data distribution method and intelligent streaming media data distribution device |
| CN104811415A (en) * | 2014-01-23 | 2015-07-29 | 杭州迪普科技有限公司 | Method and device for balancing loads of distributed scanning system |
| CN104811415B (en) * | 2014-01-23 | 2018-07-24 | 杭州迪普科技股份有限公司 | Distributed Scans system load balancing method and device |
| CN103873293B (en) * | 2014-03-05 | 2018-06-12 | 新华三技术有限公司 | A kind of healthprobe device and method |
| CN103873293A (en) * | 2014-03-05 | 2014-06-18 | 杭州华三通信技术有限公司 | Health detection device and method |
| CN104156261A (en) * | 2014-08-11 | 2014-11-19 | 浪潮(北京)电子信息产业有限公司 | Method and device for processing tasks among multiple controllers |
| CN105577410A (en) * | 2014-10-16 | 2016-05-11 | 中兴通讯股份有限公司 | Real-time terminal state refreshing method and apparatus thereof |
| CN105701109A (en) * | 2014-11-26 | 2016-06-22 | 深圳市腾讯计算机系统有限公司 | File multiplex sending method and device |
| CN105701109B (en) * | 2014-11-26 | 2019-12-03 | 深圳市腾讯计算机系统有限公司 | The method and device that file multichannel is sent |
| CN104572277A (en) * | 2014-12-17 | 2015-04-29 | 大唐移动通信设备有限公司 | Thread flow control method and thread flow control device |
| CN104572277B (en) * | 2014-12-17 | 2018-04-27 | 大唐移动通信设备有限公司 | A kind of thread flow control method and device |
| CN104731635A (en) * | 2014-12-17 | 2015-06-24 | 华为技术有限公司 | Virtual machine access control method and virtual machine access control system |
| CN104881483B (en) * | 2015-06-05 | 2018-01-09 | 南京大学 | Automatic detection evidence collecting method for the attack of Hadoop platform leaking data |
| CN104881483A (en) * | 2015-06-05 | 2015-09-02 | 南京大学 | Automatic detecting and evidence-taking method for Hadoop platform data leakage attack |
| CN104991824A (en) * | 2015-08-03 | 2015-10-21 | 上海斐讯数据通信技术有限公司 | Method and system for dynamically switching application program data sources |
| CN106528065B (en) * | 2015-09-14 | 2019-11-08 | 阿里巴巴集团控股有限公司 | A kind of thread acquisition methods and equipment |
| CN106528065A (en) * | 2015-09-14 | 2017-03-22 | 阿里巴巴集团控股有限公司 | Thread obtaining method and device |
| US10268519B2 (en) | 2015-11-16 | 2019-04-23 | Industrial Technology Research Institute | Scheduling method and processing device for thread groups execution in a computing system |
| TWI564807B (en) * | 2015-11-16 | 2017-01-01 | 財團法人工業技術研究院 | Scheduling method and processing device using the same |
| CN105550411B (en) * | 2015-12-07 | 2019-08-27 | 中车青岛四方机车车辆股份有限公司 | A kind of flow events monitor method and device that bullet train quickly designs |
| CN105550411A (en) * | 2015-12-07 | 2016-05-04 | 南车青岛四方机车车辆股份有限公司 | Rapid design process event monitoring method and device of high speed train |
| CN107357639A (en) * | 2016-05-09 | 2017-11-17 | 腾讯科技（深圳）有限公司 | A kind of distributed processing system(DPS), the method and apparatus of data processing |
| CN107357639B (en) * | 2016-05-09 | 2019-09-17 | 腾讯科技（深圳）有限公司 | A kind of distributed processing system(DPS), data processing method and apparatus |
| WO2017193873A1 (en) * | 2016-05-09 | 2017-11-16 | 腾讯科技（深圳）有限公司 | Distributed processing system, data processing method, and control node apparatus |
| US10432455B2 (en) | 2016-05-09 | 2019-10-01 | Tencent Technology (Shenzhen) Company Limited | Distributed processing system, data processing method, and control node device |
| CN107515784A (en) * | 2016-06-16 | 2017-12-26 | 阿里巴巴集团控股有限公司 | A kind of method and apparatus of computing resource in a distributed system |
| CN106341231A (en) * | 2016-08-22 | 2017-01-18 | 北京信安世纪科技有限公司 | Information processing method and electronic equipment |
| CN106773805A (en) * | 2016-11-15 | 2017-05-31 | 努比亚技术有限公司 | Task message processing system and method |
| CN106526427A (en) * | 2016-11-28 | 2017-03-22 | 河南理工大学 | Parallel calculation method for short-circuit current of coal mine high-voltage power grid based on load balancing |
| CN106526427B (en) * | 2016-11-28 | 2018-11-06 | 河南理工大学 | A kind of coalmine high-voltage power network short circuit current parallel calculating method based on load balancing |
| CN106775990A (en) * | 2016-12-31 | 2017-05-31 | 中国移动通信集团江苏有限公司 | Request scheduling method and device |
| CN107423620A (en) * | 2017-03-12 | 2017-12-01 | 郑州云海信息技术有限公司 | The management method and device of storage server service processes |
| CN107220033A (en) * | 2017-07-05 | 2017-09-29 | 百度在线网络技术（北京）有限公司 | Method and apparatus for controlling thread pool thread quantity |
| CN107562538A (en) * | 2017-08-22 | 2018-01-09 | 中国铁道科学研究院电子计算技术研究所 | Data pick-up multitask management process and system in railway traffic statistics |
| CN107562538B (en) * | 2017-08-22 | 2020-01-07 | 中国铁道科学研究院电子计算技术研究所 | Data extraction multitask management method and system in railway transportation statistics |
| CN107621978A (en) * | 2017-09-29 | 2018-01-23 | 郑州云海信息技术有限公司 | A kind of High Availabitity task processing Controlling model under parallel computation environment |
| CN107798111A (en) * | 2017-11-01 | 2018-03-13 | 四川长虹电器股份有限公司 | A kind of method that data are in high volume exported in distributed environment |
| CN107942753A (en) * | 2017-12-07 | 2018-04-20 | 惠州市德赛西威汽车电子股份有限公司 | The communication frame and the means of communication of the software of robot and terminal device |
| CN107942753B (en) * | 2017-12-07 | 2020-08-25 | 惠州市德赛西威汽车电子股份有限公司 | Communication framework and communication method for software of robot and terminal equipment |
| CN107920136B (en) * | 2017-12-29 | 2019-09-17 | Oppo广东移动通信有限公司 | Data synchronization control method, device and server |
| CN107920136A (en) * | 2017-12-29 | 2018-04-17 | 广东欧珀移动通信有限公司 | data synchronization control method, device and server |
| CN108874533A (en) * | 2018-01-08 | 2018-11-23 | 深圳市铱硙医疗科技有限公司 | Handle the server distribution method and device of MRI image |
| CN108509260A (en) * | 2018-01-31 | 2018-09-07 | 深圳市万普拉斯科技有限公司 | Thread identifying processing method, apparatus, computer equipment and storage medium |
| CN108509260B (en) * | 2018-01-31 | 2021-08-13 | 深圳市万普拉斯科技有限公司 | Thread identification processing method and device, computer equipment and storage medium |
| WO2019148728A1 (en) * | 2018-02-01 | 2019-08-08 | 平安科技（深圳）有限公司 | Electronic device, execution task assignment method for distributed system, and storage medium |
| CN108595282A (en) * | 2018-05-02 | 2018-09-28 | 广州市巨硅信息科技有限公司 | A kind of implementation method of high concurrent message queue |
| CN108762725A (en) * | 2018-05-31 | 2018-11-06 | 飞天诚信科技股份有限公司 | A kind of method and system that distributed random number is generated and detected |
| CN108762725B (en) * | 2018-05-31 | 2021-01-01 | 飞天诚信科技股份有限公司 | Distributed random number generation and detection method and system |
| CN108874550A (en) * | 2018-07-18 | 2018-11-23 | 郑州云海信息技术有限公司 | A kind of method, apparatus, storage medium and computer equipment adjusting thread pool |
| CN109189726A (en) * | 2018-08-08 | 2019-01-11 | 北京奇安信科技有限公司 | A kind of processing method and processing device for reading and writing log |
| CN109189726B (en) * | 2018-08-08 | 2020-12-22 | 奇安信科技集团股份有限公司 | Processing method and device for read-write log |
| CN113407633A (en) * | 2018-09-13 | 2021-09-17 | 华东交通大学 | Distributed data source heterogeneous synchronization method |
| CN109582445A (en) * | 2018-09-29 | 2019-04-05 | 阿里巴巴集团控股有限公司 | Message treatment method, device, electronic equipment and computer readable storage medium |
| CN111124625B (en) * | 2018-10-30 | 2024-03-26 | 阿里云计算有限公司 | Task queue processing method and device and storage medium |
| CN111124625A (en) * | 2018-10-30 | 2020-05-08 | 阿里巴巴集团控股有限公司 | Processing method and device of task queue and storage medium |
| CN110086688A (en) * | 2019-04-18 | 2019-08-02 | 上海锵戈科技有限公司 | It is a kind of to monitor the efficient end the IP performance monitoring dispatching method of task multiple target and system more |
| CN111026543A (en) * | 2019-10-31 | 2020-04-17 | 北京浪潮数据技术有限公司 | Method, device, equipment and medium for forwarding data in storage system |
| CN111045797A (en) * | 2019-10-31 | 2020-04-21 | 华控清交信息科技(北京)有限公司 | Task scheduling execution method, related device and medium |
| CN111026543B (en) * | 2019-10-31 | 2023-06-16 | 北京浪潮数据技术有限公司 | Method, device, equipment and medium for forwarding data by storage system |
| CN110825512A (en) * | 2019-11-08 | 2020-02-21 | 东南数字经济发展研究院 | Universal distributed system design and C + + implementation thereof |
| CN110888726A (en) * | 2019-11-25 | 2020-03-17 | 中冶赛迪重庆信息技术有限公司 | Multitask concurrent processing method and system |
| CN110765663A (en) * | 2019-11-25 | 2020-02-07 | 中冶赛迪重庆信息技术有限公司 | Concurrent processing method and system based on parametric simulation |
| CN110928664A (en) * | 2019-12-02 | 2020-03-27 | 南京甄视智能科技有限公司 | Distributed face searching method and system based on multiple message threads |
| CN111010313A (en) * | 2019-12-05 | 2020-04-14 | 深圳联想懂的通信有限公司 | Batch processing state monitoring method, server and storage medium |
| CN111124651B (en) * | 2019-12-27 | 2023-05-23 | 中通服公众信息产业股份有限公司 | Method for concurrently scheduling multiple threads in distributed environment |
| CN111124651A (en) * | 2019-12-27 | 2020-05-08 | 中通服公众信息产业股份有限公司 | Method for multithreading concurrent scheduling in distributed environment |
| CN111240857A (en) * | 2020-01-03 | 2020-06-05 | 上海瀚之友信息技术服务有限公司 | Remote service calling system and method |
| CN111240857B (en) * | 2020-01-03 | 2023-02-21 | 上海瀚之友信息技术服务有限公司 | Remote service calling system and method |
| CN111399951A (en) * | 2020-03-05 | 2020-07-10 | 北京云族佳科技有限公司 | Computer working data acquisition, analysis and display method and device and electronic equipment |
| CN111338803A (en) * | 2020-03-16 | 2020-06-26 | 北京达佳互联信息技术有限公司 | Thread processing method and device |
| CN111338803B (en) * | 2020-03-16 | 2024-01-09 | 北京达佳互联信息技术有限公司 | Thread processing method and device |
| WO2021208786A1 (en) * | 2020-04-13 | 2021-10-21 | 华为技术有限公司 | Thread management method and apparatus |
| CN111488214A (en) * | 2020-04-17 | 2020-08-04 | 上海智殷自动化科技有限公司 | Communication method between multiple tasks under real-time system |
| CN111651789B (en) * | 2020-06-05 | 2023-04-14 | 北京明朝万达科技股份有限公司 | Multithreading safety batch feedback method and device based on scanning system |
| CN111651789A (en) * | 2020-06-05 | 2020-09-11 | 北京明朝万达科技股份有限公司 | Multithreading safety batch feedback method and device based on scanning system |
| CN111757145A (en) * | 2020-07-31 | 2020-10-09 | 四川巧夺天工信息安全智能设备有限公司 | Method for processing monitoring videos with balanced multipath loads in batch |
| CN112328388A (en) * | 2020-09-17 | 2021-02-05 | 北京中数科技术有限公司 | Parallel computing method and system fusing multithreading and distributed technology |
| CN112148493A (en) * | 2020-09-30 | 2020-12-29 | 武汉中科通达高新技术股份有限公司 | Streaming media task management method and device and data server |
| CN112882903A (en) * | 2020-12-23 | 2021-06-01 | 沈阳世纪高通科技有限公司 | Distributed monitoring method |
| CN112865311A (en) * | 2021-01-15 | 2021-05-28 | 北京科东电力控制系统有限责任公司 | Method and device for monitoring message bus of power system |
| CN112865311B (en) * | 2021-01-15 | 2022-11-01 | 北京科东电力控制系统有限责任公司 | Method and device for monitoring message bus of power system |
| CN112817762A (en) * | 2021-01-29 | 2021-05-18 | 中汽创智科技有限公司 | Dispatching system based on adaptive automobile open system architecture standard and dispatching method thereof |
| CN113259632A (en) * | 2021-06-23 | 2021-08-13 | 国网智能科技股份有限公司 | Distributed concurrent inspection system and method for video equipment of transformer substation |
| CN113238854B (en) * | 2021-07-07 | 2021-11-19 | 苏州浪潮智能科技有限公司 | Method, device and equipment for automatically adjusting thread number and readable medium |
| CN113238854A (en) * | 2021-07-07 | 2021-08-10 | 苏州浪潮智能科技有限公司 | Method, device and equipment for automatically adjusting thread number and readable medium |
| CN113485811A (en) * | 2021-07-23 | 2021-10-08 | 平安科技（深圳）有限公司 | Computing task management method and device, computer equipment and storage medium |
| CN114579012B (en) * | 2022-03-03 | 2024-03-29 | 北京天智鲲鹏技术有限公司 | Cross-application workflow arrangement and scheduling method |
| CN114579012A (en) * | 2022-03-03 | 2022-06-03 | 北京天智鲲鹏技术有限公司 | Cross-application workflow arrangement and scheduling method |
| CN114691375A (en) * | 2022-06-02 | 2022-07-01 | 青岛展诚科技有限公司 | Integrated circuit resistance extraction method based on parallel algorithm |
| CN114896295A (en) * | 2022-07-12 | 2022-08-12 | 云启智慧科技有限公司 | Data desensitization method, desensitization device and desensitization system in big data scene |
| CN115934365A (en) * | 2023-03-10 | 2023-04-07 | 深圳华龙讯达信息技术股份有限公司 | Task scheduling coupling system applied to CPU |
| CN116954927A (en) * | 2023-09-07 | 2023-10-27 | 建信住房服务有限责任公司 | Distributed heterogeneous data acquisition method, storage medium and electronic equipment |
| CN116954927B (en) * | 2023-09-07 | 2023-12-01 | 建信住房服务有限责任公司 | Distributed heterogeneous data acquisition method, storage medium and electronic equipment |
| CN116909780B (en) * | 2023-09-12 | 2023-11-17 | 天津卓朗昆仑云软件技术有限公司 | Memory-based local distributed queue plug-in, system and queue processing method |
| CN116909780A (en) * | 2023-09-12 | 2023-10-20 | 天津卓朗昆仑云软件技术有限公司 | Memory-based local distributed queue plug-in, system and queue processing method |
| CN116932335A (en) * | 2023-09-18 | 2023-10-24 | 中国电子科技集团公司第十五研究所 | Task flow monitoring method and system based on network transmission in domestic environment |
| CN116932335B (en) * | 2023-09-18 | 2024-02-13 | 中国电子科技集团公司第十五研究所 | Task flow monitoring method and system based on network transmission in domestic environment |
Also Published As
| Publication number | Publication date |
|---|---|
| CN102360310B (en) | 2014-03-26 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN102360310B (en) | Multitask process monitoring method in distributed system environment | |
| CN102063336B (en) | Distributed computing multiple application function asynchronous concurrent scheduling method | |
| CN106202346B (en) | A kind of data load cleaning engine, scheduling and storage system | |
| CN105978960B (en) | A kind of cloud scheduling system and method based on massive video structuring processing | |
| CN102118261A (en) | Method and device for data acquisition, and network management equipment | |
| CN102043675B (en) | Thread pool management method based on task quantity of task processing request | |
| CN101652750B (en) | Data processing device, distributed processing system and data processing method | |
| CN107025139A (en) | A kind of high-performance calculation Scheduling Framework based on cloud computing | |
| CN101086711B (en) | Mission management method of multiple-mission operation system | |
| CN101464811A (en) | Multitask monitoring management system | |
| CN102193832A (en) | Cloud computing resource scheduling method and applied system | |
| CN105447088A (en) | Volunteer computing based multi-tenant professional cloud crawler | |
| CN102012840A (en) | Batch data scheduling method and system | |
| CN107193960A (en) | A kind of distributed reptile system and periodicity increment grasping means | |
| JP2002189841A (en) | Workflow management method and system, and recording medium storing its processing program | |
| CN108009258A (en) | It is a kind of can Configuration Online data collection and analysis platform | |
| CN102508639A (en) | Distributed parallel processing method based on satellite remote sensing data characteristics | |
| CN101364108B (en) | Dynamic dispatching method for workshop working based on matter drive in complex large system environment | |
| CN101424941B (en) | Control implementing method and system | |
| CN101582043A (en) | Dynamic task allocation method of heterogeneous computing system | |
| CN112559159A (en) | Task scheduling method based on distributed deployment | |
| CN105320565B (en) | A kind of computer scheduling of resource method for a variety of application software | |
| CN105608138A (en) | System for optimizing parallel data loading performance of array databases | |
| CN107135123A (en) | A kind of concocting method in the dynamic pond of RACK server resources | |
| CN113342826A (en) | Method, storage medium and system for uniformly managing data operations of different data acquisition engines |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |