TWI552079B - Intelligent multi - layer job assignment system and its - Google Patents
Intelligent multi - layer job assignment system and its Download PDFInfo
- Publication number
- TWI552079B TWI552079B TW102133788A TW102133788A TWI552079B TW I552079 B TWI552079 B TW I552079B TW 102133788 A TW102133788 A TW 102133788A TW 102133788 A TW102133788 A TW 102133788A TW I552079 B TWI552079 B TW I552079B
- Authority
- TW
- Taiwan
- Prior art keywords
- work
- module
- level
- delivery work
- delivery
- Prior art date
Links
Landscapes
- Computer And Data Communications (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Description
本發明是有關於一種智慧型多層式工作指派系統及其方法,特別是有關於一種可依據系統負荷,動態擴增派工層級以加速工作的執行效能,亦可動態收斂派工層級,降低系統負擔,進而有效控制系統執行效能之智慧型多層式工作指派系統及其方法。 The invention relates to a smart multi-layer work assignment system and a method thereof, in particular to a system that can dynamically augment a dispatch level according to system load to accelerate the execution performance of the work, and can also dynamically converge the dispatch level and reduce the system. A smart multi-layer work assignment system and method for effectively controlling system performance.
有效率的使用系統資源一直是資訊系統執行模組設計的重要設計考量,一個好的執行模組不但可以有效應用系統資源,也可提升系統服務效能,最大化系統產出;相反的,若是錯誤的執行模組設計會造成系統資源的浪費,導致系統產出效能不彰,造成使用者對系統的評價不佳。 Efficient use of system resources has always been an important design consideration for information system execution module design. A good execution module can not only effectively apply system resources, but also improve system service performance and maximize system output. On the contrary, if it is wrong The execution module design will cause a waste of system resources, resulting in poor system output performance, resulting in poor user evaluation of the system.
大型的資訊系統常以分散式架構作為效能考量的基本架構,但建置一個分散式架構所耗費的成本往往不是一個小型的專案所能負擔。其中包含分散式架構的硬體成本、軟體維護成本、軟體開發成本等,都是許多小型專案無法踏入分散式架構的一大阻礙,進而使這些專案在遇到一些需大資料運算的工作時,除了須以後端執行以外,還必須將任務的排程定義在系統閒暇時間,方可確保系統運作不被影響,此種策略不但犧牲了任務的時效性,另外因固定的排程,也使系統的彈性降低。 Large-scale information systems often use a decentralized architecture as the basic architecture for performance considerations, but the cost of building a decentralized architecture is often not affordable for a small project. The hardware cost of distributed architecture, software maintenance cost, software development cost, etc., are many obstacles that many small projects can't step into the decentralized architecture, which makes these projects encounter some work that requires large data operations. In addition to the execution of the back end, the schedule of the task must be defined in the system leisure time to ensure that the system operation is not affected. This strategy not only sacrifices the timeliness of the task, but also makes it due to the fixed schedule. The flexibility of the system is reduced.
有鑑於上述習知技藝之問題,本發明之目的就是在提供一種智慧型多層式工作指派系統及其方法,藉以改善排程任務的彈性,並可有效的運用有限的資源來提升系統的產出。 In view of the above problems of the prior art, the object of the present invention is to provide a smart multi-layer work assignment system and method thereof, thereby improving the flexibility of scheduling tasks and effectively using limited resources to improve system output. .
根據本發明之目的,提出一種智慧型多層式工作指派系統,適用於一資訊系統中。此智慧型多層式工作指派系統包含一工作管理模組、一多元樹架構模組及一動態擴增與收斂派工層級模組。工作管理模組 係接收一交付工作,並解析出交付工作所對應之一執行參數。多元樹架構模組係接收交付工作及執行參數,以依據執行參數來架構出對應交付工作之一多元樹結構,其中多元樹結構以樹狀分支方式形成有複數個層級,下一個層級係由上一個層級中至少一個節點向下分支為複數個節點所形成。動態擴增與收斂派工層級模組係執行交付工作,此動態擴增與收斂派工層級模組將依據資訊系統之負荷狀態選擇性地優先處理交付工作所對應之多元樹結構之其中一個層級,且動態擴增與收斂派工層級模組係週期性地偵測資訊系統之負荷狀態,以選擇性地擴增處理至下一個層級或收斂至上一層級,直至執行處理完所有層級中之節點。 In accordance with the purpose of the present invention, a smart multi-layer work assignment system is proposed for use in an information system. The intelligent multi-layer work assignment system includes a work management module, a multi-tree architecture module, and a dynamic amplification and convergence dispatch level module. Work management module The system receives a delivery job and parses out one of the execution parameters corresponding to the delivery work. The multi-tree architecture module receives the delivery work and execution parameters to construct a multi-tree structure corresponding to the delivery work according to the execution parameters, wherein the multi-tree structure is formed into a plurality of levels in a tree branch manner, and the next hierarchical level is At least one node in the previous hierarchy is formed by branching down to a plurality of nodes. The dynamic amplification and convergence dispatching level module performs the delivery work, and the dynamic amplification and convergence dispatching level module will selectively prioritize one of the hierarchical structures corresponding to the delivery work according to the load state of the information system. And the dynamic amplification and convergence dispatching level module periodically detects the load state of the information system to selectively amplify the processing to the next level or to the upper level until the nodes in all the levels are processed. .
較佳地,本發明所述之智慧型多層式工作指派系統,其更包含一資料庫模組,係儲存交付工作、執行參數及多元樹結構。 Preferably, the intelligent multi-layer work assignment system of the present invention further comprises a database module for storing delivery work, execution parameters and multi-tree structure.
較佳地,當動態擴增與收斂派工層級模組偵測資訊系統之負荷狀態小於一設定下限值時,將動態選定目前處理層級中之至少一個節點以進行擴增,以擴增執行被選定節點之下一個層級中的多個分支節點;若偵測到之負荷狀態大於一設定上限值時,動態擴增與收斂派工層級模組則將收斂目前處理層級中之部份或全部節點至其所對應之上一個層級之節點。 Preferably, when the load state of the dynamic amplification and convergence dispatch level module detection information system is less than a set lower limit value, at least one node in the current processing level is dynamically selected for amplification to perform amplification. Multiple branch nodes in a hierarchy below the selected node; if the detected load state is greater than a set upper limit, the dynamic amplification and convergence dispatch level module will converge some of the current processing levels or All nodes to the nodes of a hierarchy above them.
較佳地,工作管理模組係依據交付工作之工作類型解析出執行參數並儲存至資料庫模組中,且工作管理模組係依據資訊系統之負荷狀態來選擇性地將交付工作傳遞至多元樹架構模組,使多元樹架構模組由資料庫模組中取得執行參數以對交付工作進行多元樹結構之架構。。 Preferably, the work management module parses the execution parameters according to the work type of the delivery work and stores them in the database module, and the work management module selectively transmits the delivery work to the plurality according to the load status of the information system. The tree architecture module enables the multi-tree architecture module to obtain execution parameters from the database module to construct a multi-tree structure for delivery work. .
較佳地,資訊系統之負荷狀態包含記憶體使用率以及CPU使用率。 Preferably, the load status of the information system includes memory usage and CPU usage.
根據本發明之目的,又提出一種智慧型多層式工作指派方法適用於一資訊系統,此方法包含下列步驟:經由一工作管理模組接收一交付工作,並解析出交付工作所對應之一執行參數;藉由一多元樹架構模組接收交付工作及執行參數,以依據執行參數來架構出對應交付工作之一多元樹結構,其中,多元樹結構以樹狀分支方式形成有複數個層級,下一個層級係由上一個層級中至少一個節點向下分支為複數個節點所形成;以及 利用一動態擴增與收斂派工層級模組依據資訊系統之負荷狀態選擇性地優先處理交付工作所對應之多元樹結構之其中一個層級,且動態擴增與收斂派工層級模組係週期性地偵測資訊系統之負荷狀態,以選擇性地擴增處理至下一個層級或收斂至上一層級,直至執行處理完交付工作之所有層級中之節點。 According to the object of the present invention, a smart multi-layer work assignment method is further applied to an information system, the method comprising the steps of: receiving a delivery work via a work management module, and parsing one of the execution parameters corresponding to the delivery work Receiving delivery work and execution parameters by a multi-tree architecture module to construct a multi-tree structure corresponding to the delivery work according to the execution parameters, wherein the multi-tree structure is formed into a plurality of levels in a tree branch manner. The next level is formed by branching down at least one of the nodes in the previous level into a plurality of nodes; Using a dynamic amplification and convergence dispatching level module to selectively prioritize one of the multi-tree structures corresponding to the delivery work according to the load state of the information system, and the dynamic amplification and convergence dispatching hierarchical module periodicity The load state of the information system is detected to selectively augment the process to the next level or to the next level until the nodes in all the levels that have processed the delivery work are executed.
承上所述,依本發明之智慧型多層式工作指派系統及其方法,具備有下列一或多個優點: As described above, the intelligent multi-layer work assignment system and method thereof according to the present invention have one or more of the following advantages:
1、此智慧型多層式工作指派系統及其方法可確保交付之任務確實被執行。 1. This intelligent multi-layer work assignment system and its methods ensure that the tasks delivered are indeed performed.
2、此智慧型多層式工作指派系統及其方法提供動態擴增派工技術以提高伺服器的系統產能,充分利用系統資源,加速工作的產出。 2. This intelligent multi-layer work assignment system and its method provide dynamic augmentation dispatch technology to improve the system capacity of the server, make full use of system resources, and accelerate the output of the work.
3、此智慧型多層式工作指派系統及其方法提供動態收斂派工技術以確保伺服器的穩定度,透過控制執行工作的層級來確保系統負荷不會超過高標值,可確保各交付工作都可在有效控制下完成任務。 3. This intelligent multi-layer work assignment system and its method provide dynamic convergence dispatch technology to ensure the stability of the server. By controlling the level of execution work to ensure that the system load does not exceed the high value, it can ensure that all delivery work is completed. Tasks can be completed under effective control.
S11~S13、S1~S8‧‧‧步驟 S11~S13, S1~S8‧‧‧ steps
101‧‧‧工作管理模組 101‧‧‧Work Management Module
102‧‧‧多元樹架構模組 102‧‧‧Multiple Tree Architecture Module
103‧‧‧動態擴增與收斂派工層級模組 103‧‧‧Dynamic amplification and convergence dispatch level module
104‧‧‧資料庫模組 104‧‧‧Database Module
Job‧‧‧交付工作 Job‧‧‧ delivery work
L0~LN‧‧‧層級 L0~LN‧‧‧ level
A~C、A1~A3、B1~B2、C1~C2、xx‧‧‧節點 A~C, A1~A3, B1~B2, C1~C2, xx‧‧‧ nodes
1、2A~2B、3A~3C、4A~4B、5、6x、6y、7~9‧‧‧訊息 1, 2A~2B, 3A~3C, 4A~4B, 5, 6x, 6y, 7~9‧‧‧ messages
第1圖 係為本發明之智慧型多層式工作指派方法之流程圖。 Figure 1 is a flow chart of the smart multi-layer work assignment method of the present invention.
第2圖 係為本發明之智慧型多層式工作指派系統之方塊圖。 Figure 2 is a block diagram of the intelligent multi-layer work assignment system of the present invention.
第3圖 係為本發明之智慧型多層式工作指派方法之另一流程圖。 Figure 3 is another flow chart of the smart multi-layer work assignment method of the present invention.
第4圖 係為本發明之多元樹架構模組建置多元樹結構之實施例之示意圖。 Figure 4 is a schematic diagram of an embodiment of a multi-tree architecture for constructing a multi-tree architecture of the present invention.
第5圖 係為本發明之動態擴增與收斂派工層級模組執行動態擴增或收斂之實施例之示意圖。 Figure 5 is a schematic diagram of an embodiment of the dynamic amplification and convergence dispatch level module of the present invention performing dynamic amplification or convergence.
第6圖 係為本發明之智慧型多層式工作指派系統及其方法之再一流程圖。 Figure 6 is still another flow chart of the intelligent multi-layer work assignment system and method thereof.
為利 貴審查員瞭解本發明之技術特徵、內容與優點及其所能達成之功效,茲將本發明配合附圖,並以實施例之表達形式詳細說明如下,而其中所使用之圖式,其主旨僅為示意及輔助說明書之用,未必為本 發明實施後之真實比例與精準配置,故不應就所附之圖式的比例與配置關係解讀、侷限本發明於實際實施上的權利範圍,合先敘明。 The technical features, contents, and advantages of the present invention, as well as the advantages thereof, can be understood by the present inventors, and the present invention will be described in detail with reference to the accompanying drawings. The subject matter is for illustrative purposes only and is intended to be used in the specification. The true proportions and precise configurations after the implementation of the invention are not to be construed as limiting the scope and configuration of the accompanying drawings, and limiting the scope of the invention in the actual implementation.
請參閱第1圖,其係為本發明之智慧型多層式工作指派方法之流程圖。此智慧型多層式工作指派方法係由本發明所述之智慧型多層式工作指派系統所執行,適用於一資訊系統中,例如會計資訊系統等等。本發明對於資源有限的資訊系統提供一個很好的發展模組,特別是適合需大量資料分析或排程處理任務的資訊系統,像是會計資訊系統月底關帳及一些相關報表或是決策分析系統的資料分析,均可利用本發明來提升系統的產出,亦可兼顧系統的穩定性及時效性,並有效提升系統資源使用率。其中,本發明之智慧型多層式工作指派系統主要包含有工作管理模組101、多元樹架構模組102、動態擴增與收斂派工層級模組103及資料庫模組104,如第2圖所示。此智慧型多層式工作指派方法之流程步驟為: Please refer to FIG. 1 , which is a flow chart of the smart multi-layer work assignment method of the present invention. The intelligent multi-layer work assignment method is implemented by the intelligent multi-layer work assignment system of the present invention, and is applicable to an information system, such as an accounting information system. The invention provides a good development module for a resource-limited information system, in particular for an information system that requires a large amount of data analysis or scheduling tasks, such as an accounting information system closing account and some related reports or decision analysis systems. The data analysis can use the invention to improve the output of the system, and also consider the stability and timeliness of the system, and effectively improve the system resource utilization rate. The smart multi-layer work assignment system of the present invention mainly includes a work management module 101, a multi-tree architecture module 102, a dynamic amplification and convergence dispatch level module 103, and a database module 104, as shown in FIG. Shown. The process steps of this smart multi-layer work assignment method are:
步驟S11:經由工作管理模組接收一交付工作,並解析出交付工作所對應之一執行參數。其中,工作管理模組係依據交付工作之工作類型解析出執行參數。 Step S11: Receive a delivery job via the work management module, and parse out one of the execution parameters corresponding to the delivery work. Among them, the work management module parses the execution parameters according to the type of work of the delivery work.
步驟S12:藉由多元樹架構模組接收交付工作及執行參數,以依據執行參數來架構出對應交付工作之一多元樹結構。其中,多元樹結構以樹狀分支方式形成有複數個層級,下一個層級係由上一個層級中至少一個節點向下分支為複數個節點所形成。 Step S12: Receive the delivery work and the execution parameters by the multi-tree architecture module to construct a multi-tree structure corresponding to the delivery work according to the execution parameters. The multi-tree structure is formed by a plurality of levels in a tree-like branch manner, and the next hierarchical level is formed by branching at least one node of the previous hierarchical level into a plurality of nodes.
步驟S13:利用動態擴增與收斂派工層級模組依據資訊系統之負荷狀態選擇性地優先處理交付工作所對應之多元樹結構之其中一個層級,且動態擴增與收斂派工層級模組係週期性地偵測資訊系統之負荷狀態,以選擇性地擴增處理至下一個層級或收斂至上一層級,直至執行處理完交付工作之所有層級中之節點。其中,資訊系統之負荷狀態包含記憶體使用率以及CPU使用率等等。當動態擴增與收斂派工層級模組偵測資訊系統之負荷狀態小於一設定下限值時,將動態選定目前處理層級中之至少一個節點以進行擴增,以擴增執行被選定節點之下一個層級中的多個分支節點;若偵測到之負荷狀態大於一設定上限值時,動態擴增與收斂派工層級模組則將收斂目前處理層級中之部份或全部節點至其所對應之上一個層級 之節點。 Step S13: using the dynamic amplification and convergence dispatching level module to selectively prioritize one of the multi-tree structures corresponding to the delivery work according to the load state of the information system, and dynamically augment and converge the hierarchical module system. The load status of the information system is periodically detected to selectively augment processing to the next level or to the next level until the nodes in all levels that have processed the delivery are processed. Among them, the load status of the information system includes memory usage and CPU usage. When the load state of the dynamic amplification and convergence dispatch level module detection information system is less than a set lower limit value, at least one node in the current processing level is dynamically selected for amplification to amplify execution of the selected node. Multiple branch nodes in the next level; if the detected load state is greater than a set upper limit, the dynamic amplification and convergence dispatch level module will converge some or all of the nodes in the current processing level to Corresponding to a level Node.
在上述中,交付工作、執行參數及多元樹結構係儲存於資料庫模組中。另外,此方法還包含的步驟有:經由工作管理模組依據資訊系統之負荷狀態來選擇性地將交付工作傳遞至多元樹架構模組,使多元樹架構模組於資料庫模組中取得執行參數以對交付工作進行多元樹結構之架構。 In the above, the delivery work, the execution parameters, and the multi-tree structure are stored in the database module. In addition, the method further includes the steps of: selectively transmitting the delivery work to the multi-tree architecture module according to the load status of the information system by the work management module, so that the multi-tree architecture module is executed in the database module. The parameters are structured in a multi-tree structure for delivery work.
在本發明的系統架構中,每個交付工作在被執行前,會透過多元樹建置模組來產出其工作的多元樹結構,多元樹具備有向下發散與向上收斂的特性,利用此特性動態擴增與收斂派工層級模組可以依據目前資訊系統負荷以及交付工作的執行授權數來控制執行緒的個數,並由於多元樹架構的特性,各執行緒對應的節點都具備獨立性,並不會互相影響且可確保交付工作執行的完整性。 In the system architecture of the present invention, each delivery work is generated by a multi-tree building module to generate a multi-tree structure of its work before being executed, and the multi-tree has the characteristics of downward divergence and upward convergence. The feature dynamic amplification and convergence dispatching level module can control the number of threads according to the current information system load and the number of execution authorizations of the delivery work, and the nodes corresponding to each thread have independence due to the characteristics of the multi-tree architecture. , does not affect each other and ensures the integrity of the delivery work.
詳細地來說,本發明的系統主要由四個模組所組成,如第2圖所示,其名稱與主要功能分述如下: In detail, the system of the present invention is mainly composed of four modules, as shown in FIG. 2, the names and main functions are as follows:
工作管理模組101:此模組負責將使用者於前端系統介面交付之工作儲存,以及負責選定待執行之交付工作賦予多元樹架構模組102。 Work Management Module 101: This module is responsible for storing the work stored by the user in the front-end system interface, and assigning the task to be executed to the multi-tree architecture module 102.
多元樹架構模組102:此模組會依據工作類別來建置交付工作的多元樹架構。 Multi-tree architecture module 102: This module will build a multi-tree architecture for delivery work based on the work category.
動態擴增與收斂派工層級模組103:負責交付工作的執行,會依據系統負荷來決定取用工作多元樹的特定層級來執行,並於執行過程中動態檢測是否擴增或收斂派工層級來提升系統產出或降低系統負荷。 The dynamic augmentation and convergence dispatching level module 103: responsible for the execution of the delivery work, determines the specific level of the working multi-tree to be executed according to the system load, and dynamically detects whether to augment or converge the dispatch level during execution. To increase system output or reduce system load.
資料庫模組104:負責儲存工作管理模組101、多元樹架構模組102及動態擴增與收斂派工層級模組103所需要的相關資料。 The database module 104 is responsible for storing relevant information required by the work management module 101, the multi-tree architecture module 102, and the dynamic amplification and convergence dispatch level module 103.
本發明利用多元樹結構作為切割交付工作的方法,多元樹具備層化的架構,也就是上層節點與其子節點有集合的關係,這種關係作為動態擴增與收斂派工層級的基礎,可確保交付工作的完整性以及各個工作執行緒處理資料的獨立性。當前端使用者交付多個後端執行的工作後,由工作管理模組101將各交付工作儲存於資料庫模組104中,並在等待交付工作清單中選擇目前可被執行的工作交予多元樹架構模組102,多元樹架構模 組102將交付工作依據其工作類別建置多元樹結構。完成結構建置後,動態擴增與收斂派工層級模組103接手進行交付工作的執行,此模組將依據系統現況決定該工作可執行的多元樹層級,執行過程中,動態擴增與收斂派工層級模組103依據資訊系統負荷臨界值來決定是否擴增或收斂,直到交付工作執行完成。其中,資料庫模組104扮演資料暫存以及交付工作的執行狀態。 The invention utilizes a multi-tree structure as a method for cutting delivery work, and the multi-tree has a layered architecture, that is, the upper node has a set relationship with its child nodes, and this relationship serves as a basis for dynamic amplification and convergence dispatching levels, which ensures The integrity of the delivery work and the independence of the individual work thread processing data. After the current end user delivers the work performed by the plurality of backends, the work management module 101 stores the respective delivery work in the database module 104, and selects the work that can be executed in the waiting for delivery work list to be diversified. Tree architecture module 102, multi-tree architecture module Group 102 will deliver a multi-tree structure based on its work category. After the structural construction is completed, the dynamic amplification and convergence dispatching level module 103 takes over the execution of the delivery work. The module determines the multi-tree hierarchy that can be performed according to the current situation of the system, and performs dynamic amplification and convergence during execution. The dispatch level module 103 determines whether to augment or converge according to the information system load threshold until the delivery work is completed. Among them, the database module 104 plays the state of execution of the data temporary storage and delivery work.
請參閱第3圖,其係為本發明之智慧型多層式工作指派方法之另一流程圖,說明了一個被交付工作的詳細執行流程。首先,使用者於前端瀏覽器介面交付工作執行後,應用伺服器接收需求並將交付工作相關資訊傳送給工作管理模組101負責處理,工作管理模組101依據其工作類別來剖析交付工作,完成剖析後擷取使用者輸入之執行參數並儲存至資料庫模組104。完成後,工作管理模組101會依據系統狀態決定是否讓此交付工作交付執行,若系統負荷仍可執行,則會將該交付工作之執行旗標設定為TRUE,接續將此交付工作傳遞至多元樹架構模組102;若系統負荷仍無法執行該交付工作,則執行旗標維持為FALSE,等待下一次的執行判斷。多元樹架構模組102在收到交付工作執行的任務後,會從資料庫模組104取得該交付工作的相關執行參數,依據這些參數來架構該工作的多元樹結構,並將多元樹結構儲存至資料庫模組104。動態擴增與收斂派工層級模組103會定期至資料庫模組104中取得需被執行的交付工作,隨即啟動工作的執行。首先動態擴增與收斂派工層級模組103取得該工作的多元樹結構,並依據資訊系統現況決定可執行的多元樹層級,隨即分派數個執行緒開始平行執行該交付工作,並於固定周期決定是否針對此交付功能執行緒進行擴增或是收斂派工層級,直到交付工作完成執行為止。 Please refer to FIG. 3, which is another flow chart of the smart multi-layer work assignment method of the present invention, illustrating a detailed execution flow of a delivered work. First, after the user performs the execution of the front-end browser interface, the application server receives the request and transmits the work-related information to the work management module 101 for processing. The work management module 101 analyzes the delivery work according to the work category, and completes the work. After the parsing, the execution parameters input by the user are retrieved and stored in the database module 104. After the completion, the work management module 101 determines whether to deliver the delivery work according to the system status. If the system load is still executable, the execution flag of the delivery work is set to TRUE, and the delivery work is transmitted to the plurality of components. The tree architecture module 102; if the delivery cannot be performed under the system load, the execution flag is maintained at FALSE, waiting for the next execution judgment. After receiving the task of delivering the work execution, the multi-tree architecture module 102 obtains the relevant execution parameters of the delivery work from the database module 104, constructs the multi-tree structure of the work according to the parameters, and stores the multi-tree structure. To the database module 104. The dynamic augmentation and convergence dispatch level module 103 periodically obtains the delivery work to be performed in the database module 104, and then starts the execution of the work. Firstly, the dynamic amplification and convergence dispatch level module 103 obtains the multi-tree structure of the work, and determines the executable multi-tree hierarchy according to the current situation of the information system, and then dispatches several threads to start the parallel execution of the delivery work, and in a fixed period. Decide whether to augment this delivery function thread or to converge the dispatch level until the delivery is completed.
在本發明的系統中,多元樹架構模組102負責架構交付工作的多元樹架構,此多元樹架構模組102會先至資料庫模組104取得交付工作的架構因子,架構因子具備可清楚識別資料分群的特性,各類的交付工作會因為架構因子不同而會有不同的多元樹的產生。可參閱第4圖,其顯示本發明之多元樹架構模組建置多元樹結構之實施例之示意圖。在圖中,一個交付工作Job透過多元樹架構模組102後,將產生一個具有L1~LN層級 的多元樹架構,結構中每一個父節點所包含的資料均會等於轄下子節點所包含的資料總和,多元樹的節點將會被動態擴增與收斂派工層級模組103所使用,動態擴增與收斂派工層級模組103會依據資訊系統負荷來決定交付工作Job的執行派工層級。派工層級指的是多元樹結構的L1~LN層,1~N代表動態的層級,會依據第一次交付工作被執行時,動態擴增與收斂派工層級模組103會尋找最佳的派工層級來執行,在執行過程中動態擴增與收斂派工層級模組103將週期性的去偵測資訊系統使用率,包含了記憶體使用率以及CPU使用率,若發現使用率超過臨界值,動態擴增與收斂派工層級模組103將會捨棄部分執行緒,並將收斂派工層級至其父層級;若發現系統負擔較輕,仍可增加執行緒個數,動態擴增與收斂派工層級模組103將會動態選定一些節點進行擴增派工層級,加速交付工作的執行時間。可參閱第5圖,其係為本發明之動態擴增與收斂派工層級模組執行動態擴增或收斂之實施例之示意圖,說明了一個執行交付工作在動態擴增與收斂派工層級模組103所執行的生命週期。S1步驟表示工作初始的多元樹架構;進入S2步驟階段,動態擴增與收斂派工層級模組103選擇L2層作為執行交付工作的派工層級,在經過一段時間的檢測,當資訊系統使用率SUR使用率低臨界值,動態擴增與收斂派工層級模組103會啟動動態擴增派工層級,如S3步驟、S4步驟、S5步驟所示,其代表連續動態擴增派工層級;當動態擴增與收斂派工層級模組103偵測到系統使用率超過UH時,派工層級將被收斂如S6步驟所示。當有部分節點完成執行時,代表該節點的所包含的資料均已完成處理,如S7步驟所示,直到所有執行中的節點完成後,既代表該交付工作被完整的執行,如S8步驟所示。 In the system of the present invention, the multi-tree architecture module 102 is responsible for the multi-tree architecture of the architecture delivery work. The multi-tree architecture module 102 first obtains the architecture factor of the delivery work by the database module 104, and the architecture factor has clear identification. The characteristics of data grouping, various types of delivery work will have different multi-trees due to different architectural factors. Referring to FIG. 4, there is shown a schematic diagram of an embodiment of the multi-tree architecture module of the present invention for constructing a multi-tree structure. In the figure, after a delivery job job passes through the multi-tree architecture module 102, a hierarchy of L1~LN will be generated. The multi-tree architecture, the data contained in each parent node in the structure will be equal to the sum of the data contained in the child nodes, and the nodes of the multi-tree will be used by the dynamic amplification and convergence dispatching level module 103. The augmentation and dispatching level module 103 determines the execution dispatch level of the delivery job job based on the information system load. The dispatch level refers to the L1~LN layer of the multi-tree structure, and the 1~N represents the dynamic level. When the first delivery work is performed, the dynamic amplification and convergence dispatch level module 103 will find the best. The dispatching level is executed, and during the execution process, the dynamic augmentation and convergence dispatching level module 103 periodically detects the usage rate of the information system, including the memory usage rate and the CPU usage rate, and if the usage rate exceeds the criticality. Value, dynamic amplification and convergence dispatch level module 103 will discard part of the thread and will converge the dispatch level to its parent level; if the system is found to be lighter, the number of threads can still be increased, dynamic amplification and The convergence dispatch level module 103 will dynamically select some nodes for the augmentation dispatch level to speed up the execution time of the delivery work. Referring to FIG. 5, it is a schematic diagram of an embodiment of performing dynamic amplification or convergence of a dynamic amplification and convergence dispatching level module of the present invention, illustrating an execution delivery work in a dynamic amplification and convergence dispatch level module. The life cycle performed by group 103. The S1 step represents the initial multi-tree architecture; in the S2 step phase, the dynamic amplification and convergence dispatch level module 103 selects the L2 layer as the dispatch level for performing the delivery work, after a period of detection, when the information system usage rate The SUR usage rate is low, and the dynamic amplification and convergence dispatch level module 103 starts the dynamic amplification dispatch level, as shown in steps S3, S4, and S5, which represents the continuous dynamic amplification of the dispatch level; When the dynamic amplification and convergence dispatch level module 103 detects that the system usage exceeds UH, the dispatch level will be converged as shown in step S6. When some nodes complete the execution, the data contained on the node has been processed. As shown in step S7, until all the nodes in execution are completed, the delivery is completed, as shown in step S8. Show.
另外,請參閱第6圖,其係為本發明之智慧型多層式工作指派系統及其方法之再一流程圖,此描述了一個交付工作經過使用者交付給系統執行後,經過工作管理模組的解析後一直到動態擴增與收斂派工層級模組啟動執行緒到結束的過程。 In addition, please refer to FIG. 6, which is a flow chart of the smart multi-layer work assignment system and method thereof according to the present invention, which describes a delivery work after the user delivers to the system and executes the work management module. After the analysis, the process of starting the thread to the end of the dynamic amplification and convergence dispatch level module is started.
步驟一:使用者透過前端設備送出交付工作訊息1給工作管理模組101。 Step 1: The user sends a delivery work message 1 to the work management module 101 through the front-end device.
步驟二:工作管理模組101將交付工作相關資料以訊息2A 請求資料庫模組104予以儲存。資料庫模組104完成將交付工作參數儲存後,回覆訊息2B給工作管理模組101儲存完成。 Step 2: The work management module 101 will deliver the work related information to the message 2A. The request database module 104 is stored. After the database module 104 finishes storing the delivery working parameters, the reply message 2B is stored for completion by the work management module 101.
步驟三:工作管理模組101在得到2B訊息確認交付工作已完成儲存後,發送訊息3請求多元樹架構模組102為該交付工作進行多元樹結構的建置。多元樹架構模組102接收到多元樹建置需求後發送3A訊息向資料庫模組104取得該交付工作的相關執行參數,資料庫模組104取得資料後透過3B訊息回覆給多元樹架構模組102,多元樹架構模組102開始進行交付工作多元樹結構建置,完成建置後,利用3C訊息將多元樹結構儲存至資料庫模組104,並設定為等待執行狀態。 Step 3: After obtaining the 2B message confirming that the delivery work has been completed, the work management module 101 requests the multi-tree architecture module 102 to perform the multi-tree structure for the delivery work. After receiving the multi-tree setup request, the multi-tree architecture module 102 sends a 3A message to the database module 104 to obtain the relevant execution parameters of the delivery work. The database module 104 obtains the data and then replies to the multi-tree architecture module through the 3B message. 102. The multi-tree architecture module 102 starts the multi-tree structure construction of the delivery work. After the construction is completed, the multi-tree structure is stored into the database module 104 by using the 3C message, and is set to wait for the execution state.
步驟四:工作管理模組101週期利用訊息4A向資料庫模組104探詢是否有等待執行的交付工作需要被執行,資料庫模組104收到4A訊息後,會將等待並且可執行的交付工作以4B回覆給工作管理模組101。 Step 4: The work management module 101 periodically uses the message 4A to query the database module 104 whether there is a waiting for execution to be performed. After receiving the 4A message, the database module 104 will wait for and perform the delivery work. The work management module 101 is replied to with 4B.
步驟五:工作管理模組101在收到4B可執行交付工作訊息後,發送訊息5通知動態擴增與收斂派工層級模組103來啟動交付工作的執行,訊息5包含該交付工作的多元樹結構。 Step 5: After receiving the 4B executable delivery work message, the work management module 101 sends a message 5 to notify the dynamic augmentation and convergence dispatch level module 103 to start the execution of the delivery work, and the message 5 includes the multi-function tree of the delivery work. structure.
步驟六:動態擴增與收斂派工層級模組103在取得交付工作的多元樹結構後,會先依據系統負荷來決定初始執行的交付層級,然後透過6x訊息向執行緒池取得足夠數量的執行緒,在執行一段時間後動態擴增與收斂派工層級模組103會再依據系統負荷來決定是否擴增或收斂交付層級,若發現系統負荷過低,且交付工作仍可下向擴增,則再次發送6x訊息向執行緒池取得仍為閒置的執行緒;若發現系統負荷已超過設定最大值,則動態擴增與收斂派工層級模組103將收斂交付工作的派工層級,透過6y訊息歸還執行緒至執行緒池,直到交付工作所有多元樹節點均被執行完成。 Step 6: The dynamic augmentation and convergence dispatching level module 103 determines the initial execution delivery level according to the system load after obtaining the multi-tree structure of the delivery work, and then obtains a sufficient number of executions from the thread pool through the 6x message. After a period of execution, the dynamic amplification and convergence dispatch level module 103 will decide whether to augment or converge the delivery level according to the system load. If the system load is found to be too low, and the delivery work can still be expanded downward, Then, the 6x message is sent again to the thread pool to obtain the still idle thread; if the system load is found to exceed the set maximum value, the dynamic amplification and convergence dispatch level module 103 will converge the delivery level of the work, through 6y. The message is returned to the thread pool until all multi-tree nodes have been executed.
步驟七:交付工作完成執行後,動態擴增與收斂派工層級模組103將會把完成執行的相關資訊透過訊息7寫回資料庫模組104。 Step 7: After the delivery work is completed, the dynamic amplification and convergence dispatch level module 103 will write the relevant information for completion of execution to the database module 104 via the message 7.
步驟八:交付工作完成並將結果完成儲存至資料庫模組104後,動態擴增與收斂派工層級模組103以訊息8告訴工作管理模組101,此交付工作已經完成執行,請工作管理模組101進行下一個交付工作的安排。 Step 8: After the delivery work is completed and the result is completed and stored in the database module 104, the dynamic augmentation and convergence dispatching level module 103 informs the work management module 101 by the message 8, and the delivery work has been completed, and the work management is required. Module 101 performs the next delivery work arrangement.
步驟九:工作管理模組101在收到訊息8後,會將執行結果 以訊息9告訴使用者完成執行。 Step 9: After receiving the message 8, the work management module 101 will execute the result. Message 9 tells the user to complete the execution.
綜合上述,本發明使用的系統及方法,係以階層式的多元樹來切割工作,可以明確的區分每個節點所包含的資料範圍,結合動態擴增與收斂派工模組,可以依據系統負荷來決定派工層級,執行過程中動態擴增或是收斂派工層級,此方法對於線上分析處理(Online Analytical Processing)或是資料倉儲(Data Warehousing)類型的系統有顯著的幫助,特別是應用在雲端架構下的系統,更可以大幅提升系統的使用率與產出,也減少系統過載導致互相爭搶資源所造成的延遲。 In summary, the system and method used in the present invention cuts the work by a hierarchical multi-tree, and can clearly distinguish the range of data contained in each node, and combines the dynamic amplification and convergence dispatching module, which can be based on the system load. To determine the level of dispatch, dynamic amplification or convergence of the dispatch level in the implementation process, this method is of significant help for online Analytical Processing or Data Warehousing type systems, especially in applications The system under the cloud architecture can greatly increase the system utilization rate and output, and also reduce the delay caused by system overload and mutual competition for resources.
以上所述僅為舉例性,而非為限制性者。任何未脫離本發明之精神與範疇,而對其進行之等效修改或變更,均應包含於後附之申請專利範圍中。 The above is intended to be illustrative only and not limiting. Any equivalent modifications or alterations to the spirit and scope of the invention are intended to be included in the scope of the appended claims.
S11~S13‧‧‧步驟 S11~S13‧‧‧Steps
Claims (6)
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
TW102133788A TWI552079B (en) | 2013-09-18 | 2013-09-18 | Intelligent multi - layer job assignment system and its |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
TW102133788A TWI552079B (en) | 2013-09-18 | 2013-09-18 | Intelligent multi - layer job assignment system and its |
Publications (2)
Publication Number | Publication Date |
---|---|
TW201512991A TW201512991A (en) | 2015-04-01 |
TWI552079B true TWI552079B (en) | 2016-10-01 |
Family
ID=53437171
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
TW102133788A TWI552079B (en) | 2013-09-18 | 2013-09-18 | Intelligent multi - layer job assignment system and its |
Country Status (1)
Country | Link |
---|---|
TW (1) | TWI552079B (en) |
Citations (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20030236815A1 (en) * | 2002-06-20 | 2003-12-25 | International Business Machines Corporation | Apparatus and method of integrating a workload manager with a system task scheduler |
TW201131405A (en) * | 2010-02-04 | 2011-09-16 | Jack Technology Inc | Management system of technical literature data and the method thereof |
US20120096211A1 (en) * | 2009-10-30 | 2012-04-19 | Calxeda, Inc. | Performance and power optimized computer system architectures and methods leveraging power optimized tree fabric interconnect |
TW201324360A (en) * | 2011-12-08 | 2013-06-16 | Chunghwa Telecom Co Ltd | Entrusted background execution encapsulated module |
-
2013
- 2013-09-18 TW TW102133788A patent/TWI552079B/en not_active IP Right Cessation
Patent Citations (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20030236815A1 (en) * | 2002-06-20 | 2003-12-25 | International Business Machines Corporation | Apparatus and method of integrating a workload manager with a system task scheduler |
US20120096211A1 (en) * | 2009-10-30 | 2012-04-19 | Calxeda, Inc. | Performance and power optimized computer system architectures and methods leveraging power optimized tree fabric interconnect |
TW201131405A (en) * | 2010-02-04 | 2011-09-16 | Jack Technology Inc | Management system of technical literature data and the method thereof |
TW201324360A (en) * | 2011-12-08 | 2013-06-16 | Chunghwa Telecom Co Ltd | Entrusted background execution encapsulated module |
Also Published As
Publication number | Publication date |
---|---|
TW201512991A (en) | 2015-04-01 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
CN107832146A (en) | Thread pool task processing method in highly available cluster system | |
CN105389209A (en) | Asynchronous batch task processing method and system | |
CN105159769A (en) | Distributed job scheduling method suitable for heterogeneous computational capability cluster | |
CN104750543A (en) | Thread creation method, business request processing method and associated device | |
CN101957780A (en) | Resource state information-based grid task scheduling processor and grid task scheduling processing method | |
CN113656157B (en) | Distributed task scheduling method and device, storage medium and electronic equipment | |
CN105320570B (en) | Method for managing resource and system | |
CN103023805A (en) | MapReduce system | |
CN110187956A (en) | A kind of the layering real-time task scheduling method and system of multiple agent platform | |
CN108958789B (en) | Parallel stream type computing method, electronic equipment, storage medium and system | |
CN105160570A (en) | Concurrent online transaction processing method capable of being horizontally expanded | |
CN103500119A (en) | Task allocation method based on pre-dispatch | |
CN112579267A (en) | Decentralized big data job flow scheduling method and device | |
CN111831424A (en) | Task processing method, system and device | |
CN113225269A (en) | Container-based workflow scheduling method, device and system and storage medium | |
CN113961341A (en) | Concurrent data processing method, system, device and storage medium based on Actor model | |
CN112581080A (en) | Lightweight distributed workflow engine construction system | |
CN108876074B (en) | Universal scheduling method suitable for multi-class resource application approval | |
Stavrinides et al. | Multicriteria scheduling of linear workflows with dynamically varying structure on distributed platforms | |
CN114661752A (en) | Method, device and system for scheduling plan of distributed database | |
CN112527872A (en) | Data query method and device, storage medium and electronic equipment | |
Shu-Jun et al. | Optimization and research of hadoop platform based on fifo scheduler | |
Fan et al. | A scheduler for serverless framework base on kubernetes | |
TWI552079B (en) | Intelligent multi - layer job assignment system and its | |
CN112019452A (en) | Method, system and related device for processing service requirement |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
MM4A | Annulment or lapse of patent due to non-payment of fees |