CN103942098A - System and method for task processing - Google Patents
System and method for task processing Download PDFInfo
- Publication number
- CN103942098A CN103942098A CN201410177684.2A CN201410177684A CN103942098A CN 103942098 A CN103942098 A CN 103942098A CN 201410177684 A CN201410177684 A CN 201410177684A CN 103942098 A CN103942098 A CN 103942098A
- Authority
- CN
- China
- Prior art keywords
- task
- subtask
- database server
- module
- result
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Abstract
The invention discloses a system and method for task processing. The system comprises a request receiving module, a task splitting module, a task processing module, a result integration module and a result returning module. According to the characteristic that historical data of a real-time database are managed through a non-shared mechanism in the prior art, a shared management mechanism is adopted in the system. A query task requested by a user is split into a plurality of sub-tasks by various functional modules of the system on the basis of a preset splitting strategy. Parallel processing is conducted on the sub-tasks on the basis of a data source shared mechanism. When the method is specifically implemented, a plurality of database servers can be arranged to serve as equal nodes to be connected to the real-time database, so that a data access right of the real-time database is shared. Parallel access is conducted on the real-time database, so that the sub-tasks are processed in parallel. Compared with an existing task processing method based on the non-shared management mechanism, the inquiry performance of the real-time database is greatly improved through the system and method for task processing.
Description
Technical field
The invention belongs to database access, access technique field, relate in particular to a kind of task processing system and method.
Background technology
The query performance of historical data is the important performance indexes of real-time data base.
At present, data query task for user's request, real-time data base does not provide task to split function or the simple average fractionation function based on task amount is only provided, and adopt its historical data of unshared mechanism management, based on this, data query task for user's request, real-time data base can only access and access its historical data realization by the service routine of fixing corresponding task is processed, or by a plurality of service routines, with polling mode, accesses, accesses its historical data realization the corresponding subtask by simple fractionation gained is processed.This kind of processing mode affected the speed of response of task requests greatly, can cause the operating lag of large data sets query task (for example the inquiry of historical data task of the above measuring point quantity of millions or long-time section) higher, and then reduce the query performance of real-time data base.
Summary of the invention
In view of this, the object of the present invention is to provide a kind of task processing system and method, to overcome the problems referred to above, improve the query performance of real-time data base.
For this reason, the open following technical scheme of the present invention:
A task processing system, comprises that request receiving module, task split module, task processing module, result integrate module and result and return to module, wherein:
Described request receiver module, for receiving user's solicited message, described request packets of information is containing the query task that the target data set in data source is inquired about;
Described task splits module, for splitting strategy based on predefined first task, described query task is split, and obtains N subtask of described query task, and wherein, described N is greater than 1 natural number;
Described task processing module, for based on data source shared mechanism, carries out parallel processing to a described N subtask, obtains corresponding N the sub-result of inquiry;
Described result integrate module, for utilizing the predefined rule that gathers that described N the sub-result of inquiry gathered, integrated, obtains the required query results of user;
Described result is returned to module, for described query results is back to user.
Said system, preferred, described data source is specially real-time data base.
Said system, preferred, described task processing module specifically comprises task allocation unit and parallel processing element, wherein:
Described task allocation unit, for being dispensed to N database server by a described N subtask with man-to-man mapping relations;
Described parallel processing element, for dispatching the parallel access of a described N database server, accessing described data source, obtains N the inquiry sub-result corresponding with a described N subtask.
Said system, preferred, also comprise:
Subtask split cells, for splitting strategy based on predefined the second task, secondary fractionation is carried out in subtask described in each, obtain M secondary subtask of described subtask, and trigger described parallel processing element and carry out following operation: dispatch data source described in described N database server concurrent access, and make each database server process its responsible M secondary subtask with multi-thread concurrent processing mode, wherein, described M is greater than 1 natural number.
Said system, preferred, also comprise:
Fault processing module, for when described database server breaks down, delivers the responsible subtask of the database server breaking down to the database server not breaking down and processes.
Said system, preferred, described first task splits strategy, and specifically time attribute and the current parallel processing capability of database server cluster of the task amount based on described query task, the corresponding target data of query task are formulated; Described the second task splits strategy, and specifically time attribute and the current multi-thread concurrent processing power of respective database servers of the task amount based on corresponding subtask, the corresponding target data in subtask are formulated.
A task processing method, comprising:
Receive user's solicited message, described request packets of information is containing the query task that the target data set in data source is inquired about;
Based on predefined first task, split strategy described query task is split, obtain N subtask of described query task, wherein, described N is greater than 1 natural number;
Based on data source shared mechanism, parallel processing is carried out in a described N subtask, obtain corresponding N the sub-result of inquiry;
Utilize the predefined rule that gathers that described N the sub-result of inquiry gathered, integrated, obtain the required query results of user;
Described query results is back to user.
Said method, preferred, describedly based on described data source, parallel processing is carried out in a described N subtask, obtain corresponding N and inquire about sub-result, specifically comprise:
A described N subtask is dispensed to N database server with man-to-man mapping relations;
Dispatch the parallel access of a described N database server, access described data source, obtain N the inquiry sub-result corresponding with a described N subtask.
Said method, preferred, based on described data source, parallel processing is carried out in a described N subtask, obtain corresponding N the sub-result of inquiry, also comprise:
Based on predefined the second task, split strategy secondary fractionation is carried out in subtask described in each, obtain M secondary subtask of described subtask, wherein, described M is greater than 1 natural number;
Dispatch data source described in described N database server concurrent access, and make each database server process its responsible M secondary subtask with multithreading processing mode.
Said method, preferred, also comprise:
When described database server breaks down, the responsible subtask of described database server of breaking down is delivered to the database server not breaking down and processed.
Task processing system of the present invention comprises that request receiving module, task split module, task processing module, result integrate module and result and return to module.For real-time data base in prior art, adopt this feature of unshared its historical data of mechanism management, system of the present invention adopts Sharing Management mechanism, each functional module comprising by it is divided into a plurality of subtasks by the query task of user's request based on predefined fractionation strategy, and based on data source shared mechanism, carry out the parallel processing of a plurality of subtasks, during concrete enforcement, can lay a plurality of database servers as peer node access real-time database, to share its data access rights, and by real-time data base being carried out to the parallel processing of concurrent access realization to a plurality of subtasks.Thereby, the large data sets task requests of submitting to for user, the present invention can improve greatly by the parallel processing process of above task fractionation, distribution and subtask the speed of response of task requests, therefore, compared to the existing task processing mode based on unshared administrative mechanism, the present invention has significantly promoted the query performance of real-time data base.
Accompanying drawing explanation
In order to be illustrated more clearly in the embodiment of the present invention or technical scheme of the prior art, to the accompanying drawing of required use in embodiment or description of the Prior Art be briefly described below, apparently, accompanying drawing in the following describes is some embodiments of the present invention, for those of ordinary skills, do not paying under the prerequisite of creative work, can also obtain according to these accompanying drawings other accompanying drawing.
Fig. 1 is a kind of structural representation of the embodiment of the present invention one disclosed task processing system;
Fig. 2 is a kind of structural representation of the disclosed task processing module of the embodiment of the present invention one;
Fig. 3 is the another kind of structural representation of the disclosed task processing module of the embodiment of the present invention two;
Fig. 4 is the another kind of structural representation of the embodiment of the present invention three disclosed task processing systems;
Fig. 5 is a kind of process flow diagram of the embodiment of the present invention four disclosed task processing methods;
Fig. 6 is the another kind of process flow diagram of the embodiment of the present invention four disclosed task processing methods;
Fig. 7 is the composition structural representation of distributed real-time database system in the disclosed application example of the embodiment of the present invention four.
Embodiment
For quote and know for the purpose of, the technical term hereinafter using, write a Chinese character in simplified form or abridge to sum up and be explained as follows:
Real-time data base: the real-time data base of power informatization industry indication before feeling the pulse with the finger-tip.
Measuring point: refer to the Organization of Data unit in real-time data base, also claim label point, Tag.
Task: certain operation requests of fingering row.
Single-point: refer to single measuring point.
Section: the data of the synchronization of (or all) measuring points are divided in finger.
For making object, technical scheme and the advantage of the embodiment of the present invention clearer, below in conjunction with the accompanying drawing in the embodiment of the present invention, technical scheme in the embodiment of the present invention is clearly and completely described, obviously, described embodiment is the present invention's part embodiment, rather than whole embodiment.Embodiment based in the present invention, those of ordinary skills, not making the every other embodiment obtaining under creative work prerequisite, belong to the scope of protection of the invention.
Embodiment mono-
The embodiment of the present invention one discloses a kind of task processing system, refers to Fig. 1, and this system comprises that request receiving module 100, task split module 200, task processing module 300, result integrate module 400 and result and return to module 500.
Request receiving module 100, for receiving user's solicited message, described request packets of information is containing the query task that the target data set in data source is inquired about.
In the present embodiment, described data source is specially real-time data base, below the task requests of historical data in the inquiry real-time data base by user is submitted to is processed to the present invention is described in detail.
Wherein, the task requests that user submits to can be specifically that request is carried out single-point historical query to real-time data base, can be also that request is carried out section historical query to real-time data base.
Task splits module 200, for splitting strategy based on predefined first task, described query task is split, and obtains N subtask of described query task, and wherein, described N is greater than 1 natural number.
Task processing module 300, for based on data source shared mechanism, carries out parallel processing to a described N subtask, obtains corresponding N the sub-result of inquiry.
Wherein, as shown in Figure 2, task processing module 300 specifically comprises task allocation unit 310 and parallel processing element 320.Task allocation unit 310, for being dispensed to N database server by a described N subtask with man-to-man mapping relations; Parallel processing element 320, for dispatching the parallel access of a described N database server, accessing described data source, obtains N the inquiry sub-result corresponding with a described N subtask.
The present embodiment is based on data sharing mode of management, the while access real-time database using each database server in distributed database server cluster as peer node, the access right of each nodes sharing to historical data in real-time data base, and adopt distributed concurrent processing mechanism to realize the concurrent processing to each subtask.
Be different from prior art query task is only adopted to the average fractionation strategy based on task amount, in the present embodiment, obtain the query task that the fractionation strategy that uses each subtask specifically submits to based on user task amount, the current parallel processing capability of the time attribute of the corresponding target data of query task and database server cluster formulate.
For example, if total N database server is idle in current database server cluster, split the time attribute of strategy based on task amount, target data and busy state, the parallel processing capability of each database server the query task of user's request is split as to N subtask, finally make each database server be responsible for carrying out a subtask, the optimization that realizes each subtask distributes.
In real world applications scene, split tactful formulation and be not limited to above three dimensions, specifically can be correlated with according to the actual requirements and split the setting of algorithm by those skilled in the art, for example also target data can be concentrated logical interdependency between data as the reference frame that splits policy development, the larger request of data task division of logic association intensity, in same subtask, is follow-uply processed subtask more effectively and quickly to realize.
Result integrate module 400, for utilizing the predefined rule that gathers that described N the sub-result of inquiry gathered, integrated, obtains the required query results of user.
Result is returned to module 500, for described query results is back to user.
Tasks carrying is complete, obtains after the required query results of user, and result is returned to module 500 and waken user program up, and query results is back to user program for user, and so far, the task processes of system of the present invention finishes.
To sum up, task processing system of the present invention comprises that request receiving module 100, task split module 200, task processing module 300, result integrate module 400 and result and return to module 500.For real-time data base in prior art, adopt this feature of unshared its historical data of mechanism management, system of the present invention adopts Sharing Management mechanism, each functional module comprising by it is divided into a plurality of subtasks by the query task of user's request based on predefined fractionation strategy, and based on data source shared mechanism, carry out the parallel processing of a plurality of subtasks, during concrete enforcement, can lay a plurality of database servers as peer node access real-time database, to share its data access rights, and by real-time data base being carried out to the parallel processing of concurrent access realization to a plurality of subtasks.Thereby, the large data sets task requests of submitting to for user, the present invention can improve greatly by the parallel processing process of above task fractionation, distribution and subtask the speed of response of task requests, therefore, compared to the existing task processing mode based on unshared administrative mechanism, the present invention has significantly promoted the query performance of real-time data base.
Embodiment bis-
The embodiment of the present invention two continues disclosed task processing system in embodiment mono-to be optimized, refer to Fig. 3, in the present embodiment, task processing module 300 also comprises subtask split cells 330, this unit specifically, between task allocation unit 310 and parallel processing element 320, is connected with described two cellular logics.
Subtask split cells 330, carries out secondary fractionation for splitting strategy based on predefined the second task to subtask described in each, obtains M secondary subtask of described subtask, and wherein, described M is greater than 1 natural number.
Wherein, described the second task splits strategy specifically time attribute and the current multi-thread concurrent processing power formulation of respective database servers of the task amount based on corresponding subtask, the corresponding target data in subtask.Similarly, this splits tactful formulation and is not limited to above three dimensions, also can be according to actual demand using other reference factors as splitting foundation in real world applications scene.
In addition, it is perfect that corresponding function has also been carried out in parallel processing element scheduling 320, this unit is except dispatching described N database server concurrent access real-time data base, also guarantees that each database server processes its responsible M secondary subtask with multi-thread concurrent processing mode simultaneously.
Database server is distributed to M thread by its responsible M secondary subtask and is gone to process simultaneously, and first the M that M thread returned a sub-result carry out this locality and gather, and obtains the intermediate result of query task.N the raw N part of server common property intermediate result, and then N intermediate result is gathered and can obtain the required result data collection of user.
The present embodiment provides the secondary of local task to split function, and adopt multi-thread concurrent treatment mechanism to process to each secondary subtask of secondary fractionation gained, improved the treatment effeciency of each subtask, thereby, the speed of response of user task request further promoted.
Embodiment tri-
The present embodiment continue to disclosed task processing system in above two embodiment supplement, perfect.
The task processes of embodiment mono-and embodiment bis-specifically need be based on each database server this prerequisite of normally working, and in actual group system, any one or more server nodes cause it to roll off the production line temporarily and belong to common phenomenon because breaking down, for this kind of situation, refer to Fig. 4, the present embodiment is on the basis of original each functional module, for task processing system adds fault processing module 600.
Fault processing module 600, for when database server breaks down, delivers the responsible subtask of the database server breaking down to the database server not breaking down and processes.
Particularly, fault processing module 600 is monitored each database server in the mode of cycle polling.When a certain database server receives the polling order that this module sends, and while never responding in the time threshold of setting, this module judges that described database server lost efficacy, for the processing to query task not impacts, this module is set to untreated state by the responsible subtask of failed server node, and again for its allocation database server, processes.
Because the corresponding subtask result on failed server cannot be accessed, therefore, even corresponding subtask is complete on inefficacy machine, need to re-execute this subtask equally.
The present embodiment provides failure handling mechanisms for task processing system, thereby when server node breaks down, the system that still can guarantee is carried out normally, effectively processed user's task requests, has improved the robustness that system task is processed.
Embodiment tetra-
The present embodiment four discloses a kind of task processing method, and the method is corresponding with above three disclosed task processing systems of embodiment.
First, corresponding to the structure of system in embodiment mono-, a kind of flow process of the open task processing method of the present embodiment, refers to Fig. 5, and the method comprises the steps:
S501: receive user's solicited message, described request packets of information is containing the query task that the target data set in data source is inquired about.
S502: split strategy based on predefined first task described query task is split, obtain N subtask of described query task, wherein, described N is greater than 1 natural number.
S503: based on data source shared mechanism, parallel processing is carried out in a described N subtask, obtain corresponding N the sub-result of inquiry.
Wherein, step S503 specifically comprises:
A described N subtask is dispensed to N database server with man-to-man mapping relations;
Dispatch the parallel access of a described N database server, access described data source, obtain N the inquiry sub-result corresponding with a described N subtask.
S504: utilize the predefined rule that gathers that described N the sub-result of inquiry gathered, integrated, obtain the required query results of user.
S505: described query results is back to user.
Corresponding to the structure of task processing system in embodiment bis-, the present embodiment continues the another kind of flow process of open task processing method, and in this flow process, step S503 also comprises:
Based on predefined the second task, split strategy secondary fractionation is carried out in subtask described in each, obtain M secondary subtask of described subtask, wherein, described M is greater than 1 natural number;
Dispatch data source described in described N database server concurrent access, and make each database server process its responsible M secondary subtask with multithreading processing mode.
Corresponding to the structure of task processing system in embodiment tri-, as shown in Figure 6, task processing method also comprises the steps:
S506: when described database server breaks down, the responsible subtask of described database server of breaking down is delivered to the database server not breaking down and processed.
For the disclosed task processing method of the embodiment of the present invention four, because it is corresponding with the above disclosed task processing system of each embodiment, so that describes is fairly simple, relevant similarity refers to the explanation of task processing system part in above each embodiment, no longer describes in detail herein.
Next, of the present invention one concrete application example is disclosed.
This example provides a distributed real-time database system, as shown in Figure 7, this system is that (P is natural number by real-time data base, task management/fractionation server, dispatch server and P, and the group system that P >=N) individual database server forms, at user program, during to this system request query task, the process that this system is processed request task is as follows:
1) when user program is submitted task requests to this system, task management/fractionation server calls task splits strategy the large task of user's submission is split into N subtask, then the subtask request that comprises corresponding information is sent to dispatch server.
2) dispatch server is distributed to N database server idle in current system N subtask, and each database server is responsible for carrying out a subtask.
3) database server calls secondary fractionation strategy after receiving subtask, and secondary fractionation is carried out in subtask, M thread is distributed to in the M of gained secondary subtask and go to process simultaneously.And the M that M thread returned a sub-result carries out this locality and gather, obtain intermediate result value.
4), after all subtasks are all finished, dispatch server gathers N part intermediate result value by certain rule be a query results.
5) dispatch server wakes user program up, and query results is returned to user program, and this tasks carrying is complete.
In processing procedure, the situation that some or a plurality of servers break down, this system, according to failure handling mechanisms of the present invention, for the responsible task of failed server, is dispatched other normal server nodes by dispatch server it is processed.
In sum, the invention provides based on various dimensions strategy of task splits function and local task secondary fractionation function, adopt data sharing mode of management, by distributed cluster system, realized the parallel processing of each subtask, real-time data base single-point historical query performance and section historical query performance have significantly been promoted, task processing delay is little, speed is fast, and hardware configuration requires low.
It should be noted that, each embodiment in this instructions all adopts the mode of going forward one by one to describe, and each embodiment stresses is the difference with other embodiment, between each embodiment identical similar part mutually referring to.
While for convenience of description, describing above device, with function, be divided into various modules or unit is described respectively.Certainly, when implementing the application, the function of each module, unit can be realized in same or a plurality of software and/or hardware.
As seen through the above description of the embodiments, those skilled in the art can be well understood to the mode that the application can add essential general hardware platform by software and realizes.Understanding based on such, the part that the application's technical scheme contributes to prior art in essence in other words can embody with the form of software product, this computer software product can be stored in storage medium, as ROM/RAM, magnetic disc, CD etc., comprise that some instructions are with so that a computer equipment (can be personal computer, server, or the network equipment etc.) carry out the method described in some part of each embodiment of the application or embodiment.
The above is only the preferred embodiment of the present invention; it should be pointed out that for those skilled in the art, under the premise without departing from the principles of the invention; can also make some improvements and modifications, these improvements and modifications also should be considered as protection scope of the present invention.
Claims (10)
1. a task processing system, is characterized in that, comprises that request receiving module, task split module, task processing module, result integrate module and result and return to module, wherein:
Described request receiver module, for receiving user's solicited message, described request packets of information is containing the query task that the target data set in data source is inquired about;
Described task splits module, for splitting strategy based on predefined first task, described query task is split, and obtains N subtask of described query task, and wherein, described N is greater than 1 natural number;
Described task processing module, for based on data source shared mechanism, carries out parallel processing to a described N subtask, obtains corresponding N the sub-result of inquiry;
Described result integrate module, for utilizing the predefined rule that gathers that described N the sub-result of inquiry gathered, integrated, obtains the required query results of user;
Described result is returned to module, for described query results is back to user.
2. task processing system according to claim 1, is characterized in that, described data source is specially real-time data base.
3. task processing system according to claim 1, is characterized in that, described task processing module specifically comprises task allocation unit and parallel processing element, wherein:
Described task allocation unit, for being dispensed to N database server by a described N subtask with man-to-man mapping relations;
Described parallel processing element, for dispatching the parallel access of a described N database server, accessing described data source, obtains N the inquiry sub-result corresponding with a described N subtask.
4. task processing system according to claim 3, is characterized in that, described task processing module also comprises:
Subtask split cells, for splitting strategy based on predefined the second task, secondary fractionation is carried out in subtask described in each, obtain M secondary subtask of described subtask, and trigger described parallel processing element and carry out following operation: dispatch data source described in described N database server concurrent access, and make each database server process its responsible M secondary subtask with multi-thread concurrent processing mode, wherein, described M is greater than 1 natural number.
5. according to the task processing system described in claim 3-4 any one, it is characterized in that, also comprise:
Fault processing module, for when described database server breaks down, delivers the responsible subtask of the database server breaking down to the database server not breaking down and processes.
6. task processing system according to claim 4, it is characterized in that, described first task splits strategy, and specifically time attribute and the current parallel processing capability of database server cluster of the task amount based on described query task, the corresponding target data of query task are formulated; Described the second task splits strategy, and specifically time attribute and the current multi-thread concurrent processing power of respective database servers of the task amount based on corresponding subtask, the corresponding target data in subtask are formulated.
7. a task processing method, is characterized in that, comprising:
Receive user's solicited message, described request packets of information is containing the query task that the target data set in data source is inquired about;
Based on predefined first task, split strategy described query task is split, obtain N subtask of described query task, wherein, described N is greater than 1 natural number;
Based on data source shared mechanism, parallel processing is carried out in a described N subtask, obtain corresponding N the sub-result of inquiry;
Utilize the predefined rule that gathers that described N the sub-result of inquiry gathered, integrated, obtain the required query results of user;
Described query results is back to user.
8. task processing method according to claim 7, is characterized in that, describedly based on described data source, parallel processing is carried out in a described N subtask, obtains corresponding N the sub-result of inquiry, specifically comprises:
A described N subtask is dispensed to N database server with man-to-man mapping relations;
Dispatch the parallel access of a described N database server, access described data source, obtain N the inquiry sub-result corresponding with a described N subtask.
9. task processing method according to claim 8, is characterized in that, describedly based on described data source, parallel processing is carried out in a described N subtask, obtains corresponding N the sub-result of inquiry, also comprises:
Based on predefined the second task, split strategy secondary fractionation is carried out in subtask described in each, obtain M secondary subtask of described subtask, wherein, described M is greater than 1 natural number;
Dispatch data source described in described N database server concurrent access, and make each database server process its responsible M secondary subtask with multithreading processing mode.
10. the task processing method described according to Claim 8-9 any one, is characterized in that, also comprises:
When described database server breaks down, the responsible subtask of described database server of breaking down is delivered to the database server not breaking down and processed.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201410177684.2A CN103942098A (en) | 2014-04-29 | 2014-04-29 | System and method for task processing |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201410177684.2A CN103942098A (en) | 2014-04-29 | 2014-04-29 | System and method for task processing |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN103942098A true CN103942098A (en) | 2014-07-23 |
Family
ID=51189773
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201410177684.2A Pending CN103942098A (en) | 2014-04-29 | 2014-04-29 | System and method for task processing |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN103942098A (en) |
Cited By (35)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104331255A (en) * | 2014-11-17 | 2015-02-04 | 中国科学院声学研究所 | Embedded file system-based reading method for streaming data |
| CN104699542A (en) * | 2015-03-31 | 2015-06-10 | 北京奇艺世纪科技有限公司 | Task processing method and system |
| CN104731951A (en) * | 2015-03-31 | 2015-06-24 | 北京奇艺世纪科技有限公司 | Data query method and device |
| CN104731647A (en) * | 2015-03-31 | 2015-06-24 | 北京奇艺世纪科技有限公司 | Task processing method and system |
| CN105117283A (en) * | 2015-08-26 | 2015-12-02 | 深圳市华验防伪科技有限公司 | Task splitting method and system |
| CN105335143A (en) * | 2014-07-30 | 2016-02-17 | 阿里巴巴集团控股有限公司 | Business processing method and apparatus |
| CN105488134A (en) * | 2015-11-25 | 2016-04-13 | 用友网络科技股份有限公司 | Big data processing method and big data processing device |
| CN105843886A (en) * | 2016-03-21 | 2016-08-10 | 国电南瑞科技股份有限公司 | Multi-thread based power grid offline model data query method |
| CN106022908A (en) * | 2016-05-17 | 2016-10-12 | 中国建设银行股份有限公司 | Method and system for querying information of assets and liabilities |
| CN106330987A (en) * | 2015-06-15 | 2017-01-11 | 交通银行股份有限公司 | Dynamic load balancing method |
| CN106339265A (en) * | 2016-08-30 | 2017-01-18 | 中国银行股份有限公司 | Method and device for processing combined task |
| CN106407190A (en) * | 2015-07-27 | 2017-02-15 | 阿里巴巴集团控股有限公司 | Event record querying method and device |
| CN106570038A (en) * | 2015-10-12 | 2017-04-19 | 中国联合网络通信集团有限公司 | Distributed data processing method and system |
| CN106874080A (en) * | 2016-07-07 | 2017-06-20 | 阿里巴巴集团控股有限公司 | Method for computing data and system based on distributed server cluster |
| CN106873957A (en) * | 2016-06-23 | 2017-06-20 | 阿里巴巴集团控股有限公司 | The processing method and equipment of a kind of operation flow |
| CN106934027A (en) * | 2017-03-14 | 2017-07-07 | 深圳市博信诺达经贸咨询有限公司 | Distributed reptile realization method and system |
| CN107203645A (en) * | 2017-06-27 | 2017-09-26 | 浪潮软件集团有限公司 | Method for concurrently querying multiple databases and Eclipse platform |
| CN107291720A (en) * | 2016-03-30 | 2017-10-24 | 阿里巴巴集团控股有限公司 | A kind of method, system and computer cluster for realizing batch data processing |
| CN107707328A (en) * | 2016-08-08 | 2018-02-16 | 北京京东尚科信息技术有限公司 | Summary info transmission method and device |
| CN108052646A (en) * | 2017-12-25 | 2018-05-18 | 北京车联天下信息技术有限公司 | Big data system and method are calculated in real time |
| CN108172299A (en) * | 2017-12-25 | 2018-06-15 | 华中科技大学同济医学院附属协和医院 | A kind of medical data distal end computing system and method |
| CN108229908A (en) * | 2017-12-08 | 2018-06-29 | 泰康保险集团股份有限公司 | Reward appraisal method and apparatus |
| CN108241529A (en) * | 2017-10-13 | 2018-07-03 | 平安科技（深圳）有限公司 | Wages computational methods, application server and computer readable storage medium |
| CN108389121A (en) * | 2018-02-07 | 2018-08-10 | 平安普惠企业管理有限公司 | Loan data processing method, device, computer equipment and storage medium |
| WO2018188498A1 (en) * | 2017-04-12 | 2018-10-18 | 梅特勒-托利多(常州)精密仪器有限公司 | Collaborative weighing and measuring system and metering system |
| CN108846763A (en) * | 2018-06-05 | 2018-11-20 | 中国平安人寿保险股份有限公司 | Core protects request processing method, device, computer equipment and storage medium |
| CN109271243A (en) * | 2018-08-31 | 2019-01-25 | 郑州云海信息技术有限公司 | A kind of cluster task management system |
| CN109558237A (en) * | 2017-09-27 | 2019-04-02 | 北京国双科技有限公司 | A kind of task status management method and device |
| CN109901919A (en) * | 2017-12-08 | 2019-06-18 | 北京京东尚科信息技术有限公司 | Information output method and device |
| CN110119269A (en) * | 2019-04-19 | 2019-08-13 | 北京大米科技有限公司 | Method, apparatus, server and the storage medium of control task object |
| CN110209496A (en) * | 2019-05-20 | 2019-09-06 | 中国平安财产保险股份有限公司 | Task sharding method, device and sliced service device based on data processing |
| CN110765157A (en) * | 2019-09-06 | 2020-02-07 | 中国平安财产保险股份有限公司 | Data query method and device, computer equipment and storage medium |
| CN110780977A (en) * | 2019-10-25 | 2020-02-11 | 杭州安恒信息技术股份有限公司 | Task issuing method, device and system based on cloud computing and readable storage medium |
| CN112597338A (en) * | 2020-10-09 | 2021-04-02 | 腾讯科技（深圳）有限公司 | Video understanding method and related device |
| CN113438304A (en) * | 2021-06-23 | 2021-09-24 | 平安消费金融有限公司 | Data query method, device, server and medium based on database cluster |
Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US6112225A (en) * | 1998-03-30 | 2000-08-29 | International Business Machines Corporation | Task distribution processing system and the method for subscribing computers to perform computing tasks during idle time |
| US20090070773A1 (en) * | 2007-09-10 | 2009-03-12 | Novell, Inc. | Method for efficient thread usage for hierarchically structured tasks |
| CN101441557A (en) * | 2008-11-08 | 2009-05-27 | 腾讯科技（深圳）有限公司 | Distributed parallel calculating system and method based on dynamic data division |
| CN202058147U (en) * | 2011-05-23 | 2011-11-30 | 北京六所和瑞科技发展有限公司 | Distribution type real-time database management system |
| CN102630316A (en) * | 2011-12-22 | 2012-08-08 | 华为技术有限公司 | Processing method and apparatus of concurrent tasks |
| CN103235835A (en) * | 2013-05-22 | 2013-08-07 | 曙光信息产业(北京)有限公司 | Inquiry implementation method for database cluster and device |
| CN103246749A (en) * | 2013-05-24 | 2013-08-14 | 北京立新盈企信息技术有限公司 | Matrix data base system for distributed computing and query method thereof |
| CN103577938A (en) * | 2013-11-15 | 2014-02-12 | 国家电网公司 | Power grid dispatching automation main-and-standby system model synchronizing method and synchronizing system thereof |
-
2014
- 2014-04-29 CN CN201410177684.2A patent/CN103942098A/en active Pending
Patent Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US6112225A (en) * | 1998-03-30 | 2000-08-29 | International Business Machines Corporation | Task distribution processing system and the method for subscribing computers to perform computing tasks during idle time |
| US20090070773A1 (en) * | 2007-09-10 | 2009-03-12 | Novell, Inc. | Method for efficient thread usage for hierarchically structured tasks |
| CN101441557A (en) * | 2008-11-08 | 2009-05-27 | 腾讯科技（深圳）有限公司 | Distributed parallel calculating system and method based on dynamic data division |
| CN202058147U (en) * | 2011-05-23 | 2011-11-30 | 北京六所和瑞科技发展有限公司 | Distribution type real-time database management system |
| CN102630316A (en) * | 2011-12-22 | 2012-08-08 | 华为技术有限公司 | Processing method and apparatus of concurrent tasks |
| CN103235835A (en) * | 2013-05-22 | 2013-08-07 | 曙光信息产业(北京)有限公司 | Inquiry implementation method for database cluster and device |
| CN103246749A (en) * | 2013-05-24 | 2013-08-14 | 北京立新盈企信息技术有限公司 | Matrix data base system for distributed computing and query method thereof |
| CN103577938A (en) * | 2013-11-15 | 2014-02-12 | 国家电网公司 | Power grid dispatching automation main-and-standby system model synchronizing method and synchronizing system thereof |
Cited By (53)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105335143A (en) * | 2014-07-30 | 2016-02-17 | 阿里巴巴集团控股有限公司 | Business processing method and apparatus |
| CN104331255B (en) * | 2014-11-17 | 2018-04-17 | 中国科学院声学研究所 | A kind of stream data read method based on embedded file system |
| CN104331255A (en) * | 2014-11-17 | 2015-02-04 | 中国科学院声学研究所 | Embedded file system-based reading method for streaming data |
| CN104699542A (en) * | 2015-03-31 | 2015-06-10 | 北京奇艺世纪科技有限公司 | Task processing method and system |
| CN104731951A (en) * | 2015-03-31 | 2015-06-24 | 北京奇艺世纪科技有限公司 | Data query method and device |
| CN104731647A (en) * | 2015-03-31 | 2015-06-24 | 北京奇艺世纪科技有限公司 | Task processing method and system |
| CN104731951B (en) * | 2015-03-31 | 2018-08-07 | 北京奇艺世纪科技有限公司 | A kind of data query method and device |
| CN104731647B (en) * | 2015-03-31 | 2018-02-09 | 北京奇艺世纪科技有限公司 | Task processing method and system |
| CN104699542B (en) * | 2015-03-31 | 2018-02-09 | 北京奇艺世纪科技有限公司 | Task processing method and system |
| CN106330987A (en) * | 2015-06-15 | 2017-01-11 | 交通银行股份有限公司 | Dynamic load balancing method |
| US11113276B2 (en) | 2015-07-27 | 2021-09-07 | Advanced New Technologies Co., Ltd. | Querying a database |
| CN106407190A (en) * | 2015-07-27 | 2017-02-15 | 阿里巴巴集团控股有限公司 | Event record querying method and device |
| CN106407190B (en) * | 2015-07-27 | 2020-01-14 | 阿里巴巴集团控股有限公司 | Event record query method and device |
| CN105117283A (en) * | 2015-08-26 | 2015-12-02 | 深圳市华验防伪科技有限公司 | Task splitting method and system |
| CN106570038A (en) * | 2015-10-12 | 2017-04-19 | 中国联合网络通信集团有限公司 | Distributed data processing method and system |
| CN106570038B (en) * | 2015-10-12 | 2020-05-22 | 中国联合网络通信集团有限公司 | Distributed data processing method and system |
| CN105488134A (en) * | 2015-11-25 | 2016-04-13 | 用友网络科技股份有限公司 | Big data processing method and big data processing device |
| CN105843886A (en) * | 2016-03-21 | 2016-08-10 | 国电南瑞科技股份有限公司 | Multi-thread based power grid offline model data query method |
| CN107291720B (en) * | 2016-03-30 | 2020-10-02 | 阿里巴巴集团控股有限公司 | Method, system and computer cluster for realizing batch data processing |
| CN107291720A (en) * | 2016-03-30 | 2017-10-24 | 阿里巴巴集团控股有限公司 | A kind of method, system and computer cluster for realizing batch data processing |
| CN106022908A (en) * | 2016-05-17 | 2016-10-12 | 中国建设银行股份有限公司 | Method and system for querying information of assets and liabilities |
| CN106873957A (en) * | 2016-06-23 | 2017-06-20 | 阿里巴巴集团控股有限公司 | The processing method and equipment of a kind of operation flow |
| CN106874080A (en) * | 2016-07-07 | 2017-06-20 | 阿里巴巴集团控股有限公司 | Method for computing data and system based on distributed server cluster |
| CN106874080B (en) * | 2016-07-07 | 2020-05-12 | 阿里巴巴集团控股有限公司 | Data calculation method and system based on distributed server cluster |
| CN107707328B (en) * | 2016-08-08 | 2020-11-24 | 北京京东尚科信息技术有限公司 | Abstract information transmission method and device |
| CN107707328A (en) * | 2016-08-08 | 2018-02-16 | 北京京东尚科信息技术有限公司 | Summary info transmission method and device |
| CN106339265A (en) * | 2016-08-30 | 2017-01-18 | 中国银行股份有限公司 | Method and device for processing combined task |
| CN106934027A (en) * | 2017-03-14 | 2017-07-07 | 深圳市博信诺达经贸咨询有限公司 | Distributed reptile realization method and system |
| WO2018188498A1 (en) * | 2017-04-12 | 2018-10-18 | 梅特勒-托利多(常州)精密仪器有限公司 | Collaborative weighing and measuring system and metering system |
| US11378441B2 (en) | 2017-04-12 | 2022-07-05 | Mettler-Toledo (Changzhou) Precision Instruments Co., Ltd. | Collaborative weighing and measuring system and metering system |
| CN107203645A (en) * | 2017-06-27 | 2017-09-26 | 浪潮软件集团有限公司 | Method for concurrently querying multiple databases and Eclipse platform |
| CN109558237A (en) * | 2017-09-27 | 2019-04-02 | 北京国双科技有限公司 | A kind of task status management method and device |
| CN108241529A (en) * | 2017-10-13 | 2018-07-03 | 平安科技（深圳）有限公司 | Wages computational methods, application server and computer readable storage medium |
| CN108241529B (en) * | 2017-10-13 | 2021-11-09 | 平安科技（深圳）有限公司 | Salary calculation method, application server and computer readable storage medium |
| CN109901919B (en) * | 2017-12-08 | 2021-09-03 | 北京京东尚科信息技术有限公司 | Information output method and device |
| CN108229908B (en) * | 2017-12-08 | 2021-10-08 | 泰康保险集团股份有限公司 | Salary assessment method and device |
| CN109901919A (en) * | 2017-12-08 | 2019-06-18 | 北京京东尚科信息技术有限公司 | Information output method and device |
| CN108229908A (en) * | 2017-12-08 | 2018-06-29 | 泰康保险集团股份有限公司 | Reward appraisal method and apparatus |
| CN108172299B (en) * | 2017-12-25 | 2021-04-27 | 华中科技大学同济医学院附属协和医院 | Medical data remote computing system and method |
| CN108052646A (en) * | 2017-12-25 | 2018-05-18 | 北京车联天下信息技术有限公司 | Big data system and method are calculated in real time |
| CN108172299A (en) * | 2017-12-25 | 2018-06-15 | 华中科技大学同济医学院附属协和医院 | A kind of medical data distal end computing system and method |
| CN108389121A (en) * | 2018-02-07 | 2018-08-10 | 平安普惠企业管理有限公司 | Loan data processing method, device, computer equipment and storage medium |
| CN108389121B (en) * | 2018-02-07 | 2021-06-22 | 平安普惠企业管理有限公司 | Loan data processing method, loan data processing device, loan data processing program, and computer device and storage medium |
| CN108846763A (en) * | 2018-06-05 | 2018-11-20 | 中国平安人寿保险股份有限公司 | Core protects request processing method, device, computer equipment and storage medium |
| CN109271243B (en) * | 2018-08-31 | 2021-09-17 | 郑州云海信息技术有限公司 | Cluster task management system |
| CN109271243A (en) * | 2018-08-31 | 2019-01-25 | 郑州云海信息技术有限公司 | A kind of cluster task management system |
| CN110119269A (en) * | 2019-04-19 | 2019-08-13 | 北京大米科技有限公司 | Method, apparatus, server and the storage medium of control task object |
| CN110209496A (en) * | 2019-05-20 | 2019-09-06 | 中国平安财产保险股份有限公司 | Task sharding method, device and sliced service device based on data processing |
| CN110765157A (en) * | 2019-09-06 | 2020-02-07 | 中国平安财产保险股份有限公司 | Data query method and device, computer equipment and storage medium |
| CN110765157B (en) * | 2019-09-06 | 2024-02-02 | 中国平安财产保险股份有限公司 | Data query method, device, computer equipment and storage medium |
| CN110780977A (en) * | 2019-10-25 | 2020-02-11 | 杭州安恒信息技术股份有限公司 | Task issuing method, device and system based on cloud computing and readable storage medium |
| CN112597338A (en) * | 2020-10-09 | 2021-04-02 | 腾讯科技（深圳）有限公司 | Video understanding method and related device |
| CN113438304A (en) * | 2021-06-23 | 2021-09-24 | 平安消费金融有限公司 | Data query method, device, server and medium based on database cluster |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN103942098A (en) | System and method for task processing | |
| CN107066319B (en) | Multi-dimensional scheduling system for heterogeneous resources | |
| CN108874538B (en) | Scheduling server, scheduling method and application method for scheduling quantum computer | |
| CN104461740A (en) | Cross-domain colony computing resource gathering and distributing method | |
| CN110166282A (en) | Resource allocation methods, device, computer equipment and storage medium | |
| CN105242956A (en) | Virtual function service chain deployment system and deployment method therefor | |
| US9747130B2 (en) | Managing nodes in a high-performance computing system using a node registrar | |
| CN103927225A (en) | Multi-core framework Internet information processing and optimizing method | |
| CN103428008A (en) | Big data distribution strategy oriented to multiple user groups | |
| US9817698B2 (en) | Scheduling execution requests to allow partial results | |
| CN103399894A (en) | Distributed transaction processing method on basis of shared storage pool | |
| CN102789394B (en) | Method, device and nodes for parallelly processing information and server cluster | |
| Tao et al. | Job scheduling optimization for multi-user MapReduce clusters | |
| CN104112049A (en) | P2P (peer-to-peer) architecture based cross-data-center MapReduce task scheduling system and P2P architecture based cross-data-center MapReduce task scheduling method | |
| Simoncelli et al. | Stream-monitoring with blockmon: convergence of network measurements and data analytics platforms | |
| CN103473848B (en) | Network invoice checking framework and method based on high concurrency | |
| CN102420850B (en) | Resource scheduling method and system thereof | |
| CN104468710A (en) | Mixed big data processing system and method | |
| Pandya et al. | Dynamic resource allocation techniques in cloud computing | |
| Althebyan et al. | A scalable Map Reduce tasks scheduling: a threading-based approach | |
| CN103984529A (en) | X graphics system parallel acceleration method based on FT processor | |
| Wo et al. | Overbooking-based resource allocation in virtualized data center | |
| CN103617083A (en) | Storage scheduling method and system, job scheduling method and system and management node | |
| CN103379168A (en) | Data center resource distribution management method and system | |
| Mehta et al. | Performance enhancement of scheduling algorithms in clusters and grids using improved dynamic load balancing techniques |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20140723 |
|
| RJ01 | Rejection of invention patent application after publication |