CN101004743A - Distribution type file conversion system and method - Google Patents
Distribution type file conversion system and method Download PDFInfo
- Publication number
- CN101004743A CN101004743A CN 200610033196 CN200610033196A CN101004743A CN 101004743 A CN101004743 A CN 101004743A CN 200610033196 CN200610033196 CN 200610033196 CN 200610033196 A CN200610033196 A CN 200610033196A CN 101004743 A CN101004743 A CN 101004743A
- Authority
- CN
- China
- Prior art keywords
- task
- server
- file conversion
- type file
- distribution type
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Images
Abstract
A method for converting distributed file includes receiving task request sent by service system and converting said request to be task being added into system queue to be processed, indexing out available file processing server in low load and distributing task to said file processing server for carrying out treatment on said task there.
Description
[technical field]
The present invention relates to a kind of file conversion system and method, particularly a kind of distribution type file conversion system and method.
[background technology]
Along with the generation of computing machine, the operation processing mode of many business all is transformed into and operates operation on the computing machine.The professional processing that generally all can relate to document of Computer Processing, for example, report generation, document conversion, forms printing etc.The process of these document process is generally transferred to server and is finished, therefore, can the stability of server process document process and efficient will directly have influence on normally moving of system, if system handles document calculations complexity particularly, frequency height, when huge the and client of quantity needed response fast, the load of separate unit server was just too heavy, and the performance of processing can not satisfy the demands far away.
General document conversion method is so at present.For example, the contract administration system need change a large amount of contract documents every day, transfer process is that at first user end to server sends conversion request, server will specify the content of contract to take out from internal memory after receiving request, with its format and be saved as document, at last the document is converted to the file type that the user needs then.Such processing procedure is complicated, and system resources consumption is more, and to send the request average waiting response time simultaneously long when multi-client, in case and Transformation Service make mistakes, system can't normally use, thereby restrict the many parts of performances that the contract document is changed simultaneously.
[summary of the invention]
In view of above content, be necessary to provide a kind of distribution type file conversion system, it can distribute to the task requests of client different document process servers, to reduce the workload of separate unit server, improves the task treatment effeciency of server integral body.
In addition, also be necessary to provide a kind of distribution type file conversion method, it can distribute to the task requests of client different document process servers, to reduce the workload of separate unit server, improves the task treatment effeciency of server integral body.
A kind of distribution type file conversion system, it runs in the document process control center server, to distributing from the task requests of client in the operation system and carrying out parallel processing.The document processing controls central server links to each other with operation system and many document process servers.This distribution type file conversion system comprises: the task receiver module is used to receive the task requests that operation system sends, and is converted into task; The task management module is used for adding described task to the pending formation of system; The retrieval server module is used to retrieve the minimum and available document process server of charge capacity; The Task Distribution module is used for giving described charge capacity minimum and available document process server in the Task Distribution of the pending formation of system.
Further, described distribution type file conversion system also comprises: the task judge module, be used for judging whether the pending formation of this system exists this task, and judge system has finished whether there is this task in the cache set; And the task notification module, be used for the informing business system task and await orders or finish.
Further, the described task receiver module task of also being used to receive the document process server is finished information.
Further, described task management module also is used for adding task to system have been finished set and it has been issued operation system, simultaneously task is deleted from the pending formation of system, and interpolation task to system finishes in the cache set.
A kind of distribution type file conversion method, it runs in the document process control center server, to distributing from the task requests of client in the operation system and carrying out parallel processing.The document processing controls central server links to each other with operation system and many document process servers.This method comprises the steps: the task requests that (a) system that accepts business sends, and is converted into task; (b) the interpolation task is to the pending formation of system; (c) retrieve the little and available document process server of charge capacity, and give the document processing server Task Distribution; (d) this task of document process server process.
Further, this method also comprises step: whether (e) reception task is handled and is completed successfully; (f), then turn back to the step of the little and available document process server of retrieval retrieval charge capacity if do not complete successfully; (g) if complete successfully, then add task to system and finished set and it is issued operation system, simultaneously task is removed from the pending formation of system; (h) interpolation task to system has finished cache set; (i) the informing business system task is finished.
Compared to prior art, described distribution type file conversion system and method, the request task that the processing client that adopts multiple servers to walk abreast sends, improved the efficient of system handles document, and when certain station server is made mistakes, system can carry out to other server the Task Distribution of makeing mistakes, thereby has improved the stability of system.
[description of drawings]
Fig. 1 is the hardware frame figure of the preferred embodiment of distribution type file conversion system of the present invention.
Fig. 2 is the functional block diagram of distribution type file conversion system of the present invention.
Fig. 3 is the process flow diagram of the preferred embodiment of distribution type file conversion method of the present invention.
[embodiment]
As shown in Figure 1, be the hardware frame figure of the preferred embodiment of distribution type file conversion system of the present invention.The hardware frame of this preferred embodiment mainly comprises client 10, operation system 20, document process control center server 30, and a plurality of document process server 40.This distribution type file conversion system 100 runs in the document processing controls central server 30, is used to receive client 10 document convert task requests and it is distributed to each document process server 40, comes the task requests of parallel processing client 10.This distribution type file conversion system 100 comprises a plurality of functional modules, sees Fig. 2 description for details.
As shown in Figure 2, be the functional block diagram of distribution type file conversion system of the present invention.This distribution type file conversion system 100 comprises task receiver module 110, task judge module 120, task management module 130, retrieval server module 140, Task Distribution module 150, and task notification module 160.
Described task receiver module 110 is used to receive the document convert task request that operation system 20 sends and is converted into task, and receives document process server 40 tasks and finish information.
Described task judge module 120 is used for judging whether the pending formation of system exists this task, judges system has finished whether there is this task in the cache set.In this preferred embodiment, described system has finished cache set and has been used for placing and finishes the task of (in 2 minutes) recently, and the system that enters has finished task in the cache set and finished in this system that to deposit certain hour (such as 2 minutes) back in the cache set just deleted.
Described task management module 130 is used for the interpolation task to the pending formation of system, adding task to system has finished in the set and with it and has issued operation system, simultaneously task is deleted from the pending formation of system, interpolation task to system finishes in the cache set.In this preferred embodiment, described system has finished set and has been used to place all completed tasks, all tasks that supervisory system is finished dealing with.After a certain task is finished, the system that is put into has finished in the set with this task earlier, and task deleted from the pending formation of system, finished from system then and added this task to system the set and finished in the cache set, this task system finished treat in the cache set as 2 minutes will be deleted, when operation system 20 is sent the task requests of same task in 2 minutes, task judge module 120 will be judged this task and be present in system and finish in the cache set, has finished in the set and with it and issues operation system 20 so just this task has been finished the system that copies to the cache set from system.
Described retrieval server module 140 is used to retrieve the minimum and available document process server 40 of charge capacity.Details are as follows for the minimum also available document process server 40 of described retrieval charge capacity: before document process server 40 Processing tasks, document process server 40 is initialized as zero with its task average handling time, behind the document processing server 40 beginning Processing tasks, the document processing server 40 upgrades its task average handling time according to T.T. of its Processing tasks divided by the task sum of its processing; Retrieval server module 140 is obtained the task average handling time of each document process server 40 and pending number of tasks, calculates the charge capacity of each document process server 40 according to this task average handling time and this pending number of tasks.In this preferred embodiment, system can be every document process server 40 of regular hour (such as 2 seconds) retrieval.
Described Task Distribution module 150 is used for charge capacity minimum and available document process server 40 that the pending formation of system is just waiting pending Task Distribution to be retrieved for retrieval server module 140 are handled.
Described task notification module 160 is used for informing business system 20 tasks and awaits orders or finish.Judge in the task receiver module 110 task pending formation of system Already in converted according to its task requests of accepting when task judge module 120, task notification module 160 informing business systems 20 tasks are awaited orders.After task management module 130 was added into task system and has finished in the cache set, task notification module 160 informing business systems 20 tasks were finished.
By above-mentioned distribution type file conversion system 100,, as described below in the step of implementing the distribution type file conversion.
In present embodiment, at first, the task requests that task receiver module 110 reception operation systems 20 send over also is converted into task; Then, task judge module 120 judges in the pending formation of system whether have this task; If do not have this task in the pending formation of system, task judge module 120 judges system has finished whether there is this task in the buffer memory again; If system has finished and also do not had this task in the buffer memory, task management module 130 is added into the pending formation of system with this task; Then, the minimum and available document process server 40 of retrieval server module 140 retrieval charge capacity, Task Distribution module 150 will just wait pending Task Distribution to handle to this document process server that retrieves 40 in the pending formation of system; Then, document process server 40 begins to create new thread and handles this task, after finishing dealing with, the information of finishing dealing with is returned to task receiver module 110; Task receiver module 110 tasks of receiving are finished dealing with after the information, task management module 130 is added this task to system and has been finished in the set and with it and issue operation system 20, simultaneously task is deleted from the pending formation of system, again this task is added into system and has finished in the cache set; At last, task notification module 160 informing business system tasks are finished.
As shown in Figure 3, be the process flow diagram of the preferred embodiment of distribution type file conversion method of the present invention.At first, step S11, operation system 20 receives client 10 document convert task requests, and sends this task requests to distribution type file conversion system 100.
Step S12, task receiver module 110 receives the task requests that operation system 20 sends, and is converted into task.
Step S13, task judge module 120 judge in the pending formation of system whether have this task.In this preferred embodiment, the pending formation of system is used to place waits for the task that document process server 40 is handled that is assigned to, and task is assigned with according to the first in first out wait in the pending formation of this system.
Step S14, if there is this task in the pending formation of system, task notification module 160 informing business systems 20 these tasks are awaited orders, and promptly this task is in the pending formation of system, wait for and distribute to document process server 40 or just processing in document process server 40.
Step S15, if do not have this task in the pending formation of system, task judge module 120 continues to judge system has finished whether there is this task in the cache set.In this preferred embodiment, described system has finished cache set and has been used for placing and finishes the task of (in 2 minutes) recently, and the task that the system that enters has finished buffer memory has finished in this system that to deposit certain hour (such as 2 minutes) back in the cache set just deleted.
Step S16, if system has finished and do not had this task in the cache set, task management module 130 is added this task to the pending formation of system.
There is this task in step S17 if system has finished in the cache set, this task has been finished the system that copies to the cache set from system finished in the set and with it and issue operation system 20, forwards step S23 then to.
Step S18, the minimum and available document process server 40 of retrieval server module 140 retrieval charge capacity, Task Distribution module 150 is just waiting pending Task Distribution to this document process server 40 that retrieves in the pending formation of system.
Step S19, document process server 40 is handled this task.
Step S20, document process server 40 judge whether successful this task is handled.If task is finished dealing with and is handled successfully with regard to the expression task; Interrupting just expression if the task processing is not finished handles unsuccessful.
Step S21, if this task handles successfully, task management module 130 is added this task to system and is finished in the set, and task is deleted from the pending formation of system.In this preferred embodiment, described system has finished set and has been used to place all completed tasks, all tasks that supervisory system is finished dealing with.
Step S22, task management module 130 is added this task to system and is finished in the cache set.
Step S23, task notification module 160 informing business systems 20 tasks are finished.
In step S20, unsuccessful if this task is handled, then be back to step S18.
Claims (9)
1. distribution type file conversion system, it runs in the document process control center server, to distributing from the task requests of client in the operation system and carrying out parallel processing, the document processing controls central server links to each other with operation system and many document process servers, it is characterized in that this distribution type file conversion system comprises:
The task receiver module is used to receive the task requests that operation system sends, and is converted into task;
The task management module is used for adding described task to the pending formation of system;
The retrieval server module is used to retrieve the minimum and available document process server of charge capacity;
The Task Distribution module is used for giving described charge capacity minimum and available document process server in the Task Distribution of the pending formation of system.
2. distribution type file conversion system as claimed in claim 1 is characterized in that, this system also comprises:
The task judge module is used for judging whether the pending formation of this system exists this task, judges system has finished whether there is this task in the cache set; And
The task notification module is used for the informing business system task and awaits orders or finish.
3. distribution type file conversion system as claimed in claim 2 is characterized in that, described task receiver module also is used to receive the task of document process server and finishes information.
4. distribution type file conversion system as claimed in claim 2, it is characterized in that, described task management module also is used for adding task to system and has finished set and it is issued operation system, simultaneously task is deleted from the pending formation of system, and interpolation task to system finishes in the cache set.
5. distribution type file conversion system as claimed in claim 1 is characterized in that, described charge capacity is the task average handling time of document process server and the product of its waiting task number.
6. distribution type file conversion system as claimed in claim 5 is characterized in that, described task average handling time equals the T.T. of the document processing server Processing tasks divided by the task sum of handling.
7. distribution type file conversion method, it runs in the document process control center server, to distributing from the task requests of client in the operation system and carrying out parallel processing, the document processing controls central server links to each other with operation system and many document process servers, it is characterized in that this method comprises the steps:
The task requests that the system that accepts business sends, and be converted into task;
The interpolation task is to the pending formation of system;
Retrieve the little and available document process server of charge capacity, and give the document processing server Task Distribution;
This task of document process server process.
8. distribution type file conversion method as claimed in claim 7 is characterized in that, this method also comprises step:
Whether the reception task is handled and is completed successfully;
If do not complete successfully, then turn back to the step of the little and available document process server of retrieval retrieval charge capacity;
If complete successfully, then add task to system and finished set and it is issued operation system, simultaneously task is removed from the pending formation of system;
Interpolation task to system has finished cache set;
The informing business system task is finished.
9. distribution type file conversion method as claimed in claim 7 is characterized in that, wherein step interpolation task requests also comprised to the pending formation of system:
Judge in the pending formation of system and whether have this task;
If do not exist, judge then system has finished whether there is this task in the cache set;
If exist, then the informing business system task is awaited orders.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN200610033196A CN101004743B (en) | 2006-01-21 | 2006-01-21 | Distribution type file conversion system and method |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN200610033196A CN101004743B (en) | 2006-01-21 | 2006-01-21 | Distribution type file conversion system and method |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN101004743A true CN101004743A (en) | 2007-07-25 |
| CN101004743B CN101004743B (en) | 2010-05-26 |
Family
ID=38703888
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN200610033196A Expired - Fee Related CN101004743B (en) | 2006-01-21 | 2006-01-21 | Distribution type file conversion system and method |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN101004743B (en) |
Cited By (16)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2009103221A1 (en) * | 2008-02-22 | 2009-08-27 | 中国科学院软件研究所 | Effective relating theme model data processing method and system thereof |
| WO2010127475A1 (en) * | 2009-05-08 | 2010-11-11 | 北京锐安科技有限公司 | Distributed image processing method and image processing system |
| CN102117437A (en) * | 2009-12-31 | 2011-07-06 | 鸿富锦精密工业（深圳）有限公司 | Distributed electronic sing-off realization system and method |
| CN102387136A (en) * | 2011-10-10 | 2012-03-21 | 深圳中兴网信科技有限公司 | System and method for converting distributed PPT (Power Point) files into swf (small web format) files |
| US8707310B2 (en) | 2008-10-15 | 2014-04-22 | Oracle International Corporation | Batch processing of jobs on multiprocessors based on estimated job processing time |
| CN104408068A (en) * | 2014-10-29 | 2015-03-11 | 中国建设银行股份有限公司 | Report form data processing method and related equipment |
| CN104536827A (en) * | 2015-01-27 | 2015-04-22 | 浪潮(北京)电子信息产业有限公司 | Data dispatching method and device |
| CN105095299A (en) * | 2014-05-16 | 2015-11-25 | 北京奇虎科技有限公司 | Picture capturing method and system |
| CN105589957A (en) * | 2015-12-22 | 2016-05-18 | 新浪网技术(中国)有限公司 | Document conversion method and document conversion system |
| CN105824699A (en) * | 2015-01-06 | 2016-08-03 | 中国移动通信集团山东有限公司 | Distributed task scheduling apparatus and method |
| CN106599259A (en) * | 2016-12-21 | 2017-04-26 | 江苏省连云港工贸高等职业技术学校 | System for quickly accessing SQL database |
| CN109286665A (en) * | 2018-09-17 | 2019-01-29 | 北京龙拳风暴科技有限公司 | The real-time long link processing method and processing device of moving game |
| CN109635652A (en) * | 2018-11-08 | 2019-04-16 | 杭州火视科技有限公司 | Distributed face characteristic extraction system based on embedded device |
| WO2019095448A1 (en) * | 2017-11-17 | 2019-05-23 | 深圳市鹰硕技术有限公司 | Monitoring system for remote education system server farm |
| CN113364852A (en) * | 2021-06-02 | 2021-09-07 | 中国工商银行股份有限公司 | File transmission method and device and server |
| CN116932502A (en) * | 2023-07-14 | 2023-10-24 | 广州东瑞科技有限公司 | Distributed medical record document generation method, system, computer equipment and storage medium |
Families Citing this family (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102567106B (en) * | 2010-12-30 | 2014-10-01 | 中国移动通信集团云南有限公司 | Task scheduling method, system and device |
| US9537914B1 (en) * | 2015-12-01 | 2017-01-03 | International Business Machines Corporation | Vehicle domain multi-level parallel buffering and context-based streaming data pre-processing system |
Family Cites Families (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US5797005A (en) * | 1994-12-30 | 1998-08-18 | International Business Machines Corporation | Shared queue structure for data integrity |
| GB2320112B (en) * | 1996-12-07 | 2001-07-25 | Ibm | High-availability computer server system |
| US6393458B1 (en) * | 1999-01-28 | 2002-05-21 | Genrad, Inc. | Method and apparatus for load balancing in a distributed object architecture |
-
2006
- 2006-01-21 CN CN200610033196A patent/CN101004743B/en not_active Expired - Fee Related
Cited By (18)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2009103221A1 (en) * | 2008-02-22 | 2009-08-27 | 中国科学院软件研究所 | Effective relating theme model data processing method and system thereof |
| CN101821728B (en) * | 2008-10-15 | 2017-07-07 | 甲骨文国际公司 | Batch processing system |
| US8707310B2 (en) | 2008-10-15 | 2014-04-22 | Oracle International Corporation | Batch processing of jobs on multiprocessors based on estimated job processing time |
| WO2010127475A1 (en) * | 2009-05-08 | 2010-11-11 | 北京锐安科技有限公司 | Distributed image processing method and image processing system |
| CN102117437A (en) * | 2009-12-31 | 2011-07-06 | 鸿富锦精密工业（深圳）有限公司 | Distributed electronic sing-off realization system and method |
| CN102387136A (en) * | 2011-10-10 | 2012-03-21 | 深圳中兴网信科技有限公司 | System and method for converting distributed PPT (Power Point) files into swf (small web format) files |
| CN105095299A (en) * | 2014-05-16 | 2015-11-25 | 北京奇虎科技有限公司 | Picture capturing method and system |
| CN104408068A (en) * | 2014-10-29 | 2015-03-11 | 中国建设银行股份有限公司 | Report form data processing method and related equipment |
| CN105824699A (en) * | 2015-01-06 | 2016-08-03 | 中国移动通信集团山东有限公司 | Distributed task scheduling apparatus and method |
| CN104536827A (en) * | 2015-01-27 | 2015-04-22 | 浪潮(北京)电子信息产业有限公司 | Data dispatching method and device |
| CN105589957A (en) * | 2015-12-22 | 2016-05-18 | 新浪网技术(中国)有限公司 | Document conversion method and document conversion system |
| CN106599259A (en) * | 2016-12-21 | 2017-04-26 | 江苏省连云港工贸高等职业技术学校 | System for quickly accessing SQL database |
| WO2019095448A1 (en) * | 2017-11-17 | 2019-05-23 | 深圳市鹰硕技术有限公司 | Monitoring system for remote education system server farm |
| CN109286665A (en) * | 2018-09-17 | 2019-01-29 | 北京龙拳风暴科技有限公司 | The real-time long link processing method and processing device of moving game |
| CN109635652A (en) * | 2018-11-08 | 2019-04-16 | 杭州火视科技有限公司 | Distributed face characteristic extraction system based on embedded device |
| CN113364852A (en) * | 2021-06-02 | 2021-09-07 | 中国工商银行股份有限公司 | File transmission method and device and server |
| CN116932502A (en) * | 2023-07-14 | 2023-10-24 | 广州东瑞科技有限公司 | Distributed medical record document generation method, system, computer equipment and storage medium |
| CN116932502B (en) * | 2023-07-14 | 2024-04-05 | 广州东瑞科技有限公司 | Distributed medical record document generation method, system, computer equipment and storage medium |
Also Published As
| Publication number | Publication date |
|---|---|
| CN101004743B (en) | 2010-05-26 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN101004743B (en) | Distribution type file conversion system and method | |
| CN102299959B (en) | Load balance realizing method of database cluster system and device | |
| CN100531055C (en) | Data synchronous system and its method | |
| US9934263B1 (en) | Big-fast data connector between in-memory database system and data warehouse system | |
| CN111124662B (en) | Fog calculation load balancing method and system | |
| US9330177B2 (en) | System, method and device for internet search based on peer-to-peer network | |
| CN102780768A (en) | Processing method and processing system for highly-concurrent requests | |
| CN105005611B (en) | A kind of file management system and file management method | |
| CN106170016A (en) | A kind of method and system processing high concurrent data requests | |
| CN103281367A (en) | Load balance method and device | |
| CN104969213A (en) | Data stream splitting for low-latency data access | |
| CN103106249A (en) | Data parallel processing system based on Cassandra | |
| CN102982116A (en) | Multi-media transfer method and system based on cloud | |
| CN104333573A (en) | Processing method and processing system for highly-concurrent requests | |
| CN106777311B (en) | Flight space state caching method and system | |
| CN101551745A (en) | Method for greatly improving performance of workflow engine | |
| JP4000223B2 (en) | Information search method, information search system, and search management apparatus for the system | |
| CN108829512A (en) | A kind of cloud central hardware accelerates distribution method, system and the cloud center of calculating power | |
| CN108984571A (en) | Transaction Identifier operating method, system and computer readable storage medium | |
| CN102750368A (en) | High-speed importing method of cluster data in data base | |
| CN107562803B (en) | Data supply system and method and terminal | |
| CN104933202A (en) | Method and device for data extraction, transformation and ETL loading | |
| CN101159972B (en) | Traffic processing method and system and traffic control point | |
| CN103248636A (en) | Offline download system and method | |
| CN107451211B (en) | A kind of download system based on RabbitMQ and MongoDB |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C14 | Grant of patent or utility model | ||
| GR01 | Patent grant | ||
| CF01 | Termination of patent right due to non-payment of annual fee |
Granted publication date: 20100526 Termination date: 20150121 |
|
| EXPY | Termination of patent right or utility model |