CN103902378A - File allocation system and method - Google Patents
File allocation system and method Download PDFInfo
- Publication number
- CN103902378A CN103902378A CN201210571256.9A CN201210571256A CN103902378A CN 103902378 A CN103902378 A CN 103902378A CN 201210571256 A CN201210571256 A CN 201210571256A CN 103902378 A CN103902378 A CN 103902378A
- Authority
- CN
- China
- Prior art keywords
- file
- server
- charge capacity
- file server
- allocation
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Landscapes
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
- Information Transfer Between Computers (AREA)
Abstract
The invention discloses a file allocation system. The file allocation system comprises a classification module, a file acquisition module, a judgment module and an allocation module. The classification module is used for presetting file classes and classifying a plurality of file servers according to the file classes. The file acquisition module is used for receiving files to be processed and allocating the received files to the corresponding file servers according to the file classes. The judgment module is used for determining the load capacity of each file server and judging whether the load capacity of the file servers reaches a preset threshold value. The allocation module is used for allocating the files of the file server with the highest load capacity to the file server with the load capacity reaching the preset threshold value according to a preset proportion when the load capacity of the file server reaches the preset threshold value. The invention further provides a file allocation method. According to the file allocation system and method, the files to be processed in the file servers can be allocated.
Description
Technical field
The present invention relates to data distribution technology, relate in particular to a kind of file allocation system and method.
Background technology
At present, the processing majority of file utilizes computing machine to carry out, and the processing of file is also not only confined to generation and the editor of file, also comprises identification and parsing to different-format file content.For example, along with the internationalization process of patent industry is more and more faster, each applicant grows with each passing day in the patent amount of country variant and regional application, and the patent matter of the multiple countries of the thing followed is processed item and also become various, and it is exactly wherein one that the patent document received that official is sent is resolved.Taking enterprise as example, due to different at the patent numbers of every country application, some country official's document received quantity can be more, other is relatively less.
Utilize multiple servers to resolve official's document received of country variant, if a server is only in order to resolve national official's document received, will certainly cause some server load overweight because of the unequal distribution of file, some server is by vacant, the waste that will cause resource unreasonable distribution like this and produce resource, the directly processing speed of impact to file.
In addition, can the stability of server process file process and efficiency will directly have influence on normally moving of system, if particularly system is processed file calculation of complex, the frequency is high, when huge the and client of quantity needs response fast, the load of separate unit server is just too heavy, and the performance of processing can not satisfy the demands far away.
Summary of the invention
In view of above content, be necessary to provide a kind of file allocation system and method, can realize according to the load of the server of processing file the automatic distribution of file.
A kind of file allocation system, applies to distribution server, and described distribution server is connected with multiple file servers, and this system comprises: sort module, for default file classification, and according to this file class, described multiple file servers are classified; File acquisition module, for receiving pending file, according to described file class by received file allocation to corresponding file server; Judge module, for determining the charge capacity of each file server according to the quantity of the pending file of each file server, and judges whether that the charge capacity of file server reaches pre-set threshold value; And distribution module, in the time that the charge capacity that has file server reaches pre-set threshold value, the file of file server the highest charge capacity is distributed to described charge capacity and is reached the file server of pre-set threshold value by preset ratio.
A kind of file allocation method, applies to distribution server, and described distribution server is connected with multiple file servers, and the method comprises the steps: default file classification, and according to this file class, described multiple file servers is classified; Receive pending file, according to described file class by received file allocation to corresponding file server; Determine the charge capacity of each file server according to the quantity of the pending file in each file server; The charge capacity that judges whether file server reaches pre-set threshold value; And in the time that the charge capacity that has file server reaches pre-set threshold value, the file of file server the highest charge capacity is distributed to described charge capacity and is reached the file server of pre-set threshold value by preset ratio.
Compared to prior art, described file allocation system and method, can realize the automatic distribution of file according to the load of server of processing file, thereby realize the reasonable distribution of resource and guarantee the processing speed of file, to reduce the wasting of resources or the excessive loss to server.
Brief description of the drawings
Fig. 1 is the hardware structure figure of the preferred embodiments of file allocation system of the present invention.
Fig. 2 is the functional block diagram of the preferred embodiments of file allocation system of the present invention.
Fig. 3 is the process flow diagram of the preferred embodiments of file allocation method of the present invention.
Main element symbol description
| Distribution server | 1 |
| |
10 |
| |
100 |
| |
102 |
| |
104 |
| |
106 |
| Processor | 11 |
| |
12 |
| |
2 |
Following embodiment further illustrates the present invention in connection with above-mentioned accompanying drawing.
Embodiment
As shown in Figure 1, be the hardware structure figure of the first embodiment of file allocation system of the present invention.Distribution server 1 is connected with multiple file servers 2, and described distribution server 1 can be the calculation element such as computing machine, mainframe with multiple file servers 2.
Described distribution server 1 comprises file allocation system 10 as shown in Figure 2, for example, to realize the correlation function of this file distribution system 10: the All Files receiving is classified to be dispensed to different file server 2.
Described file server 2, for the file receiving is processed, includes, but are not limited to: the processing such as parsing, generation resolution data to file content.For the ease of the file in different file servers 2 being distributed and processing, therefore, each file server 2 is all provided with the related software of the file that processing itself and other file servers 2 adapt to.
In the present embodiment, the server that described distribution server 1 and described multiple file servers 2 can be same types, and be only to carry out the name of difference formula in order to be below convenient to explanation,, described distribution server 1 can be also a file server, for example, be considered as distribution server 1 by one in multiple file servers 2.
In addition, in other embodiments, described distribution server 1 can be also the server that and file server 2 exist function difference, for example, described distribution server 1 is for the file receiving is distributed and the calculating of correlation parameter, and itself can not process file.In practical application, be not limited to above-mentioned illustrating.
As shown in Figure 2, be the functional block diagram of the preferred embodiments of file allocation system of the present invention.Described file allocation system 10 is applied in described distribution server 1, be used for receiving various types of files, the All Files receiving is classified and is dispensed to different file server 2, and the file of each file server 2 required processing is adjusted with balanced load rate.
Described distribution server 1 also comprises processor 11 and memory storage 12.Described processor 11 such as, for carrying out all kinds of softwares of described file allocation system 10 and the 1 interior installation of described distribution server, operating system etc.Described memory storage 12 can be hard disk, or the storage card of other types or memory device.Described memory storage 12 is for storing Various types of data, for example, and file, image, resolution data and utilize the information such as the data that described file allocation system 10 arranges and obtain.
In the present embodiment, described file allocation system 10 comprises multiple functional modules, respectively: sort module 100, file acquisition module 102, judge module 104 and distribution module 106.
Described sort module 100, for default file classification, and classifies to described multiple file servers 2 according to this file class.For example, described file can be the patent document that the official mission of country variant sends, and described kind of document arranges according to the country variant under patent document.In addition, also can carry out corresponding classification setting according to other different attributes of file.
Described file acquisition module 102, for receiving pending file, and according to described file class by received file allocation to corresponding file server 2.Described pending file can be the file receiving by network, or user uploads to the various files of described distribution server 1, for example, the file that the official mission from every country that described distribution server 1 receives by internet etc. or other mechanisms send, or the user who receives by intranet is uploaded to the file of described distribution server 1.
Described judge module 104, for determine the charge capacity of each file server 2 according to the quantity of the pending file of each file server 2, described charge capacity equals the quantity of pending file in each file server 2.
Described judge module 104 is also for judging whether that the charge capacity of All Files server 2 is zero.If the charge capacity of All Files server 2 is all zero, described judge module 104 can judge that the file of all receptions is disposed.
If not the charge capacity of All Files server 2 is zero, described judge module 104 further judges whether that the charge capacity of file server 2 reaches pre-set threshold value.Described pre-set threshold value can be zero or arrange other numerical value.Suppose that this pre-set threshold value is at 1 o'clock, be all at 1 o'clock in the charge capacity that is not All Files server 2, the file server 2 that expression can be zero to charge capacity by the file allocation in non-vanishing file server 2 is processed.
If do not have the charge capacity of file server 2 to reach pre-set threshold value, described judge module 104 can repeat to calculate, because the reception of file, distribution and each file server 2 are that the moment is ongoing to the processing of file, therefore, the charge capacity of each file server 2 is also to change in the moment.
Described distribution module 106, in the time that the charge capacity that has file server 2 reaches pre-set threshold value, distributes to the file of file server the highest charge capacity 2 described charge capacity and reaches the file server 2 of pre-set threshold value by preset ratio.Described preset ratio can be that equity is divided equally ratio, for example, reaches the file server 2 of pre-set threshold value to described charge capacity the file allocation half in file server the highest charge capacity 2.
If being assigned to described charge capacity, to reach the file of file server 2 of pre-set threshold value different with the attribute of this file server 2 original files of processing or need to call different software this file being assigned with is processed and parsing, can utilize described sort module 100 to set in advance the code of corresponding different file classs, All Files possesses this code information in a point timing meeting, any one file server 2 can be according to this code call corresponding to the file processing software of this code to realize the relevant treatment to this category file.For example, if when described file is patent document, different classes of patent document can be distinguished according to country origin, represents Chinese file with CN, represents the file of the U.S. etc. with US.
In other embodiments, if there is the charge capacity of two or more file servers 2 to reach pre-set threshold value, described distribution module 106 can be one by one carried out the distribution of pre-set ratio by the file server 2 of high capacity amount and the file server of higher load amount 2 with multiple file servers 2 that described charge capacity reaches pre-set threshold value.
In other embodiments, described sort module 100 is also for default multiple load levels, and determines the residing load level of each file server 2 according to described charge capacity.Described load level can be divided according to default quantity of documents, for example, that load level comprises is high, high, medium and low, zero, the quantity of documents of high load level for example, for (being greater than preset value, be greater than 1000), the quantity of documents of high, medium and low load level is between two critical values, for example, the quantity of documents scope of high load level is [700, the quantity of documents scope of the load level 1000], is [400,699], the quantity of documents scope of low load level is [Isosorbide-5-Nitrae 00].
Described distribution module 106 is also for to the distribution of file for example realizing according to load level, by the file of the file server in very high loads grade 2 and low or be that the file of the file server 2 of zero load level adds General Logistics Department's mean allocation.
As shown in Figure 3, be the process flow diagram of the preferred embodiments of file allocation method of the present invention.First, step S2, described sort module 100 default file classifications, and according to this file class, described multiple file servers 2 are classified.
Step S4, described file acquisition module 102 receives pending file.
Step S6, described file acquisition module 102 according to described file class by received file allocation to corresponding file server 2.
Step S8, described judge module 104 is determined the charge capacity of each file server 2 according to the quantity of the pending file in each file server 2.
Step S10, described judge module 104 judges whether that the charge capacity of All Files server 2 is zero.If the charge capacity of All Files server 2 is zero, process ends.
If not the charge capacity of All Files server 2 is zero, in step S12, described judge module 104 judges whether that the charge capacity of file server 2 reaches pre-set threshold value.
If do not have the charge capacity of file server 2 to reach pre-set threshold value, flow process is back to step S8 and determines with the current file quantity to each file server 2 again.
If there is the charge capacity of file server 2 to reach pre-set threshold value, in step S14, described distribution module 106 is distributed to the file of file server the highest charge capacity 2 described charge capacity and reaches the file server 2 of pre-set threshold value by preset ratio, then, flow process is back to step S8 and determines with the current file quantity to each file server 2 again.
Above embodiment is only unrestricted in order to technical scheme of the present invention to be described, although the present invention is had been described in detail with reference to above preferred embodiments, those of ordinary skill in the art should be appreciated that and can modify or be equal to the spirit and scope that replacement should not depart from technical solution of the present invention technical scheme of the present invention.
Claims (10)
1. a file allocation system, applies to distribution server, and described distribution server is connected with multiple file servers, it is characterized in that, this system comprises:
Sort module, for default file classification, and classifies to described multiple file servers according to this file class;
File acquisition module, for receiving pending file, according to described file class by received file allocation to corresponding file server;
Judge module, for determining the charge capacity of each file server according to the quantity of the pending file of each file server, and judges whether that the charge capacity of file server reaches pre-set threshold value; And
Distribution module, in the time that the charge capacity that has file server reaches pre-set threshold value, distributes to the file of file server the highest charge capacity described charge capacity and reaches the file server of pre-set threshold value by preset ratio.
2. file allocation system as claimed in claim 1, is characterized in that, described sort module is also for determining the residing load level of each file server according to described charge capacity, and the quantity of documents according to default of described load level is divided.
3. file allocation system as claimed in claim 1, is characterized in that, described distribution module is also for adding General Logistics Department's mean allocation by the file of the file server of the file of the file server of high load level and low load level.
4. file allocation system as claimed in claim 1, is characterized in that, described distribution module, also for being all at 1 o'clock in the charge capacity of All Files server, determines that file processing is complete.
5. the file allocation system as described in any one in claim 1 to 4, is characterized in that, described file is the patent document that official sends, and described kind of document arranges according to the country variant under patent document.
6. a file allocation method, applies to distribution server, and described distribution server is connected with multiple file servers, it is characterized in that, the method comprises the steps:
Default file classification, and according to this file class, described multiple file servers are classified;
Receive pending file, according to described file class by received file allocation to corresponding file server;
Determine the charge capacity of each file server according to the quantity of the pending file in each file server;
The charge capacity that judges whether file server reaches pre-set threshold value; And
In the time that the charge capacity that has file server reaches pre-set threshold value, the file of file server the highest charge capacity is distributed to described charge capacity and is reached the file server of pre-set threshold value by preset ratio.
7. file allocation method as claimed in claim 6, is characterized in that, the method also comprises:
Determine the residing load level of each file server according to described charge capacity, the quantity of documents according to default of described load level is divided.
8. file allocation method as claimed in claim 6, is characterized in that, the method also comprises:
The file of the file server of the file of the file server of high load level and low load level is added to General Logistics Department's mean allocation.
9. file allocation method as claimed in claim 6, is characterized in that, the method also comprises:
Be all at 1 o'clock in the charge capacity of All Files server, determine that file processing is complete.
10. the file allocation method as described in any one in claim 6 to 9, is characterized in that, described file is the patent document that official sends, and described kind of document arranges according to the country variant under patent document.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201210571256.9A CN103902378A (en) | 2012-12-26 | 2012-12-26 | File allocation system and method |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201210571256.9A CN103902378A (en) | 2012-12-26 | 2012-12-26 | File allocation system and method |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN103902378A true CN103902378A (en) | 2014-07-02 |
Family
ID=50993716
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201210571256.9A Pending CN103902378A (en) | 2012-12-26 | 2012-12-26 | File allocation system and method |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN103902378A (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110222018A (en) * | 2019-05-14 | 2019-09-10 | 联动优势科技有限公司 | Data summarization executes method and device |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1475931A (en) * | 2002-08-02 | 2004-02-18 | ������������ʽ���� | Distribution document and system of sending/receiving distributed document |
| CN1501243A (en) * | 2002-11-18 | 2004-06-02 | 英保达股份有限公司 | Automatic categorizing and storing system and method for electronic file |
| CN1873613A (en) * | 2005-05-30 | 2006-12-06 | 英业达股份有限公司 | Load balanced system and method of preloading files |
| US20070112921A1 (en) * | 2005-11-14 | 2007-05-17 | Lunt Tracy T | Mapping electronic files contained in an electronic mail file to a file class |
| TW201227365A (en) * | 2010-12-27 | 2012-07-01 | Hon Hai Prec Ind Co Ltd | System and method for analyzing a patent electronic filing |
-
2012
- 2012-12-26 CN CN201210571256.9A patent/CN103902378A/en active Pending
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1475931A (en) * | 2002-08-02 | 2004-02-18 | ������������ʽ���� | Distribution document and system of sending/receiving distributed document |
| CN1501243A (en) * | 2002-11-18 | 2004-06-02 | 英保达股份有限公司 | Automatic categorizing and storing system and method for electronic file |
| CN1873613A (en) * | 2005-05-30 | 2006-12-06 | 英业达股份有限公司 | Load balanced system and method of preloading files |
| US20070112921A1 (en) * | 2005-11-14 | 2007-05-17 | Lunt Tracy T | Mapping electronic files contained in an electronic mail file to a file class |
| TW201227365A (en) * | 2010-12-27 | 2012-07-01 | Hon Hai Prec Ind Co Ltd | System and method for analyzing a patent electronic filing |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110222018A (en) * | 2019-05-14 | 2019-09-10 | 联动优势科技有限公司 | Data summarization executes method and device |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN109597685B (en) | Task allocation method, device and server | |
| CN103401937B (en) | Daily record data processing method and system | |
| US20160292608A1 (en) | Multi-cluster management method and device | |
| CN106953940B (en) | Dns server and configuring load application method, network system, domain name analytic method and system | |
| CN109669776B (en) | Detection task processing method, device and system | |
| CN111178380B (en) | Data classification method and device and electronic equipment | |
| CN103117903A (en) | Internet surfing unusual flow detection method and device | |
| CN102523158A (en) | Metadata server cluster load balancing method based on weight | |
| CN102694868A (en) | Cluster system implementation and task dynamic distribution method | |
| EP2044536A1 (en) | Data processing over very large databases | |
| US10425273B2 (en) | Data processing system and data processing method | |
| CN103746934A (en) | CDN bandwidth balancing method, CDN control center and system | |
| CN102932271A (en) | Method and device for realizing load balancing | |
| CN112866136A (en) | Service data processing method and device | |
| CN111047264A (en) | Logistics task allocation method and device | |
| CN116467266A (en) | Batch file intelligent online processing method and device and storable medium | |
| CN110084694B (en) | Order distribution method based on data processing and related equipment | |
| CN105872082B (en) | Fine granularity resource response system based on container cluster load-balancing algorithm | |
| CN114357085A (en) | Financial data storage method and device based on block chain and storage medium | |
| CN106445709A (en) | Method and system for invoking servers in distributed manner | |
| CN103902378A (en) | File allocation system and method | |
| CN109492031A (en) | Display methods, server and the computer storage medium of list data | |
| CN111325495B (en) | Abnormal part classification method and system | |
| CN111858657A (en) | Method and equipment for accelerating data parallel query based on high-frequency data processing | |
| CN106850272A (en) | Central server, service server and its method for detecting abnormality and system |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| WD01 | Invention patent application deemed withdrawn after publication | ||
| WD01 | Invention patent application deemed withdrawn after publication |
Application publication date: 20140702 |