JP2000003342A - Method and system for network file distribution sort - Google Patents

Abstract

PROBLEM TO BE SOLVED: To shorten the sort processing time by preventing load in a computer system of being excessively enlarged. SOLUTION: On the basis of load information of plural computer systems 21, 22, 23 and 24 and a network system 1 which connects them, a computer system which performs sort processing is decided, a file of a sort processing object is split into plural in the computer system thus decided, is transferred to each computer system, and then the sort processing of each of the split files is performed and each file of the sort-processed file is merge-processed.

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a distributed network file sorting method and a distributed network file sorting method for dividing a file to be sorted and performing a sort process on a computer system.

[0002]

2. Description of the Related Art Conventionally, when a file is to be sorted, one task first inputs all data from a file to be sorted into a sort program, and then sorts the data. After that, it was output to the file for storing the sorting result. However, in such a conventional sorting method, data input / output and sort processing are performed in one task, so that when the data in a file becomes enormous, there is a problem that it takes too much processing time. On the other hand, a sort processing method for solving this problem is described in, for example, Japanese Patent Application Laid-Open No. 5-35444.

According to the sort processing method described in this publication, a file to be sorted is divided into a plurality of files, and then the data present in each of the divided files is simultaneously subjected to multiple parallel sorts. Is performed to merge the data of each file.

[0004]

However, in such a conventional file sorting method, since all of the divided sorting processes are executed in one computer system, a CPU is used in one computer system.
Consumes a lot of resources, memory resources and file resources,
In addition, there is a problem that these CPU resources, memory resources, and file resources are occupied. In addition, since there is a case where the above-mentioned resources cannot be secured, there is a problem that the time required for creating a sort result of a file to be sorted may be long.

SUMMARY OF THE INVENTION The present invention solves the above-mentioned problem. By distributing the load generated by the sort processing to the entire computer system, it is possible to prevent the load on one computer system from becoming excessive, While facilitating connection with work other than processing,
It is an object of the present invention to obtain a network file distributed sorting method and a network file distributed sorting system that can improve operability and shorten the sort processing time.

[0006]

To achieve the above object, a network file distributed sorting method according to the first aspect of the present invention is based on load information of a plurality of computer systems and a network system connecting these computer systems. The computer system to perform the sorting process is determined, the file to be sorted is divided into a plurality of files by the determined computer system, and the divided files are transferred to the respective computer systems. The processed files are merged.

A network file distributed sorting system according to a second aspect of the present invention provides a network file distribution / sorting system which acquires load information of a computer system from monitoring means, and manages load information of all computer systems constituting the network system. Upon receiving the request for the sorting process, a computer system that performs the sorting process is determined based on the load information of the management unit, and the files to be sorted are divided, the files are transferred, the divided files are sorted, and the sorted files are sorted. Control means for instructing each execution of merge processing, and file dividing means for dividing the file to be sorted in response to the instruction to execute the file division are provided, and the file transfer means is divided by the file dividing means. Transfer files to each of the computer systems determined above And causing the sorting means to sort the files transferred by the file transfer means, and causing the merging means to merge them based on the files sorted by the sorting means. .

In the network file distributed sort system according to the third aspect of the present invention, a computer system with a small load is selected and determined as the computer system that performs the sort processing.

According to a fourth aspect of the present invention, there is provided a distributed network file sorting system, wherein each computer system stores a file for temporarily storing sorted data.

A network file distributed sort system according to a fifth aspect of the present invention is such that a computer system having the files to be sorted is provided with a file for storing merged data.

[0011]

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS One embodiment of the present invention will be described below with reference to the drawings. FIG. 1 is a block diagram showing a network file distributed sorting system according to the present invention. In FIG. 1, reference numeral 1 denotes a network system such as a LAN or WAN, and 21, 22, 23, and 24 denote computer systems connected to the network system 1. Each of the computer systems 21 to 24 has the same internal configuration and operation, and the computer system 21 will be described in detail below. Reference numeral 3 denotes a file device, and 4 denotes monitoring means. The monitoring means 4 monitors CPU resources, memory resources, file resources, and the network system 1 in the computer system 21.
The load information of the computer system 21 and the network system 1 is acquired.

Reference numeral 6 denotes management means. The management means 6 acquires load information from the monitoring means 4 and manages the load information among the similar management means in the computer systems 22, 23 and 24. The load information is transferred at a constant timing, the load information in all the computer systems 21 to 24 is accumulated, and the load information in all the computer systems 21 to 24 constituting the computer network is managed. 7
Is a control unit. The control unit 7 receives a request for a sort process, determines a computer system that performs a sort process on the divided files based on the information stored in the management unit 6, and further determines Split the file,
It instructs the transfer of the file and the sorting of the divided files, and the execution of the merge of the sorted data of the divided files.

For example, when the load on the network system 1 is considerably small, the control means 7 determines that the file can be transferred to another computer system because the load on the network system 1 is fairly small. The load of the entire computer system connected by the network system 1 is checked. At this time, information that the load on one computer system is very large and the load on the other computer system is small is stored in the management unit 6.
, The file is determined to be executable on a lightly loaded computer system, the file is divided, and an instruction is given to execute the sort processing on the lightly loaded computer system. If the load on the network system 1 is high, the network system 1 determines and executes the instruction only on its own computer system.

Thus, the load is not concentrated on one computer system, but is distributed over the entire computer systems constituting the computer network, so that the operability is excellent. Further, when the sorting process is performed by a computer system having a high load, the sorting process time can be reduced as compared with the case where the sorting process is performed on a single computer system.

Reference numeral 5 denotes a file dividing unit for dividing the file, which divides a file to be sorted based on an instruction from the control unit 7. 10
Is a file transfer means, which functions to transfer the divided files to a computer system which executes the above-mentioned sort processing of the divided files based on the instruction of the control means 7. 9 is a sorting means, which is a control means 7
In order to execute the sorting process of the divided files based on the instruction. Reference numeral 8 denotes a merging unit. The merging unit 8 merges files that have been subjected to division and sorting based on an instruction from the control unit 7, and stores the result in the file device 3.

Next, the operation will be described in detail. A file 30 as shown in FIG.
It is assumed that the control unit 7 has received a request to perform a sorting process on the file and to store the result in the file 37 of the file device 3. The control unit 7 acquires and analyzes the load information of the network system 1, the computer system 21, the computer system 22, the computer system 23, and the computer system 24 from the management unit 6. At this time, for example, if the load on the computer system 23 is large and the load on the network system 1 is small, the control unit 7 can execute the sort processing on another computer system because the load on the network system 1 is small. It is determined that the computer system 21, the computer system 22, and the computer system 24 perform the sort processing without performing the sort processing in the computer system 23 having a large load. Then, it instructs the file dividing means 5 to divide the file 30 into three.

For this reason, the file dividing means 5 divides the file 30 into three files, a file 31, a file 32 and a file 33, according to the instruction of the control means 7, and notifies the control means 7 of the completion of the division processing. Upon receiving the notification of the completion of the division process from the file division unit 5, the control unit 7 instructs the sorting unit 9 to sort the file 31, and sends the file 32 to the computer system 22 and the file 3
3 is instructed to transfer the file 3 to the computer system 24. The sorting means 9 sorts the file 31 according to the instruction of the control means 7, stores the sorted data in the file 34,
Notify.

The file transfer means 10 transfers the file 32 to the computer system 22 and the file 33 to the computer system 24 in accordance with the instruction of the control means 7. The computer system 22 sorts the received file 32, stores the sorted data in the file 35, and transfers the file 35 to the computer system 21. The computer system 24 sorts the received file 33, stores the sorted data in the file 36, and transfers the file 36 to the computer system 21.

The file transfer means 10 receives the file 35 and the file 36 and notifies the control means 7. The sorting means 9 and the control means 7 having received the notification from the file transfer means 10 perform a merging process on the files 34, 35 and 36, and instruct the merging means 8 to store the merged data in the file 37. Instruct. Therefore, the merging unit 8 performs the merging process of the file 34, the file 35, and the file 36 according to the instruction of the control unit 7, and stores the merged data in the file 37.

[0020]

As described above, according to the present invention, a computer system for performing a sort process is determined based on load information of a plurality of computer systems and a network system connecting these computer systems, and thus determined. Since the file to be sorted by the computer system is divided into a plurality of files and transferred to each computer system, the divided files are sorted, and each of the sorted files is merged. The load generated by the sorting process can be distributed to all the computer systems connected by the network system so that the load is not concentrated on one computer system. Load for execution It can prevent too high, as a result, can facilitate coordination between the work other than sort processing, thereby improving the operability. Further, when the sorting process is performed by a computer system having a high load, an effect is obtained that the sorting process time can be reduced as compared with the case where the sorting process is performed on a single computer system.

[Brief description of the drawings]

FIG. 1 is a block diagram showing a file distributed sort system according to an embodiment of the present invention.

FIG. 2 is an explanatory diagram showing division and transfer processing of a sort target file according to the present invention.

[Explanation of symbols]

 DESCRIPTION OF SYMBOLS 1 Network system 4 Monitoring means 5 File division means 6 Management means 7 Control means 8 Merge means 9 Sorting means 10 File transfer means 21, 22, 23, 24 Computer system

Claims (5)

[Claims] 1. A computer system for performing a sort process is determined based on load information of a plurality of computer systems and a network system connecting these computer systems, and a plurality of files to be sorted are determined by the determined computer system. And then transferring the divided files to each computer system, sorting the divided files, and merging the sorted files. 2. A monitoring means for monitoring load information of a network system and a plurality of computer systems connected thereto, acquiring load information from the monitoring means, and managing load information of all the computer systems constituting the network system. Receiving a request for sort processing, determining a computer system to perform sort processing based on the load information of the management means, dividing the file to be sorted, transferring the file, and sorting the divided files And control means for instructing each execution of merge processing of the sorted files; file dividing means for dividing the files to be sorted in response to the file dividing execution instruction; File transfer to be transferred to each determined computer system Receiving means, and sorting means for sorting processing of the transferred file in the file transfer means, each file sorting by said sorting means,
A network file distribution / sorting system comprising a merging means for merging these. 3. The computer file distributed sort system according to claim 2, wherein the computer system that performs the sort processing is determined by selecting a computer system with a small load. 4. The distributed computer file sorting system according to claim 2, wherein each of the computer systems has a file for temporarily storing sorted data. 5. The distributed computer file sorting system according to claim 2, wherein the computer system having the file to be sorted has a file for storing data that has undergone merge processing.