JP2701806B2 - File synchronization method - Google Patents

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a file synchronization system, and more particularly, to maintaining consistency of file contents of a synchronous file (a file which needs to maintain consistency of file contents among a plurality of hosts) in a loosely coupled multi-host configuration system. Related to file synchronization method.

[0002]

2. Description of the Related Art Conventionally, a file synchronization method for maintaining consistency of file contents of a synchronization file between hosts includes a shared file having no exclusive control mechanism between hosts (one file from a plurality of hosts).
You can connect to two files, but each host uses only its own host to connect to that file (a local file), and uses only files that can only perform exclusive control between jobs in its own host) There was a method to synchronize the contents of the file.

A shared file having an exclusive control mechanism between hosts (a plurality of hosts can connect to one file,
Each host can recognize that the file is connected to other hosts (global file),
There is a method of synchronizing file contents by permitting simultaneous updating from each host using a file (exclusive control that can be performed across hosts).

Further, the master host has a master file, the slave host has a copy file, the file is updated only for the master file, and the copy file is subjected to an asynchronous update process (consistent with the file contents of the files of a plurality of hosts). There is also a method of synchronizing file contents by performing a process of discretely (non-continuously) updating files of a plurality of hosts so as to keep the file contents.

[0005] In addition, there is a file synchronization method for immediate update processing by two-phase commitment control (for example, "Client / Server Database Design Technique", Masami Sato, pp. 154 to 164, software
Research Center).

[0006]

In the above-described conventional file synchronization method using a shared file without an exclusive control mechanism between hosts, a plurality of hosts can connect to one file, but each host can connect to the file. On the other hand, it can be seen that only the local host is connected (local file), and only exclusive control of the synchronous file can be performed between jobs in the local host, so that simultaneous updating from each host is not performed There is a problem that the administrator needs to be careful. In addition, although each host can only see the file as a (local) file connected only to the host, the file name and the location in the physical medium where the data is written are the same, In order to synchronize the file contents from each host, it is necessary to update the same data in the medium, and the file name will be inevitably common to each host, and it will be different for each host. There was a problem that it was not possible.

On the other hand, even in a file synchronization system using a shared file having an exclusive control mechanism between hosts, a plurality of hosts can connect to one file, and each host also connects another host to the file. (Global file), and exclusive control of the synchronous file can be performed between jobs across hosts, so the file name is common and simultaneous update from each host can be performed, but the shared file is occupied There has been a problem that access delay may be caused due to exclusive control or access concentration.

Further, the master host has a master file, the slave host has a copy file, the file is updated only for the master file, and the copy file is subjected to asynchronous update processing to synchronize the file contents. In the synchronous method, before the asynchronous update processing from the master file to the slave file, while the file contents between the hosts cannot be synchronized, the file contents inconsistent on the medium on which the slave file has been referred / updated. There was a problem that it occurred.

Further, in the file synchronization system based on the immediate update processing by page exclusion under the two-phase commitment control, there is a problem that a deadlock may occur.

SUMMARY OF THE INVENTION In view of the above, it is an object of the present invention to maintain the consistency of the file contents of a synchronization file among a plurality of hosts, and after updating a synchronization file from an arbitrary host, in accordance with the synchronization definition of each host. Asynchronous update processing of synchronous files on other hosts by file transfer processing ensures consistency of file contents of synchronous files between multiple hosts, and performs exclusive / exclusive control of synchronous files for each job according to the synchronization definition of each host Enables exclusive occupation of the synchronization file on another host and reference to the synchronization file on the local host, and prevents a deadlock between hosts during file transfer due to an update job from any host updating the synchronization file. It is an object of the present invention to provide a file synchronization system which prevents such a situation.

[0011]

According to the file synchronization method of the present invention, in a loosely-coupled multi-host configuration system, a synchronization definition that describes a set of a host name and a file name list of a synchronization file for each job is provided. A job entry system that accepts the input of a job and controls the start and rescheduling of the job according to the result of the start processing in the unit of a job, and manages the job use resources for each job started by the job entry system, A job control means having a start processing exit and a termination processing exit for each job, and a synchronous file is exclusively occupied by the update job according to the synchronization definition of the own host at the update processing start processing exit of the job control means, and exclusion of another host is performed. The management means is also notified of the exclusive exclusion request of the synchronous file, waits for the request result, and If the exclusive exclusion of the synchronous file in the host succeeds, the exclusive exclusion of the synchronous file on the local host is changed to the shared exclusion, and the synchronous file can be referred to. An exclusive management unit for notifying the exclusive management unit of another host of a synchronous file exclusion release request to a synchronous file according to the synchronization definition of the synchronous file and then releasing the exclusive exclusion of the synchronous file on the local host; A file transfer unit that transfers and copies the updated synchronous file to another host in accordance with the synchronization definition of the host at the exit end of the update job and performs asynchronous update processing of the synchronous file at the other host.

[0012]

Next, the present invention will be described in detail with reference to the drawings.

FIG. 1 is a block diagram showing the configuration of a loosely-coupled multi-host configuration system to which a file synchronization method according to an embodiment of the present invention is applied. This loosely coupled multi-host configuration system includes a plurality of (two shown) hosts 1 and 2.
Are loosely coupled to form the main part.

The host 1 includes an exclusive management unit 1-1, a synchronization definition 1-2, a file transfer unit 1-3, a synchronization file 1-4 (F1, F2, F3, F4), and a terminal 1-5.
, A job entry system 1-6, and a job control means 1-7.

Similarly to the host 1, the host 2 also includes an exclusive management unit 2-1, a synchronization definition 2-2, and a file transfer unit 2.
-3 and the synchronization file 2-4 (F1, F2, F3, F
4), terminal 2-5, and job entry system 2-6
And a job control means 2-7.

As shown in FIG. 2, the synchronization definitions 1-2 and 2-2 are synchronization files 1-4 and 2-4 which need to maintain consistency between the host name and the file contents between the hosts 1 and 2. Is the definition information that describes a set with the file name list of each job. In the case of the synchronization definitions 1-2 and 2-2 illustrated in FIG. 2, for example, the synchronization files F1 and F2 are exclusively occupied in units of a job (JOB) l, and the host (HOST) 1 and the host (HOST) 2 Are defined to match the file contents of the synchronization files F1 and F2 (there is no relation between the order of file update and the arrangement of file names).
If the synchronization definitions 1-2 and 2-2 are files, the synchronization definition file itself can be registered in the file names list of the synchronization definitions 1-2 and 2-2, and the synchronization definition file is updated and synchronized. It is possible.

The file transfer units 1-3 and 2-3 terminate the file update processing of each update job of each of the hosts 1 and 2 at the job unit termination processing exit of the job control units 1-7 and 2-7. In response to this, the synchronization files 1-4 and 2-4 that have been updated on the local hosts 1 and 2 according to the set of the host name and the file name list in the synchronization definitions 1-2 and 2-2, and the other hosts 2
1 and performs asynchronous update processing of the synchronous files 2-4 and 1-4 at the other hosts 2 and 1, and waits for the end of file transfer (job end processing of the job control means 1-7 and 2-7). Control returns to the exit).

Synchronization file 1-4 (F1, F2, F3,
F4), 2-4 (F1, F2, F3, F4) are non-shared files (local files) managed and exclusively controlled by each host 1 and 2.

The terminals 1-5 and 2-5 are terminals for submitting jobs, activating the job entry systems 1-6 and 2-6, and activating the exclusive management units 1-1 and 2-1.

Job entry system 1-6, 2-6
Accepts the submission of a job in each of the hosts 1 and 2, and controls the execution start and rescheduling of the job based on the result of the start processing for each job.

The job control means 1-7 and 2-7 manage the job utilization resources for each job started by the job entry systems 1-6 and 2-6, and execute processing units (shown in FIG. 1) for each job. ) Has a start processing exit (not shown) and an end processing exit (not shown) called before and after
The exclusive processing means 1-1 and 2-1 are controlled by the start processing exit,
The end processing exit controls the file transfer methods 1-3, 2-3 and the exclusive management means 1-1, 2-1.

Referring to FIG. 3, exclusive control means 1-1,
The process 2-1 includes an exclusive control request (exclusive exclusion request or exclusive exclusion release request) reception waiting step S101, a start processing exit determination step S102, a synchronization definition reference step S103, a synchronization definition reference step S103 ', and the like. Host request acceptance determination step S104, other host request acceptance determination step S104 ', synchronization definition mismatch determination step S105, and exclusive exclusion request failure notification step S10
6, exclusive exclusion step S107, other host request acceptance determination step S108, own host resource queuing request step S108 ', and exclusive exclusion request failure notification step S1.
08 ", another host request acceptance determination step S109,
Other host exclusive exclusion request / waiting step S110, other host exclusive exclusion success determination step S111, own host shared exclusive step S112, own host exclusive exclusion release step S113, exclusive exclusion request success notification S114, other host exclusive exclusion It comprises a release request notification step S115, a host exclusive exclusion release step S116, and an exclusive management end determination step S117.

The exclusive management means 1-1 and 2-1 are started as a resident type by the system or the terminals 1-5 and 2-5, and wait for the reception of an exclusive control request and receive an end of the exclusive management means (release of resident). Waiting and waiting for an exclusive control request from another host are performed (step S101).
The exclusion managers 1-1 and 2-1 use the job control units 1-7 and 2-7 activated on a job-by-job basis on the job entry systems 1-6 and 2-6. Called at the exit, the start processing exit of the update job input from the own host 1, 2 or the other host 2, 1 performs execution management of exclusive exclusion and shared exclusion of the synchronization files 1-4, 2-4, and updates The job exit processing exit manages release of exclusive exclusion. At the end of the control process of the exclusion managers 1-1 and 2-1, the exclusion managers 1-1 and 2-1 determine their own end (resident end). File 1-4, 2-4
The process is terminated after the exclusion is released (step S117).

More specifically, the exclusive management means 1-1, 2-1
Receives the exclusive exclusion request for each update job (step S101), and determines that a request has been received from the update job start processing exit of the own host 1, 2 or the other host 2, 1 (YES in step S102). Own host 1,
With reference to the second synchronization definitions 1-2 and 2-2, the synchronization files 1-4 and 2-4 updated by each update job are set as candidates for exclusive exclusion of each job (step S103).

Next, the exclusive management means 1-1 and 2-1 determine whether the exclusive exclusion request received from the update job start processing exit is an exclusive exclusion request from the other host 2 or 1 (step S104). If the request is an exclusive exclusion request from the other host 2, 1, the candidate of exclusive exclusion of the update job of the synchronization definition 1-2, 2-2 of the own host 1, 2-2 is notified from the other host 2, 1. The inconsistency with the candidate for exclusive exclusion in the other host 2 or 1 is verified (step S105). If there is a mismatch, the exclusive exclusion request is regarded as failed and the exclusive exclusion request to the other host 2 or 1 is failed. Is notified (step Sl06).

If the exclusive exclusion request is issued from the own host 1 or 2 in step S104, or if there is no inconsistency in the exclusive exclusion candidate in step S105, the exclusive management means 1-1 and 2-1 execute The exclusive exclusion request is made to the synchronous files 1-4 and 2-4 that are candidates for exclusive exclusion of the own hosts 1 and 2 (step Sl07). It is determined whether the request is an exclusive exclusion request from the host 1 or 2 or an exclusive exclusion request from the other host 2 or 1 (step S 108). After performing resource queuing (step S108 ′), re-request for exclusive exclusion of the synchronous files 1-4 and 2-4 is performed (step S107). On the other hand, in the case of the exclusive exclusion request from the other hosts 2 and 1, the exclusion managers 1-1 and 2-1 notify the other hosts 2 and 1 of the exclusive exclusion request failure (step Sl).
08 ").

If the exclusive exclusion request succeeds in step S107, the exclusive management means 1-1, 2-1 determines whether the exclusive exclusion request is from the own host 1, 2 or the exclusive exclusion request from the other host 2, 1. It is determined whether the request is an exclusive exclusion request (step S10).
9) If the request is an exclusive exclusion request from another host 2, 1, the other host 2, 1 is notified of the success of the exclusive exclusion request (step S 114). On the other hand, the exclusive exclusion request
If the request is an exclusive exclusion request from other host 2, other hosts 2 and 1
The exclusive management means 2-1 and 1-1 are also notified of the exclusive exclusion request and have the request result (step S110). At this time, since the queuing is performed on a job basis, the job entry systems 1-6 and 2-6 can accept other jobs. Upon receiving the request result notification, the exclusive management means 1-1 and 2-1 determine the exclusive exclusion request result on the other host 2 or 1 (step Sll1), and the synchronous file 1- 1 on the other host 2 or 1 is determined. If the exclusive exclusion of the hosts 4 and 2-4 succeeds, the exclusive exclusion of the local hosts 1 and 2 is changed to the shared exclusion, and the synchronous files 1-4 and 2-4 can be referred to by the page exclusion (step S112).

If the exclusive exclusion of the synchronous files 1-4 and 2-4 on the other hosts 2 and 1 has failed due to the result of the exclusive exclusion request on the other hosts 2 and 1 in step S111, the exclusive management means 1-1 and 1 2-1 releases the exclusive exclusion of the synchronous files 1-4 and 2-4 in the local hosts 1 and 2 (step Sl)
13).

When the exclusive exclusion release request is received for each update job (step S101), when it is determined that the exclusive exclusion release request is received from the end processing exit of the update job of the own host 1, 2 or the other host 2, 1 (step S101). S102
No), the exclusion managers 1-1 and 2-1 perform synchronization definitions 1-2 and 2-2 of the local hosts 1 and 2 referred to at the start processing exit.
(Step S103 '), it is determined whether the exclusive exclusion release request is a request from the other host 2 or 1 (step S104'). In the case of the exclusive exclusion release request from the own hosts 1 and 2, the exclusion management means 1-1 and 2-1 notify the other hosts 2 and 1 of the exclusive exclusion release request notification of the synchronous files 1-4 and 2-4. After the execution (step S115), the exclusive exclusion release request of the synchronous files 1-4 and 2-4 in the local hosts 1 and 2 is performed (step S116). On the other hand, if the exclusive control request received from the start processing exit of the update job is an exclusive exclusion release request from another host 2 or 1, the exclusive management means 1-1 and 2-1 skips step S115 and returns to the local host. The exclusive exclusion release request of the synchronous files 1-4 and 2-4 is made in the steps 1 and 2 (step S116).

Next, the operation of the thus configured file synchronization system of the present embodiment will be described.

Here, the update job 1 is executed by the host 1.
Will be described by way of example in which the synchronization files F1 and F2 are synchronously controlled between the host 1 and the host 2 according to the synchronization definitions 1-2 and 2-2 shown in FIG. Hereinafter, host 1 is a local host 1 and host 2 is a remote host 2.
It is described.

(1) First, the synchronization definition 1-2, 2
-2, the synchronization files F1 and F1 that need to maintain the consistency of the file contents between the hosts 1 and 2 for the update job 1
F2 is described as a file name list.

(2) When an update job 1 for updating the synchronization files F1 and F2 is input to the job entry system 1-6 from the terminal 1-5 of the local host 1, the job control unit 1-7 starts the job unit. At the processing exit, the exclusion management unit 1-1 updates the file names F1 and F2 of the synchronization files F1 and F2 that have been updated by the update job 1 from the synchronization definition 1-2 and need to be synchronized between the local host 1 and the remote host 2.
1 and F2 are retrieved and acquired (step S103).

(3) Subsequently, the exclusive management means 1-1
After exclusive exclusion is applied to the synchronous files F1 and F2 of the local host 1 based on the file names F1 and F2 obtained from the synchronous definition 1-2 (step S107), if the exclusive exclusion is successful, the synchronous definition 1- is also performed. Of the exclusive exclusion request of the synchronization files F1 and F2 of the remote host 2 to the exclusion management means 2-1 on the remote host 2 acquired from the remote host 2; Wait for the result (step S11
0).

(4) Upon receiving the exclusive exclusion request from the exclusion manager 1-1 of the local host 1 (step S101), the exclusion manager 2-1 of the remote host 2 is the start processing exit (step S102). , Synchronization definition 2
-2 (step S103), the file names F1 and F2 of the received exclusive exclusion request are compared with the synchronous file names F1 and F2 in the synchronization definition 2-2 of the host 2 (step S105). If there is a match, the exclusive exclusion request failure is notified to the exclusion manager 1-1 of the local host 1 (step S106). Synchronous file F
If the exclusive exclusion request of the synchronous files F1 and F2 has failed because the synchronous files F1 and F2 have already been occupied and exclusive by other jobs (failure in step S107), the exclusive management unit 2-1 executes The resource queuing is notified to the exclusive management means 1-1 of the local host 1 (step S108 '). In addition, the abnormality is notified to the exclusive management unit 1-1 as abnormal termination (step S10).
8 ″). If the exclusive exclusion of the synchronization files F1 and F2 of the remote host 2 succeeds in step S107, the exclusion management unit 2-1 executes the exclusion management unit 1-1 of the local host 1.
1 is notified of the success of the exclusive exclusion request (step S11).
4).

(5) The exclusion manager 1-1 of the local host 1 waits for the result of the exclusive exclusion request of the synchronous files F1 and F2 to the exclusion manager 2-1 of the remote host 2 (step S110). File F
When the success notification of the exclusive exclusion of the local files 1 and F2 is received (Yes in step S111), the exclusive exclusion of the synchronous files F1 and F2 of the local host 1 is changed to the shared exclusive and the synchronous file in the local host 1 by the page exclusion. Fl, F2
(Step S112), and the update processing of the synchronization files F1 and F2 can be executed. On the other hand, when the exclusive management unit 1-1 receives the notification of the failure of the exclusive exclusion of the synchronous files F1 and F2, the exclusive management unit 1-1 releases the exclusive exclusion of the synchronous files F1 and F2 of the local host 1 (step S11).
3), the process returns to waiting for reception of an exclusive control request (step S101). The update job 1 of the local host 1 whose control has been returned from the exclusive control unit 1-1 to the job entry system 1-6 waits for a schedule in the job entry system 1-6, and is notified of synchronization definition mismatch and other abnormalities. When the end job is notified, the update job 1 of the local host 1 ends abnormally.

(6) In response to the end of the update processing of the synchronization files Fl and F2 by the update job 1 on the local host 1 or the abnormal end of the update job 1, the job control means 1
At the exit processing exit of the update job 1 of -7, the file transfer means 1-3 executes the host name HOS according to the synchronization definition 1-2.
Referring to a set of T1, HOST2 and file name lists F1, F2, synchronous files F1, F2 of local host 1
Is transferred and copied to the remote host 2.
Perform the asynchronous update process on the local host 1 and the remote host 2 so that the file contents of the synchronous files F1 and F2 are consistent.

(7) Subsequently, the exclusive management means 1-1
Similarly, at the end processing exit of the update job 1 of the local host 1, the synchronization file F by the file transfer means 1-3 is output.
In response to the completion of the transfer of l and F2, the exclusive management unit 2-1 of the remote host 2 is notified of the exclusive exclusion release request (step S115), and then the exclusive exclusion of the synchronous files Fl and F2 on the local host 1 is performed. Release (step S11)
6).

By the above processing, the synchronization definition 1
If a set of a host name and a file name list to be synchronized with each other is defined for each job, the asynchronous update process is performed on the synchronous file of each host, and Thus, the file contents of the synchronous files 1-4 and 2-4 can be made consistent.

It is needless to say that the remote host 1 and the local host 2 can be interchanged, and that the present invention can be similarly applied to a case where there are three or more hosts.

[0041]

As described above, according to the present invention, a synchronous file of another host is asynchronously updated by a file transfer process according to the synchronization definition of each host after the update process of the synchronous file from an arbitrary host is completed. The consistency of the file content of the sync file between
Conventionally, exclusive exclusion control of a synchronization file on another host and reference of the synchronization file on the local host are enabled by performing exclusive exclusion control of the synchronization file for each job according to the synchronization definition of each host. However, it is possible to easily perform synchronization and perform centralized management of the synchronization file, in which the administrator has to work hard to maintain the consistency of the file contents of the synchronization file between the hosts.

Since the synchronization file is a local file unique to each host, the risk of simultaneous update is eliminated by exclusive occupation in the host, and exclusive exclusion is performed by job unit according to the synchronization definition of each host. The exclusive exclusion of the synchronization file on the host and the reference of the synchronization file within the local host are enabled, and the update job from any host updates the synchronization file, preventing deadlock between hosts during file transfer. There is an effect that can be. In particular, when a search process is performed on a synchronous file having a large number of records, it is expected that the processing will be distributed by a plurality of hosts.

Since an arbitrary file name can be specified for each host in the synchronization definition, a synchronization file (of course, an asynchronous file) which requires consistency of the file contents of the synchronization file between the hosts can be easily set. There is an advantage that there is.

[Brief description of the drawings]

FIG. 1 is a block diagram showing a configuration of a file synchronization system according to an embodiment of the present invention.

FIG. 2 is a diagram showing the contents of a synchronization definition in FIG. 1;

FIG. 3 is a flowchart showing a process of an exclusive management unit in FIG. 1;

[Explanation of symbols]

 1, 2 Host 1-2, 2-2 Synchronous definition 1-3, 2-3 File transfer means 1-4, 2-4 Local file 1-5, 2-5 Terminal 1-6, 2-6 Job entry system 1-7, 2-7 Job control means

Continuation of the front page (56) References JP-A-7-141241 (JP, A) JP-A-7-36763 (JP, A) JP-A-6-259302 (JP, A) JP-A-4-195558 (JP) , A) JP-A-3-202935 (JP, A) Bill Crail Book, translated by Hirotake Shinkoku, "OLTP Online Transaction Processing System", Fuji Software, 1994, p. 277-306

Claims (2)

(57) [Claims] In a loosely-coupled multi-host configuration system, a synchronization definition that describes a set of a host name and a file name list of a synchronization file in a unit of a job, accepts a job submission in each host, and starts processing in a unit of a job A job entry system that controls the start and rescheduling of a job according to the result of the above, a job use resource is managed for each job started by the job entry system, and a start processing exit and an end processing exit for each job are provided. At the job processing means and at the start processing exit of the update job of the job control means, the synchronous file is exclusively occupied by the update job according to the synchronization definition of the own host, and the exclusive management means of the other host is notified of the exclusive exclusion request of the synchronous file. Waits for the result of the request, and if the exclusive Changes the exclusive exclusion of the synchronous file on the own host to the shared exclusion and enables the synchronous file to be referred to. The exclusive management means for notifying the exclusive management means of the synchronous file of the exclusive exclusion release request of the synchronous file and then releasing the exclusive exclusion of the synchronous file on the own host; A file transfer means for transferring and copying a synchronous file updated on its own host to another host in accordance with a synchronization definition and performing asynchronous update processing of the synchronous file on another host. 2. The file synchronization according to claim 1, wherein the synchronization definition is capable of both memory expansion and file description, and when the synchronization definition is a file, the synchronization definition file itself can be registered in a file name list of the synchronization definition. method.