JP5966389B2 - Computer apparatus, arithmetic processing system, checkpoint setting method and program - Google Patents

Description

  The present invention relates to a computing device, and more particularly to a computing device that acquires a memory image by setting checkpoints.

  In the field of high performance computing, a calculation cluster in which a large number of calculation nodes are connected via a network is used to perform a large-scale calculation. With the increase in the size of computing clusters, hardware components are also increasing. For this reason, the frequency with which a computing node encounters a failure or the like is increasing. As a result, job recovery in the event of problems has become increasingly important. One of the job recovery methods will be described below. The computation node periodically sets checkpoints, and collects and stores memory images at the set checkpoints. When a problem occurs, the compute node restores the memory image of the previous checkpoint and restarts the job. In the case of this recovery method, it is necessary to save the memory image of all processes that make up the job at the checkpoint for restart, and the increase in the number of processes that make up the job and the memory usage of each process remains This leads to an increase in memory images collected at checkpoints. The increase in the memory image causes problems such as compression of the storage area and an increase in transfer load from the calculation node to the storage area. Therefore, it is necessary to set checkpoints efficiently and collect memory images.

  In the above situation, in a large-scale calculation in this field, in order to effectively use a calculation cluster, a distributed memory parallel job that uses a process of each calculation node to perform a cooperative operation and advances the calculation is often used. And using the industry standard MPI (Message Passing Interface) library, a single program multiple data (SPMD) type job that divides the calculation data into each process and executes it for a single program. Is often done. One of the calculation methods in this field is a parameter survey in which the same program is repeatedly executed while changing parameters to obtain an optimal solution, which is widely used in the field of simulation and the like.

  Here, as a method for efficiently setting checkpoints, Patent Document 1 discloses a method that focuses on the ratio of execution time and checkpoint time. Further, Patent Document 2 discloses a method focusing on a CPU (Central Processing Unit) usage rate and an I / O usage amount.

JP 2004-094422 A JP 2006-172065 A

  However, the checkpoint setting methods disclosed in Patent Documents 1 and 2 do not take into account the memory usage at the time of checkpoint setting, and therefore cannot solve the problem caused by the increase in the memory image. There is.

  The present invention has been made to solve such a problem, and an object of the present invention is to provide a computing device, an arithmetic processing system, a checkpoint setting method, and a program capable of reducing the increase in the memory image.

  A computing device according to a first aspect of the present invention is a computing device that acquires a memory image for restarting a computation job when a failure occurs based on checkpoint information, the memory being used to execute the computation job A memory usage recording unit that records memory usage in response to an operation command; and an operation terminal that aggregates the memory usage in a plurality of processes and sets the checkpoint based on the aggregated memory usage And a communication unit that transmits the memory usage recorded in the memory usage recording unit.

  An arithmetic processing system according to a second aspect of the present invention includes a computing device that acquires a memory image for restarting a computation job when a failure occurs based on checkpoint information, and the check for the computing device. An operation processing system including an operation terminal for transmitting point information, wherein the calculation device records a memory use amount in accordance with a memory operation command during execution of the calculation job, and the operation terminal A communication unit that transmits the memory usage recorded in the memory usage recording unit, and the operation terminal totalizes the memory usage in a plurality of processes and calculates the totaled memory usage And receiving input of information related to the set position of the checkpoint from the user.

  The checkpoint setting method according to the third aspect of the present invention is a checkpoint setting method executed in a computing device that acquires a memory image for restarting a calculation job when a failure occurs based on checkpoint information. An operation terminal that records a memory usage amount according to a memory operation instruction during execution of the calculation job, aggregates the memory usage amount in a plurality of processes, and sets the checkpoint based on the aggregated memory usage amount To the recorded memory usage.

  A program according to a fourth aspect of the present invention is a program to be executed by a computer of a computing device that acquires a memory image for restarting a computation job when a failure occurs based on checkpoint information, A step of recording a memory usage amount according to a memory operation instruction during job execution; and an operation terminal that aggregates the memory usage amount in a plurality of processes and sets the checkpoint based on the aggregated memory usage amount Sending the recorded memory usage amount to a computer.

  According to the present invention, it is possible to provide a computing device, an arithmetic processing system, a checkpoint setting method, and a program that can reduce the increase in the memory image.

1 is a configuration diagram of a computing device according to a first embodiment. 1 is a configuration diagram of an arithmetic processing system according to a first embodiment. 1 is a configuration diagram of a computing device according to a first embodiment. FIG. 6 is a diagram for explaining an information table recorded in a memory operation instruction execution position recording unit according to the first embodiment; 1 is a configuration diagram of an operation terminal according to a first embodiment; FIG. 6 is a diagram for explaining a calculation job memory usage table according to the first embodiment; It is a figure explaining the calculation process memory usage table concerning Embodiment 1. FIG. It is a figure explaining the calculation process memory usage table concerning Embodiment 1. FIG. FIG. 10 is a diagram for explaining an aggregation table of a calculation process memory usage table according to the first embodiment; FIG. 3 is a graph of information of a tabulation table according to the first exemplary embodiment. FIG. 6 is a diagram for explaining information regarding a checkpoint execution instruction according to the first embodiment; It is a figure explaining the information table preserve | saved at the checkpoint execution instruction | indication recording part concerning Embodiment 1. FIG. FIG. 6 is a diagram for explaining a flow of a memory usage amount recording process according to the first embodiment; FIG. 10 is a diagram for explaining a flow of processing for creating a checkpoint execution instruction according to the first embodiment; FIG. 6 is a diagram for explaining a flow of checkpoint execution processing according to the first exemplary embodiment; FIG. 10 is a diagram for explaining a bulk job memory usage table according to the third embodiment; FIG. 6 is a configuration diagram of a computing device according to a fourth embodiment. FIG. 10 is a diagram for explaining the operation of a synchronous checkpoint according to the fifth embodiment. FIG. 10 is a diagram for explaining the operation of a synchronous checkpoint according to the fifth embodiment.

(Embodiment 1)
Embodiments of the present invention will be described below with reference to the drawings. A configuration example of the computing device according to the first exemplary embodiment of the present invention will be described with reference to FIG. The computing device 10 includes processes 11 to 13. Each process includes a memory usage recording unit 101 and a communication unit 102. In addition, each process of the computing device 10 communicates with the operation terminal 30 via the communication unit 102.

  The operation terminal 30 may be, for example, a server device or a personal computer. The operation terminal 30 totals the memory usage in the processes 11 to 13 and sets checkpoints in the computing devices 10, 11, and 20 based on the total memory usage. The check point is a point for acquiring a memory image. When a failure occurs in the computing device 10 and the computation job is restarted, the memory image acquired at the immediately preceding checkpoint is restored and the computation job is restarted. The operation terminal 30 collects the respective memory usage amounts from the processes 11 to 13 that execute the calculation data divided for a single program, and generates statistical data related to the memory usage amounts. In addition, the operation terminal 30 receives information input regarding a checkpoint setting instruction from a user who has confirmed the statistical data.

  The computing device 10 acquires a memory image for restarting the computation job when a failure occurs at the set checkpoint timing. The computing device 10 is a device that executes the operations of a plurality of processes, and may be a server device, a personal computer, or the like. Each process includes a memory usage recording unit 101 and a communication unit 102.

  The memory usage amount recording unit 101 records the memory usage amount according to the memory operation command during execution of the calculation job. The memory operation instruction includes, for example, a memory securing instruction that secures memory necessary for program execution and a memory release instruction that releases unnecessary memory. For example, the memory usage recording unit 101 may record the memory usage before and after the execution of the memory operation instruction when an instruction to execute the memory operation instruction is given. The memory usage before and after the execution of the memory operation instruction is, for example, the memory usage before securing the memory and the memory usage after securing the memory in the memory securing instruction. Or, in the memory release instruction, the memory usage before releasing the memory and the memory usage after releasing the memory.

  The communication unit 102 transmits the memory usage recorded in the memory usage recording unit 101 to the operation terminal 30. The communication unit 102 may transmit the memory usage amount to the operation terminal 30 every time the information recorded in the memory usage amount recording unit 101 is updated, and periodically record the memory usage amount in the memory usage amount recording unit 101. The used memory usage may be transmitted to the operation terminal 30. The communication unit 102 may store the memory usage in an external storage device or the like, and the operation terminal 30 may acquire the memory usage stored in the external storage device or the like.

  As described above, by using the computing device 10 according to FIG. 1, the memory usage in the computing device 10 can be transmitted to the operation terminal 30 that sets a checkpoint. Thereby, the user who operates the operation terminal 30 can set a check point in consideration of the memory usage. For example, by setting a check point at a timing when the memory usage is small, it is possible to prevent an increase in the capacity of the acquired memory image.

  In addition, although the configuration in which the computing device 10 has a plurality of processes has been described in this figure, the plurality of computing devices may have a single or a plurality of processes.

  Next, a configuration example of the arithmetic processing system according to the first exemplary embodiment of the present invention will be described with reference to FIG. The arithmetic processing system includes a calculation device 10, an operation terminal 30, and a storage device 40. Further, the computing device 10, the operation terminal 30, and the storage device 40 communicate via the network 50.

  The computing device 10 is a device that executes a computation job or program using a plurality of processes. The computing device 10 may be referred to as a computation node or the like. The calculation job may also be referred to as a distributed memory parallel job that is distributed to a plurality of processes and memories and processed in parallel.

  The operation terminal 30 outputs instruction information input from the user to the computing device 10 via the network 50. The instruction information input from the user includes a calculation job execution instruction, a checkpoint setting instruction in the calculation apparatus 10, and the like.

  The storage device 40 is a device that stores data necessary for executing a calculation job in the calculation device 10. In the figure, the storage device 40 is described as an independent device, but may be provided in the computing device 10 or the operation terminal 30, for example. Alternatively, the storage device 40 may be provided in the calculation device 10 and the operation terminal 30. In addition, although the configuration in which the operation terminal 30 communicates with the computing device 10 via the network 50 has been described in this figure, the operation terminal 30 may communicate directly with the computing device 10.

  Next, a detailed configuration example of the calculation apparatus 10 according to the first embodiment of the present invention will be described with reference to FIG. The computing device 10 is composed of a plurality of computation processes. Below, the structural example of the calculation process 120 is demonstrated among several calculation processes. The configuration of other calculation processes is the same as that of the calculation process 120.

  The calculation process 120 includes a memory usage recording unit 101, a communication unit 102, a user program 103, a distributed memory parallel unit 106, a checkpoint execution instruction recording unit 107, a memory operation instruction execution position recording unit 108, a memory A management unit 109 and a checkpoint execution unit 110 are provided. The distributed memory parallel unit 106 includes a memory operation instruction execution unit 104 and a synchronous instruction execution unit 105.

  The user program 103 is a program executed using a plurality of calculation processes. That is, the user program 103 defines a sequence of instructions necessary for executing calculations in each calculation process.

  The distributed memory parallel unit 106 stores a plurality of libraries used for executing the user program 103 in the calculation process 120. The functions provided by the library stored in the distributed memory parallel unit 106 include a memory operation instruction or a synchronization instruction. Here, in the distributed memory parallel unit 106, an element that executes a memory operation instruction is a memory operation instruction execution unit 104, and an element that executes a synchronization instruction is a synchronization instruction execution unit 105.

  The memory operation command is a command for requesting the memory management unit 109 to secure a memory necessary for executing the user program 103 or release an unnecessary memory. For example, the synchronization instruction is an instruction for waiting for all the calculation processes in an SPMD program in which calculation jobs are executed in a plurality of calculation processes.

  The memory usage recording unit 101 records the memory usage before and after the memory operation command is executed, and the memory operation command execution position recorded in the memory operation command execution position recording unit 108. Further, the memory usage recording unit 101 transmits the recorded memory usage to the storage device 40 via the communication unit 102. Alternatively, the memory usage amount recording unit 101 may notify the recorded memory usage amount to the operation terminal 30 via the communication unit 102.

  The memory operation instruction execution position recording unit 108 is called when executing the memory operation instruction and the synchronization instruction, and records the execution position of the memory operation instruction. The memory operation instruction execution position recording unit 108 may record the execution position of the memory operation instruction in the format of the table 108-1 shown in FIG. The execution position of the memory operation instruction is determined using the number of times that the synchronization instruction is executed and the number of times that the memory operation instruction is executed. In this figure, for example, the memory operation instruction executed in the memory operation instruction execution unit 104 is a position where the synchronization instruction has not been executed yet, and the memory reservation instruction and the memory reservation instruction are each executed once. Is shown.

  Returning to FIG. 3, the checkpoint execution instruction recording unit 107 executes the checkpoint execution from the position specified in the checkpoint execution instruction and the execution position of the memory operation instruction recorded in the memory operation instruction execution position recording unit 108. Judgment is made. The checkpoint execution instruction is information generated by the operation terminal 30 based on information input from the user. The checkpoint execution instruction indicates the position where the checkpoint is executed. When it is determined that the checkpoint can be executed, the checkpoint execution instruction recording unit 107 calls the checkpoint execution unit 110 to execute the checkpoint. Here, execution of a checkpoint is intended to set a checkpoint and collect a memory image.

  The checkpoint execution unit 110 stores the memory image of the calculation process being executed in the storage device 40. The memory management unit 109 manages the memory used by the calculation process by securing and releasing the memory.

  Next, a configuration example of the operation terminal 30 according to the first embodiment of the present invention will be described with reference to FIG. The operation terminal 30 displays the memory usage of the calculation job for the user, and receives information related to an operation instruction for the calculation apparatus 10 from the user.

  The memory usage acquisition unit 31 extracts information on the memory usage stored in the storage device 40. Alternatively, the memory usage acquisition unit 31 may receive information on the memory usage from the memory usage recording unit 101 of the computing device 10. The memory usage acquisition unit 31 may receive the calculation job memory usage table 101-1 managed as shown in FIG. 6 as information on the memory usage. The configuration of the calculation job memory usage table 101-1 will be described below.

  The calculation job memory usage table 101-1 in FIG. 6 includes a job ID 101-2 for identifying a calculation job or a user program to be executed, a process ID 101-3, and a calculation process memory usage table 101-4. . The process ID 101-3 is an identifier of a calculation process executed in the calculation apparatus 10. The calculation process memory usage table 101-4 is a memory usage used in each calculation process. In the calculation process memory usage table 101-4, the memory usage recorded in the memory usage recording unit 101 of the calculation process 120 is set. The job ID 101-2 is an identifier of a calculation job being executed in the calculation apparatus 10. The youngest process ID 101-3 may be set as the job ID 101-2.

  Returning to FIG. 5, the memory usage totaling unit 32 totals the calculation process memory usage table 101-4 of all process IDs 101-3 included in the calculation job memory usage table 101-1. The operation terminal 30 displays the result obtained by the memory usage totalization unit 32 on the display unit (not shown) of the operation terminal 30.

  The checkpoint collection position creation unit 33 creates a checkpoint execution instruction based on information regarding the timing for executing the checkpoint input from the user. The user determines the timing for executing the checkpoint based on the totalization result of the calculation process memory usage table 101-4.

  Next, a configuration example of the calculation process memory usage table 7-1 will be described with reference to FIG. The calculation process memory usage table 7-1 is a table composed of a memory operation instruction type, a memory operation instruction execution position, a memory operation instruction execution time, and a used memory.

  The memory operation type is the type of the executed memory operation command, and for example, a memory allocation command or a memory release command is set. The memory operation instruction execution position indicates at which position of the executed calculation the executed memory operation instruction is called. In the present embodiment, as the position information, a value obtained by counting the number of executions of the synchronization instruction and the number of executions of the memory operation instruction after the synchronization instruction for each memory operation instruction type is used.

  The memory operation instruction execution time indicates the time when the memory operation instruction is executed. The time set as the memory operation instruction execution time is the time that has elapsed since the calculation process 120 started executing the calculation job.

  The used memory indicates the memory usage of the calculation process before and after the execution of the memory operation instruction. FIG. 8 shows a calculation process memory usage table 8-1 recorded in another calculation process in the calculation apparatus 10.

  Next, a table in which the calculation process memory usage tables 7-1 and 8-1 in the memory usage totaling unit 32 are tabulated will be described with reference to FIG. The memory usage totaling unit 32 extracts lines having the same memory operation instruction type and memory operation instruction execution position in the calculation process memory usage tables 7-1 and 8-1, and the memory operation instruction type and the memory operation instruction execution position. Set. The memory usage totaling unit 32 compares the extracted rows and sets the time when the memory operation instruction execution time is the latest as the memory operation instruction execution time. Further, the memory usage totaling unit 32 calculates the total used memory of the extracted rows and sets the calculated value in the used memory. The total used memory is calculated separately before and after execution.

  For example, in FIG. 7 and FIG. 8, the memory usage totaling unit 32 secures the memory as the memory operation instruction type, the first execution time of the synchronous instruction as the execution position of the memory operation instruction, and the first execution time for each memory operation instruction type. Extract lines that are Since the memory operation instruction execution time of the extracted row is later as 10 in FIG. 7, 10 is set as the memory operation instruction execution time. Further, since the used memory before execution is 50 in both FIGS. 7 and 8, 100 is set in total. Since the memory used after execution is 100 in FIG. 7 and 150 in FIG. 8, 250 is set in total. The same is set for the other lines.

  Next, a result of displaying the aggregate data aggregated by the memory usage aggregation unit 32 on the display unit of the operation terminal 30 will be described with reference to FIG. In the graph of FIG. 10, the vertical axis indicates the memory usage, and the horizontal axis indicates the call time. The graph of FIG. 10 is created based on the aggregated data of FIG. At the call time 10, the memory used before execution of the memory allocation instruction is 100, and the memory used after execution of the memory allocation instruction is 250. Further, at time 25, the used memory before execution of the memory release instruction is 350, and the used memory after execution of the memory allocation instruction is 150. Further, at time 40, the used memory before execution of the memory release instruction is 150, and the used memory after execution of the memory allocation instruction is 250.

  Next, the checkpoint execution instruction 11-1 created in the checkpoint collection position creation unit 33 will be described with reference to FIG. The checkpoint execution instruction 11-1 is that the synchronous instruction execution count is 0th and the memory release instruction execution count is after the first time, the synchronous instruction execution count is the first time, and the memory allocation instruction execution count is before the first time. , Indicate that you want to set a checkpoint.

  FIG. 12 shows a table stored in the checkpoint execution instruction recording unit 107 of the computing device 10 that has received the checkpoint execution instruction from the operation terminal 30. The table 12-1 of FIG. 12 indicates that the checkpoint is set after the synchronous instruction execution number is 0, the memory allocation instruction execution number is before the first time, and the memory release instruction execution number is the first time. Show.

  Next, the flow of the memory usage recording process in the calculation process 120 will be described with reference to FIG. The calculation job is executed in a plurality of calculation processes in the calculation apparatus 10. In this figure, focusing on one calculation process, the flow of memory usage recording processing will be described.

  First, during execution of a calculation job in the calculation process 120, when an instruction to execute a synchronous instruction is issued in the synchronous instruction execution unit 105 (S11: YES), the memory operation instruction execution position recording unit 108 determines the number of synchronous instruction executions. 1 is incremented, and the memory operation instruction execution count is initialized to 0 (S12). Next, the synchronous command execution unit 105 executes the synchronous command and returns to the processing after step S11.

  When the execution instruction of the synchronous instruction is not issued during execution of the calculation job (S11: NO) and the execution instruction of the memory operation instruction is issued in the memory operation instruction execution unit 104 (S11: YES), the memory operation instruction execution position The recording unit 108 increases the number of memory operation command executions corresponding to the memory type by 1 (S15). Next, the memory usage amount recording unit 101 refers to the memory operation instruction execution position recording unit 108, and executes the memory operation executed with the number of synchronous instruction executions and the number of memory operation instruction executions according to the type as the memory operation instruction execution position. The instruction type, the memory operation instruction execution time, and the memory usage before and after the memory operation instruction execution are recorded using the format described in FIG. 7 or FIG. 8 (S16). Next, the memory operation instruction execution unit 104 executes the memory operation instruction and returns to the processing after step S11.

  If the execution instruction of the memory operation instruction is not issued during the execution of the calculation job (S14: NO) and the user program being executed has not been completed (S18: NO), the processes after step S11 are repeated. When the user program being executed is terminated, the information recorded in the memory usage recording unit 101 is output to the storage device 40 (S19). The storage device 40 stores the output information in the calculation process memory usage table of the calculation job usage table.

  Next, a flow of a checkpoint execution instruction creation process in the operation terminal 30 will be described with reference to FIG.

  First, the memory usage amount acquisition unit 31 acquires a calculation job usage amount table from the storage device 40 (S21). Next, the memory usage totaling unit 32 totals all processes in the calculation job usage table (S22). Specifically, the aggregation table described in FIG. 9 is generated. Next, the memory usage totaling unit 32 graphs the totaling table described in FIG. 9 as shown in FIG. 10 and displays it on the display unit of the operation terminal 30 (S23). Next, the checkpoint collection position creation unit 33 receives input of information regarding the checkpoint execution location from the user (S24). Next, the checkpoint collection position creation unit 33 creates a checkpoint execution instruction based on information input from the user (S25). The generated checkpoint execution instruction is transmitted from the operation terminal 30 to the computing device 10 via the network 50.

  Next, the flow of checkpoint execution processing in the computing device 10 will be described with reference to FIG. First, the checkpoint execution instruction recording unit 107 receives the checkpoint execution instruction transmitted from the operation terminal 30, and reads the received checkpoint execution instruction (S31). Next, the processing of steps S32 to S36 is the same as the processing of steps S11 to 15 in FIG.

  Next, when the memory operation instruction execution position of the memory operation instruction execution position recording unit 108 is updated in step S36, the checkpoint execution position recorded in the checkpoint execution instruction recording unit 107, and the memory operation instruction execution position are recorded. It is determined whether or not the memory operation command execution position recorded in the recording unit 108 matches (S37). When the checkpoint execution position matches the memory operation instruction execution position (S37: match), the memory type of the memory operation instruction for which execution is instructed in step S35 is determined (S38). When the memory type is a memory reservation command (S38: reservation), the checkpoint execution unit 110 collects a memory image and stores it in the storage device 40 (S39). Next, the memory operation instruction execution unit 104 executes a memory allocation instruction, and repeats the processes after step S32 (S40). In step S38, when the memory type is a memory release instruction (S38: release), the memory operation instruction execution unit 104 executes the memory release instruction (S42). Next, the checkpoint execution unit 110 collects a memory image, stores it in the storage device 40, and repeats the processing after step S32 (S42).

  In step S37, when the checkpoint execution position and the memory operation instruction execution position do not match (S37: mismatch), the processes in and after step S32 are repeated. Since the process of step S43 is the same as that of step S18 in FIG. 13, detailed description thereof is omitted.

  As described above, by using the arithmetic processing system according to the first exemplary embodiment of the present invention, the user can determine the checkpoint execution timing based on the memory usage. Therefore, by setting checkpoints at positions where the memory usage is small, it is possible to suppress an increase in the memory image to be collected.

  In the above description, the checkpoint execution timing is determined by the user. For example, the position with the least memory usage is automatically determined, and the checkpoint is set at that position. You may make it set.

(Embodiment 2)
In Embodiment 1 of the present invention, the memory usage at the time of the first user program execution is collected, and the checkpoint execution position at the next user program execution is determined based on the collected data. In the second embodiment of the present invention, not only when the first user program is executed, but also the flow of processing for collecting memory usage each time and always determining the checkpoint execution position according to the latest memory usage. To do.

  In order to execute the above-described processing, the memory usage amount recording unit 101 is updated between step S36 and step S37 in FIG. That is, the memory usage amount recording unit 101 refers to the memory operation instruction execution position recording unit 108 and executes the memory operation instruction executed with the synchronous operation execution number and the memory operation instruction execution number corresponding to the type as the memory operation instruction execution position. , The memory operation instruction execution time, and the memory usage before and after the memory operation instruction execution are recorded using the format described in FIG. 7 or FIG.

  Further, after step S43 in FIG. 15, the information recorded in the memory usage amount recording unit 101 is output to the storage device 40. In this way, by performing the checkpoint execution process and the memory usage recording process during execution of the same user program, the memory usage is constantly updated, allowing the user to check the latest memory usage. . Further, since the user can set checkpoints according to the latest memory usage, a more optimal checkpoint position can be set.

(Embodiment 3)
Next, a memory usage calculation method according to the third embodiment of the present invention will be described with reference to FIG. The third embodiment will be described on the assumption of a parameter survey in which execution of the same program is repeated a plurality of times. When executing the parameter survey, the average of the memory usage in the program executed in the past may be calculated to allow the user to confirm the memory usage related to the average result.

  For example, FIG. 16 shows a bulk job memory usage table 16-1. The bulk job memory usage table 16-1 assigns a bulk job ID 16-2 to all calculation jobs for which parameter survey is performed. The bulk job memory usage table 16-1 collectively stores the calculation job memory usage table 101-1 described with reference to FIG. In the calculation process memory usage table created for each job ID, the memory operation instruction execution time and the average of the used memory are taken in the same row between the memory operation type and the memory operation execution position.

  As described above, by using the memory usage calculation method according to the third embodiment of the present invention, it is possible to reflect not only the initial memory usage but also the memory usage in the program executed in the past. Therefore, it is possible to make the user confirm the more accurate memory usage.

(Embodiment 4)
Next, a configuration example of the calculation process 120 according to the fourth embodiment of the present invention will be described with reference to FIG. The calculation process 120 in FIG. 17 differs from the calculation process 120 in FIG. 3 in that a checkpoint request recording unit 111 is added. Other configurations are the same as those of the calculation process 120 in FIG.

  The checkpoint request recording unit 111 records a checkpoint collection instruction requested by the user during execution of the calculation job, separately from the checkpoint collection instruction determined before execution of the calculation job. When there is a checkpoint collection instruction from the user during execution of the calculation job, the user program 103 records that a checkpoint is requested by the user to the checkpoint request recording unit 111.

  Further, it is determined whether or not there is a checkpoint request from the user between step S31 and step 32 in FIG. 15. If there is a checkpoint request, the checkpoint is recorded to the checkpoint request recording unit 111. A process for recording the request may be added. Further, if the checkpoint request recording unit 111 records that a checkpoint is requested between step S36 and step S37, checkpoints in step S38 and subsequent steps may be performed. . The checkpoint request recorded in the checkpoint request recording unit 111 may be deleted after the checkpoint is performed.

  As described above, checkpoints can be set at arbitrary timings by using the calculation process 120 according to the fourth embodiment of the present invention. For this reason, checkpoints can be set at a timing that the user determines to be necessary, so that data necessary for the user can be collected.

(Embodiment 5)
Next, a checkpoint execution process according to the fifth embodiment of the present invention will be described. In the fifth embodiment, a description will be given of a method in which checkpoints are waited for in all processes, checkpoints are simultaneously performed after inconsistencies such as a communication state between processes are resolved. Such a checkpoint execution method is referred to as a synchronous checkpoint.

  Here, a synchronous checkpoint when a memory operation command is executed across communication commands will be described with reference to FIG. FIG. 18A shows memory operation processing in processes 1 and 2. Process 1 executes a memory allocation instruction, and further executes a communication instruction with process 2 after a memory release instruction is executed. The process 2 executes the communication instruction with the process 1 after executing the memory allocation instruction, and then executes the memory release instruction.

  18B and 18C show the checkpoint execution instruction 11-1 created in the checkpoint collection position creation unit 33 in the process 1 or process 2. Checkpoints are performed at the locations indicated in 18-1 and 18-2.

  Here, when performing the synchronous checkpoint, the process 1 waits for the process 2 to perform the checkpoint after executing the memory release instruction 18-2. However, the process 2 waits for the communication of the process 1 by the communication command before the memory release command 18-2. Therefore, a checkpoint cannot be performed and a deadlock occurs.

  Therefore, the synchronization checkpoint is executed by changing the expression format of the memory operation instruction execution position from the combination of the execution count of the synchronous instruction and the execution count for each type of memory operation instruction to the synchronous instruction execution count and the memory operation instruction execution address. To do. The execution address of the memory operation instruction is an address from the head of the instruction sequence of the program loaded on the memory.

  Specifically, as shown in FIG. 19, the memory operation instruction execution address is used at the memory operation instruction execution position in FIGS. 19B and 19C. Here, as shown in FIGS. 19B and 19C, the memory release instruction straddling the communication instruction has a different execution address. Therefore, since the memory operation instruction execution position is different, it can be excluded from the checkpoint setting targets. Thereby, a synchronous checkpoint that causes a deadlock can be avoided, and the synchronous checkpoint can be performed safely.

  In the above-described embodiments, the present invention has been described as a hardware configuration, but the present invention is not limited to this. The present invention can also realize the processing of the computing device in FIG. 13 by causing a CPU (Central Processing Unit) to execute a computer program. )

  In the above example, the program can be stored and supplied to a computer using various types of non-transitory computer readable media. Non-transitory computer readable media include various types of tangible storage media. Examples of non-transitory computer-readable media include magnetic recording media (for example, flexible disks, magnetic tapes, hard disk drives), magneto-optical recording media (for example, magneto-optical disks), CD-ROMs (Read Only Memory), CD-Rs, CD-R / W, semiconductor memory (for example, mask ROM, PROM (Programmable ROM), EPROM (Erasable PROM), flash ROM, RAM (Random Access Memory)) are included. The program may also be supplied to the computer by various types of transitory computer readable media. Examples of transitory computer readable media include electrical signals, optical signals, and electromagnetic waves. The temporary computer-readable medium can supply the program to the computer via a wired communication path such as an electric wire and an optical fiber, or a wireless communication path.

  Note that the present invention is not limited to the above-described embodiment, and can be changed as appropriate without departing from the spirit of the present invention.

DESCRIPTION OF SYMBOLS 10 Computer apparatus 11 Process 12 Process 13 Process 30 Operation terminal 31 Memory usage acquisition part 32 Memory usage totaling part 33 Checkpoint collection position creation part 40 Storage device 50 Network 101 Memory usage recording part 102 Communication part 103 User program 104 Memory Operation instruction execution unit 105 Synchronous instruction execution unit 106 Distributed memory parallel unit 107 Checkpoint execution instruction recording unit 108 Memory operation instruction execution position recording unit 109 Memory management unit 110 Checkpoint execution unit 111 Checkpoint request recording unit 120 Calculation process

Claims (9)

A calculation device that acquires a memory image for restarting a calculation job when a failure occurs based on checkpoint information,
A memory usage recording unit that records a memory usage in accordance with a memory operation command during execution of the calculation job;
A communication unit that aggregates the memory usage in a plurality of processes and transmits the memory usage recorded in the memory usage recording unit to an operation terminal that sets the checkpoint based on the aggregated memory usage; ,
A position information recording unit for recording position information indicated by using the number of execution times of the memory operation instruction and the number of execution times of a synchronous instruction for waiting for execution of the calculation job in the plurality of processes;
Bei to give a,
The memory usage recording unit records the location information and the memory usage in association with each other;
Calculation apparatus. The location information is
When the memory operation instruction is executed, the increased number of times the execution of the memory operation command, the synchronization instruction execution count of the synchronization instruction when executed is increased, the computing device according to claim 1 . An instruction information recording unit that receives information on a memory image acquisition instruction indicating a set position of the checkpoint from the operation terminal using the position information;
The instruction information recording unit
When the memory operation command is executed, when the position information recorded in the position information recording unit matches the set position information of the checkpoint indicated in the memory image acquisition instruction, The computing device according to claim 2 , wherein the memory image at a checkpoint is acquired. When the calculation job is repeatedly executed multiple times,
The memory usage recording unit
Record the memory usage according to the memory operation instruction during execution of the calculation job executed for the first time,
The instruction information recording unit
The calculation apparatus according to claim 3 , wherein the check point setting position determined in the operation terminal based on the memory usage is received. When the calculation job is repeatedly executed multiple times,
The memory usage recording unit
Update the memory usage each time the calculation job is executed,
The instruction information recording unit
The calculation device according to claim 3 , wherein the check point setting position determined in the operation terminal based on the updated memory usage is received. A calculation device that acquires a memory image for restarting a calculation job when a failure occurs based on checkpoint information,
A memory usage recording unit that records a memory usage in accordance with a memory operation command during execution of the calculation job;
A communication unit that aggregates the memory usage in a plurality of processes and transmits the memory usage recorded in the memory usage recording unit to an operation terminal that sets the checkpoint based on the aggregated memory usage; ,
A position information recording unit for recording position information indicated by using an execution address on a memory operated when executing the memory operation instruction and a number of executions of a synchronous instruction for waiting for execution of the calculation job in the plurality of processes When,
Bei to give a,
The memory usage recording unit records the location information and the memory usage in association with each other ;
Calculation apparatus. An arithmetic processing system comprising: a computing device that acquires a memory image for restarting a computation job when a failure occurs based on checkpoint information; and an operation terminal that transmits the checkpoint information to the computing device There,
The computing device is:
A memory usage recording unit that records a memory usage in accordance with a memory operation command during execution of the calculation job;
A communication unit for transmitting the memory usage recorded in the memory usage recording unit to the operation terminal;
A position information recording unit that records position information indicated by using the number of executions of the memory operation instruction and the number of executions of a synchronous instruction for waiting for execution of the calculation job in a plurality of processes;
Have
The memory usage recording unit records the location information and the memory usage in association with each other,
The operation terminal is
An arithmetic processing system that aggregates the memory usage in a plurality of processes, displays the aggregated memory usage, and accepts input of information on a set position of the checkpoint from a user. A checkpoint setting method that is executed in a computing device that acquires a memory image for restarting a calculation job when a failure occurs based on checkpoint information,
Record the memory usage according to the memory operation instruction during the execution of the calculation job,
Summing up the memory usage in a plurality of processes and sending the recorded memory usage to an operating terminal that sets the checkpoint based on the aggregated memory usage ;
The location information indicated by using the number of executions of the memory operation instruction and the number of executions of the synchronous instruction for waiting for execution of the calculation job in the plurality of processes, and the memory usage are recorded in association with each other
Checkpoint setting method. A program to be executed by a computer of a computing device that acquires a memory image for restarting a computation job when a failure occurs based on checkpoint information,
Recording a memory usage amount according to a memory operation instruction during execution of the calculation job;
Summing up the memory usage in a plurality of processes and transmitting the recorded memory usage to an operating terminal that sets the checkpoint based on the aggregated memory usage;
A step of associating and recording the location information indicated by using the number of executions of the memory operation instruction and the number of executions of a synchronous instruction for waiting for execution of the calculation job in the plurality of processes, and the memory usage amount;
A program that causes a computer to execute.

Images