JP2024044866A - Information processing device, information processing method, and information processing program - Google Patents

Abstract

To provide an information processing device, an information processing method, and an information processing program with which it is possible to reduce a ratio of a total size of parity data to a total size of all data recorded to magnetic tape.SOLUTION: An information processing device adds dummy data to data other than data of a maximum size so as to execute a process of equalizing the sizes of a plurality of pieces of data to a same size, generates parity data using the plurality of pieces of data whose sizes have been equalized, exercises first control to record the plurality of pieces of data and parity data to a magnetic tape, generates parity data from new data and data portions in each of the plurality of pieces of data whose sizes have been equalized, from which portions parity data was generated using dummy data, and exercises second control to record the new data and the parity data to the magnetic tape.SELECTED DRAWING: Figure 10

Description

The present disclosure relates to an information processing device, an information processing method, and an information processing program.

Patent Document 1 discloses a technique for equalizing the size of each logical volume by adding dummy data to the end of the logical volumes that belong to a logical volume group when generating parity data.

Japanese Patent Application Publication No. 2015-143952

When multiple data and the parity data generated from the multiple data are grouped together and made the multiple data the same size, the size often differs for each group. In this case, for example, if multiple data are made the same size in the order in which they were received, and then the multiple data of the same size and the parity data generated from the multiple data are recorded on magnetic tape, the following problem may occur. That is, in this case, the proportion of the total size of the parity data in the total size of all data recorded on magnetic tape may increase.

The present disclosure has been made in view of the above circumstances, and provides an information processing device, an information processing method, and an information processing method that can reduce the ratio of the total size of parity data to the total size of all data recorded on a magnetic tape. and information processing programs.

The information processing device of the first aspect is an information processing device including at least one processor, and the processor is configured to use dummy data for data other than the largest size data among the plurality of data to be recorded on the magnetic tape. A process of making multiple pieces of data the same size by adding data, generating parity data using the multiple pieces of data made to the same size, and recording the multiple pieces of data and parity data on a magnetic tape. 1, and when a request to record new data on the magnetic tape is accepted, a data portion in which parity data is generated using the new data and dummy data of each of a plurality of data of the same size, A second control is performed in which parity data is generated from the data, and new data and parity data generated using the new data are recorded on the magnetic tape.

The second aspect of the information processing device is the information processing device of the first aspect, in which the processor, in the second control, performs control to overwrite the new data in the area on the magnetic tape where the dummy data is recorded, if the size of the new data is equal to or smaller than the size of the dummy data recorded on the magnetic tape.

The third aspect of the information processing device is the information processing device of the first or second aspect, in which, if the size of the new data exceeds the size of the dummy data recorded on the magnetic tape, the processor executes a process of making the new data and the data portion the same size by adding dummy data to the data portion.

The information processing method of the fourth aspect makes the sizes of the plurality of data the same by adding dummy data to data other than the largest size data among the plurality of data to be recorded on the magnetic tape. Executes the process, generates parity data using multiple data of the same size, performs first control to record the multiple data and parity data on the magnetic tape, and requests recording of new data on the magnetic tape. If the new data is accepted, parity data is generated from the new data and the data part where parity data is generated using dummy data for each of multiple data of the same size, and the new data and the new data are A processor included in the information processing apparatus executes a second control process for recording parity data generated using the above information on a magnetic tape.

The information processing program of the fifth aspect causes a processor of an information processing device to execute a process of making the sizes of multiple data to be recorded on magnetic tape uniform by adding dummy data to data other than the maximum-sized data, a first control of generating parity data using the multiple data made uniform in size, and recording the multiple data and the parity data on magnetic tape, and when a request to record new data on magnetic tape is received, a second control of generating parity data from the new data and a data portion of each of the multiple data made uniform in size, where the parity data is generated using dummy data, and recording the new data and the parity data generated using the new data on magnetic tape.

According to the present disclosure, it is possible to reduce the proportion of the total size of parity data in the total size of all data recorded on magnetic tape.

FIG. 1 is a block diagram illustrating an example of a configuration of an information processing system. FIG. 2 is a block diagram showing an example of a hardware configuration of an information processing device. FIG. 2 is a block diagram showing an example of a functional configuration of an information processing device. FIG. 3 is a diagram for explaining dummy data addition processing. FIG. 3 is a diagram for explaining parity data generation processing. 11 is a diagram for explaining the process of recording a data set and parity data onto a magnetic tape under the first control. FIG. 11 is a diagram for explaining a process of generating parity data when a request to record new data is received; FIG. 11 is a diagram for explaining a process of generating parity data when a request to record new data is received; FIG. FIG. 6 is a diagram for explaining parity data generation processing when a new data recording request is accepted. 13 is a diagram for explaining a process of recording data and parity data onto a magnetic tape under the second control. FIG. FIG. 7 is a diagram for explaining the recording process of data and parity data on a magnetic tape in the second control. FIG. 7 is a diagram for explaining a process of recording data and parity data on a magnetic tape in a second control according to a modification. 3 is a flowchart illustrating an example of data recording processing.

Hereinafter, embodiments for implementing the technology of the present disclosure will be described in detail with reference to the drawings.

First, the configuration of an information processing system 10 according to this embodiment will be described with reference to FIG. 1. As shown in FIG. 1, the information processing system 10 includes an information processing device 12 and a tape library 14. An example of the information processing device 12 is a server computer.

The tape library 14 includes a plurality of slots (not shown) and a plurality of tape drives 18, and each slot stores a magnetic tape T as an example of a recording medium. Each tape drive 18 is connected to the information processing device 12. The tape drive 18 writes or reads data to the magnetic tape T under the control of the information processing device 12. An example of the magnetic tape T is an LTO (Linear Tape-Open) tape.

When the information processing device 12 writes or reads data to the magnetic tape T, the magnetic tape T to be written or read is loaded from a slot into a specified tape drive 18. When writing or reading of data to the magnetic tape T loaded into the tape drive 18 is completed, the magnetic tape T is unloaded from the tape drive 18 to the slot in which it was originally stored.

Next, with reference to FIG. 2, the hardware configuration of the information processing device 12 according to this embodiment will be described. As shown in FIG. 2, the information processing device 12 includes a CPU (Central Processing Unit) 20, a memory 21 as a temporary storage area, and a nonvolatile storage section 22. The information processing device 12 also includes a display 23 such as a liquid crystal display, an input device 24 such as a keyboard and mouse, a network I/F (InterFace) 25 connected to the network, and an external I/F (InterFace) 25 to which each tape drive 18 is connected. Contains F26. The CPU 20 , memory 21 , storage section 22 , display 23 , input device 24 , network I/F 25 , and external I/F 26 are connected to the bus 27 . CPU20 is an example of a processor.

The storage unit 22 is realized by a hard disk drive (HDD), a solid state drive (SSD), a flash memory, or the like. The information processing program 30 is stored in the storage unit 22 as a storage medium. The CPU 20 reads the information processing program 30 from the storage unit 22, expands it in the memory 21, and executes the expanded information processing program 30.

The information processing device 12 according to this embodiment receives a request to record data onto the magnetic tape T and data to be recorded onto the magnetic tape T, both transmitted from an external device such as a user terminal. The information processing device 12 stores the received data in the storage unit 22. The information processing device 12 then controls the recording of the data stored in the storage unit 22 onto the magnetic tape T.

Next, the functional configuration of the information processing device 12 according to this embodiment will be described with reference to FIG. 3. As shown in FIG. 3, the information processing device 12 includes an execution unit 40, a first generation unit 42, a first control unit 44, a second generation unit 46, and a second control unit 48. When the CPU 20 executes the information processing program 30, it functions as the execution unit 40, the first generation unit 42, the first control unit 44, the second generation unit 46, and the second control unit 48.

The execution unit 40 executes a process (hereinafter referred to as a "dummy data addition process") of making the sizes of multiple data items to be recorded on the magnetic tape T stored in the memory unit 22 the same by adding dummy data to data items other than the maximum-sized data item. In this embodiment, the execution unit 40 executes the dummy data addition process by treating a collection of multiple data items as one data set.

Specifically, as shown in FIG. 4, the execution unit 40 executes a dummy data addition process in which dummy data is added to datasets other than the maximum-sized dataset among the multiple datasets to make the multiple datasets the same size. Examples of dummy data include data padded with 0s or data padded with 1s. The dummy data may also be data represented by a bit string in which 0s and 1s are arranged according to a specific rule, such as data in which 0s and 1s are repeated alternately. In FIG. 4, the horizontal length of each rectangle represents the data size of that rectangle. Note that at least one of the multiple datasets in FIG. 4 may be a single piece of data.

The first generating unit 42 generates parity data using multiple data sets that are made the same size by the executing unit 40. Specifically, as shown in FIG. 5, the first generating unit 42 generates one parity data of the same size as a data set using multiple data sets that are made the same size by the executing unit 40. The parity data according to this embodiment is a redundant code that can restore one data set from the remaining data sets and the parity data even if one of the multiple data sets is lost. Note that the example of FIG. 5 shows a configuration in which one parity data is generated from three data sets (a so-called 3D+1P configuration), but the combination of the number of data sets and the number of parity data is not limited to this example.

The parity data according to this embodiment is generated by bit operations such as exclusive OR of each bit of multiple data sets. Therefore, it is possible to restore only a portion of the data contained in the data set.

The first control unit 44 performs control (hereinafter referred to as “first control). In this embodiment, as shown in FIG. 6 as an example, a plurality of data sets and parity data are distributed and recorded on the same number of magnetic tapes T as the total number of data sets and parity data. conduct. As a result, even if one magnetic tape T becomes unusable, the data set and parity data recorded on the remaining three magnetic tapes T are used to determine whether the unusable magnetic tape T Data sets recorded in can be restored.

When the second generation unit 46 receives a request to record new data onto the magnetic tape T after the first control, the second generation unit 46 uses the new data and dummy data in each of the plurality of data sets having the same size. Parity data is generated from the data portion that generated the parity data. A specific example of the parity data generation process by the second generation unit 46 will be described with reference to FIGS. 7 to 9. In each of FIGS. 7 to 9, after the three data sets and one parity data shown in FIG. An example is shown in which the application is accepted. Furthermore, “Parity data (new)” in FIGS. 7 to 9 indicates parity data generated by the second generation unit 46.

As shown in FIG. 7, when the size of the new data is equal to or smaller than the size of the dummy data recorded on the magnetic tape T by the first control, the second generation unit 46 generates parity data from the new data and a data portion in which parity data is generated using dummy data in each of the multiple data sets of the same size. The example in FIG. 7 shows a case in which the size of the new data is equal to the size of the dummy data. The portion surrounded by the dashed rectangle in FIG. 7 to FIG. 9, that is, a portion of "Data 2" and "Data 7" and "Data 8", correspond to the data portion in which parity data is generated using dummy data in each of the multiple data sets of the same size. As described above, parity data is generated by calculation on a bit-by-bit basis, so parity data can be generated from even a portion of the data in this way.

As shown in FIG. 8, when the size of the new data is less than the size of the dummy data, the second generating unit 46 may generate parity data from the new data that has been made the same size as the data portion by adding dummy data to the new data. In this case, the process of making the new data and the data portion the same size by adding dummy data to the new data is executed by the execution unit 40 described above.

Also, as shown in FIG. 9, when the size of the new data exceeds the size of the dummy data recorded on the magnetic tape T by the first control, the second generating unit 46 generates parity data from the new data and the data portion that has been made the same size by adding the dummy data to the data portion. In this case, the process of making the new data and the data portion the same size by adding the dummy data to the data portion is executed by the execution unit 40 described above.

The second control unit 48 performs control (hereinafter referred to as "second control") to record new data and parity data generated by the second generation unit 46 using the new data on the magnetic tape T. As shown in FIG. 10, in the second control, if the size of the new data is equal to or smaller than the size of the dummy data recorded on the magnetic tape T by the first control, the second control unit 48 performs control to overwrite the new data in the area on the magnetic tape T where the dummy data is recorded. As shown in FIG. 10, in this case, the second control unit 48 further performs control to overwrite the data portion of the parity data recorded on the magnetic tape T by the first control with the parity data generated by the second generation unit 46, which was generated using the dummy data.

As shown in FIG. 11, in the second control, if the size of the new data exceeds the size of the dummy data recorded on the magnetic tape T in the first control, the second control unit 48 controls the new data. Control is performed to overwrite the area on the magnetic tape T in which dummy data is recorded. As shown in FIG. 11, in this case, the second control section 48 further converts the parity data generated by the second generation section 46 into dummy data in the parity data recorded on the magnetic tape T under the first control. control to overwrite the data part generated using As shown in FIG. 11, in this case, the second control section 48 may further perform control to additionally write dummy data used in the generation of parity data by the second generation section 46 onto the magnetic tape T.

Note that, as shown in FIG. 12, in the second control, if the size of the new data exceeds the size of the dummy data recorded on the magnetic tape T by the first control, the second control unit 48 Control for additionally writing data onto the magnetic tape T may also be performed. As shown in FIG. 12, in this case, the second control unit 48 may further perform control to additionally record the parity data generated by the second generation unit 46 on the magnetic tape T in the second control.

Further, if new data is received after the second control, the second control unit 48 may perform the second control again using the new data. Further, the new data in this case may be a data set that is a collection of a plurality of data.

Next, the operation of the information processing device 12 according to this embodiment will be described with reference to FIG. 13. The data recording process shown in FIG. 13 is executed by the CPU 20 executing the information processing program 30. The data recording process shown in FIG. 13 is executed, for example, when a command to start execution is input by the user via the input device 24, or when a predetermined number of pieces of data or more are stored in the memory unit 22.

In step S10 of FIG. 13, the execution unit 40 executes the dummy data addition process on the plurality of data to be recorded on the magnetic tape T stored in the storage unit 22, as described above. In step S12, the first generation unit 42 generates parity data using the plurality of data sets made to be the same size in step S10, as described above. In step S14, the first control unit 44 performs a process of distributing and recording the plurality of data sets and the parity data generated in step S12 using the plurality of data sets onto the plurality of magnetic tapes T, as described above. 1 control is performed.

In step S16, the execution unit 40 waits until a request for recording new data onto the magnetic tape T is received. When a request to record new data onto the magnetic tape T is accepted, the determination in step S16 becomes affirmative, and the process moves to step S18. In step S18, the execution unit 40 determines whether the size of the new data accepted in step S16 is less than or equal to the size of the dummy data recorded on the magnetic tape T in step S14. If this determination is affirmative, the process moves to step S20.

In step S20, the execution unit 40 executes a dummy data addition process in which dummy data is added to the new data received in step S16, thereby making the new data and the data portion in which parity data is generated using the dummy data in each of the multiple data sets that have been made the same size the same. Note that if the size of the new data is equal to the size of the dummy data recorded on the magnetic tape T in step S14, the process of step S20 does not need to be executed.

In step S22, the second generation unit 46 generates parity data using the new data made the same size in step S20 and the above data portion, as described above. In step S24, the second control unit 48 controls the overwriting of the new data in the area on the magnetic tape T where the dummy data is recorded, as described above. Also, the second control unit 48 controls the overwriting of the parity data generated in step S22 over the data portion of the parity data recorded on the magnetic tape T in step S14, which was generated using the dummy data, as described above. When the processing of step S24 ends, the data recording processing ends.

On the other hand, if the determination in step S18 is negative, the process moves to step S26. In step S26, the execution unit 40 executes a dummy data addition process to make the new data accepted in step S16 and the data part the same size by adding dummy data to the data part.

In step S28, the second generation unit 46 generates parity data using the new data made to the same size in step S26 and the data portion, as described above. In step S30, the second control unit 48 performs control to overwrite the area of the magnetic tape T in which the dummy data is recorded with new data, as described above. Furthermore, as described above, the second control unit 48 overwrites the parity data generated in step S28 over the data portion generated using dummy data in the parity data recorded on the magnetic tape T in step S14. Take control. When the process of step S30 is finished, the data recording process is finished.

Note that the process may return to step S16 after the process in step S24 and after the process in step S30 ends. In this case, if a request for recording new data onto the magnetic tape T is accepted, the processes from step S18 onwards are executed again.

As described above, when the information processing device 12 according to the present embodiment receives a new data recording request after recording data and parity data on the magnetic tape T, the information processing device 12 performs the following control. That is, in this case, the information processing device 12 does not generate parity data only from new data, but generates parity data from a part of the data already recorded on the magnetic tape T and new data, and generates parity data from new data. control to record data and parity data on the magnetic tape T. Therefore, the ratio of the total size of parity data to the total size of all data recorded on the magnetic tape T can be reduced.

In the above embodiment, the data to be recorded on the magnetic tape T may be data that the user wishes to save, such as document data and image data, and an object containing metadata related to that data. A storage system that handles such objects is called an object storage system. The metadata in this embodiment includes, for example, object identification information such as an object key, object name, data size, and attribute information such as a timestamp.

In the above embodiment, the various processors shown below can be used as the hardware structure of the processing units that execute various processes, such as the execution unit 40, the first generation unit 42, the first control unit 44, the second generation unit 46, and the second control unit 48. As described above, the various processors include a CPU, which is a general-purpose processor that executes software (programs) and functions as various processing units, as well as a programmable logic device (PLD), which is a processor whose circuit configuration can be changed after manufacture, such as an FPGA (Field Programmable Gate Array), and a dedicated electrical circuit, such as an ASIC (Application Specific Integrated Circuit), which is a processor with a circuit configuration designed specifically to execute specific processes.

A single processing unit may be configured with one of these various processors, or may be configured with a combination of two or more processors of the same or different types (e.g., a combination of multiple FPGAs, or a combination of a CPU and an FPGA). Also, multiple processing units may be configured with a single processor.

As an example of configuring multiple processing units with one processor, firstly, one processor is configured with a combination of one or more CPUs and software, as typified by computers such as a client and a server. There is a form in which a processor functions as multiple processing units. Second, there are processors that use a single IC (Integrated Circuit) chip, such as System on Chip (SoC), which implements the functions of an entire system including multiple processing units. be. In this way, various processing units are configured using one or more of the various processors described above as a hardware structure.

Furthermore, as the hardware structure of these various processors, more specifically, an electric circuit (circuitry) that is a combination of circuit elements such as semiconductor elements can be used.

Further, in the above embodiment, a mode has been described in which the information processing program 30 is stored (installed) in the storage unit 22 in advance, but the present invention is not limited to this. The information processing program 30 is provided in a form recorded on a recording medium such as a CD-ROM (Compact Disc Read Only Memory), a DVD-ROM (Digital Versatile Disc Read Only Memory), or a USB (Universal Serial Bus) memory. Good too. Further, the information processing program 30 may be downloaded from an external device via a network.

10 Information processing system 12 Information processing device 14 Tape library 18 Tape drive 20 CPU
21 Memory 22 Storage section 23 Display 24 Input device 25 Network I/F
26 External I/F
27 Bus 30 Information processing program 40 Execution unit 42 First generation unit 44 First control unit 46 Second generation unit 48 Second control unit T Magnetic tape

Claims (5)

An information processing device comprising at least one processor,
The processor includes:
performing a process of making the sizes of the plurality of data the same size by adding dummy data to data other than the largest size data among the plurality of data to be recorded on the magnetic tape;
Generate parity data using the plurality of data of the same size,
performing first control to record the plurality of data and the parity data on a magnetic tape;
When a request for recording new data onto the magnetic tape is accepted, parity data is generated from the new data and the data portion for which parity data is generated using the dummy data in each of the plurality of data of the same size. generate,
An information processing device that performs second control for recording the new data and parity data generated using the new data on the magnetic tape. The processor,
The information processing device according to claim 1 , wherein, in the second control, if the size of the new data is equal to or smaller than the size of the dummy data recorded on the magnetic tape, the new data is overwritten in the area of the magnetic tape where the dummy data is recorded. The processor includes:
If the size of the new data exceeds the size of the dummy data recorded on the magnetic tape, processing is performed to make the new data and the data portion the same size by adding dummy data to the data portion. The information processing device according to claim 1 or claim 2. performing a process of making the sizes of the plurality of data to be recorded on the magnetic tape equal by adding dummy data to data other than the data with the maximum size;
generating parity data using the plurality of data pieces of the same size;
performing a first control for recording the plurality of data and the parity data on a magnetic tape;
when a request to record new data on the magnetic tape is received, generating parity data from the new data and a data portion in which parity data is generated using the dummy data in each of the plurality of data having the same size;
an information processing method in which a processor included in an information processing device executes a process of performing a second control for recording the new data and parity data generated using the new data on the magnetic tape; performing a process of making the sizes of the plurality of data to be recorded on the magnetic tape equal by adding dummy data to data other than the data with the maximum size;
generating parity data using the plurality of data pieces of the same size;
performing a first control for recording the plurality of data and the parity data on a magnetic tape;
when a request to record new data on the magnetic tape is received, generating parity data from the new data and a data portion in which parity data is generated using the dummy data in each of the plurality of data having the same size;
an information processing program for causing a processor included in an information processing device to execute a process of performing a second control for recording the new data and parity data generated using the new data on the magnetic tape;