WO2022049831A1

WO2022049831A1 - Information processing device, information processing method, and information processing program

Info

Publication number: WO2022049831A1
Application number: PCT/JP2021/017591
Authority: WO
Inventors: 豊大石; 輝江渡邊; 裕史谷川; 浩司松村; 理貴近藤; 美咲大塚; 優子宇野
Original assignee: 富士フイルム株式会社
Priority date: 2020-09-01
Filing date: 2021-05-07
Publication date: 2022-03-10
Also published as: JPWO2022049831A1

Abstract

An information processing device periodically performs processing of comparing, with a threshold value, a count or a total value of size of objects in an object group to be processed, regarding which bundling processing is unexecuted, and in a case in which the number or the total value is not less than the threshold value, generates a packed object in which the object group to be processed is bundled.

Description

Information processing equipment, information processing methods, and information processing programs

This disclosure relates to an information processing device, an information processing method, and an information processing program.

A technique for selecting a magnetic tape corresponding to a backup cycle of a virtual medium when recording a virtual medium of a magnetic disk drive on a magnetic tape is disclosed (see Japanese Patent Application Laid-Open No. 2005-050104).

By the way, in the process of recording an object stored in an information processing device such as a server computer on a magnetic tape, a plurality of objects are combined into one object (hereinafter referred to as one object) in order to reduce the overhead of issuing a recording instruction command to the tape drive. It is conceivable to put them together in a "packed object") and then send the packed object to a tape drive.

It is also conceivable that the information processing device periodically executes a process of combining a plurality of objects into one packed object. In this case, it is preferable to appropriately create the packed objects so that the total number or sizes of the objects contained in each packed object does not become too small. However, the technique described in Japanese Patent Application Laid-Open No. 2005-050104 does not relate to the technique for creating a packed object.

The present disclosure has been made in view of the above circumstances, and an object of the present disclosure is to provide an information processing device, an information processing method, and an information processing program capable of appropriately creating a packed object.

The information processing apparatus of the present disclosure is an information processing apparatus including at least one processor and controlling to record a group of objects together on a magnetic tape, and the processor has not periodically executed the processing of collecting the objects. A process of comparing the total value of the number or size of the objects of the processing target object group with the threshold value is performed, and when the above number or the above total value is equal to or more than the threshold value, a packed object in which the processing target object group is put together is generated.

In the information processing device of the present disclosure, the processor may derive a threshold value according to the total value of the number or size of objects received from the external device per unit time.

In addition, the information processing apparatus of the present disclosure is the above-mentioned one or more time zones in the past, which is the same as the time zone in which the processor generates the packed object or the most recent predetermined period in which the processor performs the comparison processing. A threshold may be derived according to the number or the total value.

Further, in the information processing device of the present disclosure, the processor may derive a threshold value based on the time series data of the total value of the number or size of objects received from the external device.

Further, the information processing apparatus of the present disclosure may be controlled by the processor to record the generated packed object on a magnetic tape.

Further, the information processing method of the present disclosure is an information processing method executed by a processor included in an information processing apparatus that controls to record a group of objects together on a magnetic tape, and the processing of collecting them periodically has not been executed. A process is performed to compare the total value of the number or size of objects in the process target object group with the threshold value, and when the above number or the above total value is equal to or greater than the threshold value, a packed object that summarizes the process target object group is generated. be.

Further, the information processing program of the present disclosure is an information processing program for being executed by a processor included in an information processing apparatus that controls to record a group of objects together on a magnetic tape, and the processing of collecting the objects is not executed periodically. Performs processing to compare the total value of the number or size of objects in the processing target object group and the threshold value, and when the above number or the above total value is equal to or greater than the threshold value, a packed object that summarizes the processing target object group is generated. It is a thing.

According to this disclosure, packed objects can be created appropriately.

It is a block diagram which shows an example of the structure of a recording / reproduction system. It is a figure for demonstrating an object. It is a block diagram which shows an example of the hardware composition of an information processing apparatus. It is a figure for demonstrating the generation process of a packed object. It is a block diagram which shows an example of the functional structure of an information processing apparatus. It is a flowchart which shows an example of the object reception processing. It is a flowchart which shows an example of the object recording process. It is a figure which shows an example of the execution timing of the process to put together which concerns on embodiment. It is a figure which shows an example of the execution timing of the process to put together which concerns on a modification.

Hereinafter, an example of a form for implementing the technique of the present disclosure will be described in detail with reference to the drawings.

First, the configuration of the recording / reproducing system 10 according to the present embodiment will be described with reference to FIG. As shown in FIG. 1, the recording / playback system 10 includes an information processing device 12 and a tape library 14. Examples of the information processing apparatus 12 include a server computer and the like.

The tape library 14 includes a plurality of slots (not shown) and a plurality of tape drives 18, and each slot stores a magnetic tape T as an example of a recording medium. Each tape drive 18 is connected to the information processing device 12. The tape drive 18 writes or reads data on the magnetic tape T under the control of the information processing apparatus 12. An example of the magnetic tape T is an LTO (Linear Tape-Open) tape.

When the information processing apparatus 12 writes or reads data on the magnetic tape T, the magnetic tape T to be written or read is loaded from the slot into a predetermined tape drive 18. When the writing or reading of the data to the magnetic tape T loaded in the tape drive 18 is completed, the magnetic tape T is unloaded from the tape drive 18 into the slot originally stored.

In the present embodiment, as shown in FIG. 2 as an example, as a unit for handling the data to be recorded on the magnetic tape T, data to be saved by the user such as document data and image data, and metadata related to the data are included. An example of the form to which the object is applied will be described. In the example of FIG. 2, the metadata is expressed as “meta”. The storage system that handles this object is called an object storage system. The metadata includes, for example, object identification information such as an object key, object name, data size, and attribute information such as a time stamp. The recording order of the data and the metadata when the object is recorded on the magnetic tape T is not particularly limited, and may be the order of the metadata and the data, or may be the order of the data and the metadata.

Next, the hardware configuration of the information processing apparatus 12 according to the present embodiment will be described with reference to FIG. As shown in FIG. 3, the information processing device 12 includes a CPU (Central Processing Unit) 20, a memory 21 as a temporary storage area, and a non-volatile storage unit 22. Further, the information processing apparatus 12 includes a display unit 23 such as a liquid crystal display, an input unit 24 such as a keyboard and a mouse, a network I / F (InterFace) 25 connected to a network, and an external I to which each tape drive 18 is connected. / F26 is included. The CPU 20, the memory 21, the storage unit 22, the display unit 23, the input unit 24, the network I / F25, and the external I / F26 are connected to the bus 27.

The storage unit 22 is realized by an HDD (Hard Disk Drive), an SSD (Solid State Drive), a flash memory, or the like. The information processing program 30 is stored in the storage unit 22 as a storage medium. The CPU 20 reads the information processing program 30 from the storage unit 22, expands it into the memory 21, and executes the expanded information processing program 30.

The information processing device 12 according to the present embodiment controls to record an object (hereinafter referred to as "packed object"), which is a collection of objects received from an external device such as a user terminal, on a magnetic tape T. This is because the information processing device 12 has an overhead due to issuing a command for recording instructions to the tape drive 18 as compared with the case where the information processing device 12 controls to record the objects one by one on the magnetic tape T without generating the packed objects. This is to reduce.

The process of generating the packed object by the information processing apparatus 12 will be described with reference to FIG. As shown in FIG. 4, the information processing apparatus 12 generates a packed object that is a collection of objects received from an external device. Packed objects contain headers. The header contains, for example, information about the position of each object contained in the packed object in the packed object. The information about this position is, for example, the number of bytes to the number of bytes of each object in the packed object.

Further, the information processing apparatus 12 controls to record the generated packed object on the magnetic tape T. Specifically, the information processing apparatus 12 transmits the packed object and the command for recording instruction to the tape drive 18. As a result, the tape drive 18 records the packed object on the magnetic tape T. That is, when the information processing apparatus 12 acquires an object from the magnetic tape T, the object to be acquired is extracted from the packed object after controlling the reading of the packed object from the magnetic tape T.

Therefore, if the size of the packed object is too large, it takes a long time to read the packed object from the magnetic tape T, and as a result, the time spent to acquire the object to be acquired also becomes long. On the other hand, if the size of the packed object is too small, the ratio of the header to the packed object becomes large, and as a result, the effective capacity of the magnetic tape T decreases. The effective capacity referred to here means a capacity that can record an object to be stored, excluding the header of the packed object on the magnetic tape T.

Also, if the process of creating a packed object is performed periodically, the object received in the immediately preceding period may generate a packed object that is too large in size or a packed object that is too small in size. Therefore, the information processing apparatus 12 has a function of determining whether or not to perform a process of generating a packed object by using a predetermined threshold value TH.

Next, with reference to FIG. 5, the functional configuration of the information processing apparatus 12 according to the present embodiment will be described. As shown in FIG. 5, the information processing apparatus 12 includes a receiving unit 40, a determination unit 42, a generation unit 44, and a control unit 46. When the CPU 20 executes the information processing program 30, it functions as a receiving unit 40, a determination unit 42, a generation unit 44, and a control unit 46.

The receiving unit 40 receives the object transmitted from the external device via the network I / F25. Further, the receiving unit 40 stores the received object in the storage unit 22.

The determination unit 42 periodically performs a process of comparing the total value TS and the threshold value TH of the objects of the object group to be processed, which is the object group whose summarization process has not been executed, stored in the storage unit 22. It is determined whether or not the total value TS is equal to or greater than the threshold value TH. As the threshold value TH in this case, for example, a predetermined value can be applied as the lower limit value of the size of one packed object. Further, as the time interval T1 in which the determination unit 42 periodically performs the above determination, for example, the maximum value of the total size of the objects of the object group received within the time interval T1 in the past is one packed object. The time interval that is less than or equal to the upper limit of the size can be mentioned.

When the determination unit 42 determines that the total value TS is equal to or greater than the threshold value TH, the generation unit 44 generates a packed object that summarizes the objects to be processed. The control unit 46 controls to record the packed object generated by the generation unit 44 on the magnetic tape T.

Next, the operation of the information processing apparatus 12 according to the present embodiment will be described with reference to FIGS. 6 and 7. When the CPU 20 executes the information processing program 30, the object reception process shown in FIG. 6 and the object recording process shown in FIG. 7 are executed. The object reception process shown in FIG. 6 is executed, for example, when the information processing device 12 receives an object transmitted from an external device. The object recording process shown in FIG. 7 is periodically executed, for example, at a predetermined time interval T1.

In step S10 of FIG. 6, the receiving unit 40 receives the object transmitted from the external device via the network I / F25. In step S12, the receiving unit 40 stores the object received in step S10 in the storage unit 22. When the process of step S12 is completed, the object reception process is completed.

In step S20 of FIG. 7, the determination unit 42 performs a process of comparing the total value TS of the object size of the object group to be processed stored in the storage unit 22 with the threshold value TH, and the total value TS is equal to or higher than the threshold value TH. Determine if it exists. If this determination is affirmative, the process proceeds to step S22.

In step S22, the generation unit 44 generates a packed object that summarizes the objects to be processed. In step S24, the control unit 46 controls to record the packed object generated in step S22 on the magnetic tape T. When step S24 ends, the object recording process ends. If the determination in step S20 is a negative determination, the object recording process ends.

With reference to FIG. 8, a specific example of the execution timing of the processing to be summarized by the object recording processing shown in FIG. 7 will be described. Here, in order to simplify the explanation, an example in which the size of one object is 5 GB and the threshold value TH is 12 GB will be described. Reference numeral t in FIG. 8 represents the timing at which the object recording process shown in FIG. 7 is executed for each time interval T1. Further, when distinguishing each timing t, a number is added at the end as in timings t1 to t3.

As shown in FIG. 8, at the first timing t1, the total value TS of the object sizes of the objects to be processed is 15 GB (= 5 GB × 3), which is equal to or higher than the threshold value TH (= 12 GB). The determination in step S20 is an affirmative determination. As a result, by the processing of step S22, a packed object that summarizes the processing target object group is generated.

At the next timing t2, the total value TS of the object sizes of the objects to be processed is 5 GB (= 5 GB × 1), which is less than the threshold value TH (= 12 GB), so that the determination in step S20 in FIG. 7 is a negative determination. It becomes. As a result, the processes of steps S22 and S24 are not executed.

At the next timing t3, the total value TS of the object sizes of the objects to be processed is 15 GB (= 5 GB × 3), which is equal to or higher than the threshold value TH (= 12 GB). Therefore, the determination in step S20 in FIG. 7 is affirmative. It becomes. As a result, by the processing of step S22, a packed object that summarizes the processing target object group is generated.

As described above, according to the present embodiment, as a result of suppressing the generation of the packed object whose size is too small and the packed object whose size is too large, the packed object can be appropriately created.

In the above embodiment, the case where the total value TS of the object size of the object group to be processed and the threshold value TH are compared has been described, but the present invention is not limited to this. For example, the number N of objects in the object group to be processed may be compared with the threshold value TH. In this case, when the number N is equal to or greater than the threshold value TH, the generation unit 44 generates a packed object that is a collection of objects to be processed.

Further, in the above embodiment, the case where the threshold value TH is set to a fixed value has been described, but the present invention is not limited to this. For example, the CPU 20 of the information processing apparatus 12 may derive the threshold value TH according to the total value of the sizes of the objects received from the external device per unit time. In this case, for example, the smaller the total value of the sizes of the objects received by the CPU 20 during the period of one predetermined time interval T1 immediately before the timing t for performing the process of comparing the total value TS and the threshold value TH, the threshold value. Set TH to a small value. As a result, as shown in FIG. 9 as an example, it is possible to suppress that the packed object is not generated for a long period of time, that is, the object group to be processed is not recorded on the magnetic tape T for a long period of time. Note that FIG. 9 also illustrates the case where the size of one object is 5 GB, as in FIG. 8.

Further, when deriving the threshold value TH, the CPU 20 may derive the threshold value TH based on the time-series data of the total value of the sizes of the objects received in the latest predetermined time interval T1. In this case, for example, the CPU 20 predicts the total value of the period of the next time interval T1 from the time series data. Specifically, for example, when the time series data of the latest three periods is 1.0 TB → 1.2 TB → 1.4 TB, the CPU 20 sets the total value of the periods of the next time interval T1 to 1.6 TB. Predict. Further, for example, when the time series data of the latest three periods is 1.0 TB → 1.2 TB → 1.0 TB, the CPU 20 predicts that the total value of the periods of the next time interval T1 is 1.2 TB. .. Then, the CPU 20 sets the threshold value TH to a smaller value as the predicted total value becomes smaller. For this prediction, for example, approximation methods such as linear approximation and non-linear approximation can be used.

Further, when the CPU 20 derives the threshold value TH, the CPU 20 has a threshold value according to the total value of the sizes of the objects received in the same past time zone as the time zone of the next time interval T1 which is the time zone for generating the packed object. TH may be derived. Examples of past time zones in this case include, for example, the same time zone of the previous day or the same time zone one week ago.

Further, when deriving the threshold value TH, the CPU 20 sets the threshold value TH according to the total value of the sizes of the objects received in the same plurality of time zones as the time zone of the next time interval T1 which is the time zone for generating the packed object. It may be derived. Examples of the past plurality of time zones in this case include the same time zone of the most recent plurality of days or the same time zone one week ago and two weeks ago.

Further, when deriving these threshold values TH, the CPU 20 may derive the threshold value TH according to the number of received objects instead of the total value of the sizes of the received objects.

Further, in the above embodiment, the case where the process of generating the packed object and the process of recording the generated packed object on the magnetic tape T are executed at the same time interval has been described, but the present invention is not limited to this. The process of generating the packed object and the process of recording the generated packed object on the magnetic tape T may be executed at different time intervals. Specifically, the time interval of the process of recording the generated packed object on the magnetic tape T is made longer than the time interval of the process of generating the packed object, and after a plurality of packed objects are generated, the plurality of packed objects are generated. An example is a mode in which an object is recorded on a magnetic tape T.

Further, in the above embodiment, for example, the hardware structure of the processing unit (processing unit) that executes various processes such as the receiving unit 40, the determination unit 42, the generating unit 44, and the control unit 46 is shown below. Various processors can be used. For the above-mentioned various processors, as described above, in addition to the CPU, which is a general-purpose processor that executes software (program) and functions as various processing units, circuits after manufacturing FPGA (Field Programmable Gate Array) and the like are used. Dedicated electricity, which is a processor with a circuit configuration specially designed to execute specific processing such as programmable logic device (PLD), ASIC (Application Specific Integrated Circuit), which is a processor whose configuration can be changed. Circuits etc. are included.

One processing unit may be composed of one of these various processors, or a combination of two or more processors of the same type or different types (for example, a combination of a plurality of FPGAs or a combination of a CPU and an FPGA). It may be composed of a combination). Further, a plurality of processing units may be configured by one processor.

As an example of configuring a plurality of processing units with one processor, first, one processor is configured by a combination of one or more CPUs and software, as represented by a computer such as a client and a server. There is a form in which the processor functions as a plurality of processing units. Second, as typified by System on Chip (SoC), there is a form that uses a processor that realizes the functions of the entire system including multiple processing units with one IC (Integrated Circuit) chip. be. As described above, the various processing units are configured by using one or more of the above-mentioned various processors as a hardware-like structure.

Further, as the hardware structure of these various processors, more specifically, an electric circuit (circuitry) in which circuit elements such as semiconductor elements are combined can be used.

Further, in the above embodiment, the embodiment in which the information processing program 30 is stored (installed) in the storage unit 22 in advance has been described, but the present invention is not limited to this. The information processing program 30 is provided in a form recorded on a recording medium such as a CD-ROM (Compact Disc Read Only Memory), a DVD-ROM (Digital Versatile Disc Read Only Memory), and a USB (Universal Serial Bus) memory. May be good. Further, the information processing program 30 may be downloaded from an external device via a network.

The disclosure of Japanese Patent Application No. 2020-147049 filed on September 1, 2020 is incorporated herein by reference in its entirety. In addition, all documents, patent applications, and technical standards described herein are to the same extent as if it were specifically and individually stated that the individual documents, patent applications, and technical standards were incorporated by reference. Is incorporated herein by reference.

Claims

It is an information processing device that has at least one processor and controls to record a group of objects together on a magnetic tape.
The processor
Periodically, the process of comparing the total value of the number or size of the objects in the process target object group for which the process of summarizing has not been executed with the threshold value is performed.
An information processing device that generates a packed object that is a collection of the objects to be processed when the number or the total value is equal to or greater than the threshold value.
The processor
The information processing device according to claim 1, wherein the threshold value is derived according to the total value of the number or size of objects received from an external device per unit time.
The processor
The threshold value is set according to the number or the total value of one or more of the most recent predetermined periods in which the comparison process is performed, or one or more time zones in the past that are the same as the time zone in which the packed object is generated. The information processing apparatus according to claim 2 to be derived.
The processor
The information processing device according to claim 3, wherein the threshold value is derived based on time-series data of the total value of the number or size of objects received from the external device.
The processor
The information processing apparatus according to any one of claims 1 to 4, wherein the generated packed object is controlled to be recorded on a magnetic tape.
It is an information processing method executed by the processor provided in the information processing device that controls the recording of objects collectively on magnetic tape.
Periodically, the process of comparing the total value of the number or size of the objects in the process target object group for which the process of summarizing has not been executed with the threshold value is performed.
An information processing method for generating a packed object that is a collection of the objects to be processed when the number or the total value is equal to or greater than the threshold value.
It is an information processing program to be executed by the processor of the information processing device that controls the recording of objects together on magnetic tape.
Periodically, the process of comparing the total value of the number or size of the objects in the process target object group for which the process of summarizing has not been executed with the threshold value is performed.
An information processing program that generates a packed object that is a collection of the objects to be processed when the number or the total value is equal to or greater than the threshold value.