JP2021043542A - Data management system and data management method - Google Patents

Abstract

To suppress a cost required for a storage outside of a network when moving a part of data stored in a storage in the network to a storage outside of the network.SOLUTION: An internal storage device 100 is located in a local network 400, and a first external storage device 300 device is located outside of the local network 400. A gateway 200 is provided to the local network 400. The internal storage device 100 stores data having access conditions satisfying a reference among stored data to the first external storage device 300 and further deletes them from the internal storage device 100. The internal storage device 100 is a file storage and the first external storage device 300 is an object storage. The gateway 200 transforms data stored in the internal storage device 100 to an object and transmits it to the first external storage device 300.SELECTED DRAWING: Figure 1

Description

The present invention relates to a data management system and a data management method.

A system is used in which the storage and the terminal are connected by a network and the data used by the terminal is stored in the storage. In such a system, the data stored in the storage increases with time, so some measures are required.

For example, Patent Document 1 describes that a data group that is accessed infrequently is stored in a backup database and restored to the restoration database only when necessary. The backup database is, for example, a magnetic tape that can be increased in quantity at low cost.

Further, in Patent Document 2, a high-speed but expensive first storage device and a low-speed but inexpensive second storage device are prepared, and data is stored in the first storage device and the second storage device based on a predetermined policy. It is described that it is distributed to the storage device. For example, when the amount of data stored in the first storage device reaches the upper limit, the data of the first storage device that is infrequently accessed is moved to the second storage device.

Further, in Patent Document 3, archive storage is prepared in the local area network and cloud storage is prepared on the external network, and the specified data is archived according to the policy set by the user or the system administrator. It is stated to archive to storage or cloud storage.

Japanese Unexamined Patent Publication No. 2010-044571 International Publication No. 2014/136263 International Publication No. 2018/011914

In order to effectively utilize the storage in the network, it is conceivable to move a part of the data stored in this storage to the storage outside the network. However, as described above, since the information in the network increases with time, the capacity required for storage outside the network also increases with time. In this case, the cost required for storage outside the network also increases over time.

An object of the present invention is to reduce the cost required for storage outside the network when a part of the data stored in the storage in the network is moved to the storage outside the network.

According to the present invention, an internal storage device located in a network and storing a plurality of data,
A first external storage device located outside the network,
A gateway provided in the network and connecting the internal storage device and the first external storage device,
Data management means and
With
The data management means stores the data satisfying the criteria in the first external storage device and deletes the data from the internal storage device.
The internal storage device is a file storage.
The first external storage device is object storage.
The gateway provides a data management system that converts the data stored in the internal storage device into an object and transmits the data to the first external storage device.

According to the present invention, an internal storage device located in a network and storing a plurality of data,
A first external storage device located outside the network,
A gateway located in the network and connecting the internal storage device and the first external storage device,
Data management means and
Is a data management method in a data management system in which the internal storage device is a file storage and the first external storage device is an object storage.
The data management means stores the data satisfying the criteria in the first external storage device and deletes the data from the internal storage device.
A data management method is provided in which the gateway converts the data stored in the internal storage device into an object and transmits the data to the first external storage device.

According to the present invention, when a part of the data stored in the storage in the network is moved to the storage outside the network, the cost required for the storage outside the network can be suppressed.

It is a figure which shows the structure of the data management system 10 which concerns on 1st Embodiment. It is a figure which shows an example of the data structure of the data storage part 110. It is a block diagram which illustrates the hardware composition of the internal storage device 100. It is a flowchart which shows an example of the processing performed by the data management unit 120 of the internal storage device 100. It is a figure which shows the structure of the data management system 10 which concerns on 2nd Embodiment.

Hereinafter, embodiments of the present invention will be described with reference to the drawings. In all drawings, similar components are designated by the same reference numerals, and description thereof will be omitted as appropriate.

<First Embodiment>
FIG. 1 is a diagram showing a configuration of a data management system 10 according to the first embodiment. The data management system 10 includes an internal storage device 100, a data management unit 120, a gateway 200, and a first external storage device 300. The internal storage device 100 is located in the local network 400 and stores a plurality of data. The local network 400 is, for example, a network provided for each base of an organization (for example, a company). The first external storage device 300 is located outside the local network 400. In the example shown in this figure, the first external storage device 300 is connected to the local network 400 via the external network 20. The external network 20 is a WAN (Wide Area Network) such as the Internet.

In the example shown in this figure, only one internal storage device 100 is shown in the local network 400, but a plurality of internal storage devices 100 may be provided in the local network 400. In this case, the data management unit 120 manages the data (for example, a file) stored in the plurality of internal storage devices 100. Further, a plurality of first external storage devices 300 may be provided. For example, the first external storage device 300 may be provided for each local network 400.

The gateway 200 is provided in the local network 400 and connects the internal storage device 100 to the external network 20. In other words, the external network 20 connects the internal storage device 100 and the data management unit 120 to the first external storage device 300. Then, the data management unit 120 stores the data satisfying the reference among the data stored in the internal storage device 100 in the first external storage device 300 and deletes the data from the internal storage device 100. The internal storage device 100 is a file storage, and the first external storage device 300 is an object storage. Therefore, the gateway 200 converts the data stored in the internal storage device 100 into an object and transmits the data to the first external storage device 300. Further, the gateway 200 temporarily stores the data transmitted to the first external storage device 300. In other words, the first external storage device 300 also functions as a cache. The data management unit 120 is provided in hardware different from the internal storage device 100 and the gateway 200. Hereinafter, the data management system 10 will be described in detail.

The data management system 10 has an internal storage device 100 and a gateway 200 for each of the plurality of local networks 400. Each of the local networks 400 is provided at different locations (for example, different bases in one company). The gateway 200 connects the local network 400 to the external network 20.

In addition to the internal storage device 100 and the gateway 200, a plurality of terminals (not shown) are connected to the local network 400. These plurality of terminals may be fixed terminals or mobile terminals. The terminal accesses and uses the data stored in the internal storage device 100. The internal storage device 100 stores the access status to the data, for example, the latest access date and time for each data.

The internal storage device 100 is a file server as described above. The internal storage device 100 stores the data used by the terminal described above in a directory structure using folders. Further, the internal storage device 100 stores the above-mentioned data in association with the access status (for example, access history). In addition, the internal storage device 100 updates the access status of each data.

The data management unit 120 manages the data stored in the internal storage device 100. For example, the data management unit 120 moves the data stored in the internal storage device 100 to the gateway 200 as needed. The gateway 200 converts this data into object data and stores it in the first external storage device 300. Details of the processing performed by the data management unit 120 will be described later using a flowchart. Here, when the data management unit 120 manages a plurality of internal storage devices 100, the data management unit 120 uses a reference (policy) for moving data to the first external storage device 300 for each of the plurality of internal storage devices 100. ) May be memorized.

Further, when the data is moved to the gateway 200, the data management unit 120 has a shortcut for accessing the data stored in the first external storage device 300 in the folder in which the data is stored via the gateway 200. To create. This shortcut is associated with the metadata for reading the data stored in the first external storage device 300. Therefore, when the user selects this folder, a shortcut for accessing the data stored in the first external storage device 300 is displayed on the screen of the terminal. Then, by selecting this shortcut, the user can read the data stored in the first external storage device 300 to the terminal.

FIG. 2 is a diagram showing an example of the data structure of the internal storage device 100. In the example shown in this figure, the internal storage device 100 stores the data in association with the information indicating the folder in which the data is stored and the access history of the data. The access history includes at least the latest access date and time to the data. However, the access history may further store the past access date and time. Further, the internal storage device 100 may store the data in association with the creator (user) of the data.

FIG. 3 is a block diagram illustrating a hardware configuration of a device that functions as a data management unit 120. The internal storage device 100 includes a bus 1010, a processor 1020, a memory 1030, a storage device 1040, an input / output interface 1050, and a network interface 1060.

The bus 1010 is a data transmission line for the processor 1020, the memory 1030, the storage device 1040, the input / output interface 1050, and the network interface 1060 to transmit and receive data to and from each other. However, the method of connecting the processors 1020 and the like to each other is not limited to the bus connection.

The processor 1020 is a processor realized by a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), or the like.

The memory 1030 is a main storage device realized by a RAM (Random Access Memory) or the like.

The storage device 1040 is a storage device realized by an HDD (Hard Disk Drive), an SSD (Solid State Drive), a memory card, a ROM (Read Only Memory), or the like. The storage device 1040 stores a program module that realizes the data management unit 120. When the processor 1020 reads each of these program modules into the memory 1030 and executes them, each function corresponding to the program module is realized.

The input / output interface 1050 is an interface for connecting the internal storage device 100 and various input / output devices.

The network interface 1060 is an interface for connecting the internal storage device 100 to a network or another device (for example, a gateway 200).

FIG. 4 is a flowchart showing an example of processing performed by the data management unit 120. This flowchart shows a process when the data management unit 120 moves the data stored in the internal storage device 100 to the first external storage device 300. The data management unit 120 performs the processing shown in this figure at regular intervals, for example.

First, the data management unit 120 selects one of the data stored in the internal storage device 100 and reads out the access history of the selected data (step S102). Then, the data management unit 120 determines whether or not the read access history satisfies the reference (step S104). The criteria are, for example, no access to the data for a predetermined period (for example, one year), or no update of the data for a predetermined period, but are not limited to this. Then, when this criterion is satisfied (step S104: Yes), this data is transmitted to the gateway 200 in order to be stored in the first external storage device 300 which is the object storage (step S106).

After transmitting the data to the gateway 200, the data management unit 120 deletes the transmitted data from the internal storage device 100. Further, the data management unit 120 generates a shortcut for accessing the data stored in the gateway 200, and saves this shortcut in the internal storage device 100 instead of the deleted data (step S108).

On the other hand, when the gateway 200 receives the data, it converts the data into an object and transmits it to the first external storage device 300, and also stores the shortcut stored in the internal storage device 100 and the first external storage device 300. Link with data. (Step S110).

The data management unit 120 performs the processing shown in steps S104 to S110 on the target data among the data stored in the internal storage device 100 (step S112).

In the example shown in this figure, the access status to the data is used as a reference (policy) when the data stored in the internal storage device 100 is moved to the first external storage device 300. However, this standard is not limited to access status.

For example, in the internal storage device 100, data may be stored in association with a user of the data. In this case, the reference may be set so that a part of the user's data is moved to the first external storage device 300 for the user whose total value of the data capacity exceeds the reference.

Further, a reference may be set so as to move data having a certain capacity or more to the first external storage device 300. Further, when a plurality of data having the same name and capacity exist, one of the plurality of data is left in the internal storage device 100, and the other data is moved to the first external storage device 300. It may be set.

As described above, according to the present embodiment, among the data stored in the internal storage device 100, the data whose access history satisfies the reference is moved to the first external storage device 300. Here, the first external storage device 300 is an inexpensive object storage. Therefore, the cost required for the first external storage device 300 is lower than that when the file storage is used as the first external storage device 300. Further, the data stored in the first external storage device 300 increases with time, but even if it becomes necessary to increase the storage capacity of the first external storage device 300, the cost required for the increase becomes low.

<Second Embodiment>
FIG. 5 is a diagram showing a configuration of a data management system 10 according to the second embodiment. The data management system 10 shown in this figure has the same configuration as the data management system 10 according to the first embodiment, except that it has a second external storage device 310.

The second external storage device 310 is a file storage, and is provided for backing up the data stored in the internal storage device 100. In other words, the data management unit 120 stores the data that does not satisfy the criteria shown in step S104 of FIG. 4 in the second external storage device 310. As a result, the second external storage device 310 stores the same data as the internal storage device 100. Therefore, when certain data is deleted from the internal storage device 100, the data is also deleted from the second external storage device 310.

According to this embodiment, the same effect as that of the first embodiment can be obtained. Further, since the second external storage device 310 is provided, it is possible to secure a backup of the data stored in the internal storage device 100.

Although the embodiments of the present invention have been described above with reference to the drawings, these are examples of the present invention, and various configurations other than the above can be adopted.

Further, in the plurality of flowcharts used in the above description, a plurality of steps (processes) are described in order, but the execution order of the steps executed in each embodiment is not limited to the order of description. In each embodiment, the order of the illustrated steps can be changed within a range that does not hinder the contents. In addition, the above-described embodiments can be combined as long as the contents do not conflict with each other.

Some or all of the above embodiments may also be described, but not limited to:
1. 1. An internal storage device that is located in the network and stores multiple data,
A first external storage device located outside the network,
A gateway provided in the network and connecting the internal storage device and the first external storage device,
Data management means and
With
The data management means stores the data satisfying the criteria in the first external storage device and deletes the data from the internal storage device.
The internal storage device is a file storage.
The first external storage device is object storage.
The gateway is a data management system that converts the data stored in the internal storage device into an object and transmits the data to the first external storage device.
2. In the data management system described in 1 above,
When the data is stored in the first external storage device, the data management means stores the data in the folder in which the data is located in the internal storage device and stores the data in the first external storage device. A data management system that stores metadata for reading data.
3. 3. In the data management system described in 1 or 2 above,
Further, it is located outside the network and is provided with a second external storage device which is a file storage.
The data management means is a data management system that stores the data that does not meet the criteria in the second external storage device and maintains the state in which the data is stored in the internal storage device.
4. An internal storage device that is located in the network and stores multiple data,
A first external storage device located outside the network,
A gateway located in the network and connecting the internal storage device and the first external storage device,
Data management means and
Is a data management method in a data management system in which the internal storage device is a file storage and the first external storage device is an object storage.
The data management means stores the data satisfying the criteria in the first external storage device and deletes the data from the internal storage device.
5. A data management method in which the gateway converts the data stored in the internal storage device into an object and transmits the data to the first external storage device. In the data management method described in 4 above,
When the data is stored in the first external storage device, the data management means stores the data in the folder in which the data is located in the internal storage device and stores the data in the first external storage device. A data management method that stores metadata for reading data.
6. In the data management method described in 4 or 5 above,
The data management system is further located outside the network and includes a second external storage device which is a file storage.
The data management means is a data management method for storing the data that does not satisfy the criteria in the second external storage device and maintaining the state in which the data is stored in the internal storage device.

10 Data management system 20 External network 100 Internal storage device 102 Data storage unit 120 Data management unit 200 Gateway 300 First external storage device 310 Second external storage device 400 Local network

Claims (4)

An internal storage device that is located in the network and stores multiple data,
A first external storage device located outside the network,
A gateway provided in the network and connecting the internal storage device and the first external storage device,
Data management means and
With
The data management means stores the data satisfying the criteria in the first external storage device and deletes the data from the internal storage device.
The internal storage device is a file storage.
The first external storage device is object storage.
The gateway is a data management system that converts the data stored in the internal storage device into an object and transmits the data to the first external storage device. In the data management system according to claim 1,
When the data is stored in the first external storage device, the data management means stores the data in the folder in which the data is located in the internal storage device and stores the data in the first external storage device. A data management system that stores metadata for reading data. In the data management system according to claim 1 or 2.
Further, it is located outside the network and is provided with a second external storage device which is a file storage.
The data management means is a data management system that stores the data that does not meet the criteria in the second external storage device and maintains the state in which the data is stored in the internal storage device. An internal storage device that is located in the network and stores multiple data,
A first external storage device located outside the network,
A gateway located in the network and connecting the internal storage device and the first external storage device,
Data management means and
Is a data management method in a data management system in which the internal storage device is a file storage and the first external storage device is an object storage.
The data management means stores the data satisfying the criteria in the first external storage device and deletes the data from the internal storage device.
A data management method in which the gateway converts the data stored in the internal storage device into an object and transmits the data to the first external storage device.

Images