JP2009245004A - Bidirectional data arrangement system, access analysis server, data movement server, bidirectional data arrangement method and program - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a bidirectional data arrangement system allowing data movement processing allowing suppression of data access speed reduction, in a low-cost storage system wherein a low-cost storage and a high-cost storage are combined. <P>SOLUTION: In this bidirectional data arrangement system 1, an access analysis server 10 acquires a packet of communication between a client terminal 50 and an AP server 40, and writes access information according to an access frequency of each piece of data stored by a primary storage 41 and a secondary storage 42 into a database device 20 based on the acquired packet, and a data movement server 30 reads the access information stored in the database device 20, decides a movement destination of the data based on a decision condition of a setting file 33γ of a storage part 33, and bidirectionally moves the data between the primary storage 41 and the secondary storage 42. <P>COPYRIGHT: (C)2010,JPO&INPIT

Description

  The present invention relates to a bidirectional data arrangement system, an access analysis server, a data movement server, a bidirectional data arrangement method, and a program for moving data stored in a plurality of different types of storage apparatuses.

In recent years, with the digitization of information, the storage system field has attracted attention. In this storage system, some NAS (Network Attached Storage) using inexpensive consumer storage can be easily added, but it is difficult to transfer performance because it is accessed via a network. On the other hand, there is a storage such as DAS (Direct Attached Storage) that is directly connected to the server and is suitable for high-speed reading and writing. However, it is generally expensive and difficult to add capacity, which makes it difficult to expand.
There is also a product that forms a hierarchical storage by combining a highly reliable and expensive storage (primary) and a low reliability and inexpensive storage (secondary). Furthermore, as disclosed in Patent Document 1, there is a technique for rearranging data in a primary storage and a secondary storage based on a data life cycle and a data type.
JP 2004-295457 A

However, since the product combining the primary storage and the secondary storage described above is intended for data archiving, it is assumed that data is unidirectionally transferred from the primary storage to the secondary storage. Therefore, once the data is moved to the secondary storage, there is no mechanism for returning it to the primary side again. In addition, since the access speed to the secondary storage is slow, there is a problem that the overall data access speed is lowered if the data on the secondary side is frequently read and written.
In addition, the data rearrangement technique disclosed in Patent Document 1 is defined as an update period from the file generation period to one month and a reference period from one month later, and a file worth the reference period is a file I / O. Since data is moved to a disk with high efficiency and a unified life cycle is applied to all data, there is a problem that appropriate data relocation cannot be performed.

  The present invention has been made to solve the above problems in consideration of such circumstances, and its purpose is to reduce the data access speed in a low-cost storage system that combines inexpensive storage and expensive storage. It is an object to provide a bidirectional data arrangement system, a data movement server, an access analysis server, a bidirectional data arrangement method, and a program that can perform data movement processing that can suppress data.

  In order to solve the above problem, the present invention provides a client terminal that transmits a packet including an access request signal for data stored in either the primary storage device or the secondary storage device, and an access request signal from the client terminal. A server that responds (for example, the AP server 40 in the embodiment), a primary storage device that connects to the server and stores data in a first storage area (for example, the directory A in the embodiment), and a different type of primary storage device A secondary storage device that stores data in a second storage area (for example, directory B in the embodiment), an access analysis server, and an access analysis information storage device that stores access analysis information (for example, the embodiment) The database device 20) and the data movement server A bidirectional data placement system connected via a work, wherein a primary storage device is virtually connected to a second storage area included in a secondary storage device (for example, NFS connection in the embodiment), and the first Access target data received from the client terminal by the server, including a first virtual storage area (for example, the directory B41 in the embodiment) of the second storage area that enables execution of read processing and write processing of data in the two storage areas Identification information (for example, a combination of file name information and absolute path information in the embodiment) and first position information (for example, current data position information in the embodiment) that is current position information of the data. Based on the request signal, access to the first storage area or the first virtual storage area of the primary storage device A packet analysis unit that executes processing based on the access request for the data of the elephant, transmits a response signal of the processing result to the client terminal, and the access analysis server acquires a packet in communication between the client terminal and the server; Based on the packet identification information and the first location information acquired by the packet analysis unit, access information corresponding to the number of accesses for each data stored in the primary storage device or the secondary storage device (for example, the total in the embodiment) A time-series log analysis unit that writes the read number information, the read number information from the moving date, the total written number information, and the written number information from the moving date) to the access analysis information storage device. First location information and access for each data identification information stored in the primary storage device or the secondary storage device A table of access analysis information (for example, the access analysis table 22 in the embodiment) in which the information is associated with the second position information (for example, the optimum data position information in the embodiment) that is the position information of the movement destination of the data. A second virtual storage area (for example, an embodiment) in which the storage and data migration server is virtually connected to the first storage area of the primary storage device and executes data read processing and write processing of the first storage area. And the third virtual storage of the second storage area that is virtually connected to the second storage area of the secondary storage device and that can execute the data read process and the write process of the second storage area. An area (for example, the directory B33 in the embodiment) and determining a data movement destination based on the value of the access information A storage unit that stores data location determination condition information (for example, the setting file 33γ in the embodiment), and access analysis information stored in the access analysis information storage device is read for each piece of data identification information, and access of the read access analysis information is accessed. If the value of the information is greater than or equal to the value of the data location determination condition information stored in the storage unit, the data movement destination is determined to be the primary storage device, and if the access information value is less than the value of the data location determination condition information, the data movement A data location determination unit that determines the destination as the secondary storage device and writes the determination result to the access analysis information storage device as new second location information of the access analysis information, and access analysis information stored in the access analysis information storage device And the first location information and the second location information for each identification information in the read access analysis information. Access analysis information different from the information is detected, based on the first position information of the detected access analysis information, data corresponding to the access analysis information is read from the storage unit, and the read data is read as the second position of the access analysis information. A bidirectional data arrangement system comprising a data moving unit that moves in a storage unit based on information.

  The bidirectional data arrangement system of the present invention is characterized in that the time series log analysis unit reduces the value per access as access information for an access with an old access date and time compared to an access with a new access date and time. And

  In the bidirectional data arrangement system of the present invention, the first location information of the access analysis information detected by the data moving unit indicates the first storage area of the primary storage device, and the second location information is the first location information of the secondary storage device. In the case of indicating two storage areas, the data moving unit writes a symbolic link to the moved data in the third virtual storage area corresponding to the second position information in the second virtual storage area after the movement processing of the data to be moved, When the first location information of the access analysis information detected by the data moving unit indicates the second storage area of the secondary storage device and the second location information indicates the first storage region of the primary storage device, the data moving unit After the movement processing of the data to be moved, a symbolic link for the data before movement in the third virtual storage area corresponding to the first position information is stored in the second virtual storage. Characterized in that it removed from the range.

  The present invention also relates to a client terminal that transmits a packet including an access request signal for data stored in either the primary storage apparatus or the secondary storage apparatus, a server that responds to the access request signal from the client terminal, and a server A primary storage device that stores data in the first storage area, a storage device of a different type from the primary storage device, a secondary storage device that stores data in the second storage area, a client terminal, and a server According to the number of accesses for each data stored in the primary storage device or the secondary storage device, based on the identification information of the access target data included in the packet in the communication between and the current location information of the access target data An access analysis server for writing access information to an access analysis information storage device; For each piece of data identification information stored in the primary storage apparatus or the secondary storage apparatus, first position information indicating the current position information of the data, access information, and second information indicating the position information of the movement destination of the data A data movement server in a bidirectional data arrangement system in which an access analysis information storage device that stores access analysis information including access analysis information associated with position information and a data movement server are respectively connected via a network. A second virtual storage area that is virtually connected to the first storage area of the primary storage apparatus and that executes data read processing and write processing of the first storage area, and a second storage area provided in the secondary storage apparatus The second memory is virtually connected to the second storage area and can execute data read processing and data write processing in the second storage area. A third virtual storage area, a storage unit for storing data position determination condition information for determining a data movement destination based on a value of access information, and an access analysis information storage device for each piece of data identification information Access analysis information is read, and if the access information value of the read access analysis information is equal to or greater than the value of the data location determination condition information stored in the storage unit, the data movement destination is determined as the primary storage device, and the access information value is If the value of the data location determination condition information is not satisfied, the data movement destination is determined to be the secondary storage device, and the determination result is written to the access analysis information storage device as the new second location information of the access analysis information. And the access analysis information stored in the access analysis information storage device, and in the read access analysis information Access analysis information in which the first position information and the second position information are different for each information is detected, and data corresponding to the access analysis information is read from the storage unit based on the first position information of the detected access analysis information and read. And a data moving unit that moves the data in the storage unit based on the second position information of the access analysis information.

  The present invention also relates to a client terminal that transmits a packet including an access request signal for data stored in either the primary storage apparatus or the secondary storage apparatus, a server that responds to the access request signal from the client terminal, and a server A primary storage device that stores data in the first storage area, a storage device of a different type from the primary storage device, a secondary storage device that stores data in the second storage area, an access analysis server, An access analysis server in a bidirectional data arrangement system in which an access analysis information storage device for storing access analysis information and a data movement server are connected to each other via a network, and access in communication between a client terminal and the server Identification information of the target data and the current position of the data The primary storage device or the secondary storage device stores the packet analysis unit that acquires the packet including the first location information that is information, the packet identification information acquired by the packet analysis unit, and the first location information. An access analysis server comprising: a time-series log analysis unit that writes access information for each data in an access analysis information storage device.

  The present invention also relates to a client terminal that transmits a packet including an access request signal for data stored in either the primary storage apparatus or the secondary storage apparatus, a server that responds to the access request signal from the client terminal, and a server A primary storage device that stores data in the first storage area, a storage device of a different type from the primary storage device, a secondary storage device that stores data in the second storage area, an access analysis server, An interactive data allocation method in an interactive data allocation system in which an access analysis information storage device for storing access analysis information and a data movement server are connected via a network, wherein the primary storage device is a secondary storage device Is virtually connected to the second storage area included in the The first virtual storage area of the second storage area that can execute the data read process and write process, and the server receives the identification information of the access target data received from the client terminal, and the current position information of the data Based on the access request signal including the first location information, the processing based on the access request is executed for the data to be accessed in the first storage area or the first virtual storage area of the primary storage device, and the processing result The response analysis signal is transmitted to the client terminal, the access analysis server acquires a packet in communication between the client terminal and the server, and based on the packet identification information and the first position information acquired by the packet analysis process, Access information corresponding to the number of accesses for each data stored in the primary storage device or secondary storage device is stored. For each piece of data identification information stored in the primary storage device or the secondary storage device, the first location information, the access information, and the destination of movement of the data. A table of access analysis information associated with the second position information as the position information is stored, and the data migration server is virtually connected to the first storage area of the primary storage device, and the data of the data in the first storage area is stored. It is virtually connected to the second virtual storage area that executes the read process and the write process and the second storage area included in the secondary storage device, and the data read process and the write process of the second storage area can be executed. Data position determination condition information for determining a data movement destination based on the value of the access information. For each piece of data identification information, the access analysis information stored in the access analysis information storage device is read. If the value of the read access analysis information is equal to or greater than the value of the data location determination condition information, the data movement destination When it is determined as a storage device and the value of the access information is less than the value of the data location determination condition information, the data movement destination is determined as the secondary storage device, and the determination result is used as the new second location information of the access analysis information. The access analysis information stored in the access analysis information storage device is read out, and the access analysis information stored in the access analysis information storage device is read out. In the read access analysis information, access analysis information in which the first location information and the second location information differ for each identification information. Based on the first position information of the detected access analysis information, the data corresponding to the access analysis information is detected. Reading the data, the second virtual storage area based on the read data to the second location information of the access analysis information or a two-way data arrangement wherein the moving in the third virtual storage area.

  The present invention also relates to a client terminal that transmits a packet including an access request signal for data stored in either the primary storage apparatus or the secondary storage apparatus, a server that responds to the access request signal from the client terminal, and a server A primary storage device that stores data in the first storage area, a storage device of a different type from the primary storage device, a secondary storage device that stores data in the second storage area, an access analysis server, In a bidirectional data arrangement system in which an access analysis information storage device for storing access analysis information and a data migration server are connected via a network, a second storage area provided in the secondary storage device in the computer of the primary storage device The data in the second storage area is virtually read A process of providing a first virtual storage area of a second storage area capable of executing processing and write processing, identification information of access target data received from a client terminal in a server computer, and current position information of the data Based on the access request signal including the first location information, the processing based on the access request is executed for the data to be accessed in the first storage area or the first virtual storage area of the primary storage device, and the processing result A response signal to the client terminal, a packet analysis process for acquiring a packet in communication between the client terminal and the server to the computer of the access analysis server, and packet identification information acquired by the packet analysis process, Based on the first location information, the primary storage device or the secondary storage device stores Time series log analysis process for writing access information according to the number of accesses for each data in the access analysis information storage device, and identification information of data stored in the primary storage device or secondary storage device in the computer of the access analysis information storage device A process of storing a table of access analysis information in which the first position information, the access information, and the second position information, which is the position information of the movement destination of the data, are associated with each other; A second virtual storage area that is virtually connected to the first storage area of the primary storage device and executes data read processing and write processing of the first storage area, and a second storage area provided in the secondary storage device A second storage area that is virtually connected and that is capable of executing read processing and write processing of data in the second storage area A third virtual storage area, a storage process for storing data location determination condition information for determining a data destination based on the value of access information, and an access analysis information storage device for each piece of data identification information When the access analysis information stored in is read and the access information value of the read access analysis information is equal to or greater than the value of the data location determination condition information, the data migration destination is determined as the primary storage device, and the access information value is determined as the data location When the value of the condition information is not satisfied, the data movement destination is determined as the secondary storage device, and the determination result is written in the access analysis information storage device as new second position information of the access analysis information; The access analysis information stored in the access analysis information storage device is read, and in the read access analysis information, the identification information And detecting access analysis information in which the first location information and the second location information are different, reading data corresponding to the access analysis information based on the first location information of the detected access analysis information, and reading the read data to the access A program for executing a data movement process of moving in the second virtual storage area or the third virtual storage area based on the second position information of the analysis information.

According to the present invention, in the bidirectional data arrangement system, the access analysis server acquires a packet for communication between the client terminal and the server, and the data stored in the primary storage device and the secondary storage device based on the acquired packet The access information corresponding to the number of accesses is written to the access analysis information storage device, and the data movement server reads the access information stored in the access analysis information storage device and determines the data movement destination based on the value of the access information. The data movement destination is determined based on the data position determination condition information, and the data is moved bidirectionally between the primary storage apparatus and the secondary storage apparatus.
As a result, in a bidirectional data placement system that combines different types of storage devices, the data movement server moves the data with a lower access count to the secondary storage device based on the access information corresponding to the access count for each data, and accesses it. By moving frequently-used data to the primary storage, it is possible to suppress a decrease in data access speed and to move data between storage devices.

Further, according to the present invention, in the bi-directional data arrangement system, the time series log analysis unit reduces the value per access for the access with the old access date and time as the access information compared to the access with the new access date and time. It was decided to.
Thus, by reducing the value of the number of accesses with an old access date and time, the value for one access becomes smaller for older accesses, and the value of the access information is relatively smaller than the number of accesses with an access with an older date and time. Since the date and time is a value that gives a weight to the number of accesses by new access, there is an effect that data movement according to the access status can be performed.

According to the present invention, the first location information of the access analysis information detected by the data moving unit indicates the first storage area of the primary storage device, and the second location information indicates the second storage area of the secondary storage device. In the case of showing, the data moving unit writes a symbolic link to the moved data in the third virtual storage area corresponding to the second position information in the second virtual storage area after the movement processing of the data to be moved, and the data moving unit When the first location information of the detected access analysis information indicates the second storage area of the secondary storage device and the second location information indicates the first storage region of the primary storage device, the data moving unit displays the data to be moved After the moving process, the symbolic link for the data before the movement in the third virtual storage area corresponding to the first position information is deleted from the second virtual storage area. And the.
Thereby, even when the position of the data to be accessed is moved, the client terminal can transmit an access request signal to the server without inquiring of the server for information on the position of the data. effective.

  Hereinafter, a bidirectional data arrangement system 1 according to an embodiment of the present invention will be described with reference to the drawings. FIG. 1 is a schematic configuration diagram showing a bidirectional data arrangement system 1 according to the present embodiment. The bidirectional data placement system 1 is connected to an AP server 40 as an application (AP) server device that transmits a response signal to a request signal from a client terminal 50 connected via the network 100, and the AP server 40. A primary storage 41, a database device 20, an access analysis server 10 connected to the database device 20, a data movement server 30 connected to the database device 20, and a secondary storage 42 are provided.

The network 100 includes, for example, a public network such as a telephone network or the Internet, or a private network such as a LAN (Local Area Network).
The primary storage 41 connected to the AP server 40 is a storage device having a storage area that can handle high-speed processing of read requests and write requests from the AP server 40. Upon receiving a new data write request from the client terminal 50, the AP server 40 writes new data into the primary storage 41. Further, the primary storage 41 includes a directory A as a storage area of the own device and a directory B41 for transparently accessing the storage area of the secondary storage 42 by NFS (Network File System) connection.

The secondary storage 42 is a storage device that is relatively cheaper than the primary storage 41 and has a low access speed. The secondary storage 42 is connected to the network 100 by, for example, a NAS connection format, and includes a directory B as a storage area of the own device.
The AP server 40 reads, writes, erases data stored in the directory B of the secondary storage 42 via the directory A of the primary storage 41 or the directory B 41 based on a request signal from the client terminal 50. Execute the process.

The access analysis server 10 includes a packet analysis unit 11, a time series log analysis unit 12, and a file content analysis unit 13. The access analysis server 10 acquires a packet communicated between the client terminal 50 and the AP server 40, and the database device 20 The acquired packet information is written in.
In the access analysis server 10, the packet analysis unit 11 acquires a packet between the client terminal 50 and the AP server 40 and writes it as a packet log in the database device 20. The time-series log analysis unit 12 bundles the information of the packets written by the packet analysis unit 11 at predetermined intervals for each data (file) to be accessed. The file content analysis unit 13 reads file information stored in the directory A or the directory B via the data movement server 30 and writes the read file information to the database device 20.

  The database device 20 includes a capture table 21 that stores packet information and an access analysis table 22 that stores access analysis information for each file. FIG. 2 is a schematic diagram illustrating a data configuration of the capture table 21 and a data example. As shown in the figure, the packet information of the capture table 21 includes items of first management ID information, packet acquisition date / time information, file name information, absolute path information, access source IP information, and access type information that are unique in the order of packet acquisition. Have columns.

  The main search key of the capture table 21 is a file name. Further, each row of the capture table 21 exists for each packet between the client terminal 50 and the AP server 40, and the information of the packet of one row in the capture table 21 will be described as one access record. The first management ID information is an identification number that is unique in the packet acquisition order.

  The file name information is the file name of the file to be accessed. The absolute path information is absolute path information of a directory in which a file to be accessed exists. The access source IP information is IP address information of the access source, for example, the client terminal 50. The access type information is process type information indicating whether the process for the file to be accessed is a read process or a write process.

  FIG. 3 is a schematic diagram illustrating a data configuration of the access analysis table 22 and data examples. As shown in the figure, the access analysis information in the access analysis table 22 includes second management ID information, last access date information, record last update date information, record creation date information, data movement date information, file name that is unique for each file. Information, absolute path information, current data position information, optimum data position information, file size information, total read number information, read number information from the move date, total write number information, write number information from the move date Have columns.

  The main search key of the access analysis table 22 is a file name and an absolute path. Each row of the access analysis table 22 exists for each file for each combination of file name and absolute path, and one row of access analysis information in the access analysis table 22 will be described as one access analysis record.

  The last access date / time information is the latest date / time information among the packet acquisition date / time information in accessing the file. The record last update date / time information is date / time information when the information is updated. When any one of the items of the own record is updated, the record last update date / time information is also updated. The record creation date / time information is the creation date / time information of the own record. The data position movement date and time information is information on the date and time when the file indicated by the own record has been moved to the currently stored storage device.

  The current data position information is information indicating in which of the primary storage 41 and the secondary storage 42 the file indicated by its own record exists. The optimum data position information is information indicating a storage apparatus that is more suitable as the data position of the file indicated by the own record in the bidirectional data arrangement system 1 from the viewpoint of access performance. The file size information is information on the file size (data amount) of the file of its own record.

The total read number information is a value corresponding to the number of times the file has been read from the generation date and time of its own record, and is a value obtained by adding a process with a new access date and time to a large value with respect to a process with an old access date and time. . The read number information from the moving date is the number of readings since the file of the own record moved to the current position.
The total write number information is a value corresponding to the number of times the file has been written from the generation date and time of its own record. is there. The writing number information from the moving date is the number of writings since the file of the own record has moved to the current position.

  Returning to FIG. 1, the data movement server 30 includes a data position determination unit 31, a data movement unit 32, and a storage unit 33. Based on the access analysis information stored in the access analysis table 22 of the database device 20, the data movement server 30 The optimum data position of the file is determined for each period, and the data position of the file is moved based on the determination result.

  The storage unit 33 of the data movement server 30 stores the setting file 33γ in advance in a storage area provided in itself, and a directory A33 for transparently accessing the directory A of the primary storage 41 by NFS connection. A directory B33 for transparently accessing the directory B of the secondary storage 42. The setting file 33γ is threshold data for determining an optimum data position, which is a determination condition for determining a suitable data position. The determination condition of the setting file 33γ is a condition based on information of each item of the access analysis table 22. Here, as an example of the conditions included in the setting file 33γ, the determination condition “the number of reads from the moving date of the access analysis table 22 or the number of writing from the moving date is 11 or more at the time of determination” is set. Suppose that

  The data position determination unit 31 determines a suitable data position based on the setting file 33γ in the storage unit 33 and updates the optimum data position information in the access analysis table 22 of the database device 20 for each predetermined period. In the present embodiment, the data position determination unit 31 is suitable when the determination condition “the number of reads from the movement date of the access analysis table 22 or the number of writes from the movement date is 11 or more at the time of determination” is satisfied. If the condition is not satisfied, a suitable data position is determined as the secondary storage 42.

The data moving unit 32 moves a file of records whose current data position information is different from the optimum data position information in the access analysis table 22 of the database device 20 based on the optimum data position information.
Note that the directory name of the directory B41 in the primary storage 41 and the directory name of the directory B33 in the storage unit 33 in the data migration server 30 are the same, and here it is assumed that they are set as the directory name “sym_b”. To do.

Next, the operation flow of the access analysis process performed by the access analysis server 10 according to the embodiment of the present invention will be described with reference to a flowchart. FIG. 4 is a diagram showing a processing flow of the access analysis server 10 in the bidirectional data arrangement system 1.
As shown in FIG. 4A, in the bidirectional data arrangement system 1, when the client terminal 50 transmits a packet to the AP server 40 (step S1), the packet analysis unit 11 of the access analysis server 10 includes the client terminal 50. Acquires the packet to be transmitted, writes the acquired packet into the capture table 21 of the database device 20, performs packet capture processing, and returns to step S1 (step S2).

  On the other hand, in the access analysis server 10, as shown in FIG. 4B, the time-series log analysis unit 12 indicates that, for example, n minutes have elapsed since the previous access log analysis processing as a predetermined cycle. If detected, the process proceeds to step S4, and if it is detected that N minutes have passed since the previous update process of the total read number / write number, the process proceeds to step S9 (step S3). In step S4, the time-series log analysis unit 12 reads all the records of the access log from the capture table 21 (step S4).

  The time-series log analysis unit 12 bundles (aggregates) information of records in which the combination of the file name information and the absolute path information matches among all the records of the read access log. The time-series log analysis unit 12 reads the access analysis table 22, and based on the information obtained by collecting the access logs, the last access date / time information of the access analysis record in which the combination of the file name information and the absolute path information matches, and the record last update The date / time information, the total read number information, the read number information from the moving date, the total written number information, and the written number information from the moving date are updated.

  Further, when the access type information is “delete file”, the time series log analysis unit 12 deletes the corresponding access analysis record from the access analysis table 22. The time series log analysis unit 12 also accesses the access analysis table 22 when there is no access analysis record that matches the combination of the file name information and the absolute path information among the access log records read from the capture table 21. An access analysis record corresponding to the log record is written into the access analysis table 22. The time-series log analysis unit 12 outputs a file information update request signal including the second management ID information of the updated access analysis record to the file content analysis unit 13 (step S5).

  The file content analysis unit 13 reads file information from the storage unit 33 of the data movement server 30 for each access analysis record based on the input file information update request signal. Here, for example, the file content analysis unit 13 stores file size information in either the directory A33 or the directory B33 of the storage unit 33 as information on the file corresponding to the input second management ID information. Read from the property information of the file (step S6).

  The file content analysis unit 13 updates the file information by rewriting the file size information in the access analysis table 22 with the read file size information (step S7). After updating the access analysis table 22, the file content analysis unit 13 deletes all records in the access log from the capture table 21 (step S8).

  In step S3, when N minutes have elapsed from the previous update processing of the total read / write count, the time-series log analysis unit 12 reads the total read for all access analysis records in the access analysis table 22. Multiply the number by m (where 0 <m <1) and rewrite the multiplied value as a new total read number. Similarly, multiply the total write number by m and write the multiplied value to the new total write. Rewrite as a number. Further, after the rewriting process, the time-series log analysis unit 12 updates the record last update date / time information, and returns to Step S3 (Step S9).

  Next, a specific example of processing of the access analysis server 10 shown in FIG. 4 will be described with reference to the drawings. FIG. 5 is a diagram illustrating a process in which the access analysis server 10 updates the record of the second management ID “1”, that is, the record of the file name “a” in the access analysis table 22. Here, the case where the access analysis server 10 updates the record of the file name “a” in the access analysis table 22 of FIG. 3 based on the access log record of the capture table 21 of FIG. 2 will be described as an example. In this figure, at each time, items whose record values do not change compared to the previous time are indicated by halftone stitches.

  The record indicated by the file name “a” in the access analysis table 22 in FIG. 3 is assumed to be a record at time T1 in FIG. 5 as an initial state record. In step S5 in FIG. 4, the access analysis server 10 records the records of the first management IDs “1”, “4”, and “6” in FIG. 2 as access log records that match the file name “a” in FIG. Summarize. Specifically, the access analysis server 10 sets the latest packet acquisition date / time information as the last packet acquisition date / time information among the records whose combinations of the file name information to be aggregated and the absolute path information match, and the access type information is Aggregation processing is performed by using the number of records with “READ” as read number information and the number of records with access type information “WRITE” as write number information. By processing the number of accesses for each processing type “READ” and “WRITE” in this way, it becomes easier to determine the data update period and reference period, and to improve the accuracy of data distribution (data movement). It has the effect of being useful.

  Here, the packet date / time information “2008/2/22 15:22:51” in the first management ID “6” among the records of the first management IDs “1”, “4”, and “6” in FIG. The last packet acquisition date / time information, the record number “1” of the first management ID “6” whose access type information is “READ” becomes the read number information, and the first management ID “1” whose access type information is “WRITE”. The number of records “2” of “1” and “4” is the write number information.

  Based on the aggregation result, the access analysis server 10 rewrites the last packet acquisition date / time information as the last access date / time information of the access analysis table 22, as shown at time T2 in FIG. Also, a value obtained by adding the read number information “1” of the aggregation result to each of the total read number information “2” at the time T1 and the read number information “2” from the moving date is a new total read number information “ 3 ”, the number of readings from the moving date is rewritten as“ 3 ”. Similarly, the access analysis server 10 adds a value obtained by adding the write number information “2” of the aggregation result to each of the total write number information “1” and the write number “1” from the movement date at the time T1. Rewrite as new total write number information “3” and write number “3” from the moving date, and rewrite processing completion time as record last update date information “2008/2/22 15:23:01” Thus, the record at time T2 is obtained.

  As shown at time T3 in FIG. 5, the access analysis server 10 uses the file size information “1.7 MB” acquired from the data movement server 30 as the file information of the file name “a” in step S7 in FIG. The record is rewritten as new file size information in the access analysis table 22, and the rewrite processing completion time is rewritten as record last update date / time information “2008/2/22 15:23:22”, thereby obtaining a record at time T3.

  Further, when the process of step S9 shown in FIG. 4 is performed in the access analysis server 10, a predetermined value m, for example, for each of the total read number “3” and the total write number “3” at time T3, is given. Multiplying m = 0.9, rewrite the total read number “2.7” and the total write number “2.7”, which are multiplication results, as new values, and update the rewrite processing completion time to the last record By rewriting the date and time information as “2008/2/22 15:40:03”, the record at time T4 is obtained. Through the above steps, the access analysis server 10 updates the database device 20.

<Data migration from primary storage 41 to secondary storage 42>
Next, file (data) movement processing in the data movement server 30 will be described with reference to the drawings. 6 to 11 are conceptual diagrams showing how data is moved in the storage unit 33 of the primary storage 41, the secondary storage 42, and the data movement server 30. First, how the data movement server 30 moves the data α-0 of the file name “fileα” from the primary storage 41 to the secondary storage 42 will be described with reference to FIGS. FIG. 6 is a diagram illustrating a state of each storage apparatus when the directory A of the primary storage 41 stores data α-0. The data movement server 30 can access the data α-0 of the directory A to the directory A33 indicated by the storage unit 33 by NFS connection to the directory A.

  Next, an outline of data movement processing by the data movement server 30 will be described. FIG. 7 is a diagram illustrating a state of the storage unit 33 when the data movement server 30 moves the data α-0 from the primary storage 41 to the secondary storage 42. As shown in FIG. 7A, the data migration server 30 copies (duplicates) the data α-0 in the directory A33 to the directory B33. Here, for identification, as shown in FIG. 7B, the data α-0 copied to the directory B33 is defined as data α-1.

  Next, as shown in FIG. 7B, the data movement server 30 generates a symbolic link αs in the directory A33. The symbolic link αs of the directory A33 is a symbolic link serving as link information “../sym_b/fileα” to the data α-1 of the directory B33. As shown in FIG. 7C, the data movement server 30 deletes the data α-0 from the directory A33, and rewrites the file name of the symbolic link αs to the file name “fileα” of the data α-0.

  FIG. 8 is a diagram illustrating a state of each storage device when the data migration server 30 moves the data α-0 from the primary storage 41 to the secondary storage 42. As shown in this figure, the data α-1 which is copy data of the data α-0 is written into the directory B of the NFS-connected secondary storage 42 by the processing by the data migration server 30. Further, the data migration server 30 writes the symbolic link αs to the data α-1 in the directory A of the primary storage 41, deletes the data α-0, and changes the file name of the symbolic link αs to the data α-0. It will be rewritten.

  Here, since the same directory name “sym_b” is set in the directory B41 of the primary storage 41 and the directory B33 of the storage unit 33, a symbolic link link from the directory A33 of the storage unit 33 to the directory B33 is established. The information is the same as the link information of the symbolic link from the directory A of the primary storage 41 to the directory B41. Therefore, in the AP server 40, the link information “../sym_b/fileα” of the symbolic link αs of the directory A in the primary storage 41 is not the directory B33 of the storage unit 33 of the data migration server 30, but the data α of the directory B41. There is an effect that becomes link information to -1.

<Data Movement from Secondary Storage 42 to Primary Storage 41>
Next, how the data movement server 30 moves the data β-2 from the secondary storage 42 to the primary storage 41 will be described with reference to conceptual diagrams shown in FIGS. Here, the data β-2 is data that has been moved from the primary storage 41 to the secondary storage 42 by the data movement server 30 in the same manner as the processing of FIG.

  FIG. 9 is a diagram illustrating a state of each storage apparatus when the directory B of the secondary storage 42 stores the data β-2. As shown in this figure, the directory A of the primary storage 41 stores a symbolic link βs to the data β-2 of the directory B41. Further, the data movement server 30 can access the symbolic link βs of the directory A of the primary storage 41 by the directory A33 of the storage unit 33, and the data B-2 of the directory B of the secondary storage 42 by the directory B33. Is accessible.

  Next, an outline of data movement processing by the data movement server 30 will be described. FIG. 10 is a diagram illustrating a state of the storage unit 33 when the data movement server 30 moves the data β-2 from the secondary storage 42 to the primary storage 41. As shown in FIG. 10A, the data migration server 30 copies the data β-2 in the directory B33 to the directory A33. Here, for identification, as shown in FIG. 10B, data β-2 copied to the directory A33 is defined as data β-3. The data movement server 30 deletes the symbolic link βs in the directory A33 and the data β-2 in the directory B33. Then, the data movement server 30 rewrites the file name of the data β-2 in the directory A33 with the file name of the symbolic link βs.

  FIG. 11 is a conceptual diagram showing the state of each storage device when the data migration server 30 moves the data β-2 from the secondary storage 42 to the primary storage 41. As shown in this figure, the data migration server 30 writes data β-3, which is copy data of the data β-2, to the directory A of the NFS-connected primary storage 41. Further, the data migration server 30 deletes the symbolic link βs of the directory A of the primary storage 41 and the data β-2 of the directory B of the secondary storage 42, and the file name of the data β-3 is the symbolic link βs. It will be rewritten to the file name.

Next, the flow of the operation of the data movement process performed by the data movement server 30 according to the embodiment of the present invention in the data movement shown in FIGS. 6 to 11 will be described with reference to the drawings. FIG. 12 is a flowchart showing the flow of data movement processing in the data movement server 30.
In the data movement server 30 of the bidirectional data arrangement system 1, for example, when the data position determination unit 31 detects that m minutes have passed since the previous data movement process as a predetermined cycle, the data position determination unit 31. Reads the setting file 33γ in the storage unit 33 (step S21).

  The data position determination unit 31 reads the access analysis table 22 of the database device 20 (step S22), and the determination condition of the read setting file 33γ “the number of reads from the movement date of the access analysis table 22 at the time of determination or from the movement date” On the basis of whether or not any one of the number of writings satisfies 11 or more ”, it is determined for each access analysis record whether the optimal data position is the primary storage 41 or the secondary storage 42, and the determination result is Write to the access analysis record as new optimal data location information. The data position determination unit 31 updates the access analysis record by rewriting the processing completion time information as new record last update date / time information. When the update processing is completed for all access analysis records in the access analysis table 22, the data position determination unit 31 outputs a data movement request signal to the data movement unit 32 (step S23).

  When the data movement request signal is input, the data movement unit 32 reads the access analysis table 22 (step S24), and determines whether the current data position information and the optimum data position information differ for each access analysis record. It is determined whether or not the file corresponding to the access analysis record is a data movement target (step S25). The data position determination unit 31 performs data movement processing of the file determined as the data movement target (step S26), and updates the access analysis record by rewriting the processing completion time information as new record last update date / time information (step S26). S27).

  Next, how the access analysis table 22 is updated when the data migration server 30 moves the file with the file name “b” from the directory B to the directory A will be described with reference to the drawings. FIG. 13 is a diagram illustrating a process in which the data migration server 30 updates the record with the second management ID “2”, that is, the record with the file name “b” in the access analysis table 22. In this figure, at each time, items whose record values do not change compared to the previous time are indicated by halftone stitches.

  In FIG. 13, the access analysis record indicated by the file name “b” in the access analysis table 22 of FIG. 3 is the initial state record indicated at time T11. In step S23 of FIG. 12, the data migration server 30 reads the number of reads “10” from the migration date and the number of writes “14” from the migration date from the access analysis record of the file name “b”. Here, the number of writes “14” from the move date is 11 in the determination condition “the number of reads from the move date of the access analysis table 22 at the time of determination or the number of writes from the move date” of the setting file 33γ. In order to satisfy the above, the data movement server 30 determines that the optimal data position of the file name “b” is the primary storage 41. Based on the determination result, the data movement server 30 rewrites the optimum data position information “A” as new optimum data position information, and sets the completion time of the rewrite process as the record last update date / time information “2008/2/22 15:25:00. As a record at time T12.

  Next, in step S25 of FIG. 12, the data movement server 30 does not match the current data position information “B” in the access analysis record with the file name “b” with the optimum data position information “A”. The file “b” is determined as the data movement target. The data migration server 30 moves the file corresponding to the file name “b” to the directory A of the primary storage 41 in step S26. The data movement server 30 rewrites the current data position information “A” of the access analysis record with the file name “b” as new current data position information, and sets the completion time of the data movement processing as the record last update date / time information “2008/2 / 22 15:25:10 ”and the data movement date / time information“ 2008/2/22 15:25:10 ”, thereby rewriting the record at time T13.

  According to the above-described embodiment, the file moved from the primary storage 41 to the secondary storage 42 can be moved again to the primary storage 41, and the access written to the access analysis table 22 by the access analysis server 10 Based on the analysis information, the data movement server 30 determines which storage device is suitable as the data position of the determination target file for each predetermined period, and executes data movement processing based on the determination result. As a result, the bidirectional data placement system 1 can determine the optimum data position according to the access status, and can perform data movement in both directions between the primary storage 41 and the secondary storage 42, There is an effect that the access / cost ratio can be improved.

  In the above-described embodiment, the bidirectional data arrangement system 1 has been described as including one secondary storage 42 for one primary storage 41, but the present invention is not limited thereto, and the primary storage 41 is not limited thereto. It is good also as a structure provided with two or more secondary storage. In this case, the primary storage 41 includes a directory by NFS connection corresponding to each of the plurality of secondary storages. Similarly, in the storage unit 33 of the data migration server 30, each of the plurality of secondary storages is provided. This can be realized by providing a directory by NFS connection corresponding to the above. At this time, the directory name of each directory in the storage unit 33 and its path name are the names that match the directory name and path name of each directory in the primary storage 41 as described above.

  The determination conditions included in the setting file 33γ in the storage unit 33 of the data migration server 30 are based on the item “number of reads from the migration date” and the item “number of writes from the migration date” of the access analysis table 22. Although the determination condition has been described as an example, the present invention is not limited to this. For example, a determination condition based on the item “total read number”, a determination condition based on a combination of the item “total read number” and the item “total write number”, etc. Any determination condition can be used as long as it is a determination condition based on access analysis information written in the access analysis table 22 by the access analysis server 10 such as a determination condition based on any one of the items in the access analysis table 22 or a combination thereof. Is applicable.

  Alternatively, file movement number information may be provided as an item of access analysis information in the access analysis table 22, and the data movement unit 32 may rewrite the movement number information in the access analysis table 22 together with the current data position information. In addition, as an item in the access analysis table 22, an access presence / absence information item column indicating whether access is currently being performed is provided, and the time-series log analysis unit 12 in step S5 of FIG. The access presence / absence information may be updated based on the record.

  In this case, in the data movement process in S25 of FIG. 12, the data movement server 30 refers to the access presence / absence information in the access analysis table 22 and the capture table 21 to determine whether or not there is another access to the data movement target file. It is possible to skip the data movement processing of the currently accessed file.

  Further, the packet acquisition date information, the file name information, the absolute path information, the access source IP information, and the access type information have been described as examples of the packet information items of the capture table 21. However, the present invention is not limited to this. The capture table 21 may store any item or a plurality of items as packet information items among transfer rate information, file creation date / time information, access number information, access source OS information, and the like. Good.

  At this time, the packet analysis unit 11 writes transfer speed information, file creation date / time information, access number information, OS information, and the like as captured packet information in the capture table 21. Since the time series log analysis unit 12 writes the packet information of the capture table 21 to the access analysis table 22, the access analysis table 22 includes, as access analysis information, transfer speed information, file creation date / time information, access number information, OS One item or a plurality of items of information will be stored.

  Further, the items of the access analysis information in the access analysis table 22 are not limited to the examples shown in the above-described embodiment. For example, the total access number information, the access number information from n days ago, the access frequency (monthly, weekly, day Information, access day of the week information, access time zone information, access source area number information, actual access number information, shared / non-shared information, access interval information, etc. The present invention can also be applied to a configuration in which the access analysis table 22 stores items as access analysis information items. At this time, the time-series log analysis unit 12 selects one of the above-described access analysis information items or a plurality of items for the access analysis record in which the combination of the file name information and the absolute path information matches. Is written in the access analysis table 22.

  Further, the file size information has been described as an example of the file of the access analysis information in the access analysis table 22, but the present invention is not limited to this, and the file information includes, for example, file type information, access right (file) information, and access. Edit files that require special editing software for editing, such as rights (directory) information, file attribute (RWX) information, and editable files (for example, pdf (Portable Document Format)) File), whether it is compressed or uncompressed, whether it is archived, whether it is encrypted, whether the data type is a data type of a given product, and whether the attached file is Information about whether it is a certain mail, whether the file is not damaged, whether there is a virus check, etc. , May be stored access analysis table 22 a plurality of items as file information.

At this time, the file content analysis unit 13 reads the information of the above-mentioned file from the storage unit 33 and updates the access analysis table 22. As described above, the above-described various information is used as the item of the access analysis information in the access analysis table 22. By storing the access analysis table 22, the determination condition of the setting file 33γ based on the access analysis information of the access analysis table 22 can be set based on any one or a plurality of items.

  Further, as described above, the time-series log analysis unit 12 multiplies the total read number and the total write number by m (0 <m <1) for each predetermined period of step S9 in FIG. It was. At this time, with respect to the value of the total number of reads and the value of the total number of writes, the evaluation value for one access of the process with the old access date and time having a larger number of multiplications of m than the process with the new access date and time and the access date and time are The evaluation value for one access of the new process is a different weighting value.

  The process of giving different weights to the old access and the new access in the total read number information and the total write number information by the time series log analysis unit 12 is by reducing the value of the number of times every predetermined time described above. It is not limited to processing using simple linear calculation. For example, as another weighting method regarding the newness of access (reference), all access logs are taken, and the number of accesses in a predetermined period such as within one month, for example. By making the evaluation value with respect to h times (h> 1), it is possible to obtain an evaluation value emphasizing access during a certain period. As described above, any weighting method can be applied as long as the older access has a smaller value for one access and a relatively higher evaluation weight for the new access.

  In the above-described embodiment, the NFS connection is described as an example of the connection method of the directory B41, the directory A33, and the directory B33, which are virtual directories. However, the present invention is not limited to this, but iSCSI (Internet SCSI (Small Computer System Interface) )), CIFS (Common Internet File System), FC (Fibre Channel), SAN (Storage Area Network), etc., any connection method can be applied as long as it is a method for mounting the directory A and the directory B.

The access analysis server 10 and the data movement server 30 described above have a computer system inside. The operation processes of the packet analysis unit 11, the time series log analysis unit 12, the file content analysis unit 13, the data position determination unit 31 of the data movement server 30, and the data movement unit 32 of the access analysis server 10 are in the form of a program. The program is stored in a computer-readable recording medium, and the above processing is performed by the computer system reading and executing this program. The “computer system” herein includes a CPU, various memories, an OS, and hardware such as peripheral devices.
Further, the “computer system” includes a homepage providing environment (or display environment) if a WWW system is used.

Also, a program for realizing each step shown in FIG. 4 is recorded on a computer-readable recording medium, and a program for realizing each step shown in FIG. 12 is recorded on a computer-readable recording medium. In addition, a program for realizing the functions of the access analysis server 10 and the data movement server 30 shown in FIG. 1 is recorded on a computer-readable recording medium, and the program recorded on the recording medium is read into a computer system. In other words, the data migration server 30 may perform processing to move data between the primary storage 41 and the secondary storage 42 in both directions.
The “computer-readable recording medium” means a flexible disk, a magneto-optical disk, a ROM, a writable nonvolatile memory such as a flash memory, a portable medium such as a CD-ROM, a hard disk built in a computer system, etc. This is a storage device.

Further, the “computer-readable recording medium” refers to a volatile memory (for example, DRAM (Dynamic DRAM)) in a computer system that becomes a server or a client when a program is transmitted via a network such as the Internet or a communication line such as a telephone line. Random Access Memory)), etc., which hold programs for a certain period of time.
The program may be transmitted from a computer system storing the program in a storage device or the like to another computer system via a transmission medium or by a transmission wave in the transmission medium. Here, the “transmission medium” for transmitting the program refers to a medium having a function of transmitting information, such as a network (communication network) such as the Internet or a communication line (communication line) such as a telephone line.
The program may be for realizing a part of the functions described above. Furthermore, what can implement | achieve the function mentioned above in combination with the program already recorded on the computer system, and what is called a difference file (difference program) may be sufficient.

1 is a block diagram showing an overall configuration of a bidirectional data arrangement system 1 according to an embodiment of the present invention. It is a figure showing an example of data composition of capture table 21 in the embodiment. It is a figure showing an example of data composition of access analysis table 22 in the embodiment. It is a flowchart which shows the flow of operation | movement of the access analysis server 10 in the embodiment. It is a figure which shows the change of the data of the access analysis table 22 by the process of the access analysis server 10 in the embodiment. It is a conceptual diagram which shows the mode before the data movement from the primary storage 41 to the secondary storage 42 in the embodiment. It is a conceptual diagram which shows the mode of the data movement of the memory | storage part 33 in the embodiment. It is a conceptual diagram which shows the mode after the data movement from the primary storage 41 to the secondary storage 42 in the embodiment. 3 is a conceptual diagram showing a state before data is moved from the secondary storage 42 to the primary storage 41 in the embodiment. FIG. It is a conceptual diagram which shows the mode of the data movement of the memory | storage part 33 in the embodiment. It is a conceptual diagram which shows the mode after the data movement from the secondary storage 42 to the primary storage 41 in the embodiment. It is a flowchart which shows the flow of operation | movement of the data movement server 30 in the embodiment. It is a figure which shows the change of the data of the access analysis table 22 by the process of the data movement server 30 in the embodiment.

Explanation of symbols

DESCRIPTION OF SYMBOLS 1 Bidirectional data arrangement system 10 Access analysis server 11 Packet analysis part 12 Time series log analysis part 13 File content analysis part 20 Database apparatus 21 Capture table 22 Access analysis table 30 Data movement server 31 Data position determination part 32 Data movement part 33 Storage Part 33γ Setting file A, B, B41, A33, B33 Directory 40 AP server 41 Primary storage 42 Secondary storage 50 Client terminal 100 Network α-0, α-1, β-2, β-3 Data αs, βs Symbolic Link

Claims (7)

A client terminal that transmits a packet including an access request signal for data stored in either the primary storage apparatus or the secondary storage apparatus, a server that responds to the access request signal from the client terminal, and a connection to the server The primary storage device that stores data in a first storage area, a storage device of a different type from the primary storage device, the secondary storage device that stores data in a second storage area, an access analysis server, An interactive data arrangement system in which an access analysis information storage device for storing access analysis information and a data movement server are connected to each other via a network,
The primary storage device
A first virtual storage area of the second storage area that is virtually connected to the second storage area of the secondary storage device and that can execute data read processing and write processing of the second storage area. ,
The server
Based on the access request signal including identification information of data to be accessed received from the client terminal and first location information that is current location information of the data, or a first storage area of the primary storage device, or For the data to be accessed in the first virtual storage area, execute processing based on the access request, and send a response signal of the processing result to the client terminal,
The access analysis server
A packet analysis unit for acquiring a packet in communication between the client terminal and the server;
Based on the identification information of the packet acquired by the packet analysis unit and the first location information, the access information corresponding to the number of accesses for each data stored in the primary storage device or the secondary storage device is accessed. A time series log analysis unit for writing to the analysis information storage device,
The access analysis information storage device
For each piece of data identification information stored in the primary storage device or the secondary storage device, the first location information, the access information, and the second location information that is the location information of the movement destination of the data are associated with each other. Stores a table of access analysis information,
The data movement server is
A second virtual storage area that is virtually connected to the first storage area of the primary storage apparatus and executes data read processing and write processing of the first storage area, and the secondary storage apparatus includes the second virtual storage area A third virtual storage area of the second storage area that is virtually connected to the second storage area and is capable of executing read processing and write processing of data in the second storage area, and based on the value of the access information A storage unit for storing data position determination condition information for determining a data movement destination;
The access analysis information stored in the access analysis information storage device is read for each identification information of the data, and the value of the access information of the read access analysis information is the value of the data location determination condition information stored in the storage unit. In the above case, the data movement destination is determined as the primary storage device, and when the value of the access information is less than the value of the data location determination condition information, the data movement destination is determined as the secondary storage device, and the determination result As a new second position information of the access analysis information, a data position determination unit that writes the access analysis information storage device,
The access analysis information stored in the access analysis information storage device is read, and in the read access analysis information, access analysis information in which the first position information and the second position information are different for each identification information is detected, Data that reads data corresponding to the access analysis information from the storage unit based on the first location information of the detected access analysis information, and moves the read data in the storage unit based on the second location information of the access analysis information A bidirectional data arrangement system comprising: a moving unit. The time series log analysis unit
The bidirectional data arrangement system according to claim 1, wherein the access information has a smaller value per access than an access with an old access date and time compared to an access with an old access date and time. The first location information of the access analysis information detected by the data moving unit indicates the first storage area of the primary storage device, and the second location information indicates the second storage area of the secondary storage device. When showing
The data moving unit is
After the movement processing of the data to be moved, a symbolic link for the data after movement in the third virtual storage area corresponding to the second position information is written in the second virtual storage area,
The first location information of the access analysis information detected by the data moving unit indicates the second storage area of the secondary storage device, and the second location information indicates the first storage area of the primary storage device. When showing
The data moving unit is
The symbolic link for the data before movement in the third virtual storage area corresponding to the first position information is deleted from the second virtual storage area after the movement processing of the data to be moved. 3. The bidirectional data arrangement system according to any one of 2 above. A client terminal that transmits a packet including an access request signal for data stored in either the primary storage apparatus or the secondary storage apparatus, a server that responds to the access request signal from the client terminal, and a connection to the server The primary storage device that stores data in a first storage area, and a storage device of a different type from the primary storage device, the secondary storage device that stores data in a second storage area, the client terminal, and the Access for each data stored in the primary storage device or the secondary storage device based on the identification information of the access target data included in the packet in the communication with the server and the current location information of the access target data Access information corresponding to the number of times is stored in the access analysis information storage device For each of the identification information of the data stored in the access analysis server, the primary storage device or the secondary storage device, the first location information indicating the current location information of the data, the access information, and the data Access analysis information storage device for storing access analysis information including access analysis information in association with second position information indicating location information of the destination of movement, and a data movement server are respectively connected via a network A data movement server in a data arrangement system,
A second virtual storage area that is virtually connected to the first storage area of the primary storage apparatus and executes data read processing and write processing of the first storage area, and the secondary storage apparatus includes the second virtual storage area A third virtual storage area of the second storage area that is virtually connected to the second storage area and is capable of executing read processing and write processing of data in the second storage area, and based on the value of the access information A storage unit for storing data position determination condition information for determining a data movement destination;
The access analysis information stored in the access analysis information storage device is read for each identification information of the data, and the value of the access information of the read access analysis information is the value of the data location determination condition information stored in the storage unit. In the above case, the data movement destination is determined as the primary storage device, and when the value of the access information is less than the value of the data location determination condition information, the data movement destination is determined as the secondary storage device, and the determination result As a new second position information of the access analysis information, a data position determination unit that writes the access analysis information storage device,
The access analysis information stored in the access analysis information storage device is read, and in the read access analysis information, access analysis information in which the first position information and the second position information are different for each identification information is detected, Data that reads data corresponding to the access analysis information from the storage unit based on the first location information of the detected access analysis information, and moves the read data in the storage unit based on the second location information of the access analysis information A data movement server comprising: a movement unit. A client terminal that transmits a packet including an access request signal for data stored in either the primary storage apparatus or the secondary storage apparatus, a server that responds to the access request signal from the client terminal, and a connection to the server The primary storage device that stores data in a first storage area, a storage device of a different type from the primary storage device, the secondary storage device that stores data in a second storage area, an access analysis server, An access analysis server in a bidirectional data arrangement system in which an access analysis information storage device for storing access analysis information and a data movement server are connected to each other via a network,
A packet analyzer that obtains a packet including identification information of data to be accessed in communication between the client terminal and the server, and first position information that is current position information of the data;
Based on the identification information of the packet acquired by the packet analysis unit and the first location information, access information for each data stored in the primary storage device or the secondary storage device is stored in the access analysis information storage device. An access analysis server comprising a time series log analysis unit for writing. A client terminal that transmits a packet including an access request signal for data stored in either the primary storage apparatus or the secondary storage apparatus, a server that responds to the access request signal from the client terminal, and a connection to the server The primary storage device that stores data in a first storage area, a storage device of a different type from the primary storage device, the secondary storage device that stores data in a second storage area, an access analysis server, A bidirectional data placement method in a bidirectional data placement system in which an access analysis information storage device for storing access analysis information and a data movement server are respectively connected via a network,
The primary storage device is
A first virtual storage area of the second storage area that is virtually connected to the second storage area included in the secondary storage device and that can execute data read processing and write processing of the second storage area. Have a process,
The server is
Based on the access request signal including the identification information of the data to be accessed received from the client terminal and the first location information that is the current location information of the data, or the first storage area of the primary storage device, or Performing a process based on the access request for data to be accessed in the first virtual storage area, and transmitting a response signal of a process result to the client terminal;
The access analysis server is
A packet analysis process for obtaining a packet in communication between the client terminal and the server;
Based on the identification information of the packet acquired by the packet analysis process and the first location information, access information corresponding to the number of accesses for each data stored in the primary storage device or the secondary storage device is accessed. A time series log analysis process for writing to the analysis information storage device,
The access analysis information storage device
For each piece of data identification information stored in the primary storage device or the secondary storage device, the first location information, the access information, and the second location information that is the location information of the movement destination of the data are associated with each other. Storing a table of access analysis information;
The data movement server is
A second virtual storage area that is virtually connected to the first storage area of the primary storage apparatus and executes data read processing and write processing of the first storage area, and the secondary storage apparatus includes the second virtual storage area A process that includes a third virtual storage area of the second storage area that is virtually connected to the second storage area and that can execute a data read process and a write process of the second storage area;
A storage step of storing data position determination condition information for determining a data destination based on the value of the access information;
For each piece of identification information of the data, the access analysis information stored in the access analysis information storage device is read. If the access information value of the read access analysis information is equal to or greater than the value of the data location determination condition information, data movement When the destination is determined as the primary storage device, and the value of the access information is less than the value of the data location determination condition information, the data movement destination is determined as the secondary storage device, and the determination result is determined based on the access analysis information. As a new second position information, a data position determination process to be written in the access analysis information storage device,
The access analysis information stored in the access analysis information storage device is read, and in the read access analysis information, access analysis information in which the first position information and the second position information are different for each identification information is detected, Based on the first location information of the detected access analysis information, data corresponding to the access analysis information is read, and the read data is read from the second virtual storage area or the third virtual location based on the second location information of the access analysis information. And a data movement process for moving in the storage area. A client terminal that transmits a packet including an access request signal for data stored in either the primary storage apparatus or the secondary storage apparatus, a server that responds to the access request signal from the client terminal, and a connection to the server The primary storage device that stores data in a first storage area, a storage device of a different type from the primary storage device, the secondary storage device that stores data in a second storage area, an access analysis server, In a bidirectional data arrangement system in which an access analysis information storage device that stores access analysis information and a data movement server are connected via a network,
In the computer of the primary storage device,
A first virtual storage area of the second storage area that is virtually connected to the second storage area included in the secondary storage device and that can execute data read processing and write processing of the second storage area. Process,
In the server computer,
Based on the access request signal including the identification information of the data to be accessed received from the client terminal and the first location information that is the current location information of the data, or the first storage area of the primary storage device, or Executing a process based on the access request for data to be accessed in the first virtual storage area, and transmitting a response signal of a process result to the client terminal;
In the computer of the access analysis server,
A packet analysis process for obtaining a packet in communication between the client terminal and the server;
Based on the identification information of the packet acquired by the packet analysis process and the first location information, access information corresponding to the number of accesses for each data stored in the primary storage device or the secondary storage device is accessed. A time-series log analysis process to be written to the analysis information storage device;
In the computer of the access analysis information storage device,
For each piece of data identification information stored in the primary storage device or the secondary storage device, the first location information, the access information, and the second location information that is the location information of the movement destination of the data are associated with each other. Storing a table of access analysis information;
In the computer of the data movement server,
A second virtual storage area that is virtually connected to the first storage area of the primary storage apparatus and executes data read processing and write processing of the first storage area, and the secondary storage apparatus includes the second virtual storage area A process that includes a third virtual storage area of the second storage area that is virtually connected to the second storage area and that can execute a data read process and a write process of the second storage area;
A storage step of storing data position determination condition information for determining a data destination based on the value of the access information;
For each piece of identification information of the data, the access analysis information stored in the access analysis information storage device is read. If the access information value of the read access analysis information is equal to or greater than the value of the data location determination condition information, data movement When the destination is determined as the primary storage device, and the value of the access information is less than the value of the data location determination condition information, the data movement destination is determined as the secondary storage device, and the determination result is determined based on the access analysis information. As a new second position information, a data position determination process to be written in the access analysis information storage device,
The access analysis information stored in the access analysis information storage device is read, and in the read access analysis information, access analysis information in which the first position information and the second position information are different for each identification information is detected, Based on the first location information of the detected access analysis information, data corresponding to the access analysis information is read, and the read data is read from the second virtual storage area or the third virtual location based on the second location information of the access analysis information. A program for executing a data movement process that moves in a storage area.

Images