JP5398077B2 - Importance determination method, storage system, and program for data stored in storage device - Google Patents

Description

  The present invention relates to a method for determining the importance of file data stored in a storage device according to preset conditions, and a copy of highly important data is stored in a storage device that cannot be updated or deleted based on the determination result. The present invention relates to a method, a system, and a program.

With the increase in capacity and cost of storage devices that can be used, companies are digitizing and storing a large amount of information in the storage devices.
Recently, an enterprise search system for performing a search process on file data stored in a storage device in a company and using it effectively is becoming widespread.
In addition, some storage systems used in enterprises have a WORM (Write Once Read Many) function that allows file data to be referenced but cannot be altered or deleted.
Furthermore, a web application that handles hypertext called Wiki, which allows multiple users to view and edit the same electronic document at the same time, is used to organize and collect file data.

FIG. 9 is a block configuration diagram showing an overview of the enterprise search system. An index creation unit 91 that extracts keywords from the storage device 90 and constructs a search index, an index database 92 that stores index data, and a search from a user A search request input unit 93 that receives a request input, a search processing unit 94 that creates a search result by referring to the index database 92 from the search request, and a search result display unit 95 that displays the search result are configured.

In the enterprise search system having such a configuration, the index creation unit 91 acquires information registered in the storage device 90 and registers the keyword included in the acquired information and the location of the information of the acquisition source in the index database 92. .
On the other hand, the search request input from the search request input unit 93 is processed in the search processing unit 94 with reference to the index database 92 and the search result display unit 95 displays the search result. At this time, the search result to be displayed includes the name of the information that matches the search request and the saved location.
In addition, there exists the following patent document 1 as a well-known technical document relevant to this invention.

JP 2006-72957 A

By the way, due to the development of bills related to e-Discovery, laws and regulations that require long-term storage of data such as business documents are strengthened in companies.
If a storage device having a WORM function is used, erasure and update are impossible, so that important data can be stored for a long time without being erased or updated. However, if the data is stored as it is, the storage capacity of the storage device becomes enormous.
Therefore, it is desirable to store a copy of only highly important data in a storage apparatus having the WORM function.
However, conventionally, there is no appropriate method for determining the importance of data stored in the storage apparatus.

  An object of the present invention is to appropriately determine the importance of data stored in a storage device and to store a copy of the data in a storage device having a WORM function if it is important data based on the determination result. It is an object to provide a system and program capable of acquiring the original contents even when the contents are lost or modified.

In order to achieve the above object, according to the method of the present invention, in a computer for determining the importance of data stored in a storage device, whether the keyword of search target file data stored in the storage device is already registered. If it is unregistered, the keyword included in the file data is acquired, the hash value is acquired, and the value indicating the importance of the file is initialized and registered in the index database. If it is already registered and updated file data, a keyword and a hash value included in the file data are acquired and a value indicating the importance of the file is initialized and registered in the index database;
Registering a value for determining the importance of the file data stored in the storage device and a keyword for determining the importance document in the condition database in advance;
A hypertext document including reference information to the file data storage destination is stored in a hypertext database, and the value of the number of references to the file data included in the stored hypertext document is updated for each referenced file data. And storing as a value indicating the importance of the file data of the index database;
The value indicating the importance for each file data stored in the index database is compared with the value for determining the importance of each file data registered in the condition database, and the value indicating the importance for each file data is large. When the keyword included in the file data is acquired from the index database and the keyword registered in the condition database is included, the file data is assumed to be important document data with high importance. Storing a copy of the file data stored in the storage device in a storage device that cannot be updated or deleted.
In addition, when the value of the number of references to the file data included in the hypertext document stored in the hypertext database is updated for each referenced file data, if the deleted hyperlink exists, the file data The step of subtracting the value of the number of references to the file and adding the value of the number of references to the file data when an added hyperlink exists is provided.

Further, the system according to the present invention determines whether or not the keyword of the search target file data stored in the storage device is an already registered keyword, and if it is unregistered, the file data is stored in the file data. Acquires the included keyword and also obtains the hash value, initializes the value indicating the importance of the file, registers it in the index database, and is already registered. Means for acquiring the included keyword and hash value, initializing a value indicating the importance of the file, and registering it in the index database;
Means for preliminarily registering in the condition database a value for determining the importance of the file data stored in the storage device and a keyword for determining that the file is an important document;
A hypertext document including reference information to the file data storage destination is stored in a hypertext database, and the value of the number of references to the file data included in the stored hypertext document is updated for each referenced file data. And means for storing the value indicating the importance of the file data of the index database;
The value indicating the importance for each file data stored in the index database is compared with the value for determining the importance of each file data registered in the condition database, and the value indicating the importance for each file data is large. When the keyword included in the file data is acquired from the index database and the keyword registered in the condition database is included, the file data is assumed to be important document data with high importance. Means for storing a copy of the file data stored in the storage device in a storage device that cannot be updated or deleted.
In addition, when the value of the number of references to the file data included in the hypertext document stored in the hypertext database is updated for each referenced file data, if the deleted hyperlink exists, the file data A means for subtracting the value of the number of references to the file and adding a value of the number of references to the file data when an added hyperlink exists is provided.

Further, the program according to the present invention allows a computer that determines the importance of data stored in the storage device to determine whether or not the keyword of the search target file data stored in the storage device is a registered one by using a hash value. If it is unregistered, the keyword included in the file data is acquired and the hash value is acquired, and the value indicating the importance of the file is initialized and registered in the index database. Yes, if it is updated file data, a keyword and a hash value included in the file data are acquired, and a value indicating the importance of the file is initialized and registered in the index database;
Means for preliminarily registering in the condition database a value for determining the importance of the file data stored in the storage device and a keyword for determining that the file is an important document;
A hypertext document including reference information to the file data storage destination is stored in a hypertext database, and the value of the number of references to the file data included in the stored hypertext document is updated for each referenced file data. And means for storing the value indicating the importance of the file data of the index database;
The value indicating the importance for each file data stored in the index database is compared with the value for determining the importance of each file data registered in the condition database, and the value indicating the importance for each file data is large. When the keyword included in the file data is acquired from the index database and the keyword registered in the condition database is included, the file data is assumed to be important document data with high importance. It is characterized by functioning as a means for storing a copy of file data stored in a storage device in a storage device that cannot be updated or deleted.
In addition, when the value of the number of references to the file data included in the hypertext document stored in the hypertext database is updated for each referenced file data, if the deleted hyperlink exists, the file data A means for subtracting the value of the number of references to the file and adding a value of the number of references to the file data when an added hyperlink exists is provided.

  According to the present invention, the degree of importance of file data is determined by the number of links attached to the file data. Since it was moved and saved, the original contents can be acquired even if the original is lost or altered.

1 is a system configuration diagram showing an embodiment of the present invention. It is a block diagram of the data stored in the index database. It is a block diagram of the data stored in the hypertext database. It is a block diagram of the data stored in the condition database. It is a flowchart which shows the outline | summary of the update process of index information. It is a flowchart which shows the outline | summary of the preservation | save process of the document containing a hyperlink. It is a flowchart which shows the outline | summary of the movement process of file data. It is a flowchart which shows the outline | summary of the process which registers information into a condition database. It is a block block diagram which shows the outline | summary of the conventional enterprise search system.

Hereinafter, an embodiment of a storage system to which the present invention is applied will be described.
FIG. 1 is a system configuration diagram showing an example of an embodiment of the present invention.
This system is configured by connecting a host system 2, a storage device 3, a storage device 4 having a WORM (Write Once Read Many) function, and a terminal 5 to a network 1.

The host system 2 and the terminal 5 can store and refer to file data with respect to the storage apparatus 3 and the storage apparatus apparatus 4 having the WORM function through the network 1.
The host system 2 includes a search program 6, a hypertext management program 7, a data replication program 8, an index database 9, a hypertext database 10, and a condition database 11.
The terminal 5 includes a browser 12.

When an HTML document is used as hypertext, the host system 2 corresponds to a Web server, the hypertext management program 7 and the hypertext database 10 correspond to Wiki software, and the browser 12 corresponds to a Web browser.
The browser 12 can use the search program 6, the hypertext management program 7, and the data replication program 8 through the host system 2.

As shown in FIG. 2, the index information of the file data stored in the index database 9 includes area data of a storage destination 21, a hash value 22, a keyword 23, and an importance 24.
The storage location 21 indicates where a specific file data is stored in which file server, and serves as an identifier of the file data.
The hash value 22 is a value obtained by passing the file data through the hash function, and is used to check whether the content of the file data has been changed.
The keyword 23 is a list of words obtained by decomposing the contents of the file data with spaces, symbols, and morphemes.
As the importance 24, a value representing the importance of the file data determined by the hypertext management program 7 is substituted.

As shown in FIG. 3, a document including hyperlinks to file data stored in the hypertext database 10 includes a data title 31 and a body 32 that can include a plurality of hyperlinks.
The hyperlink included in the text 32 refers to file data stored in the storage apparatus 3 and the storage apparatus 4 having the WORM function, and is distinguished from a hyperlink to a web page on the Internet.
The title 31 is an identifier of a document stored in the hypertext database 10. A plurality of hyperlinks and sentences can be inserted into the body 32. For example, the character string “Contract A” in the text 32 of FIG. 3 is a hyperlink to the file data of the same name stored in the storage device 3.

As the condition of the file data to be moved from the storage apparatus 3 to the storage apparatus apparatus 4 having the WORM function, importance 41 and keyword 42 can be specified as shown in FIG. The importance level 41 and the keyword 42 shown in FIG. 3 are stored in the condition database 11.
A single value for determining the importance of the file data can be registered in the importance 41 and is used for comparison with the importance 24 of the index database 9.
A plurality of keywords for determining that the document is an important document can be registered in the keyword 42, and the data replication program 8 is used to check whether each registered keyword is included in the keyword 22 of the index database 8. To do.

FIG. 5 is a flowchart showing an overview of the initialization process of the index information registered in the index database 9 in the search program 6.
First, file data that is the source of index information is acquired from the storage apparatus 3 and the storage apparatus 4 having the WORM function (step 501).
Next, a hash function is applied to the acquired file data to acquire the hash value (step 502).

Next, it is determined whether or not the acquired file data information is registered in the index database 9 (step 503).
If the acquired file data is not registered in the index database 9, “0” is registered as an initial value in the importance 24 (step 505).

  However, when the information of the extracted file data is already registered in the index database 9, the extracted file data is compared with the hash value 22 registered in the index database 9, and the previous index information is initialized. It is determined whether or not the contents of the file data have been updated since the time of the execution (step 504).

  If the hash value of the extracted file data does not match the hash value registered in the index database 9, the file data has been updated, so the keyword contained in the file data is acquired. Then, new information (keyword and hash value) is registered in the index database 9 (steps 506 and 507). The importance level 24 is also initialized.

The search program 6 periodically and repeatedly executes the above processing for all file data stored in the storage apparatus 3 and the storage apparatus 4 having the WORM function.
A document containing a hyperlink is a source of information for selecting the file data to be copied, and its contents include a hyperlink for the file data that is determined to be particularly important from the file data searched and found by the user It is.

FIG. 6 is a flowchart showing an outline of processing for storing a document including a hyperlink to file data designated by the user in the hypertext management program 7.
When the user requests the host system 2 to search for file data using a keyword input to the browser 10, the host system 2 transmits data including a list of hyperlinks to file data including the input keyword to the browser.
The user selects a necessary hyperlink from the list of hyperlinks received from the host system 2 and transmits the title and the list of hyperlinks to the host system 2. Then, the data including the hyperlink is stored in the hypertext database 10.

  At this time, the hypertext management program 7 receives a document including a hyperlink from the host system 2 and acquires a list of file data storage destinations indicated by the hyperlink (step 601).

Next, the title of the document including the hyperlink is searched from the title 31 of the hypertext database 10, and it is determined whether or not the document including the hyperlink has already been registered (step 602). That is, it is determined whether or not the title already exists.
If it is not registered, the document data including the hyperlink is newly created, the index database 9 is referred to from the list of storage destinations of the first acquired file data, and the importance of each file data After adding “1” to 24, the title and body of the document including the received hyperlink are registered in the hypertext database 10 (steps 603 and 604).

  If the title of the document including the hyperlink is registered in the hypertext database 10, that is, if the title already exists, the interval between the already registered document and the document including the received hyperlink is set. In step 605, 606, and 607, it is determined whether or not there is a deleted hyperlink and an added hyperlink in the received document.

If there is a deleted hyperlink in the received document, the index database 9 is referenced from the file data storage location indicated by all the deleted hyperlinks, and the importance level 24 is subtracted (step 608). .
Conversely, if there is an added hyperlink, the index database 9 is referenced from the file data storage location indicated by all the added hyperlinks, and the importance 24 is added (step 603).

The document containing the hyperlink is overwritten and saved in the hypertext database 10 with the already existing title and the received hyperlink, and the saving process of the document containing the hyperlink ends.
When deleting a document including a hyperlink, data in which the text 32 of the target title 31 is emptied is stored.

FIG. 7 is a flowchart showing an outline of processing for moving file data from the storage apparatus 3 to the storage apparatus 4 having the WORM function in the file data replication program 8.
First, an importance level 41 and a keyword 42, which are conditions for file data to be moved, are acquired from the condition database 8. (Step 701)

Next, the storage destination 21, the hash value 22, the keyword 23, and the importance 24 of the file data to be moved are acquired from the index database 9 (step 702).
Next, it is determined by the storage destination 21 whether the file data to be migrated is file data stored in the storage device 3 (step 703).

  Further, it is determined whether or not the same file data already exists in the storage apparatus 4 having the WORM function (step 704). If the file data is stored in the storage device 4 having the WORM function, it is not necessary to move the data, and the process moves to the next file data.

  Next, the importance level 41 set in the condition database 11 is compared with the importance level 24 stored in the index database 9. If the importance level 24 is larger, the index database is included in the keyword 42 of the condition database 11. It is confirmed whether the 9 keyword 23 words are not included (steps 705 and 706).

If it is included, the file data of the storage destination 21 is read, and the read file data is stored in the storage device 4 having the WORM function (step 707).
The data replication program 8 periodically executes the above processing for all file data registered in the storage destination 21 of the index database 9.

FIG. 8 is a flowchart showing an overview of the initialization process of the condition database 11 by the data replication program 8.
The data replication program 8 displays a screen for requesting the browser 12 to input the importance value and the keyword included in the file data to be replicated. (Step 801)
The data replication program 8 receives the user input transmitted from the browser 12, and registers the importance 41 and the keyword 42 in the condition database 11 (steps 802, 803, and 804). Thereby, the initialization process of the condition database 11 is completed.

DESCRIPTION OF SYMBOLS 1 Network 2 Host system 3 Storage apparatus 4 Storage apparatus with WORM function 5 Terminal 6 Search program 7 Hypertext management program 8 Data replication program 9 Index database 10 Hypertext database 11 Condition database 12 Browser 21 Storage destination 22 Hash value 23 Keyword 24 Importance 31 Title 32 Body 41 Importance 42 Keyword

Claims (6)

In a computer for determining the importance of data stored in a storage device,
It is determined whether or not the keyword of the file data to be searched stored in the storage device is already registered, and if it is unregistered, the keyword included in the file data is acquired and the hash value is acquired. , The value indicating the importance of the file is initialized and registered in the index database. If it is already registered and updated file data, the keyword and hash value included in the file data are acquired. And initializing a value indicating the importance of the file and registering it in the index database;
Registering a value for determining the importance of the file data stored in the storage device and a keyword for determining the importance document in the condition database in advance;
A hypertext document including reference information to the file data storage destination is stored in a hypertext database, and the value of the number of references to the file data included in the stored hypertext document is updated for each referenced file data. And storing as a value indicating the importance of the file data of the index database;
The value indicating the importance for each file data stored in the index database is compared with the value for determining the importance of each file data registered in the condition database, and the value indicating the importance for each file data is large. When the keyword included in the file data is acquired from the index database and the keyword registered in the condition database is included, the file data is assumed to be important document data with high importance. And a step of storing a copy of the file data stored in the storage device in a storage device that cannot be updated or deleted.   When updating the value of the number of references to the file data included in the hypertext document stored in the hypertext database for each file data referred to, if there is a deleted hyperlink, the file data 2. The storage device according to claim 1, further comprising a step of subtracting the value of the reference number and adding the value of the reference number to the file data when an added hyperlink exists. A method for determining the importance of data. A storage system comprising a computer for storing file data in a storage device,
The computer determines whether or not the keyword of the file data stored in the storage device is a registered one by using a hash value, and if it is unregistered, acquires the keyword included in the file data. After acquiring the hash value, initialize the value indicating the importance of the file and register it in the index database. If it is already registered and updated file data, the keyword and hash value included in the file data are Means for acquiring and hash value and initializing a value indicating the importance of the file and registering it in the index database;
Means for preliminarily registering in the condition database a value for determining the importance of the file data stored in the storage device and a keyword for determining that the file is an important document;
A hypertext document including reference information to the file data storage destination is stored in a hypertext database, and the value of the number of references to the file data included in the stored hypertext document is updated for each referenced file data. And means for storing the value indicating the importance of the file data of the index database;
The value indicating the importance for each file data stored in the index database is compared with the value for determining the importance of each file data registered in the condition database, and the value indicating the importance for each file data is large. When the keyword included in the file data is acquired from the index database and the keyword registered in the condition database is included, the file data is assumed to be important document data with high importance. storage system, characterized in that it comprises a means for storing a copy of the file data stored in the storage device to update and erasing impossible storage device. When updating the value of the number of references to the file data included in the hypertext document stored in the hypertext database for each file data referred to, if there is a deleted hyperlink, the file data 4. The storage system according to claim 3 , further comprising means for subtracting the value of the reference number and adding the value of the reference number to the file data when the added hyperlink exists. A computer that determines the importance of data stored in the storage device,
Hash with keywords of the search target file data stored in the storage device determines whether or not the registered by the hash value, obtains the keywords contained in the file data as long as unregistered After obtaining the value, initialize the value indicating the importance of the file and register it in the index database. If it is already registered and updated file data, the keyword and hash value included in the file data are obtained. And means for obtaining a hash value and initializing a value indicating the importance of the file and registering it in the index database;
Means for preliminarily registering in the condition database a value for determining the importance of the file data stored in the storage device and a keyword for determining that the file is an important document;
A hypertext document including reference information to the file data storage destination is stored in a hypertext database, and the value of the number of references to the file data included in the stored hypertext document is updated for each referenced file data. And means for storing the value indicating the importance of the file data of the index database;
The value indicating the importance for each file data stored in the index database is compared with the value for determining the importance of each file data registered in the condition database, and the value indicating the importance for each file data is large. When the keyword included in the file data is acquired from the index database and the keyword registered in the condition database is included, the file data is assumed to be important document data with high importance. A program that causes a copy of file data stored in a storage device to function as means for storing in a storage device that cannot be updated or deleted.   When updating the value of the number of references to the file data included in the hypertext document stored in the hypertext database for each file data referred to, if there is a deleted hyperlink, the file data 6. The program according to claim 5, wherein when there is a hyperlink added by subtracting the value of the reference number, the program is caused to function as means for adding the value of the reference number to the file data.

Images