JP2000293412A - Information processor and method for calculating amount of data output to auxiliary storage medium - Google Patents

Abstract

PROBLEM TO BE SOLVED: To utilize the storage capacity of the auxiliary storage medium to the utmost by performing control so that, when a relevant key is already registered in another table, the amount of data of the record of the relevant key is not added to the total capacity. SOLUTION: The key of a record to be downloaded from an index file corresponding to a file to the auxiliary storage medium 5 is selected and a table which is rearranged in the order of storage to the auxiliary storage medium 5 is generated. The total capacity is initialized to 0 and tables for holding the keys of other indexes relating to the key are initialized. The data capacity needed to download records registered in the table is added to the total capacity. When other keys relating to the key are present in other tables, it is considered that the data capacity relating to other files is already added and then nothing is added to the total capacity; when other keys are absent, other key records are extracted from other indexes, the data capacity of the records is added, and other keys are added to other tables.

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to an information processing apparatus, and more particularly to a method and apparatus for calculating a data capacity when storing data in an auxiliary storage medium in the information processing apparatus.

[0002]

2. Description of the Related Art When storing necessary data from a plurality of related files stored in a host device in storage media of a plurality of auxiliary storage devices, information consistency is maintained in the same storage medium. In addition, it is necessary to divide the data or the file into a plurality of pieces so that the data amount does not exceed the capacity of the storage medium.

For example, record data (data, tables, program codes, etc.) to be loaded from a plurality of files stored in a storage device such as a hard disk device of an information processing device as a host device into a target device such as a portable information terminal device. ) Is extracted and written to an auxiliary storage medium such as an FD (floppy disk) or a semiconductor memory, and when the data of the auxiliary storage medium is loaded into a target device such as a portable information terminal device, all relevant record data are stored. It is necessary to maintain the consistency of information within the same storage medium, such as being included, and it is necessary to divide the file so that the data amount does not exceed the capacity of the storage medium.

Similarly, even when required file data is transferred from the server device connected to the network to the client terminal side on the client side, in order to avoid the occurrence of overflow in the storage device on the client terminal side, it is necessary to avoid the occurrence of overflow. In light of the storage capacity of the storage device,
It is necessary to calculate the amount of data to be downloaded, and it is necessary to divide the file so that information consistency is maintained on the client side and the amount of data does not exceed the capacity of the storage medium. .

[0005] As a conventional method of calculating the file capacity, conventionally, the capacity of another file related to each record extracted from the file is calculated and added sequentially.
A method of storing data up to the capacity of the storage medium of the auxiliary storage device from each file of the host device in the storage medium of the auxiliary storage device is generally used.

As a publication concerning the file capacity calculation method, for example, Japanese Patent Laid-Open Publication No. 2-83637 is referred to. In this publication, data including a method of organizing data files and program storage files, record length, block length, and key information are set, an area required by the data file is determined based on the data, and the area is defined as a file. A configuration for securing the device has been proposed.

[0007]

However, in the above-mentioned conventional method, the data capacity calculated in advance is larger than the data capacity actually stored in the storage medium of the auxiliary storage device (referred to as "auxiliary storage medium"). In this case, the storage of data in the storage medium of the auxiliary storage device is stopped despite the fact that the storage medium of the auxiliary storage device has free space, and the storage of the auxiliary storage device is stopped. There is a problem that the capacity cannot be used effectively.

The reason is that, in the conventional method, the size of each related file is calculated for each record to be extracted, and the sizes are sequentially added. Calculates the data capacity already calculated twice, and as a result, doubles the data capacity,
Alternatively, the calculation is performed more multiplexly.

[0009] Therefore, the present invention has been made in view of the above-mentioned problems, and an object of the present invention is to extract only necessary data from a group of related files existing in a higher-level device to an auxiliary storage medium. Another object of the present invention is to provide a method and an apparatus for effectively utilizing the storage capacity of an auxiliary storage medium.

[0010]

In order to achieve the above object, the present invention provides a data amount calculating method for extracting record data of a plurality of files and storing the extracted record data in an auxiliary storage medium. Registering an extraction key and the number of records of the extraction key for each of the plurality of files in an index file; and (b) recording data extracted from the file and stored in the auxiliary storage medium in the auxiliary storage medium. Registering key information and record information in a table provided for the file in the order in which the keys are stored; and (c) storing the key registered in the table in another file associated with the key. If there is a key of the record (referred to as “related key”), the related key is Search whether or not the relevant key is registered in the other table, if the relevant key is not registered in the other table, add the data amount of the record of the relevant key to the total capacity, while the If the related key is already registered in the other table, controlling the data amount of the record of the related key not to be added to the total capacity as a duplicate. Things.

According to the present invention, there is provided an information processing apparatus having at least a plurality of files and an auxiliary storage device having an auxiliary storage medium, wherein record data extracted from the plurality of files is stored in the auxiliary storage medium. Means for registering the key information of a record obtained by adding the amount of data to be stored in the auxiliary storage medium to the total capacity in the storage means, and searching whether the key information exists in the table for a record newly extracted from the file. Means, if the key information is not present in the table, add the data amount of the record to the total capacity, while if the key information is already registered in the table, the record Means for calculating the data capacity without adding the data amount to the total capacity.

[0012]

Embodiments of the present invention will be described. The present invention, in a preferred embodiment thereof, comprises an index file having the number of records for each extraction key, and a work table (work table) holding the extraction candidate records, and while not exceeding the capacity of the auxiliary storage medium, Add the key of the record to be extracted from each file to the work table. When extracting records, a work table is created for each key, so that in calculating the capacity when there are a plurality of extracted keys, it is possible to reliably avoid calculating the capacity of the same data redundantly.

In a preferred embodiment, the apparatus according to the present invention comprises: a file apparatus including a plurality of files; an index file having the number of records for each extraction key; storage means for holding records of extraction candidates; Extracting the extraction key from the index file, extracting the record of the extraction key from one file, calculating the data capacity of the record of another file to be extracted at the same time, and determining the medium of the auxiliary storage device for storing each record A capacity calculating unit to be recorded in the storage unit; a record extraction unit that refers to the storage unit, extracts a record from each file of the file device, and writes the record to the determined medium of the auxiliary storage device; Is provided.

In the present invention, as long as the storage capacity of the medium of the auxiliary storage device is not exceeded, a key of a record to be extracted from each file is added to the storage means, and a table is created in the storage means for each key. When calculating the data capacity of the record of the another file, the capacity calculating means searches another table with another key related to the key, and the other key exists in the other table. In this case, nothing is added to the total capacity assuming that the data capacity relating to the other file has been added, and if the other key does not exist in the other table, the data of the other key is obtained from the other index. A record is searched, the data capacity of the record is added, and the other key is added to the other table.

In a preferred embodiment of the method according to the present invention, there are provided: (a) a process of previously obtaining the number of records for each key to be extracted for each of a plurality of files, and creating respective index files;
(B) Processing of selecting a key of a record to be downloaded to a target auxiliary storage medium from one index file corresponding to one file, and creating one table in which the keys are arranged in the order of extraction to the auxiliary storage medium (C) a process for initializing the auxiliary storage medium number, and (d) a process for updating the auxiliary storage number and controlling the following processing when the auxiliary storage medium number is equal to or less than a predetermined maximum value. ,
(E) Initializing the total capacity and initializing another table for holding a key of another index file related to the key, and (f) deleting a record registered in the one table. A process of adding the data capacity required for downloading to the total capacity; (g) when there is another key related to the key (referred to as “related key”), searching the other table with the related key ,
If the related key is present in the other table, nothing is added to the total capacity assuming that the data capacity of the other file for the related key has already been added to the total capacity, Does not exist in the other table, searching for the record of the related key from the other index file, adding the data capacity of the record of the related key, and adding the related key to the other table; (H) checking the total capacity, and if the total capacity is less than or equal to the storage capacity of the auxiliary storage medium, the process proceeds to step (f) for the next record of the one table; When the total capacity is larger than the capacity of the auxiliary storage medium, the processing of step (d) for the current record of the one table is shifted to step (d). To the processes of (i), the processing is realized by a program executed on a computer. In this case, the present invention is implemented by reading or receiving the program from a storage medium or medium that holds or stores the program in a computer device, installing the program in a computer, loading the program into main storage, and executing the program by a CPU. be able to.

According to the embodiment of the present invention, the data required for calculating the data to be extracted to the auxiliary storage medium is maintained by maintaining the consistency of the data in the auxiliary storage medium, maximizing the storage capacity of the auxiliary storage medium. The amount can be reduced.

[0017]

Next, in order to explain the above-mentioned embodiment of the present invention in more detail, an embodiment of the present invention will be described in detail with reference to the drawings. FIG. 1 is a diagram showing the configuration of one embodiment of the present invention.

Referring to FIG. 1, one embodiment of the present invention is:
A host device 1 having a plurality of related files (file # 1 to file #n), a capacity calculating unit 2 for calculating a data capacity, a work table 3 for holding extraction candidate records, and a record extracting unit 4 And an auxiliary storage device 5 for storing the extracted data.

The data capacity calculation means 2 extracts key information from the index file of the host device 1, calculates the data capacity of the record of another file to be extracted at the same time, and determines the auxiliary storage medium number from which each record is to be extracted. , In the work table 3.

The record extracting means 4 includes a work table 3
, A record is extracted from each file of the host device 1 and written to an appropriate auxiliary storage medium 5.

FIG. 2 is a flowchart showing a processing procedure according to one embodiment of the present invention. Referring to FIG. 2, one embodiment of the present invention includes the following steps.

Step S1: The number of records for each key of a plurality of files is calculated in advance, and each index file is created.

Step S2: A key of a record to be downloaded to the auxiliary storage medium is selected from one index file corresponding to one file, and one table is created in which the keys are arranged in the order of storage in the auxiliary storage medium.

Step S3: If there is no unprocessed key in the one table, the process is terminated.

Step S4: Initialize the auxiliary storage medium number.

Step S5: Update the auxiliary storage medium number.

Step S6: If the auxiliary storage medium number exceeds the maximum value, the processing is terminated.

Step S7: The total capacity is initialized to 0, and another table for holding a key of another index related to the key is initialized.

Step S8: The data capacity required to download the records registered in one table is added to the total capacity.

Step S9: The other table is searched with another key related to the key.

Step S10: As a result of the search, if the other key exists in the other table, it is assumed that the data capacity relating to the other file has been added, and nothing is added to the total capacity.

Step S11: On the other hand, if the other key does not exist in the other table, a record of the other key is extracted from the other index, and the data capacity of the record is added to add the other key. Is added to the other table.

Step S12: Check the total capacity,
If the total capacity is equal to or less than the storage capacity of the auxiliary storage medium, the process proceeds to step S8 for the next record of the one table. On the other hand, when the total capacity is larger than the capacity of the auxiliary storage medium, the process proceeds to step S5 for the current record of the one table.

FIG. 3 is a schematic diagram for specifically explaining the operation of one embodiment of the present invention. The overall operation of the present embodiment will be described in detail with reference to FIG.

The capacity of the data to be downloaded to the auxiliary storage medium is calculated as follows. For simplicity of description, a case where there are two types of keys will be described as an example.

File 10 (key 12) and file 2
The number of records for each key of 0 (key 22) is calculated in advance, and the indexes 11 and 21 are respectively calculated.
Is prepared (steps (a) and (b)).

The key of the data to be downloaded is extracted from the index 11, and a table 30 is created in which the extracted keys are arranged in the order of extraction to the auxiliary storage medium (step (c)).

The auxiliary storage medium number is set to 0 as an initial value (the auxiliary storage medium number starts from 1).

The auxiliary storage medium number is incremented by 1, and the total capacity and the table 40 are initialized.

The data capacity of the file 10 necessary for downloading one record of the table 30 is added to the total capacity (step (d)).

Referring to a related key table 50 in which the relationship between the record of the key of the file 10 and the record of the key of the file 20 is registered in advance, if the key 22 related to the key 12 exists, 40 is searched (step (e)). In the example shown in FIG.
The key of the related information of the record of “2” is “x” and “y”. This relationship indicates that, for example, when processing the record data with the key “A2” (the record in the file 10), the record data with the key of the related information “x” and “y” (the record in the file 20) is required. It represents that.

When the key 22 exists in the table 40,
Since the data capacity of the file 20 has already been added, nothing is performed.

If the key 22 does not exist in the table 40, the record of the key 22 is searched from the index 21, the data capacity is added, and the key 22 is added to the table 40 (step (f)).

The total capacity is checked (step (g)).

When the total capacity is equal to or less than the capacity of the auxiliary storage medium, the processing is repeated from the step (e) for the next record in the table 30.

When the total capacity is larger than the capacity of the auxiliary storage medium, the auxiliary record medium number is added to the current record of the table 30 by 1, and the total capacity and the table 40
Is repeated from the process of initializing.

The above-described embodiment can of course be applied to the calculation of the data amount in downloading a file from a server device to a client terminal or the like.

[0048]

As described above, according to the present invention, the following effects can be obtained.

A first effect of the present invention is that accurate capacity calculation can be performed. The reason is that the capacity calculation is not repeated for the same record.

A second effect of the present invention is that the speed of the data extraction process can be increased.

The reason is that by providing each table with the storage location of the actual data and the information of the auxiliary storage medium to be downloaded, the data can be extracted only by referring to each table at the time of downloading. .

[Brief description of the drawings]

FIG. 1 is a diagram showing a configuration of an embodiment of the present invention.

FIG. 2 is a flowchart showing a processing procedure according to an embodiment of the present invention.

FIG. 3 is a schematic diagram for explaining the operation of one embodiment of the present invention.

[Explanation of symbols]

 DESCRIPTION OF SYMBOLS 1 Upper device 2 Capacity calculation means 3 Work table 4 Record extraction means 5 Auxiliary storage medium 10, 20 File 11, 21 Index (file) 30, 40 Table 50 Association (key) table

Claims (8)

[Claims] 1. A data amount calculation method for extracting record data from a plurality of files and storing the extracted record data in an auxiliary storage medium, comprising: (a) an extraction key for each of the plurality of files; Registering the number of records of the extracted key in an index file; and (b) storing the key information and the record information in the order in which the record data extracted from the file and stored in the auxiliary storage medium are stored in the auxiliary storage medium. Registering in a table provided for the file; (c) for a key registered in the table, a key of a record stored in another file related to the key (referred to as “related key”) If present, whether the relevant key is registered in another table provided for the other file If the related key is not registered in the other table, the data amount of the record of the related key is added to the total capacity of the accumulated data, while the related key is already registered in the other table. And controlling the data amount of the record of the related key not to be added to the total capacity as a duplicate when registered in the data amount calculation method. 2. A method according to claim 1, wherein record data is extracted from a plurality of files stored in a first storage device of the first information processing device, and the extracted record data is stored in a second storage device of the first information processing device. In the method for calculating a data amount in the first information processing device when storing in a second storage device of a storage device or a second information processing device connected to the first information processing device, Registering an extraction key and the number of records of the extraction key for each of the plurality of files in the first storage device in an index file; (b) extracting from the file and storing in the second storage device Registering key information and record information for the record data to be performed in a table provided for the file; If there is a key of a record stored in another file related to the key (referred to as “related key”), whether or not the related key is registered in another table provided for the other file If the related key is not registered in the other table, the data amount of the record of the related key is added to the total capacity of the accumulated data, while the related key is already registered in the other table. And controlling the data amount of the record of the related key not to be added to the total capacity as a duplicate when registered in the data amount calculation method. 3. A method comprising: (a) obtaining the number of records for each extraction key for each of a plurality of files in advance and creating respective index files; and (b) determining the number of records from one index file corresponding to one file. Selecting a key of a record to be downloaded to the auxiliary storage medium to be downloaded, and creating a table in which the keys are arranged in the order in which the keys are extracted to the auxiliary storage medium; and (c) initializing an auxiliary storage medium number. (D) updating the auxiliary storage number and, if the auxiliary storage medium number is equal to or less than a predetermined maximum value, controlling to perform the following processing; and (e) initializing the total capacity, Initializing another table to hold a key of another index associated with the key; (f) the one table Adding the data capacity required to download the records registered in the key to the total capacity; and (g) if there is another key related to the key (referred to as “related key”), the related key In the other table, if the related key exists in the other table, the data capacity of the other file related to the related key is regarded as being already added to the total capacity and is added to the total capacity. Does not add anything, while if the related key does not exist in the other table, retrieves the record of the related key from the other index file, adds the data capacity of the record, and further adds (H) checking the total capacity, and if the total capacity is less than or equal to the storage capacity of the auxiliary storage medium, Moving to step (f) for the next record registered in the one table; and (i) when the total capacity is larger than the capacity of the auxiliary storage medium, For the current record in the table,
And (c) shifting to the processing of step (d). 4. An information processing apparatus comprising at least a plurality of files and an auxiliary storage device provided with an auxiliary storage medium, wherein when storing record data extracted from the plurality of files in the auxiliary storage medium, Means for registering, in the storage means, key information of a record obtained by adding the amount of data to be stored in the auxiliary storage medium to the total capacity; and searching for whether or not the key information exists in the table for a record newly extracted from the file. Means, if the key information does not exist in the table, add the data amount of the record to the total capacity, while if the key information is already registered in the table, Means for calculating the data volume without adding the data volume of the record to the total volume, an information processing apparatus comprising: . 5. A file device comprising a plurality of files and an index file having the number of records for each extraction key; storage means for holding a record of an extraction candidate; extracting an extraction key from the index file; The key record is extracted from one file, the data capacity of the record of the other file to be extracted at the same time is calculated, the medium of the auxiliary storage device for storing each record is determined, and the capacity to be recorded in the storage means is calculated. Means for extracting a record from each file of the file device with reference to the storage device, and writing the record to a medium of the determined auxiliary storage device. apparatus. 6. A storage device for storing a relationship between a key of a certain file and a key of another file, wherein the second storage unit stores the relationship between the key of the file and the key of another file. A key of a record to be extracted from each file is added, a table is created in the storage unit for each key, and the capacity calculation unit calculates a data capacity of a record extracted from one file and stored in the auxiliary storage medium. When referring to the second storage means, if there is a related key of another file related to the key of the record, another table provided corresponding to the other file with the related key If the relevant key is already registered in the other table, it is assumed that the data capacity relating to the other file has been added, and nothing is added to the total capacity. When the key does not exist in the other table, searching for the record of the other key from the other index file, adding the data capacity of the record, and adding the related key to the other table. The information processing apparatus according to claim 5, wherein: 7. An information processing apparatus extracts record data from a plurality of files stored in a storage device, and stores the extracted record data in another storage device of the information processing device or the information processing device. Means for registering, in an index file, an extraction key and the number of records of the extraction key for each of the plurality of files when storing the information in a storage device of another information processing device connected to the storage device (referred to as “other storage device”) And key information and record information about the record data extracted from the file and stored in the other storage device,
Means for registering in a table provided for the file; and for a key registered in the table, a key of a record stored in another file related to the key (referred to as “related key”) exists. If the related key is registered in another table provided for the other file, a search is performed to determine whether the related key is not registered in the other table. Add the amount of data to the total amount of stored data,
On the other hand, when the related key is already registered in the other table, means for controlling the data amount of the record of the related key so as not to be added to the total capacity as a duplicate. An information processing apparatus characterized by the above-mentioned. 8. (a) The number of records for each key to be extracted is determined in advance for each of a plurality of files,
(B) selecting a key of a record to be downloaded to a target auxiliary storage medium from one index file corresponding to one file, and extracting the keys to the auxiliary storage medium (C) processing for initializing the auxiliary storage medium number, (d) updating the auxiliary storage medium number, and when the auxiliary storage medium number is equal to or less than a predetermined maximum value, (E) Initializing the total capacity and initializing another table for holding a key of another index file related to the key, (f) the above-mentioned processing. Processing of adding the data capacity required to download records registered in one table to the total capacity; (g) other related to the key If a key (referred to as “related key”) exists, the other table is searched by using the related key, and if the related key exists in the other table, the other table is searched for the related key of the other file. Nothing is added to the total capacity assuming that the data capacity has already been added to the total capacity, while if the related key does not exist in the other table, the data of the related key is obtained from the other index file. Search for a record,
Adding the data capacity of the record and additionally registering the related key in the another table; and (h) checking the total capacity, and when the total capacity is equal to or less than the storage capacity of the auxiliary storage medium, Step (f) for the next record registered in the one table
And (i) when the total capacity is larger than the capacity of the auxiliary storage medium, for the current record of the one table,
A recording medium for recording a program for executing, on a computer, each of the above-described processes (a) to (i) of the process of shifting to step (d).