JPH03127238A - Method and device for control of data - Google Patents

Abstract

PURPOSE:To perform the input/output of data with no interruption in an input/ output state by controlling a data storage area in a block to the fixed value of a proper size via an adjustment means. CONSTITUTION:A data controller consists of a storage means 1, an input/output means 2, and a control means 3. The means 3 includes a data control means 4 which controls the data on the means 1 in plural blocks of a fixed size, a block control means 5 which controls those blocks as a single file, and an adjustment means 6 which receives the information from both means 4 and 5 and drives the means 2 to transfer the data on the blocks adjacent logically to each other. Then the means 6 controls the quantity of data stored in the blocks to the fixed value of a proper size, and a buffer of a proper size is provided to the means 2. Thus it is possible to perform the input/output of data with no interruption in an input/output state.

Description

[Detailed Description of the Invention] The present invention relates to a data management device and a data management method for managing large amounts of data as files. It is also used for processing digital audio data and digital video data.
Although there is a growing demand to manage large amounts of data as files on computers and perform processing such as editing at high speed, what is particularly important in this case is a data management device that manages data in a format that can be processed at high speed. Conventional examples of the data management device and data management method described above are explained below with reference to the drawings. Figure 2 shows a conventional data management device. 2 is a conceptual diagram of the configuration of a conventional data management device to explain the data management method. In FIG. Hand washing 23 is a management means for managing data on the storage means 21 via the input/output means 22 24 in the management means 23 is the storage means 21
25 is a block management method that manages multiple blocks as one file, which is the conventional data management method configured as described above. The operation of the device and conventional data management methods will be explained.

The data management means 24 in the management means 23 manages continuous areas on the storage means 21 as blocks. The block management means 25 receives information such as the storage position of each block on the storage means 21 from the data management means 24 and stores it in an al file.
The logical connection information etc. are managed so that the block is composed of a plurality of blocks.

When accessing and outputting a file, the management means 23 first refers to the block connection information for each file managed by the block management means 25, and then data the position information of each block on the storage means 21. The management means 24 drives the input/output means 22 to sequentially access each block on the storage means 21 and sequentially output the data of each block constituting the file from the storage means 21.

Problems to be Solved by the Invention However, there are several problems when handling data such as digital audio data and digital video data that require seamless processing during input and output. have.

First, the storage means 21 commonly used are magnetic disks, optical disks, etc.These storage means require seek when accessing data. When handling data that requires continuous processing during input/output, such as digital audio data or digital image data, the input/output means 22 On top of that, there is the problem of requiring a large capacity buffer to absorb the uncertain seek time. Reduce seek time
In this case, it is extremely difficult to modify or change part of a file while maintaining the continuity of the physical arrangement of data on the storage means 21, and it is possible to input and output data without interruption. Ability to rearrange data\correction Take time when making changes and store optimal continuous area in storage means 2
In view of the above problems, the present invention solves the problem of having to re-secure the data on the computer and rearrange the data. It is an object of the present invention to provide a data management device and a data management method for managing files as files and processing the same at high speed and easily. It is composed of a storage means for storing data, an input/output means for inputting/outputting data to/from the storage means, and a management means for managing the storage location of data on the storage means. A data management means for managing a contiguous area of any size as a block, and a data management means for logically dividing and managing a block into a plurality of areas, and one or more areas stored at an arbitrary position on the storage means. a block management means for managing the blocks so that one file is configured, and an adjustment means for receiving information from the block management means and the data management means, driving the input/output means, and moving data of logically adjacent blocks. Based on the above-described configuration, the data management means manages continuous areas on the storage means as blocks, and further manages the blocks by dividing them into a data storage area and a free area. There is. The block management means receives information such as the storage position of a block on the storage means from the data management means, and manages linkage information etc. to configure one file from one or more blocks. Find the size of data storage for any block. If the size of the data storage area of this block is smaller than the preset value (2) Receives information such as storage location information on the storage means of adjacent blocks constituting the file from the block management means, and receives these information from the data management means. After receiving the information regarding the size of the data storage area and the free space of the adjacent block, the adjustment means drives the input/output means to move part or all of the data from one or more adjacent blocks to the corresponding block. , which always adjusts the size of the data storage area in the corresponding block to a value greater than a preset value. It is possible to provide a data management device and a data management method for managing files as files and processing them at high speed and easily.Example The following describes a data management device and a data management method according to an embodiment of the present invention. Referring to the drawings, FIG. 1 is a conceptual diagram showing the configuration of a data management device in one embodiment of the present invention.

In Figure 1, l is the memory capacity for storing data 2
3 is an input/output means for inputting and outputting data to and from the storage means 1, and 3 is a management means for managing data on the storage means 1 via the input/output means 2. 4 in the management means 3 is data on the storage means 1. 5 is a block management function that manages a plurality of blocks as one file. 6 is a block management function that manages a plurality of blocks as a single file. 6 receives information from the data management means 4 and the block management means 5. This adjustment means drives the input/output means 2 and moves data of logically adjacent blocks.

FIG. 3 shows a conceptual diagram of a plurality of blocks constituting part of a file on the storage means l shown in FIG. 1. In FIG. Even though they represent blocks arranged discretely above, they are logically adjacent and form part of the file. The inside of a block is divided into multiple areas, and the colored areas like 38 to 41 are the data storage areas where data is stored @ blank areas like 42 to 45 Although 46 represents an empty area where no data is stored, and 46 represents the size of the data storage area that is adjusted to a constant value by the adjustment means 6, FIG. In FIG. 4, which shows another conceptual diagram of a plurality of blocks constituting the Even though it is adjacent to the block and forms part of the file, the inside of the block is divided into multiple records, and records colored like 58 are data storage records where data is stored, like 59. 60 indicates the number of data storage records to be adjusted to a constant value by the adjustment means 6. The data of the present invention is calculated based on FIGS. 1 and 3. The operation of the management device and the data management method will be explained.The data management means 4 in the management means 3 manages continuous areas on the storage means 1 as blocks, some of which are blocks 31 to 3.
It is conceptually shown as 7.

The data management means 4 manages the block by further logically dividing it into a data storage area and a free area. Block 3■ Inside the block, there is a data storage area 38 where data is stored and an empty area 42 where no data is stored.
In this figure, the data storage area starts from the beginning of the block, but it can also start from the middle of the block. In addition, there may be a plurality of data storage areas and free areas in a block (~Also, the size of the free area may be O).
Figure 5 shows an example of the operation flow of the adjustment means 6. This will be explained with reference to FIG.

The adjustment means 6 receives information regarding the size of the data storage area of a given block from the data management means 4, and if the size of the data management area of this block is smaller than a certain value, the adjustment means 6 receives information from the block management means 5 about the size of the data storage area of an arbitrary block. After receiving information about the data storage area and free area size of adjacent blocks from the data management means 4, the adjustment means 6 adjusts part or all of the data from one or more adjacent blocks. The input/output means 2 is driven to move to the block, and the size of the data storage area in the block is always adjusted to be above a certain value.

Now, set the block size to 16 bytes and adjust means 6
Assuming that the constant value of the size of the data storage area in the block to be adjusted is set to 12 bytes, Figure 3 (a) shows that the size of the data storage area is set to a constant value by changing the file. The size of the data storage area of block 31 is 4 bytes, the size of the data storage area of block 32 is 14 bytes, and the size of the data storage area of block 33 is 12 bytes.
k bytes, the size of the data storage area of block 34 is 1
2nd is part time job. The data storage area of block 31 is 4
The adjustment means 6 obtains information regarding logically adjacent blocks 32 and subsequent blocks from the data management means 4 and the block management means 5. The adjusting means 6 adds the sizes of the data storage areas of adjacent blocks and sequentially inspects the adjacent blocks until the addition result satisfies the condition that it is larger than a multiple of a set constant value and smaller than a multiple of the block size. In the example shown in Fig. 3, if ζ is checked up to block 33, the addition result of the data storage area size becomes 1, 4, +14, +12, = 30, and 1
It satisfies the condition that it is larger than 2kx2=24 and smaller than 16kx2=32. Adjustment means 6 is block 3
1k bytes of data are moved from block 2 to block 31 to create block 35. Also, bytes are moved from block 33 to block 32 to 12 to create block 36.

There is no need to change I,% after block 34. In this way, the adjusting means 6 changes the plurality of blocks illustrated in FIG. 3(a) as shown in FIG. 3(b), and the data storage area in the block. Adjust the size so that it is above a certain value.

The operation and data management method of the data management device in another embodiment of the present invention will be explained based on FIG. 1 and FIG. 4. is managed as a block, a part of which is conceptually shown as blocks 51 to 57, and the data management means 4 further logically divides the block into one or more data storage records and zero or more free records. Even if you manage them separately, colored records like record 58 are records that store data.
A blank record such as record 59 is an empty record in which no data is stored, but it is also possible to use a variable-length record, although the figure shows a fixed-length record. The data storage record may start from the middle of the block, or it may not be continuous within the block.The block management means 5 receives information such as the position of each block on the storage means 1 from the data management means 4. ? & Manage logical connection information etc. so that one file is composed of one or more blocks.

FIG. 6 shows another example of the operation flow of the adjustment means 6. As will be explained below with reference to FIG. 6, the adjustment means 6 receives information regarding the number of data storage records of an arbitrary block from the data management means 4, and if the number of data storage records of this block is smaller than a certain value, Information about adjacent blocks constituting a file is received from the block management means 5, and information regarding the number of data storage records and free records of the adjacent blocks is received from the data management means 4. Thereafter, the adjusting means 6 drives the input/output means 2 to move records from one or more adjacent blocks to the corresponding block, and adjusts the number of data storage records in the corresponding block to always be above a certain value.

Now, let the number of records in the block be 12, adjustment means 6
Suppose that the number of data storage records in the block that is being adjusted is set to 8 records. Figure 3 (
A) shows a state in which a block in which the number of data storage records does not correspond to a constant value occurs due to a change in the file. The number of data storage records in block 31 is 4, the number of data storage records in block 32 is 10, block 3
Even though the number of data storage records in block 1 is 8 and the number of data storage records in block 31 is 8, the number of data storage records in block 31 is 4, which does not satisfy the set constant value 8. Information regarding the logically adjacent blocks 32 and subsequent blocks is obtained from the data management means 4 and the block management means 5.The adjustment means 6 adds the numbers of data storage records of the adjacent blocks, and the addition result is set as a constant. Adjacent blocks are sequentially inspected until the condition of being larger than a multiple of the value and smaller than a multiple of the block size is satisfied. In the example, when checking up to block 33, the addition result of the number of data storage records is 4+10+8=22, 8X2=16
It satisfies the conditions that it is larger and smaller than 12X2=24. The adjusting means 6 moves 7 records of data from block 32 to block 31 to form block 35, and also moves 8 records from block 33 to block 32 to form block 36. No changes are made after block 34. In this way, the adjustment means 6 changes the plurality of blocks illustrated in FIG. 3(a) as shown in FIG. 3(b), and adjusts the number of data storage records in the block to be equal to or greater than a certain value. Also, when a block is divided into multiple fixed-length records, the unit of data movement between blocks is limited to records.
The amount of information managed by the data management means 4 can be reduced.

The storage means l may be a secondary storage device such as a magnetic disk or an optical disk, which is used in the film.
y) A nail that requires a seek when accessing each block.As in the data management device and data management method of the present invention, the amount of data in the block is managed to a constant value of an appropriate size by the adjustment means 6, Appropriate size The amount of data during reblocking can be set arbitrarily.
The formula (
It is also possible to determine as in 1).

Lb = vo −vr −Ta/ (vr−vo
) (1) In formula (1), Lb is the size of the data storage area (bytes),
VO is the data output speed i, Vr is the disk transfer rate (by 1 second), and Ta is the disk access time (seconds).The disk access time to storage means 1 is 52ms, and the disk transfer rate is 960 bytes, which is quite standard. Assuming that a magnetic disk is used, and if the continuous output speed of data from the input/output means 2 requires 170 bytes, the size of the data storage area only needs to be 11 bytes or more. Now, it is assumed that one access to the storage means l will output one block of data, lJ<, it is also possible to input and output two or more blocks.Data management device and data management method of the present invention The data management means 4 allows the existence of free space in the blocks managed by the data management means 4.Increases and decreases in data caused by file editing can be easily absorbed by simply changing one part of the file.
There is no need to rearrange data periodically (Let EO be the data storage area size of a block where one data storage area is not a constant value, and let El be the data storage area size of a block that logically follows this block. E2,...
Ej, and the sum of these is expressed as Sj. If the constant value adjusted by the adjusting means 6 is Rmin, and the block size is Rmax, is it sufficient to make the size of the data storage area in all blocks greater than or equal to Rmin and less than or equal to Rmax? By calculating, we can calculate the number j+1 of blocks required to adjust the blocks whose data storage area size does not meet the constant value Rmln.
x(2) In Equation (2), even if N is an integer greater than or equal to 1, 0<Rmin<Rmax, 0≦SO<Rmin, so it is possible to prove Equation (3) from Equation (2). .

J ≦ Rmax/ (Rmax-Rmin) (
3) From equation (3), since j determined from the data storage area size Rmin and block size Rmax represents a finite number, the adjusting means 6 moves data from a finite number of blocks to store data in all blocks. It is possible to keep the size of the area above a certain value.

For the final block that makes up the file,
Since there is no need to consider the seek time to the next block, the size of the data storage area can be smaller than a certain value (in addition, the size of the data storage area and the number of data storage records adjusted by the adjustment means differ for each file. In that case, the block management means 5 retains this information, but the data management device and data management method of the present invention have the advantage that the data storage area in the block is appropriately allocated by the adjustment means. By managing the size to a constant value, data can be input/output without interruption during input/output.

In addition, since the data management means allows the existence of free space within the blocks managed by the data management means, it is possible to easily absorb increases and decreases in data caused by file editing by simply changing one part of the file. There is no need to rearrange the data, and even large amounts of data can be processed at high speed.

Therefore, we have developed a data management device and a data management method for managing large-volume data that requires continuous processing during input/output as files on a computer and processing it quickly and easily. It is also possible to provide

[Brief explanation of the drawing]

Fig. 1 shows a structural concept explaining a data management device and data management method in an embodiment of the present invention & Fig. 2 shows a structural concept explaining a conventional data management device and data management method
Figure 3 shows a concept for explaining blocks managed by one embodiment. Figure 4 shows a concept for explaining blocks managed by another embodiment. Figure 5 shows coordination in the present invention. A flowchart showing one example of the operation flow of the means, and FIG. 6 is a flowchart showing another example of the operation flow of the adjustment means of the present invention! ...Storage means, 2.Input/output means, 3..
Management means, 4... Data management performance 5... Block management method 6... Adjuster ratio 21... Memory performance 2
2... Input/output method 23... Management method 24... Data management performance 25... Block management method 31, 3
2, 33, 34, 35, 36, 37...Prokkyu 3
8, 39, 40.41...Data storage area 42, 4
3, 44, 45...Free space 46...Size of storage area to be adjusted X51.52.53.54.55.56.
57...Block 58...Data storage record,
59...Empty record, 60...Parent of data storage record to be adjusted

Claims (1)

[Scope of Claims] (1) Consisting of a storage means for storing data, an input/output means for inputting and outputting data to and from the storage means, and a management means for managing data on the storage means, the management means Further, data management means manages a continuous area of any size on the storage means as a block and divides the block into a plurality of areas, and stores data at an arbitrary position on the storage means. a block management means for managing a plurality of pieces of concatenated information of one or more blocks that have been input; Drives the output means to transfer data from any block to any block on the storage means.
1. A data management device comprising: adjustment means for moving part or all of the data management device. (2) The data management device according to claim 1, wherein the data management means divides the inside of the block into a data storage area in which data is stored and a free area. (3) the adjustment means obtains information regarding the size of the data storage area in the block and the size of the data storage area in adjacent blocks from the block management means and the data management means;
Drives the input/output means and extracts data from adjacent blocks.
3. The data management device according to claim 2, wherein the size of the data storage area is adjusted to a certain value or more by moving part or all of the data storage area. (4) The data management device according to claim 3, wherein the adjustment means adjusts the size of the data storage area in the block to a certain value or more that differs for each group managed by the block management means. (5) The data management device according to claim 1, wherein the data management means divides the inside of the block into one or more data storage records storing data and zero or more empty records. (6) The adjustment means determines the number of data storage records in the block from the block management means and the data management means;
Obtain information regarding the number of data storage records in adjacent blocks, drive the input/output means, and adjust the number of data storage records to a certain value or more by moving one or all records from the adjacent blocks. The data management device according to claim 5, characterized in that: (7) The data management device according to claim 6, wherein the adjustment means adjusts the number of data storage records to a predetermined value or more that is different for each group managed by the block management means. (8) Claim 3, wherein the input/output means inputs/outputs one or more blocks of data on the storage means in one access.
Data management device as described. (9) Claim 6, wherein the input/output means inputs/outputs one or more blocks of data on the storage means in one access.
Data management device as described. (10) The data management means manages a continuous area on the storage means as a block, further divides and manages the block into a data storage area and a free area, and the block management means manages one or more continuous areas on the storage means. The adjustment means manages a plurality of block connection information, and receives information regarding the size of the data storage area of an arbitrary block from the data management means, and if the size of the data storage area of this block is smaller than a preset value, The adjustment means obtains block concatenation information from the block management means, receives information regarding the data storage area and free area size of adjacent blocks from the data management means, and then drives the input/output means to 1 of data from adjacent blocks of
By moving part or all to the corresponding block,
A data management method characterized by adjusting the size of a data storage area in a corresponding block to a value greater than or equal to a preset value. (11) The data management means manages a continuous area on the storage means as a block, and further divides and manages the block into one or more data storage records and zero or more free records, and the block management means 1 on the storage means
The adjustment means receives information regarding the number of data storage records of an arbitrary block from the data management means, and the adjustment means receives information regarding the number of data storage records of an arbitrary block from the data management means, and the adjustment means receives information regarding the number of data storage records of an arbitrary block from the data management means, and the adjustment means If it is, the adjustment means obtains block concatenation information from the block management means, receives information regarding the number of data storage records and free records of adjacent blocks from the data management means, and then the adjustment means drives the input/output means. , a data management method characterized by adjusting the number of data storage records in a corresponding block to a preset value or more by moving one or all records from one or more adjacent blocks to the corresponding block. .