JP5540516B2 - Information processing system, information processing apparatus, data storage method, and program - Google Patents

Description

  The present invention relates to an information processing system, an information processing apparatus, a data storage method, and a program for storing data.

  In general, a storage element such as a memory for storing data has a limit in the capacity that can be stored. In the information-oriented society in recent years, the amount of data to be processed is enormous, and the amount of data often exceeds the capacity of the memory provided in the information processing apparatus.

  Therefore, a method is generally used in which an external storage device is connected to the outside of the information processing device, and data that cannot be stored in the memory provided in the information processing device is stored in the external storage device.

  However, since the access speed from the information processing device to the external storage device is very low compared to the access speed from the information processing device to the memory included in the information processing device, the access speed is stored in the external storage device by the information processing device. In the case of performing processing using the acquired data, it cannot be processed at high speed.

  Therefore, a technique for moving data stored in a memory (internal storage device) included in the information processing apparatus to an external storage device in accordance with the data reference frequency is considered (see, for example, Patent Document 1). .

Japanese Patent Publication No. 7-104867

  However, the technique described in Patent Document 1 is based on the premise that all data is stored in an external storage device, and data stored in the internal storage device and data stored in the external storage device. There is a problem of having to synchronize with.

  An object of this invention is to provide the information processing system, information processing apparatus, data storage method, and program which solve the subject mentioned above.

The information processing system of the present invention
In an information processing system including an external storage device that stores data and an information processing device that is connected to the external storage device and includes a memory that can be accessed at higher speed than access to the external storage device.
The information processing apparatus divides the data into groups of a predetermined unit and stores them in the memory, and sets a predetermined time as a time when the group stored in the memory is not continuously accessed. If the elapsed time of 1 coincides, the group is compressed and stored in the memory, and thereafter, the time when the access to the group is not continued and the preset second elapsed time coincide. In this case, the group is moved to the external storage device.

The information processing apparatus of the present invention
An information processing apparatus connected to an external storage device for storing data,
A memory that is accessible at a higher speed than access to the external storage device, and divides and stores the data into groups of predetermined units;
The time when the group stored in the memory is not continuously accessed is measured, and when the measured time coincides with a preset first elapsed time, the group is compressed. And a controller that moves the group to the external storage device when the measured time and a preset second elapsed time coincide with each other.

Further, the data storage method of the present invention includes:
A data storage method in which data is divided into groups of a predetermined unit and stored in a first storage unit and a second storage unit that can be accessed at higher speed than access to the first storage unit. ,
A process of measuring a time during which access to the group stored in the second storage unit is not continuously performed;
A first comparison process for comparing the measured time with a preset first elapsed time;
As a result of the first comparison process, when the measured time matches the first elapsed time, a process of compressing the group and storing it in the second storage unit;
Then, a second comparison process for comparing the measured time with a preset second elapsed time;
As a result of the second comparison process, when the measured time and the second elapsed time coincide with each other, the group is moved to the first storage unit.

The program of the present invention is
A program that is connected to an external storage device that stores data and that is executed by an information processing device having a memory that can be accessed at a higher speed than access to the external storage device,
Dividing the data into groups of predetermined units and storing them in the memory;
A procedure for measuring a time during which access to the group stored in the memory is not continuously performed;
A first comparison procedure for comparing the measured time with a preset first elapsed time;
As a result of the first comparison procedure, if the measured time and the first elapsed time coincide with each other, a procedure for compressing the group and storing it in the memory;
Then, a second comparison procedure for comparing the measured time with a preset second elapsed time;
If the measured time and the second elapsed time coincide with each other as a result of the second comparison procedure, a procedure for moving the group to the external storage device is executed.

  As described above, in the present invention, data is stored in a predetermined unit in an information processing apparatus including a memory that is connected to an external storage device that stores data and that can be accessed at higher speed than access to the external storage device. When the time when the access to the group stored in the memory is not continuously performed and the preset first elapsed time coincide with each other, the group is compressed. Stored in the memory, and then the group is moved to the external storage device when the time when the access to the group is not continued and the second elapsed time set in advance coincides. It is possible to easily maintain high-speed access to frequently used data.

It is a figure which shows one Embodiment of the information processing system of this invention. It is a figure which shows an example of the internal structure of the control part shown in FIG. It is a figure which shows an example of the parameter stored in memory or an external storage device with each column. It is a figure which shows an example of the parameter set as a system. It is a figure which shows an example of the parameter stored about columns 1-5. It is a figure which shows a mode that each parameter was stored in the memory and the external storage device for every column. It is a flowchart for demonstrating the data storage method in this form. It is a figure which shows the mode of the transition about the parameter about the column 1, a state, and a storage location. It is a figure which shows the mode of the scale-down of the parameter 3 when the parameter 3 reaches the parameter 8. It is a flowchart for demonstrating the process when the search process with respect to a column is requested | required. It is a figure which shows an example of the column data stored in ascending order. It is a flowchart for demonstrating the process which specifies the range of the actual data to decompress | decompress (to a non-compression state).

  Embodiments of the present invention will be described below with reference to the drawings.

  FIG. 1 is a diagram showing an embodiment of an information processing system of the present invention.

  As shown in FIG. 1, this embodiment includes an information processing device 100 and an external storage device 200.

  The information processing apparatus 100 processes desired data. Further, data to be held is written to the external storage device 200. Further, the data stored in the external storage device 200 is read.

  The external storage device 200 is a first storage unit that stores data written from the information processing device 100.

  In addition, the information processing apparatus 100 is provided with a control unit 110 and a memory 120.

  The control unit 110 processes desired data. Further, the control unit 110 writes data to be held in the memory 120 or the external storage device 200. At this time, the control unit 110 writes the data by dividing it into groups of a predetermined unit. In addition, the control unit 110 reads data stored in the memory 120 or the external storage device 200. In addition, the control unit 110 moves data (group) determined based on a predetermined calculation among the data stored in the memory 120 to the external storage device 200.

  The memory 120 is a second storage unit that stores data written from the control unit 110. Further, since the memory 120 is provided in the information processing apparatus 100 provided with the control unit 110, the access speed from the control unit 110 to the memory 120 is higher than the access speed from the control unit 110 to the external storage device 200. It is fast.

  FIG. 2 is a diagram illustrating an example of an internal configuration of the control unit 110 illustrated in FIG.

  As shown in FIG. 2, the control unit 110 shown in FIG. 1 includes a timer 111, comparison units 112 and 114, a compression unit 113, a moving unit 115, a counter 116, and a priority setting unit 117. It has been. FIG. 2 shows only the components related to the present invention among the components of the control unit 110 shown in FIG.

  The timer 111 measures the time during which access to the data (group) stored in the memory 120 is not performed.

  The comparison unit 112 is a first comparison unit that compares the time measured by the timer 111 with a preset first elapsed time.

  When the time measured by the timer 111 coincides with the first elapsed time as a result of the comparison in the comparison unit 112, the compression unit 113 reads the data (group) from the memory 120, compresses it, and stores it again in the memory 120. To do.

  The comparison unit 114 compares the time measured by the timer 111 with a preset second elapsed time for the data (group) compressed in the compression 113 and stored in the memory 120. It is. Note that the function of the comparison unit 114 may be performed by the comparison unit 112.

  When the comparison unit 114 compares the time measured by the timer 111 with the second elapsed time, the moving unit 115 reads the data (group) from the memory 120 and writes it to the external storage device 200. That is, the group is moved from the memory 120 to the external storage device 200.

  The counter 116 counts the number of times the group stored in the memory 120 is accessed.

  When there are a plurality of groups to be compressed by the compression unit 113 or a group to be moved by the moving unit 115, the priority order setting unit 117 sets the priority of compression or movement based on the number of times counted by the counter 116.

  Hereinafter, the above-described group will be described as a “column”. The column number is given in advance to identify the column.

  FIG. 3 is a diagram illustrating an example of parameters stored in the memory 120 or the external storage device 200 together with each column. This parameter is stored for each column.

  Parameter 1 shown in FIG. 3 indicates the type of access to the column. This type indicates whether or not the column requires high-speed processing, and can be set from the outside. Takes a default value determined from the data type or a user-specified value. For example, a column in which the value of parameter 1 is “1” indicates data that requires high-speed processing and is stored in the memory 120 in an uncompressed state. In addition, the column whose parameter 1 value is “2” indicates data that does not require high-speed processing and is stored in the external storage device 200 in an uncompressed state. In this embodiment, the data of the column determined that the high speed processing is unnecessary according to the value of parameter 1 is always stored in the external storage device 200.

  Parameter 2 indicates the degree of non-use of the column. Specifically, it is a parameter whose value is increased by a certain number at a certain time interval specified by parameter 7 described later and whose initial state is “0”. Each time the column is accessed, it is returned to the initial state. Parameter 2 cannot be set arbitrarily.

  Parameter 3 indicates the number of accesses to the column. A parameter whose initial state is “0” that is counted up each time the column is accessed. In this value, the number of times counted by the counter 116 is written. When the value of parameter 3 in a certain column reaches the value of parameter 8 to be described later, the values of parameter 3 in all columns are scaled down at a constant rate specified by the value of parameter 9 to be described later. Parameter 3 cannot be set arbitrarily.

  Parameter 4 indicates the total capacity of the uncompressed data capacity of the column and the data capacity of the additional information of these parameters. Parameter 4 cannot be set arbitrarily.

  FIG. 4 is a diagram illustrating an example of parameters set as a system. The parameters shown in FIG. 4 are stored in the memory 120.

  The parameter 5 shown in FIG. 4 is a threshold value for determining whether or not to compress column data. Specifically, when the value indicated by the parameter 2 matches the value indicated by the parameter 5, this is a reference value for the compression unit 113 to compress the data in the column. Parameter 5 can be set from the outside.

  Parameter 6 is a threshold value for determining whether or not to move column data to the external storage device 200. Specifically, when the value indicated by parameter 2 and the value indicated by parameter 6 match, this is a reference value for moving unit 115 to move data in the column from memory 120 to external storage device 200. Parameter 6 can be set from the outside.

  Parameter 7 indicates the increase interval of parameter 2 in each column. Specifically, the time interval for increasing the parameter 2 by a certain number is shown. For example, as shown in FIG. 4, when the parameter 7 is “15 minutes”, the parameter 2 is increased by a certain number at intervals of 15 minutes. Parameter 7 can be set from the outside.

  Parameter 8 indicates the upper limit value of parameter 3 in each column. The parameter 8 can be set from the outside.

  Parameter 9 indicates the rate of decreasing parameter 3 in each column. That is, it indicates the rate at which the parameter 3 of the column where the value of the parameter 3 has reached the value of the parameter 8 is reduced (scaled down). The parameter 9 can be set from the outside.

  The parameter 10 is a parameter indicating a physical memory area allocated to the memory 120.

  FIG. 5 is a diagram illustrating an example of parameters stored for columns 1 to 5.

  As shown in FIG. 5, parameters 1 to 4 are stored for each column, and parameters 5 to 10 are stored as a system. Using these parameters 1 to 10, it is determined whether to compress the column data or move it to the external storage device 200.

  FIG. 6 is a diagram illustrating a state in which each parameter is stored in the memory 120 and the external storage device 200 for each column.

  As shown in FIG. 6, the column in which the value of the parameter 1 described above is “1” (in the example shown in FIG. 6, the columns 1 to 4) is data that requires high-speed processing. The column parameters 1 to 4 are stored in the memory 120. On the other hand, since the column in which the value of parameter 1 is “2” (column 5 in the example shown in FIG. 6) is data that does not require high-speed processing, parameters 1 to 4 in the column are stored in the external storage device 200. Stored. Further, parameters 5 to 10 which are parameters as a system are stored in the memory 120.

  As described above, when the data is added to the memory database, the system determines whether to place the data of the column in the main storage device (memory 120) or the external storage device 200 based on the value of the parameter 1. to decide.

  Hereinafter, a data storage method in this embodiment will be described.

  FIG. 7 is a flowchart for explaining the data storage method in this embodiment.

  First, the timer 111 is reset (step S1). In step S1, the timer 111 and the value of parameter 2 are reset.

  Thereafter, it is determined whether or not the column has been accessed (step S2).

  When access is performed, the value of parameter 3 is counted up by the counter 116 (step S3), and the process of step S1 is performed.

  On the other hand, when the access is not performed, the comparison unit 112 compares the time when the access is not performed and the preset first elapsed time (step S4).

  Here, a method of measuring the time when access is not performed and comparing the time with the first elapsed time will be described.

  When the time measured by the timer 111 reaches the time set in the parameter 7, the value indicated by the parameter 2 in the column is counted up and the timer 111 is reset. This process is repeated when the state where the access is not performed continues. On the other hand, when an access is made, the value of parameter 2 is reset. Then, the value of parameter 2 and the value of parameter 5 are compared by the comparison unit 112. Not limited to this method, a value obtained by multiplying the value of the parameter 5 and the value of the parameter 7 conceptually as the first elapsed time, and the time measured by the timer 111 and the first elapsed time are Anything that can be compared is acceptable. That is, the comparison unit 112 compares the time when the access is not continuously performed and the preset time (first elapsed time).

  If the time during which access is not performed in step S4 does not match the preset first elapsed time, the process in step S2 is performed.

  On the other hand, when the time during which access is not performed in step S4 and the first elapsed time set in advance match, the data in the column is read from the memory 120 by the compression unit 113 and compressed, It is stored again in the memory 120 (step S5). The compression algorithm used for this compression process is not particularly specified. At this time, if there are a plurality of columns in which the time during which access is not performed and the preset first elapsed time exist, the value of parameter 3 counted up by the counter 116 is small (accessed). The number of times of compression is small). That is, the priority order setting unit 117 sets the priority order to be compressed based on the number of accesses. More specifically, the priority setting unit 117 sets a column having a larger number of accesses to a column having a lower priority for compression.

  Here, when the physical memory necessary for the compression process cannot be secured in the memory 120, the column having the larger parameter 2 value is moved to the external storage device 200 in order from the column in the compressed state. As a result, the physical memory necessary for the compression process is secured on the memory 120.

  Thereafter, it is determined whether or not the column has been accessed (step S6).

  When access is performed, the value of parameter 3 is counted up by the counter 116 (step S7). Further, the compressed and stored columns are read from the memory 120, decompressed (uncompressed), and processing is performed on the columns. Then, the data in the column is stored in the memory 120 in an uncompressed state (step S8). At this time, the value of parameter 2 in the column is cleared. And the process of step S1 is performed.

  On the other hand, when the access is not performed, the comparison unit 114 compares the time when the access is not performed with the preset second elapsed time (step S9).

  Here, a method of measuring the time when access is not performed and comparing the time with the second elapsed time will be described.

  When the time measured by the timer 111 reaches the time set in the parameter 7, the value indicated by the parameter 2 in the column is counted up and the timer 111 is reset. This process is repeated when the state where the access is not performed continues. On the other hand, when an access is made, the value of parameter 2 is reset. Then, the value of parameter 2 and the value of parameter 6 are compared by the comparison unit 114. Not limited to this method, a value obtained by multiplying the value of parameter 6 and the value of parameter 7 conceptually is the second elapsed time, and the time measured by the timer 111 and the second elapsed time are Anything that can be compared is acceptable. That is, the comparison unit 114 compares the time when the access is not continuously performed and the preset time (second elapsed time).

  If the time during which access is not performed in step S9 does not match the preset second elapsed time, the process in step S6 is performed.

  On the other hand, when the time during which access is not performed and the preset second elapsed time match in step S9, the data in the column is read from the memory 120 by the moving unit 115 and stored in the external storage device 200. Stored (step S10). At this time, the data in the column is erased (deleted) from the memory 120. That is, the data in the column is moved from the memory 120 to the external storage device 200 by the moving unit 115. At this time, when there are a plurality of columns in which the time during which access is not performed and the preset second elapsed time exist, the value of parameter 3 counted up by the counter 116 is small (accessed). It is moved in order from the column. That is, the priority order setting unit 117 sets the priority order for movement based on the number of accesses. More specifically, the priority setting unit 117 sets a column having a higher access count to a lower priority for movement.

  FIG. 8 is a diagram showing the transition of parameters, states, and storage locations for column 1. Here, a case will be described as an example where the parameter 5 is set to “3 times”, the parameter 6 is set to “6 times”, and the parameter 7 is set to “15 minutes”.

  As shown in FIG. 8, first, in the initial state (after 0 minutes), the data in column 1 is stored in the physical memory (memory 120) in an uncompressed state, and the values of parameter 2 and parameter 3 are “0”. Times.

  If there is no access before 15 minutes, the value of parameter 2 after 15 minutes is “once”.

  After that, when the column 1 is accessed after 17 minutes, the value of the parameter 2 is reset to the initial value “0”. The value of parameter 3 is “once”.

  If there is no access before 30 minutes, the value of parameter 2 after 30 minutes is “once”.

  Furthermore, when there is no access before 45 minutes, the value of parameter 2 after 45 minutes is “twice”.

  If there is no access before 60 minutes, the value of parameter 2 after 60 minutes is “3 times”. Here, since the value of parameter 2 matches the value of parameter 5, the data in column 1 is compressed by the compression unit 113 and stored in the memory 120.

  Thereafter, when there is no access before 75 minutes, the value of parameter 2 after 75 minutes is “4 times”.

  If there is no access before 90 minutes, the value of parameter 2 after 90 minutes is “5 times”.

  Further, when there is no access before 105 minutes, the value of parameter 2 after 105 minutes is “6 times”. Here, since the value of parameter 2 and the value of parameter 6 match, the data in column 1 is moved from the memory 120 to the external storage device 200 by the moving unit 115.

  After that, if there is no access before 120 minutes, the value of parameter 2 after 120 minutes is “7 times”.

  Hereinafter, access to a column in each state will be described.

  First, a case where a column on the memory 120 is accessed in an uncompressed state will be described.

  When accessing a column in physical memory in an uncompressed state, normal data processing is executed.

  Next, a case where a column on the memory 120 is accessed in a compressed state will be described.

  When accessing a column in a compressed state, access processing is performed after the compression unit 113 performs conversion processing to an uncompressed state. At this time, if the amount of physical memory necessary for the conversion process to the uncompressed state cannot be secured in the memory 120, compression is performed by moving the column in the compressed state sequentially from the column with the largest parameter 2 to the external storage device 200. Secure physical memory required for processing.

  Next, a case where a column in the external storage device 200 is accessed in a compressed state will be described.

  When accessing a column on the external storage device 200 in a compressed state, the following procedures (1) to (3) are taken.

  (1) Move to the memory 120 in a compressed state. It is deleted from the external storage device 200.

  If the data amount on the memory 120 exceeds the memory amount parameter 10 allocated to the memory DB by moving the corresponding column to the memory 120, the value of the parameter 2 is the largest among the columns on the memory 120. The column is moved to the external storage device 200 and deleted from the memory 120 to secure the memory 120.

  (2) A conversion process from the compressed state to the uncompressed state is performed on the memory 120.

  When the amount of physical memory required for the conversion process to the uncompressed state cannot be secured on the memory 120, it is necessary for the compression process by moving the columns in the compressed state from the column with the largest parameter 2 to the external storage device 200 in order. Capacity is secured on the memory 120.

  (3) Data processing is performed.

  Next, a case will be described in which parameter 1 is set to indicate that high-speed access is not required and a column in the external storage device 200 is accessed in an uncompressed state.

  In the case of a column that does not require high-speed access, data processing is executed as it is on the external storage device 200. The parameter 2 and the parameter 3 of the column set as needing no high speed access with the parameter 1 are excluded from the management target of the present invention, and are fixed as the initial values or the same as the column set to require the high speed access It is not specified whether parameter 2 and parameter 3 are changed.

  Next, the process of scaling down the parameter 3 when the parameter 3 reaches the parameter 8 will be described.

  FIG. 9 is a diagram illustrating how the parameter 3 is scaled down when the parameter 3 reaches the parameter 8. Here, a case where “1000 times” is set in the parameter 8 and “1/100” is set in the parameter 9 will be described as an example.

  As shown in FIG. 9, when the parameter 3 is less than “1000 times”, the parameter 3 of each column is counted up by the counter 116 every time each column is accessed. Thereafter, when the value of parameter 3 in the column reaches the upper limit value set in parameter 8, the value of parameter 3 in each column is scaled down at the rate set in parameter 9.

  Next, a process when a search process for a column is requested will be described.

  FIG. 10 is a flowchart for explaining processing when search processing for a column is requested.

  First, it is determined whether or not the search target column for which the search process is requested is present on the memory 120 (step S11).

  If it is determined that the search target column is on the memory 120, it is determined whether or not the search target column is in an uncompressed state (step S12).

  When it is determined that the search target column is in an uncompressed state, it is determined whether decompressing the entire column (converting to an uncompressed state) takes less time than extracting only the actual data range. (Step S13).

  If it is determined that decompressing the entire column (converting to an uncompressed state) takes less time than decompressing only the actual data range, the actual data range is identified (step S14). The range of the actual data is decompressed (step S15).

  Then, a search process is performed on the decompressed data (step S16).

  In step S13, if it is determined that decompressing the entire column (converting to an uncompressed state) takes less time than decompressing only the range of actual data, the entire column is decompressed ( In step S17), search processing is performed in step S16.

  On the other hand, if it is determined in step S11 that the search target column is not on the memory 120, it is determined whether the search target column is in a compressed state (step S18).

  If it is determined in step S18 that the search target column is in a compressed state, the data in the column is moved from the external storage device 200 to the memory 120 (step S19), and the process of step S13 is performed.

  If it is determined in step S18 that the search target column is not in a compressed state, the search process is performed on the external storage device 200 in step S16 as it is.

  A process for specifying the range of actual data to be decompressed (uncompressed) in the process of step S14 will be described.

  FIG. 11 is a diagram illustrating an example of column data stored in ascending order. FIG. 12 is a flowchart for explaining processing for specifying a range of actual data to be decompressed (in an uncompressed state).

  As shown in FIG. 11, an internal structure for storing column data in ascending order is taken, and a parameter for specifying a range to be in an uncompressed state is given. Using this, the range of actual data to be decompressed (in an uncompressed state) is specified.

  First, the uncompressed start position is specified (step S21). Here, the start position is the largest search key with the search value or less.

  Then, the uncompressed end position is specified (step S22). Here, the start position is the smallest search key that is greater than or equal to the search value.

  As described above, the present invention has the following effects.

  The first effect is that more data can be allocated on the physical memory.

  The reason is that a column in the memory 120 that is not accessed for a certain period is converted into a compressed state.

  The second effect is that the access time for a column that is not accessed for a certain period can be shortened.

  The reason is that the present invention employs a compression / uncompression algorithm that is sufficiently faster than the disk I / O time for transferring uncompressed data from the external storage device 200 to the memory 120.

  The third effect is that the disk I / O can be reduced.

  The reason is that in the present invention, data in a column passing between the memory 120 and the external storage device 200 is compressed.

  The fourth effect is that a column that has not been accessed for the same period can be converted into a compressed state and prioritized when transferred to the external storage device 200.

  The reason is that in the present invention, an access number counter is used. In the present invention, when the access number counter of a certain column reaches the upper limit value, the counter values of all the columns are scaled down at a constant rate. This is because the counter value has a weight on the recent access tendency while considering the past access tendency.

  The fifth effect is that, when a search process is requested for a column in a compressed state, the entire column is not moved to an uncompressed state, but only a limited range including the corresponding information is set to an uncompressed state. As a result, the response time for the search request can be shortened compared to the case where the entire column is moved to the uncompressed state.

  This is because the internal structure for storing the column data in ascending order as shown in FIG. 12 is taken and a parameter for specifying the range to be in an uncompressed state is given.

  Note that the processing of the information processing apparatus 100 described above may be performed by a logic circuit manufactured according to the purpose. Further, a program in which processing contents are described as a procedure is recorded on a recording medium readable by the information processing apparatus 100, and the program recorded on the recording medium is read by the information processing apparatus 100 and executed. good. The recording medium readable by the information processing apparatus 100 is a removable recording medium such as a floppy disk (registered trademark), a magneto-optical disk, a DVD, and a CD, as well as a ROM, a RAM, and the like built in the information processing apparatus 100. Memory, HDD, etc. The program recorded on the recording medium is read by the control unit 110 in the information processing apparatus 100, and the same processing as described above is performed under the control of the control unit 110. Here, the control unit 110 operates as a computer that executes a program read from a recording medium on which the program is recorded.

DESCRIPTION OF SYMBOLS 100 Information processing apparatus 110 Control part 111 Timer 112,114 Comparison part 113 Compression part 115 Movement part 116 Counter 117 Priority order setting part 120 Memory 200 External storage device

Claims (22)

In an information processing system including an external storage device that stores data and an information processing device that is connected to the external storage device and includes a memory that can be accessed at higher speed than access to the external storage device.
The information processing apparatus divides the data into groups of a predetermined unit and stores them in the memory, and sets a predetermined time as a time when the group stored in the memory is not continuously accessed. If the elapsed time of 1 coincides, the group is compressed and stored in the memory, and thereafter, the time when the access to the group is not continued and the preset second elapsed time coincide. When the group is moved to the external storage device, the number of times the group stored in the memory is accessed is counted, and when there are a plurality of groups to be compressed, the group set priorities to compress, if the count has reached the preset parameters, scale down the number of times at a predetermined ratio An information processing system which is characterized the door. The information processing system according to claim 1 ,
The information processing system is characterized in that the priority is set lower as the number of times increases. In an information processing system including an external storage device that stores data and an information processing device that is connected to the external storage device and includes a memory that can be accessed at higher speed than access to the external storage device.
  The information processing apparatus divides the data into groups of a predetermined unit and stores them in the memory, and sets a predetermined time as a time when the group stored in the memory is not continuously accessed. If the elapsed time of 1 coincides, the group is compressed and stored in the memory, and thereafter, the time when the access to the group is not continued and the preset second elapsed time coincide. When the group is moved to the external storage device, the number of times the group stored in the memory is accessed is counted, and when there are a plurality of groups to be moved to the external storage device, Set the priority of the group to be moved to the external storage device, and when the number of times reaches a preset parameter, the number of times The information processing system characterized by scaling down at a predetermined rate. The information processing system according to claim 3 ,
The information processing system is characterized in that the priority is set lower as the number of times increases. The information processing system according to any one of claims 1 to 4,
The information processing system decompresses a range of actual data corresponding to a column when a search process for the column stored in the memory is requested. An information processing apparatus connected to an external storage device for storing data,
A memory that is accessible at a higher speed than access to the external storage device, and divides and stores the data into groups of predetermined units;
The time when the group stored in the memory is not continuously accessed is measured, and when the measured time coincides with a preset first elapsed time, the group is compressed. When the measured time and the preset second elapsed time coincide with each other, the group is moved to the external storage device, and the group stored in the memory is accessed. If there are a plurality of groups to be compressed, a priority order of compression of the groups is set based on the number of times, and if the number of times reaches a preset parameter, And a control unit that scales down at a rate of . The information processing apparatus according to claim 6,
The controller is
A timer for measuring a time during which access to the group stored in the memory is not continuously performed;
A first comparison unit for comparing the time measured by the timer with the first elapsed time;
As a result of comparison in the first comparison unit, when the time measured by the timer matches the first elapsed time, the compression unit compresses the group and stores it in the memory;
Then, a second comparison unit that compares the time measured by the timer with the second elapsed time;
As a result of the comparison in the second comparison unit, when the time measured by the timer matches the second elapsed time, a moving unit that moves the group to the external storage device ;
A counter that counts the number of times the group stored in the memory is accessed;
An information processing apparatus comprising: a priority setting unit configured to set a priority of compression of the group based on the number of times when there are a plurality of groups to be compressed . The information processing apparatus according to claim 7 ,
The information processing apparatus, wherein the priority setting unit sets the priority lower as the number of times increases. An information processing apparatus connected to an external storage device for storing data,
A memory that is accessible at a higher speed than access to the external storage device, and divides and stores the data into groups of predetermined units;
The time when the group stored in the memory is not continuously accessed is measured, and when the measured time coincides with a preset first elapsed time, the group is compressed. When the measured time and the preset second elapsed time coincide with each other, the group is moved to the external storage device, and the group stored in the memory is accessed. When there are a plurality of groups to be moved to the external storage device, the priority order of the groups to be moved to the external storage device is set based on the number of times, and the number of times is set to a preset parameter. An information processing apparatus comprising: a control unit that scales down the number of times at a predetermined rate when the number of times is reached. The information processing apparatus according to claim 9,
The controller is
A timer for measuring a time during which access to the group stored in the memory is not continuously performed;
A first comparison unit for comparing the time measured by the timer with the first elapsed time;
As a result of comparison in the first comparison unit, when the time measured by the timer matches the first elapsed time, the compression unit compresses the group and stores it in the memory;
Then, a second comparison unit that compares the time measured by the timer with the second elapsed time;
As a result of the comparison in the second comparison unit, when the time measured by the timer matches the second elapsed time, a moving unit that moves the group to the external storage device;
  A counter that counts the number of times the group stored in the memory is accessed;
  An information processing apparatus comprising: a priority setting unit configured to set a priority of a group to be moved to the external storage device based on the number of times when there are a plurality of groups to be moved to the external storage device. The information processing apparatus according to claim 10,
The information processing apparatus, wherein the priority setting unit sets the priority lower as the number of times increases. The information processing apparatus according to any one of claims 6 to 11,
An information processing apparatus, wherein when a search process is requested for a column stored in the memory, a range of actual data corresponding to the column is decompressed. A data storage method in which data is divided into groups of a predetermined unit and stored in a first storage unit and a second storage unit that can be accessed at higher speed than access to the first storage unit. ,
A process of measuring a time during which access to the group stored in the second storage unit is not continuously performed;
A first comparison process for comparing the measured time with a preset first elapsed time;
As a result of the first comparison process, when the measured time matches the first elapsed time, a process of compressing the group and storing it in the second storage unit;
Then, a second comparison process for comparing the measured time with a preset second elapsed time;
As a result of the second comparison process, when the measured time and the second elapsed time match , a process of moving the group to the first storage unit ;
A process of counting the number of times the group stored in the second storage unit is accessed;
When there are a plurality of groups to be compressed, a process for setting the priority of the groups to be compressed based on the number of times
A data storage method including a process of scaling down the number of times by a predetermined ratio when the number of times reaches a preset parameter . The data storage method according to claim 13,
A data storage method comprising a process of setting the priority lower as the number of times increases. A data storage method in which data is divided into groups of a predetermined unit and stored in a first storage unit and a second storage unit that can be accessed at higher speed than access to the first storage unit. ,
A process of measuring a time during which access to the group stored in the second storage unit is not continuously performed;
A first comparison process for comparing the measured time with a preset first elapsed time;
As a result of the first comparison process, when the measured time matches the first elapsed time, a process of compressing the group and storing it in the second storage unit;
Then, a second comparison process for comparing the measured time with a preset second elapsed time;
As a result of the second comparison process, when the measured time and the second elapsed time match, a process of moving the group to the first storage unit;
A process of counting the number of times the group stored in the second storage unit is accessed;
When there are a plurality of groups to be moved to the first storage unit, a process of setting the priority order of the groups to be moved to the first storage unit based on the number of times ,
A data storage method including a process of scaling down the number of times by a predetermined ratio when the number of times reaches a preset parameter. The data storage method according to claim 15, wherein
A data storage method comprising a process of setting the priority lower as the number of times increases. The data storage method according to any one of claims 13 to 16,
A data storage method comprising: processing for decompressing a range of actual data corresponding to a column when a search process for the column stored in the second storage unit is requested.
An information processing apparatus connected to an external storage device that stores data and having a memory that can be accessed faster than access to the external storage device,
Dividing the data into groups of predetermined units and storing them in the memory;
A procedure for measuring a time during which access to the group stored in the memory is not continuously performed;
A first comparison procedure for comparing the measured time with a preset first elapsed time;
As a result of the first comparison procedure, if the measured time and the first elapsed time coincide with each other, a procedure for compressing the group and storing it in the memory;
Then, a second comparison procedure for comparing the measured time with a preset second elapsed time;
As a result of the second comparison procedure, when the measured time and the second elapsed time coincide with each other, a procedure for moving the group to the external storage device ;
Counting the number of times the group stored in the memory has been accessed;
When there are a plurality of groups to be compressed, a procedure for setting the priority order of compression of the groups based on the number of times
A program for executing a procedure of scaling down the number of times by a predetermined ratio when the number of times reaches a preset parameter . The program according to claim 18, wherein
A program for executing a procedure for setting the priority lower as the number of times increases. An information processing apparatus connected to an external storage device that stores data and having a memory that can be accessed faster than access to the external storage device,
Dividing the data into groups of predetermined units and storing them in the memory;
A procedure for measuring a time during which access to the group stored in the memory is not continuously performed;
A first comparison procedure for comparing the measured time with a preset first elapsed time;
As a result of the first comparison procedure, if the measured time and the first elapsed time coincide with each other, a procedure for compressing the group and storing it in the memory;
Then, a second comparison procedure for comparing the measured time with a preset second elapsed time;
As a result of the second comparison procedure, when the measured time and the second elapsed time coincide with each other, a procedure for moving the group to the external storage device;
Counting the number of times the group stored in the memory has been accessed;
When there are a plurality of groups to be moved to the external storage device, a procedure for setting the priority order of the groups to be moved to the external storage device based on the number of times,
A program for executing a procedure of scaling down the number of times by a predetermined ratio when the number of times reaches a preset parameter. The program according to claim 20,
A program for executing a procedure for setting the priority lower as the number of times increases. The program according to any one of claims 18 to 21,
A program for executing a procedure for decompressing a range of actual data corresponding to a column when a search process for the column stored in the memory is requested.

Images