CN114327260B - Data reading method, system, server and storage medium - Google Patents
Data reading method, system, server and storage medium Download PDFInfo
- Publication number
- CN114327260B CN114327260B CN202111447677.6A CN202111447677A CN114327260B CN 114327260 B CN114327260 B CN 114327260B CN 202111447677 A CN202111447677 A CN 202111447677A CN 114327260 B CN114327260 B CN 114327260B
- Authority
- CN
- China
- Prior art keywords
- data
- hard disk
- buffer module
- disk backboard
- module
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000000034 method Methods 0.000 title claims abstract description 50
- 230000003139 buffering effect Effects 0.000 claims description 16
- 239000007787 solid Substances 0.000 claims description 7
- 238000004364 calculation method Methods 0.000 claims description 5
- 238000004590 computer program Methods 0.000 claims description 5
- 230000009286 beneficial effect Effects 0.000 abstract description 2
- 238000013500 data storage Methods 0.000 description 11
- 238000010586 diagram Methods 0.000 description 10
- 238000007726 management method Methods 0.000 description 10
- 230000005540 biological transmission Effects 0.000 description 6
- 230000008569 process Effects 0.000 description 6
- XLYOFNOQVPJJNP-UHFFFAOYSA-N water Substances O XLYOFNOQVPJJNP-UHFFFAOYSA-N 0.000 description 6
- 238000012545 processing Methods 0.000 description 4
- 230000009471 action Effects 0.000 description 3
- 238000013461 design Methods 0.000 description 3
- 230000003993 interaction Effects 0.000 description 3
- 230000006978 adaptation Effects 0.000 description 2
- 238000013459 approach Methods 0.000 description 2
- 238000005516 engineering process Methods 0.000 description 2
- 238000012986 modification Methods 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 238000012546 transfer Methods 0.000 description 2
- 238000004891 communication Methods 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 230000007246 mechanism Effects 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 230000000750 progressive effect Effects 0.000 description 1
Classifications
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
- Y02D—CLIMATE CHANGE MITIGATION TECHNOLOGIES IN INFORMATION AND COMMUNICATION TECHNOLOGIES [ICT], I.E. INFORMATION AND COMMUNICATION TECHNOLOGIES AIMING AT THE REDUCTION OF THEIR OWN ENERGY USE
- Y02D10/00—Energy efficient computing, e.g. low power processors, power management or thermal management
Abstract
The application discloses a data reading method, which is applied to a server, wherein a memory card of the server is connected with a first hard disk backboard, a second hard disk backboard is cascaded with the first hard disk backboard, and the first hard disk backboard is provided with a data buffer module, and the data reading method comprises the following steps: detecting common data in the second hard disk backboard and storing the common data into the data buffer module; receiving a data reading instruction initiated to the second hard disk backboard, and judging whether the data to be read is stored in the data buffer module or not; if yes, reading data corresponding to the data reading instruction from the data buffer module; if not, reading the data corresponding to the data reading instruction from the second hard disk backboard. The application can improve the read-write performance of the hard disk backboard on the premise of not increasing the memory card. The application also discloses a data reading method, a system, a server and a storage medium, which have the beneficial effects.
Description
Technical Field
The present application relates to the field of data processing technologies, and in particular, to a data reading method, a system, a server, and a storage medium.
Background
With the advent of the big data and cloud age, and the continued development of science and technology, there is an increasing demand for servers, particularly storage servers, in various areas of society, mainly because storage servers have high data storage capacity, as well as high-speed data throughput capacity. In practical applications, in order for a server to have high-speed data throughput, a storage server is generally required to support a larger number of hard disks and better read-write performance of the hard disks.
The read-write performance of the server is limited by the design limitation of the memory card and the hard disk backboard, in order to realize both high memory and high hard disk read-write performance, in the related art, different memory cards are usually required to be connected to different hard disk backboard separately, the cost of the memory card is high, and the complexity of the overall structure of the server is increased.
Therefore, how to improve the read-write performance of the hard disk back plate without adding a memory card is a technical problem that needs to be solved by those skilled in the art at present.
Disclosure of Invention
The application aims to provide a data reading method, a system, a storage medium and a server, which can improve the read-write performance of a hard disk backboard on the premise of not increasing a storage card.
In order to solve the technical problems described above, the present application provides a data reading method, which is applied to a server, a memory card of the server is connected to a first hard disk back plate, a second hard disk back plate is cascaded to the first hard disk back plate, the first hard disk back plate is provided with a data buffer module, and the data reading method includes:
detecting common data in the second hard disk backboard and storing the common data into the data buffer module;
receiving a data reading instruction initiated to the second hard disk backboard, and judging whether the data to be read is stored in the data buffer module or not;
if yes, reading data corresponding to the data reading instruction from the data buffer module;
if not, reading the data corresponding to the data reading instruction from the second hard disk backboard.
Optionally, the method further comprises:
determining target data which needs to be written into the second hard disk backboard, and writing the target data into the data buffer module so that a storage management chip of the data buffer module writes the target data into the second hard disk backboard.
Optionally, before storing the common data in the data buffer module, the method further includes:
and determining the total storage space of the data buffer module according to the number of the hard disks included in the second hard disk backboard and the read-write speed of the data buffer module.
Optionally, after storing the common data in the data buffer module, the method further includes:
if the new common data in the second hard disk backboard is detected, judging whether the residual storage space of the data buffer module is larger than or equal to the data size of the new common data;
if yes, storing the new common data into the data buffer module;
if not, deleting N pieces of common data with earliest storage time in the data buffer module, so that the residual storage space of the data buffer module is larger than or equal to the data size of the new common data, and storing the new common data into the data buffer module.
Optionally, detecting the common data in the second hard disk back plate includes:
weighting calculation is carried out according to the use times and the use time of each data in the second hard disk backboard, so that the common degree score of each data is obtained;
and setting the data with the common degree score larger than a preset value as common data in the second hard disk backboard.
Optionally, the data buffer module is a solid state disk connected with the first hard disk backboard in an external connection mode or an embedded mode.
The application also provides a data reading system which is applied to a server, wherein a memory card of the server is connected with a first hard disk backboard, a second hard disk backboard is cascaded with the first hard disk backboard, the first hard disk backboard is provided with a data buffer module, and the data reading system comprises:
the buffer storage module is used for detecting common data in the second hard disk backboard and storing the common data into the data buffer module;
the judging module is used for receiving a data reading instruction initiated to the second hard disk backboard and judging whether the data to be read is stored in the data buffering module or not;
the reading module is used for reading the data corresponding to the data reading instruction from the data buffering module if the data to be read is stored in the data buffering module; and the data reading module is also used for reading the data corresponding to the data reading instruction from the second hard disk backboard if the data to be read is not stored in the data buffering module.
The present application also provides a storage medium having stored thereon a computer program which, when executed, implements the steps of the above-described data reading method.
The application also provides a server, which comprises a processor, a memory card, a first hard disk backboard and a second hard disk backboard, wherein the memory card is connected with the first hard disk backboard, the second hard disk backboard is cascaded with the first hard disk backboard, the first hard disk backboard is provided with a data buffer module, and the memory realizes the steps of the data reading method when running a computer program.
Optionally, the data buffer module is a solid state disk connected with the first hard disk backboard in an external connection mode or an embedded mode.
The application provides a data reading method, which is applied to a server, wherein a memory card of the server is connected with a first hard disk backboard, a second hard disk backboard is cascaded with the first hard disk backboard, and the first hard disk backboard is provided with a data buffer module, and the data reading method comprises the following steps: detecting common data in the second hard disk backboard and storing the common data into the data buffer module; receiving a data reading instruction initiated to the second hard disk backboard, and judging whether the data to be read is stored in the data buffer module or not; if yes, reading data corresponding to the data reading instruction from the data buffer module; if not, reading the data corresponding to the data reading instruction from the second hard disk backboard.
In the application, the first hard disk backboard is connected with the memory card of the server, the second hard disk backboard is cascaded with the first hard disk backboard, and the first hard disk backboard is provided with a data buffer module. After the common data in the second hard disk backboard is detected, the common data in the second hard disk backboard is stored to the first hard disk backboard, so that the data buffer module of the first hard disk backboard can directly provide corresponding data for the memory card of the server when the data is required to be read from the second hard disk backboard. By the method, the link length of the second hard disk backboard for transmitting data to the memory card can be reduced, performance loss generated in the interaction process of the second hard disk backboard and the memory card is avoided, and further the read-write performance of the hard disk backboard can be improved on the premise of not increasing the memory card. The application also provides a data reading system, a storage medium and a server, which have the beneficial effects and are not described herein.
Drawings
For a clearer description of embodiments of the present application, the drawings that are required to be used in the embodiments will be briefly described, it being apparent that the drawings in the following description are only some embodiments of the present application, and other drawings may be obtained according to the drawings without inventive effort for those skilled in the art.
FIG. 1 is a flowchart of a data reading method according to an embodiment of the present application;
FIG. 2 is a schematic diagram of a storage connection mode of a multi-hard disk storage server according to an embodiment of the present application;
FIG. 3 is a schematic diagram of another storage connection method of a multi-hard disk storage server according to an embodiment of the present application;
FIG. 4 is a schematic diagram of a new storage connection mode of a multi-hard disk storage server according to an embodiment of the present application;
fig. 5 is a schematic diagram of a cascade principle of a hard disk back plate according to an embodiment of the present application;
fig. 6 is a schematic structural diagram of a data reading system according to an embodiment of the present application.
Detailed Description
For the purpose of making the objects, technical solutions and advantages of the embodiments of the present application more apparent, the technical solutions of the embodiments of the present application will be clearly and completely described below with reference to the accompanying drawings in the embodiments of the present application, and it is apparent that the described embodiments are some embodiments of the present application, but not all embodiments of the present application. All other embodiments, which can be made by those skilled in the art based on the embodiments of the application without making any inventive effort, are intended to be within the scope of the application.
Referring to fig. 1, fig. 1 is a flowchart of a data reading method according to an embodiment of the application.
The specific steps may include:
s101: detecting common data in the second hard disk backboard and storing the common data into the data buffer module;
the embodiment can be applied to a server, a memory card of the server is connected with a first hard disk backboard, a second hard disk backboard is cascaded with the first hard disk backboard, and a data buffer module is arranged on the first hard disk backboard. Specifically, the first hard disk backboard is connected with the memory card through an SAS line, and the second hard disk backboard is cascaded with the first hard disk backboard through an SAS line.
As a possible implementation manner, the data buffer module is a solid state disk connected to the first hard disk back plate in an external connection manner or an embedded manner.
S102: receiving a data reading instruction initiated to the second hard disk backboard;
the data reading instruction may be an instruction issued by an upper layer application of the server, and after receiving the data reading instruction, the instruction may be judged to be an instruction for reading data in the first hard disk backboard or an instruction for reading data in the second hard disk backboard. If a data reading instruction for the first hard disk backboard is received, corresponding data can be directly read from the first hard disk backboard. If a data reading instruction is received from the second hard disk backboard, a data reading mode can be determined according to the position of the data to be read.
S103: judging whether the data to be read is stored in a data buffer module or not; if yes, go to S104; if not, entering S105;
the step is based on that a data reading instruction initiated by the upper layer application to the second hard disk backboard has been received, and the embodiment can determine the identification of the data to be read according to the data reading instruction. The data buffer module may record an identification table of each stored common data, and in this embodiment, whether the data to be read is stored in the data buffer module may be determined according to the identification table.
S104: reading data corresponding to the data reading instruction from the data buffer module;
the step is based on the data to be read being stored in the data buffer module, and the embodiment can read the data corresponding to the data reading instruction from the data buffer module without reading the data from the second hard disk back plate. By the method, the link length of reading data from the second hard disk backboard can be shortened, and the read-write performance of the second hard disk backboard is indirectly improved.
S105: and reading data corresponding to the data reading instruction from the second hard disk backboard.
The step is based on the fact that the data to be read is not stored in the data buffer module, and data corresponding to the data reading instruction can be directly read from the second hard disk backboard.
In this embodiment, the first hard disk backboard is connected to the memory card of the server, the second hard disk backboard is cascaded to the first hard disk backboard, and the first hard disk backboard is provided with a data buffer module. After detecting the common data in the second hard disk backboard, the embodiment stores the common data in the second hard disk backboard to the first hard disk backboard, so that the data buffer module of the first hard disk backboard directly provides corresponding data for the memory card of the server when the data needs to be read from the second hard disk backboard. By the method, the link length of the second hard disk backboard for transmitting data to the memory card can be reduced, performance loss generated in the interaction process of the second hard disk backboard and the memory card is avoided, and further the read-write performance of the hard disk backboard can be improved on the premise of not increasing the memory card.
As a further introduction to the corresponding embodiment of fig. 1, a new data writing method may be provided on the basis of the above embodiment, and the specific procedure is as follows: determining target data which needs to be written into the second hard disk backboard, and writing the target data into the data buffer module so that a storage management chip of the data buffer module writes the target data into the second hard disk backboard. By the mode, the data writing rate of the second hard disk backboard can be improved.
As a further introduction to the corresponding embodiment of fig. 1, this embodiment may determine, before storing the common data in the data buffer module, a total storage space of the data buffer module according to the number of hard disks included in the second hard disk backplane and a read-write speed of the data buffer module, so as to select the corresponding data buffer module based on the size of the total storage space.
Taking the example that the 12-port hard disk backboard is connected with a mechanical hard disk, the performance of each hard disk on the hard disk backboard B is reduced by about 30M/s, the speed of reducing the 12 hard disks on the second hard disk backboard by about 360M/s is accumulated, and the size of a data storage module is more than 360M, so that the requirement can be met. The read-write speed of the current data buffer module is more than 450M/s, and the buffer requirement can be completely met. If the data buffer module of the first hard disk back plate is designed to be an external connection mode, the SSD hard disk with the storage space larger than 360M can be directly used as the data buffer module to be connected with the first hard disk back plate. If the data buffer module of the first hard disk back plate is designed to be in an embedded mode, the SSD hard disk with the storage space larger than 360M can be used as the data buffer module to be implanted into the first hard disk back plate.
As a further introduction to the corresponding embodiment of fig. 1, after storing the common data in the data buffer module, it may further be determined whether new common data appears in the second hard disk back plate, and if new common data is detected in the second hard disk back plate, it is determined whether the remaining storage space of the data buffer module is greater than or equal to the data size of the new common data; if yes, storing the new common data into the data buffer module; if not, deleting N pieces of common data with earliest storage time in the data buffer module, so that the residual storage space of the data buffer module is larger than or equal to the data size of the new common data, and storing the new common data into the data buffer module.
Further, the present embodiment may detect the common data in the second hard disk back plate by: weighting calculation is carried out according to the use times and the use time of each data in the second hard disk backboard, so that the common degree score of each data is obtained; and setting the data with the common degree score larger than a preset value as common data in the second hard disk backboard. The usage time may include a duration of usage of the data and a duration of last usage of the data from a current time.
The flow described in the above embodiment is explained below by way of an embodiment in practical application. Taking an 8i memory card as an example, such a memory card has two interfaces Port0 and Port1, each of which may have data transfer capabilities.
Referring to fig. 2, fig. 2 is a schematic diagram of a storage connection mode of a multi-hard disk storage server according to an embodiment of the present application. In the scheme shown in fig. 2, each hard disk backboard is connected with a dedicated memory card, and in the scheme, the hard disk backboard and the memory card are directly connected with port0 and port1 through 2 SAS wires, so that the read-write performance of the hard disk on each hard disk backboard is not affected, and meanwhile, each hard disk can be acquired, and the storage capacity is not affected. But the number of memory cards increases. When the machine shown in fig. 2 has 2 hard disk backplanes (12 hard disk backplanes a and 12 hard disk backplanes B), 2 memory cards (memory card 1 and memory card 2) are needed, each memory card is expensive in cost and greatly increases in cost, and meanwhile, one more memory card occupies one more PCIE slot, which affects the scalability of the server and is generally not easily accepted by clients.
Referring to fig. 3, fig. 3 is a schematic diagram illustrating another storage connection mode of a multi-hard disk storage server according to an embodiment of the application. In the scheme shown in fig. 3, the server is provided with PCIE 8i memory cards, the hard disk back board B is cascaded with the hard disk back board a, and then the hard disk back board a is connected with two interfaces port0 and port1 of the memory cards, so that the number of the memory cards can be reduced, the cost of the server is saved, and meanwhile, a PCIE slot occupied by one memory card is also vacated, other devices can be connected to the PCIE slot, and scalability of the server is provided; however, this approach leads to an extended link of the hard disk backplate B, and sharing a channel with the hard disk backplate a, which tends to affect the performance of the hard disk on the hard disk backplate B.
In the two prior art solutions shown in fig. 2 and fig. 3, one solution would increase the number of memory cards, increase the cost of the server, and affect the scalability of PCIE slots of the server; another approach would be to reduce the hard disk performance of the cascaded hard disk backplane. Therefore, the prior art cannot solve the problem of how to improve the read-write performance of the hard disk back plate on the premise of not increasing the memory card.
The reason for the reduced performance of the hard disk on the hard disk back plate B is analyzed as follows: (1) The back link of the back board B cascade back board A is lengthened, so that the data transmission time of the memory card and the hard disk back board B is slightly longer than that of the back board A, and a part of the performance is affected. (2) When a server calls data of the hard disk backboard A and the hard disk backboard B in a large quantity, the data transmission of the memory card and the backboard B is slightly later than the data transmission of the hard disk backboard A, so that the data transmission quantity of the hard disk backboard A is larger, and the data on the hard disk backboard B is influenced by the transmission blockage of the SAS cable and the limitation of the processing capacity of the memory card because the transmission quantity of the SAS cable and the processing capacity of the memory card are certain.
In order to reduce the performance impact on the hard disk backplate B, it is considered to optimize the design of the hard disk backplate, create a performance buffer area on the hard disk backplate a and the hard disk backplate B, and add a "data buffer module". Referring to fig. 4, fig. 4 is a schematic diagram of a new storage connection mode of a multi-hard disk storage server according to an embodiment of the present application, after a hard disk back plate B cascades with a hard disk back plate a, the hard disk back plate a is connected to two interfaces port0 and port1 of a storage card through two SAS lines. The data buffer module is arranged on the hard disk backboard A and used for storing read-write data of the hard disk backboard B, so that the performance influence of the cascade hard disk backboard on the hard disk backboard B is reduced. The data buffer module is similar to a canal transfer module in water flow, for example, water in canal B with the same size flows to a farmland through canal A, is limited by lengthening a canal B, obtains a relatively larger water quantity of canal A than canal B in the same time, and is not faster than canal A in flow, but can relatively increase the water quantity of canal B if the water quantity of canal B is stored in canal A in advance, and the place for storing the water quantity of canal B in advance is similar to the data buffer module in the scheme.
Taking the example of reading the hard disk data on the hard disk backboard B, the detailed design and working principle of the data buffer module for the hard disk backboard a are introduced as follows:
the data storage is recorded in a digital mode, and assuming that the text data of a client exists in a data 1 module and the picture data of the client exists in a data 3 module, a data storage and retrieval mechanism is automatically built by a hard disk, when the client uses the text data, a server memory card accesses the hard disk through a back plate, and the hard disk invokes the data of the data 1 and transmits the data to the back plate, the SAS line, the memory card and the client.
The hard disk backboard establishes communication with the memory card through the SAS line, and a special ID identification relationship is established among the memory card, the backboard and the hard disk according to the working principles of the backboard and the memory card of each manufacturer, and the relationship is allocated by the memory card. Referring to fig. 5, fig. 5 is a schematic diagram of a cascading principle of hard disk back boards provided by the embodiment of the present application, as shown in fig. 5, taking a 12-port back board as an example, a memory card may allocate a DID number to each hard disk of the 12-port back board separately for distinguishing the hard disk positions, and when a user opens the hard disk data of the physical hard disk position 0 on the hard disk back board, the memory card may directly access the DID0, and further identify the hard disk position 0 and obtain the data thereof. The physical addresses of the hard disks of the 12-port hard disk backboard A are 0-11, the identifiers distributed by the work of the memory card are DID 0-DID 11, the data buffer module comprises a memory management chip and data memory, and the identifier of the data buffer module is DID12. The data buffer module and the 12-port hard disk backboard B are cascaded through an SAS, the hard disk physical address of the 12-port hard disk backboard B is 0-11, and the identification allocated by the work of the memory card is DID 0-DID 11. The hard disk 0 on the back plate B includes data 1 (text), data 2, data 3 (picture), and data 4.
According to the working relation among the memory card, the back plate and the hard disk, the data buffer module can be designed into a link mode of other hard disks on the hard disk back plate A, and a DID value is reserved for the data buffer module on the back plate independently, so that the memory card can also allocate a DID number for the data buffer module, and the memory card can be as fast and efficient as reading the data in the data buffer module on the hard disk back plate A when reading the data in the data buffer module on the hard disk back plate A.
According to the embodiment, the data of the hard disk backboard B can be output in advance and stored in the data buffer module of the hard disk backboard A, so that the data access speed of the memory card to the hard disk backboard B can be improved. The implementation mode is as follows: the data buffer module is divided into two parts of storage management and data storage, a simple storage management chip is added on the hard disk backboard A for the storage management, the hard disk backboard B cascaded by the cascade interface is independently controlled, the common data content is obtained and stored in the data storage module for waiting for calling, and other common data can be called in a mode that the hard disk backboard A and the cascade hard disk backboard B are controlled by the original storage card.
In this embodiment, the common data refers to data that is frequently accessed or used by the client, as shown in fig. 5, for example, the client opens a text document first when the client starts up for the first time, and the text document of the data 1 is the common data, and is preferentially identified by a "storage management" module in the data buffer module on the back plate and stored in the data storage module; at this time, the client opens a picture, and the picture exists in the data 3, so that the data 3 is stored in the data storage module, and the data storage is sequentially performed according to the data access sequence. When the data storage module is full of data and is newly opened with text or pictures and other data again, the data storage module can automatically store the new data and cover the data stored earlier, so that the common data of the hard disk backboard B accessed by a client can be ensured to be stored in the data buffer module of the hard disk backboard A in advance.
The above description has improved the efficiency of reading the hard disk backboard B, and this embodiment may further write the data to be written into the data buffer module of the hard disk backboard a, and then perform data distribution and writing into the hard disk backboard B through the "storage management" module, so as to solve the problem of low data reading and writing rate of the hard disk backboard B.
The embodiment realizes the scheme that a single PCIE memory card controls the multi-hard disk backboard, reduces the number of the memory cards, greatly reduces the cost of the server, and simultaneously reduces the PCIE slots which can be released by the memory cards, so that the server has better PCIE equipment expansibility. The embodiment realizes that the hard disk on each hard disk backboard still has higher data processing capability under the backboard cascade mode.
Referring to fig. 6, fig. 6 is a schematic structural diagram of a data reading system provided by an embodiment of the present application, which is applied to a server, wherein a memory card of the server is connected to a first hard disk back plate, a second hard disk back plate is cascaded to the first hard disk back plate, the first hard disk back plate is provided with a data buffer module, and the data reading system includes:
the buffer storage module 601 is configured to detect common data in the second hard disk backplate, and store the common data to the data buffer module;
the judging module 602 is configured to receive a data reading instruction initiated to the second hard disk backboard, and judge whether data to be read is stored in the data buffering module;
a reading module 603, configured to read, if the data to be read is stored in the data buffer module, data corresponding to the data reading instruction from the data buffer module; and the data reading module is also used for reading the data corresponding to the data reading instruction from the second hard disk backboard if the data to be read is not stored in the data buffering module.
In this embodiment, the first hard disk backboard is connected to the memory card of the server, the second hard disk backboard is cascaded to the first hard disk backboard, and the first hard disk backboard is provided with a data buffer module. After detecting the common data in the second hard disk backboard, the embodiment stores the common data in the second hard disk backboard to the first hard disk backboard, so that the data buffer module of the first hard disk backboard directly provides corresponding data for the memory card of the server when the data needs to be read from the second hard disk backboard. By the method, the link length of the second hard disk backboard for transmitting data to the memory card can be reduced, performance loss generated in the interaction process of the second hard disk backboard and the memory card is avoided, and further the read-write performance of the hard disk backboard can be improved on the premise of not increasing the memory card.
Further, the method further comprises the following steps:
and the data writing module is used for determining target data which needs to be written into the second hard disk backboard and writing the target data into the data buffering module so that the storage management chip of the data buffering module can write the target data into the second hard disk backboard.
Further, the method further comprises the following steps:
and the total storage space determining module is used for determining the total storage space of the data buffering module according to the number of the hard disks included in the second hard disk backboard and the read-write speed of the data buffering module before the common data is stored in the data buffering module.
Further, the method further comprises the following steps:
the space management module is used for judging whether the residual storage space of the data buffer module is larger than or equal to the data size of the new common data if the new common data in the second hard disk backboard is detected after the common data is stored in the data buffer module; if yes, storing the new common data into the data buffer module; if not, deleting N pieces of common data with earliest storage time in the data buffer module, so that the residual storage space of the data buffer module is larger than or equal to the data size of the new common data, and storing the new common data into the data buffer module.
Further, the buffer storage module 601 is configured to perform weighted calculation according to the usage frequency and the usage time of each data in the second hard disk backboard, so as to obtain a common degree score of each data; and the data with the common degree score being larger than a preset value is set as common data in the second hard disk backboard.
Further, the data buffer module is a solid state disk connected with the first hard disk backboard in an external connection mode or an embedded mode.
Since the embodiments of the system portion and the embodiments of the method portion correspond to each other, the embodiments of the system portion refer to the description of the embodiments of the method portion, which is not repeated herein.
The present application also provides a storage medium having stored thereon a computer program which, when executed, performs the steps provided by the above embodiments. The storage medium may include: a U-disk, a removable hard disk, a Read-Only Memory (ROM), a random access Memory (Random Access Memory, RAM), a magnetic disk, or an optical disk, or other various media capable of storing program codes.
The application also provides a server, which comprises a processor, a memory card, a first hard disk backboard and a second hard disk backboard, wherein the memory card is connected with the first hard disk backboard, the second hard disk backboard is cascaded with the first hard disk backboard, the first hard disk backboard is provided with a data buffer module, and the memory realizes the steps of the data reading method when running a computer program. The server may of course also include various network interfaces, power supplies, etc.
Optionally, the data buffer module is a solid state disk connected with the first hard disk backboard in an external connection mode or an embedded mode.
In the description, each embodiment is described in a progressive manner, and each embodiment is mainly described by the differences from other embodiments, so that the same similar parts among the embodiments are mutually referred. For the system disclosed in the embodiment, since it corresponds to the method disclosed in the embodiment, the description is relatively simple, and the relevant points refer to the description of the method section. It should be noted that it will be apparent to those skilled in the art that various modifications and adaptations of the application can be made without departing from the principles of the application and these modifications and adaptations are intended to be within the scope of the application as defined in the following claims.
It should also be noted that in this specification, relational terms such as first and second, and the like are used solely to distinguish one entity or action from another entity or action without necessarily requiring or implying any actual such relationship or order between such entities or actions. Moreover, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising one … …" does not exclude the presence of other like elements in a process, method, article, or apparatus that comprises the element.
Claims (9)
1. The data reading method is characterized by being applied to a server, wherein a memory card of the server is connected with a first hard disk backboard, a second hard disk backboard is cascaded with the first hard disk backboard, and the first hard disk backboard is provided with a data buffer module, and the data reading method comprises the following steps:
weighting calculation is carried out according to the use times and the use time of each datum in the second hard disk backboard, a common degree score of each datum is obtained, the datum with the common degree score being larger than a preset value is set as the common datum in the second hard disk backboard, and the common datum is stored in the data buffer module;
receiving a data reading instruction initiated to the second hard disk backboard, and judging whether the data to be read is stored in the data buffer module or not;
if yes, reading data corresponding to the data reading instruction from the data buffer module;
if not, reading the data corresponding to the data reading instruction from the second hard disk backboard.
2. The data reading method according to claim 1, further comprising:
determining target data which needs to be written into the second hard disk backboard, and writing the target data into the data buffer module so that a storage management chip of the data buffer module writes the target data into the second hard disk backboard.
3. The data reading method according to claim 1, further comprising, before storing the common data to the data buffer module:
and determining the total storage space of the data buffer module according to the number of the hard disks included in the second hard disk backboard and the read-write speed of the data buffer module.
4. The data reading method according to claim 1, further comprising, after storing the common data to the data buffer module:
if the new common data in the second hard disk backboard is detected, judging whether the residual storage space of the data buffer module is larger than or equal to the data size of the new common data;
if yes, storing the new common data into the data buffer module;
if not, deleting N pieces of common data with earliest storage time in the data buffer module, so that the residual storage space of the data buffer module is larger than or equal to the data size of the new common data, and storing the new common data into the data buffer module.
5. The method for reading data according to claim 1, wherein the data buffer module is a solid state disk connected to the first hard disk back plate in an external connection manner or an embedded manner.
6. The utility model provides a data reading system which characterized in that is applied to the server, the memory card of server connects first hard disk backplate, and the second hard disk backplate cascades first hard disk backplate, first hard disk backplate is provided with data buffer module, data reading system includes:
the buffer storage module is used for carrying out weighted calculation according to the use times and the use time of each data in the second hard disk backboard to obtain a common degree score of each data, setting the data with the common degree score larger than a preset value as the common data in the second hard disk backboard, and storing the common data into the data buffer module;
the judging module is used for receiving a data reading instruction initiated to the second hard disk backboard and judging whether the data to be read is stored in the data buffering module or not;
the reading module is used for reading the data corresponding to the data reading instruction from the data buffering module if the data to be read is stored in the data buffering module; and the data reading module is also used for reading the data corresponding to the data reading instruction from the second hard disk backboard if the data to be read is not stored in the data buffering module.
7. A server comprising a processor, a memory card, a first hard disk back plate and a second hard disk back plate, said memory card being connected to said first hard disk back plate, said second hard disk back plate cascading said first hard disk back plate, said first hard disk back plate being provided with a data buffering module, said memory implementing the steps of the data reading method according to any one of claims 1 to 5 when running a computer program.
8. The server of claim 7, wherein the data buffer module is a solid state disk connected to the first hard disk back plate in an external or embedded manner.
9. A storage medium having stored therein computer executable instructions which when loaded and executed by a processor perform the steps of the data reading method according to any of claims 1 to 5.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111447677.6A CN114327260B (en) | 2021-11-30 | 2021-11-30 | Data reading method, system, server and storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111447677.6A CN114327260B (en) | 2021-11-30 | 2021-11-30 | Data reading method, system, server and storage medium |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN114327260A CN114327260A (en) | 2022-04-12 |
| CN114327260B true CN114327260B (en) | 2023-08-25 |
Family
ID=81049060
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202111447677.6A Active CN114327260B (en) | 2021-11-30 | 2021-11-30 | Data reading method, system, server and storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN114327260B (en) |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104267912A (en) * | 2014-09-19 | 2015-01-07 | 北京联创信安科技有限公司 | NAS (Network Attached Storage) accelerating method and system |
| CN108845768A (en) * | 2018-06-19 | 2018-11-20 | 郑州云海信息技术有限公司 | A kind of date storage method, device, equipment and storage medium |
| CN108875046A (en) * | 2018-06-28 | 2018-11-23 | 郑州云海信息技术有限公司 | A kind of storage system access method, device and electronic equipment |
| CN111538461A (en) * | 2020-04-21 | 2020-08-14 | 招商局金融科技有限公司 | Data reading and writing method and device based on solid state disk cache and storage medium |
| CN112269534A (en) * | 2020-10-16 | 2021-01-26 | 苏州浪潮智能科技有限公司 | Data reading method, device and equipment and computer readable storage medium |
Family Cites Families (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102870100A (en) * | 2012-06-30 | 2013-01-09 | 华为技术有限公司 | Data buffer device, data storage system and method |
-
2021
- 2021-11-30 CN CN202111447677.6A patent/CN114327260B/en active Active
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104267912A (en) * | 2014-09-19 | 2015-01-07 | 北京联创信安科技有限公司 | NAS (Network Attached Storage) accelerating method and system |
| CN108845768A (en) * | 2018-06-19 | 2018-11-20 | 郑州云海信息技术有限公司 | A kind of date storage method, device, equipment and storage medium |
| CN108875046A (en) * | 2018-06-28 | 2018-11-23 | 郑州云海信息技术有限公司 | A kind of storage system access method, device and electronic equipment |
| CN111538461A (en) * | 2020-04-21 | 2020-08-14 | 招商局金融科技有限公司 | Data reading and writing method and device based on solid state disk cache and storage medium |
| CN112269534A (en) * | 2020-10-16 | 2021-01-26 | 苏州浪潮智能科技有限公司 | Data reading method, device and equipment and computer readable storage medium |
Also Published As
| Publication number | Publication date |
|---|---|
| CN114327260A (en) | 2022-04-12 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US7733892B2 (en) | Buffer management method based on a bitmap table | |
| US20120221828A1 (en) | Retrieving data in a storage system using thin provisioning | |
| CN101131671A (en) | Controlling access to non-volatile memory | |
| CN112632069B (en) | Hash table data storage management method, device, medium and electronic equipment | |
| CN107291399B (en) | Back-end storage method, device and system based on SPDK | |
| CN110727403B (en) | Metadata management method and device | |
| CN112954244A (en) | Method, device and equipment for realizing storage of monitoring video and storage medium | |
| US20240086332A1 (en) | Data processing method and system, device, and medium | |
| CN107203480B (en) | Data prefetching method and device | |
| CN115794669A (en) | Method, device and related equipment for expanding memory | |
| KR102471966B1 (en) | Data input and output method using storage node based key-value srotre | |
| CN116414735A (en) | Data storage method, system, storage access configuration method and related equipment | |
| CN111475099A (en) | Data storage method, device and equipment | |
| CN114327260B (en) | Data reading method, system, server and storage medium | |
| CN117012266A (en) | Performance test method and device based on EMMC (EMMC management computer) and storage medium thereof | |
| CN110515861B (en) | Memory device for processing flash command and method thereof | |
| CN112463041B (en) | Processing method for host read-write data and related device | |
| US20060277326A1 (en) | Data transfer system and method | |
| CN109189339B (en) | Automatic configuration cache acceleration method under storage system | |
| CN111984197A (en) | Computer buffer memory allocation method | |
| CN107870736B (en) | Method and device for supporting non-linear flash memory larger than 4GB | |
| CN110209343B (en) | Data storage method, device, server and storage medium | |
| CN112148486A (en) | Memory page management method, device and equipment and readable storage medium | |
| CN117393013B (en) | Efficient DDR control method and related device in statistical application | |
| US20080120464A1 (en) | Apparatus and method for managing data |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |