CN102662854B - A kind of storage means based on the many hard disks of Large Copacity - Google Patents
A kind of storage means based on the many hard disks of Large Copacity Download PDFInfo
- Publication number
- CN102662854B CN102662854B CN201210084050.3A CN201210084050A CN102662854B CN 102662854 B CN102662854 B CN 102662854B CN 201210084050 A CN201210084050 A CN 201210084050A CN 102662854 B CN102662854 B CN 102662854B
- Authority
- CN
- China
- Prior art keywords
- hard disk
- subregion
- district
- storage means
- disk
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Expired - Fee Related
Links
- 238000005192 partition Methods 0.000 claims abstract description 9
- 238000004458 analytical method Methods 0.000 claims description 9
- 230000036962 time dependent Effects 0.000 claims description 2
- 238000005516 engineering process Methods 0.000 description 3
- 238000000034 method Methods 0.000 description 2
- 230000009286 beneficial effect Effects 0.000 description 1
- 230000005540 biological transmission Effects 0.000 description 1
- 239000000969 carrier Substances 0.000 description 1
- 238000010586 diagram Methods 0.000 description 1
- 230000000717 retained effect Effects 0.000 description 1
- 238000005070 sampling Methods 0.000 description 1
Landscapes
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
The present invention relates to a kind of storage means based on the many hard disks of Large Copacity, this storage means is by carrying out subregion to each hard disk, hard disk remaining space is set in each subregion, data file is stored by disk number and partition number, make storage and delete staggered carrying out, when certain district write of certain hard disk, delete then another subregion fixed on another hard disk and carry out, absolute guarantee does not carry out in the same district of same hard disk.Storage means based on the many hard disks of Large Copacity of the present invention, can make full use of hard drive space, makes each subregion of each hard disk by the read-write of equilibrium, erasing, achieves mass data safety, fast storage and index.
Description
Technical field
The present invention relates to a kind of storage means based on the many hard disks of Large Copacity.
Background technology
Intelligent grid is digitizing, informationalized electrical network.The data of the transmission in network and network are information carriers all in intelligent substation.Along with the development of the network communications technology, applying of intelligent substation, records reliably, safely and panorama analytical method mass data in intelligent substation network, becomes requisite demand and possibility.The storage medium of current routine can only be hard disk, storage mode is substantially all the file system based on operating system, the data message of magnanimity, certainly lead to and read and write frequently, delete, and the mode that file system stores at random may cause hard disk local to be written infrequently writing, delete, thus cause hard disk local to be damaged rapidly, cause loss of data.The probability of hard disk corruptions must be reduced by certain storage policy, improve the reliability that data store.
Summary of the invention
The mode that the object of the invention is to solve existing random storage may cause hard disk local to be written infrequently writing, delete, thus causes hard disk local to be damaged rapidly, causes the problem of loss of data, the invention provides a kind of storage means based on the many hard disks of Large Copacity.
The present invention is for solving the problems of the technologies described above and providing a kind of storage means based on the many hard disks of Large Copacity, and the step of this storage means is as follows:
1). the hard disk be connected with intelligent substation network message record analysis device is carried out subregion, and each hard disk is divided at least three subregions;
2). each subregion of each hard disk is numbered, disk remaining space is set in each subregion of each hard disk;
3). data file corresponding area code in hard disk is stored, 1st district from 1st district of first hard disk to second hard disk, until arrive 1st district of last hard disk, and then from 2nd district of first hard disk, to last hard disk 2nd district in this order to last district of last hard disk again from 1st district of first hard disk, move in circles in this order;
4). when the disk remaining space in the m subregion of n-1# hard disk is not more than setting value, then adopt format mode to delete to the m subregion of n# hard disk.
Step 1 described in 2) in the subregion number of hard disk freely adjust according to hard-disk capacity.
Described each hard disk partition size be chosen as 50 ~ 100G.
Described step 2) in each subregion in arrange disk remaining space be the Time dependent deleted by each partition format.
Described hard disk is connected with intelligent substation network message record analysis device by the sata interface of intelligent substation network message record analysis device.
The invention has the beneficial effects as follows: the present invention is by storing and deleting staggered carrying out, and when certain district write of certain hard disk, delete then another subregion fixed on another hard disk and carry out, absolute guarantee does not carry out in the same district of same hard disk.Storage means based on the many hard disks of Large Copacity of the present invention, can make full use of hard drive space, makes each subregion of each hard disk by the read-write of equilibrium, erasing, achieves mass data safety, fast storage and index.
Accompanying drawing explanation
Fig. 1 is the staggered high speed storing schematic diagram putting into the many hard disks of Large Copacity in the embodiment of the present invention.
Embodiment
Below in conjunction with accompanying drawing, the specific embodiment of the present invention is described further.
In intelligent substation, according to 1 data set, 22 path computations, the total length of frame SV (9-2) message is 295 bytes, if sampling rate 4000Hz, 1 MU:300Byte × 4000/s=1.2MB/s; 24 MU:1.2 × 24=28.8MB/s, 30MB/s × 3600s/ hour × 24h/ days=2.592TB, only the SV message data volume of 24 hours is exactly approximately be 2.6T, and this just needs jumbo storage space.
Under (SuSE) Linux OS, by the carrying out format test to 5400 turns of laptop hard, hard-disc storage data are different, format number of times is different, time difference needed for formatting hard disk is little, the first time format shared time only after subregion again can be slightly long, the subregion of 50G, format needs about 3.3 seconds, the subregion of 110G needs about 7 seconds, the subregion of 160G needs about 9 seconds, for ensureing not lose record data, each subregion retains certain disk remaining space, carries out format delete when disk remaining space is less than setting value.Subregion is larger, and the time that format is deleted is longer, and need the setting value of the disk remaining space retained also larger in each subregion, the ratio of the disk useful space is also less.Setting value is certain, subregion is less, judge to carry out formaing the number of times deleted more, the ratio of the Multi-zone disk useful space is also less simultaneously, the setting value size of disk remaining space is determined by formatted. times, during ensureing that format is deleted, enough disk remaining spaces are also had to continue record data.Suppose that N is number of disks, M is number of partitions, H is disk size, D is partitions sizes, U is subregion pot life, and L is minimum disk remaining space in subregion (needing format 1 subregion when being less than this value), and S is effective storage space, V is total surplus storage space (ensureing that this numerical value is as far as possible little), A is total storage space, A=N*H=S+V, S=N*(M-1) * U, V=U+N*M*L, and the effective ratio P=S/A of storage space, classifying rationally, to make the effective ratio of storage space the highest, consider above-mentioned performance, partition size is chosen as 50 ~ 100G.
We are for n the 500G hard disk that intelligent substation network message record analysis device connects, storage means based on the many hard disks of Large Copacity of the present invention is described, for realizing the quick position of file, database selects the MySQL Relational DBMS that volume is little, speed is fast, the total cost of ownership is low, storage file index information, file system selects the ReiserFS file system having Fast-Balance tree (balancedtree) searching algorithm.Of the present invention as follows based on the specific implementation process of Large Copacity to hard-disc storage method:
1. each hard disk in n the 500G hard disk be connected by its sata interface with intelligent substation network message record analysis device is divided into 5 subregions of 100G, 1A represents the 1st subregion of 1# hard disk, and nE represents the 5th subregion of n# hard disk.
2. initial time, writes the 1st subregion, i.e. 1A of 1# hard disk by data file, this district is write completely, then write the 1st subregion 2A of 2# hard disk, until nA writes completely, again from the 2nd subregion of 1# hard disk, 2B starts, until nB ..., sequential loop write like this, until nE.
3. before the 5th subregion of n# hard disk is write completely, carry out format to the 1st subregion of 1# hard disk to delete, write completely until nE, 1A also completes the operation that format is deleted, data file is write the 1st subregion of 1# hard disk, and in 1A, retain certain disk remaining space, when the disk remaining space in the 1st subregion of 1# hard disk is not more than setting value, adopt format mode to delete to the 1st subregion of 2# hard disk, sequential loop like this is reciprocal.
Thus, store and delete staggered carrying out, when certain district write of certain hard disk, delete then another subregion fixed on another hard disk and carry out, absolute guarantee does not carry out in the same district of same hard disk.Storage means based on the many hard disks of Large Copacity of the present invention, can make full use of hard drive space, makes each subregion of each hard disk by the read-write of equilibrium, erasing, achieves mass data safety, fast storage and index.
Claims (4)
1. based on a storage means for the many hard disks of Large Copacity, it is characterized in that: the step of this storage means is as follows:
1). the N number of hard disk be connected with intelligent substation network message record analysis device is carried out subregion, and each hard disk is divided at least three subregions; Described each hard disk partition size be chosen as 50 ~ 100G;
2). each subregion of each hard disk is numbered, disk remaining space is set in each subregion of each hard disk;
3). data file is stored with partition number by hard disk number, 1st district from 1st district of first hard disk to second hard disk, until arrive 1st district of last hard disk, and then from 2nd district of first hard disk, to last hard disk 2nd district in this order to last district of last hard disk again from 1st district of first hard disk, move in circles in this order;
4). when the disk remaining space in the m subregion of n-1# hard disk is not more than setting value, then adopt format mode to delete to the m subregion of n# hard disk;
This storage means stores and deletes staggered carrying out, and when certain district write of certain hard disk, delete then another subregion fixed on another hard disk and carry out, absolute guarantee does not carry out in the same district of same hard disk.
2. the storage means based on the many hard disks of Large Copacity according to claim 1, is characterized in that: described step 1) in the subregion number of hard disk freely adjust according to hard-disk capacity.
3. the storage means based on the many hard disks of Large Copacity according to claim 1, is characterized in that: described step 2) in each subregion in arrange disk remaining space be the Time dependent deleted by each partition format.
4. the storage means based on the many hard disks of Large Copacity according to claim 1, is characterized in that: described hard disk is connected with intelligent substation network message record analysis device by the sata interface of intelligent substation network message record analysis device.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201210084050.3A CN102662854B (en) | 2012-03-27 | 2012-03-27 | A kind of storage means based on the many hard disks of Large Copacity |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201210084050.3A CN102662854B (en) | 2012-03-27 | 2012-03-27 | A kind of storage means based on the many hard disks of Large Copacity |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN102662854A CN102662854A (en) | 2012-09-12 |
| CN102662854B true CN102662854B (en) | 2016-04-20 |
Family
ID=46772351
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201210084050.3A Expired - Fee Related CN102662854B (en) | 2012-03-27 | 2012-03-27 | A kind of storage means based on the many hard disks of Large Copacity |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN102662854B (en) |
Families Citing this family (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105117177B (en) * | 2015-09-14 | 2018-08-10 | 许昌许继软件技术有限公司 | A kind of big data management method based on single hard disk multi partition |
| CN113473195A (en) * | 2021-05-31 | 2021-10-01 | 青岛海尔科技有限公司 | Multimedia data storage method and system, storage medium and electronic device |
Citations (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1553345A (en) * | 2003-06-06 | 2004-12-08 | 英业达股份有限公司 | Multireel disc array managing method and system |
-
2012
- 2012-03-27 CN CN201210084050.3A patent/CN102662854B/en not_active Expired - Fee Related
Patent Citations (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1553345A (en) * | 2003-06-06 | 2004-12-08 | 英业达股份有限公司 | Multireel disc array managing method and system |
Non-Patent Citations (1)
| Title |
|---|
| RAID技术综述;华山;《武钢技术》;20031231;第41卷(第3期);第45-49页 * |
Also Published As
| Publication number | Publication date |
|---|---|
| CN102662854A (en) | 2012-09-12 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US20150193473A1 (en) | Database Storage System based on Optical Disk and Method Using the System | |
| CN103177127B (en) | Based on CD server database storage system and utilize the method for this system | |
| CN102841907A (en) | Methods for processing data compression and decompression | |
| CN108763531B (en) | MDVR file storage system and operation method thereof | |
| CN103226965B (en) | Based on the audio/video data access method of time bitmap | |
| CN102521309B (en) | Storage organization and search method of digital video videotaping files | |
| CN104063187B (en) | Hard disk file system suitable for security application and operation method thereof | |
| CN104461390A (en) | Method and device for writing data into imbricate magnetic recording SMR hard disk | |
| CN102982122A (en) | Repeating data deleting method suitable for mass storage system | |
| CN103164528B (en) | A kind of index establishing method of audio, video data | |
| CN103473298A (en) | Data archiving method and device and storage system | |
| CN103034592A (en) | Data processing method and device | |
| CN107291399A (en) | A kind of rear end storage method based on SPDK, apparatus and system | |
| CN104484427A (en) | Video file storage device and video file storage method | |
| CN104375784A (en) | Method and device for lowering complexity of virtual disk management | |
| CN109542842A (en) | A kind of video sequences storage of compatible fat32 file system and querying method and its device | |
| CN104516677A (en) | Disk data read and write method and disk memory device | |
| US11409720B2 (en) | Metadata reduction in a distributed storage system | |
| CN102662854B (en) | A kind of storage means based on the many hard disks of Large Copacity | |
| CN109189724B (en) | Method and device for improving audio and video data storage efficiency of video monitoring system | |
| CN102937956A (en) | Method and device for storing real-time messages in intelligent substation | |
| CN104461930A (en) | Cache writing method and device | |
| CN110968271B (en) | High-performance data storage method, system and device | |
| CN115437997A (en) | Intelligent identification optimization system for data life cycle | |
| Iwata et al. | A simulation result of replicating data with another layout for reducing media exchange of cold storage |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| ASS | Succession or assignment of patent right |
Owner name: XUJI ELECTRIC CO., LTD. Free format text: FORMER OWNER: XUJI GROUP CO., LTD. Effective date: 20131206 |
|
| C41 | Transfer of patent application or patent right or utility model | ||
| TA01 | Transfer of patent application right |
Effective date of registration: 20131206 Address after: No. 1298 Xuchang City, Henan province 461000 XJ Avenue Applicant after: Xuji Electric Co., Ltd. Applicant after: Xuchang Xuji Software Technology Co., Ltd. Address before: No. 1298 Xuchang City, Henan province 461000 XJ Avenue Applicant before: Xuji Group Co., Ltd. Applicant before: Xuji Electric Co., Ltd. Applicant before: Xuchang Xuji Software Technology Co., Ltd. |
|
| C14 | Grant of patent or utility model | ||
| GR01 | Patent grant | ||
| CF01 | Termination of patent right due to non-payment of annual fee |
Granted publication date: 20160420 Termination date: 20190327 |
|
| CF01 | Termination of patent right due to non-payment of annual fee |