CN107908515A - A kind of system and method for test server hard disk large data files transmittability - Google Patents
A kind of system and method for test server hard disk large data files transmittability Download PDFInfo
- Publication number
- CN107908515A CN107908515A CN201711140352.7A CN201711140352A CN107908515A CN 107908515 A CN107908515 A CN 107908515A CN 201711140352 A CN201711140352 A CN 201711140352A CN 107908515 A CN107908515 A CN 107908515A
- Authority
- CN
- China
- Prior art keywords
- data files
- large data
- measured
- hard disk
- coding
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/22—Detection or location of defective computer hardware by testing during standby operation or during idle time, e.g. start-up testing
- G06F11/2273—Test methods
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/22—Detection or location of defective computer hardware by testing during standby operation or during idle time, e.g. start-up testing
- G06F11/2205—Detection or location of defective computer hardware by testing during standby operation or during idle time, e.g. start-up testing using arrangements specific to the hardware being tested
Landscapes
- Engineering & Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Computer Hardware Design (AREA)
- Quality & Reliability (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
The present invention provides a kind of system and method for test server hard disk large data files transmittability, and system includes import modul, action module, logging modle, judgment module, computing module.Method：Import large data files and coding tools to be measured；Large data files to be measured are encoded using coding tools；Large data files to be measured are replicated to the target partition of hard disk and record doubling time；Encoded using duplication file of the coding tools to large data files to be measured；The coding of the coding of large data files more to be measured and the duplication file of large data files to be measured simultaneously judges whether occur replicating losing；If not going out active, record transmission success is once；If going out active, record transmission failure is once；Delete the duplication file of large data files to be measured and record deletion time；It is repeated up to testing time and reaches full test number；Average multiple-copy rate is calculated, speed, transmission success number, transmission failure number, duplication maximum delay is averagely deleted and deletes maximum delay.
Description
Technical field
The invention belongs to server test field, and in particular to a kind of test server hard disk large data files transmittability
System and method.
Background technology
It is more and more rigorous for the efficiency and stability requirement of the transmission of hard disk I/O data currently in server field.
In addition to requiring the I/O throughput of server in itself and meeting business need, it is also necessary to for large data files（More than 5G files）Pass
Efficiency and stability during defeated are strict with, and avoid the damage of file or the delay of file in transmitting procedure from passing
It is defeated.Traditional hard disk I/O transmission testing tool is both for small data block（4K、8K---1024K）The transmittability of file carries out
Test, there is presently no the measuring means of covering large data files transmittability.
This is the deficiencies in the prior art, therefore, for drawbacks described above of the prior art, there is provided a kind of test server is hard
The system and method for disk large data files transmittability, is necessary.
The content of the invention
It is an object of the present invention to for it is above-mentioned lack large data files transmission stability monitoring and the method for inspection lack
Fall into, there is provided a kind of system and method for test server hard disk large data files transmittability, to solve above-mentioned technical problem.
To achieve the above object, the present invention provides following technical scheme：
A kind of system of test server hard disk large data files transmittability, including：
Import modul, for importing large data files and coding tools to be measured；
Coding module, for being compiled using coding tools to the duplication file of large data files to be measured and large data files to be measured
Code；
Action module, for replicating duplication of the large data files to be measured to the target partition of hard disk and deletion large data files to be measured
File；
Logging modle, for recording doubling time, erasing time, transmission success number and transmission failure number；
Judgment module, for large data files more to be measured coding and large data files to be measured duplication file coding and sentence
It is disconnected whether to occur replicating loss and judge whether testing time reaches full test number；
Computing module, for calculating average multiple-copy rate, averagely deleting speed, transmission success number, transmission failure number, duplication
Maximum delay and deletion maximum delay.Multiple-copy rate is calculated according to large data files size to be measured and doubling time, according to be measured
The size and erasing time of the duplication file of large data files calculate and delete speed.
Further, the size of large data files to be measured is more than 5G.
Further, coding module using md5sum coding toolses to large data files to be measured and large data files to be measured
Replicate file and carry out MD5 codings.
Further, the hard disk uses raid0 either raid1 or raid5 forms.
The present invention provides following technical scheme：
A kind of method of test server hard disk large data files transmittability, includes the following steps：
Import large data files and coding tools to be measured；
Large data files to be measured are encoded using coding tools；
Large data files to be measured are replicated to the target partition of hard disk and record doubling time；
Encoded using duplication file of the coding tools to large data files to be measured；
The coding of the coding of large data files more to be measured and the duplication file of large data files to be measured simultaneously judges whether to answer
System is lost；
If not going out active, record transmission success is once；If going out active, record transmission failure is once；
Delete the duplication file of large data files to be measured and record deletion time；
Repeat the above steps, until testing time reaches full test number；
Average multiple-copy rate is calculated, speed, transmission success number, transmission failure number, duplication maximum delay is averagely deleted and deletes
Except maximum delay.
Further, full test number is 200 times.
Further, the size of large data files to be measured is more than 5G.
Further, MD5 codings are carried out to large data files to be measured using md5sum coding toolses；Encoded using md5sum
Duplication file of the instrument to large data files to be measured carries out MD5 codings.
Further, the hard disk uses raid0 either raid1 or raid5 forms.
Further, using data orders and bash scripts calculate average multiple-copy rate, averagely delete speed, transmission into
Work(number, transmission failure number, replicate maximum delay and delete maximum delay.When according to large data files size to be measured and replicating
Between calculate multiple-copy rate, according to large data files to be measured duplication file size and erasing time calculate delete speed.
The beneficial effects of the present invention are：The present invention can be to developing large data files of the Qualify Phase to server hard disc
Transmittability carries out complete detection verification, ensures that server product disclosure satisfy that the transmitting data file requirement of client.
In addition, design principle of the present invention is reliable, and it is simple in structure, there is very extensive application prospect.
It can be seen from the above that compared with prior art, the present invention with prominent substantive distinguishing features and significant progress, it is implemented
Beneficial effect be also obvious.
Brief description of the drawings
Fig. 1 is the system schematic of the present invention；
Fig. 2 is flow chart of the method for the present invention；
Wherein, 1. import modul；2. coding module；3. action module；4. logging modle；5. judgment module；6. computing module.
Embodiment：
To enable the purpose of the present invention, feature, advantage more obvious and understandable, it is embodied below in conjunction with the present invention
Attached drawing in example, is clearly and completely described the technical solution in the present invention.
As shown in Figure 1, the present invention provides a kind of system of test server hard disk large data files transmittability, including：
Import modul 1, for importing large data files and coding tools to be measured；
Coding module 2, for using duplication text of the md5sum coding toolses to large data files to be measured and large data files to be measured
Part carries out MD5 codings；The size of large data files to be measured is more than 5G；
Action module 3, for replicating large data files to be measured to the target partition of hard disk and deleting answering for large data files to be measured
File processed；Hard disk uses raid0 either raid1 or raid5 forms；
Logging modle 4, for recording doubling time, erasing time, transmission success number and transmission failure number；
Judgment module 5, for encoding with the coding of the duplication file of large data files to be measured simultaneously for large data files more to be measured
Judge whether to occur replicating to lose and judge whether testing time reaches full test number；
Computing module 6, for calculating average multiple-copy rate, averagely deleting speed, transmission success number, transmission failure number, multiple
Maximum delay processed and deletion maximum delay.Multiple-copy rate is calculated according to large data files size to be measured and doubling time, according to treating
The size and erasing time for surveying the duplication file of large data files calculate and delete speed.
As shown in Fig. 2, the present invention provides a kind of method of test server hard disk large data files transmittability, including such as
Lower step：
Import large data files and coding tools to be measured；The size of large data files to be measured is more than 5G；
MD5 codings are carried out to large data files to be measured using md5sum coding toolses；
Large data files to be measured are replicated to the target partition of hard disk and record doubling time；The hard disk using raid0 or
Raid1 or raid5 forms；
MD5 codings are carried out using duplication file of the md5sum coding toolses to large data files to be measured；
The coding of the coding of large data files more to be measured and the duplication file of large data files to be measured simultaneously judges whether to answer
System is lost；
If not going out active, record transmission success is once；If going out active, record transmission failure is once；
Delete the duplication file of large data files to be measured and record deletion time；
Repeat the above steps, until testing time reaches full test number 200 times；
Average multiple-copy rate is calculated using data orders and bash scripts, averagely deletes speed, transmission success number, transmission mistake
Number is imitated, replicate maximum delay and deletes maximum delay.
MD5 full name are message digest algorithms（Message-Digest Algorithm 5）, this algorithm is to random length
Information is calculated by turn, and it is 128 to produce a binary length（Hexadecimal length is exactly 32）" fingerprint "（Or
" message digest "）, the possibility that different files produces identical message digest is very very small.In general, pacify
After having filled Linux, this instrument of md5sum is just had, is directly directly run in order line terminal.
Protection scope of the present invention is not limited to server hard disc, using the present invention to the big of other storage mediums such as HBA cards
The verification of transmitting data file ability also belongs to protection scope of the present invention.
The embodiment of the present invention is illustrative and not restrictive, and above-described embodiment is only to aid in understanding the present invention, because
This is every by those skilled in the art's technique according to the invention the invention is not restricted to the embodiment described in embodiment
Other embodiments that scheme is drawn, also belong to the scope of protection of the invention.
Claims (10)
- A kind of 1. system of test server hard disk large data files transmittability, it is characterised in that including：Import modul, for importing large data files and coding tools to be measured；Coding module, for being compiled using coding tools to the duplication file of large data files to be measured and large data files to be measured Code；Action module, for replicating duplication of the large data files to be measured to the target partition of hard disk and deletion large data files to be measured File；Logging modle, for recording doubling time, erasing time, transmission success number and transmission failure number；Judgment module, for large data files more to be measured coding and large data files to be measured duplication file coding and sentence It is disconnected whether to occur replicating loss and judge whether testing time reaches full test number；Computing module, for calculating average multiple-copy rate, averagely deleting speed, transmission success number, transmission failure number, duplication Maximum delay and deletion maximum delay.
- A kind of 2. system of test server hard disk large data files transmittability as claimed in claim 1, it is characterised in that The size of large data files to be measured is more than 5G.
- A kind of 3. system of test server hard disk large data files transmittability as claimed in claim 1, it is characterised in that Coding module carries out MD5 volumes using md5sum coding toolses to the duplication file of large data files to be measured and large data files to be measured Code.
- A kind of 4. system of test server hard disk large data files transmittability as claimed in claim 1, it is characterised in that The hard disk uses raid0 either raid1 or raid5 forms.
- A kind of 5. method of test server hard disk large data files transmittability, it is characterised in that include the following steps：Import large data files and coding tools to be measured；Large data files to be measured are encoded using coding tools；Large data files to be measured are replicated to the target partition of hard disk and record doubling time；Encoded using duplication file of the coding tools to large data files to be measured；The coding of the coding of large data files more to be measured and the duplication file of large data files to be measured simultaneously judges whether to answer System is lost；If not going out active, record transmission success is once；If going out active, record transmission failure is once；Delete the duplication file of large data files to be measured and record deletion time；Repeat the above steps, until testing time reaches full test number；Average multiple-copy rate is calculated, speed, transmission success number, transmission failure number, duplication maximum delay is averagely deleted and deletes Except maximum delay.
- A kind of 6. method of test server hard disk large data files transmittability as claimed in claim 5, it is characterised in that Full test number is 200 times.
- A kind of 7. method of test server hard disk large data files transmittability as claimed in claim 5, it is characterised in that The size of large data files to be measured is more than 5G.
- A kind of 8. method of test server hard disk large data files transmittability as claimed in claim 5, it is characterised in that MD5 codings are carried out to large data files to be measured using md5sum coding toolses.
- A kind of 9. method of test server hard disk large data files transmittability as claimed in claim 5, it is characterised in that The hard disk uses raid0 either raid1 or raid5 forms.
- 10. a kind of method of test server hard disk large data files transmittability as claimed in claim 5, its feature exist In using data orders and the average multiple-copy rate of bash scripts calculating, averagely deletion speed, transmission success number, transmission mistake Number is imitated, replicate maximum delay and deletes maximum delay.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201711140352.7A CN107908515A (en) | 2017-11-16 | 2017-11-16 | A kind of system and method for test server hard disk large data files transmittability |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201711140352.7A CN107908515A (en) | 2017-11-16 | 2017-11-16 | A kind of system and method for test server hard disk large data files transmittability |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN107908515A true CN107908515A (en) | 2018-04-13 |
Family
ID=61845888
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201711140352.7A Pending CN107908515A (en) | 2017-11-16 | 2017-11-16 | A kind of system and method for test server hard disk large data files transmittability |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN107908515A (en) |
Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101114244A (en) * | 2006-07-28 | 2008-01-30 | 佛山市顺德区顺达电脑厂有限公司 | Method for simultaneously copying data of a plurality of bracket |
| CN101453478A (en) * | 2007-11-28 | 2009-06-10 | 新奥特（北京）视频技术有限公司 | Integrity checking method in document transmission |
| CN103259797A (en) * | 2013-05-17 | 2013-08-21 | 中国联合网络通信集团有限公司 | Data file transmission method and platform |
| CN103488547A (en) * | 2013-09-24 | 2014-01-01 | 浪潮电子信息产业股份有限公司 | Rapid reconstruction method of RAID group fault hard disk |
| CN104380263A (en) * | 2012-05-25 | 2015-02-25 | 赛门铁克公司 | Backup image duplication |
| CN105373339A (en) * | 2014-08-29 | 2016-03-02 | 深圳市金胜电子科技有限公司 | Hard disk data copy method and system |
| CN106610877A (en) * | 2016-12-19 | 2017-05-03 | 郑州云海信息技术有限公司 | Method for testing hard disk data consistency |
-
2017
- 2017-11-16 CN CN201711140352.7A patent/CN107908515A/en active Pending
Patent Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101114244A (en) * | 2006-07-28 | 2008-01-30 | 佛山市顺德区顺达电脑厂有限公司 | Method for simultaneously copying data of a plurality of bracket |
| CN101453478A (en) * | 2007-11-28 | 2009-06-10 | 新奥特（北京）视频技术有限公司 | Integrity checking method in document transmission |
| CN104380263A (en) * | 2012-05-25 | 2015-02-25 | 赛门铁克公司 | Backup image duplication |
| CN103259797A (en) * | 2013-05-17 | 2013-08-21 | 中国联合网络通信集团有限公司 | Data file transmission method and platform |
| CN103488547A (en) * | 2013-09-24 | 2014-01-01 | 浪潮电子信息产业股份有限公司 | Rapid reconstruction method of RAID group fault hard disk |
| CN105373339A (en) * | 2014-08-29 | 2016-03-02 | 深圳市金胜电子科技有限公司 | Hard disk data copy method and system |
| CN106610877A (en) * | 2016-12-19 | 2017-05-03 | 郑州云海信息技术有限公司 | Method for testing hard disk data consistency |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN102270161B (en) | Methods for storing, reading and recovering erasure code-based multistage fault-tolerant data | |
| CN108170555A (en) | A kind of data reconstruction method and equipment | |
| CN106844098B (en) | Rapid data recovery method and system based on cross erasure coding | |
| US9916478B2 (en) | Data protection enhancement using free space | |
| CN111400083B (en) | Data storage method and system and storage medium | |
| WO2018098972A1 (en) | Log recovery method, storage device and storage node | |
| BR112015031633B1 (en) | Computer readable medium having a method for generating an erasure code, redundant mode storage method and redundant data storage system | |
| CN103116615B (en) | A kind of data index method and server based on version vector | |
| CN101784996A (en) | Emulated storage system | |
| CN106649891A (en) | Distributed data storage method and system | |
| WO2019001521A1 (en) | Data storage method, storage device, client and system | |
| CN107145407B (en) | Method for carrying out local backup on data | |
| JP2013520747A (en) | System and method for enabling a replication target to reuse unused storage space on a thin provisioning storage system | |
| US20170116217A1 (en) | High bit rate covert channel in cloud storage systems | |
| CN105511812A (en) | Method and device for optimizing big data of memory system | |
| US20160098322A1 (en) | Background Initialization for Protection Information Enabled Storage Volumes | |
| CN108062419A (en) | A kind of file memory method, electronic equipment, system and medium | |
| CN102053880A (en) | Rar file carving recovery method based on contents | |
| CN107577549A (en) | It is a kind of to store the method for testing for deleting function again | |
| CN112995337B (en) | High-performance processor chip-based high-performance Internet of things hardware platform and method | |
| Zhu et al. | An intelligent data de-duplication based backup system | |
| CN106843760A (en) | It is a kind of based on the asynchronous remote copy system deleted and method again | |
| CN107908515A (en) | A kind of system and method for test server hard disk large data files transmittability | |
| US10592336B1 (en) | Layered indexing for asynchronous retrieval of redundancy coded data | |
| CN106933707A (en) | A kind of data storage device data restoration methods and system |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20180413 |