CN108874611A - A kind of construction method and device of test data - Google Patents
A kind of construction method and device of test data Download PDFInfo
- Publication number
- CN108874611A CN108874611A CN201710334808.7A CN201710334808A CN108874611A CN 108874611 A CN108874611 A CN 108874611A CN 201710334808 A CN201710334808 A CN 201710334808A CN 108874611 A CN108874611 A CN 108874611A
- Authority
- CN
- China
- Prior art keywords
- data
- file
- tested
- test
- data file
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/36—Preventing errors by testing or debugging software
- G06F11/3668—Software testing
- G06F11/3672—Test management
- G06F11/3684—Test management for test design, e.g. generating new test cases
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/22—Detection or location of defective computer hardware by testing during standby operation or during idle time, e.g. start-up testing
- G06F11/26—Functional testing
- G06F11/263—Generation of test inputs, e.g. test vectors, patterns or sequences ; with adaptation of the tested hardware for testability with external testers
Abstract
The embodiment of the invention provides a kind of construction method of test data and device, method is：Obtain the building parameter of target detection data, wherein target detection data are：It is stored in equipment to be tested and for the test data that test system to be measured is tested belonging to the equipment to be tested, constructing parameter to be the data structure determination based on test system to be measured, and building parameter includes：First data volume of the data to be written in first quantity of the data file to be generated in equipment to be tested, each data file；The first number of data file of default file format is generated in equipment to be tested, wherein default file format is determined by the data structure of test system to be measured；For each data file, the data of corresponding first data volume of the data file is generated, and the data file is written into the data of generation, obtain the test data tested for treating test macro.The time of building test data can be reduced using the embodiment of the present invention.
Description
Technical field
The present invention relates to data test technical fields, more particularly to the construction method and device of a kind of test data.
Background technique
In the prior art, for the test of software, system, it is all based on test case completion, wherein test case
(TestCase) refer to the description that test assignment is carried out to a specific software product, embody testing scheme, method, technology and
Strategy, content includes test target, test environment, input data, testing procedure, expected results, test script etc., and forms text
Shelves.The purpose of implementation of test cases is, verifies some programs (such as the unit of software, or the integrated system being made of unit
System) whether meet particular demands.
In a distributed manner for storage system, data dispersion is stored in more independent equipment by distributed memory system,
Using expansible system structure, storage load is shared using more data servers (DataServer), utilizes location-based service
Device (NameServer) positioning storage information.In distributed memory system, when executing with the data related test case of recovery,
It needs to be tested with data recovery function of the test data to system, test data is exactly the phase constructed to be tested
Close data.
It is tested using data recovery function of the test data to distributed memory system, such as closing data server,
The operation for removing the deletion data such as data server, removal disk, removal copy can trigger system data recovery.For example, removing
The delete operation of one data server can all remove all test datas in the data server, and location server is being supervised
It controls after all test datas in the data server all remove, triggers the time data recovery mechanism of system (assuming that the system is
Three copy storage modes, the copy that is stored of the data server is lost after removing a data server, i.e., three copies have lacked one
A copy), suitable data server, other two copies places corresponding to the copy from loss are found according to balance policy
Data server in test data is copied in new data server.
As seen from the above, it needs to construct test data before testing system, it in the prior art, can be using automatic
Change mode constructs test data, can also construct test data using manual type.Wherein, automation building test data, can
To effectively improve testing efficiency.Compared with artificial constructed test data, automated data is built with following features：It is surveyed with automation
It after examination combines, continual can be tested, by the more wheel tests of long-time, tend to find indiscoverable failure.Closely
The technology of Nian Lai, automation building test data are rapidly progressed, a large amount of automatic test data construction method and work
Tool is developed, so as to uninterruptedly automatically detect the failure in software, and to some large scale business softwares and
The software fault and security risk for not having discovery in manual test largely are had found in the test of open source software.
In the automatic test of distributed memory system, there are two types of modes for building test data：One kind is randomly generated
Mode, by calling system write-in, modification, delete interface, be written the test data of random size in systems, delete random
The test data of ratio；Another kind is, according to size of data, the deletion ratio on line, to pass through calling based on actual conditions on line
System write-in, deletes interface at modification, the test data of corresponding size is written in systems, and delete the test data of ratio,
Test data is set to reflect situation on line as far as possible.
Both modes are all the write-in provided using distributed memory system, modification, delete interface to realize test number
According to building.In distributed memory system, each data server includes multiple disks (such as 36), in each disk
It is stored in the way of catalogue multiple data blocks (block), a data block indicates a copy (replica).Using certainly
After dynamicization test data construction method and tool generate data, by the data feedback of generation to distributed memory system, so that point
Cloth storage system is write data into according to the data storage logic of itself in the data block of each data server.To use
For the write-in interface that distributed memory system provides realizes the building of test data, the write-in of each data server is called to connect
When data are written in mouth within the data block, system logic could be triggered after needing to write a data block completely and generates next data
Block, is then written data in next data block generated, and the data capacity of a data block is generally 8GB.In fact,
Guarantee the accuracy of test when test, it usually needs multiple data blocks are generated in each disk.In this way, being tested in building
When data, it is more than that the data of 100GB then need to be written for biggish distributed memory system that write-in is needed in each disk
More data.
As it can be seen that the prior art constructs the mode of test data in distributed memory system, due to utilizing distributed storage
The data storage logic of system itself constructs test data, inevitably cause the data volume of the test data of building compared with
Greatly, so that the time of building test data is longer.
Summary of the invention
The construction method and device for being designed to provide a kind of test data of the embodiment of the present invention, to reduce building test
The time of data.Specific technical solution is as follows：
In a first aspect, in order to achieve the above objectives, it is described the embodiment of the invention discloses a kind of construction method of test data
Method includes：
Obtain the first building parameter of target detection data, wherein the target detection data are：It is to be measured to be stored in first
Try equipment and for the test data that test system to be measured is tested belonging to the described first equipment to be tested, first building
Parameter is the data structure determination based on the test system to be measured, and the first building parameter includes：Will described first to
First data volume of the data to be written in first quantity of the data file generated in test equipment, each data file；
The first data file of the first quantity of default file format is generated in the described first equipment to be tested, wherein
The default file format is determined by the data structure of the test system to be measured；
For every one first data file, the data of corresponding first data volume of first data file are generated, and
First data file is written into the data of generation, obtains the first test number for being tested the test system to be measured
According to.
Optionally, the test system to be measured is：Distributed memory system；
First equipment to be tested is：Data server in the distributed memory system；
First data file is：The file of storing data in the form of data block.
Optionally, the first data volume of the data to be written includes in each data file：Each data file institute
Quantity, the data volume of each object of quantity, deleted object comprising object not deleted in data block；
It is described to be directed to every one first data file, generate the data of corresponding first data volume of first data file
The step of, including：
For every one first data file, according to the number of not deleted object in the included data block of the first data file
Amount, the quantity of deleted object, the data volume of each object, generate the corresponding data of the first data file.
Optionally, the method also includes：
Correcting and eleting codes coding is carried out to first data file, the second data file is generated, obtains for described to be measured
The second test data that test system is tested.
Optionally, described the step of correcting and eleting codes coding is carried out to first data file, generates the second data file, packet
It includes：
Whether the value for judging the parameter preset in first data file is preset value；
If so, carrying out correcting and eleting codes coding to first data file, the second data file is generated.
Optionally, the method also includes：
The third data file for receiving and storing the second equipment feedback to be tested in the test system to be measured, is used for
The third test data that the test system to be measured is tested, wherein the third data file is：Described second is to be tested
The data file that generates in equipment according to the second quantity in the second building parameter and the data of the second data volume are written with,
Described second, which constructs parameter, is：It is determined based on the data structure of the test system to be measured, the second building parameter includes：It wants
The of the data to be written in second quantity of the data file generated in the described second equipment to be tested, each data file
Two data volumes, third data file are the data file of default file format.
Optionally, the method also includes：
The 4th data file for receiving and storing the described second equipment feedback to be tested, obtains for the system to be tested
The 4th test data that system is tested, wherein the 4th data file is the described second equipment to be tested to the third
Data file carries out the data file generated after correcting and eleting codes coding.
Optionally, the method also includes：
After the completion of constructing test data, the prompting message of test data is completed in output building.
Second aspect, in order to achieve the above objectives, the embodiment of the invention also discloses a kind of construction device of test data, institutes
Stating device includes：
Module is obtained, for obtaining the first building parameter of target detection data, wherein the target detection data are：
It is stored in the first equipment to be tested and for the test number that test system to be measured is tested belonging to the described first equipment to be tested
According to the first building parameter is the data structure determination based on the test system to be measured, and the first building parameter includes：
The data to be written in first quantity of the data file to be generated in the described first equipment to be tested, each data file
First data volume；
Generation module, for generating the first number of the first quantity of default file format in the described first equipment to be tested
According to file, wherein the default file format is determined by the data structure of the test system to be measured；
Writing module generates corresponding first number of first data file for being directed to every one first data file
First data file is written according to the data of amount, and by the data of generation, obtains for testing the test system to be measured
The first test data.
Optionally, the test system to be measured is：Distributed memory system；
First equipment to be tested is：Data server in the distributed memory system；
First data file is：The file of storing data in the form of data block.
Optionally, the first data volume of the data to be written includes in each data file：Each data file institute
Quantity, the data volume of each object of quantity, deleted object comprising object not deleted in data block；
The generation module, is specifically used for：
For every one first data file, according to the number of not deleted object in the included data block of the first data file
Amount, the quantity of deleted object, the data volume of each object, generate the corresponding data of the first data file.
Optionally, described device further includes：
Coding module generates the second data file, is used for carrying out correcting and eleting codes coding to first data file
In the second test data tested the test system to be measured.
Optionally, the coding module, including：
Judging submodule, for judging whether the value of the parameter preset in first data file is preset value；If
It is to trigger encoding submodule；
The encoding submodule, for generating the second data file to first data file progress correcting and eleting codes coding,
Obtain the second test data for being tested the test system to be measured.
Optionally, described device further includes：
First receiving module, for receiving and storing the third of the second equipment feedback to be tested in the test system to be measured
Data file obtains the third test data for being tested the test system to be measured, wherein the third data file
For：In second equipment to be tested according to second building parameter in the second quantity generate data file and be written with
The data of second data volume, the second building parameter are：It is determined based on the data structure of the test system to be measured, described the
Two, which construct parameters, includes：The second quantity, each data file for the data file to be generated in the described second equipment to be tested
In the data to be written the second data volume, third data file be default file format data file.
Optionally, described device further includes：
Second receiving module is obtained for receiving and storing the 4th data file of the described second equipment feedback to be tested
The 4th test data for being tested the test system to be measured, wherein the 4th data file be described second to
Test equipment carries out the data file generated after correcting and eleting codes coding to the third data file.
Optionally, described device further includes：
Output module, for after the completion of constructing test data, the prompting message of test data to be completed in output building.
A kind of test data construction method and device provided in an embodiment of the present invention, firstly, obtaining target detection data
First building parameter, wherein target detection data are：It is stored in the first equipment to be tested and for first equipment to be tested
The test data that affiliated test system to be measured is tested, the first building parameter is that the data structure based on the test system to be measured is true
Fixed, the first building parameter includes：First quantity of the data file to be generated in the first equipment to be tested, each data text
First data volume of the data to be written in part；Then, the first number of default file format is generated in the first equipment to be tested
Measure first data file, wherein default file format is determined by the data structure of test system to be measured；Finally, for every
One first data file generates the data of corresponding first data volume of first data file, and should by the write-in of the data of generation
First data file obtains the first test data tested for treating test macro.
As it can be seen that scheme provided in an embodiment of the present invention, control by building parameter to be constructed in equipment to be tested
The data volume of test data, data structure and file format based on test system to be measured generate data text in equipment to be tested
Part generates the data of corresponding data amount for each data file, and the data of generation are directly write to the data file
In, the logic for not needing to trigger test system to be measured generates a large amount of test data, so as to reduce the data volume of test data,
Reduce the time required for building test data.
Detailed description of the invention
In order to more clearly explain the embodiment of the invention or the technical proposal in the existing technology, to embodiment or will show below
There is attached drawing needed in technical description to be briefly described, it should be apparent that, the accompanying drawings in the following description is only this
Some embodiments of invention for those of ordinary skill in the art without creative efforts, can be with
It obtains other drawings based on these drawings.
Fig. 1 is the data structure schematic diagram of object storage system provided in an embodiment of the present invention；
Fig. 2 is the data structure schematic diagram of data server in object storage system provided in an embodiment of the present invention；
Fig. 3 is the bibliographic structure schematic diagram of data block in object storage system provided in an embodiment of the present invention；
Fig. 4 is the schematic diagram that dat file stores data in data block provided in an embodiment of the present invention；
Fig. 5 is a kind of flow diagram of test data construction method provided in an embodiment of the present invention；
Fig. 6 is the frame diagram of a specific embodiment provided in an embodiment of the present invention；
Fig. 7 is a kind of structural schematic diagram of test data construction device provided in an embodiment of the present invention.
Specific embodiment
Following will be combined with the drawings in the embodiments of the present invention, and technical solution in the embodiment of the present invention carries out clear, complete
Site preparation description, it is clear that described embodiments are only a part of the embodiments of the present invention, instead of all the embodiments.It is based on
Embodiment in the present invention, it is obtained by those of ordinary skill in the art without making creative efforts every other
Embodiment shall fall within the protection scope of the present invention.
In order to effectively reduce building test data data volume, shorten building test data time, the present invention implement
Example provides the construction method and device of a kind of test data.It is emphasized that scheme provided by the embodiment of the present invention can
Can be also used for the test of building conventional individual storage system for constructing test data required for distributed memory system
In data and the similar system of other principles, it is not limited here.
The embodiment of the present invention is a kind of file format for system bottom file, needs to construct test data according to test
Scheme.Such as in distributed memory system, on the basis of system bottom file format, needed to construct correspondence according to test
The data of amount are written to the bottom of each server of entire distributed testing cluster in such a way that distributed parallel is written
In file.Test data process is constructed based on demand scene and function, is not related to the bottom generation of any distributed system
The change of code, it is therefore an objective to improve testing efficiency.
For the ease of the understanding to the construction method of a kind of test data provided by inventive embodiments, this hair is introduced first
The scheme the principle on which content that bright embodiment provides.The object storage system in a distributed manner in storage system is below
Example, analyzes the entire data store organisation and file format of distributed memory system, specific as follows：
As shown in Figure 1, the data structure of object storage system can use tree represenation, including location server
(NameServer) and data server (DataServer), wherein more DataServer for storing data, share storage
Load, the storage information of institute's storing data is managed collectively by NameServer in DataServer.
As shown in Fig. 2, DataServer manages all disks (disk) of its place machine, lead in every DataServer
It often include 36 pieces of disk, each disk stores multiple block, i.e. data block below as the mode of catalogue.
Next the specific structure of block is analyzed.Firstly, with storage path of the block in disk/
For data/vols/vol1/phenix_data/00000000000000709106501, wherein last string number
00000000000000709106501 format is %d%020d%02d.Wherein, the first bit digital is 0 or 1, indicates block
Type, 0 indicate the block be three copies in a copy, 1 indicate the block be ec copy in a copy (ec copy
For the data encoded by correcting and eleting codes (Erasure-Code) mode).Intermediate two ten digits indicate block id, i.e., should
Unique identification of the block in the object storage system.Last two digits indicate copy (replicate) id, i.e. block's
Unique identification of a certain copy in all copies of the block, when the copy is a copy in three copies last two
The value of bit digital is 0-2, i.e., 00,01,02, and the value of last two digits is then in the case where other are greater than 3 copies
2 may be greater than.For example, obtaining 12 copies after encoding by Erasure-Code (including 8 data blocks, 4 verifications
Block), in this case, when a certain copy is a copy in ec copy, the value of last two digits is 0-11, i.e., 00,
01,02 ... 09,10, obtain copy and be known as ec copy after 11, Erasure-Code coding.
Then, the file under block catalogue is analyzed, block bibliographic structure is as shown in Figure 3.One block catalogue
Under have 3 file/directories, wherein 0 with 1 be catalogue, CURRENT is file.0 or 1 is stored in CURRENT file, indicates current
When the catalogue that data are stored, i.e. CURRENT content are 0, the catalogue that catalogue 0 is stored by current data is indicated.There are 0 and 1
The purpose of multiple catalogues is：It, can will be compressed when carrying out Erasure-Code coding compression to the data in block
Data are stored in another catalogue, and modifying CURRENT file after the completion of compression makes it be directed to another catalogue, thus
The operation of current data catalogue is not influenced.
There are 3 files under 0 or 1 catalogue：Idx, dat and Manifest, wherein
1, Manifest file is recorded with text formatting there are three value, sequenceId, fulltime and ecId,
In, sequenceId is used for synchronization progress when indicating three copies synchronizeds, fulltime for identify dat file whether write expire,
And dat file is at the time of write full, the ec pair that ecId is used to indicate whether to make three copies correcting and eleting codes coding and generates
This unique identification.
2, idx file is as index, and record deposits in the object (object) of the block in dat text in a binary format
Position in part；Its format is as follows：
3, dat file stores the data of object in a binary format, and format is that the header of object is added
The data data of object, as shown in figure 4, the corresponding data of multiple object can be stored in a dat file, wherein each
The format of the header of object is as follows：
It will be appreciated by persons skilled in the art that object object is the basic of data storage in distributed memory system
Unit, each object are the synthesis of data and data property set, and data attribute can be configured according to the demand of application,
Including data distribution, service quality etc..Object safeguards the attribute of oneself, to simplify the management role of storage system, increases
Flexibility is added.The size of object can be different, may include entire data structure, such as file, database table entry.
To solve prior art problem, the embodiment of the invention provides a kind of construction method of test data and devices.Under
The construction method that kept man of a noblewoman is first provided for the embodiments of the invention a kind of test data is described in detail.
It should be noted that the executing subject of scheme provided in this embodiment can be the first equipment to be tested itself,
It can be other equipment in pre-set test system to be measured, the present embodiment does not limit this.
Fig. 5 is a kind of flow diagram of the construction method of test data provided in an embodiment of the present invention, and this method includes：
S501 obtains the first building parameter of target detection data, wherein target detection data are：Be stored in this first
Equipment to be tested and for the test data that test system to be measured is tested belonging to first equipment to be tested, the first building ginseng
Number is the data structure determination based on test system to be measured, and the first building parameter includes：It to be generated in the first equipment to be tested
The first quantity of data file, in each data file the data to be written the first data volume.
S502 generates the first data file of the first quantity of default file format in first equipment to be tested,
In, default file format is determined by the data structure of test system to be measured.
S503 generates the data of corresponding first data volume of first data file for every one first data file, and
First data file is written into the data of generation, obtains the first test data tested for treating test macro.
In practical applications, by the mode of the data write-in data file of generation, equipment to be tested can directly be passed through
Operating system is written, and can also be write by way of writing direct bottom data file provided by test system to be measured
Enter, the present embodiment does not limit this.
In practical application, above-mentioned test system to be measured can be single machine storage system, then the survey of building single machine storage system
Data are tried, that is, construct test data in the storage equipment of the single machine storage system.In single machine storage system, this implementation
The executing subject of scheme provided by example can be the storage equipment itself, or another equipment, another equipment according to
Building parameter constructs test data in the storage equipment, and the present embodiment does not limit this.
It will be appreciated by persons skilled in the art that single machine storage system is a kind of encapsulation of single machine storage engines, externally
File, key assignments, table or relational model are provided, wherein single machine storage engines are exactly Hash table, B-tree (B-Tree), LSM tree
Data structures such as (Log-Structured Merge Tree, log-structured merging trees) are in mechanical disk, solid state hard disk (Solid
State Drives, SSD) etc. realization on persistences medium.
Than if any a single machine storage system, storing data, each layer are an independent file in a hierarchical fashion.
Assuming that the data store organisation of the single machine storage system is seven layers, then 7 are generated in the storage equipment of the single machine storage system
A data file, and the first data volume of the data to be written in this 7 data files can be set.Assuming that each data text
Whether at most writable data volume is 1GB in part, when due to being tested using test data system, write in data file
When can't completely be had an impact to test, and carry out test data building according to the scheme of the prior art, it is necessary to write completely each layer
Data file, the time so as to cause building test data is longer, therefore in order to shorten the time of building test data, can be with
It is lower value that the first data volume of data will be written by, which being arranged in each data file,.
First building parameter can be pre-set for tester, and the storage equipment by order line or can connect
The mode of mouth obtains the first building parameter.It is raw in the storage equipment after obtaining the first building parameter of target detection data
At the first data file of 7 preset formats, it is possible to understand that, each layer data storage organization of the single machine storage system has
Its specific file format, it is therefore desirable to the data file for meeting this layer of file format is generated at each layer.
Then, the first data volume for constructing the data to be written in each data file in parameter according to first, for every
One first data file generates the data of corresponding first data volume of first data file, and should by the write-in of the data of generation
First data file obtains the test data for being tested the single machine storage system.
Specifically, the number of specific data amount can be generated using automatic test data the build tool in the prior art
According to automatic test data the build tool such as application program GenerateData can provide random data table and generate clothes
Business, is used for software or data library test etc., and producible data include 20 multiple types, including name, Email, day
Phase, number, increases integer, currency etc. at address certainly, or even including random normal distributed data.
It should be understood that if the method according to the prior art constructs test data in the single machine storage system, from
Successively data are written in 7 data files in one layer of sequence to layer 7, it would be possible that needing to be written the data of 10GB.But
It is, using scheme provided by the present embodiment, the data file of layer 1-7 directly to be constructed in storage equipment, and respectively each
The data that preset data amount is written in data file are not needed then to write each data file completely, be surveyed so as to shorten building
The time of data is tried, further, when being tested using test data, since the data volume of test data is smaller, test
When the spent time it is also shorter, testing efficiency can be improved.
In practical application, above-mentioned test system to be measured can also be distributed memory system, then the above-mentioned first equipment to be tested
Can be：Data server in distributed memory system.In distributed memory system, data be in the form of data block into
Row storage, therefore above-mentioned first data file can be：The file of storing data in the form of data block.
In distributed memory system, the executing subject of scheme provided by the present embodiment can be the first equipment to be tested
Itself, or perhaps a certain specific data server location server or the specific data take location server
Business device constructs test parameter, the present embodiment pair according to the corresponding building parameter of each data server in each data server
This is without limitation.
Seen from the above description, it is stored with the different corresponding data of object object in data file, in practical application,
User may carry out delete operation to some object.Therefore in order to construct the test number to tally with the actual situation as far as possible
According to the first data volume of the data to be written may include in above-mentioned each data file：Each included data of data file
The quantity of not deleted object, the quantity of deleted object, the data volume of each object in block；
Correspondingly, above-mentioned be directed to every one first data file, corresponding first data volume of first data file is generated
The step of data may include：
For every one first data file, according to the number of not deleted object in the included data block of the first data file
Amount, the quantity of deleted object, the data volume of each object, generate the corresponding data of the first data file.
Due to may include multiple disks in each data server, multiple data blocks can be generated in each disk, because
This, the first quantity of the data file to generate in the first equipment to be tested that the first building parameter is included can be：It wants
The quantity of the data file generated in each disk of the first equipment to be tested.It therefore can be according to being given birth in each disk
At data file quantity, in each disk of the first equipment to be tested generate corresponding number the first data file.
Then, for every one first data file, according to not deleted right in the included data block of the first data file
The quantity of elephant, the quantity of deleted object, the data volume of each object, generate the data of the corresponding data volume of each object,
And for deleted object, the label that " deletion " can also be carried out in the header of the object is to distinguish the object
Deleted object.
It will be appreciated by persons skilled in the art that in order to improve the reliability of distributed memory system and safety,
Data storage can be carried out by the way of copy, copy replica is the common concepts in distributed memory system：It will be certain
The data of size are stored according to certain redundancy strategy, with availability of the safeguards system in local fault.For redundancy
The number of copy, most common three copy.Distributed memory system generally possesses the automatic function of restoring copy, in local data
When Server Error, system automatically initiates copy Restoration Mechanism, and the data copy on the data server of the delay machine is restored to
On the data server of other health.In consideration of it, test data described in the present embodiment is precisely in order to test distributed storage system
The copy of system restores function and constructs.
In a kind of preferable embodiment, in order to keep the data volume of the first test data of building as few as possible, and
Realize as simple as possible, to need that distributed memory system is made full use of to provide copy mechanism.It should be understood that distributed storage
It include more data servers in system, the second equipment to be tested is different from data service corresponding to the first equipment to be tested
Another data server of device.After constructing test data in each data server all in accordance with the above method, according to
The copy mechanism of distributed memory system, each data block in data server can revert to multiple copies automatically, and according to
Certain balance policy is stored respectively in multiple data servers.
Therefore, method provided by the present embodiment can also include：
The third data file for receiving and storing the second equipment feedback to be tested in test system to be measured, obtains for treating
The third test data that test macro is tested, wherein third data file is：According to the second structure in second equipment to be tested
The data file for the second quantity generation built in parameter and the data for being written with the second data volume, the second building parameter are：Base
It is determined in the data structure of test macro, the second building parameter includes：The data text to be generated in the second equipment to be tested
Second data volume of the data to be written in second quantity of part, each data file, third data file are default file lattice
The data file of formula.
Specifically, the method for the test data in the second equipment to be tested of building, with above-mentioned building first equipment to be tested
In the first test data method it is identical, this will not be repeated here.
It should be understood that by taking three copy mechanism as an example in addition the data file in the second equipment to be tested reverts to automatically
Two copies, and one of copy is sent to the first equipment to be tested to store according to balance policy, thus first to
Test data in test equipment can also originate from test data constructed in the second equipment to be tested.
As it can be seen that utilizing copy mechanism, it is only necessary to a copy be written in each data file in equipment to be tested
Then data restore function after checking that copy state is improper by the copy of system, revert to multiple copies automatically.In this way,
When constructing the first test data in the first equipment to be tested for step S503, the case where without the concern for multiple copies, only
It needs the copy id of the data block corresponding when generating the first data file to default and uses 00.It is surveyed in this way, building can be reduced
Try the complexity of data.
Further, it will be appreciated by persons skilled in the art that occupied space is stored in order to reduce data, in pair
On the basis of present mechanism, correcting and eleting codes coding can also be carried out to data block, copy mechanism and correcting and eleting codes coding are all to pass through increase
The mode of redundant data guarantees data when partial loss occurs, and initial data is not lost.But it compared to copy, entangles and deletes
Code can obtain similar reliability with much lower memory space cost.Such as three copy mode storage overhead be 3 because equally
Data be stored three parts, and under the correcting and eleting codes strategy of 8+4 (initial data being divided into 8 parts, calculate 4 parts of redundancies), storage
Expense is 1.4.The storage overhead of storage system can be greatly reduced using correcting and eleting codes, reduce hardware, O&M and management cost.
Therefore, after constructing the first test data in the first equipment to be tested, method provided by the present embodiment is also
May include：
To the first data file carry out correcting and eleting codes coding, generate the second data file, obtain for treat test macro into
Second test data of row test.
It should be understood that carrying out correcting and eleting codes coding to the first data file, the second data file of generation is properly termed as ec
Copy.By taking the correcting and eleting codes strategy of three copies and 8+4 as an example, ec copy is to pass through correcting and eleting codes after reaching specified conditions by three copies
It is obtained after coding.Specifically, since data block has certain data capacity, after the corresponding data block of three copies is write completely, number
Correcting and eleting codes encoding mechanism can be triggered according to server, correcting and eleting codes coding is carried out to the data block for being 00 of copy id in three copy, is obtained
To 12 ec copies, the copy id ec copy for being 00 is then stored in data server local, and copy id is 01-11's
Other 11 ec copies are then respectively stored into other 11 data servers according to certain equilibrating mechanism.
In the prior art, the fulltime value in the Manifest file in data block block can be 1 or -1,
It is full that fulltime=-1 indicates that data block block does not write also, when data server detects that data block block writes full,
1 is set from -1 by the fulltime value of data block block, it is full to indicate that data block block has write, triggering, which is entangled, at this time deletes
Code encoding mechanism generates ec copy.In fact, reducing system since the calculation amount for carrying out correcting and eleting codes coding to data block is larger
Performance, therefore the number of correcting and eleting codes coding should be reduced to the greatest extent.And data for being stored with more object in data block, when with
Family is deleted in the data block after the data of some objects, which can continue to store the data of other objects, if when number
Correcting and eleting codes encoding mechanism is triggered immediately after writing completely according to block, and lucky user performs deletion behaviour to the object in the data block at this time
Make, then unnecessary progress correcting and eleting codes coding at this time.And hence it is also possible to which a preset duration full is arranged, set from fulltime value
Start timing at the time of being set to 1, judges whether the data block is still after the preset duration and write full state, if so, right again
The data block carries out correcting and eleting codes coded treatment.
In the present embodiment, due to not writing full data in each data file, data server will not automatic trigger
Correcting and eleting codes encoding mechanism.In this case, the executing subject of scheme provided by the present embodiment can be by data file
Fulltime value in Manifest file is set as 1, and with forced-triggered correcting and eleting codes encoding mechanism, each data file is simultaneously at this time
Correcting and eleting codes coding can completely be carried out by not needing to write.
Therefore, it above-mentioned the step of correcting and eleting codes coding is carried out to the first data file, generates the second data file, can wrap
It includes：
Whether the value for judging the parameter preset in the first data file is preset value；
If so, carrying out correcting and eleting codes coding to the first data file, the second data file is generated.
Certainly, the present embodiment is only illustrated parameter preset by taking the fulltime value in Manifest file as an example,
In practical application, it is to trigger the parameter of correcting and eleting codes encoding mechanism that other parameters, which also can be set, and the present embodiment does not limit this.
It should be understood that the data file in arbitrary data server in distributed memory system can be according to above-mentioned
Method carries out correcting and eleting codes coding, and therefore, method provided in this embodiment can also include：
The 4th data file for receiving and storing the second equipment feedback to be tested, obtains being surveyed for treating test macro
4th test data of examination, wherein the 4th data file is that the described second equipment to be tested entangle deleting to third data file
The data file generated after code coding.
It should be understood that the ec copy that the third data file in the second equipment to be tested is encoded according to correcting and eleting codes,
One of ec copy can be sent to the first equipment to be tested to store according to balance policy, therefore the first equipment to be tested
In test data can also originate from the ec copy encoded in the second equipment to be tested by correcting and eleting codes.
As it can be seen that scheme provided by the present embodiment, first constructs the first test data in each data server, it is then sharp
With the distinctive copy mechanism of distributed memory system and correcting and eleting codes encoding mechanism, two different copy types are used different
Strategy constructs test data, constructs third test data and the second test data in each data server respectively, because
This it is constructed go out test data more meet distributed memory system need summation function.Therefore, this implementation is deposited from distribution
Storage system feature itself and function are set out, and are provided and a kind of are carried out test data building according to system bottom data structure itself
Scheme, and random data and the function of generating according to data on line may be implemented by building state modulator on this basis.This
Scheme is for distributed memory system, by accurately constructing low volume data, can effectively shorten the testing time, improves system version
This iteration efficiency quickly verifies bug reparation on line, reduces system failure time, improve through distributed storage system
The interface of system constructs the shortcomings that test data overlong time.
In practical application, method provided by the present embodiment can also include：After the completion of constructing test data, structure is exported
Build the prompting message for completing test data.In this way, tester will be seen that the building situation of test data, in test data structure
It is tested using test data after the completion of building.
As seen from the above, a kind of test data construction method provided in this embodiment, firstly, obtaining target detection data
First building parameter, wherein target detection data are：It is stored in the first equipment to be tested and for first equipment to be tested
The test data that affiliated test system to be measured is tested, the first building parameter is that the data structure based on the test system to be measured is true
Fixed, the first building parameter includes：First quantity of the data file to be generated in the first equipment to be tested, each data text
First data volume of the data to be written in part；Then, the first number of default file format is generated in the first equipment to be tested
Measure first data file, wherein default file format is determined by the data structure of test system to be measured；Finally, for every
One first data file generates the data of corresponding first data volume of first data file, and should by the write-in of the data of generation
First data file obtains the first test data tested for treating test macro.
As it can be seen that scheme provided in this embodiment, controls the test to be constructed in equipment to be tested by building parameter
The data volume of data, data structure and file format based on test system to be measured generate data file, needle in equipment to be tested
To each data file, the data of corresponding data amount are generated, and the data of generation are directly write in the data file, are not required to
The logic for triggering test system to be measured generates a large amount of test data, so as to reduce the data volume of test data, reduces structure
Build the time required for test data.
It is carried out below with the construction method that a specific embodiment is provided for the embodiments of the invention a kind of test data
Explanation.
In a distributed manner for storage system, in frame diagram as shown in FIG. 6, including master controller and data construction procedures,
Master controller is the control point of tester, can externally provide interface, distributing programs, monitoring execution；Data construction procedures
For generating data file in equipment to be tested according to building parameter and data being written.Specifically, the effect of master controller is：
1, order line or in a manner of interface for user or routine call, to obtain the target detection number in each equipment to be tested
According to building parameter；2, all data servers of the distribution data construction procedures into distributed memory system, and by user or
The building parameter of the input of program informs data construction procedures；3, the execution of monitoring data construction procedures, in data construction procedures
Building feeds back to user or program after completing test data.
Specifically, the method for data construction procedures building test data is referred to the description of embodiment illustrated in fig. 5.But
It is emphasized that on the one hand, data construction procedures only need only to write in each data block in the data server at place
Enter the data of a copy, i.e., should be written in the data directory of three data servers originally, but only needed in this programme
Data are written in a data server, function be restored after checking that copy state is improper by the copy of system, automatically
Revert to multiple copies.It can make data construction procedures in this way：1, without the concern for multiple copy id the case where generates data block
Catalogue when, copy id default use 00；2, it does not need to carry out across machine write-in, it is only necessary to machine where it be written.It is logical
Cross the above two o'clock, it is possible to reduce the complexity of data construction procedures.On the other hand, each magnetic is controlled by way of constructing parameter
Disk generates the quantity of block, does not delete object quantity in single block, deleted object quantity and each object
Size of data, the flexibility of data construction procedures can be increased, be lower value by the building parameter of input, it is possible to reduce whole
Total amount of data in a test cluster, and then reduce the data when testing copy and restoring function and restore the time used.
In practical application, master controller and data construction procedures can be used python language and write.In a kind of reality
In existing mode, master controller be can be set in location server or in a data server, the setting of data construction procedures
In each data server.This main control function and data constructing function are divided into the mode of two stand-alone programs, due to dividing
Hair, monitoring function do not need to be related to data construction procedures when changing, therefore this mode for making entire data building system decoupling,
Respectively involved range can be reduced, is facilitated and subsequent each function is extended, is modified.Certainly, in another implementation
In, can also have the function of master controller and data construction procedures simultaneously by a program A, in each data server
Program A is set, and the journey can also be arranged in itself each comfortable building test data of each data server in a certain server
Sequence A constructs test data in each data server by a certain server respectively, this is all reasonable.
Frame provided by this specific embodiment has the following advantages that：Test code is easy to extend, facilitates modification, very big
Reduce the cost of follow-up maintenance in degree, and have preferable ease for use, the tester without profession can also smoothly use this
Frame, therefore there is good replicability；The not ready-made test that can be applied to distributed memory system on the market at present
Data construction method, the scheme that the present embodiment proposes should be readily appreciated that, facilitate realization, significant effect；This programme is to system generation itself
Code layer face carries out the building of test data in bottom data level without any modification to system, is readily applied to other each
On the similar system of kind principle；The current visible data construction method generally existing time takes long time, and the data of generation are not
Enough accurate disadvantages, method of the present embodiment by writing direct system bottom data effectively compensate for this deficiency.
Corresponding with the construction method of above-mentioned test data, the embodiment of the invention also provides a kind of structures of test data
Build device.
Corresponding with embodiment of the method shown in fig. 5, Fig. 7 is a kind of building of test data provided in an embodiment of the present invention
The structural schematic diagram of device, the apparatus may include：
Module 701 is obtained, for obtaining the first building parameter of target detection data, wherein the target detection data
For：It is stored in the first equipment to be tested and for the test that test system to be measured is tested belonging to the described first equipment to be tested
Data, the first building parameter are the data structure determination based on the test system to be measured, the first building parameter packet
It includes：The number to be written in first quantity of the data file to be generated in the described first equipment to be tested, each data file
According to the first data volume；
Generation module 702, for generating the first quantity the of default file format in the described first equipment to be tested
One data file, wherein the default file format is determined by the data structure of the test system to be measured；
Writing module 703 generates first data file corresponding described first for being directed to every one first data file
The data of data volume, and first data file is written into the data of generation, it obtains for being surveyed to the test system to be measured
First test data of examination.
Specifically, the test system to be measured can be：Distributed memory system；
First equipment to be tested can be：Data server in the distributed memory system；
First data file can be：The file of storing data in the form of data block.
Specifically, the first data volume of the data to be written may include in each data file：Each data text
The quantity of not deleted object, the quantity of deleted object, the data volume of each object in the included data block of part；
The generation module 702, specifically can be used for：
For every one first data file, according to the number of not deleted object in the included data block of the first data file
Amount, the quantity of deleted object, the data volume of each object, generate the corresponding data of the first data file.
Specifically, described device can also include：
Coding module (not shown) generates the second number for carrying out correcting and eleting codes coding to first data file
According to file, the second test data for being tested the test system to be measured is obtained.
Specifically, the coding module, may include：
Judging submodule (not shown), for judge the parameter preset in first data file value whether be
Preset value；If so, triggering encoding submodule；
The encoding submodule (not shown) is generated for carrying out correcting and eleting codes coding to first data file
Second data file obtains the second test data for being tested the test system to be measured.
Specifically, described device can also include：
First receiving module (not shown) to be tested is set for receiving and storing second in the test system to be measured
The third data file of standby feedback, obtains the third test data for being tested the test system to be measured, wherein described
Third data file is：The data text generated in second equipment to be tested according to the second quantity in the second building parameter
Part and the data for being written with the second data volume, the second building parameter are：Data structure based on the test system to be measured
Determining, the second building parameter includes：Second quantity of the data file to be generated in the described second equipment to be tested,
Second data volume of the data to be written in each data file, third data file are the data file of default file format.
Specifically, described device can also include：
Second receiving module (not shown), for receiving and storing the 4th number of the described second equipment feedback to be tested
According to file, the 4th test data for being tested the test system to be measured is obtained, wherein the 4th data file is
Second equipment to be tested carries out the data file generated after correcting and eleting codes coding to the third data file.
Specifically, described device can also include：
Output module (not shown), for after the completion of constructing test data, test data to be completed in output building
Prompting message.
As seen from the above, a kind of test data construction device provided in this embodiment, firstly, obtaining target detection data
First building parameter, wherein target detection data are：It is stored in the first equipment to be tested and for first equipment to be tested
The test data that affiliated test system to be measured is tested, the first building parameter is that the data structure based on the test system to be measured is true
Fixed, the first building parameter includes：First quantity of the data file to be generated in the first equipment to be tested, each data text
First data volume of the data to be written in part；Then, the first number of default file format is generated in the first equipment to be tested
Measure first data file, wherein default file format is determined by the data structure of test system to be measured；Finally, for every
One first data file generates the data of corresponding first data volume of first data file, and should by the write-in of the data of generation
First data file obtains the first test data tested for treating test macro.
Therefore, scheme provided in this embodiment controls the test to be constructed in equipment to be tested by building parameter
The data volume of data, data structure and file format based on test system to be measured generate data file, needle in equipment to be tested
To each data file, the data of corresponding data amount are generated, and the data of generation are directly write in the data file, are not required to
The logic for triggering test system to be measured generates a large amount of test data, so as to reduce the data volume of test data, reduces structure
Build the time required for test data.
It should be noted that, in this document, relational terms such as first and second and the like are used merely to a reality
Body or operation are distinguished with another entity or operation, are deposited without necessarily requiring or implying between these entities or operation
In any actual relationship or order or sequence.Moreover, the terms "include", "comprise" or its any other variant are intended to
Non-exclusive inclusion, so that the process, method, article or equipment including a series of elements is not only wanted including those
Element, but also including other elements that are not explicitly listed, or further include for this process, method, article or equipment
Intrinsic element.In the absence of more restrictions, the element limited by sentence "including a ...", it is not excluded that
There is also other identical elements in process, method, article or equipment including the element.
Each embodiment in this specification is all made of relevant mode and describes, same and similar portion between each embodiment
Dividing may refer to each other, and each embodiment focuses on the differences from other embodiments.Especially for device reality
For applying example, since it is substantially similar to the method embodiment, so being described relatively simple, related place is referring to embodiment of the method
Part explanation.
The foregoing is merely illustrative of the preferred embodiments of the present invention, is not intended to limit the scope of the present invention.It is all
Any modification, equivalent replacement, improvement and so within the spirit and principles in the present invention, are all contained in protection scope of the present invention
It is interior.
Claims (16)
1. a kind of construction method of test data, which is characterized in that the method includes：
Obtain the first building parameter of target detection data, wherein the target detection data are：First is stored in be tested to set
For and for the test data that test system to be measured is tested belonging to the described first equipment to be tested, the first building parameter
It is the data structure determination based on the test system to be measured, the first building parameter includes：It is to be tested described first
First data volume of the data to be written in first quantity of the data file generated in equipment, each data file；
The first data file of the first quantity of default file format is generated in the described first equipment to be tested, wherein described
Default file format is determined by the data structure of the test system to be measured；
For every one first data file, the data of corresponding first data volume of first data file are generated, and will be given birth to
At data first data file is written, obtain the first test data for being tested the test system to be measured.
2. the method according to claim 1, wherein
The test system to be measured is：Distributed memory system；
First equipment to be tested is：Data server in the distributed memory system；
First data file is：The file of storing data in the form of data block.
3. according to the method described in claim 2, it is characterized in that,
The first data volume of the data to be written includes in each data file：In each included data block of data file
The quantity of not deleted object, the quantity of deleted object, the data volume of each object；
It is described to be directed to every one first data file, generate the step of the data of corresponding first data volume of first data file
Suddenly, including：
For every one first data file, according to the quantity of not deleted object in the included data block of the first data file,
The data volume of the quantity of deleted object, each object generates the corresponding data of the first data file.
4. according to the method described in claim 2, it is characterized in that, the method also includes：
Correcting and eleting codes coding is carried out to first data file, the second data file is generated, obtains for the system to be tested
The second test data that system is tested.
5. according to the method described in claim 4, it is characterized in that, described carry out correcting and eleting codes volume to first data file
The step of code, the second data file of generation, including：
Whether the value for judging the parameter preset in first data file is preset value；
If so, carrying out correcting and eleting codes coding to first data file, the second data file is generated.
6. according to the method described in claim 2, it is characterized in that, the method also includes：
The third data file for receiving and storing the second equipment feedback to be tested in the test system to be measured, obtains for institute
State the third test data that test system to be measured is tested, wherein the third data file is：Second equipment to be tested
The middle data file that the second quantity generation in parameter is constructed according to second and the data for being written with the second data volume, it is described
Second, which constructs parameter, is：It is determined based on the data structure of the test system to be measured, the second building parameter includes：Will institute
State the second quantity of the data file generated in the second equipment to be tested, in each data file the data to be written the second number
According to amount, third data file is the data file of default file format.
7. according to the method described in claim 6, it is characterized in that, the method also includes：
The 4th data file for receiving and storing the described second equipment to be tested feedback, obtain for the test system to be measured into
4th test data of row test, wherein the 4th data file is the described second equipment to be tested to the third data
File carries out the data file generated after correcting and eleting codes coding.
8. method according to claim 1-7, which is characterized in that the method also includes：
After the completion of constructing test data, the prompting message of test data is completed in output building.
9. a kind of construction device of test data, which is characterized in that described device includes：
Module is obtained, for obtaining the first building parameter of target detection data, wherein the target detection data are：Storage
In the first equipment to be tested and for the test data that test system to be measured is tested belonging to the described first equipment to be tested, institute
Stating the first building parameter is the data structure determination based on the test system to be measured, and the first building parameter includes：It will be
The first of the data to be written in first quantity of the data file generated in first equipment to be tested, each data file
Data volume；
Generation module, for generating the first quantity the first data text of default file format in the described first equipment to be tested
Part, wherein the default file format is determined by the data structure of the test system to be measured；
Writing module generates corresponding first data volume of first data file for being directed to every one first data file
Data, and first data file is written into the data of generation, obtains for being tested the test system to be measured
One test data.
10. device according to claim 9, which is characterized in that
The test system to be measured is：Distributed memory system；
First equipment to be tested is：Data server in the distributed memory system；
First data file is：The file of storing data in the form of data block.
11. device according to claim 10, which is characterized in that
The first data volume of the data to be written includes in each data file：In each included data block of data file
The quantity of not deleted object, the quantity of deleted object, the data volume of each object；
The generation module, is specifically used for：
For every one first data file, according to the quantity of not deleted object in the included data block of the first data file,
The data volume of the quantity of deleted object, each object generates the corresponding data of the first data file.
12. device according to claim 10, which is characterized in that described device further includes：
Coding module, for first data file carry out correcting and eleting codes coding, generate the second data file, obtain for pair
The second test data that the test system to be measured is tested.
13. device according to claim 12, which is characterized in that the coding module, including：
Judging submodule, for judging whether the value of the parameter preset in first data file is preset value；If so, touching
Send out encoding submodule；
The encoding submodule generates the second data file, obtains for carrying out correcting and eleting codes coding to first data file
The second test data for being tested the test system to be measured.
14. device according to claim 10, which is characterized in that described device further includes：
First receiving module, for receiving and storing the third data of the second equipment feedback to be tested in the test system to be measured
File obtains the third test data for being tested the test system to be measured, wherein the third data file is：
In second equipment to be tested according to second building parameter in the second quantity generate data file and be written with second
The data of data volume, the second building parameter are：It is determined based on the data structure of the test system to be measured, second structure
Building parameter includes：It is wanted in second quantity of the data file to be generated in the described second equipment to be tested, each data file
Second data volume of the data of write-in, third data file are the data file of default file format.
15. device according to claim 14, which is characterized in that described device further includes：
Second receiving module is used for for receiving and storing the 4th data file of the described second equipment feedback to be tested
The 4th test data that the test system to be measured is tested, wherein the 4th data file is described second to be tested
Equipment carries out the data file generated after correcting and eleting codes coding to the third data file.
16. according to the described in any item devices of claim 9-15, which is characterized in that described device further includes：
Output module, for after the completion of constructing test data, the prompting message of test data to be completed in output building.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710334808.7A CN108874611A (en) | 2017-05-12 | 2017-05-12 | A kind of construction method and device of test data |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710334808.7A CN108874611A (en) | 2017-05-12 | 2017-05-12 | A kind of construction method and device of test data |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN108874611A true CN108874611A (en) | 2018-11-23 |
Family
ID=64320148
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201710334808.7A Pending CN108874611A (en) | 2017-05-12 | 2017-05-12 | A kind of construction method and device of test data |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN108874611A (en) |
Cited By (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110083482A (en) * | 2019-04-30 | 2019-08-02 | 北京金山云网络技术有限公司 | The method, apparatus and electronic equipment of correcting and eleting codes processing are carried out to document storage system |
| CN110674029A (en) * | 2019-08-26 | 2020-01-10 | 平安科技（深圳）有限公司 | Method and device for automatically generating test data, electronic equipment and storage medium |
| CN111078647A (en) * | 2019-11-22 | 2020-04-28 | 北京安兔兔科技有限公司 | Method and device for creating uncompressed file, method and device for testing magnetic disk and electronic equipment |
| CN111352846A (en) * | 2020-03-06 | 2020-06-30 | 深圳前海微众银行股份有限公司 | Test system number making method, device, equipment and storage medium |
| CN112073709A (en) * | 2020-07-27 | 2020-12-11 | 武汉旷视金智科技有限公司 | Test data generation method and device and electronic equipment |
Citations (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102567203A (en) * | 2011-12-28 | 2012-07-11 | 创新科软件技术（深圳）有限公司 | Method and system for testing performance of distributed file system (DFS) |
| CN103034564A (en) * | 2012-12-05 | 2013-04-10 | 华为技术有限公司 | Data disaster tolerance demonstration and practicing method and data disaster tolerance demonstration and practicing device and system |
| CN103455420A (en) * | 2013-08-16 | 2013-12-18 | 华为技术有限公司 | Test data construction method and equipment |
| CN103617004A (en) * | 2013-11-20 | 2014-03-05 | 浪潮电子信息产业股份有限公司 | Tool and method for performing read-write tests on distributed file system |
| CN103793318A (en) * | 2012-10-29 | 2014-05-14 | 百度在线网络技术（北京）有限公司 | Method and device for distributed testing of module stability |
| CN104731587A (en) * | 2015-03-12 | 2015-06-24 | 用友网络科技股份有限公司 | Unit testing data generating method and unit testing data generating system |
| CN105245314A (en) * | 2015-10-20 | 2016-01-13 | 北京国电通网络技术有限公司 | Hybrid redundancy fault tolerant encoding and decoding method and system in distributed storage system |
| CN106227731A (en) * | 2016-07-06 | 2016-12-14 | 联想(北京)有限公司 | A kind of data processing method, device and distributed file system |
| EP3125120A1 (en) * | 2015-07-28 | 2017-02-01 | Zerto Ltd. | System and method for consistency verification of replicated data in a recovery system |
-
2017
- 2017-05-12 CN CN201710334808.7A patent/CN108874611A/en active Pending
Patent Citations (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102567203A (en) * | 2011-12-28 | 2012-07-11 | 创新科软件技术（深圳）有限公司 | Method and system for testing performance of distributed file system (DFS) |
| CN103793318A (en) * | 2012-10-29 | 2014-05-14 | 百度在线网络技术（北京）有限公司 | Method and device for distributed testing of module stability |
| CN103034564A (en) * | 2012-12-05 | 2013-04-10 | 华为技术有限公司 | Data disaster tolerance demonstration and practicing method and data disaster tolerance demonstration and practicing device and system |
| CN103455420A (en) * | 2013-08-16 | 2013-12-18 | 华为技术有限公司 | Test data construction method and equipment |
| CN103617004A (en) * | 2013-11-20 | 2014-03-05 | 浪潮电子信息产业股份有限公司 | Tool and method for performing read-write tests on distributed file system |
| CN104731587A (en) * | 2015-03-12 | 2015-06-24 | 用友网络科技股份有限公司 | Unit testing data generating method and unit testing data generating system |
| EP3125120A1 (en) * | 2015-07-28 | 2017-02-01 | Zerto Ltd. | System and method for consistency verification of replicated data in a recovery system |
| CN105245314A (en) * | 2015-10-20 | 2016-01-13 | 北京国电通网络技术有限公司 | Hybrid redundancy fault tolerant encoding and decoding method and system in distributed storage system |
| CN106227731A (en) * | 2016-07-06 | 2016-12-14 | 联想(北京)有限公司 | A kind of data processing method, device and distributed file system |
Non-Patent Citations (1)
| Title |
|---|
| 王维雄: "基于介质存储结构的数据恢复技术研究", 《中国优秀硕士学位论文全文数据库 信息科技辑》 * |
Cited By (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110083482A (en) * | 2019-04-30 | 2019-08-02 | 北京金山云网络技术有限公司 | The method, apparatus and electronic equipment of correcting and eleting codes processing are carried out to document storage system |
| CN110083482B (en) * | 2019-04-30 | 2023-06-02 | 北京金山云网络技术有限公司 | Method and device for performing erasure code processing on file storage system and electronic equipment |
| CN110674029A (en) * | 2019-08-26 | 2020-01-10 | 平安科技（深圳）有限公司 | Method and device for automatically generating test data, electronic equipment and storage medium |
| CN111078647A (en) * | 2019-11-22 | 2020-04-28 | 北京安兔兔科技有限公司 | Method and device for creating uncompressed file, method and device for testing magnetic disk and electronic equipment |
| CN111078647B (en) * | 2019-11-22 | 2023-09-22 | 北京安兔兔科技有限公司 | Method and device for creating uncompressed file and testing magnetic disk and electronic equipment |
| CN111352846A (en) * | 2020-03-06 | 2020-06-30 | 深圳前海微众银行股份有限公司 | Test system number making method, device, equipment and storage medium |
| CN111352846B (en) * | 2020-03-06 | 2024-03-19 | 深圳前海微众银行股份有限公司 | Method, device, equipment and storage medium for manufacturing number of test system |
| CN112073709A (en) * | 2020-07-27 | 2020-12-11 | 武汉旷视金智科技有限公司 | Test data generation method and device and electronic equipment |
| CN112073709B (en) * | 2020-07-27 | 2023-04-14 | 武汉旷视金智科技有限公司 | Test data generation method and device and electronic equipment |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN108874611A (en) | A kind of construction method and device of test data | |
| US11677687B2 (en) | Switching between fault response models in a storage system | |
| CN102834811B (en) | Multi-cascade backup procedure | |
| US8924354B2 (en) | Block level data replication | |
| US10503616B2 (en) | Periodic data replication | |
| US6983295B1 (en) | System and method for database recovery using a mirrored snapshot of an online database | |
| US7840595B1 (en) | Techniques for determining an implemented data protection policy | |
| US6393516B2 (en) | System and method for storage media group parity protection | |
| US20160026403A1 (en) | Merging an out of synchronization indicator and a change recording indicator in response to a failure in consistency group formation | |
| CN109542342A (en) | Metadata management and data reconstruction method, equipment and storage medium | |
| WO2007103141A2 (en) | Method and apparatus for providing virtual machine backup | |
| US10976942B2 (en) | Versioning a configuration of data storage equipment | |
| KR101693683B1 (en) | Virtual database rewind | |
| CN102024021A (en) | Method for logging metadata in logical file system | |
| CN109558453A (en) | A kind of storage of block chain data networkization and move the method deposited | |
| CN105095352B (en) | Data processing method and device applied to distributed system | |
| CN106227617A (en) | Self-repair method and storage system based on correcting and eleting codes algorithm | |
| CN115454717A (en) | Database real-time backup method and device, computer equipment and storage medium | |
| US20150363274A1 (en) | Storing backup data separate from catalog data | |
| CN108959604A (en) | Safeguard the method, apparatus and computer readable storage medium of data-base cluster | |
| CN113296697B (en) | Data processing system, data processing method and device | |
| AU2021100156A4 (en) | Artificial Intelligent System for Predicting the Hard Disk Failure | |
| Addis et al. | Tools for modelling and simulating migration-based preservation | |
| CN110008114A (en) | Configuration information maintaining method, device, equipment and readable storage medium storing program for executing | |
| CN114442941A (en) | Data migration method, system, storage medium and equipment |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20181123 |