CN105302717A - Detection method and apparatus for big data platform - Google Patents
Detection method and apparatus for big data platform Download PDFInfo
- Publication number
- CN105302717A CN105302717A CN201510638546.4A CN201510638546A CN105302717A CN 105302717 A CN105302717 A CN 105302717A CN 201510638546 A CN201510638546 A CN 201510638546A CN 105302717 A CN105302717 A CN 105302717A
- Authority
- CN
- China
- Prior art keywords
- test case
- test
- container
- perform
- data platform
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Landscapes
- Debugging And Monitoring (AREA)
Abstract
The present invention provides a detection method and apparatus for a big data platform. The method comprises: presetting a function test execution container for verifying whether each function of a to-be-tested big data platform is normal, and presetting a performance test execution container for verifying operation performance of components of the to-be-tested big data platform; calling a test case for testing the to-be-tested big data platform; acquiring a task type in the test case; if the task type is a function verification type, calling the function test execution container to execute the test case, and detecting a to-be-tested function of the to-be-tested big data platform according to the test case; and if the task type is a performance verification type, calling the performance test execution container to execute the test case, and detecting the performance of a to-be-tested component of the to-be-tested big data platform according to the test case. The detection method and apparatus for the big data platform can be used for detecting the big data platform.
Description
Technical field
The present invention relates to field of computer technology, particularly a kind of detection method of large data platform and device.
Background technology
In recent years, along with fast development and the popularization and application of computing machine and infotech, the scale of sector application system expanded rapidly, and the data that sector application produces are explosive increase.Easily the even tens of large data of industry/enterprise to hundreds of PB scale of hundreds of TB are reached far beyond the processing power of existing traditional computing technique and infosystem, therefore, seek effective large data processing technique, active demand that ways and means has become a reality the world.Because large data industry application demand is growing, needs are used large data parallel technology by following increasing investigation and application field, and large data technique will penetrate into each application relating to large-scale data and complicated calculations.Moreover, computing technique centered by large data processing will produce revolutionary impact to traditional calculations technology, extensively affect Computer Architecture, operating system, database, technique of compiling, programmatics and method, software engineering technology, multimedia information, artificial intelligence and other Computer Applied Technologies, and be combined with each other with traditional calculations technology and produce much new study hotspot and problem.
Along with the widespread use of large data technique, the technical field of building large data platform, using the calculating of large data to be also no longer high-end mystery, much traditional software developer also starts the concept contacting large data.Along with the application of large data technique is more and more extensive, also more and more higher to the performance requirement of large data platform.Also not for the method for the Performance Detection of large data platform in prior art.
Summary of the invention
In view of this, the invention provides a kind of detection method and device of large data platform, can detect large data platform.
On the one hand, the invention provides a kind of detection method of large data platform, comprise: the whether normal functional test of often kind of function pre-set for verifying large data platform to be measured performs container, the performance test pre-setting the runnability of the assembly for verifying large data platform to be measured performs container, also comprises:
S1: call the test case for testing described large data platform to be measured;
S2: obtain the task type in described test case;
S3: if described task type is functional verification class, then call described functional test and perform container and perform described test case, treat that brake detects according to described test case to large data platform to be measured; If described task type is performance verification class, then calls described performance test execution container and perform described test case, detect according to the performance of described test case to the testing component of large data platform to be measured.
Further, in described S3, described in call described functional test and perform container and perform described test case, according to described test case large data platform to be measured treated that brake detects, comprising:
By described functional test perform container obtains from described test case to treat described in operation parameter required for brake, data processing number of times, described in treat that brake runs successful standard, the first pending data;
By described functional test perform parameter that container treats required for brake according to described operation run described in treat brake;
Treat described in described pending data being passed through by described feature capability test execution container that brake carries out time process for several times of described data processing;
By described functional test perform container according to described in treat that brake runs successful standard, treat described in judgement that whether brake normal.
Further, in described S3, described in call described performance test perform container perform described test case, detect according to the performance of described test case to the testing component of large data platform to be measured, comprising:
Perform container by described performance test from described test case, obtain pressure environment parameter, the second pending data;
Perform container by described performance test and on described large data platform to be measured, build corresponding pressure environment according to described pressure environment parameter;
Call described testing component by described performance test execution container under described pressure environment, process described second pending data, record the performance parameter of described testing component.
Further, described S1, comprising: call described test case by restful application programming interface api.
Further, described S1, comprising: call described test case by performing shell-command.
Further, the method also comprises: pre-set multiple test case template;
Before described S1, also comprise:
Determine the outside test case template selected;
Receive the to be filled parameter corresponding by the described test case template selected of outside input;
To fill according to described parameter to be filled and described by the described test case template selected, generate described test case.
On the other hand, the pick-up unit of a kind of large data platform provided by the invention, comprising:
First setting unit, perform container for the whether normal functional test of function arranged for verifying large data platform to be measured, the performance test arranging the runnability of the assembly for verifying large data platform to be measured performs container;
Call unit, for calling the test case for testing described large data platform to be measured;
Acquiring unit, for obtaining the task type in described test case;
Detecting unit, for when described task type is functional verification class, then calls described functional test and performs container and perform described test case, treat that brake detects according to described test case to large data platform to be measured; When described task type is performance verification class, then calls described performance test execution container and perform described test case, detect according to the performance of described test case to the testing component of large data platform to be measured.
Further, described detecting unit, execution described in call described functional test perform container perform described test case, according to described test case to large data platform to be measured when brake detects, specifically perform:
Perform container by described functional test from described test case, obtains the parameter treated described in operation required for brake, data processing number of times, describedly treat that brake runs successful standard, first pending data, by described functional test perform parameter that container treats required for brake according to described operation run described in treat brake, treat described in described pending data being passed through by described feature capability test execution container that brake carries out time process for several times of described data processing, by described functional test perform container according to described in treat that brake runs successful standard, treat described in judgement that whether brake is normal.
Further, described detecting unit, calls described performance test execution container and performs described test case, when detecting according to the performance of described test case to the testing component of large data platform to be measured, specifically perform described in execution:
Perform container by described performance test from described test case, obtain pressure environment parameter, the second pending data, perform container by described performance test and on described large data platform to be measured, build corresponding pressure environment according to described pressure environment parameter, call described testing component by described performance test execution container under described pressure environment, process described second pending data, record the performance parameter of described testing component.
Further, described call unit, for calling described test case by restful application programming interface api.
Further, described call unit, for calling described test case by performing shell-command.
Further, this device also comprises:
Second setting unit, for arranging multiple test case template;
Also comprise: Test cases technology unit, for determining the outside test case template selected, receive the to be filled parameter corresponding by the described test case template selected of outside input, to fill according to described parameter to be filled and described by the described test case template selected, generate described test case.
The invention provides a kind of detection method and device of large data platform, the detection of large data platform is mainly divided into the performance test of functional test and assembly, corresponding functional test can be set for these two kinds different tests and perform container and performance test performs container, calling corresponding execution container according to the task type in test case, then by performing container implementation of test cases, large data platform to be measured being tested.
Accompanying drawing explanation
In order to be illustrated more clearly in the embodiment of the present invention or technical scheme of the prior art, be briefly described to the accompanying drawing used required in embodiment or description of the prior art below, apparently, accompanying drawing in the following describes is some embodiments of the present invention, for those of ordinary skill in the art, under the prerequisite not paying creative work, other accompanying drawing can also be obtained according to these accompanying drawings.
Fig. 1 is the process flow diagram of the detection method of a kind of large data platform that one embodiment of the invention provides;
Fig. 2 is the process flow diagram of the detection method of the large data platform of another kind that one embodiment of the invention provides;
Fig. 3 is the schematic diagram of the pick-up unit of a kind of large data platform that one embodiment of the invention provides;
Fig. 4 is the schematic diagram of the pick-up unit of the large data platform of another kind that one embodiment of the invention provides.
Embodiment
For making the object of the embodiment of the present invention, technical scheme and advantage clearly; below in conjunction with the accompanying drawing in the embodiment of the present invention; technical scheme in the embodiment of the present invention is clearly and completely described; obviously; described embodiment is the present invention's part embodiment, instead of whole embodiments, based on the embodiment in the present invention; the every other embodiment that those of ordinary skill in the art obtain under the prerequisite not making creative work, all belongs to the scope of protection of the invention.
As shown in Figure 1, embodiments provide a kind of detection method of large data platform, the method can comprise the following steps:
S0: the whether normal functional test of function pre-set for verifying large data platform to be measured performs container, and the performance test pre-setting the runnability of the assembly for verifying large data platform to be measured performs container;
S1: call the test case for testing described large data platform to be measured;
S2: obtain the task type in described test case;
S3: if described task type is functional verification class, then call described functional test and perform container and perform described test case, treat that brake detects according to described test case to large data platform to be measured; If described task type is performance verification class, then calls described performance test execution container and perform described test case, detect according to the performance of described test case to the testing component of large data platform to be measured.
The detection method of a kind of large data platform that the embodiment of the present invention provides, the detection of large data platform is mainly divided into the performance test of functional test and assembly, corresponding functional test can be set for these two kinds different tests and perform container and performance test performs container, calling corresponding execution container according to the task type in test case, then by performing container implementation of test cases, large data platform to be measured being tested.
In a kind of possible implementation, in described S3, described in call described functional test and perform container and perform described test case, according to described test case large data platform to be measured treated that brake detects, comprising:
By described functional test perform container obtains from described test case to treat described in operation parameter required for brake, data processing number of times, described in treat that brake runs successful standard, the first pending data;
By described functional test perform parameter that container treats required for brake according to described operation run described in treat brake;
Treat described in described pending data being passed through by described feature capability test execution container that brake carries out time process for several times of described data processing;
By described functional test perform container according to described in treat that brake runs successful standard, treat described in judgement that whether brake normal.
Although Ge Jia manufacturer more or less can carry out some transformations for the various assemblies of the hadoop ecosystem, but be also all the hadoop platform release based on increasing income, the rare change for basic function, even have, be also the optimization of internal logic, external call mode changes very little, therefore, according to the function of the hadoop that increases income and method of calling, the test case of general test function can be constructed, for verifying the function of large data platform.In addition, can by draw in test whether pass through, the parameter such as response time, together with the data such as daily record, start-up parameter, use template that this is tested, be recorded to together in the database pre-set.The test case of this kind of test function can provide with system; For specific function, customize by the mode transforming test case.
For the various functions of test large data platform to be measured, particularly, test case can be following form: HDTesttaskstartFuncsamples/tasks/scenarios/hdfs/BaseHDFS Test.json.Perform container by functional test and read in test case.
For example, need the files passe function of the hdfs to large data platform (Hadoop distributed file system, HadoopDistributedFileSystem) to test, corresponding test case can pass through following codes implement:
By this test case, this use test user is disposable uploads 10 files, and each file size is 1024m, and the overall deadline is no more than 10000ms and then can be regarded as Mission Success.In this test case, data processing number of times is 1 time, treat that brake runs successful standard for the overall deadline and is no more than 10000ms, 10 files of the first pending data to be each file size be 1024m, treat that the parameter required for brake comprises: the account of test user, password.
In the functional test of the hdfs for large data platform, can test multiple functions of hdfs in the test case of hdfs, such as: upload, delete, copy, move, change the multiclass functions such as owning user.Perform the function items that container defines in implementation of test cases successively, skip the function items of failure, and finally read each step and perform information, generate reports on the implementation.
In a kind of possible implementation, in described S3, described in call described performance test perform container perform described test case, detect according to the performance of described test case to the testing component of large data platform to be measured, comprising:
Perform container by described performance test from described test case, obtain pressure environment parameter, the second pending data;
Perform container by described performance test and on described large data platform to be measured, build corresponding pressure environment according to described pressure environment parameter;
Call described testing component by described performance test execution container under described pressure environment, process described second pending data, record the performance parameter of described testing component.
For large data platform, the performance parameter of various assembly is also the project that user mainly tests.Such as Hbase wall scroll inquiry number of concurrent, mapreduceterasort response time, hdfsio speed etc.And these performance datas all need just can be drawn by actual motion, need for large data platform to be measured builds pressure environment, under the pressure environment of correspondence, realize the detection of performance, pressure environment parameter comprises: Thread Count, number of concurrent, number of users, period; By realizing multithreading, how concurrent, multi-user, these conditions of multi cycle realize corresponding pressure environment.
For example, when testing, container is performed by performance test, circulation or the pending data of concurrent invocation second, to make testing component to the second pending datacycle or the pending data of concurrent processing second, and carry out the record of performance parameter, reached the object of adding up large data platform performance, performance parameter comprises: the inquiry of Hbase wall scroll number of concurrent, mapreduceterasort response time, hdfsio speed etc.
The test case of performance test can be following form: HDTesttaskstartPerfsamples/tasks/scenarios/hbase/BaseHba seTest.json.
For example, test the performance that hbase inquires about by rowKey wall scroll, corresponding test case can pass through following codes implement:
Use two user concurrents to carry out rowkey inquiry to hbase in this test case, each user plays 100 concurrent thread and inquires about, and each thread loops carries out 20 query manipulations.Pressure environment parameter comprises: concurrent thread number is each user 100, number of users is 2, loop test is each thread loops 20 times.In addition, in this test case, user account, password is also comprised.
In a kind of possible implementation, described S1, comprising: call described test case by restfulapi (ApplicationProgrammingInterface, application programming interface).Long-range test case can be called by which.
In a kind of possible implementation, described S1, comprising: call described test case by performing shell-command.Local test case can be called by which.
In a kind of possible implementation, the method also comprises: pre-set multiple test case template;
Determine the outside test case template selected;
Receive the to be filled parameter corresponding by the described test case template selected of outside input;
To fill according to described parameter to be filled and described by the described test case template selected, generate described test case.
In this implementation, in a test case template, multiple functional test of the same type can be realized, such as a hdfs template, can for the uploading of file operation, delete, copy, move, change the multiclass functions such as owning user and test.In addition, performance test is may be used in a test case template, such as Hbase template, parameter to be filled in this Hbase template comprises: pressure environment parameter, the second pending data etc., pressure environment parameter comprises: Thread Count, number of concurrent, number of users, period etc., can also comprise treat parameter required for brake, data processing number of times, described in treat that brake runs successful standard, the first pending data etc.; Also can comprise task type, in addition, task type also can be set in advance in test case template, and user selects as required.The test case of Hbase being carried out to performance test can be generated according to these parameters to be filled.
In addition, before testing, obtain the interface api address of each module of large data platform to be measured, account number cipher, operating right, these information is preserved in a database, calls as required with during pending test; Specifically can be realized by following form:
HDTestdeploymentcreate--hdfsurl＝hdfs://10.53.132.52:9000--username＝root--password＝123456
In whole test process, can produce a large amount of data, can be recorded in database by these data, conveniently operating personnel read, and these data can be become test report by unified form collator; There are many Open-Source Tools supports to generate html file or pdf file etc. by form at present, can select as the case may be herein, check being as the criterion to facilitate user.Can comprise in test report: the performance parameter etc. in the result of functional test, the result of performance test, performance test.
In addition, when generating test use case, can be generated by Componentized mode.Write every individual operations in advance, then can adjust every individual operations tissue order, multiplicity, operation branch etc., thus form test case.
Further, test case can be stored in advance in test case template storehouse, and user can call corresponding test case as required in test case template storehouse, more convenient.
For making the object, technical solutions and advantages of the present invention clearly, below in conjunction with drawings and the specific embodiments, the present invention is described in further detail.
As shown in Figure 2, embodiments provide a kind of detection method of large data platform, the method can comprise the following steps:
Step 201: the whether normal functional test of often kind of function pre-set for verifying large data platform to be measured performs container, the performance test pre-setting the runnability of the assembly for verifying large data platform to be measured performs container, pre-sets multiple test case template.
Step 202: determine the outside test case template selected, receives the to be filled parameter corresponding by the described test case template selected of outside input, fills and described by the described test case template selected according to described parameter to be filled, generating test use case.
Step 203: call the test case for testing described large data platform to be measured.
Particularly, described test case can be called by restful application programming interface api; Also described test case can be called by performing shell-command.
Step 204: obtain the task type in described test case.
Step 205: judge task type whether functional verification class, if so, then performs step 206, otherwise, perform step 207.
In this embodiment, task type only has two classes: functional verification class and performance verification class.
Step 206: call described functional test execution container and perform described test case, perform container by described functional test from described test case, obtains the parameter treated described in operation required for brake, data processing number of times, describedly treat that brake runs successful standard, first pending data, treat to treat brake described in the parameter operation required for brake according to described operation, treat described in described pending data being passed through that brake carries out time process for several times of described data processing, treat that brake runs successful standard according to described, treat described in judgement that whether brake is normal.
Step 207: call described performance test execution container and perform described test case, perform container by described performance test from described test case, obtain pressure environment parameter, the second pending data, on described large data platform to be measured, corresponding pressure environment is built according to described pressure environment parameter, call described testing component under described pressure environment, process described second pending data, record the performance parameter of described testing component.
As shown in Figure 3, Figure 4, a kind of pick-up unit of large data platform is embodiments provided.Device embodiment can pass through software simulating, also can be realized by the mode of hardware or software and hardware combining.Say from hardware view; as shown in Figure 3; a kind of hardware structure diagram of the pick-up unit place equipment of a kind of large data platform provided for the embodiment of the present invention; except the processor shown in Fig. 3, internal memory, network interface and nonvolatile memory; in embodiment, the equipment at device place can also comprise other hardware usually, as the forwarding chip etc. of responsible process message.For software simulating, as shown in Figure 4, as the device on a logical meaning, be by the CPU of its place equipment, computer program instructions corresponding in nonvolatile memory is read operation in internal memory to be formed.The pick-up unit of a kind of large data platform that the present embodiment provides, comprising:
First setting unit 401, perform container for the whether normal functional test of function arranged for verifying large data platform to be measured, the performance test arranging the runnability of the assembly for verifying large data platform to be measured performs container;
Call unit 402, for calling the test case for testing described large data platform to be measured;
Acquiring unit 403, for obtaining the task type in described test case;
Detecting unit 404, for when described task type is functional verification class, then calls described functional test and performs container and perform described test case, treat that brake detects according to described test case to large data platform to be measured; When described task type is performance verification class, then calls described performance test execution container and perform described test case, detect according to the performance of described test case to the testing component of large data platform to be measured.
In a kind of possible implementation, described detecting unit 404, execution described in call described functional test perform container perform described test case, according to described test case to large data platform to be measured when brake detects, specifically perform:
Perform container by described functional test from described test case, obtains the parameter treated described in operation required for brake, data processing number of times, describedly treat that brake runs successful standard, first pending data, by described functional test perform parameter that container treats required for brake according to described operation run described in treat brake, treat described in described pending data being passed through by described feature capability test execution container that brake carries out time process for several times of described data processing, by described functional test perform container according to described in treat that brake runs successful standard, treat described in judgement that whether brake is normal.
In a kind of possible implementation, described detecting unit 404, calls described performance test execution container and performs described test case, when detecting according to the performance of described test case to the testing component of large data platform to be measured, specifically perform described in execution:
Perform container by described performance test from described test case, obtain pressure environment parameter, the second pending data, perform container by described performance test and on described large data platform to be measured, build corresponding pressure environment according to described pressure environment parameter, call described testing component by described performance test execution container under described pressure environment, process described second pending data, record the performance parameter of described testing component.
In a kind of possible implementation, described call unit 402, for calling described test case by restful application programming interface api.
In a kind of possible implementation, described call unit 402, for calling described test case by performing shell-command.
In a kind of possible implementation, this device also comprises: the second setting unit, for arranging multiple test case template.
This device also comprises: Test cases technology unit, for determining the outside test case template selected, receive the to be filled parameter corresponding by the described test case template selected of outside input, to fill according to described parameter to be filled and described by the described test case template selected, generate described test case.
This device can be disposed together with large data platform to be measured, shares physical machine, but in order to generate load during owing to carrying out performance test, larger performance pressures is had to host, in order to test result is accurate, this device and large data platform to be measured can be separated, dispose separately.
The content such as information interaction, implementation between each unit in said apparatus, due to the inventive method embodiment based on same design, particular content can see in the inventive method embodiment describe, repeat no more herein.
The detection method of a kind of large data platform that the embodiment of the present invention provides and device, have following beneficial effect:
1, the detection method of a kind of large data platform that provides of the embodiment of the present invention and device, the detection of large data platform is mainly divided into the performance test of functional test and assembly, corresponding functional test can be set for these two kinds different tests and perform container and performance test performs container, calling corresponding execution container according to the task type in test case, then by performing container implementation of test cases, large data platform to be measured being tested.
2, the detection method of a kind of large data platform that provides of the embodiment of the present invention and device, the automatic generating test use case of test case template can be given, automatically the function of large data platform to be measured, performance are detected according to test case, greatly improve testing efficiency and credibility, also allow daily robotization patrol and examine become simple, there is very high practical value simultaneously.
It should be noted that, in this article, the relational terms of such as first and second and so on is only used for an entity or operation to separate with another entity or operational zone, and not necessarily requires or imply the relation that there is any this reality between these entities or operation or sequentially.And, term " comprises ", " comprising " or its any other variant are intended to contain comprising of nonexcludability, thus make to comprise the process of a series of key element, method, article or equipment and not only comprise those key elements, but also comprise other key elements clearly do not listed, or also comprise by the intrinsic key element of this process, method, article or equipment.When not more restrictions, the key element " being comprised a 〃 〃 〃 〃 〃 〃 " limited by statement, and be not precluded within process, method, article or the equipment comprising described key element and also there is other same factor.
One of ordinary skill in the art will appreciate that: all or part of step realizing said method embodiment can have been come by the hardware that programmed instruction is relevant, aforesaid program can be stored in the storage medium of embodied on computer readable, this program, when performing, performs the step comprising said method embodiment; And aforesaid storage medium comprises: ROM, RAM, magnetic disc or CD etc. various can be program code stored medium in.
Finally it should be noted that: the foregoing is only preferred embodiment of the present invention, only for illustration of technical scheme of the present invention, be not intended to limit protection scope of the present invention.All any amendments done within the spirit and principles in the present invention, equivalent replacement, improvement etc., be all included in protection scope of the present invention.
Claims (10)
1. the detection method of a large data platform, it is characterized in that, comprise: the whether normal functional test of often kind of function pre-set for verifying large data platform to be measured performs container, the performance test pre-setting the runnability of the assembly for verifying large data platform to be measured performs container, also comprises:
S1: call the test case for testing described large data platform to be measured;
S2: obtain the task type in described test case;
S3: if described task type is functional verification class, then call described functional test and perform container and perform described test case, treat that brake detects according to described test case to large data platform to be measured; If described task type is performance verification class, then calls described performance test execution container and perform described test case, detect according to the performance of described test case to the testing component of large data platform to be measured.
2. method according to claim 1, is characterized in that, in described S3, described in call described functional test and perform container and perform described test case, according to described test case large data platform to be measured treated that brake detects, comprising:
By described functional test perform container obtains from described test case to treat described in operation parameter required for brake, data processing number of times, described in treat that brake runs successful standard, the first pending data;
By described functional test perform parameter that container treats required for brake according to described operation run described in treat brake;
Treat described in described pending data being passed through by described feature capability test execution container that brake carries out time process for several times of described data processing;
By described functional test perform container according to described in treat that brake runs successful standard, treat described in judgement that whether brake normal.
3. method according to claim 1, is characterized in that, in described S3, described in call described performance test perform container perform described test case, detect according to the performance of described test case to the testing component of large data platform to be measured, comprising:
Perform container by described performance test from described test case, obtain pressure environment parameter, the second pending data;
Perform container by described performance test and on described large data platform to be measured, build corresponding pressure environment according to described pressure environment parameter;
Call described testing component by described performance test execution container under described pressure environment, process described second pending data, record the performance parameter of described testing component.
4. method according to claim 1, is characterized in that,
Described S1, comprising: call described test case by restful application programming interface api;
And/or,
Described S1, comprising: call described test case by performing shell-command.
5., according to described method arbitrary in claim 1-4, it is characterized in that, also comprise: pre-set multiple test case template;
Before described S1, also comprise:
Determine the outside test case template selected;
Receive the to be filled parameter corresponding by the described test case template selected of outside input;
To fill according to described parameter to be filled and described by the described test case template selected, generate described test case.
6. a pick-up unit for large data platform, is characterized in that, comprising:
First setting unit, perform container for the whether normal functional test of function arranged for verifying large data platform to be measured, the performance test arranging the runnability of the assembly for verifying large data platform to be measured performs container;
Call unit, for calling the test case for testing described large data platform to be measured;
Acquiring unit, for obtaining the task type in described test case;
Detecting unit, for when described task type is functional verification class, then calls described functional test and performs container and perform described test case, treat that brake detects according to described test case to large data platform to be measured; When described task type is performance verification class, then calls described performance test execution container and perform described test case, detect according to the performance of described test case to the testing component of large data platform to be measured.
7. device according to claim 6, it is characterized in that, described detecting unit, described in execution, call described functional test execution container perform described test case, according to described test case to large data platform to be measured when brake detects, specifically perform:
Perform container by described functional test from described test case, obtains the parameter treated described in operation required for brake, data processing number of times, describedly treat that brake runs successful standard, first pending data, by described functional test perform parameter that container treats required for brake according to described operation run described in treat brake, treat described in described pending data being passed through by described feature capability test execution container that brake carries out time process for several times of described data processing, by described functional test perform container according to described in treat that brake runs successful standard, treat described in judgement that whether brake is normal.
8. device according to claim 6, it is characterized in that, described detecting unit, described in execution, call described performance test execution container perform described test case, when detecting according to the performance of described test case to the testing component of large data platform to be measured, specifically perform:
Perform container by described performance test from described test case, obtain pressure environment parameter, the second pending data, perform container by described performance test and on described large data platform to be measured, build corresponding pressure environment according to described pressure environment parameter, call described testing component by described performance test execution container under described pressure environment, process described second pending data, record the performance parameter of described testing component.
9. device according to claim 6, is characterized in that,
Described call unit, for calling described test case by restful application programming interface api;
And/or described call unit, for calling described test case by performing shell-command.
10., according to described device arbitrary in claim 6-9, it is characterized in that, also comprise:
Second setting unit, for arranging multiple test case template;
Also comprise: Test cases technology unit, for determining the outside test case template selected, receive the to be filled parameter corresponding by the described test case template selected of outside input, to fill according to described parameter to be filled and described by the described test case template selected, generate described test case.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201510638546.4A CN105302717A (en) | 2015-09-30 | 2015-09-30 | Detection method and apparatus for big data platform |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201510638546.4A CN105302717A (en) | 2015-09-30 | 2015-09-30 | Detection method and apparatus for big data platform |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN105302717A true CN105302717A (en) | 2016-02-03 |
Family
ID=55200006
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201510638546.4A Pending CN105302717A (en) | 2015-09-30 | 2015-09-30 | Detection method and apparatus for big data platform |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN105302717A (en) |
Cited By (11)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106850321A (en) * | 2017-04-05 | 2017-06-13 | 无锡华云数据技术服务有限公司 | A kind of simulated testing system of cluster server |
| CN107609026A (en) * | 2017-08-09 | 2018-01-19 | 中南大学 | A kind of data-intensive applications integration test method and system |
| CN107885834A (en) * | 2017-11-09 | 2018-04-06 | 郑州云海信息技术有限公司 | A kind of Hadoop big datas component uniformly verifies system |
| CN107967212A (en) * | 2017-12-05 | 2018-04-27 | 广州酷狗计算机科技有限公司 | Generation method, the device and system of RF use-cases |
| CN108205477A (en) * | 2016-12-16 | 2018-06-26 | 上海仪电（集团）有限公司中央研究院 | Server stress test method |
| CN109460363A (en) * | 2018-11-09 | 2019-03-12 | 贵州医渡云技术有限公司 | Automated testing method, device, electronic equipment and computer-readable medium |
| CN109542794A (en) * | 2018-12-04 | 2019-03-29 | 中国航空工业集团公司西安航空计算技术研究所 | A kind of Software Automatic Testing Method applied to embedded system |
| CN109901999A (en) * | 2019-01-31 | 2019-06-18 | 国核自仪系统工程有限公司 | The emulation mode and system of programmable logic based on UVM |
| CN110489201A (en) * | 2018-05-15 | 2019-11-22 | 中国移动通信集团浙江有限公司 | Container performance test device and method |
| CN110633150A (en) * | 2019-09-12 | 2019-12-31 | 广东浪潮大数据研究有限公司 | Container scheduling performance testing method and device |
| CN113806150A (en) * | 2021-08-16 | 2021-12-17 | 济南浪潮数据技术有限公司 | Method, system, equipment and storage medium for remote testing of storage server |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103678098A (en) * | 2012-09-06 | 2014-03-26 | 百度在线网络技术（北京）有限公司 | HADOOP program testing method and system |
| KR20140072726A (en) * | 2012-12-05 | 2014-06-13 | 경북대학교 산학협력단 | Function Test Apparatus based on Unit Test Cases Reusing and Function Test Method thereof |
| CN104298601A (en) * | 2014-10-24 | 2015-01-21 | 浪潮电子信息产业股份有限公司 | Software system testing method based on Hadoop platform |
-
2015
- 2015-09-30 CN CN201510638546.4A patent/CN105302717A/en active Pending
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103678098A (en) * | 2012-09-06 | 2014-03-26 | 百度在线网络技术（北京）有限公司 | HADOOP program testing method and system |
| KR20140072726A (en) * | 2012-12-05 | 2014-06-13 | 경북대학교 산학협력단 | Function Test Apparatus based on Unit Test Cases Reusing and Function Test Method thereof |
| CN104298601A (en) * | 2014-10-24 | 2015-01-21 | 浪潮电子信息产业股份有限公司 | Software system testing method based on Hadoop platform |
Non-Patent Citations (1)
| Title |
|---|
| 代亮等: "大数据测试技术研究", 《计算机应用研究》 * |
Cited By (16)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108205477A (en) * | 2016-12-16 | 2018-06-26 | 上海仪电（集团）有限公司中央研究院 | Server stress test method |
| CN106850321A (en) * | 2017-04-05 | 2017-06-13 | 无锡华云数据技术服务有限公司 | A kind of simulated testing system of cluster server |
| CN107609026A (en) * | 2017-08-09 | 2018-01-19 | 中南大学 | A kind of data-intensive applications integration test method and system |
| CN107609026B (en) * | 2017-08-09 | 2020-11-06 | 中南大学 | Data intensive application integration test method and system |
| CN107885834B (en) * | 2017-11-09 | 2021-07-20 | 浪潮云信息技术股份公司 | Hadoop big data assembly unified verification system |
| CN107885834A (en) * | 2017-11-09 | 2018-04-06 | 郑州云海信息技术有限公司 | A kind of Hadoop big datas component uniformly verifies system |
| CN107967212A (en) * | 2017-12-05 | 2018-04-27 | 广州酷狗计算机科技有限公司 | Generation method, the device and system of RF use-cases |
| CN110489201A (en) * | 2018-05-15 | 2019-11-22 | 中国移动通信集团浙江有限公司 | Container performance test device and method |
| CN110489201B (en) * | 2018-05-15 | 2021-11-30 | 中国移动通信集团浙江有限公司 | Container performance testing device and method |
| CN109460363A (en) * | 2018-11-09 | 2019-03-12 | 贵州医渡云技术有限公司 | Automated testing method, device, electronic equipment and computer-readable medium |
| CN109542794A (en) * | 2018-12-04 | 2019-03-29 | 中国航空工业集团公司西安航空计算技术研究所 | A kind of Software Automatic Testing Method applied to embedded system |
| CN109901999A (en) * | 2019-01-31 | 2019-06-18 | 国核自仪系统工程有限公司 | The emulation mode and system of programmable logic based on UVM |
| CN109901999B (en) * | 2019-01-31 | 2021-01-29 | 国核自仪系统工程有限公司 | Simulation method and system of programmable logic based on UVM |
| CN110633150A (en) * | 2019-09-12 | 2019-12-31 | 广东浪潮大数据研究有限公司 | Container scheduling performance testing method and device |
| CN113806150A (en) * | 2021-08-16 | 2021-12-17 | 济南浪潮数据技术有限公司 | Method, system, equipment and storage medium for remote testing of storage server |
| CN113806150B (en) * | 2021-08-16 | 2024-02-13 | 济南浪潮数据技术有限公司 | Method, system, equipment and storage medium for remote test of storage server |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN105302717A (en) | Detection method and apparatus for big data platform | |
| CN107273286B (en) | Scene automatic test platform and method for task application | |
| EP3619611B1 (en) | Conditional debugging of server-side production code | |
| US20080028378A1 (en) | Utilizing prior usage data for software build optimization | |
| CN101964036B (en) | Leak detection method and device | |
| US10353809B2 (en) | System and method for executing integration tests in multiuser environment | |
| CN103092751B (en) | Web application performance test system based on customer behavior model in cloud environment | |
| CN110888818A (en) | Test case configuration system and method, automatic test system and method | |
| US20110314459A1 (en) | Compiler with user-defined type inference rules | |
| US20080228805A1 (en) | Method for testing a system | |
| US9063778B2 (en) | Fair stateless model checking | |
| US9396095B2 (en) | Software verification | |
| US20110173594A1 (en) | Selective Loading of Code Elements for Code Analysis | |
| CN110928777B (en) | Test case processing method, device, equipment and storage medium | |
| Panigrahi et al. | An approach to prioritize the regression test cases of object-oriented programs | |
| CA2811617C (en) | Commit sensitive tests | |
| CN112650676A (en) | Software testing method, device, equipment and storage medium | |
| CN105279092A (en) | Software testing method and apparatus | |
| US11169910B2 (en) | Probabilistic software testing via dynamic graphs | |
| US20130318499A1 (en) | Test script generation | |
| CN117236423A (en) | Nuclear function calling method, device, equipment, storage medium and program product | |
| CN110289043B (en) | Storage device testing method and device and electronic device | |
| US11057416B2 (en) | Analyze code that uses web framework using local parameter model | |
| Laaber et al. | Performance testing in the cloud. How bad is it really? | |
| CN115269390A (en) | Automatic testing method and device for graphical interface and storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| WD01 | Invention patent application deemed withdrawn after publication |
Application publication date: 20160203 |
|
| WD01 | Invention patent application deemed withdrawn after publication |