CN109189675A - Big data Framework Software test method, device, computer equipment and storage medium - Google Patents
Big data Framework Software test method, device, computer equipment and storage medium Download PDFInfo
- Publication number
- CN109189675A CN109189675A CN201810950327.3A CN201810950327A CN109189675A CN 109189675 A CN109189675 A CN 109189675A CN 201810950327 A CN201810950327 A CN 201810950327A CN 109189675 A CN109189675 A CN 109189675A
- Authority
- CN
- China
- Prior art keywords
- data
- test
- task
- dependence
- big
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/36—Preventing errors by testing or debugging software
- G06F11/3668—Software testing
- G06F11/3672—Test management
- G06F11/3688—Test management for test execution, e.g. scheduling of test suites
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/36—Preventing errors by testing or debugging software
- G06F11/3668—Software testing
- G06F11/3672—Test management
- G06F11/3684—Test management for test design, e.g. generating new test cases
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Computer Hardware Design (AREA)
- Quality & Reliability (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Debugging And Monitoring (AREA)
Abstract
This application discloses a kind of big data Framework Software test method, device, computer equipment and storage mediums, and wherein big data Framework Software is based on Hadoop frame, and the method obtains the test data table for carrying out functional test task needs；The attribute for analyzing the test data table obtains corresponding data configuration parameter；The data configuration parameter is input in preset data conversion script, to generate corresponding data configuration order；The data in the test data table are carried out being converted to test data according to the data configuration order；Functional test is carried out using correspondence task of the test data to the big data Framework Software.The application is put forward for the first time big data Hadoop framework test method, and there is no relevant test methods before this, can be widely applied in each group in the test of big data project, convenient to big data Hadoop framework test.
Description
Technical field
This application involves computer field is arrived, a kind of big data Framework Software test method, device, meter are especially related to
Calculate machine equipment and storage medium.
Background technique
Hadoop test environment is unstable, and test data is insufficient, and system data outlet is not up to standard, at present without big in industry
The test system of data Hadoop frame, test method is without reference.
Summary of the invention
The main purpose of the application is to provide a kind of big data Framework Software test method, device, computer equipment and deposit
A kind of storage media, it is desirable to provide test system under big data Hadoop frame.
In order to achieve the above-mentioned object of the invention, the application proposes a kind of big data Framework Software test method, which is characterized in that
The big data Framework Software is based on Hadoop frame, which comprises
Obtain the test data table for carrying out functional test task needs；
The attribute for analyzing the test data table obtains corresponding data configuration parameter；
The data configuration parameter is input in preset data conversion script, to generate corresponding data configuration life
It enables；
The data in the test data table are carried out being converted to test data according to the data configuration order；
Functional test is carried out using correspondence task of the test data to the big data Framework Software.
Further, the attribute of the analysis test data table, the step of obtaining corresponding data configuration parameter, packet
It includes:
Judge the test data tableau format, and using judging result as the first constructing variable；
Judge the subregion state of the test data table under first constructing variable, and using judging result as second
Constructing variable；
Determine in the test data table under second constructing variable whether there is sensitive data, and by judging result
As third constructing variable.
Further, described that the data configuration parameter is input in preset data conversion script, to generate correspondence
Data configuration order the step of, comprising:
If there are sensitive datas in the third constructing variable, the data structure that desensitization process is carried out to sensitive data is generated
Make order.
Further, described that the data in the test data table are converted to according to the data configuration order
The step of test data, comprising:
According to the data configuration order for carrying out desensitization process to sensitive data, to the sensitive data in the test data table
It desensitizes, obtains the combined data table combined with desensitization data and nonsensitive data, the data in the combined data table
The test data being as converted to.
Further, before the step of test data table of the acquisition progress functional test task needs, comprising:
Obtain multiple the participating in smoke test of the tasks；
Analyze the dependence between each task；
The first cis-position task of each task of dependence will be present, and do not have the discrete of dependence with other tasks
Task concurrently carries out smoke test, will have the task of dependence to carry out smoke test according to dependence sequence.
Further, the first cis-position task of each task that dependence will be present, and do not have with other tasks
The discrete tasks of dependence concurrently carry out smoke test, will have the task of dependence to carry out smoke test according to dependence sequence
The step of before, comprising:
Obtain the corresponding data of each task；
Undesirable data are cleared up according to default script.
Further, described to carry out functionality using correspondence task of the test data to the big data Framework Software
After the step of test, comprising:
It is transferred using default script into database and completes each first number that the appointed task of functional test is handled
It is inserted into preset comparison sheet according to the first Data Summary in table, and by each first Data Summary, wherein described first
Data Summary includes at least table name, data volume and the runing time of first tables of data；
Functional test is carried out to the appointed task again, obtains each second tables of data, and again using described default
Script obtains the second Data Summary of second tables of data, and each second Data Summary is inserted into the comparison sheet
In；
Compare the first Data Summary and the second Data Summary, if the error of the two is within a preset range, determines the finger
Determining task can be used normally.
The application also provides a kind of big data Framework Software test device, and the big data Framework Software is based on Hadoop frame
Frame, described device include:
Acquiring unit, for obtaining the test data table for carrying out functional test task needs；
Analytical unit obtains corresponding data configuration parameter for analyzing the attribute of the test data table；
Generation unit, for the data configuration parameter to be input in preset data conversion script, to generate correspondence
Data configuration order；
Converting unit, for being converted to according to the data configuration order to the data in the test data table
Test data；
Test cell, it is functional for being carried out using correspondence task of the test data to the big data Framework Software
Test.
The application also provides a kind of computer equipment, including memory and processor, and the memory is stored with computer
Program, which is characterized in that the step of processor realizes any of the above-described the method when executing the computer program.
The application also provides a kind of computer readable storage medium, is stored thereon with computer program, which is characterized in that institute
State the step of realizing method described in any of the above embodiments when computer program is executed by processor.
Big data Framework Software test method, device, computer equipment and the storage medium of the application is to be put forward for the first time greatly
Data Hadoop framework test method can be widely applied to big in each group before this there is no relevant test method
It is convenient to big data Hadoop framework test in the test of data items.
Detailed description of the invention
Fig. 1 is the flow diagram of the big data Framework Software test method of one embodiment of the application；
Fig. 2 is the schematic diagram of the dependence between each task of one embodiment of the application；
Fig. 3 is the structural schematic block diagram of the big data Framework Software test device of one embodiment of the application；
Fig. 4 is the structural schematic block diagram of the analytical unit of one embodiment of the application；
Fig. 5 is the structural schematic block diagram of the generation unit of one embodiment of the application；
Fig. 6 is the structural schematic block diagram of the converting unit of one embodiment of the application；
Fig. 7 is the structural schematic block diagram of the computer equipment of one embodiment of the application.
The embodiments will be further described with reference to the accompanying drawings for realization, functional characteristics and the advantage of the application purpose.
Specific embodiment
It is with reference to the accompanying drawings and embodiments, right in order to which the objects, technical solutions and advantages of the application are more clearly understood
The application is further elaborated.It should be appreciated that specific embodiment described herein is only used to explain the application, not
For limiting the application.
Referring to Fig.1, the embodiment of the present application provides a kind of big data Framework Software test method, wherein big data framework is soft
Part is based on Hadoop frame.
Above-mentioned Hadoop (extra large dupp) is a kind of big data frame, is mainly used for big data test environment.Hadoop is used
Database be the library hive, hive is a Tool for Data Warehouse based on Hadoop, the data file of structuring can be reflected
It penetrates as a database table, and complete sql query function is provided, sql sentence can be converted to the progress of MapReduce task
Operation.The advantages of database of Hadoop is at low cost；The disadvantage is that being stored with a large amount of table number in the database of Hadoop
According to when storing insufficient, be easy to causeing test environmental breakdown, report an error since the storage resource of database is limited
The method includes the steps:
S1, the test data table for carrying out functional test task needs is obtained；
The attribute of S2, the analysis test data table, obtain corresponding data configuration parameter；
S3, the data configuration parameter is input in preset data conversion script, to generate corresponding data configuration
Order；
S4, the data in the test data table are carried out being converted to test data according to the data configuration order；
S5, functional test is carried out using correspondence task of the test data to the big data Framework Software.
As described in above-mentioned steps S1, the big data Framework Software based on Hadoop frame can execute different tasks, in order to
Guarantee that different tasks can complete specified target, needs to carry out functional test to different tasks.Because different appoints
Business handles different data, so needing to grab and functional test task pair in database when functional test
The data answered, and different data can be inserted in different tables of data, and the tables of data grabbed is above-mentioned test data
Table.Specific crawl process is conventional data grabber process, then this is repeated no more.
As described in above-mentioned steps S2 and S3, the attribute of above-mentioned test data table includes test data tableau format, subregion
State, storing data content etc..Different test data tables can have a different attributes, in the embodiment of the present application, according to test
The attribute of tables of data forms corresponding data configuration parameter, the different configuration parameter of available difference test data tables, because
The attribute that data form may possess is known, so the attribute of obtained test data table must be in numerous known attributes
One kind, and because construction data parameters be by test data table attribute generate, the type of constructing variable is also controllable
, and then corresponding data conversion script can be write in advance, carry out data conversion.Script is written as those skilled in the art
Basic skills, the compiling procedure of details are not described herein data conversion script and specific logic etc..
As described in above-mentioned steps S4, as the data conversion in test data table is obtained at the process of test data
Test data must meet the data of test request, and no person carries out data configuration, and there will be no in all senses.
As described in above-mentioned steps S5, functional test, tool as are carried out to the correspondence task of the big data Framework Software
The test process of body is the conventional process that software carries out functional test, then details are not described herein
In one embodiment, the attribute of the above-mentioned analysis test data table, obtains corresponding data configuration parameter
Step S2, comprising:
S21, judge the test data tableau format, and using judging result as the first constructing variable；
S22, the subregion state for judging the test data table under first constructing variable, and using judging result as
Second constructing variable；
Whether there is sensitive data, and will judgement in the test data table under S23, judgement second constructing variable
As a result it is used as third constructing variable.
As described in above-mentioned steps S21 to S23, above-mentioned test data tableau format specifically includes two kinds, respectively rcfile
Format and txtfile format both can be as the first constructions when test data tableau format is any one format
Parameter；And the test data table of above-mentioned rcfile format or txtfile format tool includes by subregion and case of non-partitioned two states, institute
Using specific subregion state as the second constructing variable；Likewise, including test number in the state of subregion or case of non-partitioned
According to whether including sensitive data in table, so whether specific have sensitive data as third constructing variable.Because format,
Subregion state and whether there is the combination of sensitive data that can arrange out, it is possible to preset in advance goes out corresponding script,
Realize controllable data configuration rule etc..Above-mentioned sensitive data include it is a variety of, such as client or employee's telephone number, customer name
Deng such data forbid leaking.Judge that the test data in database includes with the presence or absence of the method for sensitive data, if
Specific key field (generally English, because order, the title etc. of software in the process of implementation are for English) is set, so
Search data corresponding with the key field in the database afterwards, these data are sensitive data.In a specific implementation
In example, the key field of setting is " Phone number (telephone number) ", then number corresponding with " Phone number "
It is sensitive data etc. according to (specific telephone number).In the test process of a task, multiple keyword words can be set
Section, to obtain different sensitive datas.
In one embodiment, above-mentioned that the data configuration parameter is input in preset data conversion script, with life
At the step S3 of corresponding data configuration order, comprising:
If there are sensitive datas in S31, the third constructing variable, the number that desensitization process is carried out to sensitive data is generated
It is ordered according to construction.
As described in above-mentioned steps S31, above-mentioned desensitization process is that sensitive data is converted into nonsensitive data, equally with
For " Phone number " corresponding sensitive data, corresponding telephone number is 13112345678, can be by finger therein
It positions number and carries out symbol replacement, be such as converted into 1311234****, 1*1*2*4*6*8,131****45678 etc..If sensitive number
According to further including " Full name (name) " corresponding name data of field, then corresponding property or name are converted, for example, surname
Entitled Zhang San changes into a *, *, PA etc..Different script rules can be set for different sensitive datas, carry out data and turn
It changes, because script edit can be according to requiring to be write, and script edit is the basic capacity of those skilled in the art, therefore
It is not repeating herein.
In one embodiment, above-mentioned that the data in the test data table are turned according to the data configuration order
Get the step S4 of test data in return, comprising:
S41, basis carry out the data configuration order of desensitization process to sensitive data, to the sensitivity in the test data table
Data desensitize, and the combined data table combined with desensitization data and nonsensitive data are obtained, in the combined data table
Data are the test data being converted to.
As described in above-mentioned steps S41, sensitive data and nonsensitive data will include in above-mentioned test data table, when to sensitivity
After data desensitization, then the combined data table combined with desensitization data and nonsensitive data can be obtained, then can use knot
The data closed in tables of data carry out functional test.
In one embodiment, above-mentioned acquisition carry out the test data table of functional test task needs step S1 it
Before, comprising:
S101, multiple the participating in smoke test of the tasks are obtained；
Dependence between S102, each task of analysis；
S103, will be present dependence each task the first cis-position task, and there is no dependence with other tasks
Discrete tasks concurrently carry out smoke test, will have the task of dependence according to dependence sequence carry out smoke test.
As described in above-mentioned steps S101, before above-mentioned smoke test refers in the source tree that coding change is embedded into product
The process that these changes are verified.Smoke test is to determine and repair the most economical effective method of software defect.It smolders
After test is designed for confirmation coding change, it can operate as intended, and the stability of entire version will not be destroyed.Big data framework
Software be substantially carried out the tasks such as big data analysis, so can concurrent multiple tasks simultaneously, and in each task execution concrete operations
Before, timing is needed to carry out smoke test, to determine the stability of big data Framework Software.In the application, task of smoldering is obtained
Method include it is a variety of, the first is to receive artificially the choosing of the task as the participating in smoke test of the task；Second, at one
In preset first task list, the task of specified quantity is randomly selected as the participating in smoke test of the task；The third, is referring to
It fixes time, obtains preset second task list, whole tasks in second task list are as times for participating in smoke test
Business etc..
As described in above-mentioned steps S102, above-mentioned dependence is also known as " logical relation ".In project management, two work are indicated
A movable change will influence whether another movable relationship in dynamic (prodecessor activity and follow-up activities).Usually between activity
Dependence include forcing dependence, disposable dependence and external three kinds of forms of dependence.Wherein, by force
Dependence processed is dependence intrinsic in task, is a kind of logical relation that cannot be violated, and also known as hard logic closes
System, it is because caused by the limitation of objective law and locality condition.Free dependence is defined by project team, example
Such as: a project team may abide by some good ways, only just start the detailed of new information system after user, which signs, to be approved
Thin design, free dependence are also sometimes referred to as soft logic relationship.External dependence refer to project and non-project activity it
Between relationship.Dependence in the application refers mainly to above-mentioned pressure dependence.
In the present embodiment, in multiple tasks, there is no the task of dependence with other tasks, can regard discrete as
Business；There is the task of dependence with other tasks, can regard dependence task as, and there may be a plurality of masters for each dependence task
It is suitable for task can be regarded as first by arteries and veins and offshoot etc. for first task on each master pulse.Specifically as shown in Fig. 2, being wrapped in Fig. 2
The multiple tasks such as A, B, C, D, E, F, G, H, I are included, wherein A, B, C and other tasks are without dependence, then A, B, C are discrete
Task；D is respectively with E, F there are dependence, and D is first along being task；G, successively there is dependence in H, I, and G is first suitable
For task.
As described in above-mentioned steps S103, i.e., discrete tasks and the first cis-position task are concurrently subjected to smoke test, specifically,
The multiple tasks such as A, B, C, D, E, F, G, H, I as the above-mentioned, first by above-mentioned tri- discrete tasks of A, B, C and D, G two
A first cis-position task concurrently carries out smoke test, after the completion of D task, carries out smoke test to E, F task respectively, when G appoints
After the completion of business, smoke test is carried out to H task, after H task, smoke test is carried out to I task.Specifically concurrently triggering can be with
It is carried out using various ways, for example batch triggering is carried out by the dispatching platform of such as linkdo, then this is not repeated.
In one embodiment, the first cis-position task of above-mentioned each task that dependence will be present, and with other
The discrete tasks of the not no dependence of business concurrently carry out smoke test, will have the task of dependence to emit according to dependence sequence
Before the step S103 of cigarette test, comprising:
S1031, the corresponding data of each task are obtained；
S1032, undesirable data are cleared up according to default script.
As described in above-mentioned steps S1031 and S1032, different tasks, the data for carrying out smoke test are different, so first
Obtain the data of corresponding task.The method of acquisition includes a variety of, for example is transferred etc. according to preset field into source data.
It is above-mentioned to clean the corresponding data of each task, undesirable data are as purged to the process of processing, it is above-mentioned
Script is the script for setting cleaning rule sentence, is such as quantitative value for the data of a certain task, then can specify that removing is big
In the number of specified quantity value, and less than the number etc. of specified quantity value.After undesirable data scrubbing, it can be improved
The efficiency of smoke test.
In one embodiment, above-mentioned to be carried out using correspondence task of the test data to the big data Framework Software
After the step S5 of functional test, comprising:
S6, using default script transferred into database complete functional test appointed task handle each first
The first Data Summary in tables of data, and each first Data Summary is inserted into preset comparison sheet, wherein described
One Data Summary includes at least table name, data volume and the runing time of first tables of data；
S7, functional test is carried out to the appointed task again, obtains each second tables of data, and again using described pre-
If script obtains the second Data Summary of second tables of data, and each second Data Summary is inserted into the comparison sheet
In；
S8, compare the first Data Summary and the second Data Summary, if the error of the two is within a preset range, described in judgement
Appointed task can be used normally.
As described in above-mentioned steps S6 to S8, the as regression test process of big data construction software is finished writing using one
Default script hugs the first Data Summary of the tables of data that each task obtains when taking functional test into database, then again to each
Task carries out the functional test such as above-mentioned steps S1-S5, each task is obtained again treated tables of data, then by pre-
If script obtains the second Data Summary of each tables of data obtained again, and the first Data Summary of comparison and the second data are total
Knot, if the two is consistent or error within the specified range, determine that regression test is completed, the appointed task can normally make
With.In the present embodiment, the data that functional test again obtains are carried out and can override first time functional test to obtain
Data.
In one embodiment, above-mentioned big data Framework Software test method further include: the interim table of periodic cleaning and dirty number
According to.
In this step, due to the hive database of Hadoop frame, table is not no major key, so it is a large amount of to will cause data
It repeats, or the data for being unsatisfactory for condition and will affect result judgement being artificially manually inserted, these data are exactly dirty data.
A large amount of interim table can be also established in the task of execution, these interim tables are after using completing, both without other purposes, such as
Fruit remains stored in hive database, will affect test result, and occupy storage resource.In the present embodiment, one can be set
A clearance time interval can be set for example, cleaning one in every mistake one week is inferior according to different situations.Specific cleaning is faced
When table and the method for dirty data include writing a cleaning script, do not repeating herein.
In a specific embodiment, above-mentioned big data Framework Software test method further include:
Record the big data Framework Software causes big data Framework Software to stop fortune because data overflow storage unit
Capable frequency；
If the frequency is greater than predeterminated frequency value, the prompting message for increasing storage unit dilatation is generated.
In the present embodiment, in order to improve the stabilization of running environment, biggish storage unit, and because storage can be generally provided
The application of unit is practical, costly, so the storage unit of a moderate amount of storage can be selected, still, with data volume
Situations such as increasing needs to carry out dilatation to storage unit.In the present embodiment, a kind of prompting logic of storage unit dilatation is provided,
In other embodiments, dilatation can also actively be selected with user according to actual use situation.
In other embodiments, can also dilatation be carried out to the computing unit for executing big data Framework Software, to improve big number
According to the stability etc. of test environment.
The big data Framework Software test method of the embodiment of the present application is to be put forward for the first time the framework test side big data Hadoop
Method, there is no relevant test methods before this, can be widely applied in each group in the test of big data project, from
Test environment arranges, and -- smoke test -- functional test -- regression test proposes more novel testing process, improves and surveys
Stability, testing efficiency are tried, sensitive information leakage etc. can also be prevented.
Referring to Fig. 3, the embodiment of the present application provides a kind of big data Framework Software test device, wherein big data framework is soft
Part is based on Hadoop frame.
Above-mentioned Hadoop (extra large dupp) is a kind of big data frame, is mainly used for big data test environment.Hadoop is used
Database be the library hive, hive is a Tool for Data Warehouse based on Hadoop, the data file of structuring can be reflected
It penetrates as a database table, and complete sql query function is provided, sql sentence can be converted to the progress of MapReduce task
Operation.The advantages of database of Hadoop is at low cost；The disadvantage is that being stored with a large amount of table number in the database of Hadoop
According to when storing insufficient, be easy to causeing test environmental breakdown, report an error since the storage resource of database is limited
Described device includes:
Acquiring unit 10, for obtaining the test data table for carrying out functional test task needs；
Analytical unit 20 obtains corresponding data configuration parameter for analyzing the attribute of the test data table；
Generation unit 30, for the data configuration parameter to be input in preset data conversion script, with generation pair
The data configuration order answered；
Converting unit 40, for convert to the data in the test data table according to the data configuration order
To test data；
Test cell 50, for carrying out function using correspondence task of the test data to the big data Framework Software
Property test.
Such as above-mentioned acquiring unit 10, the big data Framework Software based on Hadoop frame can execute different tasks, in order to
Guarantee that different tasks can complete specified target, needs to carry out functional test to different tasks.Because different appoints
Business handles different data, so needing to grab and functional test task pair in database when functional test
The data answered, and different data can be inserted in different tables of data, and the tables of data grabbed is above-mentioned test data
Table.Specific crawl process is conventional data grabber process, then this is repeated no more.
Such as above-mentioned analytical unit 20 and generation unit 30, the attribute of above-mentioned test data table includes the lattice of test data table
Formula, subregion state, storing data content etc..Different test data tables can have a different attributes, in the embodiment of the present application, root
Corresponding data configuration parameter, the different configuration ginseng of available difference test data table are formed according to the attribute of test data table
Number because the attribute that data form may possess be it is known, the attribute of obtained test data table must be it is numerous
Know one of attribute, and because construction data parameters are generated by the attribute of test data table, the type of constructing variable
It is also controllable, and then corresponding data conversion script can be write in advance, carries out data conversion.Script is written as this field
The basic skills of technical staff, the compiling procedure of details are not described herein data conversion script and specific logic etc..
Such as above-mentioned converting unit 40, as the data conversion in test data table is obtained at the unit of test data
Test data must meet the data of test request, and no person carries out data configuration, and there will be no in all senses.
Such as above-mentioned test cell 50, functional survey as is carried out for the correspondence task to the big data Framework Software
Examination, specific test process is the conventional process that software carries out functional test, then details are not described herein
Referring to Fig. 4, in one embodiment, above-mentioned analytical unit 20, comprising:
First analysis module 21, for judging the test data tableau format, and using judging result as the first construction
Parameter；
Second analysis module 22, for judging the subregion state of the test data table under first constructing variable,
And using judging result as the second constructing variable；
Third analysis module 23, it is quick for determining whether to have in the test data table under second constructing variable
Feel data, and using judging result as third constructing variable.
Such as above-mentioned first analysis module 21, the second analysis module 22 and third analysis module 23, above-mentioned test data table
Format specifically includes two kinds, respectively rcfile format and txtfile format, when test data tableau format is any one lattice
It, both can be as the first constructing variable when formula；And the test data table of above-mentioned rcfile format or txtfile format has
Including by subregion and case of non-partitioned two states, so specific subregion state is as the second constructing variable；Likewise, in subregion or
It include in test data table whether include sensitive data in the state of case of non-partitioned, so whether specific have sensitivity
Data are as third constructing variable.Because format, subregion state and whether having the combination of sensitive data that can arrange out,
So corresponding script can be gone out with preset in advance, controllable data configuration rule etc. is realized.Above-mentioned sensitive data include it is a variety of, such as
Client or employee's telephone number, customer name etc., such data forbid leaking.Judging the test data in database is
The no method there are sensitive data includes that specific key field (generally English, because software is in the process of implementation is arranged
Order, title etc. be for English), then search data corresponding with the key field in the database, these are counted
According to as sensitive data.In one embodiment, the key field of setting is " Phone number (telephone number) ", that
Data (specific telephone number) corresponding with " Phone number " are sensitive data etc..In the test of a task
Multiple key fields can be set in Cheng Zhong, to obtain different sensitive datas.
Referring to Fig. 5, in one embodiment, above-mentioned generation unit 30, comprising:
Generation module 31, if generating and being carried out to sensitive data for there are sensitive datas in the third constructing variable
The data configuration order of desensitization process.
Such as above-mentioned generation module 31, above-mentioned desensitization process is that sensitive data is converted into nonsensitive data, equally with
For " Phone number " corresponding sensitive data, corresponding telephone number is 13112345678, can be by finger therein
It positions number and carries out symbol replacement, be such as converted into 1311234****, 1*1*2*4*6*8,131****45678 etc..If sensitive number
According to further including " Full name (name) " corresponding name data of field, then corresponding property or name are converted, for example, surname
Entitled Zhang San changes into a *, *, PA etc..Different script rules can be set for different sensitive datas, carry out data and turn
It changes, because script edit can be according to requiring to be write, and script edit is the basic capacity of those skilled in the art, therefore
It is not repeating herein.
Referring to Fig. 6, in one embodiment, above-mentioned converting unit 40, comprising:
Desensitize conversion module 41, the data configuration order of desensitization process is carried out to sensitive data for basis, to the survey
Sensitive data in examination tables of data desensitizes, and obtains the combined data table combined with desensitization data and nonsensitive data, institute
Stating the data in combined data table is the test data being converted to.
Such as above-mentioned desensitization conversion module 41, sensitive data and nonsensitive data will include in above-mentioned test data table, when right
After sensitive data desensitization, then the combined data table combined with desensitization data and nonsensitive data can be obtained, then can benefit
Functional test is carried out with the data in combined data table.
In one embodiment, above-mentioned big data Framework Software test device, comprising:
TU task unit is obtained, for obtaining multiple the participating in smoke test of the tasks；
Analytical unit, for analyzing the dependence between each task；
Test cell, the first cis-position task of each task for dependence to will be present, and do not have with other tasks
The discrete tasks of dependence concurrently carry out smoke test, will have the task of dependence to carry out survey of smoldering according to dependence sequence
Examination.
Such as above-mentioned acquisition TU task unit, before above-mentioned smoke test refers in the source tree that coding change is embedded into product
The process that these changes are verified.Smoke test is to determine and repair the most economical effective method of software defect.It smolders
After test is designed for confirmation coding change, it can operate as intended, and the stability of entire version will not be destroyed.Big data framework
Software be substantially carried out the tasks such as big data analysis, so can concurrent multiple tasks simultaneously, and in each task execution concrete operations
Before, timing is needed to carry out smoke test, to determine the stability of big data Framework Software.In the application, task of smoldering is obtained
Method include it is a variety of, the first is to receive artificially the choosing of the task as the participating in smoke test of the task；Second, at one
In preset first task list, the task of specified quantity is randomly selected as the participating in smoke test of the task；The third, is referring to
It fixes time, obtains preset second task list, whole tasks in second task list are as times for participating in smoke test
Business etc..
Such as above-mentioned analytical unit, above-mentioned dependence is also known as " logical relation ".In project management, two activities are indicated
A movable change will influence whether another movable relationship in (prodecessor activity and follow-up activities).Usually between activity
Dependence includes forcing three kinds of dependence, disposable dependence and external dependence forms.Wherein, it forces
Dependence is dependence intrinsic in task, is a kind of logical relation that cannot be violated, also known as hard logic relationship,
It is because caused by the limitation of objective law and locality condition.Free dependence be defined by project team, such as: one
A project team may abide by some good ways, only just start setting in detail for new information system after user, which signs, to be approved
Meter, free dependence are also sometimes referred to as soft logic relationship.External dependence refers between project and non-project activity
Relationship.Dependence in the application refers mainly to above-mentioned pressure dependence.
In the present embodiment, in multiple tasks, there is no the task of dependence with other tasks, can regard discrete as
Business；There is the task of dependence with other tasks, can regard dependence task as, and there may be a plurality of masters for each dependence task
It is suitable for task can be regarded as first by arteries and veins and offshoot etc. for first task on each master pulse.Specifically as shown in Fig. 2, being wrapped in Fig. 2
The multiple tasks such as A, B, C, D, E, F, G, H, I are included, wherein A, B, C and other tasks are without dependence, then A, B, C are discrete
Task；D is respectively with E, F there are dependence, and D is first along being task；G, successively there is dependence in H, I, and G is first suitable
For task.
Such as above-mentioned test cell, i.e., discrete tasks and the first cis-position task are concurrently subjected to smoke test, specifically, as above
The multiple tasks such as A, B, C, D, E, F, G, H, the I referred to are stated, first by above-mentioned tri- discrete tasks of A, B, C and D, G two
One cis-position task concurrently carries out smoke test, after the completion of D task, smoke test is carried out to E, F task respectively, when G task is complete
Cheng Hou carries out smoke test to H task, after H task, carries out smoke test to I task.Specifically concurrently triggering can be used
Various ways carry out, for example carry out batch triggering by the dispatching platform of such as linkdo, then this is not repeated.
In one embodiment, above-mentioned big data Framework Software test device, comprising:
Data cell is obtained, for obtaining the corresponding data of each task；
Data scrubbing unit, for clearing up undesirable data according to default script.
Different tasks, the data for carrying out smoke test are different, so first obtaining the data of corresponding task.The side of acquisition
Method includes a variety of, for example is transferred etc. according to preset field into source data.It is above-mentioned to carry out the corresponding data of each task
Undesirable data, are as purged the process of processing by cleaning, and above-mentioned script is to set cleaning rule sentence
Script is such as quantitative value for the data of a certain task, then can specify that the number removed and be greater than specified quantity value, and be less than and refer to
The number etc. of fixed number magnitude.After undesirable data scrubbing, the efficiency of smoke test can be improved.
In one embodiment, above-mentioned big data Framework Software test device, further includes:
First insertion unit, for being transferred into database at the appointed task for completing functional test using default script
The first Data Summary in obtained each first tables of data is managed, and each first Data Summary is inserted into preset comparison sheet
In, wherein first Data Summary includes at least table name, data volume and the runing time of first tables of data；
First insertion unit, for appointed task progress functional test, obtaining each second tables of data again, and
The second Data Summary of second tables of data is obtained using the default script again, and each second Data Summary is inserted
Enter into the comparison sheet；
Comparing unit, for comparing the first Data Summary and the second Data Summary, if the error of the two is within a preset range,
Then determine that the appointed task can be used normally.
In the present embodiment, as the regression test process of big data construction software, the default script finished writing using one are arrived
The first Data Summary of the tables of data that each task obtains when taking functional test is hugged in database, and function then is carried out to each task again
Can property test, obtain each task again treated tables of data, then obtain each number obtained again by presetting script
According to the second Data Summary of table, and the first Data Summary and the second Data Summary are compared, if the two is consistent or error is referring to
Determine in range, then determines that regression test is completed, the appointed task can be used normally.In the present embodiment, carry out again
The data that functional test obtains can override the data that first time functional test obtains.
In one embodiment, above-mentioned big data Framework Software test device further include:
Timing cleaning unit, is used for the interim table of periodic cleaning and dirty data.
In the present embodiment, due to the hive database of Hadoop frame, table is not no major key, so it is big to will cause data
Amount repeats, or the data for being unsatisfactory for condition and will affect result judgement being artificially manually inserted, these data are exactly dirty number
According to.A large amount of interim table can be also established in the task of execution, these interim tables are after using completing, both without other use
On the way, if remained stored in hive database, it will affect test result, and occupy storage resource.In the present embodiment, it can set
A fixed clearance time interval can be set for example, cleaning one in every mistake one week is inferior according to different situations.It is specific clear
The method for managing interim table and dirty data includes writing a cleaning script, is not being repeated herein.
In a specific embodiment, above-mentioned big data Framework Software test device further include:
Recording unit leads to big data frame because data overflow storage unit for recording the big data Framework Software
Structure software frequency out of service；
Dilatation reminding unit generates if being greater than predeterminated frequency value for the frequency and increases storage unit dilatation
Prompting message.
In the present embodiment, in order to improve the stabilization of running environment, biggish storage unit, and because storage can be generally provided
The application of unit is practical, costly, so the storage unit of a moderate amount of storage can be selected, still, with data volume
Situations such as increasing needs to carry out dilatation to storage unit.In the present embodiment, a kind of prompting logic of storage unit dilatation is provided,
In other embodiments, dilatation can also actively be selected with user according to actual use situation.
In other embodiments, can also dilatation be carried out to the computing unit for executing big data Framework Software, to improve big number
According to the stability etc. of test environment.
The big data Framework Software test device of the embodiment of the present application is to be put forward for the first time the framework test side big data Hadoop
Method, there is no relevant test methods before this, can be widely applied in each group in the test of big data project, from
Test environment arranges, and -- smoke test -- functional test -- regression test proposes more novel testing process, improves and surveys
Stability, testing efficiency are tried, sensitive information leakage etc. can also be prevented.
Referring to Fig. 7, a kind of computer equipment is also provided in the embodiment of the present application, which can be server,
Its internal structure can be as shown in Figure 7.The computer equipment includes processor, the memory, network connected by system bus
Interface and database.Wherein, the processor of the Computer Design is for providing calculating and control ability.The computer equipment is deposited
Reservoir includes non-volatile memory medium, built-in storage.The non-volatile memory medium is stored with operating system, computer program
And database.The internal memory provides environment for the operation of operating system and computer program in non-volatile memory medium.It should
The database of computer equipment is for storing the data such as test data table.The network interface of the computer equipment is used for and outside
Terminal passes through network connection communication.To realize a kind of big data Framework Software test side when the computer program is executed by processor
Method.
Above-mentioned processor executes above-mentioned big data Framework Software test method, and wherein big data Framework Software is based on Hadoop
The step of frame, the method are as follows: obtain the test data table for carrying out functional test task needs；Analyze the test data
The attribute of table obtains corresponding data configuration parameter；The data configuration parameter is input in preset data conversion script,
To generate corresponding data configuration order；The data in the test data table are converted according to the data configuration order
Obtain test data；Functional test is carried out using correspondence task of the test data to the big data Framework Software.
In one embodiment, the attribute of the above-mentioned analysis test data table, obtains corresponding data configuration parameter
Step, comprising: judge the test data tableau format, and using judging result as the first constructing variable；Judge described first
The subregion state of the test data table under constructing variable, and using judging result as the second constructing variable；Determine described
Whether there is sensitive data in the test data table under two constructing variables, and using judging result as third constructing variable.
In one embodiment, above-mentioned that the data configuration parameter is input in preset data conversion script, with life
The step of at corresponding data configuration order, comprising: if there are sensitive datas in the third constructing variable, generate to sensitivity
The data configuration order of data progress desensitization process.
In one embodiment, above-mentioned that the data in the test data table are turned according to the data configuration order
The step of getting test data in return, comprising: according to the data configuration order for carrying out desensitization process to sensitive data, to the test
Sensitive data in tables of data desensitizes, and obtains the combined data table combined with desensitization data and nonsensitive data, described
Data in combined data table are the test data being converted to.
In one embodiment, before above-mentioned acquisition carries out the step of test data table of functional test task needs,
It include: to obtain multiple the participating in smoke test of the tasks；Analyze the dependence between each task；Dependence will be present
First cis-position task of each task, and smoke test is concurrently carried out with discrete tasks that other tasks do not have dependence, it will
There is the task of dependence to carry out smoke test according to dependence sequence.
In one embodiment, the first cis-position task of above-mentioned each task that dependence will be present, and with other
The discrete tasks of the not no dependence of business concurrently carry out smoke test, will have the task of dependence to emit according to dependence sequence
Before the step of cigarette is tested, comprising: obtain the corresponding data of each task；According to default script by undesirable data
It is cleared up.
In one embodiment, above-mentioned to be carried out using correspondence task of the test data to the big data Framework Software
After the step of functional test, comprising: transfer the appointed task for completing functional test into database using default script
The first Data Summary in obtained each first tables of data is handled, and each first Data Summary is inserted into preset comparison
In table, wherein first Data Summary includes at least table name, data volume and the runing time of first tables of data；Again
Functional test is carried out to the appointed task, obtains each second tables of data, and again using described in the default script acquisition
Second Data Summary of the second tables of data, and each second Data Summary is inserted into the comparison sheet；Compare the first number
Determine that the appointed task can be used normally if the error of the two is within a preset range with the second Data Summary according to summarizing.
It will be understood by those skilled in the art that structure shown in Fig. 7, only part relevant to application scheme is tied
The block diagram of structure does not constitute the restriction for the computer equipment being applied thereon to application scheme.
The computer equipment of the embodiment of the present application is setting for the execution big data Hadoop framework test method being put forward for the first time
Standby, there is no relevant test methods before this, can be widely applied in each group in the test of big data project, convenient
To big data Hadoop framework test.
One embodiment of the application also provides a kind of computer readable storage medium, is stored thereon with computer program, calculates
Machine program realizes a kind of big data Framework Software test method when being executed by processor, the big data Framework Software is based on
Hadoop frame, which comprises obtain the test data table for carrying out functional test task needs；Analyze the test number
According to the attribute of table, corresponding data configuration parameter is obtained；The data configuration parameter is input to preset data conversion script
In, to generate corresponding data configuration order；The data in the test data table are carried out according to the data configuration order
It is converted to test data；Functional survey is carried out using correspondence task of the test data to the big data Framework Software
Examination.
Above-mentioned big data Framework Software test method is to be put forward for the first time big data Hadoop framework test method, herein it
Preceding there is no relevant test methods, can be widely applied in each group in the test of big data project, convenient to big data
Hadoop framework test.
In one embodiment, the attribute of the above-mentioned analysis test data table, obtains corresponding data configuration parameter
Step, comprising: judge the test data tableau format, and using judging result as the first constructing variable；Judge described first
The subregion state of the test data table under constructing variable, and using judging result as the second constructing variable；Determine described
Whether there is sensitive data in the test data table under two constructing variables, and using judging result as third constructing variable.
In one embodiment, above-mentioned that the data configuration parameter is input in preset data conversion script, with life
The step of at corresponding data configuration order, comprising: if there are sensitive datas in the third constructing variable, generate to sensitivity
The data configuration order of data progress desensitization process.
In one embodiment, above-mentioned that the data in the test data table are turned according to the data configuration order
The step of getting test data in return, comprising: according to the data configuration order for carrying out desensitization process to sensitive data, to the test
Sensitive data in tables of data desensitizes, and obtains the combined data table combined with desensitization data and nonsensitive data, described
Data in combined data table are the test data being converted to.
In one embodiment, before above-mentioned acquisition carries out the step of test data table of functional test task needs,
It include: to obtain multiple the participating in smoke test of the tasks；Analyze the dependence between each task；Dependence will be present
First cis-position task of each task, and smoke test is concurrently carried out with discrete tasks that other tasks do not have dependence, it will
There is the task of dependence to carry out smoke test according to dependence sequence.
In one embodiment, the first cis-position task of above-mentioned each task that dependence will be present, and with other
The discrete tasks of the not no dependence of business concurrently carry out smoke test, will have the task of dependence to emit according to dependence sequence
Before the step of cigarette is tested, comprising: obtain the corresponding data of each task；According to default script by undesirable data
It is cleared up.
In one embodiment, above-mentioned to be carried out using correspondence task of the test data to the big data Framework Software
After the step of functional test, comprising: transfer the appointed task for completing functional test into database using default script
The first Data Summary in obtained each first tables of data is handled, and each first Data Summary is inserted into preset comparison
In table, wherein first Data Summary includes at least table name, data volume and the runing time of first tables of data；Again
Functional test is carried out to the appointed task, obtains each second tables of data, and again using described in the default script acquisition
Second Data Summary of the second tables of data, and each second Data Summary is inserted into the comparison sheet；Compare the first number
Determine that the appointed task can be used normally if the error of the two is within a preset range with the second Data Summary according to summarizing.
Those of ordinary skill in the art will appreciate that realizing all or part of the process in above-described embodiment method, being can be with
Relevant hardware is instructed to complete by computer program, the computer program can be stored in a non-volatile computer
In read/write memory medium, the computer program is when being executed, it may include such as the process of the embodiment of above-mentioned each method.Wherein,
Any reference used in provided herein and embodiment to memory, storage, database or other media,
Including non-volatile and/or volatile memory.Nonvolatile memory may include read-only memory (ROM), programming ROM
(PROM), electrically programmable ROM (EPROM), electrically erasable ROM (EEPROM) or flash memory.Volatile memory may include
Random access memory (RAM) or external cache.By way of illustration and not limitation, RAM is available in many forms,
Such as static state RAM (SRAM), dynamic ram (DRAM), synchronous dram (SDRAM), double speed are according to rate SDRAM (SSRSDRAM), enhancing
Type SDRAM (ESDRAM), synchronization link (Synchlink) DRAM (SLDRAM), memory bus (Rambus) direct RAM
(RDRAM), direct memory bus dynamic ram (DRDRAM) and memory bus dynamic ram (RDRAM) etc..
The foregoing is merely preferred embodiment of the present application, are not intended to limit the scope of the patents of the application, all utilizations
Equivalent structure or equivalent flow shift made by present specification and accompanying drawing content is applied directly or indirectly in other correlations
Technical field, similarly include in the scope of patent protection of the application.
Claims (10)
1. a kind of big data Framework Software test method, which is characterized in that the big data Framework Software is based on Hadoop frame,
The described method includes:
Obtain the test data table for carrying out functional test task needs；
The attribute for analyzing the test data table obtains corresponding data configuration parameter；
The data configuration parameter is input in preset data conversion script, to generate corresponding data configuration order；
The data in the test data table are carried out being converted to test data according to the data configuration order；
Functional test is carried out using correspondence task of the test data to the big data Framework Software.
2. big data Framework Software test method according to claim 1, which is characterized in that the analysis test number
According to the attribute of table, the step of obtaining corresponding data configuration parameter, comprising:
Judge the test data tableau format, and using judging result as the first constructing variable；
Judge the subregion state of the test data table under first constructing variable, and using judging result as the second construction
Parameter；
Determine in the test data table under second constructing variable whether there is sensitive data, and using judging result as
Third constructing variable.
3. big data Framework Software test method according to claim 2, which is characterized in that described by the data configuration
Parameter is input in preset data conversion script, the step of to generate corresponding data configuration order, comprising:
If generating the data configuration for carrying out desensitization process to sensitive data there are sensitive data in the third constructing variable and ordering
It enables.
4. big data Framework Software test method according to claim 3, which is characterized in that described according to the data structure
It makes order and the step of being converted to test data is carried out to the data in the test data table, comprising:
According to the data configuration order for carrying out desensitization process to sensitive data, the sensitive data in the test data table is carried out
Desensitization, obtains the combined data table combined with desensitization data and nonsensitive data, and the data in the combined data table are
The test data being converted to.
5. big data Framework Software test method according to claim 1, which is characterized in that the acquisition carries out functional
Before the step of test data table that test assignment needs, comprising:
Obtain multiple the participating in smoke test of the tasks；
Analyze the dependence between each task；
The first cis-position task of each task of dependence will be present, and do not have the discrete tasks of dependence with other tasks
Smoke test is concurrently carried out, there will be the task of dependence to carry out smoke test according to dependence sequence.
6. big data Framework Software test method according to claim 5, which is characterized in that described that dependence will be present
Each task the first cis-position task, and there is no the discrete tasks of dependence concurrently to carry out smoke test with other tasks,
To have the task of dependence according to dependence sequence carry out smoke test the step of before, comprising:
Obtain the corresponding data of each task；
Undesirable data are cleared up according to default script.
7. big data Framework Software test method according to claim 1, which is characterized in that described to utilize the test number
After the step of carrying out functional test according to the correspondence task to the big data Framework Software, comprising:
Each first tables of data completing the appointed task of functional test and handling is transferred into database using default script
In the first Data Summary, and each first Data Summary is inserted into preset comparison sheet, wherein first data
Summarize table name, data volume and the runing time for including at least first tables of data；
Functional test is carried out to the appointed task again, obtains each second tables of data, and utilizes the default script again
The second Data Summary of second tables of data is obtained, and each second Data Summary is inserted into the comparison sheet；
Compare the first Data Summary and the second Data Summary, if the error of the two is within a preset range, determines described specified
Business can be used normally.
8. a kind of big data Framework Software test device, which is characterized in that the big data Framework Software is based on Hadoop frame,
Described device includes:
Acquiring unit, for obtaining the test data table for carrying out functional test task needs；
Analytical unit obtains corresponding data configuration parameter for analyzing the attribute of the test data table；
Generation unit, for the data configuration parameter to be input in preset data conversion script, to generate corresponding number
It is ordered according to construction；
Converting unit, for carrying out being converted to test to the data in the test data table according to the data configuration order
Data；
Test cell, for carrying out functional survey using correspondence task of the test data to the big data Framework Software
Examination.
9. a kind of computer equipment, including memory and processor, the memory are stored with computer program, feature exists
In the step of processor realizes any one of claims 1 to 7 the method when executing the computer program.
10. a kind of computer readable storage medium, is stored thereon with computer program, which is characterized in that the computer program
The step of method described in any one of claims 1 to 7 is realized when being executed by processor.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810950327.3A CN109189675A (en) | 2018-08-20 | 2018-08-20 | Big data Framework Software test method, device, computer equipment and storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810950327.3A CN109189675A (en) | 2018-08-20 | 2018-08-20 | Big data Framework Software test method, device, computer equipment and storage medium |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN109189675A true CN109189675A (en) | 2019-01-11 |
Family
ID=64918551
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201810950327.3A Pending CN109189675A (en) | 2018-08-20 | 2018-08-20 | Big data Framework Software test method, device, computer equipment and storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN109189675A (en) |
Cited By (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109308258A (en) * | 2018-08-21 | 2019-02-05 | 中国平安人寿保险股份有限公司 | Building method, device, computer equipment and the storage medium of test data |
| CN110109824A (en) * | 2019-04-09 | 2019-08-09 | 平安科技（深圳）有限公司 | Big data automatic regression test method, apparatus, computer equipment and storage medium |
| CN110298328A (en) * | 2019-07-03 | 2019-10-01 | 中国工商银行股份有限公司 | Test data forming method, test data form device, electronic equipment and medium |
| WO2021103621A1 (en) * | 2019-11-25 | 2021-06-03 | 深圳壹账通智能科技有限公司 | Data construction method and apparatus, and computer device and storage medium |
| WO2022205696A1 (en) * | 2021-03-31 | 2022-10-06 | 公安部第三研究所 | Cloud computing big data platform function and interface testing method and system |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20150302040A1 (en) * | 2014-04-18 | 2015-10-22 | International Business Machines Corporation | Enabling testing of production systems without affecting customer data sets system and method |
| CN105320589A (en) * | 2014-07-14 | 2016-02-10 | 上海计算机软件技术开发中心 | Automatic analysis system for testing scripts in cloud testing environments and realization method thereof |
| CN106407843A (en) * | 2016-10-17 | 2017-02-15 | 深圳中兴网信科技有限公司 | Data desensitization method and data desensitization device |
| CN108388515A (en) * | 2018-03-06 | 2018-08-10 | 平安科技（深圳）有限公司 | Test data generating method, device, equipment and computer readable storage medium |
-
2018
- 2018-08-20 CN CN201810950327.3A patent/CN109189675A/en active Pending
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20150302040A1 (en) * | 2014-04-18 | 2015-10-22 | International Business Machines Corporation | Enabling testing of production systems without affecting customer data sets system and method |
| CN105320589A (en) * | 2014-07-14 | 2016-02-10 | 上海计算机软件技术开发中心 | Automatic analysis system for testing scripts in cloud testing environments and realization method thereof |
| CN106407843A (en) * | 2016-10-17 | 2017-02-15 | 深圳中兴网信科技有限公司 | Data desensitization method and data desensitization device |
| CN108388515A (en) * | 2018-03-06 | 2018-08-10 | 平安科技（深圳）有限公司 | Test data generating method, device, equipment and computer readable storage medium |
Cited By (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109308258A (en) * | 2018-08-21 | 2019-02-05 | 中国平安人寿保险股份有限公司 | Building method, device, computer equipment and the storage medium of test data |
| CN110109824A (en) * | 2019-04-09 | 2019-08-09 | 平安科技（深圳）有限公司 | Big data automatic regression test method, apparatus, computer equipment and storage medium |
| CN110298328A (en) * | 2019-07-03 | 2019-10-01 | 中国工商银行股份有限公司 | Test data forming method, test data form device, electronic equipment and medium |
| CN110298328B (en) * | 2019-07-03 | 2021-08-20 | 中国工商银行股份有限公司 | Test data forming method, test data forming apparatus, electronic device, and medium |
| WO2021103621A1 (en) * | 2019-11-25 | 2021-06-03 | 深圳壹账通智能科技有限公司 | Data construction method and apparatus, and computer device and storage medium |
| WO2022205696A1 (en) * | 2021-03-31 | 2022-10-06 | 公安部第三研究所 | Cloud computing big data platform function and interface testing method and system |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN109189675A (en) | Big data Framework Software test method, device, computer equipment and storage medium | |
| Xin et al. | Production machine learning pipelines: Empirical analysis and optimization opportunities | |
| Van Der Aalst | Process discovery from event data: Relating models and logs through abstractions | |
| Yamashita et al. | Do code smells reflect important maintainability aspects? | |
| US20130024167A1 (en) | Computer-Implemented Systems And Methods For Large Scale Automatic Forecast Combinations | |
| van der Aalst | Foundations of process discovery | |
| Bayomie et al. | Deducing case IDs for unlabeled event logs | |
| Verbeek et al. | Merging alignments for decomposed replay | |
| van Cruchten et al. | Process mining in logistics: The need for rule-based data abstraction | |
| van Eck et al. | Guided interaction exploration and performance analysis in artifact-centric process models | |
| Yan et al. | Generating process model collections | |
| Janczarek et al. | Investigating software testing and maintenance reports: Case study | |
| Ali et al. | A hybrid DevOps process supporting software reuse: A pilot project | |
| Vieira et al. | How explicit risk management is being integrated into agile methods: results from a systematic literature mapping | |
| Pegoraro et al. | Uncertain case identifiers in process mining: A user study of the event-case correlation problem on click data | |
| van Angeren et al. | Exploring the relationship between partnership model participation and interfirm network structure: An analysis of the office365 ecosystem | |
| Singla et al. | Analysis of software engineering for agile machine learning projects | |
| Fellmann et al. | Analysis of Business Process Model Reuse Literature: Are Research Concepts Empirically Validated? | |
| Pegoraro et al. | Resolving uncertain case identifiers in interaction logs: A user study | |
| Céspedes-González et al. | Design of an analysis guide for user-centered process mining projects | |
| Cerone | Model mining: Integrating data analytics, modelling and verification | |
| Cacciabue | Dynamic reliability and human factors for safety assessment of technological systems: a modern science rooted in the origin of mankind | |
| Hidayat et al. | Process model extension using heuristics miner:(Case study: Incident management of Volvo IT Belgium) | |
| Taylor et al. | A provenance maturity model | |
| Vasilecas et al. | Directed acyclic graph extraction from event logs |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |