CN102054043A - Method and device for generating big data - Google Patents

Method and device for generating big data Download PDF

Info

Publication number
CN102054043A
CN102054043A CN 201010616453 CN201010616453A CN102054043A CN 102054043 A CN102054043 A CN 102054043A CN 201010616453 CN201010616453 CN 201010616453 CN 201010616453 A CN201010616453 A CN 201010616453A CN 102054043 A CN102054043 A CN 102054043A
Authority
CN
China
Prior art keywords
data
tables
big data
field
sql statement
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN 201010616453
Other languages
Chinese (zh)
Inventor
黄海峰
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
CHANJET SOFTWARE Co Ltd
Original Assignee
CHANJET SOFTWARE Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by CHANJET SOFTWARE Co Ltd filed Critical CHANJET SOFTWARE Co Ltd
Priority to CN 201010616453 priority Critical patent/CN102054043A/en
Publication of CN102054043A publication Critical patent/CN102054043A/en
Pending legal-status Critical Current

Links

Images

Landscapes

  • Debugging And Monitoring (AREA)
  • Information Retrieval, Db Structures And Fs Structures Therefor (AREA)

Abstract

The invention provides a method for generating big data. The method comprises the following steps: step 102, acquiring the structured query language (sql) sentence corresponding to service operation when a product carries out service operation on a database; step 104, analyzing the data sheet in the sql sentence and the field and field value in the data sheet; and step 106, generating the big data according to the data sheet as well as the field and field value in the data sheet to test the product. The invention also provides a device for generating the big data. By adopting the method and the device, the sql sentence is analyzed to generate the big data, thus ensuring the validity and generating efficiency of the big data.

Description

Big data creation method and device
Technical field
The present invention relates to the database application field, in particular to a kind of big data creation method and device.
Background technology
When properties of product or efficiency test, generating big data is things that waste time and energy.Current a lot of third party's instruments, all at database, the quality of data is not ideal, and infosystem databank of product table is many, data relationship is intricate, and providing big data at product all is to have some a dot generation by each developer by existing business logic codes.The shortcoming of current big data Core Generator is as follows:
1, a large amount of third party's data Core Generator all is directly at data manipulation, and the quality of data is undesirable;
2, for the quality of data, the tester relies on the developer substantially and does big data, and the big data of product generate is generally done labor intensive, inefficiency by writing code logic by product development;
3, by product business logic codes mode, the logic complexity, it is low that database is carried out efficient, and the execution time that generate mass data is very long
When 4, third party's instrument generation data are made mistakes, be difficult to review error reason, the more hard to say debugging.
Therefore, need a kind of mode of new big data of generation, can guarantee the quick generation of big data, can guarantee the validity of big data again.
Summary of the invention
Problem to be solved by this invention is, needs a kind of mode of new big data of generation, can guarantee the quick generation of big data, can guarantee the validity of big data again.
In view of this, a kind of big data creation method of the present invention comprises: step 102, when product carries out business operation to database, gather the sql statement of described business operation correspondence; Step 104 parses the tables of data in the described sql statement, field, the field value in the described tables of data; Step 106 according to field, the field value in described tables of data, the described tables of data, generates big data to be used for the test of described product.By this technical scheme, the sql statement analyzed generate big data, can guarantee the validity and the formation efficiency of big data.
In technique scheme, preferably, in described step 104, from described database, obtain the field in described tables of data, the described tables of data, other tables of data of field value association, field, the field value in described other tables of data; In described step 106, also, generate described big data according to field, field value in described other tables of data, described other tables of data.
In technique scheme, preferably, in described step 106, utilize described sql statement, described big data are injected described database, to be used for the test of described product.
In technique scheme, preferably, among described step 106, according to relation generating code automatically between tables of data, field, field value, the tables of data, can be to the code editor, and code compile can be generated dll or exe, to carry out the big data of generation.
In technique scheme, preferably, in described step 102, also described sql statement is edited.
In technique scheme, preferably, in described step 102, from the journal file of described product, gather described sql statement.
The present invention also provides a kind of big data generating device, comprising: acquisition module, when product carries out business operation to database, gather the sql statement of described business operation correspondence; Parsing module parses the tables of data in the described sql statement, field, the field value in the described tables of data; Big data generation module according to field, the field value in described tables of data, the described tables of data, generates big data to be used for the test of described product.By this technical scheme, the sql statement analyzed generate big data, can guarantee the validity and the formation efficiency of big data.
In technique scheme, preferably, described parsing module also obtains the field in described tables of data, the described tables of data, other tables of data of field value association, field, the field value in described other tables of data from described database; Described big data generation module also according to field, field value in described other tables of data, described other tables of data, generates described big data.
In technique scheme, preferably, described big data generation module is utilized described sql statement, and described big data are injected described database, to be used for the test of described product.
In technique scheme, preferably, described big data generation module can be according to relation generating code automatically between tables of data, field, field value, the tables of data, can be to the code editor, and code compile can be generated dll or exe, generate big data to carry out.
In technique scheme, preferably, also comprise: user's adjusting module, for the user described sql statement is edited.
In technique scheme, preferably, described acquisition module is gathered described sql statement from the journal file of described product.
By technical scheme of the present invention, can realize a kind of big data creation method and device, can generate big data automatically by analyzing the field of sql statement, both guaranteed to generate the efficient of big data, guaranteed the validity of the big data of generation again.
Description of drawings
Fig. 1 is the process flow diagram of big data creation method according to an embodiment of the invention;
Fig. 2 is the block diagram of big data generating device according to an embodiment of the invention;
Fig. 3 is the workflow diagram of big data generating device according to an embodiment of the invention.
Embodiment
In order more to be expressly understood above-mentioned purpose of the present invention, feature and advantage, the present invention is further described in detail below in conjunction with the drawings and specific embodiments.
Set forth a lot of details in the following description so that fully understand the present invention, still, the present invention can also adopt other to be different from other modes described here and implement, and therefore, the present invention is not limited to the restriction of following public specific embodiment.
Fig. 1 is the process flow diagram of big data creation method according to an embodiment of the invention.
As shown in Figure 1, a kind of big data creation method of the present invention comprises: step 102, when product carries out business operation to database, gather the sql statement of described business operation correspondence; Step 104 parses the tables of data in the described sql statement, field, the field value in the described tables of data; Step 106 according to field, the field value in described tables of data, the described tables of data, generates big data to be used for the test of described product.By this technical scheme, the sql statement analyzed generate big data, can guarantee the validity and the formation efficiency of big data.
In technique scheme, in described step 104, from described database, obtain the field in described tables of data, the described tables of data, other tables of data of field value association, field, the field value in described other tables of data; In described step 106, also, generate described big data according to field, field value in described other tables of data, described other tables of data.
In technique scheme, in described step 106, utilize described sql statement, described big data are injected described database, to be used for the test of described product.
In technique scheme, among described step 106, according to relation generating code automatically between tables of data, field, field value, the tables of data, can be to the code editor, and code compile can be generated dll or exe, to carry out the big data of generation.
In technique scheme, in described step 102, also described sql statement is edited.
In technique scheme, in described step 102, from the journal file of described product, gather described sql statement.
Fig. 2 is the block diagram of big data generating device according to an embodiment of the invention;
As shown in Figure 2, the present invention also provides a kind of big data generating device 200, comprising: acquisition module 202, when product carries out business operation to database, gather the sql statement of described business operation correspondence; Parsing module 204 parses the tables of data in the described sql statement, field, the field value in the described tables of data; Big data generation module 206 according to field, the field value in described tables of data, the described tables of data, generates big data to be used for the test of described product.By this technical scheme, the sql statement analyzed generate big data, can guarantee the validity and the formation efficiency of big data.
In technique scheme, described parsing module 204 also obtains the field in described tables of data, the described tables of data, other tables of data of field value association, field, the field value in described other tables of data from described database; Described big data generation module 206 also according to field, field value in described other tables of data, described other tables of data, generates described big data.
In technique scheme, described big data generation module 206 is utilized described sql statement, and described big data are injected described database, to be used for the test of described product.
In technique scheme, preferably, described big data generation module 206 can be according to relation generating code automatically between tables of data, field, field value, the tables of data, can be to the code editor, and code compile can be generated dll or exe, generate big data to carry out.
In technique scheme, also comprise: user's adjusting module 208, for the user described sql statement is edited.
In technique scheme, described acquisition module 202 is gathered described sql statement from the journal file of described product.
Fig. 3 is the workflow diagram of big data generating device according to an embodiment of the invention.
As shown in Figure 3, step 302, specified database connects and the product operating path: database is for needing to generate the object of big data, and also can be as required during the data generation from then on database find the data of quoting and enumerate.
Step 304, acquisition module is gathered the sql statement.After operating path was specified, the acquisition module of the big data generating device in the present embodiment can collect the sql statement of generation from product.The current collection source of acquisition module is the product journal file.When the user confirms to begin to gather the sql statement, the acquisition module opening entry is gathered the start time point, after certain business operation is finished in the product, record acquisition concluding time point, and read the sql statement that takes place during this period of time from daily record, these sql of collection are exactly a complete business operation.
Step 306, the user adjusts the sql statement.After the acquisition module collection was finished, the user can directly increase, delete, change the sql statement by user's adjusting module.Some adjustment can be done in the sql statement, but need not adjust substantially in actual applications.
Step 308 is resolved the sql statement of gathering by parsing module.The key of parsing module is the parametrization code, in this process, parsing module will be analyzed each sql statement, resolve into field and table, and carrying out context variable handles, in this process, instrument also can find out the incidence relation (associate field) of these tables from database, metadata, enumerates data etc.
Step 310, generating code, go forward side by side edlin and compiling.Finish the generation of whole sql code according to big data generation module, the code of generation is done context variable, auto-associating, randomization code automatically, enumerates data, circular treatment etc.After code generated, the user can also directly revise the code that generates.
Step 312 generates big data.Behind the code that big data generation module generates, the process of compiling is that the code that will generate becomes the dll that can be carried out by actuator, can directly carry out after compiling is finished and generate big data.
Wherein, in order to satisfy more complicated logic Modification, the big data generating device in the present embodiment also provides more powerful code editor and bad debug ability, or also code directly can be generated a control desk project.Its compiling can be generated an Exe program.The user carries out the Exe program and promptly begins to generate big data.
By above technical scheme, the present invention can realize a kind of big data creation method and device, can generate big data efficiently, and has guaranteed the validity of big data, has saved manpower and materials, helps to increase work efficiency.
The above is the preferred embodiments of the present invention only, is not limited to the present invention, and for a person skilled in the art, the present invention can have various changes and variation.Within the spirit and principles in the present invention all, any modification of being done, be equal to replacement, improvement etc., all should be included within protection scope of the present invention.

Claims (10)

1. a big data creation method is characterized in that, comprising:
Step 102 when product carries out business operation to database, is gathered the sql statement of described business operation correspondence;
Step 104 parses the tables of data in the described sql statement, field, the field value in the described tables of data;
Step 106 according to field, the field value in described tables of data, the described tables of data, generates big data to be used for the test of described product.
2. big data creation method according to claim 1, it is characterized in that, in described step 104, from described database, obtain the field in described tables of data, the described tables of data, other tables of data of field value association, field, the field value in described other tables of data;
In described step 106, also, generate described big data according to field, field value in described other tables of data, described other tables of data.
3. big data creation method according to claim 1 is characterized in that, in described step 106, utilizes described sql statement, described big data is injected described database, to be used for the test of described product.
4. big data creation method according to claim 1 is characterized in that, in described step 102, also described sql statement is edited.
5. according to each described big data creation method in the claim 1 to 4, it is characterized in that, in described step 102, from the journal file of described product, gather described sql statement.
6. a big data generating device is characterized in that, comprising:
Acquisition module when product carries out business operation to database, is gathered the sql statement of described business operation correspondence;
Parsing module parses the tables of data in the described sql statement, field, the field value in the described tables of data;
Big data generation module according to field, the field value in described tables of data, the described tables of data, generates big data to be used for the test of described product.
7. big data generating device according to claim 6, it is characterized in that described parsing module also obtains the field in described tables of data, the described tables of data, other tables of data of field value association, field, the field value in described other tables of data from described database;
Described big data generation module also according to field, field value in described other tables of data, described other tables of data, generates described big data.
8. big data generating device according to claim 6 is characterized in that, described big data generation module is utilized described sql statement, and described big data are injected described database, to be used for the test of described product.
9. big data generating device according to claim 6 is characterized in that, also comprises:
User's adjusting module is edited described sql statement for the user.
10. according to each described big data generating device in the claim 6 to 9, it is characterized in that described acquisition module is gathered described sql statement from the journal file of described product.
CN 201010616453 2010-12-30 2010-12-30 Method and device for generating big data Pending CN102054043A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN 201010616453 CN102054043A (en) 2010-12-30 2010-12-30 Method and device for generating big data

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN 201010616453 CN102054043A (en) 2010-12-30 2010-12-30 Method and device for generating big data

Publications (1)

Publication Number Publication Date
CN102054043A true CN102054043A (en) 2011-05-11

Family

ID=43958365

Family Applications (1)

Application Number Title Priority Date Filing Date
CN 201010616453 Pending CN102054043A (en) 2010-12-30 2010-12-30 Method and device for generating big data

Country Status (1)

Country Link
CN (1) CN102054043A (en)

Cited By (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103092867A (en) * 2011-11-03 2013-05-08 中国移动通信集团甘肃有限公司 Method and system for managing data, and data analyzing device
CN103729361A (en) * 2012-10-12 2014-04-16 百度在线网络技术（北京）有限公司 Method and device for testing performance of database
WO2014114112A1 (en) * 2013-01-24 2014-07-31 华为技术有限公司 Data generation method and device
CN104239537A (en) * 2014-09-22 2014-12-24 国云科技股份有限公司 Method for realizing generating and processing flow for large-data pre-processing text data
CN105589803A (en) * 2014-10-24 2016-05-18 阿里巴巴集团控股有限公司 Method and terminal device for generating test tool
CN105590279A (en) * 2015-12-15 2016-05-18 温州大学 Unity 3D technology-based indoor decoration virtual practice teaching system and processing method thereof
CN107346312A (en) * 2016-05-05 2017-11-14 中国移动通信集团内蒙古有限公司 A kind of big data processing method and system
CN111625458A (en) * 2020-05-27 2020-09-04 泰康保险集团股份有限公司 Service system testing method, device and equipment
CN113726787A (en) * 2021-08-31 2021-11-30 中国平安人寿保险股份有限公司 SQL injection generation method, device, equipment and storage medium

Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1503168A (en) * 2002-11-22 2004-06-09 深圳市中兴通讯股份有限公司 Automatic test method for system products
CN101000615A (en) * 2006-12-31 2007-07-18 华为技术有限公司 Service processing method and device based on data base

Patent Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1503168A (en) * 2002-11-22 2004-06-09 深圳市中兴通讯股份有限公司 Automatic test method for system products
CN101000615A (en) * 2006-12-31 2007-07-18 华为技术有限公司 Service processing method and device based on data base

Cited By (14)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103092867B (en) * 2011-11-03 2017-02-01 中国移动通信集团甘肃有限公司 Method and system for managing data, and data analyzing device
CN103092867A (en) * 2011-11-03 2013-05-08 中国移动通信集团甘肃有限公司 Method and system for managing data, and data analyzing device
CN103729361A (en) * 2012-10-12 2014-04-16 百度在线网络技术（北京）有限公司 Method and device for testing performance of database
CN103970738B (en) * 2013-01-24 2017-08-29 华为技术有限公司 A kind of method and apparatus for producing data
CN103970738A (en) * 2013-01-24 2014-08-06 华为技术有限公司 Method and device for generating data
WO2014114112A1 (en) * 2013-01-24 2014-07-31 华为技术有限公司 Data generation method and device
CN104239537A (en) * 2014-09-22 2014-12-24 国云科技股份有限公司 Method for realizing generating and processing flow for large-data pre-processing text data
CN104239537B (en) * 2014-09-22 2017-07-07 国云科技股份有限公司 A kind of big data preprocessed text data genaration handling process implementation method
CN105589803A (en) * 2014-10-24 2016-05-18 阿里巴巴集团控股有限公司 Method and terminal device for generating test tool
CN105589803B (en) * 2014-10-24 2018-12-28 阿里巴巴集团控股有限公司 A kind of generation method and terminal device of testing tool
CN105590279A (en) * 2015-12-15 2016-05-18 温州大学 Unity 3D technology-based indoor decoration virtual practice teaching system and processing method thereof
CN107346312A (en) * 2016-05-05 2017-11-14 中国移动通信集团内蒙古有限公司 A kind of big data processing method and system
CN111625458A (en) * 2020-05-27 2020-09-04 泰康保险集团股份有限公司 Service system testing method, device and equipment
CN113726787A (en) * 2021-08-31 2021-11-30 中国平安人寿保险股份有限公司 SQL injection generation method, device, equipment and storage medium

Similar Documents

Publication Publication Date Title
CN102054043A (en) Method and device for generating big data
CN109739766B (en) System and method for rapidly building FPGA digital simulation model
CN104317589B (en) A kind of code automatic generation method and device for being used to load dynamic link library
CN101383871B (en) Network element configuration implementing method and apparatus
CN101526917B (en) Method for reproducing test scripts based on data drive
CN102117202B (en) J2EE architecture-based code generating device
EP2498178A1 (en) Method and device for development environment converting
US20050144177A1 (en) Patent analysis and formulation using ontologies
CN101996131A (en) Automatic test method and automatic test platform for graphic user interface (GUI) based on x extensive makeup language (XML) packaging key word
CN112989782A (en) Method for automatic template configuration and report generation
CN105068812B (en) A kind of list generation method and device
CN110020021B (en) Visualization-based data stream processing method
CN103034940A (en) Method and system for automatic analysis report generation
CN105242914A (en) Model driven code generation method and system
CN112163420A (en) NLP technology-based RPA process automatic generation method
CN104572238A (en) Method and system for generating executable software package efficiently
CN101183332A (en) Method and device for automatically generating testing datasets by program content
CN109933770A (en) A kind of test report generation method, system and electronic equipment and storage medium
CN109614079A (en) A kind of coding rule inspection system towards avionics field
CN102521008A (en) Program compiling device and method for compiling program
CN109086985B (en) Professional test information management system for spacecraft assembly
CN106383734A (en) Method for extracting detailed design from codes
CN114372118A (en) Audit knowledge recommendation system and method based on recursive algorithm
TWI402705B (en) Method and tool for generating simulation case for ic device
CN104090748B (en) Source code based on Makefile simplifies the method that device carries out simplifying source code

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
C53 Correction of patent for invention or patent application
CB02 Change of applicant information

Address after: 100094 Beijing city Haidian District North Road No. 68, UFIDA Software Park

Applicant after: Chanjet Information Technology Co., Ltd.

Address before: 100094 Beijing city Haidian District North Road No. 68, UFIDA Software Park

Applicant before: Chanjet Software Co., Ltd.

COR Change of bibliographic data

Free format text: CORRECT: APPLICANT; FROM: CHANJET SOFTWARE CO., LTD. TO: CHANJET INFORMATION TECHNOLOGY CO., LTD.

C12 Rejection of a patent application after its publication
RJ01 Rejection of invention patent application after publication

Application publication date: 20110511