WO2015081724A1

WO2015081724A1 - Data generation method and apparatus

Info

Publication number: WO2015081724A1
Application number: PCT/CN2014/084621
Authority: WO
Inventors: 边旭; 贾西贝
Original assignee: 深圳市华傲数据技术有限公司
Priority date: 2013-12-04
Filing date: 2014-08-18
Publication date: 2015-06-11
Also published as: CN104252660A; CN104252660B

Abstract

Provided is a data generation method, comprising: acquiring a data sequence of a same attribute in a database; generating a data rule according to the data sequence on the basis of a preset rule; and generating missing data in the data sequence according to the data rule. An embodiment further provides a corresponding apparatus. In the embodiment, a data rule of a current data sequence is computed, and the current data sequence is completed according to the data rule, thereby implementing a function of automatically completing missing data.

Description

Data generation method and device

Technical field

The present application relates to the field of data processing technologies, and in particular, to a data generating method and apparatus.

Background technique

The automatic generation of data has a wide range of applications in data leak detection, data repair and software testing. But the common way of generating data is too dependent on the dependency on user-defined rules. On the other hand, the representation of common actual data is often synonymous and different. For example, "1st floor 1st" And "1st floor 2" is actually the same type of expression, but it is expressed in the form of "layer" and "floor" respectively. This makes it difficult to capture the rules of existing data before the generation of automated data.

Summary of the invention

The technical problem to be solved by the present application is to provide a data generating method and apparatus that can automatically fill in vacancy data.

In order to solve the above problems, the present application discloses a data generating method, including:

Obtaining the same attribute data sequence in the database;

Generating a data rule according to the preset rule according to the data sequence;

Generating the data sequence vacancy data according to the data rule.

Further, after the generating the data sequence hollow data according to the data rule, the method further includes:

Adding a predetermined identification to the vacancy data.

Further, the generating the data rule according to the preset rule according to the data sequence includes:

Splitting data in a data sequence into at least one family;

For each family, calculate the upper and lower boundaries Vi (value range);

Then the values of each family are intersected to form a new data set U;

The order of the data set U is used as a data rule.

Further, the generating the data sequence hollow data according to the data rule includes:

Finding a complement N of the current data sequence and the data set U according to the data rule;

The complement N is used as vacancy data.

The application also provides a data generating device, including:

a data acquisition module, configured to acquire a sequence of the same attribute data in the database;

a rule generating module, configured to generate a data rule according to the preset rule according to the data sequence;

And a data generating module, configured to generate the data sequence hollow data according to the data rule.

Further, the device further includes:

An identification module, configured to add a predetermined identifier to the vacancy data.

Further, the rule generating module further includes:

a splitting module for splitting data in a data sequence into at least one family;

a range calculation module for calculating the upper and lower boundaries Vi (value range) for each family;

a set calculation module, which is used to intersect the value ranges of each family to form a new data set U;

A rule generation submodule is used to utilize the order of the data set U as a data rule.

Further, the data generating module is further configured to:

The complement N is used as vacancy data.

Compared with the prior art, the present application includes the following advantages: by calculating the data rule of the current data sequence, the current data sequence is complemented according to the data rule, and the function of automatically filling the vacancy data is realized.

DRAWINGS

1 is a flow chart of an embodiment of a data generating method according to the present invention;

2 is a schematic structural diagram of an embodiment of a data generating apparatus according to the present invention.

detailed description

The above described objects, features and advantages of the present application will become more apparent and understood.

Referring to FIG. 1, a data generating method of the present application is shown, including:

Step S101: Acquire a sequence of the same attribute data in the database;

A data sequence with the same attribute may be stored in the database, for example, the house number is arranged in the form of data in the form of Building A. All data in the database is extracted from the data sequence of the house number (which can be the house number of a particular cell).

Step S102: Generate a data rule according to the preset rule according to the data sequence;

Splitting data in a data sequence into at least one family;

For each family, calculate the upper and lower boundaries Vi (value range);

Then the values of each family are intersected to form a new data set U;

The order of the data set U is used as a data rule.

In step S102, it is assumed that the existing data have the same family Si, i= 0,1,2...n distribution. Then the "minimum coverage" algorithm can be described as follows: For each family, its upper and lower boundaries Vi (value range) are calculated separately. Then the values of each family are intersected to form a new data set U. The part of U's existing data in Central Africa is the newly generated data.

For example, suppose the following three data samples {1A3, 2A1, 3B3}, the division of the family is distinguished by numbers and letters, and the numerical changes of each family follow its own rules: that is, the number increases according to the natural number, and the letters are increased by A-Z. Then, the family distribution of the above samples is {natural number + letter + natural number}, and the upper and lower limits of the three families are [1, 3], [A, B], and [1, 3], respectively. The intersection of the ranges will result in the following data set U:

{1A1,1A2,1A3,1B1,1B2,1B3,2A1,2A2,2A3,2B1,2B2,2B3,3A1,3A2,3A3,3B1,3B2,3B3}

The minimum coverage algorithm takes the range of the existing data of each family as the upper and lower boundaries of the data, so the generated data set is a smaller extension based on the existing data. But here is just a viable way to generate data, not the only way.

Step S103: Generate the data sequence hollow data according to the data rule.

Adding a predetermined identification to the vacancy data.

The complement N is used as vacancy data.

If the data of the house number of a certain cell is obtained in step S101 (A building No. 01, A building No. 03, A building No. 04, B building No. 01, B building No. 02, D building No. 15); through step S102 The data set U that can be calculated (A building 01, A building 02... A building No. 15, B building No. 01 ... B building No. 15, C building No. 01 ... C building No. 15), original data sequence The complement N between the data set U and the data set U is the vacancy data.

The embodiment of the invention implements the function of automatically filling up the vacancy data by calculating the data rule of the current data sequence and filling the current data sequence according to the data rule.

The data generating apparatus provided by the application includes:

The data obtaining module 21 is configured to acquire a sequence of the same attribute data in the database;

The rule generating module 22 is configured to generate a data rule according to the preset rule according to the data sequence;

The data generating module 23 is configured to generate the data sequence hollow data according to the data rule.

Further, the device further includes:

The identification module 24 is configured to add a predetermined identifier to the vacancy data.

Further, the rule generating module 22 further includes:

a splitting module 221, configured to split data in the data sequence into at least one family;

The value domain calculation module 222 is configured to calculate the upper and lower boundaries Vi (value range) for each family;

The set calculation module 223 is configured to intersect the value ranges of each family to form a new data set U;

The rule generation sub-module 224 is configured to utilize the order of the data set U as a data rule.

Further, the data generating module 23 is further configured to:

The complement N is used as vacancy data.

Suppose there are three data samples {1A3, 2A1, 3B3}, the division of the family is distinguished by numbers and letters, and the numerical changes of each family follow its own rules: that is, the number increases according to the natural number, and the letters are increased by A-Z. Then, the rule generation module 22 calculates that the family distribution of the sample is {natural number + letter + natural number}, and the upper and lower limits of the three families are [1, 3], [A, B], and [1, 3], respectively. The intersection of the ranges will result in the following data set U:

{1A1,1A2,1A3,1B1,1B2,1B3,2A1,2A2,2A3,2B1,2B2,2B3,3A1,3A2,3A3,3B1,3B2,3B3}

The rule generation module 22 uses the minimum coverage algorithm to take the range of the existing data of each family as the upper and lower boundaries of the data, so the generated data set is a smaller extension based on the existing data. But here is just a viable way to generate data, not the only way.

If the data acquisition module 21 acquires the housing number data sequence of a certain cell (A building No. 01, A building No. 03, A building No. 04, B building No. 01, B building No. 02, D building No. 15); rule generation Module 22 can calculate the data set U (A building No. 01, A building No. 02 ... A building No. 15, B building No. 01 ... B building No. 15, C building No. 01 ... C building No. 15), data The generating module 23 takes the complement N between the original data sequence and the data set U, that is, the vacancy data.

For the device embodiment, since it is basically similar to the method embodiment, the description is relatively simple, and the relevant parts can be referred to the description of the method embodiment.

The various embodiments in the present specification are described in a progressive manner, and each embodiment focuses on differences from other embodiments, and the same similar parts between the various embodiments can be referred to each other.

The above is a further detailed description of the present invention in connection with the specific preferred embodiments, and the specific embodiments of the present invention are not limited to the description. A number of simple derivations or substitutions may be made by those skilled in the art without departing from the inventive concept.

Claims

A data generating method, comprising:

Obtaining the same attribute data sequence in the database;

Generating a data rule according to the preset rule according to the data sequence;

Generating the data sequence vacancy data according to the data rule.
The method according to claim 1, wherein the generating the data sequence hollow data according to the data rule further comprises:

Adding a predetermined identification to the vacancy data.
The method according to claim 2, wherein the generating the data rule according to the preset rule according to the data sequence comprises:

Splitting data in a data sequence into at least one family;

For each family, calculate the upper and lower boundaries Vi (value range);

Then the values of each family are intersected to form a new data set U;

The order of the data set U is used as a data rule.
The method according to claim 3, wherein the generating the data sequence vacancy data according to the data rule comprises:

Finding a complement N of the current data sequence and the data set U according to the data rule;

The complement N is used as vacancy data.
A data generating device, comprising:

a data acquisition module, configured to acquire a sequence of the same attribute data in the database;

a rule generating module, configured to generate a data rule according to the preset rule according to the data sequence;

And a data generating module, configured to generate the data sequence hollow data according to the data rule.
The device according to claim 5, wherein the device further comprises:

An identification module, configured to add a predetermined identifier to the vacancy data.
The device according to claim 6, wherein the rule generating module further comprises:

a splitting module for splitting data in a data sequence into at least one family;

a range calculation module for calculating the upper and lower boundaries Vi (value range) for each family;

a set calculation module, which is used to intersect the value ranges of each family to form a new data set U;

A rule generation submodule is used to utilize the order of the data set U as a data rule.
The device according to claim 7, wherein the data generating module is further configured to:

Finding a complement N of the current data sequence and the data set U according to the data rule;

The complement N is used as vacancy data.