CN111597232A - A data mining method and system - Google Patents

Abstract

The invention discloses a data mining method and a system thereof, wherein the method comprises the following steps: s1, outputting corresponding key phrases based on the data mining requirements; s2, generating an associated phrase of each keyword phrase, wherein the associated phrase consists of the keyword phrases, the keyword opposite phrase, the keyword similar phrase and the keyword associated phrase; s3, constructing a data mining model based on the keyword group, the keyword opposite group, the keyword similar group and the keyword related group; and S4, mining the target data based on the Hadoop running data mining model. The invention realizes the high-precision and high-efficiency mining of the target data.

Description

A data mining method and system

technical field

The invention relates to the field of data mining, in particular to a data mining method and system.

Background technique

At present, with the widening of computer and network applications and the increasing variety of business types in different fields, different types of objects are effectively mined from massive data records related to specific objects in order to implement different processing for different types of objects. Programs are becoming more and more important.

In the existing technical solution, the target objects are usually classified according to one or more attribute data associated with the target object, that is, the target object is classified based on the value of one or some specific attribute data of each target object. sort.

However, the existing technical solutions have the following problems: since the target object is only classified based on a single or several attribute data, the accuracy of the classification result is low, and since the attribute data of each target object needs to be evaluated the same operation, so the efficiency of data mining is low.

SUMMARY OF THE INVENTION

In order to solve the above problems, the present invention provides a data mining method and system, which realizes high-precision and high-efficiency mining of target data.

To achieve the above object, the technical scheme adopted in the present invention is:

A data mining method, comprising the following steps:

S1. Output corresponding keyword groups based on data mining requirements;

S2, generating an associated phrase of each keyword group, and the associated phrase is composed of a keyword group, a keyword opposite phrase, a keyword similar phrase, and a keyword associated phrase;

S3. Construct a data mining model based on keyword groups, keyword opposite phrases, keyword similar phrases, and keyword associated phrases;

S4. Run the data mining model based on Hadoop to realize target data mining.

Further, in the step S1, the acquisition of the keyword group is realized based on the CCIPCA algorithm.

Further, in the step S2, keyword groups, keyword opposite phrases, keyword similar phrases, and keyword associated phrases are implemented based on the Inception V3 deep neural network model.

Further, the step S3 constructs a keyword group mining model, a keyword opposite phrase mining model, a keyword similar phrase mining model and a keyword associated phrase respectively according to the keyword group, the keyword opposite phrase, the keyword similar phrase, and the keyword associated phrase. Mining models.

Further, in the step S4, a keyword group mining model, a keyword opposite phrase mining model, a keyword similar phrase mining model and a keyword associated phrase mining model are simultaneously run based on Hadoop to mine the target data.

The present invention also provides a data mining system, comprising:

The keyword group generation module is used to generate corresponding keyword groups based on data mining requirements;

an associated phrase generation module, configured to generate a corresponding associated phrase based on the keyword group, where the associated phrase is composed of a keyword group, a keyword opposite phrase, a keyword similar phrase, and a keyword associated phrase;

A data mining model building module is used to build a data mining model based on keyword groups, keyword opposite phrases, keyword similar phrases, and keyword associated phrases;

The data mining module is used to run the data mining model based on Hadoop to realize the target data mining

Further, the associated phrase generation module constructs the keyword group mining model, the keyword opposite phrase mining model, the keyword similar phrase mining model and the keyword association according to the keyword group, the keyword opposite phrase, the keyword similar phrase, and the keyword associated phrase. Phrase mining model;

Further, the data mining module simultaneously runs the keyword group mining model, the keyword opposite phrase mining model, the keyword similar phrase mining model and the keyword associated phrase mining model based on Hadoop to mine the target data, and each data mining model excavates the target data. The target data corresponds to a database.

The present invention has the following beneficial effects:

Extract keyword groups based on CCIPCA algorithm, realize keyword group, keyword opposite phrase, keyword similar phrase, keyword related phrase based on Inception V3 deep neural network model, and then realize keyword group and keyword opposite based on Inception V3 deep neural network model The keyword group mining model, keyword opposite phrase mining model, keyword similar phrase mining model and keyword related phrase mining model are respectively constructed for phrases, keyword-similar phrases, and keyword-related phrases. The word opposite phrase mining model, the keyword similar phrase mining model and the keyword associated phrase mining model are used to mine the target data, thereby realizing the high accuracy and high efficiency mining of the target data.

Description of drawings

FIG. 1 is a flowchart of a data mining method according to an embodiment of the present invention.

FIG. 2 is a system block diagram of a data mining system according to an embodiment of the present invention.

Detailed ways

In order to make the objects and advantages of the present invention more clear, the present invention will be further described in detail below with reference to the embodiments. It should be understood that the specific embodiments described herein are only used to explain the present invention, but not to limit the present invention.

As shown in FIG. 1, an embodiment of the present invention provides a data mining method, including the following steps:

S1. Output corresponding keyword groups based on data mining requirements;

S2, generating an associated phrase of each keyword group, and the associated phrase is composed of a keyword group, a keyword opposite phrase, a keyword similar phrase, and a keyword associated phrase;

S3. Construct a data mining model based on keyword groups, keyword opposite phrases, keyword similar phrases, and keyword associated phrases;

S4. Run the data mining model based on Hadoop to realize target data mining.

In this embodiment, in the step S1, the keyword group is obtained based on the CCIPCA algorithm.

In this embodiment, in the step S2, keyword groups, keyword opposite phrases, keyword similar phrases, and keyword associated phrases are implemented based on the Inception V3 deep neural network model.

In this embodiment, the step S3 constructs the keyword group mining model, the keyword opposite phrase mining model, the keyword similar phrase mining model and the keyword respectively according to the keyword group, the keyword opposite phrase, the keyword similar phrase, and the keyword related phrase. Associated Phrase Mining Model Mining Model.

In this embodiment, the step S4 runs the keyword group mining model, the keyword opposite phrase mining model, the keyword similar phrase mining model and the keyword associated phrase mining model simultaneously based on Hadoop to mine the target data.

As shown in FIG. 2, an embodiment of the present invention provides a data mining system, including:

The keyword group generation module is used to generate corresponding keyword groups based on data mining requirements;

an associated phrase generation module, configured to generate a corresponding associated phrase based on the keyword group, where the associated phrase is composed of a keyword group, a keyword opposite phrase, a keyword similar phrase, and a keyword associated phrase;

A data mining model building module is used to build a data mining model based on keyword groups, keyword opposite phrases, keyword similar phrases, and keyword associated phrases;

The data mining module is used to run the data mining model based on Hadoop to realize the target data mining;

In this embodiment, the associated phrase generation module constructs a keyword group mining model, a keyword opposite phrase mining model, a keyword similar phrase mining model and a Word-related phrase mining model;

In this embodiment, the data mining module runs the keyword group mining model, the keyword opposite phrase mining model, the keyword similar phrase mining model and the keyword associated phrase mining model simultaneously based on Hadoop to mine the target data. The mined target data corresponds to a database.

The above are only the preferred embodiments of the present invention. It should be pointed out that for those skilled in the art, without departing from the principles of the present invention, several improvements and modifications can be made, and these improvements and modifications should also be It is regarded as the protection scope of the present invention.

Claims (6)

1. a data mining method, is characterized in that: comprise the steps: S1. Output corresponding keyword groups based on data mining requirements; S2, generating an associated phrase of each keyword group, and the associated phrase is composed of a keyword group, a keyword opposite phrase, a keyword similar phrase, and a keyword associated phrase; S3. Construct a data mining model based on keyword groups, keyword opposite phrases, keyword similar phrases, and keyword associated phrases; S4. Run the data mining model based on Hadoop to realize target data mining. 2 . The data mining method according to claim 1 , wherein in the step S1 , the acquisition of the keyword group is realized based on the CCIPCA algorithm. 3 . 3. A data mining method as claimed in claim 1, characterized in that: in the step S2, keyword groups, keyword opposite phrases, keyword similar phrases, and keyword associated phrases are implemented based on the InceptionV3 deep neural network model. 4. a kind of data mining method as claimed in claim 1 is characterized in that: described step S3 constructs keyword group mining model according to keyword group, keyword opposite phrase, keyword similar phrase, keyword associated phrase respectively, keyword Opposite phrase mining model, keyword similarity phrase mining model and keyword association phrase mining model. 5. a kind of data mining method as claimed in claim 4, is characterized in that: described step S4 simultaneously runs keyword group mining model, keyword opposite phrase mining model, keyword similar phrase mining model and keyword associated phrase based on Hadoop The mining model is used to mine the target data. 6. A data mining system, characterized in that: comprising: The keyword group generation module is used to generate corresponding keyword groups based on data mining requirements; an associated phrase generation module, configured to generate a corresponding associated phrase based on the keyword group, where the associated phrase is composed of a keyword group, a keyword opposite phrase, a keyword similar phrase, and a keyword associated phrase; A data mining model building module is used to build a data mining model based on keyword groups, keyword opposite phrases, keyword similar phrases, and keyword associated phrases; The data mining module is used to run the data mining model based on Hadoop to realize the target data mining A data mining system as claimed in claim 6, characterized in that: the associated phrase generation module constructs a keyword group mining model according to keyword groups, keyword opposite phrases, keyword similar phrases, and keyword associated phrases. Phrase mining model, keyword similar phrase mining model and keyword related phrase mining model; A data mining system according to claim 6, wherein the data mining module simultaneously runs a keyword group mining model, a keyword opposite phrase mining model, a keyword similar phrase mining model and a keyword associated phrase mining model based on Hadoop The model mines the target data, and the target data mined by each data mining model corresponds to a database.

Images