CN112182066A - Big data information mining system based on fuzzy theory - Google Patents

Big data information mining system based on fuzzy theory Download PDF

Info

Publication number
CN112182066A
CN112182066A CN202011035118.XA CN202011035118A CN112182066A CN 112182066 A CN112182066 A CN 112182066A CN 202011035118 A CN202011035118 A CN 202011035118A CN 112182066 A CN112182066 A CN 112182066A
Authority
CN
China
Prior art keywords
data
unit
instruction
processor
fuzzy theory
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202011035118.XA
Other languages
Chinese (zh)
Inventor
卞丽丽
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Gaowei Smart Society Information Consulting Jiangsu Co ltd
Original Assignee
Gaowei Smart Society Information Consulting Jiangsu Co ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Gaowei Smart Society Information Consulting Jiangsu Co ltd filed Critical Gaowei Smart Society Information Consulting Jiangsu Co ltd
Priority to CN202011035118.XA priority Critical patent/CN112182066A/en
Publication of CN112182066A publication Critical patent/CN112182066A/en
Pending legal-status Critical Current

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/24Querying
    • G06F16/245Query processing
    • G06F16/2458Special types of queries, e.g. statistical queries, fuzzy queries or distributed queries
    • G06F16/2465Query processing support for facilitating data mining operations in structured databases
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06NCOMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N7/00Computing arrangements based on specific mathematical models

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Data Mining & Analysis (AREA)
  • General Engineering & Computer Science (AREA)
  • Databases & Information Systems (AREA)
  • Software Systems (AREA)
  • Mathematical Physics (AREA)
  • Mathematical Optimization (AREA)
  • Pure & Applied Mathematics (AREA)
  • Computing Systems (AREA)
  • Computational Mathematics (AREA)
  • Mathematical Analysis (AREA)
  • Artificial Intelligence (AREA)
  • Algebra (AREA)
  • Evolutionary Computation (AREA)
  • Fuzzy Systems (AREA)
  • Probability & Statistics with Applications (AREA)
  • Computational Linguistics (AREA)
  • Management, Administration, Business Operations System, And Electronic Commerce (AREA)
  • Information Retrieval, Db Structures And Fs Structures Therefor (AREA)

Abstract

The invention discloses a big data information mining system based on a fuzzy theory, which relates to the technical field of data mining processing, and aims at the problem of low searching speed in the prior art, the invention provides a scheme which comprises a plurality of computer terminals and a cloud processing system, wherein the computer terminals are connected with the cloud processing system in a wired or wireless manner.

Description

Big data information mining system based on fuzzy theory
Technical Field
The invention relates to the technical field of data mining processing, in particular to a big data information mining system based on a fuzzy theory.
Background
Fuzzy theory refers to the theory that uses the basic concept of fuzzy sets or continuous membership functions. It can be classified into five branches of fuzzy mathematics, fuzzy system, uncertainty and information, fuzzy decision, fuzzy logic and artificial intelligence, which are not completely independent and have close relation, and Data Mining (Data Mining) is a process of extracting hidden information and knowledge from a large amount of incomplete, noisy, fuzzy and random Data, which is not known by people in advance but is potentially useful. Because the data is analyzed and processed by a certain fuzzy concept, huge data can be rapidly collected and processed, so that the pressure of hardware equipment is reduced, and the searching efficiency is improved.
The existing big data information generally adopts a single algorithm or always inputs a man-made algorithm to search each time, great difficulty is generated in the whole searching effect and the future searching, the efficiency is low, and the data processing quantity has a certain difference.
Disclosure of Invention
The big data information mining system based on the fuzzy theory provided by the invention solves the problem of low search speed.
In order to achieve the purpose, the invention adopts the following technical scheme:
the big data information mining system based on the fuzzy theory comprises a plurality of computer terminals and a cloud processing system, wherein the computer terminals are connected with the cloud processing system in a wired or wireless mode.
Preferably, the cloud processing system comprises a coordination processor, and the coordination processor is connected with an instruction module and a receiving module.
Preferably, the instruction module comprises an instruction processor connected with the coordination processor, the instruction processor is connected with an instruction database, a selection unit and an assignment unit, the selection unit is connected with the instruction database, and the assignment unit is connected with the terminal computer.
Preferably, the receiving module comprises a receiving processor connected with the coordination processor, the receiving processor is connected with a data collecting unit, the data collecting unit is connected with the terminal computer, the data collecting unit is connected with a screening unit, the screening unit is connected with a classifying unit, the classifying unit is connected with a packing unit, and the packing unit is connected with a collecting unit connected with the receiving processor.
Preferably, the receiving processor is connected with a learning module, the learning module is connected with a learning database, and the learning database is connected with the data collecting module.
Preferably, the terminal computers are collective users or individual users.
The big data information mining process based on the fuzzy theory comprises the following steps:
s1: inputting a search instruction, processing the selection or forming a set instruction by the cloud processing system, and then searching the terminal computer;
s2: the novelty searched in the step S1 is subjected to data collection by the cloud processing system, and the collected data is subjected to data classification;
s3: and after the data in the step S2 are classified, data are packaged through the cloud processing system, and then the data are packaged and output.
Preferably, in step S3, after the data is packaged, the data is copied and sorted for storage.
The invention has the beneficial effects that:
1: when the excavation of carrying out data is sought to be handled, can carry out the coordination processing at a plurality of terminals simultaneously, utilize fuzzy theory simultaneously, can be quick search for and assemble at numerous computer terminal, carry out certain preliminary treatment to data simultaneously, when convenient follow-up output, the accounting of the inspection of data reduces the requirement that data separately conveys whole hardware simultaneously, guarantees the steady operation of whole device then, guarantees the transmission capacity of data simultaneously.
2: through the processing of each plurality of system units, certain learning can be carried out on the mining and processing of the data, the learning data are stored, the collection and mining of the data in the later period are facilitated, the integral searching efficiency is increased, and the data processing capacity is improved.
Drawings
FIG. 1 is a schematic diagram of a big data information mining system based on fuzzy theory according to the present invention;
fig. 2 is a schematic diagram of a cloud processing system of a big data information mining system based on a fuzzy theory according to the present invention;
FIG. 3 is a schematic diagram of a mining process of a big data information mining system based on fuzzy theory according to the present invention;
Detailed Description
The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments.
Big data information mining system based on fuzzy theory, including a plurality of computer terminals and high in the clouds processing system, computer terminal and high in the clouds processing system are through wired or wireless connection, and wherein computer terminal is a plurality of user terminal, carries out solitary calculation design, and the data processing of each item that the cooperation far-end processing system goes on.
The cloud processing system comprises a coordination processor, the coordination processor is connected with an instruction module and a receiving module, instruction data are transmitted to the coordination processor by the computer terminal, and the coordination processor carries out commands on the instruction module and the receiving module to coordinate to work.
The instruction module comprises an instruction processor connected with the coordination processor, the instruction processor is connected with an instruction database, a selecting unit and an assigning unit, the selecting unit is connected with the instruction database, the assigning unit is connected with the terminal computer, signals processed by the coordination processor are assigned to the instruction processor, the instruction processor firstly searches for needed instructions in the instruction database through the selecting unit, then the needed instructions enter the assigning unit after being processed by the instruction processor, the assigning unit assigns the instructions to other terminal computers, and fuzzy searching and searching are carried out on the computers.
The receiving module comprises a receiving processor connected with the coordinating processor, the receiving processor is connected with a data collecting unit, the data collecting unit is connected with a terminal computer, the data collecting unit is connected with a screening unit, the screening unit is connected with a classifying unit, the classifying unit is connected with a packing unit, the packing unit is connected with a collecting unit connected with the receiving processor, after the coordinating processor gives an instruction signal for instruction processing, the working signal is synchronously given to the receiving processor, at the moment, the data collecting unit starts working, the data information collected by the instruction set given by the distributing module is collected, then the preliminary screening is carried out by the screening unit, the redundant repeated information is deleted, the later data processing amount is reduced, then the data is classified and packed by the classifying unit and the packing unit, and then the packed data is transmitted to the receiving processor for processing by the collecting unit, and feeding back the data to the coordination processor, and outputting the data to a terminal computer which sends the instruction to finish the mining processing work of the specified big data.
The receiving processor is connected with a learning module, the learning module is connected with a learning database, the learning database is connected with a data collecting module, after the receiving processor transmits data to the coordination processor, the data searched in the data are transmitted to the learning module, the learning module compresses and simplifies the data of the packaging set, and then the data are stored in the learning database.
The terminal computers are collective users or individual users.
The big data information mining process based on the fuzzy theory comprises the following steps:
s1: inputting a search instruction, processing the selection or forming a set instruction by the cloud processing system, and then searching the terminal computer;
s2: the novelty searched in the step S1 is subjected to data collection by the cloud processing system, and the collected data is subjected to data classification;
s3: and after the data in the step S2 are classified, data are packaged through the cloud processing system, and then the data are packaged and output.
In step S3, after the data is packaged, the data is copied and sorted for storage.
The working principle is as follows:
after one computer inputs data, the required fuzzy data is transmitted to a coordination processor through wired or wireless transmission, at the moment, the coordination processor processes the data, the processed signal is assigned to an instruction processor, the instruction processor firstly searches for the required instruction in an instruction data database through a selection unit, then enters an assignment unit through the processing of the instruction processor, the assignment unit assigns and transmits the instruction to other terminal computers, fuzzy searching and searching are carried out on the computers, after the coordination processor gives the instruction signal of the instruction processing, the work signal of a receiving processor is synchronously given, at the moment, a data collection unit starts working, collects the data information collected by an instruction set given by an assignment module, then the data information is preliminarily screened through a screening unit, redundant repeated information is deleted, and the later-stage data processing amount is reduced, the data are classified and packed through the classification unit and the packing unit, then the packed data are transmitted to the receiving processor through the collection unit to be processed, the data are fed back to the coordination processor and output to a terminal computer sent by an instruction, the specified mining processing work of big data is completed, after the receiving processor transmits the data to the coordination processor, the searched data are transmitted to the learning module, the learning module compresses and simplifies the packed and collected data and stores the data in the learning database, when the data are used in the later period, a certain amount of data can be directly called in the learning use database, the working pressure of the whole system is reduced, and meanwhile, when other computers search and mine, repeated operation is carried out, and the whole system is ensured to be carried out quickly.
The above description is only for the preferred embodiment of the present invention, but the scope of the present invention is not limited thereto, and any person skilled in the art should be able to cover the technical scope of the present invention and the equivalent alternatives or modifications according to the technical solution and the inventive concept of the present invention within the technical scope of the present invention.

Claims (8)

1. Big data information mining system based on fuzzy theory, including a plurality of computer terminals and high in the clouds processing system, its characterized in that, computer terminal and high in the clouds processing system are through wired or wireless connection.
2. The fuzzy theory-based big data information mining system according to claim 1, wherein the cloud processing system comprises a coordination processor, and the coordination processor is connected with an instruction module and a receiving module.
3. The fuzzy theory-based big data information mining system according to claim 2, wherein the instruction module comprises an instruction processor connected with the coordination processor, the instruction processor is connected with an instruction database, a selecting unit and an assigning unit, the selecting unit is connected with the instruction database, and the assigning unit is connected with the terminal computer.
4. The fuzzy theory-based big data information mining system according to claim 2, wherein the receiving module comprises a receiving processor connected with the coordination processor, the receiving processor is connected with a data collecting unit, the data collecting unit is connected with the terminal computer, the data collecting unit is connected with a screening unit, the screening unit is connected with a classifying unit, the classifying unit is connected with a packing unit, and the packing unit is connected with a collecting unit connected with the receiving processor.
5. The fuzzy theory based big data information mining system according to claim 4, wherein the receiving processor is connected with a learning module, the learning module is connected with a learning database, and the learning database is connected with the data collecting module.
6. The fuzzy theory based big data information mining system according to claim 1, wherein the terminal computers are collective users or individual users.
7. The big data information mining process based on the fuzzy theory is characterized by comprising the following steps of:
s1: inputting a search instruction, processing the selection or forming a set instruction by the cloud processing system, and then searching the terminal computer;
s2: the novelty searched in the step S1 is subjected to data collection by the cloud processing system, and the collected data is subjected to data classification;
s3: and after the data in the step S2 are classified, data are packaged through the cloud processing system, and then the data are packaged and output.
8. The fuzzy theory-based big data information mining system according to claim 7, wherein in step S3, after the data is packed, the data is copied and classified for storage.
CN202011035118.XA 2020-09-27 2020-09-27 Big data information mining system based on fuzzy theory Pending CN112182066A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202011035118.XA CN112182066A (en) 2020-09-27 2020-09-27 Big data information mining system based on fuzzy theory

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202011035118.XA CN112182066A (en) 2020-09-27 2020-09-27 Big data information mining system based on fuzzy theory

Publications (1)

Publication Number Publication Date
CN112182066A true CN112182066A (en) 2021-01-05

Family

ID=73944783

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202011035118.XA Pending CN112182066A (en) 2020-09-27 2020-09-27 Big data information mining system based on fuzzy theory

Country Status (1)

Country Link
CN (1) CN112182066A (en)

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20110191277A1 (en) * 2008-06-16 2011-08-04 Agundez Dominguez Jose Luis Automatic data mining process control
CN104778266A (en) * 2015-04-22 2015-07-15 无锡天脉聚源传媒科技有限公司 Multi-data source searching method and device
CN107526762A (en) * 2017-02-28 2017-12-29 天津转知汇网络技术有限公司 Service end, multi-data source searching method and system
CN108989340A (en) * 2018-08-21 2018-12-11 新开普电子股份有限公司 A kind of implementation method directly docked with third party system
CN111428106A (en) * 2020-03-18 2020-07-17 安徽格雷皖创信息科技有限公司 Big data-based information collection and analysis system
US20200278964A1 (en) * 2019-03-01 2020-09-03 Palantir Technologies Inc. Fuzzy searching and applications therefor

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20110191277A1 (en) * 2008-06-16 2011-08-04 Agundez Dominguez Jose Luis Automatic data mining process control
CN104778266A (en) * 2015-04-22 2015-07-15 无锡天脉聚源传媒科技有限公司 Multi-data source searching method and device
CN107526762A (en) * 2017-02-28 2017-12-29 天津转知汇网络技术有限公司 Service end, multi-data source searching method and system
CN108989340A (en) * 2018-08-21 2018-12-11 新开普电子股份有限公司 A kind of implementation method directly docked with third party system
US20200278964A1 (en) * 2019-03-01 2020-09-03 Palantir Technologies Inc. Fuzzy searching and applications therefor
CN111428106A (en) * 2020-03-18 2020-07-17 安徽格雷皖创信息科技有限公司 Big data-based information collection and analysis system

Similar Documents

Publication Publication Date Title
CN109639481B (en) Deep learning-based network traffic classification method and system and electronic equipment
CN110135468B (en) Coal gangue identification method
Zhang et al. Data preparation for data mining
CN110287552B (en) Motor bearing fault diagnosis method and system based on improved random forest algorithm
CN111259064B (en) Visual natural language analysis mining system and modeling method thereof
CN113392646A (en) Data relay system, construction method and device
CN105956016A (en) Associated information visualization processing system
CN105159148B (en) Robot instruction processing method and device
CN107239538B (en) Parallel customer service robot system with self-learning function and self-learning method thereof
CN110297879A (en) A kind of method, apparatus and storage medium of the data deduplication based on big data
CN105930942A (en) Intelligent system for predicting energy technologies under big data background
CN106343607A (en) Tobacco leaf grading method and device based on FPGA (field programmable gate array)
CN112182066A (en) Big data information mining system based on fuzzy theory
CN109871865A (en) A kind of coalcutter online system failure diagnosis based on colony intelligence optimizing
CN112214524A (en) Data evaluation system and evaluation method based on deep data mining
Hasan et al. Moving towards accurate monitoring and prediction of gold mine underground dam levels
CN110489348A (en) A kind of software function defect method for digging based on transfer learning
CN114996207A (en) Big data analysis method and system based on 5G cloud computing
CN110895541A (en) Intelligent platform for Timing cloud data statistics
CN113515560A (en) Vehicle fault analysis method and device, electronic equipment and storage medium
CN106227857A (en) Data-pushing and loading method and device
CN110852937A (en) Deformed article image generation method based on content and style decoupling
Meng et al. An Integrated Semi-supervised Software Defect Prediction Model
CN113742413A (en) High-accuracy big data analysis system based on multi-form processing
CN116633870B (en) Operation and maintenance data processing system and method based on cloud end-added mode

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination