CN104361060A - Data mining method and system applied to manufacturing Internet of things - Google Patents
Data mining method and system applied to manufacturing Internet of things Download PDFInfo
- Publication number
- CN104361060A CN104361060A CN201410609807.5A CN201410609807A CN104361060A CN 104361060 A CN104361060 A CN 104361060A CN 201410609807 A CN201410609807 A CN 201410609807A CN 104361060 A CN104361060 A CN 104361060A
- Authority
- CN
- China
- Prior art keywords
- data
- event
- things
- internet
- mining
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/24—Querying
- G06F16/245—Query processing
- G06F16/2458—Special types of queries, e.g. statistical queries, fuzzy queries or distributed queries
- G06F16/2465—Query processing support for facilitating data mining operations in structured databases
Abstract
The invention discloses a data mining method and system applied to manufacturing Internet of things, wherein the data mining method comprises the following steps that data is collected, the data type is defined, and a corresponding collection strategy is adopted; the data is managed, data importing, data exporting, data extraction and data compression are carried out; events are processed, the data is combined and analyzed according to corresponding events to events concerned by users, and specified data output is provided; mining services are provided, and any one or multiple mining services in classification, prediction, clustering, isolated point prediction, correlation analysis and type mining are provided, so that the users can fast and accurately mine the interested knowledge from mass data for the manufacturing Internet of things, and the data mining difficulty due to access of more and more applications into a network terminal is solved. The data mining system comprises a data collecting unit, a data management unit, an event processing unit and a mining service unit, the manufacturing Internet of things is divided into a plurality of small cells in a distributive mode, and a lamination method is adopted in the small cells for data mining.
Description
Technical field
The present invention relates to and manufacture Internet of Things Data Mining, particularly relate to a kind of data digging method and the system that are applied to manufacture Internet of Things.
Background technology
Internet of Things is that internet, applications expands emphasis, Internet of Things is the starting point of ubiquitous network, Internet of Things is the information-based point of penetration merged with industrialization, breaking through industry enter bulwark in Internet of Things application is difficult point, Internet of Things is the strong point of low-carbon economy, Internet of Things is the growth point of emerging strategic industries, and Internet of Things is the new highlight of people's livelihood service, and Internet of Things is the new focus of international competition
Along with the high speed development manufacturing technology of Internet of things, increasing application is access in the network terminal, and the huge data volume of the thing followed materially increases the difficulty that user excavates interest knowledge from mass data.The data manufacturing Internet of Things generation have quantity greatly, and the feature of high degree of dispersion, traditional distributed data digging cannot solve available data process bottleneck problem.
The data mining simultaneously manufactured in Internet of Things is excavated from traditional data statistic analysis, potential mode discovery, turns to and manufactures indispensable link in Internet of Things.
Summary of the invention
In order to overcome the deficiencies in the prior art, the invention provides a kind of data digging method and the system that are applied to manufacture Internet of Things, reduce the difficulty that user excavates interest knowledge from the mass data manufacturing Internet of Things, solve and manufacture data processing bottleneck problem in Internet of Things.
To achieve these goals, technical scheme of the present invention is: a kind of data digging method being applied to manufacture Internet of Things, comprising:
Collect data, collect the related data manufacturing event or object in Internet of Things, define the type of the related data collected and select the collection strategy corresponding to related data;
Management data, managing system divine force that created the universe networking Distributed Data Warehouse, carry out data importing, derivation and data extraction, compression etc., raw data is extracted, simplifies, multiple mathematical algorithm and statistics is used to calculate or generate new derivative variable to the interest knowledge in raw data, be saved in and manufacture in Internet of Things Distributed Data Warehouse, and the data that external user is specified are imported, process and derived;
Process event, analyzing and processing manufactures Internet of Things event, event handling is carried out to primary event, again event filtering is carried out to the event processed, the monitoring of wait system divine force that created the universe networked system obtains the event of corresponding event or user's concern, the event paid close attention to according to corresponding event or user combines data, analysis etc., provides the data of specifying to export;
Excavate service, auxiliary data is excavated, and uses multiple mathematical algorithm and statistics to provide any one of classification, prediction, cluster, Outlier prediction, association analysis, type excavation or multinomial excavation service.
User, according to data digging method provided by the invention, excavates interest knowledge quickly and accurately from the mass data manufacturing Internet of Things, solves the data mining difficult problem more and more applied and be access in the network terminal and cause.
Be applied to the data digging system manufacturing Internet of Things, comprise:
For collecting the related data manufacturing event or object in Internet of Things, defining the type of the related data collected and selecting the data collection module of the collection strategy corresponding to related data;
For the manufacture of the management of Internet of Things Distributed Data Warehouse, data importing, derivation and data extraction, compression etc., raw data is extracted, simplifies, multiple mathematical algorithm and statistics is used to calculate or generate new derivative variable to the interest knowledge in raw data, be saved in and manufacture in Internet of Things Distributed Data Warehouse, and to the Data Management Unit that the data that external user is specified import, process and derive;
Internet of Things event is manufactured for analyzing and processing, event handling is carried out to primary event, again event filtering is carried out to the event processed, the monitoring of wait system divine force that created the universe networked system obtains the event of corresponding event or user's concern, the event paid close attention to according to corresponding event or user combines data, analysis etc., provides the event handling unit that the data of specifying export;
Excavate for auxiliary data, use multiple mathematical algorithm and statistics to provide any one of classification, prediction, cluster, Outlier prediction, association analysis, type excavation or the excavation service unit of multinomial excavation service.
The data digging system of described data collection module, Data Management Unit, event handling unit and excavation service unit composition provides service to the application layer manufacturing Internet of Things, and the data that the distributed way of data digging system is concerned about according to application layer adjust.
The data digging system that the present invention proposes uses distributed way that manufacture Internet of Things is divided into some zonules, in these some zonules, use hierarchical method to carry out data mining, data digging system accomplishes flexible distributed, and the data can be concerned about according to application layer adjust.
Described data collection module is positioned at data digging system bottom.
Described excavation service unit is higher than Data Management Unit and event handling unit.
Described data collection module comprises Intellisense equipment and data transmission set, the different collection strategy of different types of data acquisition, properly settle run in data-gathering process data collision, lose, the problem such as to repeat.
Compared with prior art, beneficial effect of the present invention is:
1) the present invention makes user from the mass data manufacturing Internet of Things, excavate interest knowledge quickly and accurately, solves the data mining difficult problem that increasing application access network terminal causes.
2) manufacture Internet of Things is divided into some zonules by the present invention, in these some zonules, use hierarchical method to carry out data mining, and the data that data digging system can be concerned about according to application layer adjust, and accomplish flexible distributed.
3) the present invention solve run in data-gathering process data collision, lose, the problem such as to repeat, ensure the quality of collecting data.
Accompanying drawing explanation
Fig. 1 is the structural representation of the embodiment of the present invention.
Embodiment
Below in conjunction with accompanying drawing, the present invention will be further described, but embodiments of the present invention are not limited to this.
As shown in Figure 1, a kind of data digging system being applied to manufacture Internet of Things, comprising:
For collecting the related data manufacturing event or object in Internet of Things, defining the type of the related data collected and selecting the data collection module of the collection strategy corresponding to related data;
For the manufacture of the management of Internet of Things Distributed Data Warehouse, data importing, derivation and data extraction, compression etc., raw data is extracted, simplifies, multiple mathematical algorithm and statistics is used to calculate or generate new derivative variable to the interest knowledge in raw data, be saved in and manufacture in Internet of Things Distributed Data Warehouse, and to the Data Management Unit that the data that external user is specified import, process and derive;
Internet of Things event is manufactured for analyzing and processing, event handling is carried out to primary event, again event filtering is carried out to the event processed, the monitoring of wait system divine force that created the universe networked system obtains the event of corresponding event or user's concern, the event paid close attention to according to corresponding event or user combines data, analysis etc., provides the event handling unit that the data of specifying export;
Excavate for auxiliary data, use multiple mathematical algorithm and statistics to provide any one of classification, prediction, cluster, Outlier prediction, association analysis, type excavation or the excavation service unit of multinomial excavation service.
The data digging system of data collection module, Data Management Unit, event handling unit and excavation service unit composition provides service to the application layer manufacturing Internet of Things, and the data that the distributed way of data digging system is concerned about according to application layer adjust.
The data digging system that the present invention proposes uses distributed way that manufacture Internet of Things is divided into some zonules, in these some zonules, use hierarchical method to carry out data mining, data digging system accomplishes flexible distributed, and the data can be concerned about according to application layer adjust.
Data collection module is positioned at data digging system bottom as shown in the figure, excavates service unit higher than Data Management Unit and event handling unit.
Data collection module comprises Intellisense equipment and data transmission set, the different collection strategy of different types of data acquisition, properly settle run in data-gathering process data collision, lose, the problem such as to repeat.
The present invention makes user from the mass data manufacturing Internet of Things, excavate interest knowledge quickly and accurately, solves the data mining difficult problem that increasing application access network terminal causes.
Manufacture Internet of Things is divided into some zonules by the present invention, in these some zonules, use hierarchical method to carry out data mining, and the data that data digging system can be concerned about according to application layer adjust, and accomplish flexible distributed.
The present invention solve run in data-gathering process data collision, lose, the problem such as to repeat, ensure the quality of collecting data.
Above-described embodiments of the present invention, do not form limiting the scope of the present invention.Any amendment done within spiritual principles of the present invention, equivalent replacement and improvement etc., all should be included within claims of the present invention.
Claims (6)
1. be applied to the data digging method manufacturing Internet of Things, it is characterized in that, comprising:
Carry out distributed treatment to manufacture Internet of Things, its concrete mode is that the data be concerned about according to application layer adjust;
Collect data, collect the related data manufacturing event or object in Internet of Things, define the type of the related data collected and select the collection strategy corresponding to related data;
Management data, managing system divine force that created the universe networking Distributed Data Warehouse, carry out data importing, derivation and data to extract, compress, raw data is extracted, simplifies, interest knowledge in raw data is calculated or generates new derivative variable, be saved in and manufacture in Internet of Things Distributed Data Warehouse, and the data that external user is specified are imported, process and derived;
Process event, analyzing and processing manufactures Internet of Things event, event handling is carried out to primary event, again event filtering is carried out to the event processed, the monitoring of wait system divine force that created the universe networked system obtains the event of corresponding event or user's concern, data are combined according to the event that corresponding event or user are paid close attention to, analyzes, provide the data of specifying to export;
Excavate service, auxiliary data is excavated, and provides any one of classification, prediction, cluster, Outlier prediction, association analysis, type excavation or multinomial excavation service.
2. be applied to the data digging system manufacturing Internet of Things, it is characterized in that, comprising:
For collecting the related data manufacturing event or object in Internet of Things, defining the type of the related data collected and selecting the data collection module of the collection strategy corresponding to related data;
Extract for the manufacture of the management of Internet of Things Distributed Data Warehouse, data importing, derivation and data, compression, raw data is extracted, simplifies, interest knowledge in raw data is calculated or generates new derivative variable, be saved in and manufacture in Internet of Things Distributed Data Warehouse, and to the Data Management Unit that the data that external user is specified import, process and derive;
Internet of Things event is manufactured for analyzing and processing, event handling is carried out to primary event, again event filtering is carried out to the event processed, the monitoring of wait system divine force that created the universe networked system obtains the event of corresponding event or user's concern, data are combined according to the event that corresponding event or user are paid close attention to, analyzes, the event handling unit that the data of specifying export is provided;
Excavate for auxiliary data, provide any one of classification, prediction, cluster, Outlier prediction, association analysis, type excavation or the excavation service unit of multinomial excavation service.
3. the data digging system being applied to manufacture Internet of Things according to claim 2, it is characterized in that, the data digging system of described data collection module, Data Management Unit, event handling unit and excavation service unit composition provides service to the application layer manufacturing Internet of Things, data mining model is distributed, and the data that its distribution mode is concerned about according to application layer adjust.
4. the data digging system being applied to manufacture Internet of Things according to claim 3, it is characterized in that, described data collection module is positioned at data digging system bottom.
5. the data digging system being applied to manufacture Internet of Things according to claim 4, it is characterized in that, described excavation service unit is higher than Data Management Unit and event handling unit.
6. the data digging system being applied to manufacture Internet of Things according to claim 5, it is characterized in that, described data collection module comprises Intellisense equipment and data transmission set.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201410609807.5A CN104361060A (en) | 2014-10-31 | 2014-10-31 | Data mining method and system applied to manufacturing Internet of things |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201410609807.5A CN104361060A (en) | 2014-10-31 | 2014-10-31 | Data mining method and system applied to manufacturing Internet of things |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN104361060A true CN104361060A (en) | 2015-02-18 |
Family
ID=52528321
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201410609807.5A Pending CN104361060A (en) | 2014-10-31 | 2014-10-31 | Data mining method and system applied to manufacturing Internet of things |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN104361060A (en) |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| RU2654167C2 (en) * | 2015-11-10 | 2018-05-16 | федеральное государственное автономное образовательное учреждение высшего образования "Санкт-Петербургский политехнический университет Петра Великого" (ФГАОУ ВО "СПбПУ") | Method for detecting hidden interactions on the internet of things |
| CN109241135A (en) * | 2018-08-23 | 2019-01-18 | 吾达软件（武汉）股份有限公司 | A kind of intelligence extracts the digging system of data |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101140646A (en) * | 2007-11-05 | 2008-03-12 | 陆航程 | 'Data great tracking' tax controlling system and tax controlling terminal based on EPC, EBC article internet |
| CN102325177A (en) * | 2011-09-05 | 2012-01-18 | 太原理工大学 | Coal mine production three-dimensional visualization information system based on Internet of things |
| US8290951B1 (en) * | 2008-07-10 | 2012-10-16 | Bank Of America Corporation | Unstructured data integration with a data warehouse |
| CN103577605A (en) * | 2013-11-20 | 2014-02-12 | 贵州电网公司电力调度控制中心 | Data warehouse based on data fusion and data mining and application method of data warehouse |
| CN103576632A (en) * | 2012-08-07 | 2014-02-12 | 南京财经大学 | Live pig growth environment monitoring and control system based on internet of things technology |
-
2014
- 2014-10-31 CN CN201410609807.5A patent/CN104361060A/en active Pending
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101140646A (en) * | 2007-11-05 | 2008-03-12 | 陆航程 | 'Data great tracking' tax controlling system and tax controlling terminal based on EPC, EBC article internet |
| US8290951B1 (en) * | 2008-07-10 | 2012-10-16 | Bank Of America Corporation | Unstructured data integration with a data warehouse |
| CN102325177A (en) * | 2011-09-05 | 2012-01-18 | 太原理工大学 | Coal mine production three-dimensional visualization information system based on Internet of things |
| CN103576632A (en) * | 2012-08-07 | 2014-02-12 | 南京财经大学 | Live pig growth environment monitoring and control system based on internet of things technology |
| CN103577605A (en) * | 2013-11-20 | 2014-02-12 | 贵州电网公司电力调度控制中心 | Data warehouse based on data fusion and data mining and application method of data warehouse |
Non-Patent Citations (1)
| Title |
|---|
| 李斌等: "瓦楞纸制造过程能耗监控物联网关键技术研究", 《传感器与微系统》 * |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| RU2654167C2 (en) * | 2015-11-10 | 2018-05-16 | федеральное государственное автономное образовательное учреждение высшего образования "Санкт-Петербургский политехнический университет Петра Великого" (ФГАОУ ВО "СПбПУ") | Method for detecting hidden interactions on the internet of things |
| CN109241135A (en) * | 2018-08-23 | 2019-01-18 | 吾达软件（武汉）股份有限公司 | A kind of intelligence extracts the digging system of data |
| CN109241135B (en) * | 2018-08-23 | 2021-03-05 | 吾达软件（武汉）股份有限公司 | Mining system for intelligently extracting data |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN107730394A (en) | The polynary isomeric data fusion method of panorama power network based on big data | |
| CN107577771A (en) | A kind of big data digging system | |
| CN106709012A (en) | Method and device for analyzing big data | |
| CN107038167A (en) | Big data excavating analysis system and its analysis method based on model evaluation | |
| CN108768986A (en) | A kind of encryption traffic classification method and server, computer readable storage medium | |
| CN105069025A (en) | Intelligent aggregation visualization and management control system for big data | |
| CN106294738B (en) | A kind of Intelligent household scene configuration method | |
| CN107104951B (en) | Method and device for detecting network attack source | |
| CN106959948A (en) | The system and its preprocess method pre-processed for distributed nature to big data | |
| CN104484412A (en) | Big data analysis system based on multiform processing | |
| CN104486116A (en) | Multidimensional query method and multidimensional query system of flow data | |
| CN106326461A (en) | Real time processing guarantee method and system based on network signaling record | |
| CN102567488A (en) | System and method for mining data of electric vehicle based on cloud computer framework | |
| CN105335368A (en) | Product clustering method and apparatus | |
| CN111159152B (en) | Secondary operation and data fusion method based on big data processing technology | |
| CN104933127A (en) | Cross-machine-room database synchronization equipment and method based on MariaDB | |
| CN104361060A (en) | Data mining method and system applied to manufacturing Internet of things | |
| CN102801548A (en) | Intelligent early warning method, device and information system | |
| CN105069710A (en) | Data processing method and system for intelligent power grid | |
| CN107590225A (en) | A kind of Visualized management system based on distributed data digging algorithm | |
| CN116484651B (en) | Digital twinning-based system parameter adjusting method and device and electronic equipment | |
| CN106294873A (en) | The analytical equipment of a kind of machine data and the method for analysis | |
| CN110413622B (en) | Data processing method based on electric power big data platform | |
| CN107992590B (en) | Big data system beneficial to information comparison | |
| CN103458032A (en) | Method and system for dynamic statistics and information compression of spatial data access law |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20150218 |
|
| RJ01 | Rejection of invention patent application after publication |