CN110113421A - A kind of big data information processing system based on Internet of Things - Google Patents

A kind of big data information processing system based on Internet of Things Download PDF

Info

Publication number
CN110113421A
CN110113421A CN201910383693.XA CN201910383693A CN110113421A CN 110113421 A CN110113421 A CN 110113421A CN 201910383693 A CN201910383693 A CN 201910383693A CN 110113421 A CN110113421 A CN 110113421A
Authority
CN
China
Prior art keywords
module
data
information
internet
things
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201910383693.XA
Other languages
Chinese (zh)
Inventor
校景中
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Southwest Minzu University
Original Assignee
Southwest Minzu University
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Southwest Minzu University filed Critical Southwest Minzu University
Priority to CN201910383693.XA priority Critical patent/CN110113421A/en
Publication of CN110113421A publication Critical patent/CN110113421A/en
Pending legal-status Critical Current

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/21Design, administration or maintenance of databases
    • G06F16/215Improving data quality; Data cleansing, e.g. de-duplication, removing invalid entries or correcting typographical errors
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/24Querying
    • G06F16/245Query processing
    • G06F16/2458Special types of queries, e.g. statistical queries, fuzzy queries or distributed queries
    • G06F16/2462Approximate or statistical queries
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L41/00Arrangements for maintenance, administration or management of data switching networks, e.g. of packet switching networks
    • H04L41/06Management of faults, events, alarms or notifications
    • H04L41/0654Management of faults, events, alarms or notifications using network fault recovery
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L43/00Arrangements for monitoring or testing data switching networks
    • H04L43/08Monitoring or testing based on specific metrics, e.g. QoS, energy consumption or environmental parameters
    • H04L43/0823Errors, e.g. transmission errors
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L63/00Network architectures or network communication protocols for network security
    • H04L63/12Applying verification of the received information
    • H04L63/123Applying verification of the received information received data contents, e.g. message integrity
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00Network arrangements or protocols for supporting network services or applications
    • H04L67/01Protocols
    • H04L67/12Protocols specially adapted for proprietary or special-purpose networking environments, e.g. medical networks, sensor networks, networks in vehicles or remote metering networks

Landscapes

  • Engineering & Computer Science (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Signal Processing (AREA)
  • General Engineering & Computer Science (AREA)
  • Computer Security & Cryptography (AREA)
  • Databases & Information Systems (AREA)
  • Data Mining & Analysis (AREA)
  • Probability & Statistics with Applications (AREA)
  • Computing Systems (AREA)
  • General Physics & Mathematics (AREA)
  • Mathematical Physics (AREA)
  • Computational Linguistics (AREA)
  • Software Systems (AREA)
  • Health & Medical Sciences (AREA)
  • Medical Informatics (AREA)
  • Fuzzy Systems (AREA)
  • Environmental & Geological Engineering (AREA)
  • General Health & Medical Sciences (AREA)
  • Computer Hardware Design (AREA)
  • Quality & Reliability (AREA)
  • Computer And Data Communications (AREA)

Abstract

The big data information processing system based on Internet of Things that the invention discloses a kind of, including data acquisition module, data transmission module, legitimacy inspection module, miscue module, fault detection module, preprocessing module, information filtering module, data memory module and data inquiry module.The design that big data information processing system based on Internet of Things of the invention passes through functional module, it realizes and complicated big data is effectively handled, carry out the filtering of big data effective information, precision is higher, superior performance, illustrates preferable application value, improve the efficiency of big data processing, and does not allow data easy to be lost, have the characteristics that high efficiency, using safe, suitable popularization and application.

Description

A kind of big data information processing system based on Internet of Things
Technical field
The invention belongs to internet of things field, are related to a kind of big data information processing system based on Internet of Things.
Background technique
Internet of Things is the important component of generation information technology, and the important development stage in " informationization " epoch. Its English name is: " Internet of things(IoT) ".As its name suggests, Internet of Things is exactly the connected internet of object object.This There is two layers of meaning: first, the core of Internet of Things and basis are still internet, it is extension and extension based on the internet Network;Second, its user terminal extends and extends between any article and article, information exchange and communication are carried out, that is, Object object mutually ceases.Internet of Things communicates cognition technology by Intellisense, identification technology and general fit calculation etc., is widely used in network In fusion, also therefore it is referred to as the third wave that world information industry develops after computer, internet.Internet of Things is mutual The application extension of networking.Big data (big data), refer to can not be captured within the scope of certain time with conventional software tool, The data acquisition system of management and processing is to need new tupe that could have stronger decision edge, see clearly discovery power and process is excellent Magnanimity, high growth rate and the diversified information assets of change ability.
Internet of Things connects the people in life with Internet of Things, produces a large amount of data, although Internet of Things is given at present We provide specific solutions: cloud computing technology, distributed computing technology, still, has become one of the internet of things era Basic calculating technology.Since the information content of big data is huge, inquiry, analysis and the processing of internet of things data are also current people The a great problem faced.
In the prior art, it is badly in need of a kind of big data information processing system based on Internet of Things.
Summary of the invention
The big data information processing system based on Internet of Things that the purpose of the present invention is to provide a kind of.
Itself the specific technical proposal is:
A kind of big data information processing system based on Internet of Things, including the inspection of data acquisition module, data transmission module, legitimacy Test module, miscue module, fault detection module, preprocessing module, information filtering module, data memory module sum number it is investigated that Ask module, the data acquisition module, data transmission module, legitimacy inspection module, miscue module, fault detection mould Block, preprocessing module, information filtering module, data memory module, data inquiry module are sequentially connected;
The data acquisition module by information of the network to Internet of Things big data for being acquired;
The data transmission module is used to transmit the information of the Internet of Things big data of data collecting module collected;
Whether the format that the legitimacy inspection module is used for inspection data is correct, whether information is complete;
The miscue module is for analyzing the inspection result of legitimacy inspection module, if there is illegalities, out Existing miscue and related advisory operation;
The fault detection module is used in big data information gathering process, abnormal transmission situation is occurred, is prompted the original of failure Because and suggest eliminating the operation of failure, after Failure elimination, big data auto-complete;
The preprocessing module is used to carry out effective big data information characteristics correlation dimension feature extraction pretreatment, to effective The association factor of information data is ranked up, and extracts the main characteristic quantity of the degree of association;
The information filtering module carries out regular processing for rationally being filtered to dereferenced information, to all data, turns Identical section is changed to be handled;
The data memory module carries out treated data for storing information filtering module;
The data inquiry module is used to inquire the historical data of data memory module storage.
Further, the data transmission module supports the breakpoint transmission to data acquisition module.
It further, further include display module, for showing the result of data inquiry module inquiry.
Further, the inquiry is as the result is shown picture, picture, chart and text etc..
The utility model has the advantages that
Big data information processing system based on Internet of Things of the invention is realized by the design of functional module to complicated big number According to effectively being handled, the filtering of big data effective information is carried out, precision is higher, superior performance, illustrates preferably using valence Value improves the efficiency of big data processing, and does not allow data easy to be lost, has the characteristics that high efficiency, using safe, suitable It promotes and applies.
Detailed description of the invention
Fig. 1 is that the present invention is based on the schematic diagrams of the big data information processing system of Internet of Things.
Specific embodiment
Technical solution of the present invention is described in more detail in the following with reference to the drawings and specific embodiments.
Referring to Fig.1, a kind of big data information processing system based on Internet of Things, including the transmission of data acquisition module, data Module, legitimacy inspection module, miscue module, fault detection module, preprocessing module, information filtering module, data are deposited Store up module and data inquiry module, the data acquisition module, data transmission module, legitimacy inspection module, miscue mould Block, fault detection module, preprocessing module, information filtering module, data memory module, data inquiry module are sequentially connected;
The data acquisition module by information of the network to Internet of Things big data for being acquired;
The data transmission module is used to transmit the information of the Internet of Things big data of data collecting module collected;
Whether the format that the legitimacy inspection module is used for inspection data is correct, whether information is complete;
The miscue module is for analyzing the inspection result of legitimacy inspection module, if there is illegalities, out Existing miscue and related advisory operation;
The fault detection module is used in big data information gathering process, abnormal transmission situation is occurred, is prompted the original of failure Because and suggest eliminating the operation of failure, after Failure elimination, big data auto-complete;
The preprocessing module is used to carry out effective big data information characteristics correlation dimension feature extraction pretreatment, to effective The association factor of information data is ranked up, and extracts the main characteristic quantity of the degree of association;
The information filtering module carries out regular processing for rationally being filtered to dereferenced information, to all data, turns Identical section is changed to be handled;
The data memory module carries out treated data for storing information filtering module;
The data inquiry module is used to inquire the historical data of data memory module storage.
The data transmission module supports the breakpoint transmission to data acquisition module.
It further include display module, for showing the result of data inquiry module inquiry.
The inquiry is as the result is shown picture, picture, chart and text etc..
Big data information processing system based on Internet of Things of the invention in the specific application process, is realized to complicated big Data are effectively handled, and carry out the filtering of big data effective information, precision is higher, superior performance, illustrates preferable application Value improves the efficiency of big data processing, and does not allow data easy to be lost, has the characteristics that high efficiency, using safe, suitable It closes and promotes and applies.
The foregoing is only a preferred embodiment of the present invention, the scope of protection of the present invention is not limited to this, it is any ripe Know those skilled in the art within the technical scope of the present disclosure, the letter for the technical solution that can be become apparent to Altered or equivalence replacement are fallen within the protection scope of the present invention.

Claims (4)

1. a kind of big data information processing system based on Internet of Things, which is characterized in that transmitted including data acquisition module, data Module, legitimacy inspection module, miscue module, fault detection module, preprocessing module, information filtering module, data are deposited Store up module and data inquiry module, the data acquisition module, data transmission module, legitimacy inspection module, miscue mould Block, fault detection module, preprocessing module, information filtering module, data memory module, data inquiry module are sequentially connected;
The data acquisition module by information of the network to Internet of Things big data for being acquired;
The data transmission module is used to transmit the information of the Internet of Things big data of data collecting module collected;
Whether the format that the legitimacy inspection module is used for inspection data is correct, whether information is complete;
The miscue module is for analyzing the inspection result of legitimacy inspection module, if there is illegalities, out Existing miscue and related advisory operation;
The fault detection module is used in big data information gathering process, abnormal transmission situation is occurred, is prompted the original of failure Because and suggest eliminating the operation of failure, after Failure elimination, big data auto-complete;
The preprocessing module is used to carry out effective big data information characteristics correlation dimension feature extraction pretreatment, to effective The association factor of information data is ranked up, and extracts the main characteristic quantity of the degree of association;
The information filtering module carries out regular processing for rationally being filtered to dereferenced information, to all data, turns Identical section is changed to be handled;
The data memory module carries out treated data for storing information filtering module;
The data inquiry module is used to inquire the historical data of data memory module storage.
2. the big data information processing system according to claim 1 based on Internet of Things, which is characterized in that the data pass Defeated module supports the breakpoint transmission to data acquisition module.
3. the big data information processing system according to claim 1 based on Internet of Things, which is characterized in that further include display Module, for showing the result of data inquiry module inquiry.
4. the big data information processing system according to claim 3 based on Internet of Things, which is characterized in that the inquiry It is as the result is shown picture, picture, chart and text.
CN201910383693.XA 2019-05-08 2019-05-08 A kind of big data information processing system based on Internet of Things Pending CN110113421A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201910383693.XA CN110113421A (en) 2019-05-08 2019-05-08 A kind of big data information processing system based on Internet of Things

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201910383693.XA CN110113421A (en) 2019-05-08 2019-05-08 A kind of big data information processing system based on Internet of Things

Publications (1)

Publication Number Publication Date
CN110113421A true CN110113421A (en) 2019-08-09

Family

ID=67489035

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201910383693.XA Pending CN110113421A (en) 2019-05-08 2019-05-08 A kind of big data information processing system based on Internet of Things

Country Status (1)

Country Link
CN (1) CN110113421A (en)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111526056A (en) * 2020-04-28 2020-08-11 汇智道晟(舟山)科技有限公司 Internet of things data transmission method, gateway and Internet of things system
CN112164154A (en) * 2020-09-23 2021-01-01 吉林大学 Traffic transportation energy consumption big data information processing system

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104506352A (en) * 2014-12-24 2015-04-08 福建江夏学院 Internet-of-things data preprocessing method and system
CN106708815A (en) * 2015-07-15 2017-05-24 中兴通讯股份有限公司 Data processing method, device and system
CN106982101A (en) * 2017-03-28 2017-07-25 深圳信息职业技术学院 A kind of method for realizing frequency modulation broadcasting real-time information interaction, device and system
CN108076053A (en) * 2017-11-24 2018-05-25 国网天津市电力公司电力科学研究院 A kind of real-time traffic towards wireless internet of things is intercepted and abnormity early warning system and method

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104506352A (en) * 2014-12-24 2015-04-08 福建江夏学院 Internet-of-things data preprocessing method and system
CN106708815A (en) * 2015-07-15 2017-05-24 中兴通讯股份有限公司 Data processing method, device and system
CN106982101A (en) * 2017-03-28 2017-07-25 深圳信息职业技术学院 A kind of method for realizing frequency modulation broadcasting real-time information interaction, device and system
CN108076053A (en) * 2017-11-24 2018-05-25 国网天津市电力公司电力科学研究院 A kind of real-time traffic towards wireless internet of things is intercepted and abnormity early warning system and method

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
李云玮,马蕾: ""基于SVM的物联网大数据有效信息过滤挖掘"", 《控制工程》 *

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111526056A (en) * 2020-04-28 2020-08-11 汇智道晟(舟山)科技有限公司 Internet of things data transmission method, gateway and Internet of things system
CN112164154A (en) * 2020-09-23 2021-01-01 吉林大学 Traffic transportation energy consumption big data information processing system

Similar Documents

Publication Publication Date Title
CN108667725A (en) A kind of industrial AnyRouter and implementation method based on a variety of accesses and edge calculations
CN107612740A (en) A kind of daily record monitoring system and method under distributed environment
CN102932195B (en) A kind of business diagnosis method for supervising of protocal analysis Network Based and system
CN105528280B (en) System log and health monitoring relationship determine the method and system of log alarm grade
CN110113421A (en) A kind of big data information processing system based on Internet of Things
CN110392039A (en) Network system events source tracing method and system based on log and flow collection
CN106713351B (en) Secure communication method and device based on serial server
CN105824837A (en) Log treatment method and device
CN107682395A (en) A kind of big data cloud computing runtime and method
CN109977700A (en) A kind of big data processing system based on network security
CN106682461A (en) Big data analysis system applying computer verification code technique
CN104778177A (en) Data processing method and device
CN106817262A (en) A kind of log analysis device
CN106096060A (en) Ocean network security risk system of defense
CN107679097A (en) A kind of distributed data processing method, system and storage medium
CN111431821A (en) Method for rapidly detecting and identifying specific information in network large flow
CN105446707A (en) Data conversion method
CN113986990A (en) Data resource acquisition and labeling method and device based on block chain data mining
CN107274292A (en) A kind of investment management of enterprises system
CN107391695A (en) A kind of information extracting method based on big data
CN113159721A (en) Internet of things platform based on full life cycle of equipment
CN113032435A (en) Data processing method and device for risk assessment
CN112860811A (en) Method and device for determining data blood relationship, electronic equipment and storage medium
CN111077861A (en) Remote operation and maintenance system of intelligent factory
CN108449425A (en) A kind of monitoring system of machine and its method based on Internet of Things

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
RJ01 Rejection of invention patent application after publication

Application publication date: 20190809

RJ01 Rejection of invention patent application after publication