CN109672577A - A kind of acquisition analysis system suitable for big data - Google Patents
A kind of acquisition analysis system suitable for big data Download PDFInfo
- Publication number
- CN109672577A CN109672577A CN201710954214.6A CN201710954214A CN109672577A CN 109672577 A CN109672577 A CN 109672577A CN 201710954214 A CN201710954214 A CN 201710954214A CN 109672577 A CN109672577 A CN 109672577A
- Authority
- CN
- China
- Prior art keywords
- data
- module
- acquisition
- big data
- database
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Withdrawn
Links
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L43/00—Arrangements for monitoring or testing data switching networks
- H04L43/02—Capturing of monitoring data
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L43/00—Arrangements for monitoring or testing data switching networks
- H04L43/04—Processing captured monitoring data, e.g. for logfile generation
- H04L43/045—Processing captured monitoring data, e.g. for logfile generation for graphical visualisation of monitoring data
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L43/00—Arrangements for monitoring or testing data switching networks
- H04L43/06—Generation of reports
- H04L43/062—Generation of reports related to network traffic
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L43/00—Arrangements for monitoring or testing data switching networks
- H04L43/12—Network monitoring probes
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/10—Protocols in which an application is distributed across nodes in the network
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/10—Protocols in which an application is distributed across nodes in the network
- H04L67/1097—Protocols in which an application is distributed across nodes in the network for distributed storage of data in networks, e.g. transport arrangements for network file system [NFS], storage area networks [SAN] or network attached storage [NAS]
Landscapes
- Engineering & Computer Science (AREA)
- Computer Networks & Wireless Communication (AREA)
- Signal Processing (AREA)
- Data Mining & Analysis (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
The invention discloses a kind of acquisition analysis systems suitable for big data, characterized in that including server, master controller and terminal node；The master controller is connected with server and terminal node respectively by network；Each terminal node includes sequentially connected acquisition module, processing module, analysis module, evaluation module and memory module；The acquisition module is used to be acquired integration to data according to the acquisition method being previously set；The information that the processing module is used to acquire acquisition module after integration carries out effective information extraction, and forms data flow；The analysis module is for analyzing the data in data flow.Advantageous effects of the invention: the acquisition of big data is assigned on each node by this system, the processing of big data is turned to the processing of minor node, the low efficiency of big data disposed of in its entirety and the problem that difficulty is big can not only be alleviated, additionally it is possible to enable when handling big data more comprehensive carry out analytical integration in place.
Description
Technical field
The present invention relates to a kind of acquisition analysis systems suitable for big data, belong to big data processing technology field.
Background technique
With the arriving of big data, many industries, which are all highly desirable to, carries out comprehensive processing to big data.And currently,
Very high due to requiring for the analysis processing of big data in the prior art, information content is huge, deals with and is difficult with very comprehensively
In place.
Summary of the invention
To solve the deficiencies in the prior art, the purpose of the present invention is to provide a kind of collection analysis systems suitable for big data
System, is able to solve the inefficient problem of current big data collection analysis.
In order to achieve the above objectives, the present invention adopts the following technical scheme that:
A kind of acquisition analysis system suitable for big data, characterized in that including server, master controller and terminal section
Point；The master controller is connected with server and terminal node respectively by network；The terminal node is provided with several；
Each terminal node includes sequentially connected acquisition module, processing module, analysis module, evaluation module and memory module；
The acquisition module is used to be acquired integration to data according to the acquisition method being previously set；The processing module will be for that will adopt
Collection module acquires the information after integration and carries out effective information extraction, and forms data flow；The analysis module is used for data
Data in stream are analyzed；The evaluation module forms data and is classified for assessing data；The memory module
For by evaluation module, treated that data store, and transmitted by network.
A kind of acquisition analysis system suitable for big data above-mentioned, characterized in that the server uses three-layered node mould
Formula B/S framework service device.
3. a kind of acquisition analysis system suitable for big data according to claim 1, characterized in that the service
It include database in device, the database is divided into first database, the second database and backup database；First data
Library is used to store current and toward data interior for the previous period；Second database is used for store historical data；It is described standby
Part database is for backing up all data.
A kind of acquisition analysis system suitable for big data above-mentioned, characterized in that each terminal node also matches
There are human-computer interaction interface and human-machine operation module.
A kind of acquisition analysis system suitable for big data above-mentioned, characterized in that the analysis module is being analyzed
Before, data classification is carried out to data.
A kind of acquisition analysis system suitable for big data above-mentioned, characterized in that the data classification is drawn using figure
Method processed.
Advantageous effects of the invention: the acquisition of big data is assigned on each node by this system, by big data
Processing turn to the processing of minor node, the low efficiency of big data disposed of in its entirety and the problem that difficulty is big can not only be alleviated, also
Enabling to being capable of more comprehensive carry out analytical integration in place when handling big data.
Specific embodiment
The invention will be further described below.Following embodiment is only used for clearly illustrating technical side of the invention
Case, and not intended to limit the protection scope of the present invention.
A kind of acquisition analysis system suitable for big data of the present invention, including server, master controller and terminal
Node.Master controller is connected with server and terminal node respectively by network.Terminal node is provided with several.
Each terminal node includes sequentially connected acquisition module, processing module, analysis module, evaluation module and storage mould
Block.
Acquisition module is used to be acquired integration to data according to the acquisition method being previously set.
The information that processing module is used to acquire acquisition module after integration carries out effective information extraction, and forms data
Stream.
Analysis module is for analyzing the data in data flow.
Evaluation module forms data and is classified for assessing data.
Memory module is used for that treated that data store by evaluation module, and is transmitted by network.
Server uses three-layered node Mode B/S framework service device.It include database in server, the database is divided into
First database, the second database and backup database；The first database is current and toward for the previous period for storing
Interior data；Second database is used for store historical data；The backup database is for backing up all data.
Each terminal node is also matched with human-computer interaction interface and human-machine operation module, in order to improve whole spirit
Activity.Analysis module carries out data classification before being analyzed, to data.Data classification uses pattern drawing method.
The above is only a preferred embodiment of the present invention, it is noted that for the ordinary skill people of the art
For member, without departing from the technical principles of the invention, several improvement and deformations can also be made, these improvement and deformations
Also it should be regarded as protection scope of the present invention.
Claims (6)
1. a kind of acquisition analysis system suitable for big data, characterized in that including server, master controller and terminal node；
The master controller is connected with server and terminal node respectively by network；The terminal node is provided with several；Often
A terminal node includes sequentially connected acquisition module, processing module, analysis module, evaluation module and memory module；
The acquisition module is used to be acquired integration to data according to the acquisition method being previously set；
The information that the processing module is used to acquire acquisition module after integration carries out effective information extraction, and forms data
Stream；
The analysis module is for analyzing the data in data flow；
The evaluation module forms data and is classified for assessing data；
The memory module is used for that treated that data store by evaluation module, and is transmitted by network.
2. a kind of acquisition analysis system suitable for big data according to claim 1, characterized in that the server is adopted
With three-layered node Mode B/S framework service device.
3. a kind of acquisition analysis system suitable for big data according to claim 1, characterized in that in the server
It include database, the database is divided into first database, the second database and backup database；The first database is used
In storage currently and toward data interior for the previous period；Second database is used for store historical data；The backup number
According to library for backing up all data.
4. a kind of acquisition analysis system suitable for big data according to claim 1, characterized in that each terminal
Node is also matched with human-computer interaction interface and human-machine operation module.
5. a kind of acquisition analysis system suitable for big data according to claim 1, characterized in that the analysis module
Before being analyzed, data classification is carried out to data.
6. a kind of acquisition analysis system suitable for big data according to claim 5, characterized in that the data classification
Using pattern drawing method.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710954214.6A CN109672577A (en) | 2017-10-13 | 2017-10-13 | A kind of acquisition analysis system suitable for big data |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710954214.6A CN109672577A (en) | 2017-10-13 | 2017-10-13 | A kind of acquisition analysis system suitable for big data |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN109672577A true CN109672577A (en) | 2019-04-23 |
Family
ID=66138882
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201710954214.6A Withdrawn CN109672577A (en) | 2017-10-13 | 2017-10-13 | A kind of acquisition analysis system suitable for big data |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN109672577A (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113486125A (en) * | 2021-06-29 | 2021-10-08 | 北京德风新征程科技有限公司 | Industrial internet big data information processing terminal |
-
2017
- 2017-10-13 CN CN201710954214.6A patent/CN109672577A/en not_active Withdrawn
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113486125A (en) * | 2021-06-29 | 2021-10-08 | 北京德风新征程科技有限公司 | Industrial internet big data information processing terminal |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| McCreadie et al. | Scalable distributed event detection for twitter | |
| CN104112026A (en) | Short message text classifying method and system | |
| CN106126601A (en) | A kind of social security distributed preprocess method of big data and system | |
| CN105955876B (en) | Data monitoring processing method and device | |
| CN105608144A (en) | Big data analysis platform device and method based on multilayer model iteration | |
| US8224622B2 (en) | Method and apparatus for distribution-independent outlier detection in streaming data | |
| CN206039665U (en) | Intelligence equipment inspection system | |
| CN105511812A (en) | Method and device for optimizing big data of memory system | |
| CN112462012A (en) | Intelligent cloud system for food safety monitoring | |
| CN111737549B (en) | Economic index intelligent analysis system | |
| CN109672577A (en) | A kind of acquisition analysis system suitable for big data | |
| CN110555138B (en) | Hybrid cloud storage method under cloud computing architecture | |
| CN111259000A (en) | Data cleaning method | |
| CN104333732A (en) | Distributed video analysis method and system thereof | |
| CN102752582A (en) | Intelligent video analysis system and method | |
| CN102201922A (en) | Data charging method and relevant apparatus | |
| CN104239537A (en) | Method for realizing generating and processing flow for large-data pre-processing text data | |
| CN103812676A (en) | Apparatus and method for realizing log data real-time association | |
| CN110647845A (en) | Invoice data identification device, related method and related device | |
| CN105843724B (en) | A kind of IT system monitoring state index compression analysis method | |
| CN104679819A (en) | Data analysis method and system of spot resources for steel trading industry | |
| CN204576174U (en) | A kind of digital device intelligent identification device | |
| CN112487850A (en) | Judicial place quick roll call method based on artificial intelligence face recognition | |
| CN106503263A (en) | A kind of E-Government news is gathered and edited method automatically | |
| CN103365994A (en) | Data storage method and device based on flexible testing technology |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| WW01 | Invention patent application withdrawn after publication |
Application publication date: 20190423 |
|
| WW01 | Invention patent application withdrawn after publication |