CN111625573A - Big data analysis system - Google Patents
Big data analysis system Download PDFInfo
- Publication number
- CN111625573A CN111625573A CN201910146568.7A CN201910146568A CN111625573A CN 111625573 A CN111625573 A CN 111625573A CN 201910146568 A CN201910146568 A CN 201910146568A CN 111625573 A CN111625573 A CN 111625573A
- Authority
- CN
- China
- Prior art keywords
- data
- module
- analysis
- data analysis
- instruction
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000007405 data analysis Methods 0.000 title claims abstract description 76
- 238000004458 analytical method Methods 0.000 claims abstract description 49
- 238000013500 data storage Methods 0.000 claims abstract description 17
- 238000007619 statistical method Methods 0.000 claims abstract description 11
- 230000005540 biological transmission Effects 0.000 claims abstract description 10
- 238000012544 monitoring process Methods 0.000 claims description 8
- 238000004891 communication Methods 0.000 claims description 6
- 238000010276 construction Methods 0.000 claims description 6
- 238000001514 detection method Methods 0.000 claims description 6
- 238000006243 chemical reaction Methods 0.000 claims description 3
- 238000000034 method Methods 0.000 description 3
- 230000007547 defect Effects 0.000 description 2
- 238000012545 processing Methods 0.000 description 2
- 238000003860 storage Methods 0.000 description 2
- 230000000007 visual effect Effects 0.000 description 2
- 230000009286 beneficial effect Effects 0.000 description 1
- 230000015572 biosynthetic process Effects 0.000 description 1
- 238000012790 confirmation Methods 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 238000004141 dimensional analysis Methods 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 238000007726 management method Methods 0.000 description 1
- 238000005065 mining Methods 0.000 description 1
- 238000011160 research Methods 0.000 description 1
- 238000012800 visualization Methods 0.000 description 1
Images
Abstract
The invention discloses a big data analysis system, which comprises a data acquisition module, a data transmission module, a data storage module, a data analysis server and a terminal, wherein the data acquisition module is used for acquiring data; the data analysis server is used for selecting a corresponding analysis method according to a data analysis instruction input by the terminal to perform statistical analysis on the data received from the data storage module and sending a data analysis result after the statistical analysis to the terminal equipment; the terminal is used for transmitting the data analysis requirement to the data analysis server and receiving the data analysis result sent by the data analysis server. The invention has reasonable design, realizes the centralization of functions such as data analysis and the like by deeply analyzing the data analysis requirements in multiple aspects and constructing an analysis method, thereby reducing the complexity of data analysis and having intuitive and diversified analysis result display forms.
Description
Technical Field
The invention relates to a big data analysis system, and belongs to the technical field of data analysis.
Background
With the rapid development of informatization, big data come into play, and a big data technology refers to a data set which is large in scale and greatly exceeds the capability range of a traditional database software tool in the aspects of acquisition, storage, management and analysis, and has the four characteristics of massive data scale, rapid data circulation, various data types and low value density. The formation of data diversity is mainly due to two reasons: the method has the advantages that firstly, the data sources are multiple, and a search engine, a social network, call records, sensors and the like are available; and secondly, the data format is multiple, and the data format comprises structural data, semi-structural data and non-structural data. In order to overcome the defect that the traditional method cannot process large data with large quantity and non-structure, people research out cloud computing, information storage, sharing and mining means based on the cloud computing, and can cheaply and effectively store the large data of the large-quantity, high-speed and variable terminals.
The strategic significance of big data counting is not to grasp huge data information, but to perform specialized analysis processing on the meaningful data, in other words, if big data is compared with an industry, the key to realizing the profit of the industry is to analyze the data accurately, improve the processing and analyzing capability and the visualization degree of the data, and realize value increase.
Disclosure of Invention
The invention aims to solve the defects in the prior art, and provides a big data analysis system, which realizes the centralization of functions such as data analysis and the like by deeply analyzing data analysis requirements in multiple aspects and constructing an analysis method, thereby reducing the complexity of data analysis and having intuitive and diversified analysis result display forms.
In order to achieve the above object, the present invention provides a big data analysis system, which comprises a data acquisition module, a data transmission module, a data storage module, a data analysis server and a terminal; the data acquisition module is used for acquiring data information; the data transmission module is used for transmitting the acquired data information to the data storage module; the data storage module is used for storing data information; the data analysis server is used for selecting a corresponding analysis method according to a data analysis instruction input by the terminal to perform statistical analysis on the data received from the data storage module and sending a data analysis result after the statistical analysis to the terminal equipment; the terminal is used for transmitting the data analysis requirement to the data analysis server and receiving the data analysis result sent by the data analysis server; the data analysis server includes: the system comprises a data monitoring module, a data sorting system, an instruction analyzing module and a data analyzing module; the data monitoring module is used for separating the data stored by the data storage module from the terminal and setting different authorities for different users; the data sorting module is used for sorting and sorting the data; the instruction analysis module is used for analyzing the data analysis requirement of the terminal equipment; the data analysis module is used for carrying out statistical analysis on the classified and sorted data to obtain a data analysis result; the terminal comprises an instruction input module and an analysis result display module, wherein the analysis result display module comprises a data report display module and a voice conversion module.
As an improvement to the above technical solution, the data sorting system includes a data detection module and a data classification module, wherein the data detection module is configured to perform discrimination between valid data and invalid data on received data, and input the valid data to the data classification module; and the data classification module is used for classifying and sorting the marked data.
As an improvement to the above technical solution, the data transmission module includes a wireless communication module and a communication cable.
As an improvement to the above technical solution, the data analysis module includes an analysis requirement confirmation module, a physical modeling module, a logical modeling module, and an analysis method dynamic construction module; the analysis requirement confirming module is used for confirming analysis requirements; the physical modeling module is used for constructing a physical model according to the analysis requirement confirmed by the analysis requirement confirming module; the logic modeling module is used for building a logic model according to the physical model built by the physical modeling module; and the analysis method dynamic construction module is used for dynamically constructing an analysis method according to the logic model constructed by the logic modeling module.
As an improvement to the above technical solution, the instruction parsing module includes an instruction content module and an instruction destination module; the instruction content module is used for confirming a keyword of an instruction; the instruction destination module is used for confirming the purpose of creating the instruction.
Compared with the prior art, the invention has the beneficial effects that: through data monitoring module sets up different users 'authority, has guaranteed the security of data, instruction analysis module carries out the multidimension degree to the instruction and resolves, can accurate positioning instruction's purpose, simultaneously analysis result display module carries out visual show and pronunciation broadcast to the analysis result.
Drawings
The drawings illustrate preferred embodiments of the invention without limiting the scope of the invention's application.
Fig. 1 is a flow chart of a big data analysis system program module system according to the present invention.
Fig. 2 is a system flow chart of program modules of a data sorting system of a big data analysis system according to the present invention.
Fig. 3 is a system flow chart of program modules of a data analysis module of a big data analysis system according to the present invention.
Fig. 4 is a system flow chart of a program module of an instruction parsing module of the big data analysis system according to the present invention.
Detailed Description
The present invention will be described in detail below with reference to specific embodiments shown in the drawings. These embodiments are not intended to limit the present invention, and structural, methodological, or functional changes made by those skilled in the art according to these embodiments are included in the scope of the present invention.
In the present invention, the term "comprising" is to be understood as open-ended, i.e. including but not limited to, unless explicitly stated or limited otherwise.
Fig. 1 is a flow chart of a big data analysis system program module system according to the present invention. The big data analysis system comprises a data acquisition module, a data transmission module, a data storage module, a data analysis server and a terminal; the data acquisition module is used for acquiring data information; the data transmission module is used for transmitting the acquired data information to the data storage module; the data storage module is used for storing data information; the data analysis server is used for selecting a corresponding analysis method according to a data analysis instruction input by the terminal to perform statistical analysis on the data received from the data storage module and sending a data analysis result after the statistical analysis to the terminal equipment; the terminal is used for transmitting the data analysis requirement to the data analysis server and receiving the data analysis result sent by the data analysis server; the data analysis server includes: the system comprises a data monitoring module, a data sorting system, an instruction analyzing module and a data analyzing module; the data monitoring module is used for separating the data stored by the data storage module from the terminal and setting different authorities for different users; the data sorting module is used for sorting and sorting the data; the instruction analysis module is used for analyzing the data analysis requirement of the terminal equipment; the data analysis module is used for carrying out statistical analysis on the classified and sorted data to obtain a data analysis result; the terminal comprises an instruction input module and an analysis result display module, wherein the analysis result display module comprises a data report display module and a voice conversion module. According to the invention, the data monitoring module is used for setting the authorities of different users, so that the data security is ensured, the instruction analysis module is used for carrying out multi-dimensional analysis on the instruction, the purpose of accurately positioning the instruction can be achieved, and meanwhile, the analysis result display module is used for carrying out visual display and voice playing on the analysis result.
Fig. 2 is a system flow chart of program modules of a data sorting system of a big data analysis system according to the present invention. In the above embodiment, preferably, the data sorting system includes a data detection module and a data classification module, and the data detection module is configured to perform discrimination between valid data and invalid data on received data, and input the valid data to the data classification module; and the data classification module is used for classifying and sorting the marked data.
In the above embodiment, preferably, the data transmission module includes a wireless communication module and a communication cable.
Fig. 3 is a system flow chart of program modules of a data analysis module of a big data analysis system according to the present invention. In the above embodiment, preferably, the data analysis module includes an analysis requirement confirming module, a physical modeling module, a logic modeling module and an analysis method dynamic construction module; the analysis requirement confirming module is used for confirming analysis requirements; the physical modeling module is used for constructing a physical model according to the analysis requirement confirmed by the analysis requirement confirming module; the logic modeling module is used for building a logic model according to the physical model built by the physical modeling module; and the analysis method dynamic construction module is used for dynamically constructing an analysis method according to the logic model constructed by the logic modeling module.
Fig. 4 is a system flow chart of program modules of an instruction parsing module of a big data analysis system according to the present invention. In the above embodiment, preferably, the instruction parsing module includes an instruction content module and an instruction destination module; the instruction content module is used for confirming a keyword of an instruction; the instruction destination module is used for confirming the purpose of creating the instruction.
The above embodiments are merely exemplary and not restrictive, and any equivalent embodiments made without departing from the spirit of the present invention should fall within the scope of the present invention.
Claims (5)
1. A big data analysis system is characterized by comprising a data acquisition module, a data transmission module, a data storage module, a data analysis server and a terminal; the data acquisition module is used for acquiring data information; the data transmission module is used for transmitting the acquired data information to the data storage module; the data storage module is used for storing data information; the data analysis server is used for selecting a corresponding analysis method according to a data analysis instruction input by the terminal to perform statistical analysis on the data received from the data storage module and sending a data analysis result after the statistical analysis to the terminal equipment; the terminal is used for transmitting the data analysis requirement to the data analysis server and receiving the data analysis result sent by the data analysis server; the data analysis server includes: the system comprises a data monitoring module, a data sorting system, an instruction analyzing module and a data analyzing module; the data monitoring module is used for separating the data stored by the data storage module from the terminal and setting different authorities for different users; the data sorting module is used for sorting and sorting the data; the instruction analysis module is used for analyzing the data analysis requirement of the terminal equipment; the data analysis module is used for carrying out statistical analysis on the classified and sorted data to obtain a data analysis result; the terminal comprises an instruction input module and an analysis result display module, wherein the analysis result display module comprises a data report display module and a voice conversion module.
2. The big data analysis system according to claim 1, wherein the data sorting system comprises a data detection module and a data classification module, wherein the data detection module is used for identifying valid data and invalid data of the received data and inputting the valid data to the data classification module; and the data classification module is used for classifying and sorting the marked data.
3. The big data analysis system of claim 1, wherein the data transmission module comprises a wireless communication module and a communication cable.
4. The big data analysis system according to claim 1, wherein the data analysis module comprises an analysis requirement confirming module, a physical modeling module, a logic modeling module and an analysis method dynamic construction module; the analysis requirement confirming module is used for confirming analysis requirements; the physical modeling module is used for constructing a physical model according to the analysis requirement confirmed by the analysis requirement confirming module; the logic modeling module is used for building a logic model according to the physical model built by the physical modeling module; and the analysis method dynamic construction module is used for dynamically constructing an analysis method according to the logic model constructed by the logic modeling module.
5. The big data analysis system according to claim 1, wherein the command parsing module comprises a command content module, a command destination module; the instruction content module is used for confirming a keyword of an instruction; the instruction destination module is used for confirming the purpose of creating the instruction.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910146568.7A CN111625573A (en) | 2019-02-27 | 2019-02-27 | Big data analysis system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910146568.7A CN111625573A (en) | 2019-02-27 | 2019-02-27 | Big data analysis system |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN111625573A true CN111625573A (en) | 2020-09-04 |
Family
ID=72270762
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201910146568.7A Pending CN111625573A (en) | 2019-02-27 | 2019-02-27 | Big data analysis system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN111625573A (en) |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113347276A (en) * | 2021-07-07 | 2021-09-03 | 南京大学城市规划设计研究院有限公司深圳分公司 | Mobile access system based on GIS |
| CN115470251A (en) * | 2022-08-23 | 2022-12-13 | 陕西天诚软件有限公司 | Big data analysis display device |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104657475A (en) * | 2015-02-16 | 2015-05-27 | 百度在线网络技术（北京）有限公司 | Method and system for data analysis |
| CN106886612A (en) * | 2017-04-21 | 2017-06-23 | 厦门华厦学院 | A kind of big data acquisition analysis system |
| CN106992009A (en) * | 2017-05-03 | 2017-07-28 | 深圳车盒子科技有限公司 | Vehicle-mounted voice exchange method, system and computer-readable recording medium |
| CN107656974A (en) * | 2017-09-05 | 2018-02-02 | 北京天平检验行有限公司 | A kind of big data analysis system |
-
2019
- 2019-02-27 CN CN201910146568.7A patent/CN111625573A/en active Pending
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104657475A (en) * | 2015-02-16 | 2015-05-27 | 百度在线网络技术（北京）有限公司 | Method and system for data analysis |
| CN106886612A (en) * | 2017-04-21 | 2017-06-23 | 厦门华厦学院 | A kind of big data acquisition analysis system |
| CN106992009A (en) * | 2017-05-03 | 2017-07-28 | 深圳车盒子科技有限公司 | Vehicle-mounted voice exchange method, system and computer-readable recording medium |
| CN107656974A (en) * | 2017-09-05 | 2018-02-02 | 北京天平检验行有限公司 | A kind of big data analysis system |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113347276A (en) * | 2021-07-07 | 2021-09-03 | 南京大学城市规划设计研究院有限公司深圳分公司 | Mobile access system based on GIS |
| CN115470251A (en) * | 2022-08-23 | 2022-12-13 | 陕西天诚软件有限公司 | Big data analysis display device |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN107656974B (en) | Big data analysis system | |
| WO2021159834A1 (en) | Abnormal information processing node analysis method and apparatus, medium and electronic device | |
| CN115661553A (en) | BIM-based rail transit member classification method, system and equipment | |
| CN111625573A (en) | Big data analysis system | |
| CN110011962A (en) | A kind of recognition methods of car networking business datum | |
| CN116055448A (en) | Identification data management platform for electric power operation | |
| CN111125450A (en) | Management method of multilayer topology network resource object | |
| CN106055641A (en) | Human-computer interaction method and device oriented to intelligent robot | |
| CN107169722A (en) | A kind of complete intelligent tracing management system of official document operating and method | |
| CN112967759B (en) | DNA material evidence identification STR typing comparison method based on memory stack technology | |
| CN111026940A (en) | Network public opinion and risk information monitoring system and electronic equipment for power grid electromagnetic environment | |
| CN113344393B (en) | Resource construction method based on V model product development process | |
| CN107992590B (en) | Big data system beneficial to information comparison | |
| CN113705623A (en) | Rail transit station classification method and device | |
| CN115438629A (en) | Data processing method, data processing device, storage medium and electronic equipment | |
| CN112905797A (en) | Scenic spot multi-dimensional vulnerability assessment method based on MNLP | |
| CN106157651B (en) | A kind of traffic radio traffic information broadcasting system based on voice semantic understanding | |
| CN116362462B (en) | Full-closed-loop production management system based on Internet of things and big data analysis | |
| Liu et al. | Data Acquisition, Hot Issues and System of Microblog Mining | |
| CN116186019B (en) | Function integrated intelligent analysis method and device applied to civil aircraft avionics system | |
| CN109635074A (en) | A kind of entity relationship analysis method and terminal device based on public feelings information | |
| CN109165276A (en) | Self-service questionnaire logic design method and system based on natural language | |
| CN113422816A (en) | Big data information analysis system based on cloud computing | |
| CN116127074B (en) | Anchor image classification method based on LDA theme model and kmeans clustering algorithm | |
| CN107526818A (en) | One kind is based on enterprise's private clound big data processing system and method |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |