CN112364211A - Information release statistical system and method based on cloud platform - Google Patents
Information release statistical system and method based on cloud platform Download PDFInfo
- Publication number
- CN112364211A CN112364211A CN202011166610.0A CN202011166610A CN112364211A CN 112364211 A CN112364211 A CN 112364211A CN 202011166610 A CN202011166610 A CN 202011166610A CN 112364211 A CN112364211 A CN 112364211A
- Authority
- CN
- China
- Prior art keywords
- information
- data
- cloud platform
- data storage
- stored
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 17
- 238000013500 data storage Methods 0.000 claims abstract description 40
- 238000007781 pre-processing Methods 0.000 claims abstract description 10
- 238000012216 screening Methods 0.000 claims abstract description 10
- 238000007726 management method Methods 0.000 claims abstract description 4
- 238000012163 sequencing technique Methods 0.000 claims abstract description 4
- 238000001914 filtration Methods 0.000 claims abstract description 3
- 238000004891 communication Methods 0.000 claims description 10
- 238000004458 analytical method Methods 0.000 claims description 7
- 238000003066 decision tree Methods 0.000 claims description 7
- 230000001364 causal effect Effects 0.000 claims description 3
- 238000004140 cleaning Methods 0.000 claims description 2
- 230000009466 transformation Effects 0.000 claims description 2
- 230000005540 biological transmission Effects 0.000 abstract description 20
- 238000007619 statistical method Methods 0.000 abstract description 5
- 238000010586 diagram Methods 0.000 description 3
- 230000003993 interaction Effects 0.000 description 2
- 238000012545 processing Methods 0.000 description 2
- 230000009286 beneficial effect Effects 0.000 description 1
- 238000006243 chemical reaction Methods 0.000 description 1
- 238000007405 data analysis Methods 0.000 description 1
- 238000013480 data collection Methods 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/90—Details of database functions independent of the retrieved data types
- G06F16/903—Querying
- G06F16/9035—Filtering based on additional data, e.g. user or group profiles
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/90—Details of database functions independent of the retrieved data types
- G06F16/903—Querying
- G06F16/90335—Query processing
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
- G06F3/0601—Interfaces specially adapted for storage systems
- G06F3/0628—Interfaces specially adapted for storage systems making use of a particular technique
- G06F3/0646—Horizontal data movement in storage systems, i.e. moving data in between storage devices or systems
- G06F3/0652—Erasing, e.g. deleting, data cleaning, moving of data to a wastebasket
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Databases & Information Systems (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Computational Linguistics (AREA)
- Data Mining & Analysis (AREA)
- Human Computer Interaction (AREA)
- Data Exchanges In Wide-Area Networks (AREA)
Abstract
The invention discloses an information publishing statistical system and method based on a cloud platform, belonging to the technical field of information publishing, and comprising acquisition equipment, a data preprocessor, a data manager, a data memory, a data analyzer and a data cleaner, wherein: the acquisition equipment is used for acquiring the published information in real time; the data preprocessor is used for preprocessing the information collected in real time, screening out useless information and filtering out the useless information; the data manager is used for carrying out sequencing management on the preprocessed information according to a certain algorithm. The information issuing statistical system and the information issuing statistical method based on the cloud platform are convenient for users to know the issuing condition of the information in real time and make corresponding decisions for the information issued based on the cloud platform, are convenient to use, can avoid the condition that the information cannot be stored due to the fact that the storage space of a data storage is full, can effectively ensure the smooth proceeding of information transmission, effectively improve the information transmission efficiency and optimize the storage space resources.
Description
Technical Field
The invention relates to the technical field of information release, in particular to an information release statistical system and method based on a cloud platform.
Background
The cloud computing platform is also called a cloud platform, and is a service based on hardware resources and software resources, and provides computing, network and storage capabilities. Cloud computing platforms can be divided into 3 classes: the cloud computing platform comprises a storage type cloud platform taking data storage as a main part, a computing type cloud platform taking data processing as a main part and a comprehensive cloud computing platform taking computing and data storage processing into consideration.
At present, for the published information, due to the lack of a corresponding statistical method, a user cannot know the publishing condition of the information in real time and cannot make a corresponding decision, so that the use is inconvenient and great burden is brought to the user.
Disclosure of Invention
The invention aims to provide an information issuing statistical system and method based on a cloud platform, which are convenient for users to know the issuing condition of information in real time and make corresponding decisions for the information issued based on the cloud platform, are convenient to use, can avoid the condition that a data memory cannot store the information due to the fact that the storage space is full, can effectively ensure the smooth proceeding of information transmission, effectively improve the information transmission efficiency, optimize the storage space resources and solve the problems in the background technology.
In order to achieve the purpose, the invention provides the following technical scheme:
the utility model provides an information issuing statistical system based on cloud platform, includes collection equipment, data preprocessor, data manager, data memory, data analysis appearance and data cleaner, wherein:
the acquisition equipment is used for acquiring the published information in real time;
the data preprocessor is used for preprocessing the information collected in real time, screening out useless information and filtering out the useless information;
the data manager is used for carrying out sequencing management on the preprocessed information according to a certain algorithm;
the data memory is used for storing the sequenced information;
the data analyzer is used for analyzing and counting the information stored in the data memory;
the data cleaner is used for correspondingly cleaning the information after the data memory is full and storing new information into the data memory.
Furthermore, the acquisition equipment and the data preprocessor perform communication transmission in a simplex communication mode through a wireless network, the data preprocessor performs data transmission with the data manager through an RS485 protocol, the data manager performs data interaction with the data storage through an RS232 protocol, the data storage performs data transmission with the data analyzer through a USB data line, and the data storage and the data cleaner perform communication transmission in a half-duplex communication mode.
According to another aspect of the present invention, there is provided an information distribution statistics method for an information distribution statistics system based on a cloud platform, including the following steps:
s10: the acquisition equipment is provided with a plurality of data acquisition interfaces, and can acquire various types of information issued based on the cloud platform through different data acquisition interfaces and transmit the acquired information to the data preprocessor;
s20: after receiving the collected information, the data preprocessor performs preliminary preprocessing on the collected information, filters useless information by screening the information, only leaves useful information, and transmits the useful information to the data manager;
s30: the data manager manages the screened information, sorts the information according to a certain algorithm, and transmits the information waiting for storage to the data storage;
s40: after receiving the information waiting for storage, the data storage stores the information into the data storage, and transmits the stored information to the data analyzer:
s50: the data analyzer can analyze the information stored in the data memory, and count the analyzed information;
s60: in the process of storing information, the data cleaner can correspondingly clean the information which is full stored in the data memory and store new information into the data memory.
Further, the information in S20 is preprocessed by clustering, transformation, frequent itemsets, statistical description, link prediction, and causal analysis.
Further, the information in S30 is sorted in a clustering manner, and the sorted information is compressed and fused and then stored in the data storage 400.
Further, in S50, a decision tree algorithm is used for statistics.
Compared with the prior art, the invention has the beneficial effects that:
1. the invention relates to a statistical system and a statistical method for information release based on a cloud platform, which can collect various types of information released based on the cloud platform through different data collecting interfaces arranged on collecting equipment, and transmit the collected information to a data preprocessor, the data preprocessor receives the collected information and carries out preliminary preprocessing on the collected information, filters out useless information by screening the information, only leaves useful information and transmits the useful information to a data manager, the data manager manages the screened information, sorts the information according to a certain algorithm and transmits the information to be stored to a data memory, the data memory stores the information to be stored into the data memory after receiving the information to be stored, and transmits the stored information to a data analyzer, and the data analyzer can analyze the information stored in the data memory, after analysis, statistics is carried out by adopting a decision tree algorithm, and for information issued based on the cloud platform, a user can conveniently know the issuing condition of the information in real time and make a corresponding decision, so that the use is convenient.
2. According to the information release statistical system and method based on the cloud platform, the data cleaner correspondingly deletes the information which is fully stored in the data memory according to the priority algorithm, and then stores the received new information in the data memory, so that the situation that the information cannot be stored in the data memory due to the fact that the storage space of the data memory is full is avoided, smooth information transmission can be effectively guaranteed, the information transmission efficiency is effectively improved, and the storage space resource is optimized.
Drawings
Fig. 1 is a device diagram of an information distribution statistical system based on a cloud platform according to the present invention;
FIG. 2 is a block diagram of an information distribution statistical system based on a cloud platform according to the present invention;
FIG. 3 is a flow chart of the statistical method for information distribution based on the cloud platform according to the present invention;
fig. 4 is an algorithm diagram of the information distribution statistical method based on the cloud platform.
In the figure: 100. collecting equipment; 200. a data preprocessor; 300. a data manager; 400. a data storage; 500. a data analyzer; 600. and a data cleaner.
Detailed Description
The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
Referring to fig. 1-2, an information distribution statistical system based on a cloud platform includes an acquisition device 100, a data preprocessor 200, a data manager 300, a data storage 400, a data analyzer 500, and a data clearer 600, where the acquisition device 100 performs communication transmission with the data preprocessor 200 in a simplex communication manner through a wireless network, the data preprocessor 200 performs data transmission with the data manager 300 through an RS485 protocol, the data manager 300 performs data interaction with the data storage 400 through an RS232 protocol, the data storage 400 performs data transmission with the data analyzer 500 through a USB data line, and the data storage 400 further performs communication transmission with the data clearer 600 in a half-duplex communication manner, where:
the collecting device 100 is used to collect the published information in real time.
The data preprocessor 200 is used to preprocess information collected in real time and filter out useless information.
The data manager 300 is used for performing sequencing management on the preprocessed information according to a certain algorithm;
the data storage 400 is used to store the sorted information.
The data analyzer 500 is used for analyzing and counting the information stored in the data storage 400.
The data clearer 600 is used to perform corresponding clearing on the information stored in the data storage 400 and store the new information into the data storage 400.
The data pre-processor 200 receives the collected information, performs preliminary pre-processing on the collected information, filters out useless information by screening the information, only leaves useful information, and transmits the useful information to the data manager 300, the data manager 300 manages the screened information, sorts the information according to a certain algorithm, and transmits the information to be stored to the data memory 400, the data memory 400 receives the information to be stored, stores the information into the data memory 400, and transmits the stored information to the data analyzer 500, and the data analyzer 500 can analyze the information stored in the data memory 400, after analysis, statistics is carried out by adopting a decision tree algorithm, and for information issued based on the cloud platform, a user can conveniently know the issuing condition of the information in real time and make a corresponding decision, so that the use is convenient.
Referring to fig. 3 to 4, in order to better show the information publishing statistics process based on the cloud platform, the embodiment now provides an information publishing statistics method based on the cloud platform, which includes the following steps:
s10: the acquisition device 100 is provided with a plurality of data acquisition interfaces, and can acquire various types of information issued based on a cloud platform through different data acquisition interfaces and transmit the acquired information to the data preprocessor 200;
s20: the data preprocessor 200 receives the collected information, performs preliminary preprocessing on the collected information, filters useless information by screening the information, only leaves useful information, and transmits the useful information to the data manager 300, and the information in the S20 is preprocessed through clustering, conversion, frequent item set, statistical description, link prediction and causal analysis;
s30: the data manager 300 manages the screened information, sorts the information according to a certain algorithm, transmits the information to be stored to the data memory 400, sorts the information in the S30 according to a clustering mode, compresses and fuses the sorted information, and stores the information in the data memory 400;
s40: after receiving the information to be stored, the data storage 400 stores the information into the data storage 400 and transmits the stored information to the data analyzer 500:
s50: the data analyzer 500 may analyze the information stored in the data storage 400, and count the analyzed information, wherein a decision tree algorithm is used for counting in S50;
s60: in the process of storing information, the data clearer 600 can correspondingly clear the information stored in the data memory 400 and store new information into the data memory 400 through the data memory 400, and the data clearer 600 correspondingly deletes the information stored in the data memory 400 according to the priority algorithm and stores the received new information into the data memory 400, so that the situation that the data memory 400 cannot store information due to the fact that the storage space is full is avoided, smooth information transmission can be effectively guaranteed, the information transmission efficiency is effectively improved, and the storage space resources are optimized.
The working principle is as follows: the data pre-processor 200 receives the collected information, performs preliminary pre-processing on the collected information, filters out useless information by screening the information, only leaves useful information, and transmits the useful information to the data manager 300, the data manager 300 manages the screened information, sorts the information according to a certain algorithm, and transmits the information to be stored to the data memory 400, the data memory 400 receives the information to be stored, stores the information into the data memory 400, and transmits the stored information to the data analyzer 500, and the data analyzer 500 can analyze the information stored in the data memory 400, after analysis, a decision tree algorithm is adopted for statistics, for information published based on a cloud platform, a user can conveniently know the publishing condition of the information in real time and make a corresponding decision, the use is convenient, meanwhile, after the data cleaner 600 correspondingly deletes the information which is full stored in the data memory 400 according to a priority algorithm, the received new information is stored in the data memory 400, the situation that the information cannot be stored in the data memory 400 due to the fact that the storage space of the data memory 400 is full is avoided, the smooth information transmission can be effectively guaranteed, the information transmission efficiency is effectively improved, and the storage space resources are optimized.
To sum up, in the cloud platform-based information distribution statistical system and method of the present invention, various types of information distributed based on a cloud platform can be collected through different data collection interfaces arranged on the collection device 100, and the collected information is transmitted to the data preprocessor 200, the data preprocessor 200 receives the collected information, performs preliminary preprocessing on the collected information, filters out useless information by screening the information, only leaves useful information, and transmits the useful information to the data manager 300, the data manager 300 manages the screened information, sorts the information according to a certain algorithm, and transmits information to be stored to the data storage 400, the data storage 400 receives the information to be stored, stores the information into the data storage 400, and transmits the stored information to the data analyzer 500, the data analyzer 500 can analyze the information stored in the data storage 400, count the information by adopting a decision tree algorithm after analysis, facilitate a user to know the information release condition in real time and make a corresponding decision for the information released based on the cloud platform, and is convenient to use, and meanwhile, after correspondingly deleting the information full in the data storage 400 by the data cleaner 600 according to a priority algorithm, the received new information is stored in the data storage 400, so that the situation that the information cannot be stored in the data storage 400 due to the fact that the storage space is full is avoided, the smooth information transmission can be effectively ensured, the information transmission efficiency is effectively improved, and the storage space resources are optimized.
The above description is only for the preferred embodiment of the present invention, but the scope of the present invention is not limited thereto, and any person skilled in the art should be able to cover the technical solutions and the inventive concepts of the present invention within the technical scope of the present invention.
Claims (6)
1. The information release statistical system based on the cloud platform is characterized by comprising a collection device (100), a data preprocessor (200), a data manager (300), a data storage (400), a data analyzer (500) and a data cleaner (600), wherein:
the acquisition equipment (100) is used for acquiring published information in real time;
the data preprocessor (200) is used for preprocessing the information collected in real time, screening out useless information and filtering out the useless information;
the data manager (300) is used for carrying out sequencing management on the preprocessed information according to a certain algorithm;
the data memory (400) is used for storing the sorted information;
the data analyzer (500) is used for analyzing and counting the information stored in the data storage (400);
the data cleaner (600) is used for correspondingly cleaning the information after the data storage (400) is full and storing new information into the data storage (400).
2. The information distribution statistical system based on the cloud platform as claimed in claim 1, wherein the collection device (100) communicates with the data preprocessor (200) via a wireless network in a simplex communication manner, the data preprocessor (200) communicates with the data manager (300) via an RS485 protocol, the data manager (300) communicates with the data storage (400) via an RS232 protocol, the data storage (400) communicates with the data analyzer (500) via a USB data line, and the data storage (400) communicates with the data cleaner (600) in a half-duplex communication manner.
3. The information distribution statistics method based on the information distribution statistics system of the cloud platform as claimed in claim 1, characterized by comprising the following steps:
s10: the acquisition equipment (100) is provided with a plurality of data acquisition interfaces, and can acquire various types of information issued based on the cloud platform through different data acquisition interfaces and transmit the acquired information to the data preprocessor (200);
s20: after receiving the collected information, the data preprocessor (200) carries out preliminary preprocessing on the collected information, filters useless information by screening the information, only leaves useful information, and transmits the useful information to the data manager (300);
s30: the data manager (300) manages the screened information, sorts the information according to a certain algorithm, and transmits the information waiting for storage to the data storage (400);
s40: after receiving the information waiting to be stored, the data storage (400) stores the information into the data storage (400), and transmits the stored information to the data analyzer (500):
s50: the data analyzer (500) can analyze the information stored in the data memory (400), and count the analyzed information;
s60: during the process of storing information, the data memory (400) can correspondingly clear the information after the data memory (400) is full through the data clearer (600) and store new information into the data memory (400).
4. The cloud platform-based information distribution statistics system information distribution statistics method of claim 3, wherein the information in S20 is preprocessed by clustering, transformation, frequent itemsets, statistical description, link prediction and causal analysis.
5. The information distribution statistics method of the information distribution statistics system based on the cloud platform as claimed in claim 3, wherein the information in S30 is sorted in a clustering manner, and the sorted information is compressed and fused and stored in the data storage (400).
6. The information distribution statistics method of the information distribution statistics system based on the cloud platform as claimed in claim 3, wherein the statistics is performed by using a decision tree algorithm in S50.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202011166610.0A CN112364211A (en) | 2020-10-27 | 2020-10-27 | Information release statistical system and method based on cloud platform |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202011166610.0A CN112364211A (en) | 2020-10-27 | 2020-10-27 | Information release statistical system and method based on cloud platform |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN112364211A true CN112364211A (en) | 2021-02-12 |
Family
ID=74510943
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202011166610.0A Pending CN112364211A (en) | 2020-10-27 | 2020-10-27 | Information release statistical system and method based on cloud platform |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN112364211A (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114968715A (en) * | 2022-05-23 | 2022-08-30 | 重庆伏特猫科技有限公司 | Comprehensive energy management system based on Internet |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| KR20050112403A (en) * | 2004-05-25 | 2005-11-30 | 주식회사 제이컴정보 | Method for data process of agent layer of ism system |
| CN108958049A (en) * | 2018-07-10 | 2018-12-07 | 三智头智能科技(佛山)有限公司 | A kind of energy monitor management method and system |
| CN111338582A (en) * | 2020-05-19 | 2020-06-26 | 北京东方通科技股份有限公司 | Industrial internet data acquisition method and system and terminal |
-
2020
- 2020-10-27 CN CN202011166610.0A patent/CN112364211A/en active Pending
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| KR20050112403A (en) * | 2004-05-25 | 2005-11-30 | 주식회사 제이컴정보 | Method for data process of agent layer of ism system |
| CN108958049A (en) * | 2018-07-10 | 2018-12-07 | 三智头智能科技(佛山)有限公司 | A kind of energy monitor management method and system |
| CN111338582A (en) * | 2020-05-19 | 2020-06-26 | 北京东方通科技股份有限公司 | Industrial internet data acquisition method and system and terminal |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114968715A (en) * | 2022-05-23 | 2022-08-30 | 重庆伏特猫科技有限公司 | Comprehensive energy management system based on Internet |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN112181955B (en) | Data standard management method for information sharing of heavy haul railway comprehensive big data platform | |
| CN111338582A (en) | Industrial internet data acquisition method and system and terminal | |
| CN110912773A (en) | Cluster monitoring system and monitoring method for multiple public cloud computing platforms | |
| CN106610616B (en) | A kind of performance automated tuning method and device based on big data analysis | |
| CN104750813A (en) | Data cleaning method based on data reduction model | |
| CN102915432A (en) | Method and device for extracting vehicle-bone microcomputer image video data | |
| CN112364211A (en) | Information release statistical system and method based on cloud platform | |
| CN116777284A (en) | Space and attribute data integrated quality inspection method | |
| CN110544171A (en) | Investment management service system based on credit system | |
| CN108228254A (en) | Intelligent Problems processing method, server and terminal device applied to parking lot | |
| CN112559480A (en) | Distributed data set computing method and system in parallel computing scene | |
| CN108989116B (en) | Big data collection and analysis system and method | |
| CN109447177A (en) | Account clustering method, device and server | |
| CN210528140U (en) | Elevator floor automatic dispatching system based on artificial intelligence | |
| CN211741914U (en) | Energy consumption data monitoring and management system | |
| CN107205028A (en) | A kind of classification of service method and device | |
| CN113259346A (en) | Situation awareness system for network security | |
| CN113393273A (en) | Accurate marketing method | |
| CN112965948A (en) | Management service center system based on data | |
| CN112489400A (en) | Electric mobile operation terminal early warning system and method based on flow analysis | |
| CN116796986A (en) | Scheduling system and method for sanitation intelligent management | |
| CN215416651U (en) | Multisource data statistical analysis system based on space | |
| CN114510618B (en) | Processing method and device based on smart mine | |
| CN213240880U (en) | Real-time data acquisition equipment based on network data transmission equipment | |
| CN112905683A (en) | Mobile application analysis system based on measurement economics |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |