CN112800308A - Big data-based public opinion monitoring platform - Google Patents
Big data-based public opinion monitoring platform Download PDFInfo
- Publication number
- CN112800308A CN112800308A CN202110131944.2A CN202110131944A CN112800308A CN 112800308 A CN112800308 A CN 112800308A CN 202110131944 A CN202110131944 A CN 202110131944A CN 112800308 A CN112800308 A CN 112800308A
- Authority
- CN
- China
- Prior art keywords
- data
- module
- information
- public opinion
- big data
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000012544 monitoring process Methods 0.000 title claims abstract description 27
- 238000007781 pre-processing Methods 0.000 claims abstract description 58
- 238000004458 analytical method Methods 0.000 claims abstract description 52
- 238000012545 processing Methods 0.000 claims abstract description 26
- 238000013480 data collection Methods 0.000 claims abstract description 25
- 230000004931 aggregating effect Effects 0.000 claims abstract description 6
- 230000002776 aggregation Effects 0.000 claims abstract description 6
- 238000004220 aggregation Methods 0.000 claims abstract description 6
- 238000006243 chemical reaction Methods 0.000 claims description 39
- 238000005516 engineering process Methods 0.000 claims description 18
- 238000005457 optimization Methods 0.000 claims description 17
- 230000009471 action Effects 0.000 claims description 15
- 238000013499 data model Methods 0.000 claims description 15
- 238000011161 development Methods 0.000 claims description 12
- 238000012800 visualization Methods 0.000 claims description 10
- 230000006399 behavior Effects 0.000 claims description 6
- 230000002457 bidirectional effect Effects 0.000 claims description 5
- 238000013135 deep learning Methods 0.000 claims description 5
- 230000000007 visual effect Effects 0.000 claims description 5
- 238000003032 molecular docking Methods 0.000 claims description 2
- 238000011160 research Methods 0.000 claims description 2
- 238000010606 normalization Methods 0.000 abstract description 5
- 238000010586 diagram Methods 0.000 description 4
- 238000000034 method Methods 0.000 description 3
- 230000008447 perception Effects 0.000 description 3
- 230000008569 process Effects 0.000 description 3
- 238000007405 data analysis Methods 0.000 description 2
- 230000006872 improvement Effects 0.000 description 2
- 230000009286 beneficial effect Effects 0.000 description 1
- 230000008859 change Effects 0.000 description 1
- 238000013079 data visualisation Methods 0.000 description 1
- 230000008451 emotion Effects 0.000 description 1
- 230000007613 environmental effect Effects 0.000 description 1
- 230000001815 facial effect Effects 0.000 description 1
- 230000008921 facial expression Effects 0.000 description 1
- 230000014509 gene expression Effects 0.000 description 1
- 238000007726 management method Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004044 response Effects 0.000 description 1
- 230000001953 sensory effect Effects 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/90—Details of database functions independent of the retrieved data types
- G06F16/95—Retrieval from the web
- G06F16/951—Indexing; Web crawling techniques
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/90—Details of database functions independent of the retrieved data types
- G06F16/95—Retrieval from the web
- G06F16/953—Querying, e.g. by the use of web search engines
- G06F16/9535—Search customisation based on user profiles and personalisation
Landscapes
- Engineering & Computer Science (AREA)
- Databases & Information Systems (AREA)
- Theoretical Computer Science (AREA)
- Data Mining & Analysis (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
The invention discloses a big data-based public opinion monitoring platform, and relates to the technical field of information. The system comprises a global data acquisition module, a data preprocessing module, an analysis control module and a big data module, wherein the global data acquisition module is used for acquiring text, audio, picture and video public opinion data information, the output end of the global data acquisition module is connected with the input end of the data preprocessing module, and the data preprocessing module is used for receiving the public opinion data information acquired by the global data acquisition module, classifying and aggregating the data, eliminating interference information, and preprocessing the data in a smooth aggregation, data generalization, normalization and other modes. The platform of the invention adopts various public sentiment collection modes, improves the comprehensiveness of data collection, provides guarantee for public sentiment analysis and processing, public sentiment decision and public sentiment prediction based on big data, and solves the problems that the existing public sentiment monitoring platform is not comprehensive in data collection and not ideal in monitoring accuracy.
Description
Technical Field
The invention belongs to the technical field of information technology, and particularly relates to a public opinion monitoring platform based on big data.
Background
Public opinion refers to the social attitude of the main public in relation to the orientation of objective social managers, enterprises, individuals and other organizations, politics, society and morality around the occurrence, development and change of social events, which is the sum of the expressions of beliefs, attitudes, opinions, emotions and the like expressed by many people about various phenomena and problems in the society.
Through retrieval, the notice number CN111611464A and the notice date 2020.09.01 disclose a public opinion monitoring platform based on big data, which relates to the field of big data acquisition monitoring platforms and comprises a public opinion big data acquisition module, a preprocessing module, a deep processing module, a public opinion analysis module, a public opinion decision module and a display module. The invention can realize automatic collection and processing of a large amount of network public opinion data, greatly improve the processing efficiency of the network public opinion data, discover public opinion hotspots and development trends of various events in time, and make a predicted decision scheme, wherein the public opinion information and the decision scheme are displayed on the display module through a big data visualization technology.
The patent has the following disadvantages:
1. the public opinion monitoring platform is not comprehensive in information acquisition, only acquires text information and is difficult to accurately reflect public opinion information;
2. the public opinion monitoring platform is not accurate enough in data analysis, and is difficult to perform comprehensive and accurate analysis and judgment based on big data.
Therefore, the existing public opinion monitoring platform cannot meet the requirements in practical use, so that an improved technology is urgently needed in the market to solve the problems.
Disclosure of Invention
The invention aims to provide a public opinion monitoring platform based on big data, which adopts a plurality of public opinion collecting modes to improve the comprehensiveness of data collection, provides guarantee for public opinion analysis and processing, public opinion decision and public opinion prediction based on the big data, and solves the problems that the existing public opinion monitoring platform is not comprehensive in data collection and not ideal in monitoring accuracy.
In order to solve the technical problems, the invention is realized by the following technical scheme:
the invention relates to a big data-based public opinion monitoring platform, which comprises a global data acquisition module, a data preprocessing module, an analysis control module and a big data module, wherein the global data acquisition module is used for acquiring text, audio, picture and video public opinion data information, the output end of the global data acquisition module is connected with the input end of the data preprocessing module, the data preprocessing module is used for receiving the public opinion data information acquired by the global data acquisition module, classifying and aggregating the data, eliminating interference information, preprocessing the data by means of smooth aggregation, data generalization, normalization and the like, converting the data into a form suitable for data processing, the output end of the data preprocessing module is connected with the input end of the analysis control module, and the analysis control module is used for analyzing the public opinion data preprocessed by the data preprocessing module, the global data acquisition module, the data preprocessing module, the big data module, the display module, the decision module, the prediction module and the early warning module are controlled to work;
the output end of the analysis control module is respectively connected with the input end of the display module, the input end of the decision module, the input end of the prediction module and the input end of the early warning module, the display module is used for displaying public opinion information processed by the analysis control module and displaying the decision information of the decision module, the prediction information of the prediction module and the early warning information of the early warning module, the decision module determines a next action scheme based on the public opinion information processed by the analysis control module, the prediction module predicts the public opinion development trend based on the public opinion information processed by the analysis control module, and the early warning module is used for early warning a user when the severity of the public opinion reaches or exceeds a set value;
the analysis control module is connected with the big data module in a bidirectional mode.
Further, universe data acquisition module includes network data acquisition unit, perception equipment data acquisition unit and third party data cooperation unit, network data acquisition unit passes through crawler cloud collection technology and gathers search engine, paste bar, microblog, blog, news website, miniature public number, APP and all kinds of public opinion information from the media platform, perception equipment data acquisition unit passes through sensor, camera and other intelligent terminal and gathers limbs action, pronunciation and other public opinion information, third party data cooperation unit docks and obtains the public opinion information of third party through the database with the third party.
Furthermore, the public opinion data collected by the network data collection unit specifically includes content of the public opinion, speaker identity information, a recent utterance record of the speaker, and a comment forwarding amount of the utterance, and the speaker identity information specifically includes information such as age, utterance time, occupation, academic calendar, utterance place, and the like.
Further, the data preprocessing module comprises a minority language processing unit, a data classifying and summarizing unit and a data eliminating unit, the minority language processing unit converts the minority language into Chinese through a language conversion algorithm, the data classifying and summarizing unit is used for summarizing the text information, the audio information, the picture information and the video public opinion data information acquired by the global data acquisition module, the audio information, the picture information and the video information, the data eliminating unit converts public sentiment information data in pictures, audios and videos into text information based on the big data module, and the public opinion data irrelevant to the event is removed, the accuracy of converting the picture, the audio and the video into the text information can be improved based on the big data module on the ordinary network, and the specific meaning to be expressed in the picture, the audio and the video of the speaker can be accurately translated.
Further, the big data module comprises a big data conversion model unit, a big data prediction model unit, a big data decision model unit and a model optimization unit, the big data conversion model unit is used for converting information data in pictures, audios and videos based on the big data model when the data preprocessing module carries out data preprocessing, the big data prediction model unit is used for predicting public opinion development trend based on the big data model when the prediction module performs prediction, the big data decision model unit is used for establishing a next action scheme based on the big data model when the decision module makes a decision, the model optimization unit is used for optimizing the big data conversion model unit, the big data prediction model unit and the big data decision model unit to obtain a model more suitable for a user to use.
Furthermore, the model optimization unit adopts a technology combining statistical learning and deep learning, automatically adjusts the study and judgment standard according to the user industry, and continuously updates and perfects the whole big data system.
Further, the display module adopts a visualization technology to perform visualization processing on the data before the data are displayed to obtain a corresponding visual two-dimensional or three-dimensional report, the report is displayed on the user APP client and the PC client, and the report can be downloaded and printed through the report downloading and printing unit.
Furthermore, the early warning mode of the early warning module is set as mail, short message, WeChat, APP client and PC popup window, five kinds of early warning modes ensure that the user does not miss important public opinion information, and the user can process the information at the first time when serious public opinion problems occur.
The invention has the following beneficial effects:
1. the invention not only has traditional network data acquisition, but also can acquire real sensory data through the sensing equipment by setting the conversion and conversion of the network data acquisition unit, the conversion and conversion of the sensing equipment data acquisition unit and the conversion and conversion of the third-party data cooperation unit, and the public opinion acquisition modes are matched together, so that the data acquisition of the invention is more comprehensive, the subsequent data analysis is more accurate based on comprehensive data, and the invention can be applied to the public opinion monitoring in different fields.
2. The invention can more accurately translate the specific meanings to be expressed in the pictures, audios and videos of the speakers when the data preprocessing module is converted to process the pictures, audios and videos based on the big data by arranging the big data conversion model unit conversion, the big data prediction model unit conversion, the big data decision model unit conversion and the model optimization unit conversion, and the decision of the decision module conversion and the prediction of the prediction module conversion are more accurate based on the big data.
3. The invention has the advantages that five early warning modes of mail, short message, WeChat, APP client and PC popup are matched with each other through setting the conversion of the early warning module, so that the user is greatly ensured not to miss important public opinion information, and the user can process the public opinion information at the first time when serious public opinion problems occur.
Of course, it is not necessary for any product in which the invention is practiced to achieve all of the above-described advantages at the same time.
Drawings
In order to more clearly illustrate the technical solutions of the embodiments of the present invention, the drawings used in the description of the embodiments will be briefly introduced below, and it is obvious that the drawings in the following description are only some embodiments of the present invention, and it is obvious for those skilled in the art that other drawings can be obtained according to the drawings without creative efforts.
FIG. 1 is a schematic block diagram of the overall architecture of the present invention;
FIG. 2 is a schematic structural diagram of a global data acquisition module according to the present invention;
FIG. 3 is a schematic diagram of a data preprocessing module according to the present invention;
FIG. 4 is a schematic diagram of a big data module according to the present invention.
In the drawings, the components represented by the respective reference numerals are listed below:
1. a global data acquisition module; 2. a data preprocessing module; 3. an analysis control module; 4. a big data module; 5. a display module; 6. a decision-making module; 7. a prediction module; 8. an early warning module; 101. a network data acquisition unit; 102. a sensing device data acquisition unit; 103. a third party data collaboration unit; 201. a minority language processing unit; 202. a data classification and summarization unit; 203. a data eliminating unit; 401. a big data conversion model unit; 402. a big data prediction model unit; 403. a big data decision model unit; 404. and a model optimization unit.
Detailed Description
The technical solution in the embodiments of the present invention will be clearly and completely described below with reference to the accompanying drawings in the embodiments of the present invention.
Embodiment one application of the invention in tourism enterprises
Please refer to fig. 1, the present invention is a public opinion monitoring platform based on big data, comprising a global data collecting module 1, a data preprocessing module 2, an analysis control module 3 and a big data module 4, wherein the global data collecting module 1 is used for collecting the text, audio, picture and video public opinion data information of tourists in the tourist attraction, the output end of the global data collecting module 1 is connected with the input end of the data preprocessing module 2, the data preprocessing module 2 is used for receiving the public opinion data information collected by the global data collecting module 1, classifying, aggregating and eliminating interference information of data, and preprocessing the data by smooth aggregation, data generalization, normalization and other ways, so that the data is converted into a form suitable for data processing, the output end of the data preprocessing module 2 is connected with the input end of the analysis control module 3, the analysis control module 3 is used for analyzing the public opinion data preprocessed by the data preprocessing module 2, the global data acquisition module 1, the data preprocessing module 2, the big data module 4, the display module 5, the decision module 6, the prediction module 7 and the early warning module 8 are controlled to work; the output end of the analysis control module 3 is respectively connected with the input end of the display module 5, the input end of the decision module 6, the input end of the prediction module 7 and the input end of the early warning module 8, the display module 5 is used for displaying public opinion information processed by the analysis control module 3, and displaying the decision information of the decision module 6, the prediction information of the prediction module 7 and the early warning information of the early warning module 8, the decision module 6 determines a next action scheme based on the public opinion information processed by the analysis control module 3, the prediction module 7 predicts the development trend of the public opinion based on the public opinion information processed by the analysis control module 3, and the early warning module 8 is used for early warning a user when the severity of the public opinion reaches or exceeds a set value; the analysis control module 3 is connected with the big data module 4 in a bidirectional way, when the analysis control module 3 is applied to a tourist enterprise, the analysis control module 3 judges whether the layout, service, commodity, sanitation and other information of the scenic spot meet the requirements of the tourist or not based on the collected public opinion information of the tourist, whether the information needs to be improved or not, closely pays attention to the public opinion of the tourist on the public praise of the scenic spot, controls the decision module 6 to generate a new scheme of scenic spot facility layout, service, commodity and the like to perfect and improve the content of facilities, service and the like of the existing scenic spot, thereby creating a scenic spot satisfied by the tourist, increasing the income of the enterprise, the prediction module 7 gives a reasonable prediction based on the new improved scheme of the scenic spot, predicts whether the satisfaction of the tourist can be achieved or not, the early warning module 8 is used for reporting to the staff of the scenic spot when the complaint amount of the scenic spot is too large, the collected public opinion information, the limbs, facial, and then take a solution.
As shown in fig. 2, the global data collection module 1 includes a network data collection unit 101, a sensing device data collection unit 102 and a third party data cooperation unit 103, the network data collection unit 101 collects the public opinion information on the search engine, the sticker, the microblog, the blog, the news website, the micro public number, the APP and various self-media platforms of the tourist attraction through a crawler cloud collection technology, the public opinion data collected by the network data collection unit 101 specifically includes the content of the public opinion, the identity information of the speaker, the recent utterance record of the speaker and the comment forwarding amount of the utterance, the sensing device data collection unit 102 collects the behavior actions of the limbs, the voices and other public opinion information through a sensor, a camera and other intelligent terminals, and is applied to enterprises, the sensing device is installed in the tourist attraction, and the action behavior of the tourist in the attraction is collected through the sensing device, The third party data cooperation unit 103 obtains public opinion information of the third party by interfacing with the database of the third party.
As shown in fig. 3, the data preprocessing module 2 includes a minority language processing unit 201, a data classifying and summarizing unit 202, and a data rejecting unit 203, the minority language processing unit 201 converts the minority language into a chinese language through a language conversion algorithm, the data classifying and summarizing unit 202 is configured to perform text information summarization, audio information summarization, picture information summarization and video information summarization on text, audio, picture and video public opinion data information acquired by the global data acquisition module 1, and the data rejecting unit 203 converts public opinion information data in the picture, audio and video into text information based on the big data module 4 and rejects public opinion data irrelevant to an event.
As shown in fig. 4, the big data module 4 includes a big data conversion model unit 401, a big data prediction model unit 402, a big data decision model unit 403, and a model optimization unit 404, where the big data conversion model unit 401 is used for performing information data conversion in pictures, audio, and video based on a big data model when the data preprocessing module 2 performs data preprocessing, the big data prediction model unit 402 is used for performing prediction of public sentiment development trend based on the big data model when the prediction module 7 performs prediction, the big data decision model unit 403 is used for performing next step action scheme establishment based on the big data model when the decision module 6 performs decision, and the model optimization unit 404 is used for optimizing the big data conversion model unit 401, the big data prediction model unit 402, and the big data decision model unit 403 to obtain a model more suitable for a user to use, the model optimization unit 404 adopts a technology combining statistical learning and deep learning, automatically adjusts the study and judgment standard according to the tourism industry, and continuously updates and perfects the whole big data system.
The display module 5 adopts a visualization technology to perform visualization processing on the data before the data are displayed to obtain a corresponding visual two-dimensional or three-dimensional report, the report is displayed on the user APP client and the PC client, and the report can be downloaded and printed through the report downloading and printing unit.
The early warning mode of the early warning module 8 is set as mail, short message, WeChat, APP client and PC popup.
Example II application of the invention to municipal enterprises
Please refer to fig. 1, the present invention is a public opinion monitoring platform based on big data, comprising a global data collecting module 1, a data preprocessing module 2, an analysis control module 3 and a big data module 4, wherein the global data collecting module 1 is used for collecting text, audio, picture and video public opinion data information of residents in the municipal area, the output end of the global data collecting module 1 is connected with the input end of the data preprocessing module 2, the data preprocessing module 2 is used for receiving the public opinion data information collected by the global data collecting module 1, classifying and aggregating the data, eliminating interference information, and preprocessing the data by smooth aggregation, data generalization, normalization and other ways, so that the data is converted into a form suitable for data processing, the output end of the data preprocessing module 2 is connected with the input end of the analysis control module 3, the analysis control module 3 is used for analyzing the public opinion data preprocessed by the data preprocessing module 2, the global data acquisition module 1, the data preprocessing module 2, the big data module 4, the display module 5, the decision module 6, the prediction module 7 and the early warning module 8 are controlled to work; the output end of the analysis control module 3 is respectively connected with the input end of the display module 5, the input end of the decision module 6, the input end of the prediction module 7 and the input end of the early warning module 8, the display module 5 is used for displaying public opinion information processed by the analysis control module 3, and displaying the decision information of the decision module 6, the prediction information of the prediction module 7 and the early warning information of the early warning module 8, the decision module 6 determines a next action scheme based on the public opinion information processed by the analysis control module 3, the prediction module 7 predicts the development trend of the public opinion based on the public opinion information processed by the analysis control module 3, and the early warning module 8 is used for early warning a user when the severity of the public opinion reaches or exceeds a set value; the analysis control module 3 is connected with the big data module 4 in a bidirectional way, when the analysis control module 3 is applied to a municipal enterprise, the analysis control module 3 judges whether the information of urban facility layout, urban service, urban sanitation and the like in the region meets the requirements of residents and needs to be improved or not based on the collected public opinion information of the residents, closely pays attention to public praise opinions of the residents to the city, controls the decision module 6 to generate a new scheme of the urban facility layout, the urban service, the urban sanitation and the like to perfect and improve the existing contents of the urban layout, the urban service, the urban sanitation and the like, so as to create a city with satisfied residents, the prediction module 7 gives reasonable prediction based on the new improved scheme of the city, and predicts whether the satisfaction of the residents can be achieved or not, the early warning module 8 is used for judging that the public opinion amount of the city is too large, and when the limbs, facial expressions and, the intelligent city management system can report to municipal workers in time, further take solving measures, adopt sensing and analysis of public sentiments of residents, integrate various key information of a city operation core system, and make intelligent response to various requirements of livelihood, environmental protection, public safety, city service and the like.
As shown in fig. 2, the global data collection module 1 includes a network data collection unit 101, a sensing device data collection unit 102 and a third party data cooperation unit 103, the network data collection unit 101 collects public opinion information on a search engine, a sticker, a microblog, a blog, a news site, a micro public number, an APP and various self-media platforms of the city municipal administration through a crawler cloud collection technology, the public opinion data collected by the network data collection unit 101 specifically includes public opinion content, speaker identity information, a speaker recent utterance record and a comment forwarding amount of the utterance, the sensing device data collection unit 102 collects body behavior, voice and other information through a sensor, a camera and other intelligent terminals, and when the system is applied to a municipal enterprise, the sensing device can be installed in a district, on a street lamp, in a park and other places, and collects the behavior, voice, etc., of residents in the city, through the sensing device, The third party data cooperation unit 103 obtains public opinion information of the third party by interfacing with the database of the third party.
As shown in fig. 3, the data preprocessing module 2 includes a minority language processing unit 201, a data classifying and summarizing unit 202, and a data rejecting unit 203, the minority language processing unit 201 converts the minority language into a chinese language through a language conversion algorithm, the data classifying and summarizing unit 202 is configured to perform text information summarization, audio information summarization, picture information summarization and video information summarization on text, audio, picture and video public opinion data information acquired by the global data acquisition module 1, and the data rejecting unit 203 converts public opinion information data in the picture, audio and video into text information based on the big data module 4 and rejects public opinion data irrelevant to an event.
As shown in fig. 4, the big data module 4 includes a big data conversion model unit 401, a big data prediction model unit 402, a big data decision model unit 403, and a model optimization unit 404, where the big data conversion model unit 401 is used for performing information data conversion in pictures, audio, and video based on a big data model when the data preprocessing module 2 performs data preprocessing, the big data prediction model unit 402 is used for performing prediction of public sentiment development trend based on the big data model when the prediction module 7 performs prediction, the big data decision model unit 403 is used for performing next step action scheme establishment based on the big data model when the decision module 6 performs decision, and the model optimization unit 404 is used for optimizing the big data conversion model unit 401, the big data prediction model unit 402, and the big data decision model unit 403 to obtain a model more suitable for a user to use, the model optimization unit 404 adopts a technology combining statistical learning and deep learning, automatically adjusts the study and judgment standard according to the municipal industry, and continuously updates and perfects the whole big data system.
The display module 5 adopts a visualization technology to perform visualization processing on the data before the data are displayed to obtain a corresponding visual two-dimensional or three-dimensional report, the report is displayed on the user APP client and the PC client, and the report can be downloaded and printed through the report downloading and printing unit.
The early warning mode of the early warning module 8 is set as mail, short message, WeChat, APP client and PC popup.
Third embodiment of the invention in e-commerce marketing application
Please refer to fig. 1, the present invention is a public opinion monitoring platform based on big data, comprising a global data collecting module 1, a data preprocessing module 2, an analysis control module 3 and a big data module 4, wherein the global data collecting module 1 is used for collecting text, audio, picture and video public opinion data information of tourists in the e-commerce website, the output end of the global data collecting module 1 is connected with the input end of the data preprocessing module 2, the data preprocessing module 2 is used for receiving the public opinion data information collected by the global data collecting module 1, classifying, aggregating and eliminating interference information of the data, and preprocessing the data by smooth aggregation, data generalization, normalization and the like, so that the data is converted into a form suitable for data processing, the output end of the data preprocessing module 2 is connected with the input end of the analysis control module 3, the analysis control module 3 is used for analyzing the public opinion data preprocessed by the data preprocessing module 2, the global data acquisition module 1, the data preprocessing module 2, the big data module 4, the display module 5, the decision module 6, the prediction module 7 and the early warning module 8 are controlled to work; the output end of the analysis control module 3 is respectively connected with the input end of the display module 5, the input end of the decision module 6, the input end of the prediction module 7 and the input end of the early warning module 8, the display module 5 is used for displaying public opinion information processed by the analysis control module 3, and displaying the decision information of the decision module 6, the prediction information of the prediction module 7 and the early warning information of the early warning module 8, the decision module 6 determines a next action scheme based on the public opinion information processed by the analysis control module 3, the prediction module 7 predicts the development trend of the public opinion based on the public opinion information processed by the analysis control module 3, and the early warning module 8 is used for early warning a user when the severity of the public opinion reaches or exceeds a set value; the analysis control module 3 is connected with the big data module 4 in a bidirectional mode, when the system is applied to the field of e-commerce marketing, the analysis control module 3 judges whether goods meet the requirements of customers or not based on collected customer public opinion information, whether improvement is needed or not, closely pays attention to public praise public opinions of the customers to company products, comprehensively monitors media proportion, guides advertisement media delivery, improves the research quality of consumer behaviors, controls the decision module 6 to update a marketing scheme in real time, gives reasonable prediction based on the marketing scheme through the prediction module 7, and is used for reporting to e-commerce workers in time when the complaint amount of the products is too large, and then takes solving measures.
As shown in fig. 2, the global data acquisition module 1 includes a network data acquisition unit 101, a sensing device data acquisition unit 102, and a third party data cooperation unit 103, the network data acquisition unit 101 acquires a search engine, a sticker, a microblog, a blog, and a news site of the e-commerce website through a crawler cloud acquisition technology, public sentiment information on miniature public numbers, APP and all kinds of self-media platforms, the public sentiment data that network data collection unit 101 gathered specifically include the content of public sentiment, speaker identity information, the most recent record of speaking of speaker and the comment forward volume of speaking, perception equipment data collection unit 102 is through sensor, camera and other intelligent terminal collection limbs action, pronunciation and other public sentiment information, third party data cooperation unit 103 is through docking and obtain the public sentiment information of third party with the database of third party.
As shown in fig. 3, the data preprocessing module 2 includes a minority language processing unit 201, a data classifying and summarizing unit 202, and a data rejecting unit 203, the minority language processing unit 201 converts the minority language into a chinese language through a language conversion algorithm, the data classifying and summarizing unit 202 is configured to perform text information summarization, audio information summarization, picture information summarization and video information summarization on text, audio, picture and video public opinion data information acquired by the global data acquisition module 1, and the data rejecting unit 203 converts public opinion information data in the picture, audio and video into text information based on the big data module 4 and rejects public opinion data irrelevant to an event.
As shown in fig. 4, the big data module 4 includes a big data conversion model unit 401, a big data prediction model unit 402, a big data decision model unit 403, and a model optimization unit 404, where the big data conversion model unit 401 is used for performing information data conversion in pictures, audio, and video based on a big data model when the data preprocessing module 2 performs data preprocessing, the big data prediction model unit 402 is used for performing prediction of public sentiment development trend based on the big data model when the prediction module 7 performs prediction, the big data decision model unit 403 is used for performing next step action scheme establishment based on the big data model when the decision module 6 performs decision, and the model optimization unit 404 is used for optimizing the big data conversion model unit 401, the big data prediction model unit 402, and the big data decision model unit 403 to obtain a model more suitable for a user to use, the model optimization unit 404 adopts a technology combining statistical learning and deep learning, automatically adjusts the study and judgment standard according to the e-commerce industry, and continuously updates and perfects the whole big data system.
The display module 5 adopts a visualization technology to perform visualization processing on the data before the data are displayed to obtain a corresponding visual two-dimensional or three-dimensional report, the report is displayed on the user APP client and the PC client, and the report can be downloaded and printed through the report downloading and printing unit.
The early warning mode of the early warning module 8 is set as mail, short message, WeChat, APP client and PC popup.
The above are only preferred embodiments of the present invention, and the present invention is not limited thereto, and any modification, equivalent replacement, and improvement made to the technical solutions described in the above embodiments, and to some of the technical features thereof, are included in the scope of the present invention.
Claims (8)
1. The utility model provides a public opinion monitoring platform based on big data, includes universe data acquisition module (1), data preprocessing module (2), analysis control module (3) and big data module (4), its characterized in that: the global data acquisition module (1) is used for acquiring text, audio, picture and video public opinion data information, the output end of the global data acquisition module (1) is connected with the input end of the data preprocessing module (2), the data preprocessing module (2) is used for receiving the public opinion data information acquired by the global data acquisition module (1), classifying, aggregating and eliminating interference information of data, preprocessing the data in a smooth aggregation, data generalization, standardization and other modes, so that the data is converted into a form suitable for data processing, the output end of the data preprocessing module (2) is connected with the input end of the analysis control module (3), the analysis control module (3) is used for analyzing the public opinion data preprocessed by the data preprocessing module (2) and controlling the global data acquisition module (1), The data preprocessing module (2), the big data module (4), the display module (5), the decision module (6), the prediction module (7) and the early warning module (8) work;
the output end of the analysis control module (3) is respectively connected with the input end of the display module (5), the input end of the decision module (6), the input end of the prediction module (7) and the input end of the early warning module (8), the display module (5) is used for displaying public sentiment information processed by the analysis control module (3), and displaying the decision information of the decision module (6), the prediction information of the prediction module (7) and the early warning information of the early warning module (8), the decision module (6) determines a next action scheme based on the public sentiment information processed by the analysis control module (3), the prediction module (7) predicts the development trend of the public sentiment based on the public sentiment information processed by the analysis control module (3), and the early warning module (8) is used for early warning a user when the severity of the public sentiment reaches or exceeds a set value;
the analysis control module (3) is connected with the big data module (4) in a bidirectional mode.
2. The big data-based public opinion monitoring platform according to claim 1, wherein the global data collection module (1) comprises a network data collection unit (101), a sensing device data collection unit (102) and a third party data cooperation unit (103), the network data collection unit (101) collects public opinion information on a search engine, a sticker bar, a microblog, a blog, a news site, a micro public number, an APP and various self-media platforms through a crawler cloud collection technology, the sensing device data collection unit (102) collects body behavior actions, voices and other public opinion information through a sensor, a camera and other intelligent terminals, and the third party data cooperation unit (103) obtains the public opinion information of a third party by docking with a database of the third party.
3. A big data-based public opinion monitoring platform according to claim 2, wherein the public opinion data collected by the network data collection unit (101) specifically includes content of public opinion, speaker identity information, recent utterance record of a speaker, and comment forwarding amount of utterance.
4. The big data-based public opinion monitoring platform as claimed in claim 1, wherein, the data preprocessing module (2) comprises a minority language processing unit (201), a data classifying and summarizing unit (202) and a data eliminating unit (203), the minority language processing unit (201) converts the minority language into Chinese through a language conversion algorithm, the data classification and summarization unit (202) is used for summarizing text information, audio information, pictures and video public opinion data information acquired by the global data acquisition module (1), summarizing the audio information, summarizing the picture information and summarizing the video information, the data removing unit (203) converts public opinion information data in pictures, audios and videos into text information based on the big data module (4), and removes public opinion data irrelevant to events.
5. The big data-based public opinion monitoring platform according to claim 1, wherein the big data module (4) comprises a big data conversion model unit (401), a big data prediction model unit (402), a big data decision model unit (403), and a model optimization unit (404), the big data conversion model unit (401) is used for performing information data conversion in pictures, audio, and video based on the big data model when the data preprocessing module (2) performs data preprocessing, the big data prediction model unit (402) is used for performing public opinion development trend prediction based on the big data model when the prediction module (7) performs prediction, the big data decision model unit (403) is used for performing next action scheme establishment based on the big data model when the decision module (6) performs decision, and the model optimization unit (404) is used for determining the big data conversion model unit (401), And the big data prediction model unit (402) and the big data decision model unit (403) are optimized to obtain a model more suitable for a user to use.
6. A big data-based public opinion monitoring platform according to claim 5, wherein the model optimization unit (404) adopts a combination technology of statistical learning and deep learning, automatically adjusts the research and judgment criteria according to the user industry, and continuously updates and perfects the whole big data system.
7. A big data-based public opinion monitoring platform according to claim 1, wherein the display module (5) performs visualization processing on data by using visualization technology before data display to obtain corresponding visual two-dimensional or three-dimensional reports, and displays the reports on the user APP client and the PC client, and the reports can be downloaded and printed by a report downloading and printing unit.
8. A big data-based public opinion monitoring platform according to claim 1, wherein the early warning modes of the early warning module (8) are email, short message, WeChat, APP client and PC popup.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110131944.2A CN112800308A (en) | 2021-01-30 | 2021-01-30 | Big data-based public opinion monitoring platform |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110131944.2A CN112800308A (en) | 2021-01-30 | 2021-01-30 | Big data-based public opinion monitoring platform |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN112800308A true CN112800308A (en) | 2021-05-14 |
Family
ID=75813153
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202110131944.2A Pending CN112800308A (en) | 2021-01-30 | 2021-01-30 | Big data-based public opinion monitoring platform |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN112800308A (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114585141A (en) * | 2022-01-10 | 2022-06-03 | 自贡海天文化股份有限公司 | Human interactive LED landscape building light control system |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104933093A (en) * | 2015-05-19 | 2015-09-23 | 武汉泰迪智慧科技有限公司 | Regional public opinion monitoring and decision-making auxiliary system and method based on big data |
| CN109471965A (en) * | 2018-10-26 | 2019-03-15 | 四川才子软件信息网络有限公司 | A kind of network public-opinion data sampling and processing method and monitoring platform based on big data |
| CN111611464A (en) * | 2020-05-22 | 2020-09-01 | 河南智慧云大数据有限公司 | Big data-based public opinion monitoring platform |
-
2021
- 2021-01-30 CN CN202110131944.2A patent/CN112800308A/en active Pending
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104933093A (en) * | 2015-05-19 | 2015-09-23 | 武汉泰迪智慧科技有限公司 | Regional public opinion monitoring and decision-making auxiliary system and method based on big data |
| CN109471965A (en) * | 2018-10-26 | 2019-03-15 | 四川才子软件信息网络有限公司 | A kind of network public-opinion data sampling and processing method and monitoring platform based on big data |
| CN111611464A (en) * | 2020-05-22 | 2020-09-01 | 河南智慧云大数据有限公司 | Big data-based public opinion monitoring platform |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114585141A (en) * | 2022-01-10 | 2022-06-03 | 自贡海天文化股份有限公司 | Human interactive LED landscape building light control system |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN110796570B (en) | Intelligent text travel system | |
| Panagiotopoulos et al. | The value of social media data: Integrating crowd capabilities in evidence-based policy | |
| Lock et al. | Social media as passive geo-participation in transportation planning–how effective are topic modeling & sentiment analysis in comparison with citizen surveys? | |
| Ruggiero et al. | Social media monitoring for crisis communication: Process, methods and trends in the scientific literature | |
| CN106598994B (en) | Efficient recruitment system and method based on user online behavior data | |
| CN110111084A (en) | A kind of government affairs service hotline analysis method and system | |
| CN112364086A (en) | Business visualization method and system based on big data platform | |
| CN116663664A (en) | Customer marketing scene data analysis system and method based on NLP algorithm | |
| CN116383198A (en) | Decision analysis method and system based on big data | |
| CN110012177A (en) | It is a kind of based on the outer paging system of intelligence intelligently supervised and guided | |
| CN112800308A (en) | Big data-based public opinion monitoring platform | |
| CN112365281B (en) | Power customer service demand analysis method and device | |
| CN109033378A (en) | A kind of application method of Zero-shot Learning in intelligent customer service system | |
| JP7239124B1 (en) | Local interest measuring system, local interest measuring method and program | |
| CN116821106A (en) | Enterprise data digital management system and method | |
| CN107767156A (en) | A kind of information input method, apparatus and system | |
| TW201421265A (en) | Intellectual news analyzing system | |
| Su et al. | Retracted: Research on the Construction of Tourism Information Sharing Service Platform and the Collection of Tourist Satisfaction | |
| WO2014068745A1 (en) | Message-based management system | |
| CN111625616B (en) | Enterprise-level data management system capable of mass storage | |
| Wang et al. | Research on Availability of Intelligent Express Cabinet Service System | |
| KR102551779B1 (en) | Persona-based review data analysis method and system | |
| KR102544313B1 (en) | Awareness and management of event, issue situation system and method based on artificial intelligence | |
| JP7181657B1 (en) | Local interest measuring system, local interest measuring method and program | |
| JP7017766B1 (en) | Information processing device and software generation support method |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20210514 |