CN113094621B - Internet public opinion cloud platform - Google Patents

Internet public opinion cloud platform Download PDF

Info

Publication number
CN113094621B
CN113094621B CN202110444555.5A CN202110444555A CN113094621B CN 113094621 B CN113094621 B CN 113094621B CN 202110444555 A CN202110444555 A CN 202110444555A CN 113094621 B CN113094621 B CN 113094621B
Authority
CN
China
Prior art keywords
public opinion
data
module
access
network
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN202110444555.5A
Other languages
Chinese (zh)
Other versions
CN113094621A (en
Inventor
李芳芳
刘志
宁肯
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Central South University
Original Assignee
Central South University
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Central South University filed Critical Central South University
Priority to CN202110444555.5A priority Critical patent/CN113094621B/en
Publication of CN113094621A publication Critical patent/CN113094621A/en
Application granted granted Critical
Publication of CN113094621B publication Critical patent/CN113094621B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/90Details of database functions independent of the retrieved data types
    • G06F16/95Retrieval from the web
    • G06F16/958Organisation or management of web site content, e.g. publishing, maintaining pages or automatic linking
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/30Information retrieval; Database structures therefor; File system structures therefor of unstructured textual data
    • G06F16/33Querying
    • G06F16/3331Query processing
    • G06F16/334Query execution
    • G06F16/3344Query execution using natural language analysis

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Databases & Information Systems (AREA)
  • Data Mining & Analysis (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Artificial Intelligence (AREA)
  • Computational Linguistics (AREA)
  • Management, Administration, Business Operations System, And Electronic Commerce (AREA)

Abstract

The invention provides a network public opinion cloud platform, which comprises a keyword group, a joint database management subsystem and a data analysis model exchange subsystem; the keyword group and joint database management subsystem comprises a keyword group collection module, a keyword group distribution module, a public opinion cloud data storage module and a public opinion cloud data distribution module; the data analysis model exchange subsystem comprises a standardized network public opinion data analysis model operation environment module and a network public opinion data analysis model transaction module. And the network public opinion data is integrated and exchanged and shared uniformly through the keyword group and the joint database management subsystem, so that the comprehensive application and the scheduling of the network access public opinion system are formed, and the data utilization rate is improved. The data analysis model exchange subsystem effectively improves the types and the quantity of the network public opinion data analysis models which can be provided by each access public opinion system, so that the final network public opinion users can flexibly configure the network public opinion analysis models required by the final network public opinion users according to actual needs.

Description

Internet public opinion cloud platform
Technical Field
The invention relates to the field of network public opinion information or data management, in particular to a network public opinion cloud platform.
Background
At present, the technical means of the public opinion monitoring system mainly takes the collection of internet public opinion data as a main part, the technical threshold is low, many software companies, university institutions, traditional media, even public relations companies and the like are surrendered into the industry, and various public opinion products (hereinafter, public opinion product providers are called as 'public opinion manufacturers') are provided. However, most public opinion manufacturers have low autonomous innovation ability, and mutual plagiarism causes serious homogenization. There is also a misroad for the understanding of network public opinion technical services by many user units, one typical example being the server "tiling theory", which considers that by a large investment of equipment and bandwidth, sufficient acquisition and storage capacity can be formed, thus realizing so-called "whole network monitoring". The phenomenon that the public opinion systems are respectively administrative and scattered little bad is serious, the waste of bandwidth and calculation resources is serious, and repeated collection and storage of the same public opinion data source are serious. The public opinion service industry has the scale effect of natural monopoly, and can obtain more data accumulation only by continuous large resource investment, thus forming a forward feedback loop. However, the current low-level market competition mode enables public opinion enterprises to have no need of fine tillage and fine work, price war is increasingly carried out, and market popularization cost extrudes investment in the aspects of technology research and development, equipment upgrading and updating and the like.
The following problems generally exist in the current public opinion monitoring industry.
Firstly, public opinion manufacturers are numerous, and at present, the public opinion manufacturers lack standard supervision, and lack standard analysis indexes as quantitative basis, so that the internal consumption of public opinion management is serious.
And secondly, an effective public opinion data aggregation system is lacking. The public opinion monitoring working process mainly relies on public opinion manufacturers to acquire related data through various acquisition technologies for processing, the data acquisition results are mostly mastered inside the public opinion manufacturers, and different public opinion manufacturers can acquire the same source data at the same time, so that redundant acquisition is caused, and resource waste is caused.
Thirdly, a coordination mechanism for data processing and analysis overall is lacked. The single public opinion manufacturer is often limited by factors such as company scale, fund scale, geographic position, customer demand and the like, the acquired data range is different, each public opinion manufacturer only considers own factors to acquire data, the data acquisition range is narrow, and the data processing capability is limited by the public opinion manufacturer providing service. Public opinion supervision and use departments can only use data provided by public opinion service manufacturers, lack data sharing, and the public opinion data requirements cannot be met to the maximum.
Disclosure of Invention
The invention aims to provide a network public opinion cloud platform which can realize effective information sharing after effective information collection and overall processing.
The network public opinion cloud platform provided by the invention comprises a keyword group and a joint database management subsystem and a data analysis model exchange subsystem;
the keyword group and joint database management subsystem comprises a keyword group collection module, a keyword group distribution module, a public opinion cloud data storage module and a public opinion cloud data distribution module;
the keyword group collection module is used for collecting collected keyword groups and constructing a unified keyword group of the public opinion cloud platform; the keyword group distribution module is used for distributing unified keyword groups to each access public opinion system; the public opinion cloud data storage module is used for carrying out aggregation and arrangement on the effective network public opinion data to form a public opinion cloud joint database; the public opinion cloud data distribution module is used for distributing corresponding effective network public opinion data to the public opinion systems according to the unified keyword groups corresponding to the public opinion systems;
the data analysis model exchange subsystem comprises a standardized network public opinion data analysis model operation environment module and a network public opinion data analysis model transaction module;
The standardized network public opinion data analysis model operation environment module is used for constructing a standardized network public opinion data analysis model operation environment; the network public opinion data analysis model trading module is used for constructing a network public opinion data analysis model trading bazaar so as to access the public opinion system to autonomously bid the provided data analysis model, and is accessed to the public opinion system or any data analysis module of a user unit.
Furthermore, the keyword group and the combined database management subsystem also comprise a specific emergency network public opinion event keyword group module, a specific emergency network public opinion event keyword group of a specific emergency network public opinion event is constructed according to actual requirements, the specific emergency network public opinion event keyword group is pushed to part or all of the access public opinion systems, and the access public opinion systems match after receiving the specific emergency network public opinion event keyword group and package and share matching data to a public opinion cloud platform; the priority of the specific emergency network public opinion event keyword group is higher than that of the conventional cloud platform unified keyword group, and the access public opinion system performs priority matching after receiving the specific emergency network public opinion event keyword group and packages and shares relevant data to the public opinion cloud platform at the first time.
Furthermore, the keyword group and the joint database management subsystem further comprise a public opinion cloud data management module, which comprises
Data resource integration, which is to manage the cleaning and conversion process of the data collection of the public opinion cloud platform, provide standardized flow and specification for the process, and ensure that the cleaned and converted data is available;
the data resource catalogue classifies the data of the public opinion cloud platform and forms the data resource catalogue so as to facilitate the management and inquiry of the data;
data standard management, namely collecting standard specification information required by data resource management, and forming a public opinion cloud combined database into a standard database;
and (3) data security access management, namely establishing hierarchical rights management for the process of accessing the public opinion cloud combined database, and ensuring the security of the data in the process of accessing.
In specific implementation, the network public opinion cloud platform further comprises a standard library subsystem, wherein the standard library subsystem comprises a keyword group standard module, a public opinion data format standard module, a public opinion data exchange standard module and a network public opinion data analysis model standardized operation environment module.
Specifically, the keyword group standard module constrains the keyword data format uploaded to the keyword group aggregation module by public opinion manufacturers; the public opinion data format standard module is used for restraining the effective network public opinion data format acquired by the public opinion cloud data storage module; the public opinion data exchange standard module is used for restraining a data exchange process in the data analysis model exchange subsystem; the standardized running environment module of the network public opinion data analysis model establishes standardized input and output standards.
In specific implementation, the network public opinion cloud platform also comprises an optimizing subsystem for resource allocation of an accessed public opinion system, and the subsystem comprises
The network public opinion data acquisition recommendation module pushes configuration optimization suggestions of acquisition websites to each accessed public opinion system;
and the network public opinion data analysis model recommendation module pushes optimization suggestions for research and development investment of the network public opinion data analysis model to each access public opinion system.
In specific implementation, the network public opinion cloud platform further comprises a subsystem for changing configuration of the user unit, wherein the subsystem comprises
The network public opinion technical service self-selection combined supermarket module is used for constructing a network public opinion technical service self-selection combined supermarket, and the network public opinion data acquisition module and the network public opinion data analysis module which are connected into the public opinion system are uniformly displayed and are used for a user unit to select and combine;
the network public opinion cloud platform provides a system interface for setting the keyword group for the user unit through a cloud public opinion system, so that the keyword group required by the user unit is obtained;
the network public opinion cloud platform distributes keyword groups required by the user units of the cloud public opinion system to the related access public opinion system;
The charging module is used for charging the effective network public opinion information provided for the user units by the related access public opinion system;
and the charging module of the network public opinion data acquisition data analysis module charges the network public opinion data analysis module which is provided by the related access public opinion system for a user unit.
In specific implementation, the network public opinion cloud platform further comprises an access operation efficiency evaluation subsystem, and the subsystem comprises
The data acquisition exchange efficiency module is used for evaluating the data acquisition exchange efficiency of each access public opinion system, and the data acquisition exchange efficiency is determined according to the shared data and the received data of the access public opinion system;
the data analysis model efficiency module is used for evaluating the data analysis model efficiency of each access public opinion system, and the data analysis model efficiency is determined according to the use duration and the number of times of the data analysis model of the access public opinion system;
and the network public opinion cloud platform is connected to the operation efficiency module, and the operation efficiency of the connection is determined according to the data acquisition exchange efficiency evaluation result and/or the data analysis model efficiency evaluation result of each connection public opinion system.
Further, the access operation efficiency evaluation subsystem further comprises an elimination module, wherein the elimination module sets an end elimination rate S1 of the data acquisition and exchange efficiency and an end elimination rate S2 of the data analysis model efficiency for an access public opinion system in the public opinion cloud platform; and calculating an access public opinion system set T1 to be eliminated according to the S1 according to the time period, calculating an access public opinion system set T2 to be eliminated according to the S2, and determining an intersection T3 of the T1 and the T2 to be eliminated to access the public opinion system.
Furthermore, the access operation efficiency evaluation subsystem further comprises an efficiency monitoring module and a warning module; the efficiency monitoring module monitors shared or accepted data of each accessed public opinion system through a public opinion cloud platform and a data analysis model; the warning module pre-warns the public opinion cloud platform and the related access public opinion system according to the abnormal monitoring result of the efficiency monitoring module, timely discovers the access public opinion system which fails to share or accept data normally, timely discovers the public opinion data analysis model which cannot operate normally on the cloud platform, and timely informs related access public opinion enterprises to carry out rectification.
The invention integrates and exchanges the network public opinion data uniformly through the key word group and the combined database management subsystem to form the comprehensive application and dispatch of the network access public opinion system, and improves the data utilization rate. The data analysis model exchange subsystem can effectively improve the types and the quantity of the network public opinion data analysis models which can be provided by each access public opinion system, and can enable the final network public opinion users not to be limited to the types of the data analysis models owned by a public opinion company according to actual needs, so that the network public opinion analysis models required by the public opinion companies can be flexibly configured. By constructing the network public opinion data analysis model exchange platform, the utilization rate of analysis models of all access network public opinion companies can be improved.
Drawings
Fig. 1 is a schematic diagram of a network public opinion cloud platform according to a preferred embodiment of the present invention.
FIG. 2 is a flow chart of key word group and federated database management subsystem management in accordance with a preferred embodiment.
Fig. 3 is a flow chart of the data analysis model switching subsystem in accordance with the preferred embodiment.
Fig. 4 is a schematic diagram of a network public opinion cloud platform according to a second preferred embodiment of the present invention.
Fig. 5 is a block diagram of a network public opinion data sharing exchange mechanism in a second preferred embodiment.
Fig. 6 is a flowchart of a subsystem for optimizing access to public opinion system configuration according to a second preferred embodiment of the present invention.
Fig. 7 is a schematic diagram of a network public opinion cloud platform according to a second preferred embodiment of the present invention.
Fig. 8 is a subsystem workflow diagram of a user unit change configuration in a third preferred embodiment.
Fig. 9 is a block chain charging flow chart in a third preferred embodiment.
Fig. 10 is a schematic diagram of a network public opinion cloud platform according to a fourth preferred embodiment of the present invention.
Fig. 11 is a flowchart of the access performance evaluation subsystem according to the fourth preferred embodiment.
Detailed Description
Detailed description of preferred embodiments
As shown in fig. 1, the online public opinion cloud platform provided in this embodiment includes two subsystems, namely a keyword group and a joint database management subsystem and a data analysis model exchange subsystem.
The key word group and the joint database management subsystem comprise
The keyword group collection module is used for collecting the keyword groups accessed to the public opinion cloud platform and accessing the public opinion systems, and constructing a cloud platform unified keyword group;
the keyword group distribution module unifies the keyword groups to each cloud-separating platform of the access public opinion system;
the public opinion cloud data storage module is connected with the public opinion systems to share effective network public opinion data which is not needed by the public opinion systems and is matched with the unified key phrase of the cloud platform to the public opinion cloud platform, and the public opinion cloud database module carries out aggregation and arrangement on the effective network public opinion data to form a public opinion cloud combined database; and
and the public opinion cloud data distribution module distributes corresponding effective network public opinion data to the public opinion systems according to the unified key word groups of the cloud platforms corresponding to the public opinion systems.
The public opinion cloud platform-accessed public opinion systems ((public opinion companies)) realize the sharing of common or emergency state cloud platform unified key word groups through the public opinion cloud platform on one hand, and realize the direct exchange sharing of the collected effective network public opinion data among the accessed public opinion systems (public opinion companies) through the public opinion cloud platform on the other hand. When the public opinion cloud platform collects data submitted by all parties, the data are subjected to early-stage cleaning conversion, the collected data are subjected to data rearrangement, data cleaning and other processes, and the collected data are accumulated in the collecting and distributing processes to form a public opinion cloud joint database. The data collection flow is as follows:
a. The access public opinion systems of all accesses independently collect network data of all internet platforms;
b. the accessed public opinion systems of all accesses match network data according to the unified keyword group of the cloud platform;
c. the accessed public opinion systems upload effective network public opinion data which are not needed but matched to the public opinion cloud platform;
d. the public opinion cloud platform distributes the uploaded effective network public opinion data to each access public opinion system according to 'the public opinion system (the home opinion company) +the user unit' marked by the matching key phrase corresponding to the effective network public opinion data submitted by each access public opinion system;
e. after receiving cloud distributed public opinion data, each accessed public opinion system analyzes and displays the accessed public opinion system of the relevant user units served by the accessed public opinion system according to the identification of the user unit in the 'explicit system (associated opinion company) +user unit';
f. and the public opinion cloud platform performs centralized storage on all forwarded effective network public opinion data to form a data source of a public opinion cloud joint database.
Meanwhile, in the embodiment, the keyword group and the combined database management subsystem are used for pointedly packaging data required by each public opinion company through the forms of keywords, unique identification, labels and the like, distributing each access public opinion system through the network public opinion cloud data distribution module, and setting safe exchange permission by the data exchange platform to ensure that the data requested by each access public opinion system can only be data within the permission range of the user.
When the data is pushed by all the system of the home-use feelings (the opposite feelings company), the network public opinion cloud data distribution module carries out authority grading and rights management on the data exchange process of all the vendors, after all the system of the home-use feelings (the opposite feelings company) sends a data request, the public opinion cloud platform carries out auditing on the data request, and after the auditing passes, the data containing key word groups can be packed, namely, all the system of the home-use feelings (the opposite feelings company) can only exchange the related data containing the key word groups in the authorities from the data exchange platform of the public opinion cloud platform.
The key phrase and the combined database management subsystem also comprise a specific emergency network public opinion event key phrase module, a specific emergency network public opinion event key phrase of a specific emergency network public opinion event is constructed according to actual requirements, the specific emergency network public opinion event key phrase is pushed to part or all of the access public opinion systems, and the access public opinion systems match after receiving the specific emergency network public opinion event key phrase and package and share matching data to the public opinion cloud platform. The priority of the specific emergency network public opinion event keyword group is higher than that of the conventional cloud platform unified keyword group, and the specific emergency network public opinion event keyword group is received by the public opinion system, then is subjected to priority matching, and related data are packaged and shared to the public opinion cloud platform at the first time.
The key word group and the combined database management subsystem enable the access public opinion systems to be fully utilized through the key word group gathering module, the key word group distribution module and the database storage module, and the network public opinion data are integrated and exchanged and shared uniformly through the public opinion cloud platform, so that the comprehensive application and the scheduling of the network access public opinion systems are formed, and the data utilization rate is improved. Meanwhile, the system can realize high-timeliness collaborative monitoring on emergency or major emergencies.
Further, the keyword group and the combined database management subsystem also comprise a public opinion cloud data management module which comprises data resource integration, manages the cleaning and conversion process of the data collection of the public opinion cloud platform, provides standardized flow and specification for the process, and ensures that the cleaned and converted data are available; the data resource catalogue classifies the data of the public opinion cloud platform and forms the data resource catalogue so as to facilitate the management and inquiry of the data; data standard management, namely collecting standard specification information required by data resource management, and forming a public opinion cloud combined database into a standard database; data security access management, namely establishing hierarchical rights management for the process of accessing the public opinion cloud combined database, and ensuring the security of the data in the process of accessing; and data tag management, namely constructing a unified marking system of the public opinion cloud platform aiming at key word groups of each access public opinion system to form a tag specific to each access public opinion system, so that the public opinion cloud platform is convenient for carrying out data distribution on each access public opinion system.
Considering that the public opinion cloud platform data aggregate mass public opinion data such as various forums, websites, microblogs, weChats, traditional media information and the like, the data structure is complex, the data types are various, and the data maintenance work becomes complex and heavy, so that a set of convenient, efficient and safe data management system is established through the public opinion cloud data management module. The public opinion cloud platform provides data management and monitoring functions from different layers such as data resource directory service, data resource integration process, data standard management, data security access management, data keyword management of each access public opinion system, data tag library management and the like.
As shown in fig. 2, when the subsystem performs data management, the keyword groups of all accessed public opinion systems are collected, and a cloud platform unified keyword group is constructed; the public opinion cloud platform distributes cloud platform unified key word groups to all access public opinion systems, and all access public opinion systems match data acquired by the access public opinion systems according to the cloud platform unified key word groups; each access public opinion system shares effective network public opinion data which is not required by the public opinion system and is matched with the unified keyword group of the cloud platform to the public opinion cloud platform; and collecting the effective network public opinion data provided by each access public opinion system by the public opinion cloud platform, forming a public opinion cloud combined database, and distributing the corresponding public opinion data to the cloud platform according to the cloud platform unified key word group corresponding to each access public opinion system.
In the prior art, all user units served by the current network access public opinion systems belong to independent purchasing and the access public opinion systems built in a self-built and self-used mode are subjected to four stages of monitoring processes of acquisition, comparison, display and analysis independently. The user units need to collect the content of the basic similar main websites, so that most technical resources accessed to the public opinion system are dissipated in the repeated redundant collection process from the global aspect, and the pages collected each time only extract the useful information of interest of the unit because only key word groups focused by the unit are configured. A large amount of valid information not of the unit is directly discarded because no keyword configuration is performed; from the global level, technical resources such as calculation storage and network bandwidth of the access public opinion system which are built by user units of all departments of each place are in a larger internal consumption state due to lack of a unified integration scheduling platform covering heterogeneous access public opinion system networks operated by a plurality of public opinion companies.
The public opinion cloud platform can gather key phrases required or provided by each accessed public opinion system, and after the cloud platform unifies the key phrases according to certain rules, the cloud platform unifies the key phrases and distributes the key phrases to each accessed public opinion system, so that each accessed public opinion system can match not only the key words focused by the cloud platform unifies the key phrases on the basis of original acquired data, thereby simultaneously extracting data information corresponding to the key words of the cloud platform and data information corresponding to the cloud platform unifies the key phrases, sharing the data information corresponding to the cloud platform unifies the key phrases to the public opinion cloud platform, and the cloud platform can distribute the corresponding public opinion data to the cloud platform unifies the key phrases according to the cloud platform unifies corresponding to other accessed public opinion systems for the first time, thereby facilitating the other accessed public opinion systems to receive the required data information from the public opinion cloud platform. The public opinion cloud platform and the keyword group management method are used for integrating and exchanging the network public opinion data uniformly to form comprehensive application and scheduling of the network access public opinion system, and the data utilization rate is improved. Meanwhile, according to the effective network public opinion data provided by each access public opinion system, a public opinion cloud combined database is formed, and the data stored in the public opinion cloud combined database are all effective or useful data, so that the public opinion cloud combined database has public opinion value.
Each access public opinion system determines the key word groups required by the public opinion system and marks the key word groups and then shares the key word groups to the public opinion cloud platform, and the public opinion cloud platform performs compliance checking on the key word groups; if the combination rule is collected, the keyword groups are subjected to duplication removal and integration, and a cloud platform unified keyword group is constructed; if the rule is not met, the rule is fed back to the corresponding access public opinion system and is required to be adjusted or modified to be met.
The key word group and the combined database management subsystem perform compliance checking on the key word group provided by the accessed public opinion system, and the difference of the different accessed public opinion systems in the key word group form can be effectively avoided through the compliance checking on each accessed public opinion system. And the key word groups are de-duplicated and integrated, and the cloud platform unified key word groups are determined, so that each access public opinion system is relatively unified, and the key word groups of all clients served by each access public opinion company are included, so that the full coverage of data matching is ensured, and the operation accuracy and the operation efficiency of the public opinion cloud platform are ensured.
The labeling mode of key word groups required by each access public opinion system is as follows: the labeling content comprises company name and user name of the access public opinion system, and the labeling form is a unique identification. For example, the labeling rule may be preferably XnYm, where n in Xn is a unique code of the public opinion cloud platform for accessing the public opinion system, m in Ym is a unique code of the public opinion system for accessing the public opinion system to the user, for example, X0001Y001 indicates the 0001 th user accessing the public opinion cloud platform for accessing the 001 th user of the public opinion system.
The access public opinion system can also send data requests according to own requirements, and after the keyword groups and the combined database management subsystem audit the data requests, the public opinion data containing keywords required by the access public opinion system are packaged and sent. The access public opinion system can also actively send related data requests to the keyword groups and the combined database management subsystem according to the change of the self requirements, and obtain related public opinion data after the public opinion cloud platform is audited, so that the access public opinion system can quickly and conveniently obtain various public opinion data, and the service quality and the service efficiency of the access public opinion system are facilitated to be provided.
The data analysis model exchange subsystem comprises a standardized network public opinion data analysis model operation environment module, a standardized network public opinion data analysis model operation environment is constructed, and various network public opinion data analysis models of various access public opinion systems of the access public opinion cloud platform provide a standardized operation environment; each access public opinion system standardized data analysis model ensures that the provided data analysis model can normally operate under the standardized operation environment of the public opinion cloud platform; the network public opinion data analysis model trading module is used for constructing a network public opinion data analysis model trading bazaar, and accessing the public opinion system to autonomously bid the provided data analysis model according to rules; and accessing a public opinion system or a user unit to purchase or use any data analysis module from the public opinion cloud platform according to own requirements. And the data analysis model exchange subsystem shares the analysis models of the heterogeneous network access public opinion systems to a platform for exchange use, forms comprehensive application and scheduling of the network access public opinion systems driven by the network public opinion analysis models, and improves the utilization rate of the analysis models.
As shown in fig. 3, the method for exchanging data by using the data analysis model exchanging subsystem includes:
constructing a standardized network public opinion data analysis model operation environment, and providing a standardized operation environment for various network public opinion data analysis models of various access public opinion systems of the public opinion cloud platform;
each access public opinion system standardized data analysis model ensures that the provided data analysis model can normally operate under the standardized operation environment of the public opinion cloud platform;
establishing a network public opinion data analysis model to trade a bazaar, and accessing a public opinion system to autonomously bid the provided data analysis model according to rules; and
and accessing a public opinion system or a user unit to purchase or use any data analysis module from the public opinion cloud platform according to own requirements.
The running environment supports a mainstream technical framework and programming language and is provided with an access interface capable of accessing a public opinion cloud platform database. And each access public opinion system reconstructs and reforms each network public opinion data analysis model which needs to be submitted to the network public opinion cloud platform according to the technical requirements of the standardized operation environment, so that the network public opinion data analysis model meets the requirements of operation on the standardized operation environment of the cloud platform.
In the embodiment, the network public opinion data analysis models of all the accessed public opinion systems (public opinion companies) are uniformly brought into a standardized operation environment through the public opinion cloud platform, all the accessed public opinion systems (private opinion companies) reconstruct and reform all the network public opinion data analysis models which are required to be submitted to the network public opinion cloud platform, so that the network public opinion data analysis models meet the requirements of operation on the standardized operation environment of the cloud platform, and the network public opinion data analysis models are transferred to the standardized operation environment according to relevant standards, thereby realizing the sharing, exchange use and transaction of the data analysis models of different accessed public opinion systems (private opinion companies) on the public opinion cloud platform; each connected public opinion system (a public opinion company) can purchase and configure any data analysis model in the public opinion cloud platform according to the client requirements or the operation and development requirements of the public opinion system, so that a more flexible and diversified network public opinion data analysis model option which is not limited to the self-developed analysis model and is more suitable for the user requirements is provided for the client.
In a specific use process, when a public opinion system or a user unit is accessed to purchase or use any data analysis module, a request service is provided for a public opinion cloud platform, the public opinion cloud platform records the request, the public opinion cloud platform loads a data analysis model into a standardized operation environment after recording, analyzes appointed data of the accessed public opinion system or the user unit, and then pushes a data analysis result to the accessed public opinion system or the user unit.
And the public opinion cloud platform constructs a basic data analysis module according to the requirement of accessing a public opinion system or a user unit.
In this embodiment, the data analysis modules in the network public opinion cloud platform are classified into three categories, the first category is that the public opinion cloud platform constructs basic data analysis modules according to the requirements of access public opinion systems or user units, the second category is that various network public opinion data analysis models which are shared to the public opinion cloud platform by all access public opinion systems (public opinion companies), and the third category is that network public opinion data analysis models which are independently researched and developed by related universities, scientific research institutions or professionals and are uploaded and shared to the public opinion cloud platform. The embodiment forms the comprehensive application and the scheduling of the network access public opinion system driven by the network public opinion analysis model, and improves the utilization rate of the analysis model.
The pricing rule includes pricing based on the number of uses, the length of use, or the amount of analysis data of the data analysis model. The system also comprises a block chain technology-based storage of transaction data of each data analysis model, and a public opinion cloud platform monitors transaction behaviors. The public opinion cloud platform establishes a unified data analysis model transaction mode, transaction behaviors are uniformly regulated by the platform, and transaction data are stored based on a blockchain technology, so that transparency and credibility for each access public opinion system (public opinion company) are ensured.
Second preferred embodiment,
As shown in fig. 4, in this embodiment, a standard library subsystem and a subsystem configured to optimize access to public opinion system are added on the basis of the first preferred embodiment.
The standard library subsystem comprises a keyword group standard module, a public opinion data format standard module, a public opinion data exchange standard module and a network public opinion data analysis model standardized operation environment module.
The keyword group standard module is used for restraining the keyword data format uploaded to the keyword group gathering module by the public opinion manufacturer; the public opinion data format standard module is used for restraining the effective network public opinion data format acquired by the public opinion cloud data storage module; the public opinion data exchange standard module is used for restraining a data exchange process in the data analysis model exchange subsystem; the standardized running environment module of the network public opinion data analysis model establishes standardized input and output standards.
The network public opinion data sharing exchange mechanism mainly comprises public opinion keyword standards, public opinion data format standards, public opinion data exchange standards and the like. Meanwhile, after standardized constraint is carried out on public opinion data, a public opinion core database is further constructed, so that a channel is provided for sharing and exchanging public opinion data among users and between users and platforms, and the public opinion data is shown in fig. 5.
Public opinion keyword criteria. Because the keyword data collected by each public opinion manufacturer has more sources and types and a large amount of repeated data, the platform formulates corresponding network public opinion keyword standards. Such as the key words "security + (greedy |counterfeit |academic falsification)", namely "security greedy", "security counterfeit", "security academic falsification". In this way, a plurality of keywords can be connected into one character string, and the relationship between the keywords can be intuitively understood. Each manufacturer firstly needs to perform stop word removal and repeated data removal processing on the respective keyword data, and then changes the keyword data format to meet the platform standard requirements before uploading the keyword data format to the platform, so that the quality and standardization level of the data are improved.
Public opinion data format standard. Aiming at the problem that the public opinion data formats provided by public opinion manufacturers are not uniform, corresponding format standards are formulated to restrict the formats of the network public opinion data, as shown in table 1.
Table 1 network public opinion data format standard requirement field
Before uploading the public opinion data to the platform, each manufacturer should adjust the format of the public opinion data according to the standard, splice the fields with the corresponding content in the public opinion data, and upload the fields to the platform in the form of JSON or XML. By the mode, the public opinion data can be stored and managed conveniently by the platform, and a user can clearly and intuitively know related information of the public opinion data.
Public opinion data exchange criteria. In the standard, after a user submits data to a platform according to a data format standard, the platform calculates the relevance and similarity index of the keywords according to the data provided by the user, and the data is audited according to the relevance and similarity index. After the verification is passed, the platform stores the analysis result and the original data together into a database. When the user needs to acquire public opinion data by using the platform, the platform only needs to send the keywords to the platform, and then the platform forwards the request to other public opinion manufacturers. When other public opinion manufacturers upload corresponding data, the platform firstly carries out auditing on the data uploaded by the manufacturers, and after the auditing is passed, the data provided by the public opinion manufacturers, the corresponding data in the platform public opinion core database and the data analysis result of the platform are returned to the user together, so that the requirements of the user are met to the maximum extent, and meanwhile, convenience is brought to the data screening and analysis work of the user.
As shown in fig. 6, when the subsystem configured by the optimized access public opinion system recommends the optimized configuration for the network public opinion data collection strategy of each access public opinion system, on one hand, the data collection strategy of each access public opinion system is proposed with the optimized configuration suggestion by analyzing the network public opinion data which is mutually forwarded by the public opinion cloud platform of each access public opinion system in a period of time, and the collaborative coordination of each access public opinion system in the aspect of website data collection is promoted, so that the overall network public opinion data collection efficiency is improved; on the other hand, the collection is connected to the network public opinion data analysis model of each public opinion system of the public opinion cloud platform, and the network public opinion data analysis model with low adoption rate is screened from the network public opinion data analysis models with similar functions and more submitted quantity and fed back to the related access public opinion system, so that the research and development investment of the related model is recommended to be regulated.
And in the redundancy elimination process of the collected network public opinion data collection model, the redundancy is reduced after the range of the collection website is negotiated and cooperated. The method comprises the steps of selecting a website with the configuration rate 2 times higher than the average configuration rate as a high-configuration-rate acquisition website during negotiation, selecting a website with the configuration rate 1/2 lower than the average configuration rate as a low-configuration-rate acquisition website, pushing suggestions for reducing configuration to public opinion companies related to the access public opinion system if the acquisition frequency of the high-configuration-rate acquisition website is higher than the data updating frequency, and pushing the acquisition website with the low configuration rate to the suggestions for increasing configuration of the related access public opinion system according to the category to acquire the website.
Wherein average allocation rate = number of public opinion systems configured to collect target websites/sum of configured to collect target websites.
In the redundancy reduction process, the public opinion cloud platform can analyze the range and the acquisition frequency of each acquisition website which are set by the access opinion system from effective public opinion data for a period of time. The websites with most of the system in the condition are selected as the network public opinion data acquisition range, and the comprehensive acquisition frequency is greatly higher than the data update frequency of the websites in the whole, and each system in the condition is accessed to the website because of the network public opinion data exchange sharing mechanism, so that the websites with the excessively high acquisition frequency in the whole set part can be completely abandoned without worrying about the problem of missed acquisition of important information caused by abandoning the acquisition. Meanwhile, the public opinion cloud platform can analyze acquisition websites with relatively less configuration of each website, divide the websites with less acquisition according to the configuration conditions of the acquisition websites of each access emotion system, and recommend related access emotion systems to configure the websites into acquired websites. The related access condition system is recommended to reduce and increase related acquired websites, so that the overall acquisition efficiency of all access condition systems is optimized on the whole, and the acquisition range and the effectiveness are not sacrificed.
And in the redundancy removing process of the collected network public opinion data analysis model, collecting the adoption rate of the user units or the access public opinion systems to the network public opinion data analysis model shared on the public opinion cloud platform, screening the network public opinion data analysis model with the adoption rate lower than the average adoption rate by 1/2, and feeding back to the public opinion systems.
The network public opinion data acquisition recommendation module is used for pushing configuration optimization suggestions of acquisition websites to each accessed public opinion system; and screening out websites which are set as the network public opinion data acquisition range by most public opinion systems, and acquiring websites which are relatively less configured by all public opinion systems. And thus, the related collection websites are reduced and increased by recommending related access public opinion systems.
And the network public opinion data analysis model recommendation module is used for pushing optimization suggestions for research and development investment of the network public opinion data analysis model to each access public opinion system. And submitting the respectively developed network public opinion data analysis models to the system by each access public opinion system. The module analyzes the repeated conditions of the types and the number of the analysis models on the whole for the adoption of the network public opinion data analysis model submitted by each access public opinion system by a user unit for a period of time for the network public opinion data analysis model submitted by each access public opinion system. And selecting the network public opinion data analysis models with lower user unit adoption rate from the network public opinion data analysis models, and suggesting to submit the model public opinion systems to reduce the research and development investment of the data analysis models. The repeated investment is reduced by coordinating each access public opinion system, the cooperative technology is developed by concentrating resources, the investment efficiency of the research and development resources of the network data model of all access public opinion systems is optimized on the whole in a complementary advantage mode, and the diversity, the advancement and the user unit satisfaction of the network public opinion data analysis model on the whole are not sacrificed.
Preferred embodiment III,
As shown in fig. 7, in this embodiment, a subsystem for changing the configuration of the user unit is added to the second preferred embodiment.
The subsystem is composed of the following parts.
And the network public opinion technical service self-selection combined supermarket module is used for uniformly displaying the network public opinion data acquisition modules and the network public opinion data analysis modules which are connected into the public opinion system and providing the network public opinion data acquisition modules for user units to select and combine. The module is used for uniformly displaying the network public opinion data acquisition capacity (including indexes such as acquisition range and acquisition frequency) and the network public opinion data analysis module (including module introduction, module price and the like) of each access public opinion system. The user unit can combine the data acquisition capability and the data analysis module in a menu mode according to the self system construction budget and the actual service requirement. The method is characterized in that the method comprises the steps of assembling according to a selection combination of user units through a unified standardized interface, supporting the user units to adjust the combination of the data acquisition capability and the data analysis module which are originally selected according to the serial numbers of self business requirements at the later stage of using the self-selection combination type cloud public opinion system, and comprising adding, deleting or replacing. Therefore, the requirements of the user units are met, the implementation is not limited by the range which can be provided by a certain access public opinion system, the selection can be performed from the sum of data technology resources which can be provided by all access public opinion systems, and the flexibility of the user units in the aspect of coping with the change of the service requirements is improved.
And the network public opinion cloud platform provides a system interface for setting the keyword group for the user unit through the cloud public opinion system, so that the keyword group required by the user unit is obtained.
And the network public opinion cloud platform distributes keyword groups required by the user units of the cloud public opinion system to related access public opinion systems (selected by the user units to be network public opinion data acquisition module providers).
And the network public opinion cloud platform distributes the unified keyword groups of the network public opinion cloud platform to the related access public opinion system (selected by a user unit to be a network public opinion data acquisition module provider).
The standardized network public opinion data analysis model operation environment module is used for constructing a standardized network public opinion data analysis model operation environment and providing a standardized operation environment for various network public opinion data analysis models accessed to the public opinion system; each access public opinion system standardized data analysis model ensures that the provided data analysis model can normally operate under the standardized operation environment of the public opinion cloud platform;
and the network public opinion data analysis model trading module is used for constructing a network public opinion data analysis model trading bazaar, accessing the public opinion system to autonomously bid the provided data analysis model according to rules, and accessing the public opinion system or a user unit to purchase or use any data analysis module from the public opinion cloud platform according to own requirements.
And the charging module is used for charging the effective network public opinion information provided for the user units by the related access public opinion system.
And the charging module of the network public opinion data acquisition data analysis module charges the network public opinion data analysis module which is provided by the related access public opinion system for a user unit.
After the invention is put into use, a network public opinion technical service self-selection combined supermarket facing to the user units is constructed, a unified display platform is provided for each public opinion company, meanwhile, the keyword group set by the user units is distributed to a related access public opinion system for collection and matching, the matching network public opinion data of the related access public opinion system is collected and then subjected to repeated elimination treatment, and the data is provided for the user units through a cloud public opinion system;
on one hand, each access public opinion system (public opinion company) provides network public opinion data acquisition and network public opinion data analysis capability for a user unit through the cloud public opinion system, so that cost investment of each access public opinion system (public opinion company) in marketing can be effectively reduced; on the other hand, each user unit can change the configuration of the network public opinion data acquisition and the network public opinion data analysis according to the service requirements of the user unit and the advantages and disadvantages of the network public opinion data acquisition and the network public opinion data analysis capability provided by different manufacturers in the use process of the cloud public opinion system, so that the flexible adaptability of the cross public opinion system (public opinion company) is realized.
As shown in fig. 8, when the subsystem is put into operation, the specific steps are as follows:
the first step, the network public opinion cloud platform gathers the network public opinion data acquisition module and the network public opinion data analysis module which are respectively connected to the public opinion system, and the network public opinion technology capability self-selection supermarket which can be used for the self-selection combination of the user units is constructed after all the modules of the gathering are combined and adjusted.
In this step, the public opinion cloud platform connects each network public opinion data acquisition module (the acquisition capability includes the acquisition range, the acquisition frequency and other indexes) and the network public opinion data analysis module (including module introduction, module price and the like) to the "company", and performs unified display on the module. The user can combine the data acquisition capability and the data analysis module in a menu mode according to specific conditions such as self system construction budget, actual service requirements and the like.
The public opinion cloud platform assembles the interfaces according to the selection combination of the user by using a unified and standardized 'cloud public opinion system', and supports the self-selection combination of the user.
In the step, the network public opinion cloud platform builds a standardized network public opinion data analysis model operation environment, and various network public opinion data analysis models of various public opinion systems accessed to the public opinion cloud platform provide the standardized operation environment; and (3) standardizing the data analysis model by each public opinion system, and ensuring that the provided data analysis model can normally operate in a standardized operation environment of a public opinion cloud platform. The operating environment supports mainstream technical frameworks and programming languages and has an access interface that can access public opinion cloud platform databases.
Secondly, after a user unit autonomously selects and combines different modules in a 'network public opinion technical ability self-selected supermarket', generating a 'cloud public opinion system' for the user unit by a network public opinion cloud platform; after the user unit is in a self-selection combined type, the combination of the original selected data acquisition capacity and the data analysis module is adjusted according to the change of the self service requirement, including addition, deletion or replacement, so that the continuous adaptability of the user unit requirement is met. The user unit can select the data acquisition module and the data analysis module from the sum of all the data technical resources provided by all the access companies without being limited by the range provided by one home-active company.
And thirdly, the network public opinion cloud platform gathers keyword groups set by user units through a cloud public opinion system, and distributes the keyword groups to related access public opinion systems (the keyword groups are selected by the user units to form a network public opinion data acquisition module provider).
And fourthly, accessing a public opinion system to collect and match key word groups set by related user units, defining successfully matched network public opinion data as effective network public opinion data, and pushing the effective network public opinion data to a network public opinion cloud platform.
And fifthly, in the step, the network public opinion cloud platform is connected to the public opinion system to perform duplication elimination by taking the links of the public opinion pages as units on the effective network public opinion data pushed by the 'cloud public opinion system' user. The same link is pushed by a plurality of 'regular emotion companies', the 'regular emotion company' which pushes the link first is marked with the 'effective collection' of the link, and the 'effective collection' of the link is displayed on a 'cloud public opinion system' interface of a related user, and the 'regular emotion company' which pushes the link is marked with the 'ineffective collection' of the link.
And step six, in the service period of the user of the cloud public opinion system, carrying out statistics and charging on the effective network public opinion information provided for the user units by the related access public opinion system.
And seventhly, the user unit is in the network public opinion data analysis model of the network public opinion cloud platform to trade the local market and automatically combine and select the relevant network public opinion data analysis module.
And eighth step, the network public opinion cloud platform operates a related network public opinion data analysis module selected by the user unit through the standardized network public opinion data analysis model operation environment, and a unified system interface is provided by the cloud public opinion system for display to the user unit for use.
And ninth, carrying out statistics and charging on the network public opinion data analysis module which is provided for the user unit by the related access public opinion system.
And tenth, the user unit changes the configuration of the network public opinion data acquisition and the network public opinion data analysis according to the service requirements of the user unit and the advantages and disadvantages of the network public opinion data acquisition and the network public opinion data analysis provided by different manufacturers.
The public opinion cloud platform and a cloud platform fund pool and a settlement system based on block chains between the public opinion systems can also be additionally arranged. The system comprises the following modules:
a user platform interface. And a graphic system interface facing the user units is provided by the public opinion cloud platform, so that a user using the cloud public opinion system does not need to care about the operation mechanism of each item of the platform, only needs to care about public opinion information or a public opinion analysis model required by the user, and selects a corresponding operator providing service through the interface, thereby being flexible and configurable. The public opinion cloud platform provides a trading bazaar of public opinion information and analysis model for users, and the public opinion information and analysis result are focused on, so that the requirements of the users for rapidly and high-quality obtaining public opinion are met. And, the transaction of the platform will be supported by the billing system.
A blockchain-based billing system. Transaction data in the public opinion cloud platform is stored through a blockchain, and the transaction data is counted by different manufacturers through a platform background to finally provide effective public opinion data or data of an analysis model for a user, and the data is stored. As shown in fig. 9, the blockchain charging flow is as follows: the user collects charging information according to the transaction details of the user; the client encrypts the data and transmits the encrypted data to the cloud server; the cloud records the charging information into a block chain; the blockchain intelligence contract automatically charges a fee.
Fourth preferred embodiment,
As shown in fig. 9, the third embodiment adds an access operation efficiency evaluation subsystem based on the third preferred embodiment, which includes a data acquisition exchange efficiency module, and evaluates the data acquisition exchange efficiency of each access public opinion system, where the data acquisition exchange efficiency is determined according to the shared data and the received data of the access public opinion system; the data analysis model efficiency module is used for evaluating the data analysis model efficiency of each access public opinion system, and the data analysis model efficiency is determined according to the use duration and the number of times of the data analysis model of the access public opinion system; and the network public opinion cloud platform is connected to the operation efficiency module, and the operation efficiency of the connection is determined according to the data acquisition exchange efficiency evaluation result and/or the data analysis model efficiency evaluation result of each connection public opinion system.
The access operation efficiency evaluation subsystem further comprises an elimination module, wherein the elimination module sets the final elimination rate S1 of the data acquisition and exchange efficiency and the final elimination rate S2 of the data analysis model efficiency for the access public opinion system in the public opinion cloud platform; and calculating an access public opinion system set T1 to be eliminated according to the S1 according to the time period, calculating an access public opinion system set T2 to be eliminated according to the S2, and determining an intersection T3 of the T1 and the T2 to be eliminated to access the public opinion system.
The access operation efficiency evaluation subsystem further comprises an efficiency monitoring module and a warning module; the efficiency monitoring module monitors shared or accepted data of each accessed public opinion system through a public opinion cloud platform and a data analysis model; the warning module pre-warns the public opinion cloud platform and the related access public opinion system according to the abnormal monitoring result of the efficiency monitoring module, timely discovers the access public opinion system which fails to share or accept data normally, timely discovers the public opinion data analysis model which cannot operate normally on the cloud platform, and timely informs related access public opinion enterprises to carry out rectification.
As shown in fig. 10, when the subsystem performs evaluation of the network public opinion cloud platform access operation efficiency, the method is as follows:
The method comprises the steps that data acquisition and exchange efficiency is evaluated on access public opinion systems of heterogeneous access of different public opinion enterprises in a public opinion cloud platform, and the data acquisition and exchange efficiency is determined according to shared data and accepted data of the access public opinion systems;
evaluating the efficiency of a data analysis model of each access public opinion system in the public opinion cloud platform, wherein the efficiency of the data analysis model is determined according to the use duration and the number of times of the data analysis model of the access public opinion system;
and determining the cloud platform access operation efficiency of the access public opinion system according to the data acquisition exchange efficiency evaluation result and/or the data analysis model efficiency evaluation result of each access public opinion system.
In this embodiment, through the above evaluation method, a public opinion cloud platform having a plurality of public opinion systems can be accessed to perform efficiency evaluation on each public opinion system, and the public opinion system is accessed with lower operation efficiency in a clear period, and some public opinion systems with higher operation efficiency in the market are accessed in a introduced manner, so that the operation efficiency of the whole public opinion cloud platform is improved, and benign operation of the public opinion cloud platform is formed. Meanwhile, the evaluation can be performed by only adopting the data acquisition and exchange efficiency evaluation results of all the access public opinion systems, the evaluation can be performed by only adopting the data analysis model efficiency evaluation results of all the access public opinion systems, the comprehensive evaluation can be performed by adopting the data acquisition and exchange efficiency evaluation results and the data analysis model efficiency evaluation results of all the access public opinion systems, and the evaluation method is flexible and applicable to various situations.
The data acquisition exchange efficiency is shared data of the access public opinion system: the receiving data of the access public opinion system is the data of other access public opinion systems adopted or used by the access public opinion system from the public opinion cloud platform, and the sharing data is the data which is shared by the access public opinion system to the public opinion cloud platform and is adopted or used by the other access public opinion systems.
In this embodiment, the efficiency of the data analysis model of the nth access public opinion system is set to An, the shared data of the access public opinion system is set to Bn, and the accepted data of the access public opinion system is set to Cn; an=bn/Cn, when the more data is received or used by An access public opinion system from the public opinion cloud platform, cn is larger, when the more data is received or used by the access public opinion cloud platform, bn is larger, for the public opinion cloud platform, the more shared data of An access public opinion system is used, the better the efficiency of the access public opinion system, when a certain access public opinion system receives a large amount of data from the platform but the shared data is not adopted by other access public opinion systems, the worse the public opinion efficiency is, so for an=bn/Cn, when An value of An of the access public opinion system is larger, the better the efficiency of network public opinion data is.
The efficiency of the data analysis model is the use duration and the number of times of the data analysis model which is shared by the access public opinion system to the public opinion cloud platform and is adopted or used by other access public opinion systems.
In this embodiment, each access public opinion system in the access public opinion cloud platform shares the data analysis model while sharing data, so the efficiency of the data analysis model is also an important index for evaluating the efficiency of one access public opinion system, and the longer or the more times the data analysis model shared by the access public opinion system is used, the better the efficiency of the data analysis model of the access public opinion system is.
And establishing a elimination mechanism according to the cloud platform access operation efficiency evaluation result, setting the final elimination rate S1 of the data acquisition and exchange efficiency and the final elimination rate S2 of the data analysis model efficiency for the access public opinion system in the public opinion cloud platform. As a preferred embodiment, in this embodiment, the set of to-be-eliminated access public opinion systems T1 is calculated according to S1, the set of to-be-eliminated access public opinion systems T2 is calculated according to S2, and the intersection T3 of T1 and T2 is calculated to determine to-be-eliminated access public opinion systems. And setting final elimination rates for the two effectiveness respectively, so that each access public opinion system is stimulated to improve data quality, the data resource quality of the public opinion cloud platform is ensured, the benign competition among different access public opinion systems is promoted on the basis of comprehensively, effectively and accurately evaluating the cloud platform access operation effectiveness of each public opinion system, and the data resource on the public opinion cloud platform is efficiently utilized.
In summary, the present embodiment evaluates the cloud platform access operation performance of the access public opinion system from two aspects of data collection exchange performance and data analysis model performance. The embodiment evaluates the data acquisition exchange efficiency of the access public opinion system based on the proportion of the shared data and the accepted data of the access public opinion system; evaluating the effectiveness of a data analysis model accessing the public opinion system based on the duration and the number of times the data analysis model is used; the adoption amount of the shared data by the user can reflect the effectiveness of the shared data, and the higher the adoption amount is, the higher the correlation of the data is; the using time length and the times of the user to the analysis model can reflect the quality degree of the analysis model, and the longer the using time length or the more times of the user of the analysis model with better efficiency are, otherwise, the shorter the using time length or the less times are. By adopting the method, the cloud platform access operation efficiency of each public opinion system can be comprehensively, effectively and accurately estimated, the advantages and disadvantages of each public opinion system are intuitively reflected by the cloud platform access operation efficiency estimation mode, the benign competition among different access public opinion systems is promoted, and the better screening of users in different access public opinion systems is also facilitated. On the other hand, the method and the device enable the data resources on the public opinion cloud platform to be utilized efficiently.

Claims (6)

1. The utility model provides a network public opinion cloud platform which characterized in that: the platform comprises a keyword group and a joint database management subsystem and a data analysis model exchange subsystem;
the keyword group and joint database management subsystem comprises a keyword group collection module, a keyword group distribution module, a public opinion cloud data storage module and a public opinion cloud data distribution module;
the keyword group collection module is used for collecting collected keyword groups and constructing a unified keyword group of the public opinion cloud platform; the keyword group distribution module is used for distributing unified keyword groups to each access public opinion system; the public opinion cloud data storage module is used for carrying out aggregation and arrangement on the effective network public opinion data to form a public opinion cloud joint database; the public opinion cloud data distribution module is used for distributing corresponding effective network public opinion data to the public opinion systems according to the unified keyword groups corresponding to the public opinion systems;
the data analysis model exchange subsystem comprises a standardized network public opinion data analysis model operation environment module and a network public opinion data analysis model transaction module;
the standardized network public opinion data analysis model operation environment module is used for constructing a standardized network public opinion data analysis model operation environment; the network public opinion data analysis model trading module is used for constructing a network public opinion data analysis model trading bazaar so as to access the public opinion system to autonomously bid the provided data analysis model, and access any data analysis module of the public opinion system or a user unit can be selected;
The key phrase and the combined database management subsystem also comprise a specific emergency network public opinion event key phrase module, a specific emergency network public opinion event key phrase of a specific emergency network public opinion event is constructed according to actual requirements, the specific emergency network public opinion event key phrase is pushed to part or all of the access public opinion systems, and the access public opinion systems match after receiving the specific emergency network public opinion event key phrase and package and share matching data to a public opinion cloud platform; the priority of the specific emergency network public opinion event keyword group is higher than that of the conventional cloud platform unified keyword group, and the specific emergency network public opinion event keyword group is received by the public opinion system, then is subjected to priority matching and related data are packed and shared to the public opinion cloud platform at the first time;
the platform also includes a subsystem for changing configuration of the user unit, the subsystem includes
The network public opinion technical service self-selection combined supermarket module is used for constructing a network public opinion technical service self-selection combined supermarket, and the network public opinion data acquisition module and the network public opinion data analysis module which are connected into the public opinion system are uniformly displayed and are used for a user unit to select and combine;
the network public opinion cloud platform provides a system interface for setting the keyword group for the user unit through the cloud public opinion system, so that the keyword group required by the user unit is obtained;
The network public opinion cloud platform distributes keyword groups required by the user units of the cloud public opinion system to the related access public opinion system;
the charging module is used for charging the effective network public opinion information provided for the user units by the related access public opinion system;
the network public opinion data acquisition data analysis module charging module is used for charging the network public opinion data analysis module which is provided for a user unit by the related access public opinion system;
the platform also includes an access performance evaluation subsystem including
The data acquisition exchange efficiency module is used for evaluating the data acquisition exchange efficiency of each access public opinion system, and the data acquisition exchange efficiency is determined according to the shared data and the received data of the access public opinion system;
the data analysis model efficiency module is used for evaluating the data analysis model efficiency of each access public opinion system, and the data analysis model efficiency is determined according to the use duration and the number of times of the data analysis model of the access public opinion system;
the network public opinion cloud platform is connected to the operation efficiency module, and the operation efficiency of the connection is determined according to the data acquisition exchange efficiency evaluation result and/or the data analysis model efficiency evaluation result of each connection public opinion system;
The access operation efficiency evaluation subsystem further comprises an elimination module, wherein the elimination module sets an end elimination rate S1 of data acquisition and exchange efficiency and an end elimination rate S2 of data analysis model efficiency for an access public opinion system in the public opinion cloud platform; and calculating an access public opinion system set T1 to be eliminated according to the S1 according to the time period, calculating an access public opinion system set T2 to be eliminated according to the S2, and determining an intersection T3 of the T1 and the T2 to be eliminated to access the public opinion system.
2. The network public opinion cloud platform of claim 1, wherein: the keyword group and the joint database management subsystem also comprise a public opinion cloud data management module which comprises
Data resource integration, which is to manage the cleaning and conversion process of the data collection of the public opinion cloud platform, provide standardized flow and specification for the process, and ensure that the cleaned and converted data is available;
the data resource catalogue classifies the data of the public opinion cloud platform and forms the data resource catalogue so as to facilitate the management and inquiry of the data;
data standard management, namely collecting standard specification information required by data resource management, and forming a public opinion cloud combined database into a standard database;
And (3) data security access management, namely establishing hierarchical rights management for the process of accessing the public opinion cloud combined database, and ensuring the security of the data in the process of accessing.
3. The network public opinion cloud platform of claim 1, wherein: the platform also comprises a standard library subsystem, wherein the standard library subsystem comprises a keyword group standard module, a public opinion data format standard module, a public opinion data exchange standard module and a network public opinion data analysis model standardized operation environment module.
4. The network public opinion cloud platform of claim 3, wherein: the keyword group standard module is used for restraining the keyword data format uploaded to the keyword group gathering module by the public opinion manufacturer; the public opinion data format standard module is used for restraining the effective network public opinion data format acquired by the public opinion cloud data storage module; the public opinion data exchange standard module is used for restraining a data exchange process in the data analysis model exchange subsystem; the standardized running environment module of the network public opinion data analysis model establishes standardized input and output standards.
5. The network public opinion cloud platform of claim 3, wherein: the platform also comprises an optimizing subsystem for the resource allocation of the accessed public opinion system, and the subsystem comprises
The network public opinion data acquisition recommendation module pushes configuration optimization suggestions of acquisition websites to each accessed public opinion system;
and the network public opinion data analysis model recommendation module pushes optimization suggestions for research and development investment of the network public opinion data analysis model to each access public opinion system.
6. The network public opinion cloud platform of claim 1, wherein: the access operation efficiency evaluation subsystem further comprises an efficiency monitoring module and a warning module; the efficiency monitoring module monitors shared or accepted data of each accessed public opinion system through a public opinion cloud platform and a data analysis model; the warning module pre-warns the public opinion cloud platform and the related access public opinion system according to the abnormal monitoring result of the efficiency monitoring module, timely discovers the access public opinion system which fails to share or accept data normally, timely discovers the public opinion data analysis model which cannot operate normally on the cloud platform, and timely informs related access public opinion enterprises to carry out rectification.
CN202110444555.5A 2021-04-23 2021-04-23 Internet public opinion cloud platform Active CN113094621B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202110444555.5A CN113094621B (en) 2021-04-23 2021-04-23 Internet public opinion cloud platform

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202110444555.5A CN113094621B (en) 2021-04-23 2021-04-23 Internet public opinion cloud platform

Publications (2)

Publication Number Publication Date
CN113094621A CN113094621A (en) 2021-07-09
CN113094621B true CN113094621B (en) 2023-08-08

Family

ID=76679876

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202110444555.5A Active CN113094621B (en) 2021-04-23 2021-04-23 Internet public opinion cloud platform

Country Status (1)

Country Link
CN (1) CN113094621B (en)

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN114968329B (en) * 2022-04-22 2022-12-20 深圳市魔数智擎人工智能有限公司 Full-process management method for custom model

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2013026362A1 (en) * 2011-08-22 2013-02-28 华为技术有限公司 Method and system for monitoring network traffic
CN109286613A (en) * 2018-08-28 2019-01-29 刘琦 Control system is led in a kind of monitoring of network public-opinion
CN109903176A (en) * 2019-02-03 2019-06-18 内蒙古工业大学 A kind of real-time the analysis of public opinion method based on streaming cloud platform
CN111353085A (en) * 2018-12-24 2020-06-30 广州市优泰安防技术有限公司 Cloud mining network public opinion analysis method based on feature model

Family Cites Families (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
TWI601088B (en) * 2014-10-06 2017-10-01 Chunghwa Telecom Co Ltd Topic management network public opinion evaluation management system and method

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2013026362A1 (en) * 2011-08-22 2013-02-28 华为技术有限公司 Method and system for monitoring network traffic
CN109286613A (en) * 2018-08-28 2019-01-29 刘琦 Control system is led in a kind of monitoring of network public-opinion
CN111353085A (en) * 2018-12-24 2020-06-30 广州市优泰安防技术有限公司 Cloud mining network public opinion analysis method based on feature model
CN109903176A (en) * 2019-02-03 2019-06-18 内蒙古工业大学 A kind of real-time the analysis of public opinion method based on streaming cloud platform

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
大数据时代的职工舆情监测分析――以网络大数据监测分析系统的构建与应用为中心;李双;张才明;;新视野(第03期);94-100 *

Also Published As

Publication number Publication date
CN113094621A (en) 2021-07-09

Similar Documents

Publication Publication Date Title
US8195525B2 (en) Method and apparatus upgrade assistance using critical historical product information
CN110175788A (en) A kind of smart city energy cloud platform
CN103493076B (en) For the method and system for the improvement reservation system for optimizing the searching request repeated
US20020046053A1 (en) Web based risk management system and method
CN104169950A (en) Database system using batch-oriented computation
CN106663224A (en) Interactive interfaces for machine learning model evaluations
RU2004133050A (en) COMPUTING SYSTEM AND METHOD FOR FORMING ANALYTICAL DATA RELATING TO THE METHOD OF PROCESSING PROJECT PROPOSALS AND APPLICATIONS
CN101763611A (en) Intelligent tour schedule planning system based on wideband network
KR101703529B1 (en) Market analysis service provision method in accordance with market analysis thereof
KR102181950B1 (en) Method for providing big data based insolvency stock transaction service
CN107067260A (en) Information management system and method
Yu A web-based consumer-oriented intelligent decision support system for personalized e-services
CN113094621B (en) Internet public opinion cloud platform
US20040143488A1 (en) System and method for integration of actual product costs
US7461019B2 (en) System and method for integration of material costs of a product
CN109754276A (en) Method and system, record media and the computer program product that big data is collected and shares in the benefit
CN111460300B (en) Network content pushing method, device and storage medium
Krishankumar et al. An integrated personalized decision approach with probabilistic linguistic context for grading restaurants in India
CN113094620B (en) Network public opinion cloud platform data analysis model exchange method, system and platform
US20200342374A1 (en) Method of managing information security program maturity
CN108268482A (en) Information-pushing method, device and equipment
US8386372B2 (en) System, method and computer program product for compiling golden copy of securities pricing
RU53794U1 (en) AUTOMATED CUSTOMER DATA COLLECTION AND PROCESSING SYSTEM
KR20220142163A (en) BCS Systems and Methods Based on Big Data Analytics
Li et al. A road data assets revenue allocation model based on a modified Shapley value approach considering contribution evaluation

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant