CN110533477A - A kind of intelligent analysis method and system based on big data - Google Patents
A kind of intelligent analysis method and system based on big data Download PDFInfo
- Publication number
- CN110533477A CN110533477A CN201910827781.4A CN201910827781A CN110533477A CN 110533477 A CN110533477 A CN 110533477A CN 201910827781 A CN201910827781 A CN 201910827781A CN 110533477 A CN110533477 A CN 110533477A
- Authority
- CN
- China
- Prior art keywords
- data
- module
- submodule
- user
- intelligent analysis
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/21—Design, administration or maintenance of databases
- G06F16/215—Improving data quality; Data cleansing, e.g. de-duplication, removing invalid entries or correcting typographical errors
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/26—Visual data mining; Browsing structured data
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06Q30/00—Commerce
- G06Q30/02—Marketing; Price estimation or determination; Fundraising
- G06Q30/0201—Market modelling; Market analysis; Collecting market data
- G06Q30/0202—Market predictions or forecasting for commercial activities
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Databases & Information Systems (AREA)
- Business, Economics & Management (AREA)
- Finance (AREA)
- Strategic Management (AREA)
- Data Mining & Analysis (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Accounting & Taxation (AREA)
- Development Economics (AREA)
- General Engineering & Computer Science (AREA)
- Entrepreneurship & Innovation (AREA)
- Quality & Reliability (AREA)
- Game Theory and Decision Science (AREA)
- Economics (AREA)
- Marketing (AREA)
- General Business, Economics & Management (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
- Management, Administration, Business Operations System, And Electronic Commerce (AREA)
Abstract
The invention discloses a kind of intelligent analysis method and system based on big data.Wherein the system includes: data acquisition screening module, data processing module, data-mining module, data display module, propagates fission module, authority management module.This method comprises: data acquisition screening, data processing, data mining, data displaying, propagation fission and rights management.The present invention has the advantages that the powerful processing capacity of cloud computing technology and mass data storage ability are combined, analysis mass users behavioral data in real time, user interest is obtained in time, share by internet with wechat propagation, realization can allow enterprise to service target user by the marketing methods of data, and promotion obtains objective ability and marketing efficiency.
Description
Technical field
The present invention relates to big data processing technology field, in particular to a kind of intelligent analysis method based on big data and it is
System.
Background technique
As internet platform is increasingly developed, the environment of a kind of hardware and software platform, diversification is presented in current internet.It is mutual instantly
In networked environment, many enterprises all suffer from the puzzlement that Customer Tracking is difficult, conversion ratio is low, marketing efficiency is low, how to reduce and stay
Money loss increases and obtains objective channel, increase Communication with Customer stickiness, improve success rate of signing a bill, and is the problem of enterprise needs most attention.It passes
The data sheet development efficiency of system is low, Maintenance Difficulty, and the coding R&D cycle is long, and difficult in maintenance, especially many SaaS are soft on the market
All customer demands can not be flexibly met towards numerous clients in part.
Summary of the invention
The technical problem to be solved by the present invention is in view of the above problems, provide a kind of intellectual analysis side based on big data
Method and system combine the powerful processing capacity of cloud computing technology and mass data storage ability, analyze magnanimity in real time and use
Family behavioral data, obtains user interest in time, shares by internet with wechat propagation, realizing can allow enterprise to pass through data
Marketing methods have serviced target user, and promotion obtains objective ability and marketing efficiency.
In order to solve the above technical problems, technical solution provided by the invention are as follows: a kind of intellectual analysis system based on big data
System, it is characterised in that: including data acquisition screening module, data processing module, data-mining module, data display module, pass
Broadcast fission module and authority management module.
As an improvement, the described data acquisition screening module include data-acquisition submodule, it is data cleansing submodule, basic
Data sub-module stored and primitive behavior data sub-module stored.
As an improvement, the data processing module includes data prediction submodule.
As an improvement, the data-mining module include data modeling submodule, characteristic operation submodule, user portrait deposit
Store up submodule.
As an improvement, the data display module includes electrical form, instrument board.
As an improvement, the authority management module includes user role system control submodule.
A kind of intelligent analysis method based on big data, which comprises the following steps:
S1: data-acquisition submodule and data cleansing submodule are acquired and screen to the information and data of user, and
It sends user's master data to master data sub-module stored to store, user behavior data sends primitive behavior data to
Sub-module stored storage；
S2: being pre-processed collected data by pretreatment submodule, pretreatment include removal deficiency of data,
Deleting duplicated data, picture, counting user are to using the event action different to anchor point to be converted into after treatment
Corresponding data format saves in the database, creates data set by data modeling submodule, while establishing user behavior number
It according to ontology model, and stores in the database, the table in a variety of different data sources is created as to different data sets, and collect
In data set list；
S3: characteristic operation submodule carries out operation to the data that data modeling submodule is included, and excavates user characteristic data,
And it is stored by user's portrait sub-module stored；
S4: by electrical form to the data procession screening of storage, Classifying Sum, AutoSum, conditional formats, number
According to export, text-processing, Form Handle, instrument board by data in a manner of line chart, pie chart, histogram, dendrogram, with visualization
Mode presented, while data are screened and are inquired, the data between each chart is allow to link；
S5: it propagates fission module reception popularization access connection and propagates the data of generation, and store it in ephemeral data
In table, by data temporally, user, ID classification save into corresponding temporary data table；It is successively obtained from temporary data table
The relation information for including in data；The access request for promoting access link is received, and is believed according to the relationship that temporary data table obtains
The user being related to is established association binding relationship by breath；According to the data in effective list, generates and propagate fission figure；
S6: by user role system manage submodule, carry out basic rights management so that different people see it is different
Report content realizes the row grade granularity authority managing and controlling of data.
The invention has the advantages that the present invention acquires screening module, data processing module, data mining mould by data
Block, data display module propagate fission module, authority management module these module compositions.The present invention can not for enterprise
Marketing efficiency is promoted, high intention top-tier customer can not be identified, the problem of target user can not be expanded and phenomenon is improved and created
Newly, the powerful processing capacity of cloud computing technology and mass data storage ability are combined, analyzes mass users behavior in real time
Data obtain user interest in time, share by internet with wechat propagation, realize the marketing hand that enterprise can be allowed to pass through data
Section has serviced target user, and promotion obtains objective ability and marketing efficiency.
Detailed description of the invention
Fig. 1 is a kind of flow chart of the intelligent analysis method based on big data of the present invention.
Fig. 2 is the principle that a kind of data of intelligent analysis method and system based on big data of the present invention acquire screening module
Block diagram.
Fig. 3 is a kind of principle frame of the data-mining module of intelligent analysis method and system based on big data of the present invention
Figure.
Fig. 4 is a kind of structural representation of the propagation fission figure of intelligent analysis method and system based on big data of the present invention
Figure.
Specific embodiment
To make the objectives, technical solutions, and advantages of the present invention clearer, below with reference to embodiment, the present invention is made
Further to be described in detail, exemplary embodiment of the invention and its explanation for explaining only the invention, are not intended as to this
The restriction of invention.
Embodiment
As shown in Figure 1, a kind of intelligent analysis method and system based on big data, includes the following steps:
S1, data acquire screening module.Including data-acquisition submodule, data cleansing submodule, master data storage
Module and primitive behavior data sub-module stored, are deposited wherein user's master data is sent to master data sub-module stored
Storage, user behavior data send the storage of primitive behavior data sub-module stored to.
S2, data processing module.Including data prediction and data modeling.
Specifically, the data prediction includes removal deficiency of data；Deleting duplicated data, picture；Counting user pair
Using the operation of different product, after obtaining data, it is converted into corresponding data format and saves in the database.Data are built
Mould includes creation data set, quickly establishes user behavior data ontology model, and is stored in the database, can be by various differences
Data source in table be created as data set, in data set list, the data set added can also be edited, move and
Delete operation improves model interoperability and reliability.
S3, data-mining module.Including data modeling submodule, characteristic operation submodule, user draw a portrait sub-module stored,
Wherein, data modeling submodule includes different data model rules to be supplied to characteristic operation submodule and carry out operation, to dig
User characteristic data is excavated, and is stored by user's portrait sub-module stored.
S4, data display module.Including electrical form, instrument board, data portal.
Specifically, the electrical form includes the relevant operation function of online electrical form, cover ranks screening, classification converges
Always, the data analysis functions such as AutoSum, conditional formats, and support that data export and text-processing, Form Handle etc. are abundant
Function.The instrument board includes that Visual Chart control towed is assembled into instrument board, supports line chart, pie chart, histogram, tree
A variety of charts such as shape figure；It supports the basic control such as querying condition and text box, supports data linkage effect between chart.It not only may be used
To be presented data in a manner of visual, also support through various data screenings and inquiry, using various data exhibiting modes,
Critical field in prominent data.
S5, fission figure is propagated.It propagates fission module reception popularization access connection and propagates the data of generation, and stored
In temporary data table, by data temporally, user, ID classification save into corresponding temporary data table；From temporary data table
In successively obtain the relation information for including in data；The access request for promoting access link is received, and is obtained according to temporary data table
The user being related to is established association binding relationship by the relation information taken；According to the data in effective list, generates and propagate fission
Figure.
S6, authority management module.Authority management module includes the control of user role system, realizes basic rights management,
It realizes that different people sees different report contents, realizes the row grade granularity authority managing and controlling of data, realize same tables of data, realize
Thousand people, thousand face data shows.
Above-described specific embodiment has carried out further the purpose of the present invention, technical scheme and beneficial effects
It is described in detail, it should be understood that being not intended to limit the present invention the foregoing is merely a specific embodiment of the invention
Protection scope, all within the spirits and principles of the present invention, any modification, equivalent substitution, improvement and etc. done should all include
Within protection scope of the present invention.
Claims (7)
1. a kind of intelligent analysis system based on big data, it is characterised in that: acquire screening module, data processing mould including data
Block, data display module, propagates fission module and authority management module at data-mining module.
2. a kind of intelligent analysis system based on big data according to claim 1, it is characterised in that: the data are adopted
Collecting screening module includes data-acquisition submodule, data cleansing submodule, master data sub-module stored and primitive behavior data
Sub-module stored.
3. a kind of intelligent analysis system based on big data according to claim 1, it is characterised in that: the data processing
Module includes data prediction submodule.
4. a kind of intelligent analysis system based on big data according to claim 1, it is characterised in that: the data mining
Module includes data modeling submodule, characteristic operation submodule, user's portrait sub-module stored.
5. a kind of intelligent analysis system based on big data according to claim 1, it is characterised in that: the data are shown
Module includes electrical form, instrument board.
6. a kind of intelligent analysis system based on big data according to claim 1, it is characterised in that: the rights management
Module includes user role system control submodule.
7. a kind of intelligent analysis method based on big data, which comprises the following steps:
S1: data-acquisition submodule and data cleansing submodule are acquired and screen to the information and data of user, and will use
Family master data sends master data sub-module stored to and is stored, and user behavior data sends the storage of primitive behavior data to
Submodule storage；
S2: collected data are pre-processed by pretreatment submodule, pretreatment includes removal deficiency of data, deletes
Repeated data, picture, counting user are to using the event action different to anchor point to be converted into correspondence in after treatment
Data format save in the database, data set is created by data modeling submodule, while establishing user behavior data sheet
Body Model, and store in the database, the table in a variety of different data sources is created as to different data sets, and collect in number
According in collection list；
S3: characteristic operation submodule carries out operation to the data that data modeling submodule is included, and excavates user characteristic data, and lead to
User's portrait sub-module stored is crossed to store；
S4: the data procession screening of storage, Classifying Sum, AutoSum, conditional formats, data are led by electrical form
Out, text-processing, Form Handle, instrument board by data in a manner of line chart, pie chart, histogram, dendrogram, with visual side
Formula is presented, while data are screened and being inquired, and the data between each chart is allow to link；
S5: propagating fission module reception popularization access connection and propagate the data of generation, and store it in temporary data table,
By data temporally, user, ID classification save into corresponding temporary data table；From successively being obtained in data in temporary data table
The relation information for including；The access request for promoting access link, and the relation information obtained according to temporary data table are received, will be related to
And user establish association binding relationship；According to the data in effective list, generates and propagate fission figure；
S6: submodule is managed by user role system, basic rights management is carried out, so that different people sees different reports
Content realizes the row grade granularity authority managing and controlling of data.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910827781.4A CN110533477A (en) | 2019-09-03 | 2019-09-03 | A kind of intelligent analysis method and system based on big data |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910827781.4A CN110533477A (en) | 2019-09-03 | 2019-09-03 | A kind of intelligent analysis method and system based on big data |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN110533477A true CN110533477A (en) | 2019-12-03 |
Family
ID=68666472
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201910827781.4A Pending CN110533477A (en) | 2019-09-03 | 2019-09-03 | A kind of intelligent analysis method and system based on big data |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN110533477A (en) |
Cited By (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111046428A (en) * | 2019-12-13 | 2020-04-21 | 江苏智谋科技有限公司 | Client data information security protection system and method for scientific and technological service |
| CN111242676A (en) * | 2020-01-02 | 2020-06-05 | 上海全筑建筑装饰集团股份有限公司 | Fission marketing system and construction method thereof |
| CN111444292A (en) * | 2020-04-14 | 2020-07-24 | 恩亿科(北京)数据科技有限公司 | Fast-moving-away article data processing method and device, electronic equipment and storage medium |
| CN112150220A (en) * | 2020-10-22 | 2020-12-29 | 天元大数据信用管理有限公司 | Internet user behavior based analysis method |
| CN113076370A (en) * | 2021-04-23 | 2021-07-06 | 上海寒光信息科技有限公司 | Internet data sky-eye agent BI system |
| CN113570190A (en) * | 2021-06-18 | 2021-10-29 | 中国科学院地理科学与资源研究所 | Quick poverty information acquisition method, module and equipment based on multi-source data |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101075254A (en) * | 2007-06-08 | 2007-11-21 | 北京神舟航天软件技术有限公司 | Autonomous access control method for row-level data of database table |
| CN107193855A (en) * | 2016-12-30 | 2017-09-22 | 杭州博采网络科技股份有限公司 | A kind of data analysis system and method |
| CN109615443A (en) * | 2019-01-30 | 2019-04-12 | 百度在线网络技术（北京）有限公司 | User's processing method, device, server and storage medium based on block chain |
| CN109816435A (en) * | 2019-01-09 | 2019-05-28 | 广州市简美网络科技有限公司 | Information processing method and device based on social networks chain |
-
2019
- 2019-09-03 CN CN201910827781.4A patent/CN110533477A/en active Pending
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101075254A (en) * | 2007-06-08 | 2007-11-21 | 北京神舟航天软件技术有限公司 | Autonomous access control method for row-level data of database table |
| CN107193855A (en) * | 2016-12-30 | 2017-09-22 | 杭州博采网络科技股份有限公司 | A kind of data analysis system and method |
| CN109816435A (en) * | 2019-01-09 | 2019-05-28 | 广州市简美网络科技有限公司 | Information processing method and device based on social networks chain |
| CN109615443A (en) * | 2019-01-30 | 2019-04-12 | 百度在线网络技术（北京）有限公司 | User's processing method, device, server and storage medium based on block chain |
Non-Patent Citations (1)
| Title |
|---|
| 叶天琦: "大数据自助分析平台的研发与应用", 《2019年第二届钢铁工业智能制造发展论坛会议论文集》 * |
Cited By (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111046428A (en) * | 2019-12-13 | 2020-04-21 | 江苏智谋科技有限公司 | Client data information security protection system and method for scientific and technological service |
| CN111242676A (en) * | 2020-01-02 | 2020-06-05 | 上海全筑建筑装饰集团股份有限公司 | Fission marketing system and construction method thereof |
| CN111444292A (en) * | 2020-04-14 | 2020-07-24 | 恩亿科(北京)数据科技有限公司 | Fast-moving-away article data processing method and device, electronic equipment and storage medium |
| CN111444292B (en) * | 2020-04-14 | 2023-11-03 | 恩亿科(北京)数据科技有限公司 | Quick-service data processing method and device, electronic equipment and storage medium |
| CN112150220A (en) * | 2020-10-22 | 2020-12-29 | 天元大数据信用管理有限公司 | Internet user behavior based analysis method |
| CN113076370A (en) * | 2021-04-23 | 2021-07-06 | 上海寒光信息科技有限公司 | Internet data sky-eye agent BI system |
| CN113570190A (en) * | 2021-06-18 | 2021-10-29 | 中国科学院地理科学与资源研究所 | Quick poverty information acquisition method, module and equipment based on multi-source data |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN110533477A (en) | A kind of intelligent analysis method and system based on big data | |
| CN106339509A (en) | Power grid operation data sharing system based on large data technology | |
| CN112698953A (en) | Power grid intelligent operation and detection platform based on micro-service | |
| CN105069025A (en) | Intelligent aggregation visualization and management control system for big data | |
| CN103973705A (en) | Omnimedia and new media fusing platform | |
| CN109003027A (en) | A kind of management method and system of label of drawing a portrait | |
| CN111352903A (en) | Log management platform, log management method, medium, and electronic device | |
| CN111126852A (en) | BI application system based on big data modeling | |
| CN110019157A (en) | Safety in production business datum analysis method based on Internet of Things | |
| CN109344137A (en) | A kind of log storing method and system | |
| CN111047270A (en) | Intelligent optimal configuration system and method for electronic government forms | |
| CN109413133A (en) | One kind recording system and method based on Internet of Things and block chain distributed information | |
| CN107977855A (en) | A kind of method and device of managing user information | |
| CN105450733B (en) | A kind of business datum distribution processing method and system | |
| CN106372962A (en) | Information publishment and feedback method of intelligent cloud screen | |
| CN201726426U (en) | Internet information monitoring system based on cloud computing | |
| WO2019104952A1 (en) | Scene intelligent analysis system and method based on metropolitan area level internet of things perceptual data | |
| CN108874818A (en) | A kind of data intelligence visualization system and method | |
| CN106257447A (en) | The video storage of cloud storage server and search method, video cloud storage system | |
| CN112488643A (en) | Digital middle platform system for enterprise application | |
| CN101471846A (en) | Network event analysis and management system | |
| CN207691854U (en) | A kind of Government Affair Information System based on data share exchange | |
| CN105373996A (en) | Modeling system based on approval data | |
| CN110517163A (en) | A kind of distribution network feeder group analyzing method | |
| CN114707968A (en) | Flow billboard based on electric power big data |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20191203 |
|
| RJ01 | Rejection of invention patent application after publication |