CN108334599A - A kind of analysis system based on big data - Google Patents
A kind of analysis system based on big data Download PDFInfo
- Publication number
- CN108334599A CN108334599A CN201810096702.2A CN201810096702A CN108334599A CN 108334599 A CN108334599 A CN 108334599A CN 201810096702 A CN201810096702 A CN 201810096702A CN 108334599 A CN108334599 A CN 108334599A
- Authority
- CN
- China
- Prior art keywords
- data
- analysis system
- big data
- system based
- database
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Withdrawn
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06Q30/00—Commerce
- G06Q30/02—Marketing; Price estimation or determination; Fundraising
- G06Q30/0241—Advertisements
- G06Q30/0251—Targeted advertisements
- G06Q30/0254—Targeted advertisements based on statistics
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/90—Details of database functions independent of the retrieved data types
- G06F16/95—Retrieval from the web
- G06F16/953—Querying, e.g. by the use of web search engines
- G06F16/9535—Search customisation based on user profiles and personalisation
Landscapes
- Engineering & Computer Science (AREA)
- Databases & Information Systems (AREA)
- Business, Economics & Management (AREA)
- Theoretical Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Accounting & Taxation (AREA)
- Development Economics (AREA)
- Finance (AREA)
- Strategic Management (AREA)
- Game Theory and Decision Science (AREA)
- Marketing (AREA)
- General Business, Economics & Management (AREA)
- Economics (AREA)
- Entrepreneurship & Innovation (AREA)
- Probability & Statistics with Applications (AREA)
- Data Mining & Analysis (AREA)
- General Engineering & Computer Science (AREA)
- Management, Administration, Business Operations System, And Electronic Commerce (AREA)
Abstract
An embodiment of the present invention provides a kind of analysis system based on big data, the system comprises：Data acquisition module, the data acquisition module can carry out data acquisition according to behaviors such as the previous historical viewings of user, purchaser records；The data of computing module, the data collecting module collected are converted into computer language after calculating；Database, the data for storing the data collecting module collected pass through the computer language of computing module conversion；Operating system can call the information stored in the database by the operating system, and send the data in database to cloud computing；Cloud computing receives data to be calculated, and carries out calculation processing.Using the embodiment of the present invention, the precision of the precision and store merchandise display of the advertizing of website can be promoted according to the analysis system based on big data.
Description
Technical field
The present invention relates to electronic technology field more particularly to a kind of analysis systems based on big data.
Background technology
In recent years, the development of internet is more and more rapider, and also more and more universal using the people of internet, people are using mutual
When networking carries out daily activity, such as net purchase, program, information are checked, commodity can all generate a large amount of data, and these
Data are very valuable for e-commerce website or the Internet media class website, utilize the processing of these big datas
Analysis can obtain very valuable commercial value.
Big data is widely used in internet items application, great to the significance of website, passes through mass data point
The realization of analysis and cloud computing can maximize and help the Internet media class advertiser web site system and e-commerce class website big data
Commodity supplying system is maximumlly promoted.The big data advertisement of the Internet media class website reads preference push according to user,
For the cloud computing of mass data, it is pushed to website browsing user by various advertisement forms, such as apply in chamber of commerce's net
(www.netcoc.com)；E-commerce class website big data commodity are pushed to on-line purchase person, and row is clicked by analyzing user
Corresponding commodity and sales promotion information are pushed for, buying behavior, product correlation, preference and usage time rule, such as are applied
Product obtain store (www.pedemall.com).
The appearance of big data is causing technology and Business Change deep in global range.Technically, big data makes
The usual manner that information is extracted in data is changed.The machine to play a significant role in search engine and online advertisement
Device learns, it is considered to be big data plays the field of true value.The behavior of people, custom is precipitated in statistical in the data of magnanimity
Etc. modes, utmostly advertiser is helped to find accurate potential customers, is operated to promote advertising results and follow-up purchase.
Existing big data analysis technology, often the analysis result of big data often do not have real-time, specific aim, it is former
The otherness and modeling structure mistake of beginning data sampling precision and statistical method can all cause to analyze wrong.In addition not
Same usage scenario also brings along entirely different result.
Invention content
The embodiment of the present invention is designed to provide a kind of analysis system based on big data, with according to based on big data
Analysis system can promote the precision of the precision and store merchandise display of the advertizing of website.
In order to achieve the above object, the present invention provides a kind of analysis system based on big data, which is characterized in that the system
System includes：
Data acquisition module, the data acquisition module can be carried out according to behaviors such as the previous historical viewings of user, purchaser records
Data acquire；
The data of computing module, the data collecting module collected are converted into computer language after calculating；
Database, the data for storing the data collecting module collected pass through the machine word of computing module conversion
Speech；
Operating system can call the information stored in the database, and send in database by the operating system
Data are to cloud computing；
Cloud computing receives data to be calculated, and calculate and obtain incremental data and calculate what the big data calculated
Increment exports result.
Preferably, the data acquisition module carries out the acquisition of data using SAS web crawlers.
Preferably, the data acquisition, is filtered data by preset data filtering rule, by filtered data
The data arrived as the data collecting module collected.
Preferably, the data filtering is to use Bloom filter, is filtered to the collected data of institute.
Preferably, the data analysis system includes network server, can will be multiple described by the network server
Data connection in database is got up, and the data of bigger are provided.
Preferably, the operating system is Linux operating systems.
Preferably, the quantity that the network server connects the database is 6 to 10.
Preferably, in the cloud computing, the necessary data includes at least one in complete input, complete output, institute
Increment delivery rules are stated to be used to using data be each described calculating step of granularity description each calculating step according to
It is defeated that increment inputs the increment for needing the necessary data preserved to calculate each calculating step with each described calculating step
The computation rule gone out, each described calculating step need the necessary data preserved root when carrying out complete computation or incremental computations
It is preserved according to each described increment delivery rules for calculating step；Result and the big data meter are exported according to the increment
The original output calculated is as a result, determine final calculation result.
The embodiment of the present invention provides a kind of analysis system based on big data, and the analysis system based on big data is combined with
On the basis of the various solutions of current big data technology, formation is concisely and efficiently technical finesse means.Suitable for medium and small enterprise
Industry, media platform, electric business platform, sexual valence is relatively high, can meet the data analysis needed for day-to-day operations and support, help enterprise
Preferably obtain income.Can be promoted according to the analysis system based on big data the advertizing of website precision and
The precision of store merchandise display.
Description of the drawings
In order to more clearly explain the embodiment of the invention or the technical proposal in the existing technology, to embodiment or will show below
There is attached drawing needed in technology description to be briefly described, it should be apparent that, the accompanying drawings in the following description is only this
Some embodiments of invention for those of ordinary skill in the art without creative efforts, can be with
Obtain other attached drawings according to these attached drawings.
Fig. 1 is the first structural schematic diagram of the analysis system provided by the invention based on big data.
Fig. 2 is second of structural schematic diagram of the analysis system provided by the invention based on big data.
Fig. 3 is the third structural schematic diagram of the analysis system provided by the invention based on big data.
Specific implementation mode
Following will be combined with the drawings in the embodiments of the present invention, and technical solution in the embodiment of the present invention carries out clear, complete
Site preparation describes, it is clear that described embodiments are only a part of the embodiments of the present invention, instead of all the embodiments.It is based on
Embodiment in the present invention, it is obtained by those of ordinary skill in the art without making creative efforts every other
Embodiment shall fall within the protection scope of the present invention.
Below by specific embodiment, the present invention will be described in detail.
Referring to Fig. 1, a kind of analysis system based on big data, the system comprises：
Data acquisition module 1, the data acquisition module can according to the behaviors such as the previous historical viewings of user, purchaser record into
Row data acquire；
The data of computing module 2, the data collecting module collected are converted into computer language after calculating；
Database 3, the data for storing the data collecting module collected pass through the machine word of computing module conversion
Speech；
Operating system 4 can call the information stored in the database, and send in database by the operating system
Data to cloud computing；
Cloud computing 5 receives data to be calculated, and calculate and obtain incremental data and calculate what the big data calculated
Increment output result, wherein the necessary data includes at least one in complete input, complete output, and the increment transmits
Rule for using data be granularity description it is described each calculate step according to each described increment for calculating step input with
Each described calculating for calculating the increment output that the necessary data that step needs preserve calculates each calculating step is advised
Then, each described calculating step needs the necessary data preserved when carrying out complete computation or incremental computations according to described each
A increment delivery rules for calculating step are preserved；According to the increment export result calculate with the big data it is original defeated
Go out as a result, determining final calculation result.
Specifically, the data acquisition module carries out the acquisition of data using reptile, and pass through preset data filtering rule
Data are filtered, the data that filtered data are arrived as the data collecting module collected, in addition, the data point
Analysis system includes network server, and the data connection in multiple databases can be got up by the network server, carried
For the data of bigger.Specifically, the operating system is Linux operating systems.
Based on the Application of analysis system of big data on some the Internet media class websites, such as apply in chamber of commerce's net
(www.netcoc.com) on.Wherein analysis system of chamber of commerce's net based on big data, especially chamber of commerce's net big data advertisement system
System, energy automatic lifting paid advertisement client utmostly match potential customers on website, pass through a large number of users behavioral data point
Analysis is the associated advertising information of pushes customer to browse web sites in a short time by cloud computing analysis.It is online to promote
User browses the advertisement of classification interested, clicks the follow-up behavior such as check, is to realize maximized one of advertisement value
Core Internet technology.Chamber of commerce's net ad system also supports internet overwhelming majority advertisement form, including word chain, figure simultaneously
Piece advertisement, video ads etc..Possess sound Advertisement arrangement mechanism, can precisely count advertisement PV, click effect, data statistics
Deng.Have Advertisers bid system, can charge according to diversified forms such as cpc, cpm, cpa, cps, cpv.In order to realize
The function of chamber of commerce's net big data ad system, the present invention provide a kind of analysis system based on big data and use Distributed Calculation
Framework (LAMP), LAMP frames include：(SuSE) Linux OS, Apache network servers, MySQL database, Perl, PHP
Or Python programming languages, all composition products are open source softwares, are the architecture frameworks of international mature.And Java/
J2EE frameworks are compared, and LAMP has the characteristics that web resource abundant, light weight, safe, compared with the .NET frameworks of Microsoft, LAMP tools
There are general, cross-platform, high-performance benefits.Pass through cloud computing form, processing large-scale parallel (MPP) database, distribution simultaneously
Database, can quickly, it is a large amount of, accurately handle advertising information and diversified displaying in front of the user.
Distributed data digging according to figure 1, distributed data digging rely on the distributed treatment of cloud computing, divide
Cloth database (PaaS) and cloud storage, virtualization technology (IaaS).Number is presented to show cloud computing by mobile terminal, the ends PC
According to effect.Website user's behavioral data can be effectively excavated, and effectively does cloud computing processing in real time, feedback user is interested
Advertising information and commodity.
With the arriving of cloud era, big data has also attracted more and more concerns.Big data is commonly used to describe one
Company create a large amount of unstructured datas and semi-structured data, these data download to relevant database for point
It can overspending time and money when analysis.Big data analysis is often linked together with cloud computing, because of large data collection in real time
Analysis needs the frame as MapReduce to share out the work to tens of, hundreds of or even thousands of computer.
Referring to Fig. 2, the data analysis system include network service 6, by the network server can will it is multiple described in
Data connection in database is got up, and the data of bigger are provided.Referring to Fig. 3, network service 6 and database 11, database 12, number
It is attached according to library 13, specifically, the quantity that the network server connects the database is 6 to 10.Ensure
Data between database can be serviced 6 and be realized by network to be shared, and that improves data resource enjoys efficiency.
Big data needs special technology, effectively to handle largely in the data received by time content.It is suitable for
The technology of big data, including MPP (MPP) database, data mining power grid, distributed file system, distribution
Formula database, cloud computing platform, internet and expansible storage system.
It should be noted that herein, relational terms such as first and second and the like are used merely to a reality
Body or operation are distinguished with another entity or operation, are deposited without necessarily requiring or implying between these entities or operation
In any actual relationship or order or sequence.Moreover, the terms "include", "comprise" or its any other variant are intended to
Non-exclusive inclusion, so that the process, method, article or equipment including a series of elements is not only wanted including those
Element, but also include other elements that are not explicitly listed, or further include for this process, method, article or equipment
Intrinsic element.In the absence of more restrictions, the element limited by sentence "including a ...", it is not excluded that
There is also other identical elements in process, method, article or equipment including the element.
Each embodiment in this specification is all made of relevant mode and describes, identical similar portion between each embodiment
Point just to refer each other, and each embodiment focuses on the differences from other embodiments.
The foregoing is merely illustrative of the preferred embodiments of the present invention, is not intended to limit the scope of the present invention.It is all
Any modification, equivalent replacement, improvement and so within the spirit and principles in the present invention, are all contained in protection scope of the present invention
It is interior.
Claims (8)
1. a kind of analysis system based on big data, which is characterized in that the system comprises：
Data acquisition module, the data acquisition module can be carried out according to behaviors such as the previous historical viewings of user, purchaser records
Data acquire；
The data of computing module, the data collecting module collected are converted into computer language after calculating；
Database, the data for storing the data collecting module collected pass through the machine word of computing module conversion
Speech；
Operating system can call the information stored in the database, and send in database by the operating system
Data are to cloud computing；
Cloud computing receives data to be calculated, and calculate and obtain incremental data and calculate what the big data calculated
Increment exports result.
2. a kind of analysis system based on big data according to claim 1, which is characterized in that the data acquisition module
The acquisition of data is carried out using SAS web crawlers.
3. a kind of analysis system based on big data according to claim 1, which is characterized in that the data acquisition is led to
It crosses preset data filtering rule to be filtered data, the number that filtered data are arrived as the data collecting module collected
According to.
4. a kind of analysis system based on big data according to claim 3, which is characterized in that the data filtering is to adopt
With Bloom filter, the collected data of institute are filtered.
5. a kind of analysis system based on big data according to claim 1, which is characterized in that the data analysis system
Including network server, the data connection in multiple databases can be got up by the network server, bigger is provided
Data.
6. a kind of analysis system based on big data according to claim 1, which is characterized in that the operating system is
Linux operating systems.
7. a kind of analysis system based on big data according to claim 5, which is characterized in that the network server connects
The quantity for connecing the database is 6 to 10.
8. a kind of analysis system based on big data according to claim 1, which is characterized in that in the cloud computing, institute
It includes at least one in complete input, complete output to state necessary data, and the increment delivery rules are used for using data as granularity
Increment input and described each calculating step need of each the described calculating step of description according to each calculating step
The necessary data to be preserved calculates the computation rule that each described increment for calculating step exports, each described calculating step
The necessary data preserved is needed to be transmitted according to each described increment for calculating step when carrying out complete computation or incremental computations
Rule is preserved；The original output that result is calculated with the big data is exported according to the increment finally to calculate as a result, determining
As a result.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810096702.2A CN108334599A (en) | 2018-01-31 | 2018-01-31 | A kind of analysis system based on big data |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810096702.2A CN108334599A (en) | 2018-01-31 | 2018-01-31 | A kind of analysis system based on big data |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN108334599A true CN108334599A (en) | 2018-07-27 |
Family
ID=62927599
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201810096702.2A Withdrawn CN108334599A (en) | 2018-01-31 | 2018-01-31 | A kind of analysis system based on big data |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN108334599A (en) |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109472637A (en) * | 2018-10-18 | 2019-03-15 | 微梦创科网络科技（中国）有限公司 | A kind of user throws advertisement optimization method and device surely |
| CN113538027A (en) * | 2020-04-16 | 2021-10-22 | 深圳市前海高新国际医疗管理有限公司 | Product parameter analysis matching system based on big data |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105205055A (en) * | 2014-06-06 | 2015-12-30 | 上海商会网网络信息技术有限公司 | Big data analyzing system |
| CN106484855A (en) * | 2016-09-30 | 2017-03-08 | 广州特道信息科技有限公司 | A kind of big data concerning taxes intelligence analysis system |
| CN106933882A (en) * | 2015-12-31 | 2017-07-07 | 华为技术有限公司 | A kind of big data incremental calculation method and device |
| CN107153710A (en) * | 2017-05-19 | 2017-09-12 | 肇庆市智高电机有限公司 | A kind of big data processing method and system |
| CN107590681A (en) * | 2017-08-16 | 2018-01-16 | 佛山市高研信息技术有限公司 | A kind of big data analysis system |
-
2018
- 2018-01-31 CN CN201810096702.2A patent/CN108334599A/en not_active Withdrawn
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105205055A (en) * | 2014-06-06 | 2015-12-30 | 上海商会网网络信息技术有限公司 | Big data analyzing system |
| CN106933882A (en) * | 2015-12-31 | 2017-07-07 | 华为技术有限公司 | A kind of big data incremental calculation method and device |
| CN106484855A (en) * | 2016-09-30 | 2017-03-08 | 广州特道信息科技有限公司 | A kind of big data concerning taxes intelligence analysis system |
| CN107153710A (en) * | 2017-05-19 | 2017-09-12 | 肇庆市智高电机有限公司 | A kind of big data processing method and system |
| CN107590681A (en) * | 2017-08-16 | 2018-01-16 | 佛山市高研信息技术有限公司 | A kind of big data analysis system |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109472637A (en) * | 2018-10-18 | 2019-03-15 | 微梦创科网络科技（中国）有限公司 | A kind of user throws advertisement optimization method and device surely |
| CN113538027A (en) * | 2020-04-16 | 2021-10-22 | 深圳市前海高新国际医疗管理有限公司 | Product parameter analysis matching system based on big data |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN105205055A (en) | Big data analyzing system | |
| CN110648185B (en) | Target crowd circling method and device and computer equipment | |
| CN107590681A (en) | A kind of big data analysis system | |
| Sılahtaroğlu et al. | Analysis and prediction of Ε-customers' behavior by mining clickstream data | |
| WO2014018635A2 (en) | Advertisement billing method and device | |
| CN106355432A (en) | Method for monitoring effectiveness of television advertisements | |
| US20140156347A1 (en) | Enhanced Market Basket Analysis | |
| WO2019242343A1 (en) | Marketing information release platform construction method and apparatus | |
| CN107153710A (en) | A kind of big data processing method and system | |
| Alazab et al. | Maximising competitive advantage on E-business websites: A data mining approach | |
| CN108446306A (en) | A kind of processing equipment of big data | |
| CN106447464A (en) | Electronic commerce data processing system | |
| CN108122153A (en) | Personalized recommendation method based on cloud computing tupe under e-commerce environment | |
| CN104517157A (en) | Method and system for using social media for predictive analytics in available-to-promise systems | |
| CN108932625A (en) | Analysis method, device, medium and the electronic equipment of user behavior data | |
| TWI629652B (en) | Intelligent network marketing analysis and judgment method | |
| CN108090712A (en) | A kind of method and device for analyzing service exception | |
| US10325274B2 (en) | Trend data counter | |
| CN108334599A (en) | A kind of analysis system based on big data | |
| CN114741598A (en) | Marketing big data informatization management cloud platform | |
| CN112070554A (en) | System for accurately pushing advertisements according to analysis result of user types | |
| US8423558B2 (en) | Targeting online ads by grouping and mapping user properties | |
| CA2805264C (en) | Product pricing in e-commerce | |
| KR20100123206A (en) | Method and apparatus for ranking analysis based on artificial intelligence, and recording medium thereof | |
| KR20100130664A (en) | Using open api or scrapping openmaket and change in the price of items of information and sales status watch the price system to provide |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| WW01 | Invention patent application withdrawn after publication | ||
| WW01 | Invention patent application withdrawn after publication |
Application publication date: 20180727 |