CN107590681A - A kind of big data analysis system - Google Patents
A kind of big data analysis system Download PDFInfo
- Publication number
- CN107590681A CN107590681A CN201710703485.4A CN201710703485A CN107590681A CN 107590681 A CN107590681 A CN 107590681A CN 201710703485 A CN201710703485 A CN 201710703485A CN 107590681 A CN107590681 A CN 107590681A
- Authority
- CN
- China
- Prior art keywords
- data
- analysis system
- big data
- database
- big
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Withdrawn
Links
Landscapes
- Management, Administration, Business Operations System, And Electronic Commerce (AREA)
Abstract
The invention provides a kind of big data analysis system, the system includes：Data acquisition module, the data acquisition module can carry out data acquisition according to behaviors such as the conventional historical viewings of user, purchaser records；Computing module, the data of the data collecting module collected are converted into computer language after calculating；Database, the data for storing the data collecting module collected pass through the computer language of computing module conversion；Operating system, by the operating system, the information stored in the database can be called, and send the data in database to cloud computing；Cloud computing, data to be calculated are received, and carry out calculating processing.Big data analysis system provided by the invention, the precision of advertizing and the precision of store merchandise display of website can be lifted according to big data analysis system.
Description
Technical field
The invention belongs to big data analysis technical field, more particularly to a kind of big data analysis system.
Background technology
In recent years, the development of internet is more and more rapider, is also increasingly popularized using the people of internet, and people are using mutual
When networking carries out daily activity, such as net purchase, program, information are checked, commodity can all produce substantial amounts of data, and these
Data are very valuable for e-commerce website or the Internet media class website, utilize the processing of these big datas
Analysis can obtain very valuable commercial value.
Big data is widely used in the every application in internet, great to the significance of website, passes through mass data point
Analysis and the realization of cloud computing, can maximize and help the Internet media class advertiser web site system and ecommerce class website big data
Commodity supplying system is maximumlly lifted.The big data advertisement of the Internet media class website reads preference push according to user,
For the cloud computing of mass data, website browsing user is pushed to by various advertisement forms, such as apply in chamber of commerce's net；Electronics
Commercial class website big data commodity are pushed to on-line purchase person, and behavior, buying behavior, product correlation are clicked on by analyzing user
Property, preference and usage time rule push corresponding commodity and sales promotion information, such as apply and obtain store in product.
The appearance of big data, triggering technology and Business Change deep in global range.Technically, big data makes
The usual manner that information is extracted among data is changed.The machine to be played a significant role in search engine and online advertisement
Device learns, it is considered to be big data plays the field of true value.Statistical separates out the behavior of people, custom in the data of magnanimity
Etc. mode, at utmost help advertiser to find accurate potential customers, operated so as to lift advertising results and follow-up purchase.
2016, China's big data industry kept high speed development situation, and governments at all levels and enterprise carry forward vigorously, technological innovation
Obvious breakthrough is obtained, the big data application propulsion impetus is good, and industrial system has begun to take shape, and enabling capabilities increasingly strengthen.Prospect
2017, big data industry development will be welcome " golden period ", and further Characteristic Development, innovation driving will be by Industrial agglomeration
The main keynote of industry development, big data fusion application process accelerate, and for digital economy of running business big and strong, drive conventional industries transition and upgrade
New power is provided.
Cloud computing is a kind of supercomputing mode based on internet, is to parallel processing, distributed treatment and grid meter
The extension of calculation.It is believed that cloud computing is not only a kind of new computation model, while it is a kind of side of new shared architecture
Formula.Towards ultra-large distributed user environment, its major function is to provide the high in the clouds data storage of quick and safe for cloud computing
And network service.
First, it is to complement each other between cloud computing and big data, the relation to bring out the best in each other.Big data excavation processing needs cloud
Calculating is used as platform, and value and rule that big data covers then can make cloud computing preferably be combined and played with sector application
Bigger effect.Excavation of the cloud computing using computing resource as supporting big data, and the development trend of big data is to reality
When the mass data inquiry, the analysis that interact provide the value information that each needs.
Secondly, cloud computing and the combination of big data will likely turn into the new instrument of human knowledge's things.It facts have proved people
Class is with advances in technology to the understanding of objective world and recognizes the tool renewal in the world and progressively go deep into.The past mankind are first
The surface of things is first appreciated that, by causality from outward appearance to inner essence, by recognizing individual and then finding general character rule.Now will
Cloud computing and the combination of big data, people's can analyze the correlation of mass data using efficient, low cost computing resource,
General character rule is quickly found out, accelerates people for understanding of the objective world about rule.
3rd, the information privacy protection of big data is the important prerequisite that cloud computing big data is fast-developing and uses.No
Information security is also just without the safety of cloud service.Industry and service are healthy, quickly development just needs to obtain the trust of user,
Scientific and technological circle and industrial circle is just needed more to pay attention to the safety problem of cloud computing, the secret protection being important to note that in big data excavation is asked
Topic.The research and development of depth are carried out from technological layer, prevents and hits virus and the attack of hacker.Accelerate the progress of legislation, dimension simultaneously
Protect the environment of good information service.
Existing big data analytical technology, often the analysis result of big data often do not possess real-time, specific aim, it is former
The otherness of beginning data sampling precision and statistical method, and modeling structure mistake, it can all cause to analyze wrong.In addition not
Same usage scenario also brings along entirely different result.
The content of the invention
It is an object of the invention to provide a kind of big data analysis system, can be lifted according to big data analysis system
The precision of the advertizing of website and the precision of store merchandise display.
In order to achieve the above object, the invention provides a kind of big data analysis system, the system to include：
Data acquisition module, the data acquisition module can be carried out according to behaviors such as the conventional historical viewings of user, purchaser records
Data acquisition；
Computing module, the data of the data collecting module collected are converted into computer language after calculating；
Database, the data for storing the data collecting module collected pass through the machine word of computing module conversion
Speech；
Operating system, by the operating system, the information stored in the database can be called, and send in database
Data are to cloud computing；
Cloud computing, data to be calculated are received, and carry out calculating processing.
Preferably, the data acquisition module carries out the collection of data using SAS web crawlers.
Preferably, after the data acquisition, and data are filtered by preset data filtering rule, after filtering
The data that data arrive as the data collecting module collected.
Preferably, the data filtering is to use Bloom filter, and the data collected are filtered.
Preferably, the data analysis system includes the webserver, can will be multiple described by the webserver
Data in database connect, there is provided bigger data.
Preferably, the operating system is Linux operating systems.
Preferably, the quantity that the webserver connects the database is 6 to 10.
Preferably, the cloud computing, data to be calculated are received, and carries out calculating processing, including：Treated using cloud computing
The data of calculating are normalized and cluster analysis.
Compared with prior art, the beneficial effects of the present invention are：
The present invention provides a kind of analysis system of big data, and big data analysis system is combined with the various of current big data technology
On the basis of solution, formation is concisely and efficiently technical finesse means.Suitable for medium-sized and small enterprises, media platform, electric business platform,
Cost performance is higher, can meet that the data analysis needed for day-to-day operations is supported, help enterprise preferably to obtain income.Can root
The precision of the advertizing of website and the precision of store merchandise display can be lifted according to big data analysis system.
Brief description of the drawings
, below will be to the present invention or prior art in order to illustrate more clearly of technical scheme of the invention or of the prior art
The required accompanying drawing used is briefly described in description, it should be apparent that, drawings in the following description are only the present invention's
Some embodiments, for those of ordinary skill in the art, on the premise of not paying creative work, can also be according to this
A little accompanying drawings obtain other accompanying drawings.
Fig. 1 is the first structural representation of big data analysis system provided by the invention.
Fig. 2 is second of structural representation of big data analysis system provided by the invention.
Fig. 3 is the third structural representation of big data analysis system provided by the invention.
Embodiment
Below in conjunction with the accompanying drawing in the embodiment of the present invention, the technical scheme in the embodiment of the present invention is carried out clear, complete
Site preparation describes, it is clear that described embodiment is only part of the embodiment of the present invention, rather than whole embodiments.It is based on
Embodiment in the present invention, those of ordinary skill in the art are obtained every other under the premise of creative work is not made
Embodiment, belong to the scope of protection of the invention.
Below by specific embodiment, the present invention will be described in detail.
Referring to Fig. 1, a kind of big data analysis system, the system includes：
Data acquisition module 1, the data acquisition module can enter according to behaviors such as the conventional historical viewings of user, purchaser records
Row data acquisition；
Computing module 2, the data of the data collecting module collected are converted into computer language after calculating；
Database 3, the data for storing the data collecting module collected pass through the machine word of computing module conversion
Speech；
Operating system 4, by the operating system, the information stored in the database can be called, and send in database
Data to cloud computing；
Cloud computing 5, data to be calculated are received, and carry out calculating processing.
Specifically, the data acquisition module carries out the collection of data using reptile, and pass through preset data filtering rule
Data are filtered, the data that the data after filtering are arrived as the data collecting module collected, in addition, the data point
Analysis system includes the webserver, can connect the data in multiple databases by the webserver, carries
For bigger data.Specifically, the operating system is Linux operating systems.
Big data Application of analysis system is on some the Internet media class websites, such as applies in chamber of commerce's net
(www.netcoc.com) on.Wherein chamber of commerce's net big data analysis system, especially chamber of commerce's net big data ad system, can be certainly
Dynamic lifting paid advertisement client at utmost matches potential customers on website, is analyzed, passed through by a large number of users behavioral data
Cloud computing analysis is in a short time the associated advertising message of the pushes customer to browse web sites.So as to promote online user couple
The advertisement of classification interested browsed, clicks on the follow-up behavior such as check, is to realize that the maximized core of advertisement value is mutual
Networking technology.Chamber of commerce's net ad system also supports internet overwhelming majority advertisement form simultaneously, including word chain, display advertising,
Video ads etc..Possess sound Advertisement arrangement mechanism, can precisely count advertisement PV, click on effect, data statistics etc..Possess
Advertisers bid system, it can be charged according to diversified forms such as cpc, cpm, cpa, cps, cpv.In order to realize chamber of commerce's net
The function of big data ad system, the present invention provide a kind of big data analysis system and use distributed computing architecture (LAMP),
LAMP frameworks include：(SuSE) Linux OS, the Apache webservers, MySQL database, Perl, PHP or Python are compiled
Cheng Yuyan, all composition products are open source softwares, are the architecture frameworks of international mature.Compared with Java/J2EE frameworks,
LAMP has the characteristics that web resource abundant, light weight, safe, compared with the .NET frameworks of Microsoft, LAMP have it is general, across flat
Platform, high-performance benefits., can simultaneously by cloud computing form, processing large-scale parallel (MPP) database, distributed data base etc.
With it is quick, a large amount of, accurately handle advertising message and it is diversified displaying in front of the user.
Distributed data digging according to Fig. 1, distributed data digging rely on the distributed treatment of cloud computing, divided
Cloth database (PaaS) and cloud storage, virtualization technology (IaaS).Number is presented to show cloud computing by mobile terminal, PC ends
According to effect.Website user's behavioral data can be effectively excavated, and effectively does cloud computing processing in real time, feedback user is interested
Advertising message and commodity.
With the arriving of cloud era, big data has also attracted increasing concern.Big data is commonly used to describe one
Company create a large amount of unstructured datas and semi-structured data, these data download to relevant database be used for point
Can overspending time and money during analysis.Big data analysis is often linked together with cloud computing, because large data collection in real time
Analysis needs the framework as MapReduce to be shared out the work to tens of, hundreds of or even thousands of computer.
Referring to Fig. 2, the data analysis system includes network service 6, can will be multiple described by the webserver
Data in database connect, there is provided bigger data.Referring to Fig. 3, network service 6 and database 11, database 12, number
It is attached according to storehouse 13, specifically, the quantity that the webserver connects the database is 6 to 10.Ensure
Data between database can be realized by network service 6 to be shared, and that improves data resource enjoys efficiency.
Big data needs special technology, effectively to handle the data largely accommodated within the elapsed time.It is applied to
The technology of big data, including MPP (MPP) database, data mining power network, distributed file system, distribution
Formula database, cloud computing platform, internet and expansible storage system.
It should be noted that herein, such as first and second or the like relational terms are used merely to a reality
Body or operation make a distinction with another entity or operation, and not necessarily require or imply and deposited between these entities or operation
In any this actual relation or order.Moreover, term " comprising ", "comprising" or its any other variant are intended to
Nonexcludability includes, so that process, method, article or equipment including a series of elements not only will including those
Element, but also the other element including being not expressly set out, or it is this process, method, article or equipment also to include
Intrinsic key element.In the absence of more restrictions, the key element limited by sentence "including a ...", it is not excluded that
Other identical element also be present in process, method, article or equipment including the key element.
Each embodiment in this specification is described by the way of related, identical similar portion between each embodiment
Divide mutually referring to what each embodiment stressed is the difference with other embodiment.
The foregoing is merely illustrative of the preferred embodiments of the present invention, is not intended to limit the scope of the present invention.It is all
Any modification, equivalent substitution and improvements made within the spirit and principles in the present invention etc., are all contained in protection scope of the present invention
It is interior.
Claims (8)
1. a kind of big data analysis system, it is characterised in that the system includes：
Data acquisition module, the data acquisition module can be carried out according to behaviors such as the conventional historical viewings of user, purchaser records
Data acquisition；
Computing module, the data of the data collecting module collected are converted into computer language after calculating；
Database, the data for storing the data collecting module collected pass through the machine word of computing module conversion
Speech；
Operating system, by the operating system, the information stored in the database can be called, and send in database
Data are to cloud computing；
Cloud computing, data to be calculated are received, and carry out calculating processing.
2. a kind of big data analysis system according to claim 1, it is characterised in that the data acquisition module uses
SAS web crawlers carries out the collection of data.
3. a kind of big data analysis system according to claim 2, it is characterised in that after the data acquisition, and pass through
Preset data filtering rule filters to data, the number that the data after filtering are arrived as the data collecting module collected
According to.
4. a kind of big data analysis system according to claim 3, it is characterised in that the data filtering is grand using cloth
Filter, the data collected are filtered.
5. a kind of big data analysis system according to claim 1, it is characterised in that the data analysis system includes net
Network server, the data in multiple databases can be connected by the webserver, there is provided bigger data.
6. a kind of big data analysis system according to claim 1, it is characterised in that the operating system is grasped for Linux
Make system.
7. a kind of big data analysis system according to claim 3, it is characterised in that described in the webserver connection
The quantity of database is 6 to 10.
8. a kind of big data analysis system according to claim 3, it is characterised in that the cloud computing, receive to be calculated
Data, and carry out calculating processing, including：Data to be calculated are normalized using cloud computing and cluster analysis.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710703485.4A CN107590681A (en) | 2017-08-16 | 2017-08-16 | A kind of big data analysis system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710703485.4A CN107590681A (en) | 2017-08-16 | 2017-08-16 | A kind of big data analysis system |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN107590681A true CN107590681A (en) | 2018-01-16 |
Family
ID=61042428
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201710703485.4A Withdrawn CN107590681A (en) | 2017-08-16 | 2017-08-16 | A kind of big data analysis system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN107590681A (en) |
Cited By (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108198007A (en) * | 2018-02-08 | 2018-06-22 | 王四春 | A kind of anti-cross-border electric business commercial affairs big data decision and analysis system divulged a secret |
| CN108334599A (en) * | 2018-01-31 | 2018-07-27 | 佛山市聚成知识产权服务有限公司 | A kind of analysis system based on big data |
| CN108427712A (en) * | 2018-01-31 | 2018-08-21 | 佛山市聚成知识产权服务有限公司 | A kind of system for realizing big data safety |
| CN108446306A (en) * | 2018-01-31 | 2018-08-24 | 佛山市聚成知识产权服务有限公司 | A kind of processing equipment of big data |
| CN111145037A (en) * | 2018-11-03 | 2020-05-12 | 广州市明领信息科技有限公司 | Big data analysis system |
| CN113538027A (en) * | 2020-04-16 | 2021-10-22 | 深圳市前海高新国际医疗管理有限公司 | Product parameter analysis matching system based on big data |
-
2017
- 2017-08-16 CN CN201710703485.4A patent/CN107590681A/en not_active Withdrawn
Cited By (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108334599A (en) * | 2018-01-31 | 2018-07-27 | 佛山市聚成知识产权服务有限公司 | A kind of analysis system based on big data |
| CN108427712A (en) * | 2018-01-31 | 2018-08-21 | 佛山市聚成知识产权服务有限公司 | A kind of system for realizing big data safety |
| CN108446306A (en) * | 2018-01-31 | 2018-08-24 | 佛山市聚成知识产权服务有限公司 | A kind of processing equipment of big data |
| CN108198007A (en) * | 2018-02-08 | 2018-06-22 | 王四春 | A kind of anti-cross-border electric business commercial affairs big data decision and analysis system divulged a secret |
| CN111145037A (en) * | 2018-11-03 | 2020-05-12 | 广州市明领信息科技有限公司 | Big data analysis system |
| CN113538027A (en) * | 2020-04-16 | 2021-10-22 | 深圳市前海高新国际医疗管理有限公司 | Product parameter analysis matching system based on big data |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN107590681A (en) | A kind of big data analysis system | |
| CN105205055A (en) | Big data analyzing system | |
| US20140156347A1 (en) | Enhanced Market Basket Analysis | |
| CN107153710A (en) | A kind of big data processing method and system | |
| WO2014018635A2 (en) | Advertisement billing method and device | |
| CN107077486A (en) | Affective Evaluation system and method | |
| CN103455636A (en) | Automatic capturing and intelligent analyzing method based on Internet tax data | |
| CN103345698A (en) | Personalized recommendation method based on cloud processing mode and applied in e-business environment | |
| US7657535B2 (en) | Technique for data mining using a web service | |
| US20110187717A1 (en) | Producing Optimization Graphs in Online Advertising Systems | |
| CN107220867A (en) | object control method and device | |
| CN108122153A (en) | Personalized recommendation method based on cloud computing tupe under e-commerce environment | |
| KR20210104960A (en) | Lowest shopping mall service providing server and its providing method | |
| CN108446306A (en) | A kind of processing equipment of big data | |
| CN107133279A (en) | A kind of intelligent recommendation method and system based on cloud computing | |
| Nurdin et al. | Utilization of Business Intelligence in Sales Information Systems | |
| CN108334599A (en) | A kind of analysis system based on big data | |
| CN107403327A (en) | Mobile differential pin store processing system and its method | |
| CN111782611A (en) | Prediction model modeling method, device, equipment and storage medium | |
| US20130297436A1 (en) | Customer Value Scoring Based on Social Contact Information | |
| CN107590707A (en) | A SaaS architecture modes realize more distribution substation systems | |
| Iyer et al. | Spry Farm: A Portal for Connecting Farmers and End Users | |
| Vancea et al. | Challenges in Using AI in Online Commerce | |
| CN107463694A (en) | Internet marketing cloud service platform application method | |
| CN107845005A (en) | webpage generating method and device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| WW01 | Invention patent application withdrawn after publication |
Application publication date: 20180116 |
|
| WW01 | Invention patent application withdrawn after publication |