CN106294587A - Special topic module drainage effect methods of exhibiting in the website of a kind of Rapid Implementation - Google Patents
Special topic module drainage effect methods of exhibiting in the website of a kind of Rapid Implementation Download PDFInfo
- Publication number
- CN106294587A CN106294587A CN201610612144.1A CN201610612144A CN106294587A CN 106294587 A CN106294587 A CN 106294587A CN 201610612144 A CN201610612144 A CN 201610612144A CN 106294587 A CN106294587 A CN 106294587A
- Authority
- CN
- China
- Prior art keywords
- page
- module
- webpage
- current
- ref
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/90—Details of database functions independent of the retrieved data types
- G06F16/95—Retrieval from the web
- G06F16/958—Organisation or management of web site content, e.g. publishing, maintaining pages or automatic linking
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/90—Details of database functions independent of the retrieved data types
- G06F16/95—Retrieval from the web
- G06F16/955—Retrieval from the web using information identifiers, e.g. uniform resource locators [URL]
- G06F16/9566—URL specific, e.g. using aliases, detecting broken or misspelled links
Landscapes
- Engineering & Computer Science (AREA)
- Databases & Information Systems (AREA)
- Theoretical Computer Science (AREA)
- Data Mining & Analysis (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Information Transfer Between Computers (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
In the website of Rapid Implementation, special topic module drainage effect methods of exhibiting, encodes according to the url feature of each webpage, and the url of page of often throwing the net all generates 1 and throws the net page/module title dimension table, updating maintenance every day webpage/module title dimension table；The url of page of often throwing the net is subordinated to 1 module, has the unique rec_id of oneself；After updating maintenance every day webpage/module title dimension table, then resolve access log table；During parsing, the url feature according to webpage/module title dimension table carries out canonical coupling to access log referer field, and the match is successful then can resolve the rec_id of webpage/module title dimension table to the ref_id of log sheet；In like manner, according to the url feature of webpage/module title dimension table, access log request field being carried out canonical coupling, the match is successful then can resolve the rec_id of webpage/module title dimension table to the req_id of log sheet.
Description
Technical field
The present invention relates to business intelligence, the analysis of public opinion field, propose one for drainage effect in each special topic module station of website
Plant the method processing and showing.In particular to drainage effect methods of exhibiting in the thematic module station of a kind of Rapid Implementation and
Device.
Background technology
With the fast development of internet economy, increasing user tends to be disappeared by e-commerce platform
Take.Correspondingly, the data message produced based on electricity business's platform, business intelligence field starts to show up prominently.The key of business intelligence
From different operation informations, to extract useful data and clear up, to ensure data correctness, then by extraction, conversion and
Loading process, obtains the global view of a business data, utilizes suitable query analysis instrument to be analyzed on this basis
Process, knowledge is presented to manager, provide for decision making process and support.The main flow relational data that business intelligence field is used
There are Oracle, DB2, Microsoft SQL Server, Microsoft Access, MySQL etc. in storehouse, and the front end used represents
Instrument has QlikView, Tableau etc..
A new station safety net is domestic B2C the Internet insurance industry pioneer, and it is unexpected that its insurance products contains traffic/comprehensively
Dangerous, domestic/danger of overseas travelling, health insurance, group danger, family property insurance, shipping danger, financing danger, vehicle insurance, life insurance, product duty danger etc.
10 insurance kinds；The platform that places an order includes PC end, touch screen end, mobile phone A PP end；Comprise insurance dictionary in standing, insure school, insurance words
Topic, Help Center etc. ten several special topic modules；Form stable customer group and ecosphere, deeply have break-up value.Thus the present invention
Rely on a new station safety net demonstration implementation result.
The present invention prepares back-end data by oracle database, represents means using QlikView form as front end, carries
Go out drainage effect methods of exhibiting and device in the thematic module station of a kind of Rapid Implementation.
Summary of the invention
The present invention seeks to, propose special topic module drainage effect methods of exhibiting in the website of a kind of Rapid Implementation, it is only necessary to accurate
Standby webpage/module title dimension table and access log summary sheet, it is not necessary to complex process, page up of can connecting, current page,
Lower one page module accesses page, simple and easy to do, it is suitable for enterprise's Rapid Implementation；Designed by QV module, observable set period model
Enclose drainage effect in the station of each webpage or module.
The technical scheme is that special topic module drainage effect methods of exhibiting in the website of Rapid Implementation, it is characterized in that
Url feature according to each webpage encodes, and the url of page of often throwing the net all generates 1 and throws the net page/module title dimension table, and every day is more
Newly safeguard webpage/module title dimension table；The url of page of often throwing the net is subordinated to 1 module, has the unique rec_id of oneself；
After updating maintenance every day webpage/module title dimension table, then resolve access log table；According to webpage/module during parsing
The url feature of title dimension table carries out canonical coupling to access log referer field, and the match is successful then can be by webpage/module name
The rec_id claiming dimension table resolves to the ref_id of log sheet；In like manner, according to the url feature of webpage/module title dimension table to access
Daily record request field carries out canonical coupling, and the match is successful then can resolve the rec_id of webpage/module title dimension table to daily record
The req_id of table.
Based on updating maintenance webpage/module title dimension table, and parse ref_id, the access log number of req_id
According to collecting, owing to the request of page up is equivalent to the referer of current page, the request of current page is equivalent to lower one page
Referer, therefore when being loaded into QlikView, page up req_id and current page ref_id is set to same file-name field；Current page
Req_id and lower one page ref_id is set to same file-name field.The linkage function of same file-name field will be connected page up by QlikView,
Current page, the accession page (the concrete page or module title can associate dimension table and obtain) of lower one page；Just can show special topic module station
Interior drainage effect.
Specifically comprise the following steps that
Step 1. more new web page/module title dimension table, is denoted as Table A；
Step 2., according to the url feature analysis access log table of Table A, is denoted as table B；
The url feature of Table A is carried out canonical with the referer of table B and mates by step 21., the match is successful then B.ref_id=
A.rec_id；
The url feature of Table A is carried out canonical with the request of table B and mates by step 22., the match is successful then B.req_id=
A.rec_id；
Step 3. is added up access times according to the cal_number of table B, ref_id, req_id, is denoted as table C；
Step 4. therefore, the req_id of the page up i.e. ref_id of current page, thus in QlikView loaded page by table C,
The left connection of Table A, and renaming respective field, successively as page up, current page, the back-end data of lower one page module；
Field contents of the same name is linked by QlikView, is based only upon Table A, table C, can be by page up, current page, lower one page module accesses page
Connect in face；
Step 41. page up module, left connection table A of table C, limit C.ref_id=A.rec_id, can from Table A obtain one
The concrete webpage of page or module title:
Link link_front_current by C.ref_id RNTO and current page module, after page up module
Number of units evidence；
Step 42. current page module, left connection table A of table C, limit C.req_id=A.rec_id, can obtain from Table A current
The concrete webpage of page or module title:
By C.ref_id RNTO link_front_current (linking with page up module), C.req_id is heavily ordered
Entitled link_current_next (links with lower one page module), as current page module back-end data；
Step 43. time one page module, left connection table A of table C, limit C.req_id=A.rec_id, can be obtained next from Table A
The concrete webpage of page or module title
By C.ref_id RNTO link_current_next (linking with current page module), as lower one page module
Back-end data；
Back-end data is integrated into global view by step 5.QlikView module, shows page up, current page, lower one page mould
Drainage effect in block station.
A new station safety net encodes according to the url feature of each webpage, the url of page of often throwing the net all generate 1 throw the net page/
Module title dimension table, updating maintenance every day.The url of page of often throwing the net is subordinated to 1 module, has the unique rec_id of oneself.With PC
As a example by end, record as follows:
Table 1 webpage/module title dimension table (PC end)
Every day, a new station scheduling meeting first more new web page/module title dimension table, then resolve access log.According to net during parsing
The url feature of page/module title dimension table carries out canonical coupling to access log referer field, and the match is successful then can be by dimension table
Rec_id resolve to the ref_id of log sheet.In like manner, req_id also does respective handling.It is parsed rear example as follows:
Table 2 20160620 is parsed rear access log matrix section field
As known from Table 2,1005132 pages (page up) are drained to 1023 pages (current page), are then drained to page 1024
Face (lower one page).
Based on table 1, these 2 underlying tables of table 2, only need to slightly process and just can show drain effect in special topic module station easily
Really.
The materialization of step 4 flow process:
Step 41. page up module, left connection table A of table C, limit C.ref_id=A.rec_id,
By C.ref_id RNTO link_front_current (linking with current page module), as page up module
Back-end data；
Code is as follows:
--page up module
Step 42. current page module, left connection table A of table C, limit C.req_id=A.rec_id,
By C.ref_id RNTO link_front_current (linking with page up module), C.req_id is heavily ordered
Entitled link_current_next (links with lower one page module), as current page module back-end data；
Code is as follows:
--current page module
Step 43. time one page module, left connection table A of table C, limit C.req_id=A.rec_id, C.ref_id is heavily ordered
Entitled link_current_next (links with current page module), as lower one page module back-end data；
Code is as follows:
--lower one page module
The method have the benefit that 1) only need to prepare webpage/module title dimension table and access log summary sheet, it is not necessary to complicated
Processing procedure, page up of can connecting, current page, lower one page module accesses page, simple and easy to do, it is suitable for enterprise's Rapid Implementation；
2) designed by QV module, drainage effect in the station of each webpage of observable set period scope or module.
Accompanying drawing explanation
Fig. 1 is drainage effect displaying flow chart in special topic module station；
Fig. 2 is drainage effect exhibiting device structural representation in special topic module station.
Detailed description of the invention
Below in conjunction with drawings and Examples, it is specifically described embodiment of the present invention.Described embodiment is merely illustrative, base
The change made in the technology of the present invention essence or equivalent variations, still fall within scope.
Refering to shown in Fig. 1, embodiment of the present invention flow process is as follows:
Step 11. more new web page/module title dimension table, screens rec_id=1005132, the detailed data of 1023,1024
As embodiment, i.e. table 1；
Step 12. carries out canonical coupling according to the url feature of table 1 to access log referer, request, resolves respectively
Go out ref_id, req_id, i.e. table 2；
Step 13. adds up access times, i.e. table 3 according to the cal_number of table 2, ref_id, req_id；
Step 14. develops QlikView loaded page, and by left for table 3 connection table 1, renaming respective field, successively as upper one
Page, current page, the back-end data of lower one page module；
Step 15. designs module, and back-end data is integrated into global view, shows page up, current page, lower one page module
Drainage effect in standing.Such as table 4, table 5, table 6, i.e. page up module selection [insurance products], current page module selects [member's clothes
Business], lower one page module selects the drain data that [page of insuring] obtains.
Table 3 20160620 access log summary sheet
| cal_number | ref_id | rec_id | pv |
| 20160620 | 1005132 | 1023 | 1 |
| 20160620 | 1023 | 1024 | 9 |
Table 4 20160620 page up insurance products module
Table 5 20160620 current page membership service module
6 20160620 times one pages of table are insured page module
Refering to shown in Fig. 2, embodiment of the present invention apparatus structure is as follows:
Module 1: data source unit, this module provides data to subsequent module；
Module 11: operation system module, a new station webpage/module title dimension table of this module stores, including url feature,
Rec_id, webpage title, module title etc.；
Module 12: access log module, the new station safety net of this module stores accesses record, including the access time,
Referer (connection of server), request, ref_id, req_id etc..
Module 2: data pre-processing unit, this module at oracle database according to access log table cal_number,
Ref_id, req_id add up access times.
Module 3:QlikView data loading unit, this block coupled in series page up, current page, the rear number of units of lower one page module
According to, and it is loaded into QlikView front end；
Module 31: with left connection table A of table C of current page module linkage, limit C.ref_id=A.rec_id, by C.ref_
Id RNTO link_front_current (links with current page module), as page up module back-end data；
Module 32: with page up, lower one page module all has left connection table A of table C of linkage, limits C.req_id=A.rec_
Id, by C.ref_id RNTO link_front_current (linking with page up module), by C.req_id RNTO
Link_current_next (links with lower one page module), as current page module back-end data；
Module 33: with left connection table A of table C of current page module linkage, limit C.req_id=A.rec_id, by C.ref_
Id RNTO link_current_next (links with current page module), as lower one page module back-end data；
Module 4:QlikView data display unit, this module generation global view, displaying page up, current page, next
Drainage effect in page module station；
Module 41: page up module, drainage effect in each webpage/module station of page in observable set period scope；
Module 42: current page module, drainage effect in the current each webpage/module station of observable set period scope；
Module 43: lower one page module, drainage effect in each webpage/module station of observable set period scope nextpage.
Those of ordinary skill in the field it is understood that the foregoing is only the specific embodiment of the present invention, and
Be not used in the restriction present invention, all within the spirit and principles in the present invention, any modification, equivalent substitution and improvement etc. done, all
Within protection scope of the present invention should being included in.
Claims (3)
1. special topic module drainage effect methods of exhibiting in the website of Rapid Implementation, is characterized in that the url feature according to each webpage
Encoding, the url of page of often throwing the net all generates 1 and throws the net page/module title dimension table, updating maintenance every day webpage/module title dimension
Table；The url of page of often throwing the net is subordinated to 1 module, has the unique rec_id of oneself；
After updating maintenance every day webpage/module title dimension table, then resolve access log table；According to webpage/module title during parsing
The url feature of dimension table carries out canonical coupling to access log referer field, and the match is successful then can be by webpage/module title dimension
The rec_id of table resolves to the ref_id of log sheet；In like manner, according to the url feature of webpage/module title dimension table to access log
Request field carries out canonical coupling, and the match is successful then can resolve the rec_id of webpage/module title dimension table to log sheet
req_id。
In website the most according to claim 1, special topic module drainage effect methods of exhibiting, is characterized in that based on updating maintenance
Webpage/module title dimension table, and parse ref_id, the access log of req_id carries out data summarization, due to page up
Request is equivalent to the referer of current page, and the request of current page is equivalent to the referer of lower one page, therefore is loaded into
During QlikView, page up req_id and current page ref_id is set to same file-name field；Current page req_id and lower one page
Ref_id is set to same file-name field.The linkage function of same file-name field will be connected page up by QlikView, current page, lower one page
Accession page, the concrete page or module title can associate dimension table and obtain；Just can show drainage effect in special topic module station.
In website the most according to claim 2, special topic module drainage effect methods of exhibiting, is characterized in that specifically comprising the following steps that
Step 1. more new web page/module title dimension table, is denoted as Table A；
Step 2., according to the url feature analysis access log table of Table A, is denoted as table B；
The url feature of Table A is carried out canonical with the referer of table B and mates by step 21., the match is successful then B.ref_id=
A.rec_id；
The url feature of Table A is carried out canonical with the request of table B and mates by step 22., the match is successful then B.req_id=
A.rec_id；
Step 3. is added up access times according to the cal_number of table B, ref_id, req_id, is denoted as table C；
Step 4. therefore, the req_id of the page up i.e. ref_id of current page, therefore by left to table C, Table A in QlikView loaded page
Connect, and renaming respective field, successively as page up, current page, the back-end data of lower one page module；QlikView will be with
File-name field content linkage, is based only upon Table A, table C, can be by page up, current page, and lower one page module accesses page is connected；
Step 41. page up module, left connection table A of table C, limit C.ref_id=A.rec_id, page up tool can be obtained from Table A
Body webpage or module title:
Link link_front_current by C.ref_id RNTO and current page module, as number of units after page up module
According to；
Step 42. current page module, left connection table A of table C, limit C.req_id=A.rec_id, current page tool can be obtained from Table A
Body webpage or module title:
By C.ref_id RNTO link_front_current, i.e. link, by C.req_id renaming with page up module
For link_current_next, i.e. link, as current page module back-end data with lower one page module；
Step 43. time one page module, left connection table A of table C, limit C.req_id=A.rec_id, can have by one page from Table A obtains
Body webpage or module title:
C.ref_id RNTO link_current_next is i.e. linked, as lower one page module backstage with current page module
Data；
Back-end data is integrated into global view by step 5.QlikView module, shows page up, current page, lower one page module station
Interior drainage effect.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610612144.1A CN106294587B (en) | 2016-07-28 | 2016-07-28 | Thematic module drainage effect methods of exhibiting in a kind of website of Rapid Implementation |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610612144.1A CN106294587B (en) | 2016-07-28 | 2016-07-28 | Thematic module drainage effect methods of exhibiting in a kind of website of Rapid Implementation |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN106294587A true CN106294587A (en) | 2017-01-04 |
| CN106294587B CN106294587B (en) | 2019-05-10 |
Family
ID=57663069
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201610612144.1A Active CN106294587B (en) | 2016-07-28 | 2016-07-28 | Thematic module drainage effect methods of exhibiting in a kind of website of Rapid Implementation |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN106294587B (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106846074A (en) * | 2017-04-11 | 2017-06-13 | 新站保险代理股份有限公司 | A kind of effective discharge analysis method and system based on QlikView data linkages |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2000090111A (en) * | 1998-09-14 | 2000-03-31 | Matsushita Electric Ind Co Ltd | Information retrieval agent device, and computer- readable recording medium recorded with program exhibiting function of information retrieval agent device |
| EP1122656A2 (en) * | 2000-01-25 | 2001-08-08 | TekInsight.Com. Inc. | Universal resource locator and navigation method |
| CN202870820U (en) * | 2012-09-05 | 2013-04-10 | 常州嘴馋了信息科技有限公司 | Webpage blog display system |
| CN105488697A (en) * | 2015-12-09 | 2016-04-13 | 焦点科技股份有限公司 | Potential customer mining method based on customer behavior characteristics |
| CN105678588A (en) * | 2016-01-13 | 2016-06-15 | 焦点科技股份有限公司 | Product sales volume fluctuation assessment method based on e-commerce platform |
-
2016
- 2016-07-28 CN CN201610612144.1A patent/CN106294587B/en active Active
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2000090111A (en) * | 1998-09-14 | 2000-03-31 | Matsushita Electric Ind Co Ltd | Information retrieval agent device, and computer- readable recording medium recorded with program exhibiting function of information retrieval agent device |
| EP1122656A2 (en) * | 2000-01-25 | 2001-08-08 | TekInsight.Com. Inc. | Universal resource locator and navigation method |
| CN202870820U (en) * | 2012-09-05 | 2013-04-10 | 常州嘴馋了信息科技有限公司 | Webpage blog display system |
| CN105488697A (en) * | 2015-12-09 | 2016-04-13 | 焦点科技股份有限公司 | Potential customer mining method based on customer behavior characteristics |
| CN105678588A (en) * | 2016-01-13 | 2016-06-15 | 焦点科技股份有限公司 | Product sales volume fluctuation assessment method based on e-commerce platform |
Non-Patent Citations (2)
| Title |
|---|
| SANTIAGO DE LA PEÑA & RODOLFO BARREIRO: "Biomonitoring acidic drainage impact in a complex setting using periphyton", 《RESEARCHGATE》 * |
| 甘亮 等: "一种构建StreamCube的超大维表连接算法", 《计算机研究与发》 * |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106846074A (en) * | 2017-04-11 | 2017-06-13 | 新站保险代理股份有限公司 | A kind of effective discharge analysis method and system based on QlikView data linkages |
Also Published As
| Publication number | Publication date |
|---|---|
| CN106294587B (en) | 2019-05-10 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US10963513B2 (en) | Data system and method | |
| CN106682150B (en) | Information processing method and device | |
| CN106528693B (en) | Educational resource recommended method and system towards individualized learning | |
| CN105468605B (en) | Entity information map generation method and device | |
| CN103294781B (en) | A kind of method and apparatus for processing page data | |
| CN104850554B (en) | Searching method and system | |
| EP3401870A1 (en) | Apparatus, systems, and methods for batch and realtime data processing | |
| US20140214942A1 (en) | Building a semantics graph for an enterprise communication network | |
| Machado et al. | DIGO: An open data architecture for e-government | |
| CN103425741A (en) | Information exhibiting method and device | |
| CN102681994B (en) | Webpage information extracting method and system | |
| CN102708096A (en) | Network intelligence public sentiment monitoring system based on semantics and work method thereof | |
| CN104394118A (en) | User identity identification method and system | |
| CN101751458A (en) | Network public sentiment monitoring system and method | |
| CN105468744A (en) | Big data platform for realizing tax public opinion analysis and full text retrieval | |
| CN103246963B (en) | Based on the staffs training system of Internet of Things | |
| US11093529B2 (en) | Method for displaying landmark data | |
| CN103605715A (en) | Method and device used for data integration processing of multiple data sources | |
| CN104199938B (en) | Agricultural land method for sending information and system based on RSS | |
| CN105389389A (en) | Network public opinion transmission situation media linked analysis method | |
| CN113918725A (en) | Construction method of knowledge graph in water affairs field | |
| CN100470549C (en) | Form locating data mining method | |
| CN105260365A (en) | Terminal information processing method and device | |
| CN103714120A (en) | System for extracting interesting topics from url (uniform resource locator) access records of users | |
| CN105718457B (en) | Information pushing method and system based on electronic bill |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |