CN104182542A - 用于网站集群的数据处理方法和装置 - Google Patents
用于网站集群的数据处理方法和装置 Download PDFInfo
- Publication number
- CN104182542A CN104182542A CN201410449676.9A CN201410449676A CN104182542A CN 104182542 A CN104182542 A CN 104182542A CN 201410449676 A CN201410449676 A CN 201410449676A CN 104182542 A CN104182542 A CN 104182542A
- Authority
- CN
- China
- Prior art keywords
- chain
- website
- data
- enters
- out data
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000003672 processing method Methods 0.000 title claims abstract description 27
- 238000001914 filtration Methods 0.000 claims abstract description 72
- 239000000284 extract Substances 0.000 claims description 43
- 238000000605 extraction Methods 0.000 claims description 23
- 238000006243 chemical reaction Methods 0.000 claims description 12
- 238000000034 method Methods 0.000 abstract description 14
- 238000010586 diagram Methods 0.000 description 10
- 230000000694 effects Effects 0.000 description 6
- 230000006870 function Effects 0.000 description 2
- 230000010354 integration Effects 0.000 description 2
- 239000012141 concentrate Substances 0.000 description 1
- 230000005055 memory storage Effects 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/90—Details of database functions independent of the retrieved data types
- G06F16/95—Retrieval from the web
- G06F16/955—Retrieval from the web using information identifiers, e.g. uniform resource locators [URL]
- G06F16/9566—URL specific, e.g. using aliases, detecting broken or misspelled links
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/25—Integrating or interfacing systems involving database management systems
- G06F16/254—Extract, transform and load [ETL] procedures, e.g. ETL data flows in data warehouses
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/90—Details of database functions independent of the retrieved data types
- G06F16/95—Retrieval from the web
- G06F16/953—Querying, e.g. by the use of web search engines
- G06F16/9535—Search customisation based on user profiles and personalisation
Landscapes
- Engineering & Computer Science (AREA)
- Databases & Information Systems (AREA)
- Theoretical Computer Science (AREA)
- Data Mining & Analysis (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
Description
Claims (10)
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201410449676.9A CN104182542B (zh) | 2014-09-04 | 2014-09-04 | 用于网站集群的数据处理方法和装置 |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201410449676.9A CN104182542B (zh) | 2014-09-04 | 2014-09-04 | 用于网站集群的数据处理方法和装置 |
Publications (2)
Publication Number | Publication Date |
---|---|
CN104182542A true CN104182542A (zh) | 2014-12-03 |
CN104182542B CN104182542B (zh) | 2018-02-02 |
Family
ID=51963581
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN201410449676.9A Active CN104182542B (zh) | 2014-09-04 | 2014-09-04 | 用于网站集群的数据处理方法和装置 |
Country Status (1)
Country | Link |
---|---|
CN (1) | CN104182542B (zh) |
Cited By (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN108280103A (zh) * | 2017-02-10 | 2018-07-13 | 广州市动景计算机科技有限公司 | 网站指标统计方法、装置及服务器 |
Citations (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN1716867A (zh) * | 2004-06-29 | 2006-01-04 | 杭州华为三康技术有限公司 | 数据流量统计方法及装置 |
US20130124559A1 (en) * | 2009-10-22 | 2013-05-16 | Vmware, Inc, | Method and system for inserting data records into files |
CN103218411A (zh) * | 2013-03-26 | 2013-07-24 | 亿赞普(北京)科技有限公司 | 网站关联信息获取方法与装置 |
-
2014
- 2014-09-04 CN CN201410449676.9A patent/CN104182542B/zh active Active
Patent Citations (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN1716867A (zh) * | 2004-06-29 | 2006-01-04 | 杭州华为三康技术有限公司 | 数据流量统计方法及装置 |
US20130124559A1 (en) * | 2009-10-22 | 2013-05-16 | Vmware, Inc, | Method and system for inserting data records into files |
CN103218411A (zh) * | 2013-03-26 | 2013-07-24 | 亿赞普(北京)科技有限公司 | 网站关联信息获取方法与装置 |
Cited By (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN108280103A (zh) * | 2017-02-10 | 2018-07-13 | 广州市动景计算机科技有限公司 | 网站指标统计方法、装置及服务器 |
CN108280103B (zh) * | 2017-02-10 | 2022-01-07 | 阿里巴巴(中国)有限公司 | 网站指标统计方法、装置及服务器 |
Also Published As
Publication number | Publication date |
---|---|
CN104182542B (zh) | 2018-02-02 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
CN111477290B (zh) | 保护用户隐私的联邦学习和图像分类方法、系统及终端 | |
CN110908997B (zh) | 数据血缘构建方法、装置、服务器及可读存储介质 | |
JP2013536492A (ja) | 複数のシステムを用いたデータ解析 | |
WO2004114160A3 (en) | Systems and processes for automated criteria and attribute generation, searching, auditing and reporting of data | |
CN109829096A (zh) | 一种数据采集方法、装置、电子设备及存储介质 | |
CN106886535A (zh) | 一种适配多种数据源的数据抽取方法和装置 | |
CN110347708A (zh) | 一种数据处理方法以及相关设备 | |
CN109582289B (zh) | 规则引擎中规则流的处理方法、系统、存储介质和处理器 | |
CN108829884A (zh) | 数据映射方法及装置 | |
CN108762846B (zh) | 插件化实时推荐方法、服务器及计算机可读存储介质 | |
CN110750559A (zh) | 权限信息的处理方法及装置、存储介质、电子装置 | |
CN108073641B (zh) | 查询数据表的方法和装置 | |
CN108197338B (zh) | 一种浏览器书签生成方法、系统及终端设备 | |
CN109117467A (zh) | 可配置的动态数据报表的生成方法、系统、设备和介质 | |
CN109830029B (zh) | 投票方法、装置、系统及服务器、计算机可读存储介质 | |
CN104182542A (zh) | 用于网站集群的数据处理方法和装置 | |
CN109558403B (zh) | 数据聚合方法及装置、计算机装置及计算机可读存储介质 | |
CN110825729B (zh) | 数据查询方法及装置、存储介质、电子装置 | |
CN106326249A (zh) | 数据整合处理方法及装置 | |
CN103544278B (zh) | 确定网站抓取流量配额的方法及设备 | |
CN110515943A (zh) | 数据存储、查询方法及设备、数据处理设备、存储介质 | |
CN106844377B (zh) | 多维数据库的处理方法及装置 | |
CN106528750B (zh) | 数据提取方法及装置 | |
CN112435151B (zh) | 一种基于关联分析的政务信息数据处理方法及系统 | |
CN103902715A (zh) | Ip区间查找方法和装置 |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
C06 | Publication | ||
PB01 | Publication | ||
C10 | Entry into substantive examination | ||
SE01 | Entry into force of request for substantive examination | ||
GR01 | Patent grant | ||
GR01 | Patent grant | ||
PE01 | Entry into force of the registration of the contract for pledge of patent right | ||
PE01 | Entry into force of the registration of the contract for pledge of patent right |
Denomination of invention: Data processing method and device for website clusters Effective date of registration: 20190531 Granted publication date: 20180202 Pledgee: Shenzhen Black Horse World Investment Consulting Co.,Ltd. Pledgor: BEIJING GRIDSUM TECHNOLOGY Co.,Ltd. Registration number: 2019990000503 |
|
CP02 | Change in the address of a patent holder | ||
CP02 | Change in the address of a patent holder |
Address after: 100083 No. 401, 4th Floor, Haitai Building, 229 North Fourth Ring Road, Haidian District, Beijing Patentee after: BEIJING GRIDSUM TECHNOLOGY Co.,Ltd. Address before: 100086 Beijing city Haidian District Shuangyushu Area No. 76 Zhichun Road cuigongfandian 8 layer A Patentee before: BEIJING GRIDSUM TECHNOLOGY Co.,Ltd. |
|
PP01 | Preservation of patent right | ||
PP01 | Preservation of patent right |
Effective date of registration: 20240604 Granted publication date: 20180202 |