CN110543478B - 公共层宽表建设方法、装置及服务器 - Google Patents
公共层宽表建设方法、装置及服务器 Download PDFInfo
- Publication number
- CN110543478B CN110543478B CN201910647532.7A CN201910647532A CN110543478B CN 110543478 B CN110543478 B CN 110543478B CN 201910647532 A CN201910647532 A CN 201910647532A CN 110543478 B CN110543478 B CN 110543478B
- Authority
- CN
- China
- Prior art keywords
- data
- main
- incremental
- auxiliary
- service table
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000010276 construction Methods 0.000 title description 9
- 238000000034 method Methods 0.000 claims abstract description 55
- 230000003111 delayed effect Effects 0.000 claims abstract description 13
- 238000012545 processing Methods 0.000 claims description 56
- 230000010076 replication Effects 0.000 claims description 32
- 238000012986 modification Methods 0.000 claims description 22
- 230000004048 modification Effects 0.000 claims description 22
- 238000007781 pre-processing Methods 0.000 claims description 19
- 230000008569 process Effects 0.000 claims description 17
- 230000008859 change Effects 0.000 claims description 14
- 238000004590 computer program Methods 0.000 claims description 12
- 238000012216 screening Methods 0.000 claims description 8
- 230000004083 survival effect Effects 0.000 claims description 7
- 238000009938 salting Methods 0.000 claims description 6
- 230000000717 retained effect Effects 0.000 claims description 3
- 238000010586 diagram Methods 0.000 description 11
- 230000006870 function Effects 0.000 description 7
- 238000007726 management method Methods 0.000 description 7
- 230000015556 catabolic process Effects 0.000 description 2
- 238000006731 degradation reaction Methods 0.000 description 2
- 230000001934 delay Effects 0.000 description 2
- 238000004458 analytical method Methods 0.000 description 1
- 230000009286 beneficial effect Effects 0.000 description 1
- 230000005540 biological transmission Effects 0.000 description 1
- 238000013497 data interchange Methods 0.000 description 1
- 230000003247 decreasing effect Effects 0.000 description 1
- 230000001419 dependent effect Effects 0.000 description 1
- 238000013461 design Methods 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 238000004519 manufacturing process Methods 0.000 description 1
- 230000002093 peripheral effect Effects 0.000 description 1
- 238000011084 recovery Methods 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/22—Indexing; Data structures therefor; Storage structures
- G06F16/2282—Tablespace storage structures; Management thereof
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/25—Integrating or interfacing systems involving database management systems
- G06F16/254—Extract, transform and load [ETL] procedures, e.g. ETL data flows in data warehouses
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Databases & Information Systems (AREA)
- Data Mining & Analysis (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Software Systems (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
Description
Claims (22)
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201910647532.7A CN110543478B (zh) | 2019-07-17 | 2019-07-17 | 公共层宽表建设方法、装置及服务器 |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201910647532.7A CN110543478B (zh) | 2019-07-17 | 2019-07-17 | 公共层宽表建设方法、装置及服务器 |
Publications (2)
Publication Number | Publication Date |
---|---|
CN110543478A CN110543478A (zh) | 2019-12-06 |
CN110543478B true CN110543478B (zh) | 2023-02-03 |
Family
ID=68709937
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN201910647532.7A Active CN110543478B (zh) | 2019-07-17 | 2019-07-17 | 公共层宽表建设方法、装置及服务器 |
Country Status (1)
Country | Link |
---|---|
CN (1) | CN110543478B (zh) |
Families Citing this family (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN113220797A (zh) * | 2020-01-21 | 2021-08-06 | 浙江大搜车软件技术有限公司 | 信息配置的方法、设备、系统、计算机设备和存储介质 |
CN113656370B (zh) * | 2021-08-16 | 2024-04-30 | 南方电网数字电网集团有限公司 | 电力量测系统数据处理方法、装置和计算机设备 |
CN114116842B (zh) * | 2021-11-25 | 2023-05-19 | 上海柯林布瑞信息技术有限公司 | 多维医疗数据实时获取方法、装置、电子设备及存储介质 |
Citations (7)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
EP1494042A1 (fr) * | 2003-07-04 | 2005-01-05 | Alcatel | Serveur de données utilisé dans un système pour la fourniture de données d'augmentation pour les signaux de navigation par satellite |
CN103577474A (zh) * | 2012-08-03 | 2014-02-12 | 阿里巴巴集团控股有限公司 | 一种数据库的更新方法及系统 |
CN108399256A (zh) * | 2018-03-06 | 2018-08-14 | 北京慧萌信安软件技术有限公司 | 异构数据库内容同步方法、装置及中间件 |
CN108681590A (zh) * | 2018-05-15 | 2018-10-19 | 普信恒业科技发展(北京)有限公司 | 增量数据处理方法及装置、计算机设备、计算机存储介质 |
CN109597846A (zh) * | 2018-10-22 | 2019-04-09 | 平安科技(深圳)有限公司 | 大数据平台数据仓库数据处理方法、装置和计算机设备 |
CN109614398A (zh) * | 2018-11-02 | 2019-04-12 | 阿里巴巴集团控股有限公司 | 数据库中表结构的变更方法及装置 |
CN109960629A (zh) * | 2019-03-14 | 2019-07-02 | 银清科技(北京)有限公司 | 对支付系统业务量实时监控的方法和装置 |
Family Cites Families (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US8713073B2 (en) * | 2010-06-29 | 2014-04-29 | Asserted Versioning, Llc | Management of temporal data by means of a canonical schema |
US8856193B2 (en) * | 2011-12-20 | 2014-10-07 | Sap Se | Merge monitor for table delta partitions |
-
2019
- 2019-07-17 CN CN201910647532.7A patent/CN110543478B/zh active Active
Patent Citations (7)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
EP1494042A1 (fr) * | 2003-07-04 | 2005-01-05 | Alcatel | Serveur de données utilisé dans un système pour la fourniture de données d'augmentation pour les signaux de navigation par satellite |
CN103577474A (zh) * | 2012-08-03 | 2014-02-12 | 阿里巴巴集团控股有限公司 | 一种数据库的更新方法及系统 |
CN108399256A (zh) * | 2018-03-06 | 2018-08-14 | 北京慧萌信安软件技术有限公司 | 异构数据库内容同步方法、装置及中间件 |
CN108681590A (zh) * | 2018-05-15 | 2018-10-19 | 普信恒业科技发展(北京)有限公司 | 增量数据处理方法及装置、计算机设备、计算机存储介质 |
CN109597846A (zh) * | 2018-10-22 | 2019-04-09 | 平安科技(深圳)有限公司 | 大数据平台数据仓库数据处理方法、装置和计算机设备 |
CN109614398A (zh) * | 2018-11-02 | 2019-04-12 | 阿里巴巴集团控股有限公司 | 数据库中表结构的变更方法及装置 |
CN109960629A (zh) * | 2019-03-14 | 2019-07-02 | 银清科技(北京)有限公司 | 对支付系统业务量实时监控的方法和装置 |
Non-Patent Citations (1)
Title |
---|
智慧社保大数据分析平台构建;周天绮等;《计算机与现代化》;20190614(第06期);全文 * |
Also Published As
Publication number | Publication date |
---|---|
CN110543478A (zh) | 2019-12-06 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
CN110543478B (zh) | 公共层宽表建设方法、装置及服务器 | |
CN110674154B (zh) | 一种基于Spark的对Hive中数据进行插入、更新和删除的方法 | |
CN106970929B (zh) | 数据导入方法及装置 | |
CN109857803B (zh) | 数据同步方法、装置、设备、系统及计算机可读存储介质 | |
CN103678491A (zh) | 一种基于Hadoop中小文件优化和倒排索引的方法 | |
WO2014173279A1 (zh) | 一种面向Hbase数据库的复合查询方法 | |
CN107679104B (zh) | 大表流式并行高速数据比对方法 | |
CN110490761B (zh) | 一种电网配网设备台账数据模型建模方法 | |
CN111008521A (zh) | 生成宽表的方法、装置及计算机存储介质 | |
CN104866576A (zh) | 一种Data Vault模型数据仓库自动构建的方法及装置 | |
CN105608126A (zh) | 一种建立海量数据库二级索引的方法和装置 | |
CN112199935B (zh) | 数据的比对方法、装置、电子设备及计算机可读存储介质 | |
CN114329096A (zh) | 一种原生图数据库处理方法及系统 | |
CN103136244A (zh) | 基于云计算平台的并行数据挖掘方法及系统 | |
CN114138907A (zh) | 数据处理方法、计算机设备、存储介质和计算机程序产品 | |
CN115292414A (zh) | 一种业务数据同步到数仓的方法 | |
CN110647421B (zh) | 数据库处理方法、装置、系统以及电子设备 | |
CN112307318A (zh) | 一种内容发布方法、系统及装置 | |
US10135926B2 (en) | Shuffle embedded distributed storage system supporting virtual merge and method thereof | |
US11321354B2 (en) | System, computing node and method for processing write requests | |
KR20180085633A (ko) | 질의 처리 장치 및 방법 | |
CN116186053A (zh) | 一种数据处理方法、装置及存储介质 | |
CN115878592A (zh) | 一种政务数据治理方法、装置、存储介质及电子设备 | |
CN115658680A (zh) | 数据存储方法、数据查询方法和相关装置 | |
CN109902258A (zh) | 基于区块链的数据处理方法及设备 |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PB01 | Publication | ||
PB01 | Publication | ||
SE01 | Entry into force of request for substantive examination | ||
SE01 | Entry into force of request for substantive examination | ||
TA01 | Transfer of patent application right |
Effective date of registration: 20201012 Address after: Cayman Enterprise Centre, 27 Hospital Road, George Town, Grand Cayman Islands Applicant after: Advanced innovation technology Co.,Ltd. Address before: A four-storey 847 mailbox in Grand Cayman Capital Building, British Cayman Islands Applicant before: Alibaba Group Holding Ltd. Effective date of registration: 20201012 Address after: Cayman Enterprise Centre, 27 Hospital Road, George Town, Grand Cayman Islands Applicant after: Innovative advanced technology Co.,Ltd. Address before: Cayman Enterprise Centre, 27 Hospital Road, George Town, Grand Cayman Islands Applicant before: Advanced innovation technology Co.,Ltd. |
|
TA01 | Transfer of patent application right | ||
GR01 | Patent grant | ||
GR01 | Patent grant | ||
TR01 | Transfer of patent right |
Effective date of registration: 20240219 Address after: Guohao Times City # 20-01, 128 Meizhi Road, Singapore Patentee after: Advanced Nova Technology (Singapore) Holdings Ltd. Country or region after: Singapore Address before: Cayman Enterprise Centre, 27 Hospital Road, George Town, Grand Cayman Islands Patentee before: Innovative advanced technology Co.,Ltd. Country or region before: United Kingdom |
|
TR01 | Transfer of patent right |