CN110019360A - 一种数据处理方法及装置 - Google Patents
一种数据处理方法及装置 Download PDFInfo
- Publication number
- CN110019360A CN110019360A CN201711025417.3A CN201711025417A CN110019360A CN 110019360 A CN110019360 A CN 110019360A CN 201711025417 A CN201711025417 A CN 201711025417A CN 110019360 A CN110019360 A CN 110019360A
- Authority
- CN
- China
- Prior art keywords
- hash table
- hash
- full dose
- data processing
- data
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000003672 processing method Methods 0.000 title claims abstract description 61
- 238000000034 method Methods 0.000 claims description 55
- 238000012545 processing Methods 0.000 claims description 38
- 238000004590 computer program Methods 0.000 claims description 27
- 230000006835 compression Effects 0.000 claims description 21
- 238000007906 compression Methods 0.000 claims description 21
- 230000006837 decompression Effects 0.000 claims description 9
- 230000005540 biological transmission Effects 0.000 description 20
- 230000008569 process Effects 0.000 description 16
- 238000010586 diagram Methods 0.000 description 9
- 238000012952 Resampling Methods 0.000 description 8
- 238000005516 engineering process Methods 0.000 description 4
- 230000006399 behavior Effects 0.000 description 3
- 238000004422 calculation algorithm Methods 0.000 description 2
- 230000008859 change Effects 0.000 description 2
- 238000001514 detection method Methods 0.000 description 2
- 241001269238 Data Species 0.000 description 1
- 230000009471 action Effects 0.000 description 1
- 230000009286 beneficial effect Effects 0.000 description 1
- 238000004364 calculation method Methods 0.000 description 1
- 239000004744 fabric Substances 0.000 description 1
- 238000001914 filtration Methods 0.000 description 1
- 230000006870 function Effects 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 238000012544 monitoring process Methods 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 230000029058 respiratory gaseous exchange Effects 0.000 description 1
- 239000000523 sample Substances 0.000 description 1
- 238000012216 screening Methods 0.000 description 1
- 230000003068 static effect Effects 0.000 description 1
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/22—Indexing; Data structures therefor; Storage structures
- G06F16/2228—Indexing structures
- G06F16/2255—Hash tables
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/24—Querying
- G06F16/245—Query processing
- G06F16/2455—Query execution
- G06F16/24553—Query execution of query operations
- G06F16/24558—Binary matching operations
- G06F16/2456—Join operations
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Data Mining & Analysis (AREA)
- Databases & Information Systems (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Computational Linguistics (AREA)
- Software Systems (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
Description
Claims (27)
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201711025417.3A CN110019360A (zh) | 2017-10-27 | 2017-10-27 | 一种数据处理方法及装置 |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201711025417.3A CN110019360A (zh) | 2017-10-27 | 2017-10-27 | 一种数据处理方法及装置 |
Publications (1)
Publication Number | Publication Date |
---|---|
CN110019360A true CN110019360A (zh) | 2019-07-16 |
Family
ID=67186673
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN201711025417.3A Pending CN110019360A (zh) | 2017-10-27 | 2017-10-27 | 一种数据处理方法及装置 |
Country Status (1)
Country | Link |
---|---|
CN (1) | CN110019360A (zh) |
Cited By (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
WO2021031527A1 (zh) * | 2019-08-20 | 2021-02-25 | 蚂蚁金服(杭州)网络技术有限公司 | 分布式数据库表连接方法、装置、系统、服务器及介质 |
Citations (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN102521307A (zh) * | 2011-12-01 | 2012-06-27 | 北京人大金仓信息技术股份有限公司 | 一种云计算环境下的无共享数据库集群并行查询处理方法 |
CN103544259A (zh) * | 2013-10-16 | 2014-01-29 | 国家计算机网络与信息安全管理中心 | 分组聚集排序TopK查询处理方法及系统 |
-
2017
- 2017-10-27 CN CN201711025417.3A patent/CN110019360A/zh active Pending
Patent Citations (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN102521307A (zh) * | 2011-12-01 | 2012-06-27 | 北京人大金仓信息技术股份有限公司 | 一种云计算环境下的无共享数据库集群并行查询处理方法 |
CN103544259A (zh) * | 2013-10-16 | 2014-01-29 | 国家计算机网络与信息安全管理中心 | 分组聚集排序TopK查询处理方法及系统 |
Cited By (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
WO2021031527A1 (zh) * | 2019-08-20 | 2021-02-25 | 蚂蚁金服(杭州)网络技术有限公司 | 分布式数据库表连接方法、装置、系统、服务器及介质 |
CN113434500A (zh) * | 2019-08-20 | 2021-09-24 | 北京奥星贝斯科技有限公司 | 表连接方法、装置、分布式数据库系统、服务器及介质 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US10261902B2 (en) | Parallel processing of a series of data units for writing | |
US20180276274A1 (en) | Parallel processing database system with a shared metadata store | |
WO2021073211A1 (zh) | 训练图神经网络模型的方法和装置 | |
US20200301961A1 (en) | Image retrieval method and apparatus, system, server, and storage medium | |
US12038851B2 (en) | Method and apparatus for accessing storage system | |
WO2020147336A1 (zh) | 一种微服务全链路监控系统及方法 | |
US7457835B2 (en) | Movement of data in a distributed database system to a storage location closest to a center of activity for the data | |
EP2962226A1 (en) | System and method for distributed sql join processing in shared-nothing relational database clusters using stationary tables | |
US20140280020A1 (en) | System and Method for Distributed SQL Join Processing in Shared-Nothing Relational Database Clusters Using Self Directed Data Streams | |
CN103607424B (zh) | 一种服务器连接方法及服务器系统 | |
US11102322B2 (en) | Data processing method and apparatus, server, and controller | |
KR102126320B1 (ko) | 분산 처리 시스템, 데이터 처리 방법 및 제어 노드 장치 | |
CN110147377A (zh) | 大规模空间数据环境下基于二级索引的通用查询算法 | |
CN109783564A (zh) | 支持多节点的分布式缓存方法及设备 | |
US11321021B2 (en) | Method and apparatus of managing mapping relationship between storage identifier and start address of queue of storage device corresponding to the storage identifier | |
CN110175175A (zh) | 一种基于spark的分布式空间二级索引与范围查询算法 | |
CN109800236A (zh) | 支持多节点的分布式缓存方法及设备 | |
CN110019360A (zh) | 一种数据处理方法及装置 | |
CN110381136A (zh) | 一种数据读取方法、终端、服务器及存储介质 | |
WO2024119792A1 (zh) | 一种视频数据存储及分析方法、装置、系统、通信设备和存储介质 | |
CN117527805A (zh) | 一种基于服务器集群的多模态数据接入优化方法及系统 | |
US9842148B2 (en) | Method for failure-resilient data placement in a distributed query processing system | |
CN108234552A (zh) | 一种数据存储方法及装置 | |
CN109032967B (zh) | 一种基于三维众核处理器的Cache地址映射方法 | |
CN105426501B (zh) | 多维数据库自动路由实现方法和系统 |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PB01 | Publication | ||
PB01 | Publication | ||
SE01 | Entry into force of request for substantive examination | ||
SE01 | Entry into force of request for substantive examination | ||
REG | Reference to a national code |
Ref country code: HK Ref legal event code: DE Ref document number: 40010851 Country of ref document: HK |
|
TA01 | Transfer of patent application right | ||
TA01 | Transfer of patent application right |
Effective date of registration: 20210922 Address after: Room 508, floor 5, building 4, No. 699, Wangshang Road, Changhe street, Binjiang District, Hangzhou City, Zhejiang Province Applicant after: Alibaba (China) Co.,Ltd. Address before: A four-storey 847 mailbox in Grand Cayman Capital Building, British Cayman Islands Applicant before: ALIBABA GROUP HOLDING Ltd. |
|
TA01 | Transfer of patent application right | ||
TA01 | Transfer of patent application right |
Effective date of registration: 20211203 Address after: No.12 Zhuantang science and technology economic block, Xihu District, Hangzhou City, Zhejiang Province Applicant after: Aliyun Computing Co.,Ltd. Address before: 310052 room 508, 5th floor, building 4, No. 699 Wangshang Road, Changhe street, Binjiang District, Hangzhou City, Zhejiang Province Applicant before: Alibaba (China) Co.,Ltd. |
|
RJ01 | Rejection of invention patent application after publication | ||
RJ01 | Rejection of invention patent application after publication |
Application publication date: 20190716 |