CN109076021A - 数据处理的方法和装置 - Google Patents

数据处理的方法和装置 Download PDF

Info

Publication number
CN109076021A
CN109076021A CN201680058640.5A CN201680058640A CN109076021A CN 109076021 A CN109076021 A CN 109076021A CN 201680058640 A CN201680058640 A CN 201680058640A CN 109076021 A CN109076021 A CN 109076021A
Authority
CN
China
Prior art keywords
hash
grades
tables
hash tables
target position
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN201680058640.5A
Other languages
English (en)
Other versions
CN109076021B (zh
Inventor
张丰伟
张学仓
德鲁日宁·伊戈尔
王元钢
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Huawei Technologies Co Ltd
Original Assignee
Huawei Technologies Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Huawei Technologies Co Ltd filed Critical Huawei Technologies Co Ltd
Publication of CN109076021A publication Critical patent/CN109076021A/zh
Application granted granted Critical
Publication of CN109076021B publication Critical patent/CN109076021B/zh
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L9/00—Cryptographic mechanisms or cryptographic arrangements for secret or secure communications; Network security protocols
    • H04L9/32—Cryptographic mechanisms or cryptographic arrangements for secret or secure communications; Network security protocols including means for verifying the identity or authority of a user of the system or for message authentication, e.g. authorization, entity authentication, data integrity or data verification, non-repudiation, key authentication or verification of credentials
    • H04L9/3236—Cryptographic mechanisms or cryptographic arrangements for secret or secure communications; Network security protocols including means for verifying the identity or authority of a user of the system or for message authentication, e.g. authorization, entity authentication, data integrity or data verification, non-repudiation, key authentication or verification of credentials using cryptographic hash functions
    • H04L9/3239—Cryptographic mechanisms or cryptographic arrangements for secret or secure communications; Network security protocols including means for verifying the identity or authority of a user of the system or for message authentication, e.g. authorization, entity authentication, data integrity or data verification, non-repudiation, key authentication or verification of credentials using cryptographic hash functions involving non-keyed hash functions, e.g. modification detection codes [MDCs], MD5, SHA or RIPEMD

Landscapes

  • Engineering & Computer Science (AREA)
  • Computer Security & Cryptography (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Signal Processing (AREA)
  • Information Retrieval, Db Structures And Fs Structures Therefor (AREA)

Abstract

一种数据处理的方法(200)和装置。该方法(200)包括：从第N+1级哈希表包括的多个位置中确定负载最小的位置为目标位置，所述多个位置为第一哈希数据在所述第N级哈希表中的候选位置在所述第N+1级哈希表中对应的位置，所述第一哈希数据为待插入所述第N级哈希表中的哈希数据(S210)；将所述第N级哈希表中的第二哈希数据迁移至所述目标位置，其中，所述第二哈希数据为所述目标位置在所述第N级哈希表中对应的位置存储的哈希数据(S220)；将所述第一哈希数据插入所述候选位置(S230)。上述方法和装置可以减小第N+1级哈希表中哈希冲突的概率，提高第N+1级哈希表的读写效率。

Description

PCT国内申请，说明书已公开。

Claims (10)

  1. PCT国内申请，权利要求书已公开。
CN201680058640.5A 2016-12-30 2016-12-30 数据处理的方法和装置 Active CN109076021B (zh)

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/CN2016/113705 WO2018120109A1 (zh) 2016-12-30 2016-12-30 数据处理的方法和装置

Publications (2)

Publication Number Publication Date
CN109076021A true CN109076021A (zh) 2018-12-21
CN109076021B CN109076021B (zh) 2020-09-11

Family

ID=62706806

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201680058640.5A Active CN109076021B (zh) 2016-12-30 2016-12-30 数据处理的方法和装置

Country Status (2)

Country Link
CN (1) CN109076021B (zh)
WO (1) WO2018120109A1 (zh)

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110688219A (zh) * 2019-09-05 2020-01-14 浙江理工大学 基于反向混沌布谷鸟搜索的自适应权重负载均衡算法
CN111953682A (zh) * 2020-08-11 2020-11-17 北京八分量信息科技有限公司 银行云计算门户网站页面的防篡改方法、装置及相关产品
CN112612419A (zh) * 2020-12-25 2021-04-06 西安交通大学 Nvm的数据存储结构、存储方法、读取方法、设备及介质

Families Citing this family (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109800228B (zh) * 2018-12-28 2023-03-10 深圳竹云科技有限公司 一种高效快速解决hash冲突的方法
CN109828966A (zh) * 2019-01-17 2019-05-31 平安科技（深圳）有限公司 渐进式重哈希方法、装置、计算机设备及存储介质
CN111857982B (zh) * 2019-04-25 2023-10-27 浙江大学 一种数据处理方法及其装置
CN113141317B (zh) * 2021-03-05 2022-09-30 西安电子科技大学 流媒体服务器负载均衡方法、系统、计算机设备、终端
CN114661680B (zh) * 2022-05-25 2022-08-12 蓝象智联(杭州)科技有限公司 一种私有数据隐匿共享方法
WO2024197825A1 (zh) * 2023-03-31 2024-10-03 新华三技术有限公司 存储mac地址表项
CN116401258B (zh) * 2023-06-06 2023-09-22 支付宝(杭州)信息技术有限公司 数据索引方法、数据查询方法及对应装置
CN118606327A (zh) * 2024-08-08 2024-09-06 芯云晟(杭州)电子科技有限公司 弹性哈希表的处理方法、装置、设备及介质

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6151708A (en) * 1997-12-19 2000-11-21 Microsoft Corporation Determining program update availability via set intersection over a sub-optical pathway
CN101667958A (zh) * 2008-09-01 2010-03-10 华为技术有限公司 选择哈希函数的方法、存储及查找路由表的方法及装置
CN101674234A (zh) * 2009-08-21 2010-03-17 曙光信息产业(北京)有限公司 Ip报文的分片重组方法和装置
CN102754394A (zh) * 2010-08-19 2012-10-24 华为技术有限公司 一种哈希表存储、查找方法以及装置
CN105447059A (zh) * 2014-09-29 2016-03-30 华为技术有限公司 一种数据处理方法及装置

Family Cites Families (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1184775C (zh) * 2002-02-07 2005-01-12 华为技术有限公司 多哈希函数的虚通道标识/虚通路标识的查找方法
US7571484B2 (en) * 2003-12-04 2009-08-04 Microsoft Corporation System and method for image authentication of a resource-sparing operating system
CN101267381B (zh) * 2007-03-13 2010-12-29 大唐移动通信设备有限公司 哈希表操作方法及装置
CN102073733B (zh) * 2011-01-19 2014-08-13 中兴通讯股份有限公司 哈希表管理方法及装置
CN103581024A (zh) * 2013-11-21 2014-02-12 盛科网络（苏州）有限公司 Mac地址硬件与软件相结合的学习方法及装置

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6151708A (en) * 1997-12-19 2000-11-21 Microsoft Corporation Determining program update availability via set intersection over a sub-optical pathway
CN101667958A (zh) * 2008-09-01 2010-03-10 华为技术有限公司 选择哈希函数的方法、存储及查找路由表的方法及装置
CN101674234A (zh) * 2009-08-21 2010-03-17 曙光信息产业(北京)有限公司 Ip报文的分片重组方法和装置
CN102754394A (zh) * 2010-08-19 2012-10-24 华为技术有限公司 一种哈希表存储、查找方法以及装置
CN105447059A (zh) * 2014-09-29 2016-03-30 华为技术有限公司 一种数据处理方法及装置

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110688219A (zh) * 2019-09-05 2020-01-14 浙江理工大学 基于反向混沌布谷鸟搜索的自适应权重负载均衡算法
CN111953682A (zh) * 2020-08-11 2020-11-17 北京八分量信息科技有限公司 银行云计算门户网站页面的防篡改方法、装置及相关产品
CN112612419A (zh) * 2020-12-25 2021-04-06 西安交通大学 Nvm的数据存储结构、存储方法、读取方法、设备及介质
CN112612419B (zh) * 2020-12-25 2022-10-25 西安交通大学 Nvm的数据存储结构、存储方法、读取方法、设备及介质

Also Published As

Publication number Publication date
CN109076021B (zh) 2020-09-11
WO2018120109A1 (zh) 2018-07-05

Similar Documents

Publication Publication Date Title
CN109076021A (zh) 数据处理的方法和装置
US11163828B2 (en) Building and querying hash tables on processors
JP6875557B2 (ja) サービス・データをブロックチェーン・システムに書き込むための方法およびデバイス
US10810179B2 (en) Distributed graph database
CN110674053B (zh) Ssd数据存储节点管理方法、装置、计算机设备及存储介质
US7890541B2 (en) Partition by growth table space
US10552378B2 (en) Dividing a dataset into sub-datasets having a subset of values of an attribute of the dataset
CN110096227B (zh) 数据存储方法、数据处理方法、装置、电子设备及计算机可读介质
US8868526B2 (en) Parallel segmented index supporting incremental document and term indexing
CN109690522B (zh) 一种基于b+树索引的数据更新方法、装置及存储装置
US20180129675A1 (en) Dynamic column synopsis for analytical databases
US20200167327A1 (en) System and method for self-resizing associative probabilistic hash-based data structures
CN106599247B (zh) LSM-tree结构中数据文件的合并方法及装置
CN110851434B (zh) 一种数据存储方法、装置及设备
US20200089776A1 (en) Method for migrating data records from a source database to a target database
CN104598652B (zh) 一种数据库查询方法及装置
WO2016191964A1 (zh) 一种文件系统的管理方法及装置
CN106227769B (zh) 数据存储方法及装置
US10733218B2 (en) System, method, and program for aggregating data
CN114880289A (zh) 一种文件分组显示方法及计算设备
US11422998B2 (en) Data management system, data management device, data management method, and storage medium
CN108804571B (zh) 一种数据存储方法、装置以及设备
US20220092049A1 (en) Workload-driven database reorganization
CN111143232B (zh) 用于存储元数据的方法、设备和计算机可读介质
JP2002342403A (ja) フォールスパス検出装置、フォールスパス検出方法およびそのプログラム

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant