SG11202112945SA - Data processing method and apparatus, electronic device, and computer storage medium - Google Patents

Data processing method and apparatus, electronic device, and computer storage medium

Info

Publication number
SG11202112945SA
SG11202112945SA SG11202112945SA SG11202112945SA SG11202112945SA SG 11202112945S A SG11202112945S A SG 11202112945SA SG 11202112945S A SG11202112945S A SG 11202112945SA SG 11202112945S A SG11202112945S A SG 11202112945SA SG 11202112945S A SG11202112945S A SG 11202112945SA
Authority
SG
Singapore
Prior art keywords
electronic device
storage medium
data processing
processing method
computer storage
Prior art date
Application number
SG11202112945SA
Inventor
Gui Huang
Canfang Shang
Dengcheng He
Original Assignee
Alibaba Group Holding Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Alibaba Group Holding Ltd filed Critical Alibaba Group Holding Ltd
Publication of SG11202112945SA publication Critical patent/SG11202112945SA/en

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/25—Integrating or interfacing systems involving database management systems
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/21—Design, administration or maintenance of databases
    • G06F16/215—Improving data quality; Data cleansing, e.g. de-duplication, removing invalid entries or correcting typographical errors
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/22—Indexing; Data structures therefor; Storage structures
    • G06F16/2228—Indexing structures

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Databases & Information Systems (AREA)
  • Data Mining & Analysis (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Software Systems (AREA)
  • Quality & Reliability (AREA)
  • Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
SG11202112945SA 2019-05-30 2020-05-21 Data processing method and apparatus, electronic device, and computer storage medium SG11202112945SA (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201910462532.XA CN112015791B (en) 2019-05-30 2019-05-30 Data processing method, device, electronic equipment and computer storage medium
PCT/CN2020/091526 WO2020238750A1 (en) 2019-05-30 2020-05-21 Data processing method and apparatus, electronic device, and computer storage medium

Publications (1)

Publication Number Publication Date
SG11202112945SA true SG11202112945SA (en) 2021-12-30

Family

ID=73501783

Family Applications (1)

Application Number Title Priority Date Filing Date
SG11202112945SA SG11202112945SA (en) 2019-05-30 2020-05-21 Data processing method and apparatus, electronic device, and computer storage medium

Country Status (4)

Country Link
US (1) US12093234B2 (en)
CN (1) CN112015791B (en)
SG (1) SG11202112945SA (en)
WO (1) WO2020238750A1 (en)

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN117725035B (en) * 2024-01-30 2024-06-18 支付宝(杭州)信息技术有限公司 File merging method for LSM tree and related equipment

Family Cites Families (24)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9275067B2 (en) * 2009-03-16 2016-03-01 International Busines Machines Corporation Apparatus and method to sequentially deduplicate data
US8719235B2 (en) * 2011-12-07 2014-05-06 Jeffrey Tofano Controlling tape layout for de-duplication
US9846711B2 (en) * 2012-12-28 2017-12-19 Facebook, Inc. LSM cache
CN103744617B (en) * 2013-12-20 2016-09-28 北京奇虎科技有限公司 The merging compression method of a kind of key-value storage Data File and device
US10346432B2 (en) 2015-03-17 2019-07-09 Cloudera, Inc. Compaction policy
CN104809237B (en) * 2015-05-12 2018-12-14 百度在线网络技术（北京）有限公司 The optimization method and device of LSM-tree index
US10496760B2 (en) * 2015-10-21 2019-12-03 International Business Machines Corporation Partitioned joins in analytical databases
CN105808169A (en) * 2016-03-14 2016-07-27 联想(北京)有限公司 Data deduplication method, apparatus and system
US10592348B2 (en) * 2016-06-17 2020-03-17 Acronis International Gmbh System and method for data deduplication using log-structured merge trees
US10795871B2 (en) 2016-09-26 2020-10-06 Vmware, Inc. Key-value stores implemented using fragmented log-structured merge trees
US10929042B2 (en) * 2016-10-20 2021-02-23 Hitachi, Ltd. Data storage system, process, and computer program for de-duplication of distributed data in a scalable cluster system
US10706105B2 (en) 2017-02-09 2020-07-07 Micron Technology, Inc. Merge tree garbage metrics
US10706106B2 (en) 2017-02-09 2020-07-07 Micron Technology, Inc. Merge tree modifications for maintenance operations
US10474656B1 (en) 2017-02-21 2019-11-12 Nutanix, Inc. Repurposing log files
US20220358019A1 (en) * 2017-03-10 2022-11-10 Pure Storage, Inc. Initiating Recovery Actions When A Dataset Ceases To Be Synchronously Replicated Across A Set Of Storage Systems
CN108572788A (en) * 2017-03-13 2018-09-25 广州市动景计算机科技有限公司 Data access method, apparatus and system
WO2018200475A1 (en) 2017-04-24 2018-11-01 Reniac, Inc. System and method to accelerate compaction
US20180349095A1 (en) 2017-06-06 2018-12-06 ScaleFlux, Inc. Log-structured merge tree based data storage architecture
US10445022B1 (en) * 2018-04-26 2019-10-15 Alibaba Group Holding Limited Optimization of log-structured merge (LSM) tree-based databases using object solid state drive (SSD) devices
US11100071B2 (en) 2018-10-10 2021-08-24 Micron Technology, Inc. Key-value store tree data block spill with compaction
US10915546B2 (en) 2018-10-10 2021-02-09 Micron Technology, Inc. Counter-based compaction of key-value store tree data block
US10909102B2 (en) * 2018-12-06 2021-02-02 Vmware, Inc. Systems and methods for performing scalable Log-Structured Merge (LSM) tree compaction using sharding
CN110377531B (en) * 2019-07-19 2021-08-10 清华大学 Persistent memory storage engine device based on log structure and control method
US11675789B2 (en) * 2021-06-29 2023-06-13 EMC IP Holding Company LLC Tracking utilization of data blocks in a storage system

Also Published As

Publication number Publication date
WO2020238750A1 (en) 2020-12-03
US20220083522A1 (en) 2022-03-17
CN112015791A (en) 2020-12-01
CN112015791B (en) 2024-06-07
US12093234B2 (en) 2024-09-17

Similar Documents

Publication Publication Date Title
SG11202102257PA (en) Data processing method and apparatus based on blockchain network, electronic device, and storage medium
EP3955204A4 (en) Data processing method and apparatus, electronic device and storage medium
EP4020321A4 (en) Data processing method, apparatus, computer device, and storage medium
SG11202102157UA (en) Transaction processing method, apparatus, and device and computer storage medium
EP3792916C0 (en) Data processing method based on simultaneous interpretation, computer device, and storage medium
EP4020328A4 (en) Data processing method and apparatus, computer device, and storage medium
EP3813379A4 (en) Data processing method and apparatus, electronic device, system, and storage medium
SG11202101120XA (en) Data processing method and apparatus, computer device, and storage medium
SG11202004543PA (en) Data processing method and apparatus, computer device, and storage medium
SG11202104263QA (en) Batch normalization data processing method and apparatus, electronic device, and storage medium
EP3993436C0 (en) Data processing method and apparatus, computer-readable storage medium, and electronic device
EP3842929A4 (en) Method and apparatus for processing structured data, and storage medium and electronic device
EP4057109A4 (en) Data processing method and apparatus, electronic device and storage medium
EP4307233A4 (en) Data processing method and apparatus, and electronic device and computer-readable storage medium
SG11202106254TA (en) Data processing method and apparatus, electronic device, and storage medium
SG11202010510XA (en) Data processing method and apparatus, electronic device and storage medium
EP4030817A4 (en) Data processing method and apparatus, and electronic device and computer readable storage medium
EP3849178A4 (en) Data processing method and apparatus, and electronic device and storage medium
EP4310695A4 (en) Data processing method and apparatus, computer device, and storage medium
EP3843386A4 (en) Data processing method and apparatus, and electronic device and storage medium
SG11201913925YA (en) Question and answer data processing method and apparatus, computer device, and storage medium
EP3993341A4 (en) Multimedia data processing method and apparatus, storage medium and electronic device
SG11202110551WA (en) Data analysis method and apparatus, electronic device and computer storage medium
SG11202109528SA (en) Data processing method and apparatus, electronic device and storage medium
EP3955133A4 (en) Data processing method and apparatus, electronic device, and storage medium