SG11201700190WA - Dynamic load-based merging - Google Patents

Dynamic load-based merging

Info

Publication number
SG11201700190WA
SG11201700190WA SG11201700190WA SG11201700190WA SG11201700190WA SG 11201700190W A SG11201700190W A SG 11201700190WA SG 11201700190W A SG11201700190W A SG 11201700190WA SG 11201700190W A SG11201700190W A SG 11201700190WA SG 11201700190W A SG11201700190W A SG 11201700190WA
Authority
SG
Singapore
Prior art keywords
dynamic load
based merging
merging
dynamic
load
Prior art date
Application number
SG11201700190WA
Inventor
Zhenkun Yang
Zhidong Sun
Hu Xu
Original Assignee
Alibaba Group Holding Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Alibaba Group Holding Ltd filed Critical Alibaba Group Holding Ltd
Priority claimed from PCT/US2015/045747 external-priority patent/WO2016032803A1/en
Publication of SG11201700190WA publication Critical patent/SG11201700190WA/en

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/10—File systems; File servers
    • G06F16/17—Details of further file system functions
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00—Network arrangements or protocols for supporting network services or applications
    • H04L67/01—Protocols
    • H04L67/10—Protocols in which an application is distributed across nodes in the network
    • H04L67/1001—Protocols in which an application is distributed across nodes in the network for accessing one among a plurality of replicated servers
    • H04L67/1004—Server selection for load balancing
    • H04L67/1008—Server selection for load balancing based on parameters of servers, e.g. available memory or workload
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F11/00—Error detection; Error correction; Monitoring
    • G06F11/30—Monitoring
    • G06F11/3003—Monitoring arrangements specially adapted to the computing system or computing system component being monitored
    • G06F11/3006—Monitoring arrangements specially adapted to the computing system or computing system component being monitored where the computing system is distributed, e.g. networked systems, clusters, multiprocessor systems
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F11/00—Error detection; Error correction; Monitoring
    • G06F11/30—Monitoring
    • G06F11/34—Recording or statistical evaluation of computer activity, e.g. of down time, of input/output operation ; Recording or statistical evaluation of user activity, e.g. usability assessment
    • G06F11/3409—Recording or statistical evaluation of computer activity, e.g. of down time, of input/output operation ; Recording or statistical evaluation of user activity, e.g. usability assessment for performance assessment
    • G06F11/3433—Recording or statistical evaluation of computer activity, e.g. of down time, of input/output operation ; Recording or statistical evaluation of user activity, e.g. usability assessment for performance assessment for load management
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/23—Updating
    • G06F16/2379—Updates performed during online database operations; commit processing
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F17/00—Digital computing or data processing equipment or methods, specially adapted for specific functions
    • G06F17/40—Data acquisition and logging
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q10/00—Administration; Management
    • G06Q10/06—Resources, workflows, human or project management; Enterprise or organisation planning; Enterprise or organisation modelling
    • G06Q10/063—Operations research, analysis or management
    • G06Q10/0631—Resource planning, allocation, distributing or scheduling for enterprises or organisations
    • G06Q10/06314—Calendaring for a resource
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00—Network arrangements or protocols for supporting network services or applications
    • H04L67/01—Protocols
    • H04L67/10—Protocols in which an application is distributed across nodes in the network
    • H04L67/1095—Replication or mirroring of data, e.g. scheduling or transport for data synchronisation between network nodes

Landscapes

  • Engineering & Computer Science (AREA)
  • Business, Economics & Management (AREA)
  • Theoretical Computer Science (AREA)
  • Human Resources & Organizations (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Databases & Information Systems (AREA)
  • Entrepreneurship & Innovation (AREA)
  • Strategic Management (AREA)
  • Economics (AREA)
  • Data Mining & Analysis (AREA)
  • Quality & Reliability (AREA)
  • Signal Processing (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Computer Hardware Design (AREA)
  • Educational Administration (AREA)
  • Operations Research (AREA)
  • Marketing (AREA)
  • Game Theory and Decision Science (AREA)
  • General Business, Economics & Management (AREA)
  • Development Economics (AREA)
  • Tourism & Hospitality (AREA)
  • Mathematical Physics (AREA)
  • Computing Systems (AREA)
  • Software Systems (AREA)
  • Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
SG11201700190WA 2014-08-27 2015-08-18 Dynamic load-based merging SG11201700190WA (en)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
CN201410429616.0A CN105446653B (en) 2014-08-27 2014-08-27 A kind of data merging method and equipment
PCT/US2015/045747 WO2016032803A1 (en) 2014-08-27 2015-08-18 Dynamic load-based merging
US14/829,132 US10523743B2 (en) 2014-08-27 2015-08-18 Dynamic load-based merging

Publications (1)

Publication Number Publication Date
SG11201700190WA true SG11201700190WA (en) 2017-02-27

Family

ID=55403945

Family Applications (1)

Application Number Title Priority Date Filing Date
SG11201700190WA SG11201700190WA (en) 2014-08-27 2015-08-18 Dynamic load-based merging

Country Status (8)

Country Link
US (1) US10523743B2 (en)
EP (1) EP3186760B8 (en)
JP (1) JP6412244B2 (en)
KR (1) KR101938501B1 (en)
CN (1) CN105446653B (en)
ES (1) ES2845654T3 (en)
PL (1) PL3186760T3 (en)
SG (1) SG11201700190WA (en)

Families Citing this family (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20180349095A1 (en) * 2017-06-06 2018-12-06 ScaleFlux, Inc. Log-structured merge tree based data storage architecture
US10542078B1 (en) * 2017-06-13 2020-01-21 Parallels International Gmbh System and method of load balancing traffic bursts in non-real time networks
CN107295080B (en) * 2017-06-19 2020-12-18 北京百度网讯科技有限公司 Data storage method applied to distributed server cluster and server
KR102509256B1 (en) * 2018-03-27 2023-03-14 넷플릭스, 인크. Techniques for Scheduled Anti-Entropy Recovery Design
CN109039898B (en) * 2018-08-08 2021-12-07 网宿科技股份有限公司 Management method and device of drainage information
EP3791283A1 (en) * 2018-09-14 2021-03-17 Google LLC Staggered merging in log-structured merge forests
US11514000B2 (en) 2018-12-24 2022-11-29 Cloudbrink, Inc. Data mesh parallel file system replication
CN112235332B (en) * 2019-07-15 2024-01-16 北京京东尚科信息技术有限公司 Method and device for switching reading and writing of clusters
CN112463048B (en) * 2020-11-26 2022-08-30 新华三技术有限公司成都分公司 Compact processing speed adjusting method and device, electronic equipment and medium
CN113590040B (en) * 2021-07-29 2024-03-19 郑州阿帕斯数云信息科技有限公司 Data processing method, device, equipment and storage medium

Family Cites Families (65)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US4775932A (en) 1984-07-31 1988-10-04 Texas Instruments Incorporated Computer memory system with parallel garbage collection independent from an associated user processor
EP0681721B1 (en) * 1993-02-01 2005-03-23 Sun Microsystems, Inc. Archiving file system for data servers in a distributed network environment
US6226650B1 (en) 1998-09-17 2001-05-01 Synchrologic, Inc. Database synchronization and organization system and method
US20020010783A1 (en) * 1999-12-06 2002-01-24 Leonard Primak System and method for enhancing operation of a web server cluster
US6981005B1 (en) * 2000-08-24 2005-12-27 Microsoft Corporation Partial migration of an object to another storage location in a computer system
US7228441B2 (en) 2000-09-27 2007-06-05 Huron Ip Llc Multi-server and multi-CPU power management system and method
WO2002052381A2 (en) * 2000-12-22 2002-07-04 Warp Solutions, Inc. System and method for intelligently distributing content over a communications network
JP2003022209A (en) * 2001-07-05 2003-01-24 Nri & Ncc Co Ltd Distributed server system
US8005966B2 (en) 2002-06-11 2011-08-23 Pandya Ashish A Data processing system using internet protocols
EP3321769A1 (en) 2003-05-07 2018-05-16 Conversant Intellectual Property Management Inc. Managing power on integrated circuits using power islands
US20050038954A1 (en) 2003-06-04 2005-02-17 Quantum Corporation Storage drive having universal format across media types
US7051215B2 (en) 2003-06-13 2006-05-23 Intel Corporation Power management for clustered computing platforms
US7565454B2 (en) 2003-07-18 2009-07-21 Microsoft Corporation State migration in multiple NIC RDMA enabled devices
JP4371739B2 (en) 2003-09-02 2009-11-25 株式会社東芝 Electronic device having serial ATA interface and power saving method of serial ATA bus
US7490239B2 (en) 2005-01-07 2009-02-10 First Data Corporation Facilitating digital signature based on ephemeral private key
US7389379B1 (en) * 2005-04-25 2008-06-17 Network Appliance, Inc. Selective disk offlining
US7480766B2 (en) 2005-08-03 2009-01-20 Sandisk Corporation Interfacing systems operating through a logical address space and on a direct data file basis
US8260924B2 (en) 2006-05-03 2012-09-04 Bluetie, Inc. User load balancing systems and methods thereof
EP2038729A2 (en) 2006-06-27 2009-03-25 Koninklijke Philips Electronics N.V. A device and a method for managing power consumption of a plurality of data processing units
US20080243847A1 (en) * 2007-04-02 2008-10-02 Microsoft Corporation Separating central locking services from distributed data fulfillment services in a storage system
US8359430B1 (en) * 2007-08-30 2013-01-22 Network Appliance, Inc. Techniques for efficient mass storage layout optimization
JP5343399B2 (en) * 2008-05-22 2013-11-13 富士通株式会社 Management program, management method, and management apparatus
US8954654B2 (en) 2008-06-18 2015-02-10 Super Talent Technology, Corp. Virtual memory device (VMD) application/driver with dual-level interception for data-type splitting, meta-page grouping, and diversion of temp files to ramdisks for enhanced flash endurance
US9547589B2 (en) 2008-06-18 2017-01-17 Super Talent Technology, Corp. Endurance translation layer (ETL) and diversion of temp files for reduced flash wear of a super-endurance solid-state drive
CN101889313B (en) 2008-12-30 2014-12-03 E·孔法洛涅里 Non-volatile memory with extended operating temperature range
EP2396742A2 (en) 2009-02-10 2011-12-21 Uniloc Usa, Inc. Web content access using a client device identifier
US8918365B2 (en) * 2009-06-19 2014-12-23 Blekko, Inc. Dedicating disks to reading or writing
US8688894B2 (en) 2009-09-03 2014-04-01 Pioneer Chip Technology Ltd. Page based management of flash storage
US9390035B2 (en) 2009-12-21 2016-07-12 Sanmina-Sci Corporation Method and apparatus for supporting storage modules in standard memory and/or hybrid memory bus architectures
JP5585116B2 (en) * 2010-02-19 2014-09-10 日本電気株式会社 Storage system
JP5598017B2 (en) * 2010-02-24 2014-10-01 富士通株式会社 Judgment program, method and apparatus
JP2011198133A (en) 2010-03-19 2011-10-06 Toshiba Corp Memory system and controller
US8688897B2 (en) 2010-05-28 2014-04-01 International Business Machines Corporation Cache memory management in a flash cache architecture
JP4886877B2 (en) 2010-05-31 2012-02-29 株式会社東芝 Recording medium control apparatus and method
US8725934B2 (en) 2011-12-22 2014-05-13 Fusion-Io, Inc. Methods and appratuses for atomic storage operations
US8516284B2 (en) 2010-11-04 2013-08-20 International Business Machines Corporation Saving power by placing inactive computing devices in optimized configuration corresponding to a specific constraint
US9208071B2 (en) 2010-12-13 2015-12-08 SanDisk Technologies, Inc. Apparatus, system, and method for accessing memory
US9805108B2 (en) * 2010-12-23 2017-10-31 Mongodb, Inc. Large distributed database clustering systems and methods
US8452819B1 (en) * 2011-03-22 2013-05-28 Amazon Technologies, Inc. Methods and apparatus for optimizing resource utilization in distributed storage systems
KR101717081B1 (en) 2011-03-23 2017-03-28 삼성전자주식회사 Storage device comprising a buffer memory by using a nonvolatile-ram and volatile-ram
JP5583069B2 (en) * 2011-04-18 2014-09-03 三菱電機株式会社 Database system
KR20130031046A (en) 2011-09-20 2013-03-28 삼성전자주식회사 Flash memory device and data manage method thererof
US8843451B2 (en) * 2011-09-23 2014-09-23 International Business Machines Corporation Block level backup and restore
CN102497353B (en) * 2011-10-28 2015-08-26 深圳第七大道网络技术有限公司 Multi-server distributed data processing method, server and system
US9213645B2 (en) 2011-12-29 2015-12-15 Sandisk Technologies Inc. Command aware partial page programming
US9645917B2 (en) 2012-05-22 2017-05-09 Netapp, Inc. Specializing I/O access patterns for flash storage
US9092223B1 (en) 2012-05-31 2015-07-28 Google Inc. Systems and methods to save power in data-center networks
US9405621B2 (en) 2012-12-28 2016-08-02 Super Talent Technology, Corp. Green eMMC device (GeD) controller with DRAM data persistence, data-type splitting, meta-page grouping, and diversion of temp files for enhanced flash endurance
US9432755B2 (en) 2013-02-15 2016-08-30 Futurewei Technologies, Inc. Downstream burst transmission in passive optical networks
US8984171B2 (en) 2013-03-01 2015-03-17 Silicon Motion, Inc. Data storage device and flash memory control method
US9298752B2 (en) * 2013-08-26 2016-03-29 Dropbox, Inc. Facilitating data migration between database clusters while the database continues operating
CN105453044B (en) 2013-09-19 2020-06-12 英特尔公司 Techniques for distributed processing task portion assignment
US20160232103A1 (en) 2013-09-26 2016-08-11 Mark A. Schmisseur Block storage apertures to persistent memory
US9251154B2 (en) 2013-11-15 2016-02-02 International Business Machines Corporation Priority based reliability mechanism for archived data
US9240722B2 (en) 2014-06-19 2016-01-19 Dell Products Lp Methods and systems for improving light load efficiency for power stages of multi-phase voltage regulator circuits
US9626286B2 (en) 2014-10-03 2017-04-18 Sandisk Technologies Llc Hardware and firmware paths for performing memory read processes
US9710330B2 (en) 2014-10-15 2017-07-18 Empire Technology Development Llc Partial cloud data storage
US10234930B2 (en) 2015-02-13 2019-03-19 Intel Corporation Performing power management in a multicore processor
US9734051B2 (en) 2015-02-16 2017-08-15 Quantum Corporation Garbage collection and defragmentation for solid state drives (SSD) and shingled magnetic recording (SMR) drives
US9911487B2 (en) 2015-05-19 2018-03-06 EMC IP Holding Company LLC Method and system for storing and recovering data from flash memory
US20160350002A1 (en) 2015-05-29 2016-12-01 Intel Corporation Memory device specific self refresh entry and exit
US9965441B2 (en) 2015-12-10 2018-05-08 Cisco Technology, Inc. Adaptive coalescing of remote direct memory access acknowledgements based on I/O characteristics
US10389839B2 (en) 2016-06-01 2019-08-20 Intel Corporation Method and apparatus for generating data prefetches specifying various sizes to prefetch data from a remote computing node
US10514862B2 (en) 2016-07-21 2019-12-24 Micron Technology, Inc. Memory device including concurrent suspend states for different operations
JP6274589B1 (en) 2016-09-28 2018-02-07 ウィンボンド エレクトロニクス コーポレーション Semiconductor memory device and continuous reading method

Also Published As

Publication number Publication date
CN105446653B (en) 2018-12-14
JP2017528794A (en) 2017-09-28
EP3186760A1 (en) 2017-07-05
PL3186760T3 (en) 2021-09-27
EP3186760B8 (en) 2021-03-10
KR101938501B1 (en) 2019-04-11
US10523743B2 (en) 2019-12-31
JP6412244B2 (en) 2018-10-24
US20160065663A1 (en) 2016-03-03
EP3186760A4 (en) 2018-04-25
CN105446653A (en) 2016-03-30
KR20170042298A (en) 2017-04-18
EP3186760B1 (en) 2020-10-14
ES2845654T3 (en) 2021-07-27

Similar Documents

Publication Publication Date Title
AU361515S (en) Dishrack
AU362944S (en) Lapboard
SG11201700190WA (en) Dynamic load-based merging
ZA201503021B (en) Support arrangement
GB201414866D0 (en) Support component
DK3191586T3 (en) Cellobiosephosphorylase
DK3178931T3 (en) Anti-orai1-antistof
GB201403873D0 (en) Dynamic energy menagement system
DK3002465T3 (en) Hydrauliksystem
ZA201605444B (en) Skincare system
GB201419650D0 (en) Modified heterocyclase
DK3234061T3 (en) Nano-inhibitorer
ZA201604337B (en) Container-drum structural arrangement
DK3194944T3 (en) Tomografiapparat
DK3145380T3 (en) Toiletventilationssystem
GB201500780D0 (en) Dynamic Balanced-Beam
AU5593P (en) Lanmissouri Mandevilla sanderi
AU5598P (en) Lanidaho Mandevilla sanderi
AU5594P (en) Lanoregon Mandevilla sanderi
AU5585P (en) Lanutah Mandevilla sanderi
AU5591P (en) Lanmontana Mandevilla sanderi
AU5583P (en) Lanminnesota Mandevilla sanderi
AU5597P (en) Lancalifornia Mandevilla sanderi
AU5596P (en) Lannevada Mandevilla sanderi
AU5584P (en) Laniowa Mandevilla sanderi