CN110874382B - 一种数据写入方法、装置及其设备 - Google Patents

一种数据写入方法、装置及其设备 Download PDF

Info

Publication number
CN110874382B
CN110874382B CN201810994734.4A CN201810994734A CN110874382B CN 110874382 B CN110874382 B CN 110874382B CN 201810994734 A CN201810994734 A CN 201810994734A CN 110874382 B CN110874382 B CN 110874382B
Authority
CN
China
Prior art keywords
data
group identifier
node
written
group
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201810994734.4A
Other languages
English (en)
Chinese (zh)
Other versions
CN110874382A (zh
Inventor
章颖强
何登成
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Alibaba Cloud Computing Ltd
Original Assignee
Alibaba Cloud Computing Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Alibaba Cloud Computing Ltd filed Critical Alibaba Cloud Computing Ltd
Priority to CN201810994734.4A priority Critical patent/CN110874382B/zh
Priority to PCT/US2019/048317 priority patent/WO2020046916A1/en
Priority to US16/553,077 priority patent/US10893098B2/en
Priority to JP2021507465A priority patent/JP7371087B2/ja
Priority to EP19856128.4A priority patent/EP3844635B1/en
Publication of CN110874382A publication Critical patent/CN110874382A/zh
Application granted granted Critical
Publication of CN110874382B publication Critical patent/CN110874382B/zh
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00Network arrangements or protocols for supporting network services or applications
    • H04L67/01Protocols
    • H04L67/10Protocols in which an application is distributed across nodes in the network
    • H04L67/104Peer-to-peer [P2P] networks
    • H04L67/1044Group management mechanisms 
    • H04L67/1051Group master selection mechanisms
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/27Replication, distribution or synchronisation of data between databases or within a distributed database system; Distributed database system architectures therefor
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/10File systems; File servers
    • G06F16/17Details of further file system functions
    • G06F16/178Techniques for file synchronisation in file systems
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/10File systems; File servers
    • G06F16/18File system types
    • G06F16/182Distributed file systems
    • G06F16/184Distributed file systems implemented as replicated file system
    • G06F16/1844Management specifically adapted to replicated file systems
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00Network arrangements or protocols for supporting network services or applications
    • H04L67/01Protocols
    • H04L67/10Protocols in which an application is distributed across nodes in the network
    • H04L67/1095Replication or mirroring of data, e.g. scheduling or transport for data synchronisation between network nodes
    • YGENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
    • Y02TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
    • Y02DCLIMATE CHANGE MITIGATION TECHNOLOGIES IN INFORMATION AND COMMUNICATION TECHNOLOGIES [ICT], I.E. INFORMATION AND COMMUNICATION TECHNOLOGIES AIMING AT THE REDUCTION OF THEIR OWN ENERGY USE
    • Y02D10/00Energy efficient computing, e.g. low power processors, power management or thermal management

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Signal Processing (AREA)
  • Databases & Information Systems (AREA)
  • Data Mining & Analysis (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Computing Systems (AREA)
  • Mathematical Physics (AREA)
  • Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
CN201810994734.4A 2018-08-29 2018-08-29 一种数据写入方法、装置及其设备 Active CN110874382B (zh)

Priority Applications (5)

Application Number Priority Date Filing Date Title
CN201810994734.4A CN110874382B (zh) 2018-08-29 2018-08-29 一种数据写入方法、装置及其设备
PCT/US2019/048317 WO2020046916A1 (en) 2018-08-29 2019-08-27 Method and apparatus for data writing
US16/553,077 US10893098B2 (en) 2018-08-29 2019-08-27 Method and apparatus for data writing
JP2021507465A JP7371087B2 (ja) 2018-08-29 2019-08-27 データ書き込みのための方法及び装置
EP19856128.4A EP3844635B1 (en) 2018-08-29 2019-08-27 Method and apparatus for data writing

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201810994734.4A CN110874382B (zh) 2018-08-29 2018-08-29 一种数据写入方法、装置及其设备

Publications (2)

Publication Number Publication Date
CN110874382A CN110874382A (zh) 2020-03-10
CN110874382B true CN110874382B (zh) 2023-07-04

Family

ID=69640552

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201810994734.4A Active CN110874382B (zh) 2018-08-29 2018-08-29 一种数据写入方法、装置及其设备

Country Status (5)

Country Link
US (1) US10893098B2 (https=)
EP (1) EP3844635B1 (https=)
JP (1) JP7371087B2 (https=)
CN (1) CN110874382B (https=)
WO (1) WO2020046916A1 (https=)

Families Citing this family (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US11759460B2 (en) * 2020-08-14 2023-09-19 Devie Medical Gmbh Method of local antibiotic treatment of infective endocarditis
CN112905390B (zh) * 2021-03-31 2025-03-28 恒生电子股份有限公司 日志数据备份方法、装置、设备及存储介质

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR20130048093A (ko) * 2011-11-01 2013-05-09 한국전자통신연구원 분산 데이터 베이스 장치 및 그 장치에서의 스트림 데이터 처리 방법
CN104866584A (zh) * 2015-05-28 2015-08-26 交通银行股份有限公司 一种基于业务规则的数据分区方法及装置
CN107153660A (zh) * 2016-03-04 2017-09-12 福建天晴数码有限公司 分布式数据库系统的故障检测处理方法及其系统
CN107295080A (zh) * 2017-06-19 2017-10-24 北京百度网讯科技有限公司 应用于分布式服务器集群的数据存储方法和服务器
CN107544869A (zh) * 2017-05-27 2018-01-05 新华三技术有限公司 一种数据恢复方法和装置

Family Cites Families (17)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH05165693A (ja) * 1991-12-17 1993-07-02 Fujitsu Ltd 分散情報処理装置
JP2005004474A (ja) * 2003-06-11 2005-01-06 Digital Dream:Kk 意味づけされた情報要素を分散管理する情報ストレージシステムの構成方法
US8375001B2 (en) * 2008-10-03 2013-02-12 Telefonaktiebolaget Lm Ericsson (Publ) Master monitoring mechanism for a geographical distributed database
US8572031B2 (en) * 2010-12-23 2013-10-29 Mongodb, Inc. Method and apparatus for maintaining replica sets
US8732140B2 (en) * 2011-05-24 2014-05-20 Red Lambda, Inc. Methods for storing files in a distributed environment
JP5701398B2 (ja) * 2011-11-16 2015-04-15 株式会社日立製作所 計算機システム、データ管理方法及びプログラム
US9069827B1 (en) * 2012-01-17 2015-06-30 Amazon Technologies, Inc. System and method for adjusting membership of a data replication group
US8843441B1 (en) 2012-01-17 2014-09-23 Amazon Technologies, Inc. System and method for maintaining a master replica for reads and writes in a data store
US9230000B1 (en) * 2012-06-04 2016-01-05 Google Inc. Pipelining Paxos state machines
US8965921B2 (en) * 2012-06-06 2015-02-24 Rackspace Us, Inc. Data management and indexing across a distributed database
JP6028641B2 (ja) * 2013-03-21 2016-11-16 富士通株式会社 情報処理システム、情報処理装置の制御プログラム及び情報処理システムの制御方法
US9569513B1 (en) * 2013-09-10 2017-02-14 Amazon Technologies, Inc. Conditional master election in distributed databases
CN106062717B (zh) * 2014-11-06 2019-05-03 华为技术有限公司 一种分布式存储复制系统和方法
JP2016177578A (ja) * 2015-03-20 2016-10-06 株式会社日立製作所 管理システム、サーバ装置、およびデータ管理方法
US10623486B2 (en) 2015-06-15 2020-04-14 Redis Labs Ltd. Methods, systems, and media for providing distributed database access during a network split
EP3193256B1 (en) * 2016-01-12 2018-08-01 Politechnika Poznanska A fault-tolerant data processing computer system and method for implementing a distributed two-tier state machine
US20200019476A1 (en) * 2018-07-11 2020-01-16 EMC IP Holding Company LLC Accelerating Write Performance for Microservices Utilizing a Write-Ahead Log

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR20130048093A (ko) * 2011-11-01 2013-05-09 한국전자통신연구원 분산 데이터 베이스 장치 및 그 장치에서의 스트림 데이터 처리 방법
CN104866584A (zh) * 2015-05-28 2015-08-26 交通银行股份有限公司 一种基于业务规则的数据分区方法及装置
CN107153660A (zh) * 2016-03-04 2017-09-12 福建天晴数码有限公司 分布式数据库系统的故障检测处理方法及其系统
CN107544869A (zh) * 2017-05-27 2018-01-05 新华三技术有限公司 一种数据恢复方法和装置
CN107295080A (zh) * 2017-06-19 2017-10-24 北京百度网讯科技有限公司 应用于分布式服务器集群的数据存储方法和服务器

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
储佳佳 ; 郭进伟 ; 刘柏众 ; 张晨东 ; 钱卫宁 ; .高可用数据库系统中的分布式一致性协议.华东师范大学学报(自然科学版).2016,(第05期),全文. *

Also Published As

Publication number Publication date
US10893098B2 (en) 2021-01-12
CN110874382A (zh) 2020-03-10
EP3844635A4 (en) 2022-05-18
JP2021535468A (ja) 2021-12-16
EP3844635B1 (en) 2025-05-14
WO2020046916A1 (en) 2020-03-05
US20200076890A1 (en) 2020-03-05
JP7371087B2 (ja) 2023-10-30
EP3844635A1 (en) 2021-07-07

Similar Documents

Publication Publication Date Title
US10157214B1 (en) Process for data migration between document stores
US11070979B2 (en) Constructing a scalable storage device, and scaled storage device
WO2020134615A1 (zh) 跨链存证方法及访问方法、装置、电子设备
CN108235751A (zh) 识别对象存储设备亚健康的方法、装置和数据存储系统
CN110928943B (zh) 一种分布式数据库及数据写入方法
JPWO2014007249A1 (ja) I/oノード及び複数の計算ノードに備えられたキャッシュメモリの制御方法
CN105550306A (zh) 多副本数据的读写方法及系统
CN104054076B (zh) 数据存储方法、数据库存储节点故障处理方法及装置
CN103970678B (zh) 目录设计方法及装置
CN110837499B (zh) 数据访问处理方法、装置、电子设备和存储介质
CN107391033A (zh) 数据迁移方法及装置、计算设备、计算机存储介质
CN114785662B (zh) 一种存储管理方法、装置、设备及机器可读存储介质
CN110874382B (zh) 一种数据写入方法、装置及其设备
WO2018090606A1 (zh) 数据存储方法及装置
WO2014190700A1 (zh) 一种内存访问的方法、缓冲调度器和内存模块
CN114884962A (zh) 负载均衡方法及装置和电子设备
CN110399354A (zh) 数据库的分区交换方法及装置
JP2021508867A (ja) データベースをクエリするためのシステム、方法および装置
CN107493309B (zh) 一种分布式系统中的文件写入方法及装置
CN108595482A (zh) 一种数据索引方法及装置
CN110096355B (zh) 一种共享资源分配方法、装置和设备
CN114443598B (zh) 写数据方法、装置、计算机设备及存储介质
CN116804984B (zh) 日志流控制方法及装置
CN112596669A (zh) 一种基于分布式存储的数据处理方法及装置
CN117290354A (zh) 数据处理方法、装置、计算机设备和存储介质

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
TA01 Transfer of patent application right
TA01 Transfer of patent application right

Effective date of registration: 20210907

Address after: Room 508, floor 5, building 4, No. 699, Wangshang Road, Changhe street, Binjiang District, Hangzhou City, Zhejiang Province

Applicant after: Alibaba (China) Co.,Ltd.

Address before: A four-storey 847 mailbox in Grand Cayman Capital Building, British Cayman Islands

Applicant before: ALIBABA GROUP HOLDING Ltd.

TA01 Transfer of patent application right
TA01 Transfer of patent application right

Effective date of registration: 20211119

Address after: No.12 Zhuantang science and technology economic block, Xihu District, Hangzhou City, Zhejiang Province

Applicant after: Aliyun Computing Co.,Ltd.

Address before: 310052 room 508, 5th floor, building 4, No. 699 Wangshang Road, Changhe street, Binjiang District, Hangzhou City, Zhejiang Province

Applicant before: Alibaba (China) Co.,Ltd.

GR01 Patent grant
GR01 Patent grant