DE112018004222T5 - Datenbankaufteilung - Google Patents

Datenbankaufteilung Download PDF

Info

Publication number
DE112018004222T5
DE112018004222T5 DE112018004222.7T DE112018004222T DE112018004222T5 DE 112018004222 T5 DE112018004222 T5 DE 112018004222T5 DE 112018004222 T DE112018004222 T DE 112018004222T DE 112018004222 T5 DE112018004222 T5 DE 112018004222T5
Authority
DE
Germany
Prior art keywords
database
split
record
key
bloom filter
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
DE112018004222.7T
Other languages
German (de)
English (en)
Inventor
Claude Nelson Jr. Warren
Michael Ryan
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
International Business Machines Corp
Original Assignee
International Business Machines Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by International Business Machines Corp filed Critical International Business Machines Corp
Publication of DE112018004222T5 publication Critical patent/DE112018004222T5/de
Pending legal-status Critical Current

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/27—Replication, distribution or synchronisation of data between databases or within a distributed database system; Distributed database system architectures therefor
    • G06F16/278—Data partitioning, e.g. horizontal or vertical partitioning
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/21—Design, administration or maintenance of databases
    • G06F16/211—Schema design and management
    • G06F16/212—Schema design and management with details for data modelling support
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/22—Indexing; Data structures therefor; Storage structures
    • G06F16/2228—Indexing structures
    • G06F16/2237—Vectors, bitmaps or matrices
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/24—Querying
    • G06F16/245—Query processing
    • G06F16/2455—Query execution
    • G06F16/24553—Query execution of query operations
    • G06F16/24554—Unary operations; Data partitioning operations

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Databases & Information Systems (AREA)
  • Data Mining & Analysis (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Computing Systems (AREA)
  • Computational Linguistics (AREA)
  • Software Systems (AREA)
  • Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
DE112018004222.7T 2017-10-25 2018-10-18 Datenbankaufteilung Pending DE112018004222T5 (de)

Applications Claiming Priority (5)

Application Number Priority Date Filing Date Title
US15/793,100 US10585915B2 (en) 2017-10-25 2017-10-25 Database sharding
US15/793,100 2017-10-25
US15/813,577 2017-11-15
US15/813,577 US10592532B2 (en) 2017-10-25 2017-11-15 Database sharding
PCT/EP2018/078495 WO2019081322A1 (en) 2017-10-25 2018-10-18 BASIC PARTITIONING OF DATA

Publications (1)

Publication Number Publication Date
DE112018004222T5 true DE112018004222T5 (de) 2020-05-14

Family

ID=66169387

Family Applications (1)

Application Number Title Priority Date Filing Date
DE112018004222.7T Pending DE112018004222T5 (de) 2017-10-25 2018-10-18 Datenbankaufteilung

Country Status (6)

Country Link
US (2) US10585915B2 (https=)
JP (1) JP7046172B2 (https=)
CN (1) CN111247518B (https=)
DE (1) DE112018004222T5 (https=)
GB (1) GB2581738A (https=)
WO (1) WO2019081322A1 (https=)

Families Citing this family (22)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US10073903B1 (en) * 2017-02-27 2018-09-11 Timescale, Inc. Scalable database system for querying time-series data
US11126625B2 (en) 2019-05-31 2021-09-21 Salesforce.Com, Inc. Caching techniques for a database change stream
US10936562B2 (en) 2019-08-02 2021-03-02 Timescale, Inc. Type-specific compression in database systems
US11194773B2 (en) * 2019-09-12 2021-12-07 Oracle International Corporation Integration of existing databases into a sharding environment
CN110968265B (zh) * 2019-11-05 2023-08-08 北京字节跳动网络技术有限公司 分片扩容方法、装置及电子设备
WO2021124287A1 (en) * 2019-12-20 2021-06-24 Niantic, Inc. Sharded storage of geolocated data with predictable query response times
KR102371529B1 (ko) * 2020-02-14 2022-03-07 구글 엘엘씨 다수 당사자 도달 및 빈도 추정 보안화
US11531666B1 (en) 2020-08-20 2022-12-20 Amazon Technologies, Inc. Indexing partitions using distributed bloom filters
EP3961419A1 (en) * 2020-08-28 2022-03-02 Siemens Aktiengesellschaft Computer-implemented method for storing a dataset and computer network
CN112162981A (zh) * 2020-09-08 2021-01-01 杭州涂鸦信息技术有限公司 一种自适应的路由分库分表方法及系统
CN115461745B (zh) * 2020-10-05 2026-03-24 谷歌有限责任公司 具有计数向量的布隆过滤器的元估计的方法和系统
CN113760837B (zh) * 2020-10-27 2025-07-15 北京沃东天骏信息技术有限公司 数据写入、查询方法和装置
CN112417276A (zh) * 2020-11-18 2021-02-26 北京字节跳动网络技术有限公司 分页数据获取方法、装置、电子设备及计算机可读存储介质
CN114722360B (zh) * 2021-01-04 2024-10-18 中国移动通信有限公司研究院 水印插入方法、提取方法及装置
US11568065B2 (en) * 2021-01-15 2023-01-31 Bank Of America Corporation System for securing electronic data by aggregation of distributed electronic database entries
US11829394B2 (en) * 2021-03-11 2023-11-28 International Business Machines Corporation Soft deletion of data in sharded databases
CN114357024A (zh) * 2021-12-24 2022-04-15 南京苏宁软件技术有限公司 提升用户画像接口性能的方法、装置和计算机设备
JP7815000B2 (ja) * 2022-03-23 2026-02-17 株式会社エヌ・ティ・ティ・データ・セキスイシステムズ インデックス管理装置
CN114676139B (zh) * 2022-03-29 2025-04-18 浪潮云信息技术股份公司 一种索引数据存储方法、系统、设备及存储介质
CN115941787A (zh) * 2022-11-28 2023-04-07 北京青云科技股份有限公司 一种缓存数据访问处理方法、装置、电子设备及存储介质
CN115934761A (zh) * 2022-12-29 2023-04-07 天翼云科技有限公司 一种基于Counting布隆过滤器的数据库中间件查询优化方法
US11995084B1 (en) 2023-10-05 2024-05-28 Timescale, Inc. Database system for querying time-series data stored in a tiered storage using a cloud platform

Family Cites Families (20)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP4722620B2 (ja) * 2005-08-19 2011-07-13 Ｋｄｄｉ株式会社 暗号化文書検索方法および暗号化文書検索システム
US9275129B2 (en) 2006-01-23 2016-03-01 Symantec Corporation Methods and systems to efficiently find similar and near-duplicate emails and files
US8209178B1 (en) 2008-01-10 2012-06-26 Google Inc. Randomized language models
JP5353231B2 (ja) * 2008-12-25 2013-11-27 日本電気株式会社 情報転送装置、情報転送方法およびプログラム
US20100312749A1 (en) 2009-06-04 2010-12-09 Microsoft Corporation Scalable lookup service for distributed database
CN103488680B (zh) 2009-06-19 2017-09-29 国际商业机器公司 在数据库系统中计数项目的方法
US8996568B2 (en) * 2009-07-14 2015-03-31 Qualcomm Incorporated Methods and apparatus for efficiently processing multiple keyword queries on a distributed network
CN101916261B (zh) 2010-07-28 2013-07-17 北京播思软件技术有限公司 一种分布式并行数据库系统的数据分区方法
US8996463B2 (en) 2012-07-26 2015-03-31 Mongodb, Inc. Aggregation framework system architecture and method
US8924426B2 (en) 2011-04-29 2014-12-30 Google Inc. Joining tables in a mapreduce procedure
EP2786276A1 (en) 2011-11-30 2014-10-08 DeCarta Inc. Systems and methods for performing geo-search and retrieval of electronic point-of-interest records using a big index
EP2629212A1 (en) * 2012-02-14 2013-08-21 Alcatel Lucent Method for storing and searching tagged content items in a distributed system
US8856234B2 (en) 2013-02-28 2014-10-07 Workiva Llc System and method for performing distributed asynchronous calculations in a networked environment
US9507824B2 (en) * 2014-08-22 2016-11-29 Attivio Inc. Automated creation of join graphs for unrelated data sets among relational databases
US9875263B2 (en) 2014-10-21 2018-01-23 Microsoft Technology Licensing, Llc Composite partition functions
US9727275B2 (en) 2014-12-02 2017-08-08 International Business Machines Corporation Coordinating storage of data in dispersed storage networks
US20160328429A1 (en) 2015-03-17 2016-11-10 Cloudera, Inc. Mutations in a column store
US9886441B2 (en) 2015-04-06 2018-02-06 Sap Se Shard aware near real time indexing
US11210279B2 (en) 2016-04-15 2021-12-28 Apple Inc. Distributed offline indexing
US10430598B2 (en) * 2017-06-08 2019-10-01 The Government Of The United States, As Represented By The Secretary Of The Army Secure generalized bloom filter

Also Published As

Publication number Publication date
GB2581738A (en) 2020-08-26
JP2021500649A (ja) 2021-01-07
GB202007157D0 (en) 2020-07-01
US10585915B2 (en) 2020-03-10
US10592532B2 (en) 2020-03-17
CN111247518A (zh) 2020-06-05
CN111247518B (zh) 2024-05-14
JP7046172B2 (ja) 2022-04-01
US20190121902A1 (en) 2019-04-25
US20190121901A1 (en) 2019-04-25
WO2019081322A1 (en) 2019-05-02

Similar Documents

Publication Publication Date Title
DE112018004222T5 (de) Datenbankaufteilung
DE112012005533B4 (de) Unterstützende Abfrage und ein Abfragen
DE112019001480B4 (de) Automatisches Optimieren der Ressourcennutzung in einemZieldatenbankverwaltungssystem zum Erhöhen der Arbeitslastleistung
DE112012005037B4 (de) Verwalten von redundanten unveränderlichen Dateien unter Verwendung von Deduplizierungen in Speicher-Clouds
DE60118973T2 (de) Verfahren zum abfragen einer struktur komprimierter daten
DE202015009874U1 (de) Implementierung semistrukturierter Daten als ein Datenbankelement erster Klasse
DE112017006106T5 (de) Erzeugen von, Zugreifen auf und Anzeigen von Abstammungsmetadaten
DE102013206281A1 (de) Optimieren von zerstreuten schemalosen Daten in relationalen Speichern
DE112014001361T5 (de) Verfahren, Vorrichtung und computerlesbares Medium für effiziente Ausführung von Operationen an individuellen Datenwerten
DE102016216843A1 (de) Verteiltes Zusammenführen von Dateien
DE202012013432U1 (de) Speichern von Daten auf Speicherknoten
DE202012013462U1 (de) Datenverarbeitung in einem Mapreduce-Framework
DE112011100618T5 (de) Verwalten von Schreiboperationen auf einen Speicherbereich von Spuren, der zwischen Speichereinheiten verlagert wird
DE202010018481U1 (de) Asynchroner verteilter Objekt-Upload für replizierte Assoziativspeichercluster
DE102017207686A1 (de) Einblicke in die belegschaftsstrategie
DE112019000206T5 (de) Dynamisches Erstellen und Konfigurieren eines Lernmodells für Dialogagenten
DE112018004462T5 (de) Abfrageverarbeitung
DE112013003300B4 (de) Schrittweise Vorbereitung von Videos auf die Lieferung
DE112017007656T5 (de) Verschobene aktualisierung von datenbank-hashcode in einer blockchain
DE202015009292U1 (de) Erzeugung eines Aktivitätsflusses
DE112021006604T5 (de) Dynamisches in-rangordnung-bringen von facetten
DE112013001751T5 (de) Hybride Adressumsetzung
DE202015104128U1 (de) Datenzugriffssystem
DE112016000776T5 (de) Effiziente Durchführung von Einfüge- und Punktabfrage-Operationen in einem Spaltenspeicher
DE112018000456T5 (de) Verwalten von umfangreichen Zuordnungsgruppen unter Verwendung von optimierten Bitmap-Darstellungen

Legal Events

Date Code Title Description
R012 Request for examination validly filed
R079 Amendment of ipc main class

Free format text: PREVIOUS MAIN CLASS: G06F0017300000

Ipc: G06F0016220000

R079 Amendment of ipc main class

Free format text: PREVIOUS MAIN CLASS: G06F0016220000

Ipc: G06F0016270000

R016 Response to examination communication
R084 Declaration of willingness to licence