CN107408128B - 用于使用高速缓存和碎片拓扑提供对分片数据库的访问的系统和方法 - Google Patents

用于使用高速缓存和碎片拓扑提供对分片数据库的访问的系统和方法 Download PDF

Info

Publication number
CN107408128B
CN107408128B CN201680014244.2A CN201680014244A CN107408128B CN 107408128 B CN107408128 B CN 107408128B CN 201680014244 A CN201680014244 A CN 201680014244A CN 107408128 B CN107408128 B CN 107408128B
Authority
CN
China
Prior art keywords
database
shard
connection
client application
pool
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201680014244.2A
Other languages
English (en)
Chinese (zh)
Other versions
CN107408128A (zh
Inventor
V·赫格德
J·德拉瓦瑞恩
D·萨博
M·迪尔曼
L·诺瓦克
胡维
A·施瓦鲁德拉艾哈
周彤
I·塔拉努维
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Oracle International Corp
Original Assignee
Oracle International Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Oracle International Corp filed Critical Oracle International Corp
Publication of CN107408128A publication Critical patent/CN107408128A/zh
Application granted granted Critical
Publication of CN107408128B publication Critical patent/CN107408128B/zh
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/22—Indexing; Data structures therefor; Storage structures
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/24—Querying
    • G06F16/245—Query processing
    • G06F16/2455—Query execution
    • G06F16/24553—Query execution of query operations
    • G06F16/24554—Unary operations; Data partitioning operations
    • G06F16/24557—Efficient disk access during query execution
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/27—Replication, distribution or synchronisation of data between databases or within a distributed database system; Distributed database system architectures therefor
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/22—Indexing; Data structures therefor; Storage structures
    • G06F16/2282—Tablespace storage structures; Management thereof
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/24—Querying
    • G06F16/245—Query processing
    • G06F16/2455—Query execution
    • G06F16/24552—Database cache management
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/25—Integrating or interfacing systems involving database management systems
    • G06F16/252—Integrating or interfacing systems involving database management systems between a Database Management System and a front-end application

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Databases & Information Systems (AREA)
  • Data Mining & Analysis (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Software Systems (AREA)
  • Computational Linguistics (AREA)
  • Computing Systems (AREA)
  • Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
CN201680014244.2A 2015-04-20 2016-04-20 用于使用高速缓存和碎片拓扑提供对分片数据库的访问的系统和方法 Active CN107408128B (zh)

Applications Claiming Priority (7)

Application Number Priority Date Filing Date Title
US201562150188P 2015-04-20 2015-04-20
US201562150191P 2015-04-20 2015-04-20
US62/150,191 2015-04-20
US62/150,188 2015-04-20
US201562198958P 2015-07-30 2015-07-30
US62/198,958 2015-07-30
PCT/US2016/028420 WO2016172195A1 (en) 2015-04-20 2016-04-20 System and method for providing access to a sharded database using a cache and a shard topology

Publications (2)

Publication Number Publication Date
CN107408128A CN107408128A (zh) 2017-11-28
CN107408128B true CN107408128B (zh) 2020-12-08

Family

ID=55910387

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201680014244.2A Active CN107408128B (zh) 2015-04-20 2016-04-20 用于使用高速缓存和碎片拓扑提供对分片数据库的访问的系统和方法

Country Status (5)

Country Link
US (3) US11636075B2 (enExample)
EP (1) EP3286664B1 (enExample)
JP (1) JP6675419B2 (enExample)
CN (1) CN107408128B (enExample)
WO (1) WO2016172195A1 (enExample)

Families Citing this family (32)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US11636075B2 (en) * 2015-04-20 2023-04-25 Oracle International Corporation System and method for providing direct access to a sharded database
US10331634B2 (en) 2015-10-07 2019-06-25 Oracle International Corporation Request routing and query processing in a sharded database
CN106599711A (zh) * 2015-10-15 2017-04-26 华为技术有限公司 一种数据库访问控制方法，及装置
AU2016238870B2 (en) 2016-08-16 2019-02-14 Quintessencelabs Pty Ltd. Fault-tolerant key management system
US10997557B2 (en) 2016-10-14 2021-05-04 Slack Technologies, Inc. Method, apparatus, and computer program product for authorizing and authenticating user communication within an enterprise group-based communication platform
US10536437B2 (en) 2017-01-31 2020-01-14 Hewlett Packard Enterprise Development Lp Performing privacy-preserving multi-party analytics on vertically partitioned local data
US10565524B2 (en) * 2017-01-31 2020-02-18 Hewlett Packard Enterprise Development Lp Performing privacy-preserving multi-party analytics on horizontally partitioned local data
US10938878B2 (en) 2017-05-16 2021-03-02 Red Hat, Inc. Separate cache servers for storing objects in different dedicated size ranges
US10503714B2 (en) 2017-06-02 2019-12-10 Facebook, Inc. Data placement and sharding
US10402371B2 (en) 2017-07-20 2019-09-03 Slack Technologies, Inc. Method, apparatus and computer program product for generating externally shared communication channels
US11341093B2 (en) 2017-07-20 2022-05-24 Slack Technologies, Llc Method, apparatus and computer program product for generating externally shared communication channels
US10541825B2 (en) 2017-07-20 2020-01-21 Slack Technologies, Inc. Method, apparatus and computer program product for generating externally shared communication channels
US10810268B2 (en) * 2017-12-06 2020-10-20 Futurewei Technologies, Inc. High-throughput distributed transaction management for globally consistent sharded OLTP system and method of implementing
US10855767B1 (en) * 2018-03-05 2020-12-01 Amazon Technologies, Inc. Distribution of batch data to sharded readers
US10346378B1 (en) * 2018-11-30 2019-07-09 Slack Technologies, Inc. Data storage architecture for an enterprise communication system
US10698770B1 (en) * 2019-04-10 2020-06-30 Capital One Services, Llc Regionally agnostic in-memory database arrangements with reconnection resiliency
CN110471935B (zh) * 2019-08-15 2022-02-18 上海达梦数据库有限公司 一种数据操作的执行方法、装置、设备和存储介质
US11151124B2 (en) * 2019-09-09 2021-10-19 Oracle International Corporation Automatic derivation of shard key values and transparent multi-shard transaction and query support
US11194773B2 (en) 2019-09-12 2021-12-07 Oracle International Corporation Integration of existing databases into a sharding environment
CN111061801A (zh) * 2019-12-25 2020-04-24 天津南大通用数据技术股份有限公司 一种事务型数据库读写分离实现方法
CN111159219B (zh) * 2019-12-31 2023-05-23 湖南亚信软件有限公司 一种数据管理方法、装置、服务器及存储介质
CN111782632B (zh) * 2020-06-28 2024-07-09 百度在线网络技术（北京）有限公司 数据处理方法、装置、设备和存储介质
US20240004890A1 (en) * 2020-12-04 2024-01-04 Geun Seok KIM Data sharding system, data sharding method, and program stored in recording medium
KR102287483B1 (ko) * 2020-12-04 2021-08-06 김근석 데이터 샤딩 시스템, 데이터 샤딩 방법 및 기록 매체에 저장된 프로그램
US11310142B1 (en) * 2021-04-23 2022-04-19 Trend Micro Incorporated Systems and methods for detecting network attacks
US12079194B1 (en) * 2022-02-10 2024-09-03 Rapid7, Inc. Encoding table schema and storage metadata in a file store
US12242448B1 (en) 2022-02-10 2025-03-04 Rapid7, Inc. Columnar storage format for fast table updates
US11888929B1 (en) * 2022-11-15 2024-01-30 SimpliSafe, Inc. Load balancing device connections
KR20240077233A (ko) * 2022-11-24 2024-05-31 재단법인대구경북과학기술원 샤딩 기반의 키-값 캐싱 시스템 및 방법
US12158870B1 (en) * 2023-09-26 2024-12-03 Oracle International Corporation Heterogeneous XML document support in a sharded database
US12430212B1 (en) * 2024-04-02 2025-09-30 Rubrik, Inc. Application-aware adaptive sharding for data backup
CN118796897B (zh) * 2024-09-13 2025-02-07 数翊科技(北京)有限公司 一种基于数据库分布式通信的连接复用方法及装置

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1567301A (zh) * 2003-06-23 2005-01-19 华为技术有限公司 访问数据库的方法及装置
CN101777047A (zh) * 2009-01-08 2010-07-14 国际商业机器公司 多租户环境下访问数据库的系统、设备和方法
CN103365929A (zh) * 2012-04-10 2013-10-23 阿里巴巴集团控股有限公司 一种数据库连接的管理方法及系统
CN103605727A (zh) * 2013-11-19 2014-02-26 浪潮电子信息产业股份有限公司 基于连接池的多用户数据库访问高效率优化方法及架构

Family Cites Families (20)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CA2744925C (en) 2003-04-08 2014-06-03 Grant L. Hutchison Method and system for executing a database query
US7953860B2 (en) 2003-08-14 2011-05-31 Oracle International Corporation Fast reorganization of connections in response to an event in a clustered computing system
JP2006259790A (ja) 2005-03-15 2006-09-28 Nomura Research Institute Ltd データベースを有するアプリケーションシステム、データベースのアクセス方法、及びデータベースへアクセスするためのコンピュータプログラム
US8510267B2 (en) * 2011-03-08 2013-08-13 Rackspace Us, Inc. Synchronization of structured information repositories
US8782762B2 (en) 2011-08-17 2014-07-15 International Business Machines Corporation Building data security in a networked computing environment
US8700683B2 (en) * 2011-10-24 2014-04-15 Nokia Corporation Method and apparatus for providing a key-value based storage interface
KR101365464B1 (ko) 2012-03-05 2014-02-20 네이버비즈니스플랫폼 주식회사 데이터베이스 미들웨어를 이용한 데이터 관리 시스템 및 방법
US8898109B2 (en) * 2012-07-27 2014-11-25 Microsoft Corporation Automatic transaction retry after session failure
US8838535B2 (en) * 2012-10-05 2014-09-16 Oracle International Corporation Providing services across systems that manage distributed replicas
KR101544356B1 (ko) * 2012-10-31 2015-08-13 삼성에스디에스 주식회사 메타데이터 및 트랜잭션 발생량을 고려한 동적 샤딩 기능을 지원하는 분산 데이터베이스 관리 방법 및 그 구성 노드
US9647900B2 (en) 2012-12-13 2017-05-09 Level 3 Communications, Llc Devices and methods supporting content delivery with delivery services
US9251178B2 (en) * 2013-04-26 2016-02-02 Oracle International Corporation System and method for connection labeling for use with connection pools
US9747341B2 (en) 2013-06-06 2017-08-29 Oracle International Corporation System and method for providing a shareable global cache for use with a database environment
US9813516B2 (en) * 2014-02-18 2017-11-07 Salesforce.Com, Inc. Transparent sharding of traffic across messaging brokers
US10025710B2 (en) * 2014-04-30 2018-07-17 Walmart Apollo, Llc Pattern for integrating primary and secondary data stores in a sharded data domain
US10043208B2 (en) 2014-05-30 2018-08-07 Walmart Apollo, Llc Smart order management and database sharding
US9817726B2 (en) * 2015-01-09 2017-11-14 Ariba, Inc. Delta replication of index fragments to enhance disaster recovery
US11636075B2 (en) * 2015-04-20 2023-04-25 Oracle International Corporation System and method for providing direct access to a sharded database
US10331634B2 (en) * 2015-10-07 2019-06-25 Oracle International Corporation Request routing and query processing in a sharded database
CN105673010B (zh) 2016-03-08 2017-12-05 中煤张家口煤矿机械有限责任公司 一种用于刨煤机的调向装置及调向方法

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1567301A (zh) * 2003-06-23 2005-01-19 华为技术有限公司 访问数据库的方法及装置
CN101777047A (zh) * 2009-01-08 2010-07-14 国际商业机器公司 多租户环境下访问数据库的系统、设备和方法
CN103365929A (zh) * 2012-04-10 2013-10-23 阿里巴巴集团控股有限公司 一种数据库连接的管理方法及系统
CN103605727A (zh) * 2013-11-19 2014-02-26 浪潮电子信息产业股份有限公司 基于连接池的多用户数据库访问高效率优化方法及架构

Also Published As

Publication number Publication date
JP6675419B2 (ja) 2020-04-01
EP3286664A1 (en) 2018-02-28
JP2018514028A (ja) 2018-05-31
WO2016172195A1 (en) 2016-10-27
CN107408128A (zh) 2017-11-28
US20200125546A1 (en) 2020-04-23
US20160306832A1 (en) 2016-10-20
US11409721B2 (en) 2022-08-09
EP3286664B1 (en) 2021-10-13
US20160306854A1 (en) 2016-10-20
US10545935B2 (en) 2020-01-28
US11636075B2 (en) 2023-04-25

Similar Documents

Publication Publication Date Title
CN107408128B (zh) 用于使用高速缓存和碎片拓扑提供对分片数据库的访问的系统和方法
JP7309005B2 (ja) データベーステナントマイグレーションのシステム及び方法
US10635649B2 (en) Systems, methods, and media for managing an in-memory NoSQL database
US8954391B2 (en) System and method for supporting transient partition consistency in a distributed data grid
US10742748B2 (en) System and method for supporting live addition of a tenant in a connection pool environment
JP7336554B2 (ja) マルチテナント・データベース環境においてテナントの動的再配置を提供するためのシステムおよび方法
US20130191523A1 (en) Real-time analytics for large data sets
US20230171163A1 (en) Online restore to different topologies with custom data distribution
US8954478B2 (en) Systems, methods, and media for managing RAM resources for in-memory NoSQL databases
CN110633378A (zh) 一种支持超大规模关系网络的图数据库构建方法
CN108959538B (zh) 全文检索系统及方法
US11734229B2 (en) Reducing database fragmentation
CN105677761A (zh) 一种数据切分的方法及系统
US11290540B2 (en) System and method for use of server-side connection pool tagging in a multi-tenant environment
US20180276267A1 (en) Methods and system for efficiently performing eventual and transactional edits on distributed metadata in an object storage system
CN112905601A (zh) 一种数据库分表的路由方法及装置
US11768853B2 (en) System to copy database client data
US9292559B2 (en) Data distribution/retrieval using multi-dimensional index
WO2014180395A1 (zh) 海量数据融合存储方法及系统
Cao et al. Efficient and Flexible Index Access in MapReduce.
KR20250093808A (ko) 스토리지 서버 및 스토리지 서버의 데이터 입출력 방법
WO2016148680A1 (en) Method and apparatus for key-value-store de-duplication leveraging relational database configuration

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant