CN106030573A - 半结构化数据作为第一等级数据库元素的实现 - Google Patents

半结构化数据作为第一等级数据库元素的实现 Download PDF

Info

Publication number
CN106030573A
CN106030573A CN201580009233.0A CN201580009233A CN106030573A CN 106030573 A CN106030573 A CN 106030573A CN 201580009233 A CN201580009233 A CN 201580009233A CN 106030573 A CN106030573 A CN 106030573A
Authority
CN
China
Prior art keywords
data
data element
semi
structured
row
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN201580009233.0A
Other languages
English (en)
Other versions
CN106030573B (zh
Inventor
本诺特·戴奇维勒
瓦迪姆·安东诺夫
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Snowflake Co
Original Assignee
Snow Flake Computing
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Snow Flake Computing filed Critical Snow Flake Computing
Publication of CN106030573A publication Critical patent/CN106030573A/zh
Application granted granted Critical
Publication of CN106030573B publication Critical patent/CN106030573B/zh
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F9/00Arrangements for program control, e.g. control units
    • G06F9/06Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
    • G06F9/46Multiprogramming arrangements
    • G06F9/50Allocation of resources, e.g. of the central processing unit [CPU]
    • G06F9/5005Allocation of resources, e.g. of the central processing unit [CPU] to service a request
    • G06F9/5011Allocation of resources, e.g. of the central processing unit [CPU] to service a request the resources being hardware resources other than CPUs, Servers and Terminals
    • G06F9/5016Allocation of resources, e.g. of the central processing unit [CPU] to service a request the resources being hardware resources other than CPUs, Servers and Terminals the resource being the memory
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/27Replication, distribution or synchronisation of data between databases or within a distributed database system; Distributed database system architectures therefor
    • G06F16/273Asynchronous replication or reconciliation
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61FFILTERS IMPLANTABLE INTO BLOOD VESSELS; PROSTHESES; DEVICES PROVIDING PATENCY TO, OR PREVENTING COLLAPSING OF, TUBULAR STRUCTURES OF THE BODY, e.g. STENTS; ORTHOPAEDIC, NURSING OR CONTRACEPTIVE DEVICES; FOMENTATION; TREATMENT OR PROTECTION OF EYES OR EARS; BANDAGES, DRESSINGS OR ABSORBENT PADS; FIRST-AID KITS
    • A61F5/00Orthopaedic methods or devices for non-surgical treatment of bones or joints; Nursing devices; Anti-rape devices
    • A61F5/56Devices for preventing snoring
    • A61F5/566Intra-oral devices
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/10File systems; File servers
    • G06F16/11File system administration, e.g. details of archiving or snapshots
    • G06F16/128Details of file system snapshots on the file-level, e.g. snapshot creation, administration, deletion
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/10File systems; File servers
    • G06F16/14Details of searching files based on file metadata
    • G06F16/148File search processing
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/10File systems; File servers
    • G06F16/18File system types
    • G06F16/182Distributed file systems
    • G06F16/1824Distributed file systems implemented using Network-attached Storage [NAS] architecture
    • G06F16/1827Management specifically adapted to NAS
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/21Design, administration or maintenance of databases
    • G06F16/211Schema design and management
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/22Indexing; Data structures therefor; Storage structures
    • G06F16/221Column-oriented storage; Management thereof
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/23Updating
    • G06F16/2365Ensuring data consistency and integrity
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/24Querying
    • G06F16/245Query processing
    • G06F16/2453Query optimisation
    • G06F16/24532Query optimisation of parallel queries
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/24Querying
    • G06F16/245Query processing
    • G06F16/2453Query optimisation
    • G06F16/24534Query rewriting; Transformation
    • G06F16/24542Plan optimisation
    • G06F16/24545Selectivity estimation or determination
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/24Querying
    • G06F16/245Query processing
    • G06F16/2455Query execution
    • G06F16/24552Database cache management
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/24Querying
    • G06F16/245Query processing
    • G06F16/2455Query execution
    • G06F16/24553Query execution of query operations
    • G06F16/24558Binary matching operations
    • G06F16/2456Join operations
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/24Querying
    • G06F16/245Query processing
    • G06F16/2458Special types of queries, e.g. statistical queries, fuzzy queries or distributed queries
    • G06F16/2471Distributed queries
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/25Integrating or interfacing systems involving database management systems
    • G06F16/254Extract, transform and load [ETL] procedures, e.g. ETL data flows in data warehouses
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/27Replication, distribution or synchronisation of data between databases or within a distributed database system; Distributed database system architectures therefor
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/28Databases characterised by their database models, e.g. relational or object models
    • G06F16/283Multi-dimensional databases or data warehouses, e.g. MOLAP or ROLAP
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/90Details of database functions independent of the retrieved data types
    • G06F16/95Retrieval from the web
    • G06F16/951Indexing; Web crawling techniques
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/90Details of database functions independent of the retrieved data types
    • G06F16/95Retrieval from the web
    • G06F16/953Querying, e.g. by the use of web search engines
    • G06F16/9535Search customisation based on user profiles and personalisation
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/90Details of database functions independent of the retrieved data types
    • G06F16/95Retrieval from the web
    • G06F16/953Querying, e.g. by the use of web search engines
    • G06F16/9538Presentation of query results
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F9/00Arrangements for program control, e.g. control units
    • G06F9/06Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
    • G06F9/46Multiprogramming arrangements
    • G06F9/48Program initiating; Program switching, e.g. by interrupt
    • G06F9/4806Task transfer initiation or dispatching
    • G06F9/4843Task transfer initiation or dispatching by program, e.g. task dispatcher, supervisor, operating system
    • G06F9/4881Scheduling strategies for dispatcher, e.g. round robin, multi-level priority queues
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F9/00Arrangements for program control, e.g. control units
    • G06F9/06Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
    • G06F9/46Multiprogramming arrangements
    • G06F9/50Allocation of resources, e.g. of the central processing unit [CPU]
    • G06F9/5005Allocation of resources, e.g. of the central processing unit [CPU] to service a request
    • G06F9/5027Allocation of resources, e.g. of the central processing unit [CPU] to service a request the resource being a machine, e.g. CPUs, Servers, Terminals
    • G06F9/5044Allocation of resources, e.g. of the central processing unit [CPU] to service a request the resource being a machine, e.g. CPUs, Servers, Terminals considering hardware capabilities
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F9/00Arrangements for program control, e.g. control units
    • G06F9/06Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
    • G06F9/46Multiprogramming arrangements
    • G06F9/50Allocation of resources, e.g. of the central processing unit [CPU]
    • G06F9/5083Techniques for rebalancing the load in a distributed system
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F9/00Arrangements for program control, e.g. control units
    • G06F9/06Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
    • G06F9/46Multiprogramming arrangements
    • G06F9/50Allocation of resources, e.g. of the central processing unit [CPU]
    • G06F9/5083Techniques for rebalancing the load in a distributed system
    • G06F9/5088Techniques for rebalancing the load in a distributed system involving task migration
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00Network arrangements or protocols for supporting network services or applications
    • H04L67/01Protocols
    • H04L67/10Protocols in which an application is distributed across nodes in the network
    • H04L67/1095Replication or mirroring of data, e.g. scheduling or transport for data synchronisation between network nodes
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00Network arrangements or protocols for supporting network services or applications
    • H04L67/01Protocols
    • H04L67/10Protocols in which an application is distributed across nodes in the network
    • H04L67/1097Protocols in which an application is distributed across nodes in the network for distributed storage of data in networks, e.g. transport arrangements for network file system [NFS], storage area networks [SAN] or network attached storage [NAS]
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00Network arrangements or protocols for supporting network services or applications
    • H04L67/50Network services
    • H04L67/56Provisioning of proxy services
    • H04L67/568Storing data temporarily at an intermediate stage, e.g. caching

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Databases & Information Systems (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Data Mining & Analysis (AREA)
  • Software Systems (AREA)
  • Health & Medical Sciences (AREA)
  • Computational Linguistics (AREA)
  • Signal Processing (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Computing Systems (AREA)
  • Animal Behavior & Ethology (AREA)
  • Nursing (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Heart & Thoracic Surgery (AREA)
  • General Health & Medical Sciences (AREA)
  • Public Health (AREA)
  • Veterinary Medicine (AREA)
  • Biomedical Technology (AREA)
  • Orthopedic Medicine & Surgery (AREA)
  • Vascular Medicine (AREA)
  • Pulmonology (AREA)
  • Otolaryngology (AREA)
  • Library & Information Science (AREA)
  • Computer Security & Cryptography (AREA)
  • Fuzzy Systems (AREA)
  • Mathematical Physics (AREA)
  • Probability & Statistics with Applications (AREA)
  • Operations Research (AREA)
  • Information Retrieval, Db Structures And Fs Structures Therefor (AREA)

Abstract

用于管理半结构化数据系统的数据存储和数据访问的系统、设备和方法。

Description

半结构化数据作为第一等级数据库元素的实现
相关申请的交叉引用
本申请要求标题为“Apparatus and method for enterprise data warehousedata processing on cloud infrastructure”的且于2014年2月19日提交的美国临时专利申请序列号61/941,986的利益,该公开通过引用被全部并入本文。
技术领域
本公开涉及管理数据存储和计算资源的资源管理系统和方法。
背景
在今天,许多现有的数据存储和取回系统是可用的。例如,在共享盘系统中,所有的数据被储存在从数据群集中的所有处理节点可访问的共享存储设备上。在这种类型的系统中,所有的数据变化被写入共享存储设备以确保数据群集中的所有处理节点访问数据的一致的版本。随着共享盘系统中的处理节点的数量增加,共享存储设备(和处理节点和共享存储设备之间的通信链路)变成减慢数据读操作和数据写操作的瓶颈。随着更多的处理节点的添加,这个瓶颈进一步恶化。因此,由于这个瓶颈问题,现有的共享盘系统具有受限的可缩放性。
另一种现有的数据存储和取回系统被称为“无共享架构”。在这种架构中,数据被分布在多个处理节点之间,使得每个节点在整个数据库中储存数据的子集。当新的处理节点被添加或移除时,无共享架构必须在多个处理节点之间重新布置数据。数据的这种重新布置可以是耗时的并且对数据重新布置期间执行的数据读和写操作是破坏性的。并且,数据与特殊节点的相关性可在数据群集上创建用于常用数据的“热点”。此外,因为每个处理节点也执行存储功能,这个架构需要至少一个处理节点以储存数据。因此,如果所有处理节点被移除,则无共享架构无法储存数据。另外,由于数据在许多不同处理节点之间的分布,在无共享架构中的数据的管理是复杂的。
本文描述的系统和方法提供缓和现有系统的以上明确的限制的数据存储和数据取回的改进的方法。
附图简述
本公开的非限制和非穷举实施方式参考下面的附图描述,其中,除非以其它方式说明,贯穿各种图形中的相似的参考数字指相似的部件。
图1示出描绘半结构化数据的处理的信息流和关系图。
图2示出描绘本文公开的方法的实现的过程流程图。
图3示出描绘根据本公开的教导的操作环境的实施方式的框图。
图4示出描绘根据本公开的教导的资源管理器的实现的示例的框图。
图5示出描绘根据本公开的教导的执行平台的实现的示例的框图。
图6示出描绘根据本公开的教导的示例计算设备的框图。
详细描述
本文公开的是用于管理半结构化数据的方法、设备和系统。例如,用于管理半结构化数据的方法的实现接收来自半结构化数据源的半结构化数据元素,并且可在半结构化数据元素被添加到数据库时实施对他们的集合的统计分析。来自半结构化数据内的公共数据元素可被识别并根据公共性阈值被分配为第一等级数据和/或次要等级数据。实现还可将来自半结构化数据源的公共数据元素合并到储存在缓存存储器中的单独的伪列,并且然后使对应于第一等级数据元素的伪列的元数据和统计信息对基于计算机的查询生成器可用。
在下面的说明书中,参考形成其一部分的附图,并且其中通过说明公开内容可被实践的特定的示例性实施方式的方式示出。这些实施方式以足够的细节来描述以使本领域中的技术人员能够实践本文公开的概念,并且应理解的是可以对各种公开的实施方式做出修改,并且其它实施方式可被利用,而不脱离本公开的范围。因此,下面的详细描述不被是限制性意义的。
本说明书通篇对“一个实施方式”、“实施方式”、“一个示例”或“示例”的引用是指结合实施方式或示例的特殊的特征、结构或特性被包括在本公开的至少一个实施方式中。因此,短语“在一个实施方式中”、“在实施方式中”、“一个示例”或“示例”在贯穿本说明书的各个位置的出现不必所有都指相同的实施方式或示例。此外,应认识到,此处的附图是出于说明的目的提供给本领域中的普通技术人员并且附图不必按照比例绘制。
根据本公开的实施方式可被实现为设备、方法或计算机程序产品。因此,本公开的方面可采用完全硬件组合的实施方案、完全软件组合的实施方案(包括固件、驻留软件、微代码等等)或组合软件和硬件方面的实施方案的形式,这些实施方案可在本文中被全部统称为“电路”、“模块”或“系统”。此外,本公开的实施方案可采用计算机程序产品的形式,该计算机程序产品以具有嵌入在介质中的可用程序代码的任何有形介质的形式实施。
一个或多个计算机可用或计算机可读介质的任意组合可被利用。例如,计算机可读介质可包括便携式计算机磁盘、硬盘、随机存取存储器(RAM)设备、只读存储器(ROM)设备、可擦除可编程只读存储器(EPROM或闪存)设备、便携式光盘只读存储器(CDROM)、光存储设备和磁存储设备。用于实现本公开的操作的计算机程序代码可以一个或多个编程语言的任意组合来编写。这种代码从源代码被编译成适用于代码将被执行的设备或计算机的计算机可读汇编语言或机器码。
实施方式还可在云计算环境中被实现。在本说明书和以下的权利要求书中,“云计算”可被定义为用于使能对可配置的计算资源的共享池(如,网络、服务器、存储器、应用程序和服务)的无处不在的、方便的、立即响应式的网络访问,该可配置的计算资源的共享库可经由虚拟化被快速供应并用最少的管理工作或服务提供商交互来释放并且然后相应地被缩放的模型。云模型可以由各种特性(如,立即响应式自服务、广泛的网络访问、资源合并、快速伸缩性和测量的服务)、服务模块(如,软件即服务(“SaaS”)、平台即服务(“PaaS”)以及基础结构即服务(“IaaS”))和部署模块(如,私有云、社区云、公有云和混合云)组成。
附图中的流程图和框图示出根据本文公开的各种实施方式的架构、功能和系统、方法以及计算机程序产品的可能的实现的操作。在这点上,流程图或框图中的每一个框可表示代码的模块、段或部分,其包括用于实现特定的逻辑功能的一个或多个可执行指令。还应注意到,框图和/或流程图中的每一个块以及框图和/或流程图中的块的组合可由实施指定功能或动作或专用硬件和计算机指令的专用的基于硬件的系统来实现。这些计算机程序指令还可被储存在能够知道计算机或其它可编程数据处理装置以特殊方式工作的计算机可读介质,使得储存在计算机可读介质中的指令产生包括实现在流程图和/或框图的框中指定的功能/动作的指令手段的生产的项目。
本文描述的系统和方法提供使用新的数据处理平台的灵活的和可缩放的数据仓库。在一些实施方式中,所描述的系统和方法利用支持基于云的存储资源、计算资源等的云基础结构。示例基于云的存储资源供应以低成本的按需的可用的重要的存储容量。此外,这些基于云的存储资源可以是容错和高度可缩放的,这在私有数据存储系统中实现是昂贵的。示例基于云的计算资源是按需可用的并且可基于资源的实际使用等级来定价。通常,云基础结构是以快速方式动态地部署、重配置和停用的。
在所描述的系统和方法中,数据存储系统利用基于半结构化的关系数据库。然而,这些系统和方法可应用于使用任意数据存储架构并使用任意语言在数据库内储存和取回数据的任何类型的数据库。如本文所使用的,半结构化数据意味着传达结构化数据的形式,该结构化数据的形式不符合与关系数据库相关的数据模块的典型的正式的结构,但是仍然包括标记或其它标志以分离语义元素并强制执行记录和数据的字段的层次。本文描述的系统和方法还提供多租户系统,其支持在不同的客户/客户端之间以及相同的客户/客户端内的不同用户之间的计算资源和数据的隔离。
本文公开的是显著地改进处理大量半结构化数据的数据库和数据仓库的性能的方法和系统。现有的数据库系统是关系的(即,SQL数据库)或键-值库。
关系数据库可由于查询数据访问修剪(基于关于储存在表的特定列中的值的聚合的元数据从搜索中排除数据库的部分)而实施有效的查询。然而,这需要严格的表格格式的数据,其不能用于表示半结构化数据。
另外,键-值库更灵活,但是由于缺乏修剪而引入严重的性能恶化。在现有产品和研究项目中有许多方式来将半结构化数据的处理添加到关系数据库。
1.序列化编码-半结构化数据记录被储存在列中作为序列化表示。每当一些字段的值被使用,其被提取并被转换成基本类型。这种方法是灵活的,但使得对数据的访问由修剪改进。从序列化表示的提取是昂贵的,并且需要比与常规的关系数据工作显著多的CPU时间。整个序列化数据记录必须从永久存储器读出并被处理,即使仅他们的很少的部分(诸如单一元素)在查询中被使用。
2.在引入处转换-半结构化数据在引入处被转换成关系数据。这使得对这种数据的访问和对任何其它关系数据的访问一样快,但是需要在引入处的数据结构的严格的规范,并且需要对应的数据库架构事先被完全指定。由于对改变数据库架构的需要,该方法使得用改变结构来处理数据变得非常昂贵。具有结构从记录到记录的改变的数据不能使用这种方法来处理。该转换方法必须被先验地指定,并且任何非微不足道的改变将需要重新引入原始的半结构化数据。
3.结构化数据的关系类表示等效于储存在常规关系数据库中的对象属性值三元表示。这种方法是灵活的,但实际上需要对数据子组件的访问的联合操作,这取决于数据,可能是非常慢的。
4.关系数据模块的非传统扩展,允许具有不同基数的列在反映源数据的结构中被链接。用于这种数据表示的查询方法未被很好的理解(并因此在本领域的当今状态没有有效的查询生成是可能的)。这种方法还需要输入数据以符合严格的(通过非表格的)架构,并且因此对于处理任意的半结构化数据不是足够灵活的。
所需要的是用于与半结构化数据一起工作的有效的、低成本的和易响应的系统和方法,因为它将保留半结构化数据的语义同时管理可以像更多传统数据结构一样被处理和查询的至少伪列中的数据。
在以下的公开的实现中,数据可以文件、文件的元素、文件的部分等的形式进入。文件可包括文档的集合并且数据的部分可包括文件、来自连接的多个文档和/或文档的部分。此外,在该实现中,元数据可与文件、文件的部分和数据的部分相关。
如本文所使用的,术语“公共数据元素”旨在意味着属于相同组的数据元素和逻辑地类似元素的集合。
图1示出计算机系统中的半结构化数据流的示意图,该半结构化数据流处理半结构化数据并分配等级指示到数据元素,用于增加对查询的访问。如在图中可见的,半结构化数据110可在其中包括公共和非公共数据元素。为了从半结构化数据中提取公共数据,分析统计122可针对半结构化数据运行以确定公共数据元素、非公共数据元素,并生成将被分配到每个数据元素的等级指示。另外,应注意,用户兴趣和用户请求124还可被使用以确定用于公共数据元素的等级指示。如在图中所示出的,公共数据可被储存在被称为伪列120的暂时的分列结构中并且还可根据等级指示被储存,其中,第一等级数据元素被储存用于对查询的更好的访问。未被确定为公共的数据元素可被串行地储存在“溢出”序列化数据140中。最终,用户将接收结果130以更快和更准确地从第一等级数据元素中进行查询。
在实现中,如果请求的数据元素不在伪列120中,则它可从“溢出”序列化数据140中被提取,而如果整体半结构化数据记录150被请求重构,则它可从伪列120中的第一等级数据、伪列120中的次要等级数据以及“溢出”数据140被重构并被重新序列化成原始形式。
图2示出用于处理半结构化数据并分配用于设置数据存储的优先级的数据等级的方法200的流程图。如在图中可见的,在210处,半结构化数据元素从半结构化数据源或多个半结构数据源被接收。在数据元素被接收时他们可被指示为公共和非公共。这可通过在220处在半结构化数据的集合被添加到数据库时实施他们的统计分析来实现。基于统计分析,公共数据元素可在230处被识别。在240处,公共数据元素可被分配等级指示,诸如针对被需要的或重新出现的数据分配第一等级,针对较少被需要的和较少出现的数据元素分配次要等级指示。实施方法200的指令的系统还可根据公共性阈值在240处将来自半结构化数据的第一等级数据元素的存储合并在单独的伪列中,同时非公共数据元素在250处被储存在“溢出”序列化存储器中。例如,公共性阈值可基于数据元素出现在半结构化数据中的次数或可基于搜寻该数据的用户查询的数量。这些元素可从半结构化数据提取并被单独地储存在对用户不可见的分列格式中。在260处,第一等级数据由于其被需要性可被储存在快速存取缓存存储器中的伪列中,将认识到的是,这些伪列的元数据和统计信息(诸如最小和最大值、不同值的数量等)可然后在270处对查询生成器可用。注意到单独的集合(即储存在单独文件中的表的部分)可具有数据元素被提取的不同子集。
如在图2中可见的,数据元素的公共性指示和等级分配可被重复,以便确保半结构化数据元素的数据库保持最新以用于查询。
在实现中,当提取数据时,如果需要公共数据元素的值,则它可使用有效的分列访问直接从对应的伪列获得。
在实现中,公共数据元素可在任何时间被添加到第一等级指示,并且同样地,数据元素可在他们被发现为较少被需要或较少被表示时丢失第一等级指示。
对于用户,该方法与储存序列化记录不能区别,并在独立的数据记录的结构上没有强加限制。然而,因为大部分公共数据元素以与传统的关系数据相同的方式被储存,对他们的访问被提供并且不需要整体半结构化记录的读取和提取,因此得到传统关系数据库的速度优势。
因为半结构化数据的不同集合(来自相同的表格)可使数据元素的不同组被提取,查询生成器和修剪应能够与部分可用的元数据(即表格的部分可使元数据和统计信息对特定的数据元素可用,而其它部分可能缺乏它)一起工作。
优于现有技术的优点是由该方法提供的用于使用混合数据存储表示(作为较少的公共元素的序列化存储和公共元素的分列存储)的能力。这允许用户使用序列化表示和由传统关系数据库提供的数据查询的高性能来实现灵活性和储存系统的任意的半结构化数据的能力。
本领域中的那些技术人员将认识到,任何数据处理平台可使用本方法来处理半结构化数据。它不需要被限制到运行SQL的DBMS系统。
在图3中示出的是用于运行本文公开的方法的计算机系统。如在图3中所示出的,资源管理器302被耦合到多个用户304、306和308。在特定的实现中,资源管理器302可支持要求访问数据处理平台300的任意数量的用户。用户304-308可包括,例如,提供数据存储和取回请求的终端用户、管理本文描述的系统和方法的系统管理员、与数据库交互的软件应用以及与资源管理器302交互的其它组件/设备。资源管理器302提供支持在数据处理平台300内的所有系统和组件的操作的各种服务和功能。资源管理器302还被耦合到元数据310,其与贯穿数据处理平台300储存的数据的整体相关。因为资源管理器与对应于文件集的元数据耦合,所以元数据可被用于生成用户查询。在一些实施方式中,元数据310包括储存在远程数据存储系统的数据以及本地缓存可用的数据的概略。另外,元数据310可包括关于数据在远程数据存储系统和本地缓存中是如何组织的信息。元数据310允许系统和服务确定数据片是否需要被处理而不加载或访问来自存储器设备的实际数据。
资源管理器302还被耦合到执行平台312,其提供执行各种数据存储和数据取回功能任务的多个计算资源,如在下面更详细地讨论的。执行平台312被耦合到为存储平台314的部分的多个数据存储设备316、318和320。尽管三个数据存储设备316、318和320在图3中被示出,执行平台312能够与任意数量的数据存储设备通信。在一些实施方式中,数据存储设备316、318和320是位于一个或多个地理位置中的基于云的存储设备。例如,数据存储设备316、318和320可以是公共云基础结构的部分或私有云基础结构。数据存储设备316、318和320可以是硬盘驱动器(HDD)、固态硬盘(SSD)、存储器群集或其它数据存储技术。另外,存储平台314可包括分布式文件系统(诸如Hadoop分布式文件系统(HDFS))、对象存储系统等。
在特定的实施方式中,资源管理器302和用户304-308、元数据310以及执行平台312之间的通信链路经由一个或多个数据通信网络被实现。类似地,执行平台312和存储平台314中的数据存储设备316-320之间的通信链路经由一个或多个数据通信网络被实现。这些数据通信网络可利用任意通信协议和任意类型的通信介质。在一些实施方式中,数据通信网络是耦合到彼此的一个或多个数据通信网络(或子网络)的组合。在可选的实施方式中,这些通信链路使用任意类型的通信介质和任意通信协议被实现。
如在图3中所示的,数据存储设备316、318和320从与执行平台312相关的计算资源被解耦。基于改变数据存储/取回需求以及访问数据处理平台300的用户和系统的改变需求,该架构支持到数据处理平台300的动态改变。动态改变的支持允许数据处理平台300快速缩放以响应于数据处理平台300内的系统和组件的改变需求。计算资源从数据存储设备的解耦支持数据的大量的存储,而不需要对应的大量的计算资源。类似地,资源的解耦支持在特定时间处利用的计算资源的显著增加,而不需要在可用的数据存储资源中的对应的增加。
资源管理器302、元数据310、执行平台312和存储平台314在图3中被示出为单独的组件。然而,资源管理器302、元数据310、执行平台312和存储平台314中的每个可被实现为分布式系统(如,分布在多个地理位置处的多个系统/平台之间)。另外,资源管理器302、元数据310、执行平台312和存储平台314中的每个根据到接收自用户304-308的请求的改变和数据处理平台300的改变需求可(独立于彼此地)被放大或缩小。因此,在所描述的实施方式中,数据处理平台300是动态的并支持定期改变以满足当前的数据处理需求。
图4是描绘资源管理器302的实施方式的框图。如在图3中所示出的,资源管理器302包括耦合到数据存储设备406的访问管理器402和密钥管理器404。访问管理器402处理用于本文描述的系统的认证和授权任务。密钥管理器404管理在认证和授权任务期间使用的密钥的存储和认证。请求处理服务408管理所接收的数据存储请求和数据取回请求。管理控制台服务410支持由管理员和其它系统管理员对各种系统和过程的访问。
资源管理器302还包括SQL编译器412、SQL优化器414和SQL执行器410。SQL编译器412解析SQL查询并生成用于查询的执行代码。SQL优化器414基于需要被处理的数据确定执行查询的最好的方法。SQL执行器416执行用于由资源管理器302接收的请求的请求代码。查询调度器和协调器418将所接收的请求发送到合适的服务或系统用于编译、优化和到执行平台的调度。虚拟仓库管理器420管理在执行平台中实现的多个虚拟仓库的操作。
另外,资源管理器302包括配置和元数据管理器422,其管理与储存在远程数据存储设备中和本地缓存中的数据相关的信息。监测器和工作负载分析器424监督由资源管理器302实施的过程并管理任务(如工作负载)在虚拟仓库和执行平台中的执行节点之间的分布。配置和元数据管理器422以及监测器和工作负载分析器424被耦合到数据存储设备426。
资源管理器302还包括交易管理和访问控制模块428,其管理与数据存储请求和数据访问请求的处理相关的各种任务和其它活动。例如,交易管理和访问控制模块428提供多个用户或系统对数据的一致的和同步的访问。由于多个用户/系统可同时访问相同的数据,对数据的改变必须被同步以确保每个用户/系统工作在数据的当前版本。交易管理和访问控制模块428提供对资源管理器302中的单一的、集中的位置处的各种数据处理活动的控制。
图5是描绘执行平台的实施方式的框图。如在图5中所示出的,执行平台512包括多个虚拟仓库502、504和506。每个虚拟仓库包括多个执行节点,其每个包括缓存和处理器。尽管在图5中示出的每个虚拟仓库502-506包括三个执行节点,特定的虚拟仓库可包括任意数量的执行节点。此外,在虚拟仓库中的执行节点的数量是动态的,使得当出现额外的需求时,新的执行节点可被创建,并且当他们不再被需要时,现有的执行节点被删除。
每个虚拟仓库502-506能够访问图3中示出的任何数据存储设备316-320。因此,虚拟仓库502-506不必被分配到数据存储设备316-320,并且相反可访问来自任何数据存储设备316-320的数据。类似地,在图5中示出的执行节点中的每个可访问来自任何数据存储设备316-320的数据。在一些实施方式中,特定的虚拟仓库或特定的执行节点可被暂时分配到特定的数据存储设备,但是虚拟仓库或执行节点可随后访问来自任何其它数据存储设备的数据。
在图5的示例中,虚拟仓库502包括三个执行节点508、510和512。执行节点508包括缓存514和处理器516。执行节点510包括缓存518和处理器520。执行节点512包括缓存522和处理器524。每个执行节点508-512与处理一个或多个数据存储和/或数据取回任务相关。例如,特定的虚拟仓库可处理与特定用户或客户相关的数据存储和数据取回任务。在其它实现中,特定的虚拟仓库可处理与特定的数据存储系统或数据的特定类别相关的数据存储和数据取回任务。
类似于上面讨论的虚拟仓库502,虚拟仓库504包括三个执行节点526、528和530。执行节点526包括缓存532和处理器534。执行节点528包括缓存536和处理器538。执行节点530包括缓存540和处理器542。另外,虚拟仓库506包括三个执行节点544、546和548。执行节点544包括缓存550和处理器552。执行节点546包括缓存554和处理器556。执行节点548包括缓存558和处理器560。
尽管在图5中示出的执行节点每个包括一个缓存和一个处理器,可选的实施方案可包括包含任意数量的处理器和任意数量的缓存的执行节点。另外,在不同的执行节点之间,缓存可在尺寸上可变化。在图5中示出的缓存在本地执行节点中储存数据,该数据从存储平台314(图3)中的一个或多个数据存储设备取回。因此,缓存减少或消除出现在一致地从远程存储系统取回数据的平台中的瓶颈问题。代替从远程存储设备重复地访问数据,本文描述的系统和方法从执行节点中的缓存访问数据,这显著地更快并避免上面讨论的瓶颈问题。在一些实施方式中,缓存使用提供对缓存数据的快速访问的高速存储器设备来实现。每个缓存可储存来自存储平台314中的任意存储设备的数据。
此外,缓存资源和计算资源可在不同的执行节点之间切换。例如,一个执行节点可包含相当多的计算资源和最小的缓存资源,使执行节点对需要相当多的计算资源的任务有用。另一个执行节点可包含相当多的缓存资源和最小的计算资源,使该执行节点对需要数据的大量的缓存的任务有用。在一些实施方式中,当执行节点基于由该执行节点实施的期望的任务被创建时,与特定的执行节点相关的缓存资源和计算资源被确定。
另外,与特定的执行节点相关的缓存资源和计算资源被可基于改变由执行节点实施的任务而随时间改变。例如,如果由执行节点实施的任务变得更处理器密集,则该特定的执行节点可被分配更多的处理资源。类似地,如果由执行节点实施的任务需要更大的缓存容量,则该执行节点可被分配更多的缓存资源。
尽管虚拟仓库502-506与图3的相同的执行平台312相关,虚拟仓库可使用多个地理位置处的多个计算系统来实现。例如,虚拟仓库502可由处于从第一地理位置处的计算系统实现,而虚拟仓库504和506由处于第二地理位置处的另一个计算系统来实现。在一些实施方式中,这些不同的计算系统是由一个或多个不同的实体维护的基于云的计算系统。
另外,每个虚拟仓库在图5中被示出为具有多个执行节点。与每个虚拟仓库相关的多个执行节点可使用处于多个地理位置的多个计算系统实现。例如,虚拟仓库502的特定实例实现在特定地理位置处的一个计算平台上的执行节点508和510,并在另一个地理位置处的不同的计算平台处实现执行节点512。选择特定的计算系统以实现执行节点可取决于各种因素,诸如特定执行节点所需要的资源的等级(如,处理资源需求和缓存需求)、在特定计算系统处可用的资源、在地理位置内或地理位置之间的网络的通信能力以及哪个计算系统已经实施在虚拟仓库中的其它执行节点。执行平台312也是容错的。例如,如果一个虚拟仓库故障,该虚拟仓库被快速地用不同地理位置处的不同的虚拟仓库代替。
特定的执行平台312可包括任意数量的虚拟仓库502-506。另外,在特定执行平台中的虚拟仓库的数量是动态的,使得当额外的处理和/或缓存资源被需要时新的虚拟仓库被创建。类似地,当与虚拟仓库相关的资源不再必要时,现有的虚拟仓库可被删除。
图6是描绘示例计算设备600的框图。在一些实施方式中,计算设备600被用于实现本文讨论的一个或多个系统和组件。例如,计算设备600可允许用户或管理员访问资源管理器302。此外,计算设备600可与本文描述的任何系统和组件交互。相应地,计算设备600可用于实施各种过程和任务,诸如本文讨论的那些。计算设备600可起到服务器、客户端或任何其它计算实体的作用。计算设备600可以是任意的各种各样的计算设备,诸如台式计算机、笔记本式计算机、服务器计算机、手持计算机、平板电脑等。
计算设备600包括一个或多个处理器602、一个或多个存储器设备604、一个或多个接口606、一个或多个大容量存储设备608以及一个或多个输入/输出(I/O)设备610,这些全部被耦合到总线612。处理器602包括执行储存在存储器设备604和/或大容量存储设备608中的指令的一个或多个处理器或控制器。处理器602还可包括各种类型的计算机可读介质,诸如缓存存储器。
存储器设备604包括各种计算机可读介质,诸如易失性存储器(如,随机存取存储器(RAM))和/或非易失性存储器(如,只读存储器(ROM))。存储器设备604还可包括可重写的ROM,诸如闪存。
大容量存储设备608包括各种计算机可读介质,诸如磁带、磁盘、光盘、固态存储器(如,闪存)等。各种驱动器也可被包括在大容量存储设备608中以使能对各种计算机可读介质的读出和/或写入。大容量存储设备608包括可移动介质和/或不可移动介质。
I/O设备610包括允许数据和/或其它信息被输入到计算设备600或从计算设备600取回的各种设备。示例I/O设备610包括光标控制设备、键盘、小键盘、传声器、监视器或其它显示设备、扬声器、打印机、网络接口卡、调制解调器、CCD或其它图像捕获设备等。
接口606包括允许计算设备600与其它系统、设备或计算环境交互的各种接口。示例接口606包括任意数量的不同的网络接口,诸如与局域网(LAN)、广域网(WAN)、无线网络和因特网的接口。
总线612允许处理器602、存储器设备604、接口606、大容量存储设备608和I/O设备610与彼此以及耦合到总线612的其它设备或组件通信。总线612表示总线结构的几个类型中的一个或多个,诸如系统总线、PCI总线、IEEE 1394总线、USB总线等。
出于说明的目的,程序和其它可执行程序组件在本文中被示出为离散的框,尽管应理解这种程序和组件可在各种时间处存在于计算设备600的不同的存储组件中,并可由处理器602执行。可选地,本文描述的系统和过程可在硬件或硬件、软件和/或固件的组合中实现。例如,一个或多个专用集成电路(ASIC)可经编程来执行本文所描述的系统和程序中的一个或多个。
尽管本公开根据特定的优选实施方式来描述,其它实施方式对于本领域中的那些普通技术人员是明显的,给定本公开的优势,包括不提供本文阐述的所有的优势和特征的实施方式,其也落入本公开的范围。将理解,其他的实施方式可以被利用而不偏离本公开的范围。

Claims (22)

1.一种用于储存半结构化数据的方法,包括:
接收来自数据源的半结构化数据元素;
当所述半结构化数据元素的集合被添加到数据库时,实施对它们的统计分析;
从所述半结构化数据内识别公共数据元素;
根据公共性阈值将所述公共数据元素分配为第一等级数据和次要等级数据;
将来自所述数据源的所述公共数据元素合并到单独的伪列中;以及
将第一等级数据在缓存存储器中储存在伪列中并使对应于所述第一等级数据元素的所述伪列的元数据和统计信息对基于计算机的查询生成器可用。
2.如权利要求1所述的方法,还包括从所述半结构化数据内重新识别公共数据元素并将额外的公共数据元素分配为第一等级数据,并将所述额外的数据元素保存在缓存存储器中。
3.如权利要求2所述的方法,还包括识别已经落到所述公共性阈值以下的第一等级数据元素并分配次要等级给所识别的数据元素,并从缓存存储器中移除。
4.如权利要求1所述的方法,其中,所述公共性阈值是关于所述数据元素出现在所述半结构化数据中的频率的计数。
5.如权利要求1所述的方法,其中,所述公共性阈值是数据元素被用户请求的频率。
6.如权利要求1所述的方法,还包括将次要等级数据储存在磁盘储存器上的伪列中。
7.如权利要求2所述的方法,还包括将非公共半结构化数据元素储存在溢出序列化列中。
8.如权利要求7所述的方法,还包括通过将所述第一等级数据元素、所述次要等级数据元素以及所述非公共数据合并来将半结构化数据重构回到原始形式。
9.如权利要求7所述的方法,还包括用表示当前伪列结构和内容的更新来维护聚合的元数据。
10.如权利要求1所述的方法,还包括将次要等级数据储存在主存储器中。
11.一种用于聚合半结构化数据的系统,包括计算机处理器、缓存存储器、磁盘储存器和计算机指令,所述系统还包括:
接收模块,其被配置为接收来自数据源的半结构化数据元素;
统计分析模块,其被配置为得到在所述半结构化数据元素的集合被添加到数据库时得到的对应于所述集合的统计分析数据;
识别模块,其被配置为从所述半结构化数据内识别公共数据元素并被配置为根据公共性阈值将公共数据元素分配为第一等级数据和次要等级数据;
聚合模块,其被配置为将来自所述数据源的公共数据元素合并到单独的伪列中;以及
其中,所述聚合模块被配置为将第一等级数据储存在缓存存储器的伪列中,并被配置为使所述第一等级数据元素的所述伪列的元数据和统计信息对基于计算机的查询生成器可用。
12.如权利要求11所述的系统,其中,所述识别模块还被配置为从所述半结构化数据内重新识别公共数据元素,并还被配置为将额外的公共数据元素分配为第一等级数据并将所述额外的数据元素保存在缓存存储器中。
13.如权利要求12所述的系统,其中,所述识别模块还被配置为识别已经落到所述公共性阈值以下的第一等级数据元素并分配次要等级给所识别的数据元素并从缓存存储器中移除。
14.如权利要求11所述的系统,其中,所述公共性阈值是关于所述数据元素出现在所述半结构化数据中的频率的计数。
15.如权利要求11所述的系统,其中,所述公共性阈值是数据元素被用户请求的频率。
16.如权利要求11所述的系统,其中,较低等级数据被储存在磁盘储存器上的伪列中。
17.如权利要求11所述的系统,其中,非公共半结构化数据元素被储存在溢出序列化列中。
18.如权利要求17所述的系统,其中,半结构化数据被重构成具有重新合并的第一等级数据元素和次要等级数据的原始形式。
19.一种用于聚合半结构化数据的设备,包括:
接收模块,其被配置为接收来自数据源的半结构化数据元素;
统计模块,其被配置为得到在所述半结构化数据元素的集合被添加到数据库时得到的对应于所述集合的统计分析数据;以及
聚合装置,其用于从所述半结构化数据内识别公共数据元素并用于根据公共性阈值将公共数据元素分配为第一等级数据和次要等级数据,所述聚合装置还用于将来自所述数据源的公共数据元素合并到单独的伪列中,并且所述聚合装置还用于将第一等级数据储存在缓存存储器中的伪列中。
20.如权利要求19所述的设备,其中,所述聚合装置还从所述半结构化数据内重新识别公共数据元素,并还将额外的公共数据元素分配为第一等级数据并将所述额外的数据元素保存在缓存存储器中。
21.如权利要求20所述的设备,其中,所述聚合装置还识别已经落到所述公共性阈值以下的第一等级数据元素并且还分配次要等级给所识别的数据元素并从缓存存储器中移除。
22.如权利要求19所述的设备,其中所述聚合装置还基本上持续地用表示当前伪列结构和内容的更新来维护聚合的元数据。
CN201580009233.0A 2014-02-19 2015-02-18 半结构化数据作为第一等级数据库元素的实现 Active CN106030573B (zh)

Applications Claiming Priority (5)

Application Number Priority Date Filing Date Title
US201461941986P 2014-02-19 2014-02-19
US61/941,986 2014-02-19
US14/518,913 2014-10-20
US14/518,913 US10108686B2 (en) 2014-02-19 2014-10-20 Implementation of semi-structured data as a first-class database element
PCT/US2015/016409 WO2015126961A1 (en) 2014-02-19 2015-02-18 Implementaton of semi-structured data as a first-class database element

Publications (2)

Publication Number Publication Date
CN106030573A true CN106030573A (zh) 2016-10-12
CN106030573B CN106030573B (zh) 2019-12-24

Family

ID=53798208

Family Applications (10)

Application Number Title Priority Date Filing Date
CN201910595708.9A Pending CN110308994A (zh) 2014-02-19 2015-02-18 资源管理系统及方法
CN201580009233.0A Active CN106030573B (zh) 2014-02-19 2015-02-18 半结构化数据作为第一等级数据库元素的实现
CN201580020409.2A Active CN106233275B (zh) 2014-02-19 2015-02-18 数据管理系统及方法
CN201580020410.5A Active CN106233255B (zh) 2014-02-19 2015-02-18 资源供应系统及方法
CN201580020415.8A Active CN106233263B (zh) 2014-02-19 2015-02-18 缓存系统及方法
CN201910595838.2A Pending CN110297799A (zh) 2014-02-19 2015-02-18 数据管理系统及方法
CN201580020412.4A Active CN106233277B (zh) 2014-02-19 2015-02-18 资源管理系统及方法
CN201580009234.5A Active CN106104526B (zh) 2014-02-19 2015-02-18 半结构化数据模式的透明发现
CN201580020416.2A Active CN106233253B (zh) 2014-02-19 2015-02-19 资源供应系统及方法
CN201780034461.2A Active CN109564564B (zh) 2014-02-19 2017-06-01 克隆目录对象

Family Applications Before (1)

Application Number Title Priority Date Filing Date
CN201910595708.9A Pending CN110308994A (zh) 2014-02-19 2015-02-18 资源管理系统及方法

Family Applications After (8)

Application Number Title Priority Date Filing Date
CN201580020409.2A Active CN106233275B (zh) 2014-02-19 2015-02-18 数据管理系统及方法
CN201580020410.5A Active CN106233255B (zh) 2014-02-19 2015-02-18 资源供应系统及方法
CN201580020415.8A Active CN106233263B (zh) 2014-02-19 2015-02-18 缓存系统及方法
CN201910595838.2A Pending CN110297799A (zh) 2014-02-19 2015-02-18 数据管理系统及方法
CN201580020412.4A Active CN106233277B (zh) 2014-02-19 2015-02-18 资源管理系统及方法
CN201580009234.5A Active CN106104526B (zh) 2014-02-19 2015-02-18 半结构化数据模式的透明发现
CN201580020416.2A Active CN106233253B (zh) 2014-02-19 2015-02-19 资源供应系统及方法
CN201780034461.2A Active CN109564564B (zh) 2014-02-19 2017-06-01 克隆目录对象

Country Status (8)

Country Link
US (102) US9576039B2 (zh)
EP (14) EP3108375A4 (zh)
JP (12) JP6643242B2 (zh)
CN (10) CN110308994A (zh)
AU (8) AU2015219106B2 (zh)
CA (8) CA2939906C (zh)
DE (14) DE202015009859U1 (zh)
WO (8) WO2015126962A1 (zh)

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107679096A (zh) * 2017-09-08 2018-02-09 北京京东尚科信息技术有限公司 数据集市间指标共享的方法和装置
CN109685375A (zh) * 2018-12-26 2019-04-26 重庆誉存大数据科技有限公司 一种基于半结构化文本数据的企业风险规则引擎运算方法
CN113507464A (zh) * 2021-07-06 2021-10-15 深圳市吉芯微半导体有限公司 基于虚拟设备的数据访问方法、装置、设备及存储介质
CN114511149A (zh) * 2022-02-16 2022-05-17 长沙祥云瑞风信息技术有限公司 一种分层分布式气象预测平台、方法、介质及设备

Families Citing this family (159)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9961011B2 (en) 2014-01-21 2018-05-01 Oracle International Corporation System and method for supporting multi-tenancy in an application server, cloud, or other environment
US9576039B2 (en) 2014-02-19 2017-02-21 Snowflake Computing Inc. Resource provisioning systems and methods
US9607073B2 (en) 2014-04-17 2017-03-28 Ab Initio Technology Llc Processing data from multiple sources
US9524186B2 (en) * 2014-04-28 2016-12-20 Oracle International Corporation System and method for supporting common transaction identifier (XID) optimization based on resource manager (RM) instance awareness in a transactional environment
US11474874B2 (en) 2014-08-14 2022-10-18 Qubole, Inc. Systems and methods for auto-scaling a big data system
WO2016049584A1 (en) * 2014-09-26 2016-03-31 Oracle International Corporation System and method for transaction recovery in a multitenant application server environment
US9672122B1 (en) * 2014-09-29 2017-06-06 Amazon Technologies, Inc. Fault tolerant distributed tasks using distributed file systems
US10587465B1 (en) * 2015-02-19 2020-03-10 VCE IP Holding Company LLC Methods, systems, and computer readable mediums for selecting and configuring a computing system to support a replicated application
US11436667B2 (en) 2015-06-08 2022-09-06 Qubole, Inc. Pure-spot and dynamically rebalanced auto-scaling clusters
US10210220B2 (en) * 2015-09-16 2019-02-19 DataStax System and method for fault tolerant queries
CN106548262B (zh) * 2015-09-21 2020-11-06 阿里巴巴集团控股有限公司 用于处理任务的资源的调度方法、装置和系统
US10091295B1 (en) * 2015-09-23 2018-10-02 EMC IP Holding Company LLC Converged infrastructure implemented with distributed compute elements
CN106790324B (zh) * 2015-11-20 2020-06-16 华为技术有限公司 内容分发方法、虚拟服务器管理方法、云平台和系统
CN107193813B (zh) * 2016-03-14 2021-05-14 阿里巴巴集团控股有限公司 数据表连接方式处理方法及装置
US10289347B2 (en) 2016-04-26 2019-05-14 Servicenow, Inc. Detection and remediation of memory leaks
KR101866487B1 (ko) * 2016-04-27 2018-06-12 주식회사 와이즈넛 복수의 이기종 사물인터넷디바이스의 반정형 데이터를 그룹핑하여 실시간으로 분석하는 데이터처리장치
EP3449363A4 (en) 2016-04-28 2019-10-02 Snowflake Inc. MULTIPLE CLUSTER WAREHOUSE
US11080207B2 (en) * 2016-06-07 2021-08-03 Qubole, Inc. Caching framework for big-data engines in the cloud
US11169982B2 (en) 2016-06-30 2021-11-09 Microsoft Technology Licensing, Llc Dynamic deactivation of cold database in database service
US11240305B2 (en) 2016-07-28 2022-02-01 At&T Intellectual Property I, L.P. Task allocation among devices in a distributed data storage system
CN106250566A (zh) * 2016-08-31 2016-12-21 天津南大通用数据技术股份有限公司 一种分布式数据库及其数据运算的管理方法
US20180060133A1 (en) * 2016-09-01 2018-03-01 Amazon Technologies, Inc. Event-driven resource pool management
US10817540B2 (en) 2016-09-02 2020-10-27 Snowflake Inc. Incremental clustering maintenance of a table
US10606664B2 (en) 2016-09-07 2020-03-31 Qubole Inc. Heterogeneous auto-scaling big-data clusters in the cloud
US11461334B2 (en) 2016-09-26 2022-10-04 Splunk Inc. Data conditioning for dataset destination
US11269939B1 (en) 2016-09-26 2022-03-08 Splunk Inc. Iterative message-based data processing including streaming analytics
US11250056B1 (en) 2016-09-26 2022-02-15 Splunk Inc. Updating a location marker of an ingestion buffer based on storing buckets in a shared storage system
US11163758B2 (en) 2016-09-26 2021-11-02 Splunk Inc. External dataset capability compensation
US10353965B2 (en) 2016-09-26 2019-07-16 Splunk Inc. Data fabric service system architecture
US11567993B1 (en) 2016-09-26 2023-01-31 Splunk Inc. Copying buckets from a remote shared storage system to memory associated with a search node for query execution
US11604795B2 (en) 2016-09-26 2023-03-14 Splunk Inc. Distributing partial results from an external data system between worker nodes
US11615104B2 (en) 2016-09-26 2023-03-28 Splunk Inc. Subquery generation based on a data ingest estimate of an external data system
US10795884B2 (en) 2016-09-26 2020-10-06 Splunk Inc. Dynamic resource allocation for common storage query
US11243963B2 (en) 2016-09-26 2022-02-08 Splunk Inc. Distributing partial results to worker nodes from an external data system
US11232100B2 (en) 2016-09-26 2022-01-25 Splunk Inc. Resource allocation for multiple datasets
US10776355B1 (en) 2016-09-26 2020-09-15 Splunk Inc. Managing, storing, and caching query results and partial query results for combination with additional query results
US10726009B2 (en) * 2016-09-26 2020-07-28 Splunk Inc. Query processing using query-resource usage and node utilization data
US11620336B1 (en) 2016-09-26 2023-04-04 Splunk Inc. Managing and storing buckets to a remote shared storage system based on a collective bucket size
US11023463B2 (en) 2016-09-26 2021-06-01 Splunk Inc. Converting and modifying a subquery for an external data system
US11550847B1 (en) 2016-09-26 2023-01-10 Splunk Inc. Hashing bucket identifiers to identify search nodes for efficient query execution
US11106734B1 (en) 2016-09-26 2021-08-31 Splunk Inc. Query execution using containerized state-free search nodes in a containerized scalable environment
US11860940B1 (en) 2016-09-26 2024-01-02 Splunk Inc. Identifying buckets for query execution using a catalog of buckets
US11442935B2 (en) 2016-09-26 2022-09-13 Splunk Inc. Determining a record generation estimate of a processing task
US10977260B2 (en) 2016-09-26 2021-04-13 Splunk Inc. Task distribution in an execution node of a distributed execution environment
US10956415B2 (en) 2016-09-26 2021-03-23 Splunk Inc. Generating a subquery for an external data system using a configuration file
US11321321B2 (en) 2016-09-26 2022-05-03 Splunk Inc. Record expansion and reduction based on a processing task in a data intake and query system
US11222066B1 (en) 2016-09-26 2022-01-11 Splunk Inc. Processing data using containerized state-free indexing nodes in a containerized scalable environment
US11003714B1 (en) 2016-09-26 2021-05-11 Splunk Inc. Search node and bucket identification using a search node catalog and a data store catalog
US11416528B2 (en) 2016-09-26 2022-08-16 Splunk Inc. Query acceleration data store
US11580107B2 (en) 2016-09-26 2023-02-14 Splunk Inc. Bucket data distribution for exporting data to worker nodes
US11314753B2 (en) 2016-09-26 2022-04-26 Splunk Inc. Execution of a query received from a data intake and query system
US11593377B2 (en) 2016-09-26 2023-02-28 Splunk Inc. Assigning processing tasks in a data intake and query system
US11586627B2 (en) 2016-09-26 2023-02-21 Splunk Inc. Partitioning and reducing records at ingest of a worker node
US10984044B1 (en) 2016-09-26 2021-04-20 Splunk Inc. Identifying buckets for query execution using a catalog of buckets stored in a remote shared storage system
US11599541B2 (en) 2016-09-26 2023-03-07 Splunk Inc. Determining records generated by a processing task of a query
US11281706B2 (en) 2016-09-26 2022-03-22 Splunk Inc. Multi-layer partition allocation for query execution
US11562023B1 (en) 2016-09-26 2023-01-24 Splunk Inc. Merging buckets in a data intake and query system
US11294941B1 (en) 2016-09-26 2022-04-05 Splunk Inc. Message-based data ingestion to a data intake and query system
US20180089324A1 (en) 2016-09-26 2018-03-29 Splunk Inc. Dynamic resource allocation for real-time search
US11874691B1 (en) 2016-09-26 2024-01-16 Splunk Inc. Managing efficient query execution including mapping of buckets to search nodes
US11663227B2 (en) 2016-09-26 2023-05-30 Splunk Inc. Generating a subquery for a distinct data intake and query system
US11126632B2 (en) 2016-09-26 2021-09-21 Splunk Inc. Subquery generation based on search configuration data from an external data system
US10482098B2 (en) 2016-11-14 2019-11-19 Microsoft Technology Licensing, Llc Consuming streamed data records
US11003658B2 (en) * 2016-11-21 2021-05-11 International Business Machines Corporation Selectively retrieving data from remote share nothing computer clusters
US11106639B1 (en) 2016-12-05 2021-08-31 EMC IP Holding Company LLC Methods, systems, and computer readable mediums for performing metadata-driven data collection
US10592681B2 (en) 2017-01-10 2020-03-17 Snowflake Inc. Data sharing in a multi-tenant database system
EP3355225B1 (en) * 2017-01-31 2022-07-27 Sony Group Corporation Apparatus and method for providing a ethereum virtual device
CN108399102A (zh) * 2017-02-08 2018-08-14 阿里巴巴集团控股有限公司 一种资源分配方法和装置
US11157690B2 (en) 2017-02-22 2021-10-26 Microsoft Technology Licensing, Llc Techniques for asynchronous execution of computationally expensive local spreadsheet tasks
US10725799B2 (en) * 2017-02-22 2020-07-28 Microsoft Technology Licensing, Llc Big data pipeline management within spreadsheet applications
US10979328B2 (en) * 2017-03-31 2021-04-13 Intel Corporation Resource monitoring
US10733024B2 (en) 2017-05-24 2020-08-04 Qubole Inc. Task packing scheduling process for long running applications
US20180357328A1 (en) * 2017-06-09 2018-12-13 Linkedin Corporation Functional equivalence of tuples and edges in graph databases
US10445370B2 (en) 2017-06-09 2019-10-15 Microsoft Technology Licensing, Llc Compound indexes for graph databases
US10671671B2 (en) 2017-06-09 2020-06-02 Microsoft Technology Licensing, Llc Supporting tuples in log-based representations of graph databases
US11921672B2 (en) 2017-07-31 2024-03-05 Splunk Inc. Query execution at a remote heterogeneous data store of a data fabric service
US11989194B2 (en) 2017-07-31 2024-05-21 Splunk Inc. Addressing memory limits for partition tracking among worker nodes
US11113090B1 (en) 2017-08-09 2021-09-07 United Services Automobile Association (Usaa) Systems and methods for container management
US11249808B2 (en) * 2017-08-22 2022-02-15 Intel Corporation Connecting accelerator resources using a switch
CN107481006B (zh) * 2017-08-24 2020-06-26 维沃移动通信有限公司 一种资源转移方法、服务器及终端
US10896182B2 (en) 2017-09-25 2021-01-19 Splunk Inc. Multi-partitioning determination for combination operations
US11151137B2 (en) 2017-09-25 2021-10-19 Splunk Inc. Multi-partition operation in combination operations
CN109814861A (zh) * 2017-11-21 2019-05-28 海云数据 为终端用户提供能力的开放平台
US11228489B2 (en) 2018-01-23 2022-01-18 Qubole, Inc. System and methods for auto-tuning big data workloads on cloud platforms
WO2019183219A1 (en) 2018-03-22 2019-09-26 Snowflake Computing Inc. Incremental feature development and workload capture in database systems
TWI666901B (zh) * 2018-03-27 2019-07-21 緯穎科技服務股份有限公司 資料傳輸方法與使用此方法的主機系統
US11892996B1 (en) 2019-07-16 2024-02-06 Splunk Inc. Identifying an indexing node to process data using a resource catalog
US11157497B1 (en) * 2018-04-30 2021-10-26 Splunk Inc. Dynamically assigning a search head and search nodes for a query
US11327992B1 (en) 2018-04-30 2022-05-10 Splunk Inc. Authenticating a user to access a data intake and query system
US11275733B1 (en) 2018-04-30 2022-03-15 Splunk Inc. Mapping search nodes to a search head using a tenant identifier
US11334543B1 (en) 2018-04-30 2022-05-17 Splunk Inc. Scalable bucket merging for a data intake and query system
US11030204B2 (en) * 2018-05-23 2021-06-08 Microsoft Technology Licensing, Llc Scale out data storage and query filtering using data pools
US20190364109A1 (en) * 2018-05-23 2019-11-28 Microsoft Technology Licensing, Llc Scale out data storage and query filtering using storage pools
US20190362004A1 (en) * 2018-05-23 2019-11-28 Microsoft Technology Licensing, Llc Data platform fabric
US10877801B2 (en) * 2018-09-28 2020-12-29 Atlassian Pty Ltd. Systems and methods for scheduling tasks
US10339150B1 (en) 2018-10-04 2019-07-02 Capital One Services, Llc Scalable dynamic acronym decoder
CN109582858A (zh) * 2018-10-17 2019-04-05 北京邮电大学 一种可信的知识生态系统
KR102047233B1 (ko) * 2018-10-22 2019-11-21 강릉원주대학교산학협력단 이중 부하 분산을 이용한 메타데이터 검색 시스템 및 이중 부하 분산을 통한 데이터베이스 관리 방법
US11030186B2 (en) * 2018-10-26 2021-06-08 Snowflake lnc. Incremental refresh of a materialized view
US11521089B2 (en) * 2018-11-29 2022-12-06 Sap Se In-database predictive pipeline incremental engine
KR20200083048A (ko) * 2018-12-31 2020-07-08 삼성전자주식회사 폴링 시간을 예측하는 뉴럴 네트워크 시스템 및 이를 이용한 뉴럴 네트워크 모델 처리 방법
US11128701B1 (en) * 2019-03-28 2021-09-21 Amazon Technologies, Inc. Cooperative preemption in a distributed multi-tenant resource pool
US11194795B2 (en) * 2019-04-16 2021-12-07 Snowflake Inc. Automated maintenance of external tables in database systems
US11048423B2 (en) 2019-04-17 2021-06-29 Verizon Media Inc. Method and system for synchronizing requests related to key-value storage having different portions
US11222022B2 (en) 2019-04-17 2022-01-11 Verizon Patent And Licensing Inc. Method and system for searching a key-value storage
WO2020220216A1 (en) 2019-04-29 2020-11-05 Splunk Inc. Search time estimate in data intake and query system
US11715051B1 (en) 2019-04-30 2023-08-01 Splunk Inc. Service provider instance recommendations using machine-learned classifications and reconciliation
US11144360B2 (en) 2019-05-31 2021-10-12 Qubole, Inc. System and method for scheduling and running interactive database queries with service level agreements in a multi-tenant processing system
US11704316B2 (en) 2019-05-31 2023-07-18 Qubole, Inc. Systems and methods for determining peak memory requirements in SQL processing engines with concurrent subtasks
US11556640B1 (en) * 2019-06-27 2023-01-17 Mandiant, Inc. Systems and methods for automated cybersecurity analysis of extracted binary string sets
US11270531B2 (en) 2019-06-28 2022-03-08 GM Cruise Holdings, LLC Autonomous vehicle data management platform
US11416465B1 (en) 2019-07-16 2022-08-16 Splunk Inc. Processing data associated with different tenant identifiers
US11429604B2 (en) * 2019-09-10 2022-08-30 Oracle International Corporation Techniques of heterogeneous hardware execution for SQL analytic queries for high volume data processing
US11265328B2 (en) 2019-09-12 2022-03-01 Snowflake Inc. Private data exchange metrics sharing
US11334604B2 (en) * 2019-09-12 2022-05-17 Snowflake Inc. Private data exchange
US11494380B2 (en) 2019-10-18 2022-11-08 Splunk Inc. Management of distributed computing framework components in a data fabric service system
US20210182070A1 (en) * 2019-12-11 2021-06-17 International Business Machines Corporation Explicit resource file to assign exact resources to job ranks
US11308090B2 (en) 2019-12-26 2022-04-19 Snowflake Inc. Pruning index to support semi-structured data types
US11567939B2 (en) 2019-12-26 2023-01-31 Snowflake Inc. Lazy reassembling of semi-structured data
US11275725B2 (en) * 2020-01-29 2022-03-15 Salesforce.Com, Inc. Transporting a database structure from a first version to a second version
US11922222B1 (en) 2020-01-30 2024-03-05 Splunk Inc. Generating a modified component for a data intake and query system using an isolated execution environment image
US11048716B1 (en) * 2020-01-31 2021-06-29 Snowflake Inc. Managed virtual warehouses for tasks
US11829415B1 (en) 2020-01-31 2023-11-28 Splunk Inc. Mapping buckets and search peers to a bucket map identifier for searching
CN111291231B (zh) * 2020-02-14 2023-09-15 支付宝(杭州)信息技术有限公司 数据处理结果的存储方法及其系统
US11580102B2 (en) * 2020-04-02 2023-02-14 Ocient Holdings LLC Implementing linear algebra functions via decentralized execution of query operator flows
US10860381B1 (en) * 2020-05-14 2020-12-08 Snowflake Inc. Flexible computing
US11347735B2 (en) 2020-06-01 2022-05-31 Snowflake Inc. Scalable query processing
US11163768B1 (en) 2020-06-01 2021-11-02 Snowflake Inc. Checkpoints in batch file processing
US10997286B1 (en) * 2020-06-02 2021-05-04 Snowflake Inc. Secure code execution in a database system
US11556636B2 (en) * 2020-06-30 2023-01-17 Microsoft Technology Licensing, Llc Malicious enterprise behavior detection tool
US11687497B2 (en) * 2020-07-21 2023-06-27 Akamai Technologies Inc. Learning-based storage reduction in an overlay network
CN111881123B (zh) * 2020-07-22 2022-04-22 北京浪潮数据技术有限公司 分布式系统之间的数据同步方法及系统
US11449371B1 (en) 2020-07-31 2022-09-20 Splunk Inc. Indexing data at a data intake and query system based on a node capacity threshold
US11615082B1 (en) 2020-07-31 2023-03-28 Splunk Inc. Using a data store and message queue to ingest data for a data intake and query system
CN112035516B (zh) * 2020-09-30 2023-08-18 北京百度网讯科技有限公司 用于算子服务的处理方法、装置、智能工作站和电子设备
US11609913B1 (en) 2020-10-16 2023-03-21 Splunk Inc. Reassigning data groups from backup to searching for a processing node
US11704313B1 (en) 2020-10-19 2023-07-18 Splunk Inc. Parallel branch operation using intermediary nodes
US11989178B2 (en) 2020-10-26 2024-05-21 Oracle International Corporation Efficient compilation of graph queries including complex expressions on top of sql based relational engine
KR102411806B1 (ko) * 2020-11-17 2022-06-23 쿠팡 주식회사 데이터베이스 쿼리 효율 향상을 위한 시스템 및 방법
CN112348444A (zh) * 2020-11-18 2021-02-09 关酢壬 一种基于互联网的物料仓库远程监控管理系统
CN113762865A (zh) * 2021-01-06 2021-12-07 北京京东乾石科技有限公司 一种库存信息处理方法和装置
CN112631527A (zh) * 2021-01-07 2021-04-09 上海明略人工智能(集团)有限公司 基于k8s多租户的Juypter Notebook代码远端存储方法及装置
US11138038B1 (en) * 2021-01-29 2021-10-05 Snowflake Inc. Adaptive freepool size prediction
US20220284056A1 (en) * 2021-03-05 2022-09-08 Oracle International Corporation Fast and memory efficient in-memory columnar graph updates while preserving analytical performance
US11354362B1 (en) 2021-05-06 2022-06-07 Workiva Inc. System and method for copying linked documents
CN113176878B (zh) * 2021-06-30 2021-10-08 深圳市维度数据科技股份有限公司 自动查询方法、装置和设备
US11914595B2 (en) 2021-07-13 2024-02-27 Capital One Services, Llc Virtual warehouse query monitoring and reporting
US11494413B1 (en) 2021-07-13 2022-11-08 Capital One Services, Llc Query alerts generation for virtual warehouse
US11669529B2 (en) * 2021-07-13 2023-06-06 Capital One Services, Llc Dynamic query allocation to virtual warehouses
US11809395B1 (en) 2021-07-15 2023-11-07 Splunk Inc. Load balancing, failover, and reliable delivery of data in a data intake and query system
CN113488180B (zh) * 2021-07-28 2023-07-18 中国医学科学院医学信息研究所 一种临床指南知识建模方法及系统
WO2023137444A2 (en) * 2022-01-14 2023-07-20 Sentinel Labs Israel Ltd. Systems and methods for data management and query optimization
US11621882B1 (en) * 2022-01-28 2023-04-04 United Services Automobile Association (Usaa) Automated remedial actions for service level objective thresholds
TWI820684B (zh) * 2022-04-21 2023-11-01 騰升科技股份有限公司 開放式倉儲生產系統及方法
CN114945026A (zh) * 2022-04-24 2022-08-26 网易(杭州)网络有限公司 数据处理方法、装置和系统
US11914637B2 (en) * 2022-07-25 2024-02-27 Sap Se Image scaling cloud database
US11947559B1 (en) 2022-10-10 2024-04-02 Bank Of America Corporation Dynamic schema identification to process incoming data feeds in a database system
CN116150093B (zh) * 2023-03-04 2023-11-03 北京大道云行科技有限公司 一种对象存储列举对象的实现方法及电子设备
CN116226095A (zh) * 2023-05-08 2023-06-06 中用科技有限公司 一种无共享架构数据库的存算分离系统

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20100235385A1 (en) * 2009-03-10 2010-09-16 Fujitsu Limited Semi-structured data retrieval method, and structured data retrieval device
CN102243629A (zh) * 2010-05-12 2011-11-16 北京安华金和科技有限公司 一种基于多级视图和触发器的数据库透明加解密方法
CN102567378A (zh) * 2010-12-28 2012-07-11 上海杉达学院 基于异构数据的信息检索系统
CN102779114A (zh) * 2011-05-12 2012-11-14 商业对象软件有限公司 利用自动规则生成的非结构化数据支持

Family Cites Families (499)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US3074210A (en) 1959-07-28 1963-01-22 Yates American Machine Co Combination sander
US4967341A (en) * 1986-02-14 1990-10-30 Hitachi, Ltd. Method and apparatus for processing data base
US5325509A (en) 1991-03-05 1994-06-28 Zitel Corporation Method of operating a cache memory including determining desirability of cache ahead or cache behind based on a number of available I/O operations
US5634125A (en) * 1993-09-02 1997-05-27 International Business Machines Corporation Selecting buckets for redistributing data between nodes in a parallel database in the quiescent mode
US5584024A (en) * 1994-03-24 1996-12-10 Software Ag Interactive database query system and method for prohibiting the selection of semantically incorrect query parameters
US5694593A (en) * 1994-10-05 1997-12-02 Northeastern University Distributed computer database system and method
JPH08339323A (ja) * 1995-06-12 1996-12-24 Mitsubishi Electric Corp データベース管理システムにおける分散データ管理方式
US5864842A (en) * 1995-10-23 1999-01-26 Ncr Corporation Optimization of SQL queries using hash star join operations
US5892945A (en) 1996-03-21 1999-04-06 Oracle Corporation Method and apparatus for distributing work granules among processes based on the location of data accessed in the work granules
US5787466A (en) 1996-05-01 1998-07-28 Sun Microsystems, Inc. Multi-tier cache and method for implementing such a system
DE19709992C1 (de) 1997-03-11 1998-10-01 Betr Forsch Inst Angew Forsch Verfahren zum Messen der Oberflächengeometrie von Warmband
FR2762110A1 (fr) * 1997-04-14 1998-10-16 Renishaw Plc Systeme formant capteur programmable
US5873074A (en) * 1997-04-18 1999-02-16 Informix Software, Inc. Applying distinct hash-join distributions of operators to both even and uneven database records
US6453334B1 (en) * 1997-06-16 2002-09-17 Streamtheory, Inc. Method and apparatus to allow remotely located computer programs and/or data to be accessed on a local computer in a secure, time-limited manner, with persistent caching
US6112198A (en) * 1997-06-30 2000-08-29 International Business Machines Corporation Optimization of data repartitioning during parallel query optimization
US6363411B1 (en) * 1998-08-05 2002-03-26 Mci Worldcom, Inc. Intelligent network
US7047300B1 (en) * 1998-02-10 2006-05-16 Sprint Communications Company L.P. Survivable and scalable data system and method for computer networks
US6209128B1 (en) * 1998-06-05 2001-03-27 International Business Machines Corporation Apparatus and method for providing access to multiple object versions
US6185557B1 (en) * 1998-07-31 2001-02-06 Unisys Corporation Merge join process
US6226639B1 (en) * 1998-09-22 2001-05-01 International Business Machines Corporation System and method for hybrid hash join using over-partitioning to respond to database query
JP4406944B2 (ja) * 1998-11-11 2010-02-03 株式会社日立製作所 計算機システム及び問合せに対する処理分散システム
US6338056B1 (en) * 1998-12-14 2002-01-08 International Business Machines Corporation Relational database extender that supports user-defined index types and user-defined search
US20020038308A1 (en) * 1999-05-27 2002-03-28 Michael Cappi System and method for creating a virtual data warehouse
JP2000348038A (ja) 1999-06-02 2000-12-15 Fujitsu Ltd 半構造データベースのためのデータ格納装置および方法
US6374235B1 (en) * 1999-06-25 2002-04-16 International Business Machines Corporation Method, system, and program for a join operation on a multi-column table and satellite tables including duplicate values
CA2279359C (en) * 1999-07-30 2012-10-23 Basantkumar John Oommen A method of generating attribute cardinality maps
US6597956B1 (en) * 1999-08-23 2003-07-22 Terraspring, Inc. Method and apparatus for controlling an extensible computing system
JP3463803B2 (ja) * 1999-11-09 2003-11-05 松下電器産業株式会社 クラスタサーバ装置
US6938256B2 (en) * 2000-01-18 2005-08-30 Galactic Computing Corporation System for balance distribution of requests across multiple servers using dynamic metrics
US6604100B1 (en) * 2000-02-09 2003-08-05 At&T Corp. Method for converting relational data into a structured document
US6490590B1 (en) 2000-02-14 2002-12-03 Ncr Corporation Method of generating a logical data model, physical data model, extraction routines and load routines
US6484186B1 (en) * 2000-02-15 2002-11-19 Novell, Inc. Method for backing up consistent versions of open files
US7124144B2 (en) 2000-03-02 2006-10-17 Actuate Corporation Method and apparatus for storing semi-structured data in a structured manner
US6618720B1 (en) * 2000-06-15 2003-09-09 Ncr Corporation Common spool files for maintaining join indexes
US6826564B2 (en) * 2000-07-10 2004-11-30 Fastforward Networks Scalable and programmable query distribution and collection in a network of queryable devices
JP2002132455A (ja) 2000-10-25 2002-05-10 Hitachi Ltd キャッシュマネジャー及びこれを含むコンピュータシステム
US6954757B2 (en) 2001-02-02 2005-10-11 Hewlett-Packard Development Company, L.P. Framework, architecture, method and system for reducing latency of business operations of an enterprise
US7418620B1 (en) 2001-02-16 2008-08-26 Swsoft Holdings, Ltd. Fault tolerant distributed storage method and controller using (N,K) algorithms
US6804677B2 (en) * 2001-02-26 2004-10-12 Ori Software Development Ltd. Encoding semi-structured data for efficient search and browsing
JP2004533738A (ja) * 2001-03-02 2004-11-04 カセンナ インコーポレイテッド ネットワークにわたって低レイテンシで効率的にビデオコンテンツを配給するためのメタデータイネーブル型プッシュ−プルモデル
JP4129353B2 (ja) 2001-03-29 2008-08-06 株式会社東芝 分散データ管理システム、分散データ管理方法及び分散データ管理プログラム
US7085891B2 (en) * 2001-04-04 2006-08-01 International Business Machines Corporation Method for managing a cache memory using a predictive modeling engine to select a caching algorithm
US7085769B1 (en) * 2001-04-26 2006-08-01 Ncr Corporation Method and apparatus for performing hash join
US7797375B2 (en) * 2001-05-07 2010-09-14 International Business Machines Corporat System and method for responding to resource requests in distributed computer networks
US7092951B1 (en) * 2001-07-06 2006-08-15 Ncr Corporation Auxiliary relation for materialized view
US7363353B2 (en) * 2001-07-06 2008-04-22 Juniper Networks, Inc. Content service aggregation device for a data center
WO2003017136A1 (en) * 2001-08-16 2003-02-27 Etagon Israel Ltd. Using associative memory to perform database operations
US7499960B2 (en) * 2001-10-01 2009-03-03 Oracle International Corporation Adaptive memory allocation
US7080072B1 (en) * 2001-11-14 2006-07-18 Ncr Corp. Row hash match scan in a partitioned database system
US6954456B2 (en) * 2001-12-14 2005-10-11 At & T Corp. Method for content-aware redirection and content renaming
US7257597B1 (en) 2001-12-18 2007-08-14 Siebel Systems, Inc. Table substitution
US7188364B2 (en) 2001-12-20 2007-03-06 Cranite Systems, Inc. Personal virtual bridged local area networks
US7092954B1 (en) * 2001-12-31 2006-08-15 Ncr Corporation Optimizing an equi-join operation using a bitmap index structure
WO2003065252A1 (en) * 2002-02-01 2003-08-07 John Fairweather System and method for managing memory
US7266823B2 (en) 2002-02-21 2007-09-04 International Business Machines Corporation Apparatus and method of dynamically repartitioning a computer system in response to partition workloads
JP2003271429A (ja) 2002-03-15 2003-09-26 Hitachi Ltd 記憶装置資源管理方法、記憶資源管理プログラム、該プログラムを記録した記録媒体、及び記憶資源管理装置
US7149737B1 (en) * 2002-04-04 2006-12-12 Ncr Corp. Locking mechanism using a predefined lock for materialized views in a database system
US7617179B2 (en) * 2002-06-29 2009-11-10 Ianywhere Solutions, Inc. System and methodology for cost-based subquery optimization using a left-deep tree join enumeration algorithm
US7379990B2 (en) 2002-08-12 2008-05-27 Tsao Sheng Ted Tai Distributed virtual SAN
US6996556B2 (en) 2002-08-20 2006-02-07 International Business Machines Corporation Metadata manager for database query optimizer
EP1546928A4 (en) * 2002-09-18 2008-07-09 Netezza Corp Field-Oriented Pipeline Architecture for a Programmable Data Streaming Processor
JP2004126804A (ja) * 2002-09-30 2004-04-22 Just Syst Corp 文書管理方法および装置
DE20217309U1 (de) 2002-11-09 2003-01-30 Eichenauer Heizelemente Gmbh Heizkörper für gasförmige Medien
US6968335B2 (en) * 2002-11-14 2005-11-22 Sesint, Inc. Method and system for parallel processing of database queries
US7395536B2 (en) 2002-11-14 2008-07-01 Sun Microsystems, Inc. System and method for submitting and performing computational tasks in a distributed heterogeneous networked environment
US7562090B2 (en) * 2002-12-19 2009-07-14 International Business Machines Corporation System and method for automating data partitioning in a parallel database
US8468227B2 (en) * 2002-12-31 2013-06-18 Motorola Solutions, Inc. System and method for rendering content on multiple devices
US20040181522A1 (en) * 2003-01-16 2004-09-16 Jardin Cary A. Shared memory router system and method for node communication in a distributed system
US20040181524A1 (en) * 2003-01-16 2004-09-16 Jardin Cary A. System and method for distributed processing in a node environment
US7490097B2 (en) 2003-02-20 2009-02-10 Microsoft Corporation Semi-structured data storage schema selection
JP2004252789A (ja) 2003-02-21 2004-09-09 Nippon Telegr & Teleph Corp <Ntt> 情報検索装置、情報検索方法、情報検索プログラム及びそのプログラムを記録した記録媒体
US7254636B1 (en) * 2003-03-14 2007-08-07 Cisco Technology, Inc. Method and apparatus for transparent distributed network-attached storage with web cache communication protocol/anycast and file handle redundancy
JP4313068B2 (ja) * 2003-03-28 2009-08-12 株式会社日立製作所 記憶装置のキャッシュ管理方法
US7111025B2 (en) * 2003-04-30 2006-09-19 International Business Machines Corporation Information retrieval system and method using index ANDing for improving performance
US7603464B2 (en) 2003-06-04 2009-10-13 Sony Computer Entertainment Inc. Method and system for identifying available resources in a peer-to-peer network
US7357035B2 (en) 2003-06-06 2008-04-15 The Board Of Trustees Of The University Of Illinois Sensor chip and apparatus for tactile and/or flow sensing
US7280998B1 (en) 2003-07-28 2007-10-09 At&T Corp. Virtual data warehousing
JP2005056085A (ja) * 2003-08-01 2005-03-03 Fujitsu Ltd データ構造変換プログラム
JP2005056077A (ja) 2003-08-01 2005-03-03 Hitachi Ltd データベース制御方法
US7349913B2 (en) * 2003-08-21 2008-03-25 Microsoft Corporation Storage platform for organizing, searching, and sharing data
US7401104B2 (en) * 2003-08-21 2008-07-15 Microsoft Corporation Systems and methods for synchronizing computer systems through an intermediary file system share or device
US7702610B2 (en) * 2003-09-19 2010-04-20 Netezza Corporation Performing sequence analysis as a multipart plan storing intermediate results as a relation
US7555504B2 (en) * 2003-09-23 2009-06-30 Emc Corporation Maintenance of a file version set including read-only and read-write snapshot copies of a production file
US20050081210A1 (en) * 2003-09-25 2005-04-14 International Business Machines Corporation Dynamic adjustment of system resource allocation during query execution in a database management system
AU2004282219C1 (en) 2003-10-15 2009-12-17 Osi Pharmaceuticals, Inc. Imidazo [1, 5 - a] pyrazine tyrosine kinase inhibitors
US20050091231A1 (en) * 2003-10-24 2005-04-28 Shankar Pal System and method for storing and retrieving XML data encapsulated as an object in a database store
CN1543138B (zh) * 2003-11-04 2010-09-08 浙江大学 宽带adsl业务自动处理系统
US7380039B2 (en) * 2003-12-30 2008-05-27 3Tera, Inc. Apparatus, method and system for aggregrating computing resources
US20050198303A1 (en) * 2004-01-02 2005-09-08 Robert Knauerhase Dynamic virtual machine service provider allocation
US7562143B2 (en) * 2004-01-13 2009-07-14 International Business Machines Corporation Managing escalating resource needs within a grid environment
US7136973B2 (en) 2004-02-04 2006-11-14 Sandisk Corporation Dual media storage device
JP4247135B2 (ja) * 2004-02-10 2009-04-02 株式会社東芝 構造化文書記憶方法、構造化文書記憶装置、構造化文書検索方法
US7843906B1 (en) * 2004-02-13 2010-11-30 Habanero Holdings, Inc. Storage gateway initiator for fabric-backplane enterprise servers
JP4777972B2 (ja) * 2004-02-21 2011-09-21 データレグロ,インコーポレーテッド 無共有型並列データベースシステム及びデータベース管理方法
US20050192937A1 (en) * 2004-02-26 2005-09-01 International Business Machines Corporation Dynamic query optimization
WO2005092032A2 (en) 2004-03-22 2005-10-06 Sliccware Corporation Secure virtual data warehousing system and method
JP4631301B2 (ja) * 2004-03-31 2011-02-16 株式会社日立製作所 記憶装置のキャッシュ管理方法
US20110145489A1 (en) * 2004-04-05 2011-06-16 Super Talent Electronics, Inc. Hybrid storage device
US8255388B1 (en) * 2004-04-30 2012-08-28 Teradata Us, Inc. Providing a progress indicator in a database system
US7644050B2 (en) * 2004-12-02 2010-01-05 International Business Machines Corporation Method and apparatus for annotation-based behavior extensions
US7395258B2 (en) * 2004-07-30 2008-07-01 International Business Machines Corporation System and method for adaptive database caching
WO2006026659A2 (en) 2004-08-31 2006-03-09 Ascential Software Corporation Services oriented architecture for data integration services
US7523098B2 (en) 2004-09-15 2009-04-21 International Business Machines Corporation Systems and methods for efficient data searching, storage and reduction
US7644083B1 (en) * 2004-09-30 2010-01-05 Teradata Us, Inc. Efficiently performing inequality joins
US20060074872A1 (en) 2004-09-30 2006-04-06 International Business Machines Corporation Adaptive database buffer memory management using dynamic SQL statement cache statistics
US7478080B2 (en) * 2004-09-30 2009-01-13 International Business Machines Corporation Canonical abstraction for outerjoin optimization
US7620953B1 (en) 2004-10-05 2009-11-17 Azul Systems, Inc. System and method for allocating resources of a core space among a plurality of core virtual machines
US20060090164A1 (en) * 2004-10-05 2006-04-27 Microsoft Corporation Object cloning for demand events
US7574424B2 (en) * 2004-10-13 2009-08-11 Sybase, Inc. Database system with methodology for parallel schedule generation in a query optimizer
US20060085451A1 (en) * 2004-10-15 2006-04-20 Microsoft Corporation Mapping of schema data into data structures
JP2006119745A (ja) * 2004-10-19 2006-05-11 Hitachi Ltd コンピュータシステム及びコンピュータシステムの制御方法
US8145642B2 (en) * 2004-11-30 2012-03-27 Oracle International Corporation Method and apparatus to support bitmap filtering in a parallel system
US7721292B2 (en) * 2004-12-16 2010-05-18 International Business Machines Corporation System for adjusting resource allocation to a logical partition based on rate of page swaps and utilization by changing a boot configuration file
US7415487B2 (en) * 2004-12-17 2008-08-19 Amazon Technologies, Inc. Apparatus and method for data warehousing
CN1622095A (zh) * 2004-12-27 2005-06-01 中国科学院软件研究所 可扩展标记语言文件存储及插入关系数据库表的方法
US7882100B2 (en) * 2005-01-24 2011-02-01 Sybase, Inc. Database system with methodology for generating bushy nested loop join trees
US8126870B2 (en) * 2005-03-28 2012-02-28 Sybase, Inc. System and methodology for parallel query optimization using semantic-based partitioning
US7512625B2 (en) * 2005-04-01 2009-03-31 International Business Machines Corporation Method, system and program for joining source table rows with target table rows
US7640230B2 (en) * 2005-04-05 2009-12-29 Microsoft Corporation Query plan selection control using run-time association mechanism
JP4839706B2 (ja) * 2005-07-12 2011-12-21 株式会社日立製作所 データベース管理システムのインデックス運用方法
US20070033247A1 (en) * 2005-08-02 2007-02-08 The Mathworks, Inc. Methods and system for distributing data to technical computing workers
US7475056B2 (en) * 2005-08-11 2009-01-06 Oracle International Corporation Query processing in a parallel single cursor model on multi-instance configurations, using hints
US20090234711A1 (en) * 2005-09-14 2009-09-17 Jorey Ramer Aggregation of behavioral profile data using a monetization platform
US20070067274A1 (en) * 2005-09-16 2007-03-22 International Business Machines Corporation Hybrid push-down/pull-up of unions with expensive operations in a federated query processor
US7814091B2 (en) * 2005-09-27 2010-10-12 Oracle International Corporation Multi-tiered query processing techniques for minus and intersect operators
US7870288B2 (en) * 2005-10-28 2011-01-11 Yahoo! Inc. Sharing data in scalable software blade architecture
JP4795778B2 (ja) 2005-11-07 2011-10-19 株式会社東芝 データ管理装置、データ管理方法およびプログラム
US20070124274A1 (en) * 2005-11-30 2007-05-31 International Business Machines Corporation Apparatus and method for autonomic adjustment of resources in a logical partition to improve partitioned query performance
US7921132B2 (en) 2005-12-19 2011-04-05 Yahoo! Inc. System for query processing of column chunks in a distributed column chunk data store
US8073929B2 (en) * 2005-12-29 2011-12-06 Panasonic Electric Works Co., Ltd. Systems and methods for managing a provider's online status in a distributed network
US20070174290A1 (en) * 2006-01-19 2007-07-26 International Business Machines Corporation System and architecture for enterprise-scale, parallel data mining
US20070174429A1 (en) 2006-01-24 2007-07-26 Citrix Systems, Inc. Methods and servers for establishing a connection between a client system and a virtual machine hosting a requested computing environment
US7716238B2 (en) 2006-02-15 2010-05-11 Sony Computer Entertainment America Inc. Systems and methods for server management
US9229967B2 (en) * 2006-02-22 2016-01-05 Oracle International Corporation Efficient processing of path related operations on data organized hierarchically in an RDBMS
WO2007099273A1 (en) 2006-03-03 2007-09-07 Arm Limited Monitoring values of signals within an integrated circuit
US20070294692A1 (en) * 2006-06-16 2007-12-20 Microsoft Corporation Task Assignment Among Multiple Devices
US20080005486A1 (en) * 2006-06-29 2008-01-03 Mannava Phanindra K Coordination of snoop responses in a multi-processor system
US8074210B1 (en) * 2006-06-29 2011-12-06 Xilinx, Inc. Method and apparatus for producing optimized matrix triangulation routines
US8359297B2 (en) 2006-06-29 2013-01-22 International Business Machines Corporation Multiple source data management using a conflict rule
US7730119B2 (en) * 2006-07-21 2010-06-01 Sony Computer Entertainment Inc. Sub-task processor distribution scheduling
US7624118B2 (en) * 2006-07-26 2009-11-24 Microsoft Corporation Data processing over very large databases
US7991800B2 (en) 2006-07-28 2011-08-02 Aprimo Incorporated Object oriented system and method for optimizing the execution of marketing segmentations
US20080082644A1 (en) * 2006-09-29 2008-04-03 Microsoft Corporation Distributed parallel computing
US20080091806A1 (en) * 2006-10-11 2008-04-17 Jinmei Shen Dynamic On-Demand Clustering
US8589550B1 (en) * 2006-10-23 2013-11-19 Emc Corporation Asymmetric data storage system for high performance and grid computing
US8185893B2 (en) * 2006-10-27 2012-05-22 Hewlett-Packard Development Company, L.P. Starting up at least one virtual machine in a physical machine by a load balancer
JP4571609B2 (ja) * 2006-11-08 2010-10-27 株式会社日立製作所 リソース割当方法、リソース割当プログラム、および、管理コンピュータ
EP2092440B1 (en) * 2006-11-13 2019-01-09 IP Reservoir, LLC Method and system for high performance integration, processing and searching of structured and unstructured data using coprocessors
US7844608B2 (en) * 2006-12-15 2010-11-30 Yahoo! Inc. Clustered query support for a database query engine
JP2010517779A (ja) 2007-02-06 2010-05-27 シーメンス アクチエンゲゼルシヤフト ろう材および超合金における硬ろう付け法
US7657572B2 (en) 2007-03-06 2010-02-02 Microsoft Corporation Selectively utilizing a plurality of disparate solid state storage locations
US20080242315A1 (en) * 2007-03-27 2008-10-02 Gm Global Technology Operations, Inc. Traffic data collection utilizing a cellular communication network and probe units
US20080256549A1 (en) * 2007-04-10 2008-10-16 International Business Machines Corporation System and Method of Planning for Cooperative Information Processing
US8892624B2 (en) * 2007-04-10 2014-11-18 International Business Machines Corporation Method for the interoperation of virtual organizations
US7716183B2 (en) * 2007-04-11 2010-05-11 Dot Hill Systems Corporation Snapshot preserved data cloning
US8706914B2 (en) 2007-04-23 2014-04-22 David D. Duchesneau Computing infrastructure
US8015180B2 (en) * 2007-05-18 2011-09-06 Oracle International Corp. Queries with hard time constraints
CN101093559B (zh) * 2007-06-12 2010-06-23 北京科技大学 一种基于知识发现的专家系统构造方法
US8819080B2 (en) * 2007-06-13 2014-08-26 The Boeing Company System and method for collection, retrieval, and distribution of data
JP5011006B2 (ja) * 2007-07-03 2012-08-29 株式会社日立製作所 リソース割当方法、リソース割当プログラム、および、リソース割当装置
US7788233B1 (en) * 2007-07-05 2010-08-31 Amazon Technologies, Inc. Data store replication for entity based partition
US20090010326A1 (en) * 2007-07-05 2009-01-08 Andreas Rossholm Method and apparatus for parallel video decoding
US20090019103A1 (en) * 2007-07-11 2009-01-15 James Joseph Tommaney Method and system for processing a database query
US7984043B1 (en) * 2007-07-24 2011-07-19 Amazon Technologies, Inc. System and method for distributed query processing using configuration-independent query plans
US9424315B2 (en) * 2007-08-27 2016-08-23 Teradata Us, Inc. Methods and systems for run-time scheduling database operations that are executed in hardware
US7966343B2 (en) 2008-04-07 2011-06-21 Teradata Us, Inc. Accessing data in a column store database based on hardware compatible data structures
US8862625B2 (en) 2008-04-07 2014-10-14 Teradata Us, Inc. Accessing data in a column store database based on hardware compatible indexing and replicated reordered columns
JP5196924B2 (ja) * 2007-09-11 2013-05-15 株式会社東芝 データベース処理装置、方法及びプログラム
US8041773B2 (en) * 2007-09-24 2011-10-18 The Research Foundation Of State University Of New York Automatic clustering for self-organizing grids
EP2056562B1 (en) * 2007-11-02 2016-09-07 Alcatel Lucent Resilient service quality in a managed multimedia delivery network
US20090150511A1 (en) * 2007-11-08 2009-06-11 Rna Networks, Inc. Network with distributed shared memory
US8392404B2 (en) * 2007-11-19 2013-03-05 Teradata Us, Inc. Dynamic query and step routing between systems tuned for different objectives
US8095512B2 (en) * 2007-11-19 2012-01-10 International Business Machines Corporation Managing database resources used for optimizing query execution on a parallel computer system
CN101453398A (zh) * 2007-12-06 2009-06-10 怀特威盛软件公司 一种新型分布式网格超级计算系统及方法
US8150850B2 (en) * 2008-01-07 2012-04-03 Akiban Technologies, Inc. Multiple dimensioned database architecture
US8805949B2 (en) 2008-01-16 2014-08-12 Netapp, Inc. System and method for populating a cache using behavioral adaptive policies
US7925656B2 (en) * 2008-03-07 2011-04-12 International Business Machines Corporation Node level hash join for evaluating a query
US8386540B1 (en) * 2008-03-31 2013-02-26 Amazon Technologies, Inc. Scalable relational database service
EP2112799A1 (en) * 2008-04-25 2009-10-28 Koninklijke KPN N.V. Service integrity handling in an IMS-based system
US7930322B2 (en) 2008-05-27 2011-04-19 Microsoft Corporation Text based schema discovery and information extraction
US8073840B2 (en) 2008-06-17 2011-12-06 Attivio, Inc. Querying joined data within a search engine index
US20100011368A1 (en) * 2008-07-09 2010-01-14 Hiroshi Arakawa Methods, systems and programs for partitioned storage resources and services in dynamically reorganized storage platforms
US8813091B2 (en) 2008-08-04 2014-08-19 Oracle America, Inc. Distribution data structures for locality-guided work stealing
US8214329B2 (en) 2008-08-26 2012-07-03 Zeewise, Inc. Remote data collection systems and methods
US8032707B2 (en) 2008-09-15 2011-10-04 Microsoft Corporation Managing cache data and metadata
JP5484471B2 (ja) * 2008-09-19 2014-05-07 オラクル・インターナショナル・コーポレイション 記憶側記憶要求管理
CN101685449B (zh) * 2008-09-26 2012-07-11 国际商业机器公司 一种用于连接多个异构分布式数据库中的表的方法和系统
US7738454B1 (en) 2008-09-30 2010-06-15 Juniper Networks, Inc. Methods and apparatus related to packet classification based on range values
US9069613B2 (en) * 2008-09-30 2015-06-30 Hewlett-Packard Development Company, L.P. Processing batch database workload while avoiding overload
US20100082599A1 (en) * 2008-09-30 2010-04-01 Goetz Graefe Characterizing Queries To Predict Execution In A Database
US8505015B2 (en) 2008-10-29 2013-08-06 Teradata Us, Inc. Placing a group work item into every prioritized work queue of multiple parallel processing units based on preferred placement of the work queues
US8566821B2 (en) * 2008-11-11 2013-10-22 Netapp Inc. Cloning virtual machines
US8214352B2 (en) * 2008-11-26 2012-07-03 Hewlett-Packard Development Company Modular query optimizer
JP4688111B2 (ja) * 2008-11-28 2011-05-25 インターナショナル・ビジネス・マシーンズ・コーポレーション 情報処理装置、データベース・システム、情報処理方法、およびプログラム
US8762367B2 (en) 2008-12-08 2014-06-24 Teradata Us, Inc. Accurate and timely enforcement of system resource allocation rules
JP5257843B2 (ja) 2008-12-12 2013-08-07 日本電気株式会社 分散キャッシュシステム、方法、プログラム、及び計算ノード
US8099411B2 (en) * 2008-12-15 2012-01-17 Teradata Us, Inc. System, method, and computer-readable medium for applying conditional resource throttles to facilitate workload management in a database system
US8301650B1 (en) 2008-12-19 2012-10-30 Google, Inc. Bloom filter compaction
JP5273718B2 (ja) 2008-12-22 2013-08-28 花王株式会社 電子写真用トナーの製造方法
US8762642B2 (en) 2009-01-30 2014-06-24 Twinstrata Inc System and method for secure and reliable multi-cloud data replication
US8666966B2 (en) * 2009-01-30 2014-03-04 Hewlett-Packard Development Company, L.P. Providing parallel result streams for database queries
US8055651B2 (en) * 2009-02-10 2011-11-08 International Business Machines Corporation Distribution of join operations on a multi-node computer system
WO2010099513A2 (en) * 2009-02-27 2010-09-02 Coach Wei Adaptive network with automatic scaling
WO2010102084A2 (en) * 2009-03-05 2010-09-10 Coach Wei System and method for performance acceleration, data protection, disaster recovery and on-demand scaling of computer applications
US9207984B2 (en) * 2009-03-31 2015-12-08 Amazon Technologies, Inc. Monitoring and automatic scaling of data volumes
US10163140B2 (en) 2009-04-10 2018-12-25 Shipwire, Inc. Online merchants to third party warehouse providers broker and order fulfillment system
US20100274750A1 (en) 2009-04-22 2010-10-28 Microsoft Corporation Data Classification Pipeline Including Automatic Classification Rules
US8290972B1 (en) 2009-04-29 2012-10-16 Netapp, Inc. System and method for storing and accessing data using a plurality of probabilistic data structures
WO2010127365A1 (en) * 2009-05-01 2010-11-04 Citrix Systems, Inc. Systems and methods for establishing a cloud bridge between virtual storage resources
US8161244B2 (en) * 2009-05-13 2012-04-17 Microsoft Corporation Multiple cache directories
US8577892B2 (en) * 2009-06-05 2013-11-05 Microsoft Corporation Utilizing affinity groups to allocate data items and computing resources
US9852011B1 (en) * 2009-06-26 2017-12-26 Turbonomic, Inc. Managing resources in virtualization systems
US9836504B2 (en) * 2009-06-30 2017-12-05 Hewlett Packard Enterprise Development Lp Query progress estimation based on processed value packets
US8285681B2 (en) * 2009-06-30 2012-10-09 Commvault Systems, Inc. Data object store and server for a cloud storage environment, including data deduplication and data management across multiple cloud storage sites
US8458799B2 (en) * 2009-06-30 2013-06-04 Nokia Corporation Method and apparatus for providing a scalable service platform using a network cache
US8352945B2 (en) * 2009-08-11 2013-01-08 International Business Machines Corporation System, method, and apparatus for scan-sharing for business intelligence queries in an in-memory database
JP5440067B2 (ja) * 2009-09-18 2014-03-12 富士通株式会社 キャッシュメモリ制御装置およびキャッシュメモリ制御方法
US8706715B2 (en) 2009-10-05 2014-04-22 Salesforce.Com, Inc. Methods and systems for joining indexes for query optimization in a multi-tenant database
US8620903B2 (en) * 2009-11-04 2013-12-31 Nec Laboratories America, Inc. Database distribution system and methods for scale-out applications
KR102066532B1 (ko) 2009-11-06 2020-01-15 가부시키가이샤 한도오따이 에네루기 켄큐쇼 반도체 장치
US8688683B2 (en) * 2009-11-30 2014-04-01 Business Objects Software Ltd. Query plan reformulation
US8495250B2 (en) 2009-12-16 2013-07-23 International Business Machines Corporation Asynchronous file operations in a scalable multi-node file system cache for a remote cluster file system
US8458239B2 (en) 2009-12-16 2013-06-04 International Business Machines Corporation Directory traversal in a scalable multi-node file system cache for a remote cluster file system
US8200812B2 (en) 2009-12-31 2012-06-12 International Business Machines Corporation Reducing workload on a backend system using client side request throttling
US8631403B2 (en) * 2010-01-04 2014-01-14 Vmware, Inc. Method and system for managing tasks by dynamically scaling centralized virtual center in virtual infrastructure
US20110167033A1 (en) * 2010-01-05 2011-07-07 Strelitz David Allocating resources in a data warehouse
US8260768B2 (en) * 2010-01-29 2012-09-04 Hewlett-Packard Development Company, L.P. Transformation of directed acyclic graph query plans to linear query plans
US8621145B1 (en) 2010-01-29 2013-12-31 Netapp, Inc. Concurrent content management and wear optimization for a non-volatile solid-state cache
US9058334B2 (en) * 2010-02-11 2015-06-16 Emc Corporation Parallel file system processing
US8464255B2 (en) * 2010-03-12 2013-06-11 Microsoft Corporation Managing performance interference effects on cloud computing servers
US8458191B2 (en) 2010-03-15 2013-06-04 International Business Machines Corporation Method and system to store RDF data in a relational store
US8996563B2 (en) 2010-04-06 2015-03-31 Tokutek, Inc. High-performance streaming dictionary
US8949834B2 (en) * 2010-04-07 2015-02-03 Yahoo! Inc. Modeling and scheduling asynchronous incremental workflows
US8572612B2 (en) * 2010-04-14 2013-10-29 International Business Machines Corporation Autonomic scaling of virtual machines in a cloud computing environment
US8341363B2 (en) 2010-05-03 2012-12-25 Panzura, Inc. Efficient cloud network attached storage
US9852150B2 (en) * 2010-05-03 2017-12-26 Panzura, Inc. Avoiding client timeouts in a distributed filesystem
US8799413B2 (en) 2010-05-03 2014-08-05 Panzura, Inc. Distributing data for a distributed filesystem across multiple cloud storage systems
WO2011140633A1 (en) * 2010-05-10 2011-11-17 Pravala Inc. Scalable reliable failover in a network
US8732473B2 (en) * 2010-06-01 2014-05-20 Microsoft Corporation Claim based content reputation service
US8935232B2 (en) * 2010-06-04 2015-01-13 Yale University Query execution systems and methods
US8874853B2 (en) * 2010-06-04 2014-10-28 International Business Machines Corporation Local and global memory request predictor
JP5332065B2 (ja) 2010-06-11 2013-11-06 株式会社日立製作所 クラスタ構成管理方法、管理装置及びプログラム
US20110314001A1 (en) * 2010-06-18 2011-12-22 Microsoft Corporation Performing query expansion based upon statistical analysis of structured data
US8898324B2 (en) * 2010-06-24 2014-11-25 International Business Machines Corporation Data access management in a hybrid memory server
US9075665B2 (en) * 2010-06-29 2015-07-07 International Business Machines Corporation Smoothing peak system load via behavior prediction in collaborative systems with temporal data access patterns
US8381015B2 (en) 2010-06-30 2013-02-19 International Business Machines Corporation Fault tolerance for map/reduce computing
US20120005307A1 (en) 2010-06-30 2012-01-05 Abhik Das Storage virtualization
CN107608755A (zh) 2010-07-01 2018-01-19 纽戴纳公司 为了优化群集特定配置的使用而按进程类型在群集之间分割进程
EP2596430B1 (en) * 2010-07-21 2019-06-19 Sqream Technologies Ltd A system and method for the parallel execution of database queries over cpus and multi core processors
CN101916261B (zh) 2010-07-28 2013-07-17 北京播思软件技术有限公司 一种分布式并行数据库系统的数据分区方法
JP5556498B2 (ja) 2010-08-17 2014-07-23 富士通株式会社 管理装置,ファイルサーバシステム,処理方法及び管理プログラム
US8290936B2 (en) * 2010-08-17 2012-10-16 International Business Machines Corporation Executing a query plan with display of intermediate results
US8832130B2 (en) * 2010-08-19 2014-09-09 Infosys Limited System and method for implementing on demand cloud database
US8775425B2 (en) * 2010-08-24 2014-07-08 International Business Machines Corporation Systems and methods for massive structured data management over cloud aware distributed file system
US8640137B1 (en) * 2010-08-30 2014-01-28 Adobe Systems Incorporated Methods and apparatus for resource management in cluster computing
US20120059817A1 (en) * 2010-09-07 2012-03-08 Teradata Us, Inc. Method for increasing the efficiency of synchronized scans through intelligent query dispatching
US8428087B1 (en) 2010-09-17 2013-04-23 Amazon Technologies, Inc. Framework for stateless packet tunneling
US8661120B2 (en) * 2010-09-21 2014-02-25 Amazon Technologies, Inc. Methods and systems for dynamically managing requests for computing capacity
US9705730B1 (en) * 2013-05-07 2017-07-11 Axcient, Inc. Cloud storage using Merkle trees
EP2442228A1 (en) * 2010-10-13 2012-04-18 Thomas Lippert A computer cluster arrangement for processing a computaton task and method for operation thereof
US9483313B2 (en) * 2010-10-19 2016-11-01 Microsoft Technology Licensing, Llc Availability management for reference data services
US20120101860A1 (en) 2010-10-25 2012-04-26 Ezzat Ahmed K Providing business intelligence
US20120036146A1 (en) * 2010-10-26 2012-02-09 ParElastic Corporation Apparatus for elastic database processing with heterogeneous data
US9645839B2 (en) 2010-10-27 2017-05-09 Microsoft Technology Licensing, Llc Stateful applications operating in a stateless cloud computing environment
US20120109868A1 (en) * 2010-11-01 2012-05-03 Microsoft Corporation Real-Time Adaptive Output
US9253016B2 (en) * 2010-11-02 2016-02-02 International Business Machines Corporation Management of a data network of a computing environment
US20140332328A1 (en) 2010-11-05 2014-11-13 Brian F. Albert Railroad car hand brake release system
JP5948340B2 (ja) * 2010-11-22 2016-07-06 ヒタチ データ システムズ エンジニアリング ユーケー リミテッドHitachi Data Systems Engineering Uk Limited データストレージシステムにおける、ファイルのクローニング及びデクローニング
WO2012074529A1 (en) * 2010-12-03 2012-06-07 Hewlett-Packard Development Company, L.P. Systems and methods for performing a nested join operation
JP5659757B2 (ja) * 2010-12-09 2015-01-28 日本電気株式会社 分散データベース管理システム、分散データベース管理方法
US9058211B2 (en) * 2010-12-09 2015-06-16 Verizon Patent And Licensing Inc. Pre-validation in a computing on demand system
US8560887B2 (en) 2010-12-09 2013-10-15 International Business Machines Corporation Adding scalability and fault tolerance to generic finite state machine frameworks for use in automated incident management of cloud computing infrastructures
US20120151479A1 (en) 2010-12-10 2012-06-14 Salesforce.Com, Inc. Horizontal splitting of tasks within a homogenous pool of virtual machines
US20120158650A1 (en) * 2010-12-16 2012-06-21 Sybase, Inc. Distributed data cache database architecture
US9395957B2 (en) * 2010-12-22 2016-07-19 Microsoft Technology Licensing, Llc Agile communication operator
US8478743B2 (en) * 2010-12-23 2013-07-02 Microsoft Corporation Asynchronous transfer of state information between continuous query plans
KR101473317B1 (ko) * 2010-12-23 2014-12-17 주식회사 케이티 클라우드 컴퓨팅 시스템 및 클라우드 컴퓨팅 시스템에서의 트래픽 분산 방법 및 제어 방법
US8527497B2 (en) 2010-12-30 2013-09-03 Facebook, Inc. Composite term index for graph data
US9407516B2 (en) * 2011-01-10 2016-08-02 Storone Ltd. Large scale storage system
US8768878B2 (en) * 2011-01-21 2014-07-01 International Business Machines Corporation Characterizing business intelligence workloads
US8595839B2 (en) * 2011-01-21 2013-11-26 International Business Machines Corporation Selecting one of a plurality of scanner nodes to perform scan operations for an interface node receiving a file request
US8538954B2 (en) * 2011-01-25 2013-09-17 Hewlett-Packard Development Company, L.P. Aggregate function partitions for distributed processing
CA2825393C (en) * 2011-01-28 2019-03-12 Level 3 Communications, Llc Content delivery network with deep caching infrastructure
US20120204187A1 (en) 2011-02-08 2012-08-09 International Business Machines Corporation Hybrid Cloud Workload Management
US8516355B2 (en) 2011-02-16 2013-08-20 Invensys Systems, Inc. System and method for fault tolerant computing using generic hardware
US20130205028A1 (en) 2012-02-07 2013-08-08 Rackspace Us, Inc. Elastic, Massively Parallel Processing Data Warehouse
US20120233315A1 (en) 2011-03-11 2012-09-13 Hoffman Jason A Systems and methods for sizing resources in a cloud-based environment
WO2012125166A1 (en) * 2011-03-17 2012-09-20 Hewlett-Packard Development Company L.P. Data source analytics
CN102693168B (zh) 2011-03-22 2014-12-31 中兴通讯股份有限公司 一种数据备份恢复的方法、系统和服务节点
JP2012198843A (ja) 2011-03-23 2012-10-18 Fuji Xerox Co Ltd 仮想サーバ調整システム、仮想サーバ制御装置及びプログラム
US9292523B1 (en) * 2011-03-23 2016-03-22 Emc Corporation Managing data storage
US9535765B1 (en) * 2011-03-28 2017-01-03 Google Inc. Opportunistic job Processing of input data divided into partitions of different sizes
JP5843459B2 (ja) * 2011-03-30 2016-01-13 インターナショナル・ビジネス・マシーンズ・コーポレーションInternational Business Machines Corporation 情報処理システム、情報処理装置、スケーリング方法、プログラムおよび記録媒体
US8789062B2 (en) * 2011-04-05 2014-07-22 Teradata Us, Inc. Workload management of a concurrently accessed database server
US8806159B2 (en) 2011-04-08 2014-08-12 Symantec Corporation Data storage resource management systems and methods
JP5939740B2 (ja) 2011-04-11 2016-06-22 インターナショナル・ビジネス・マシーンズ・コーポレーションInternational Business Machines Corporation 動的にリソースを割り当てる方法、システム及びプログラム
US20120265881A1 (en) 2011-04-14 2012-10-18 Yuan Chen Provisioning data center resources
US20120284307A1 (en) 2011-05-06 2012-11-08 Gopogo, Llc String Searching Systems and Methods Thereof
JP6082387B2 (ja) 2011-05-14 2017-02-15 ビットカーサ インコーポレイテッド ユーザ不可知暗号化ファイルのサーバ側非複製化を有するクラウドファイルシステム
JP5610227B2 (ja) 2011-05-18 2014-10-22 株式会社日立製作所 計算機及び識別子管理方法
CN103688259B (zh) 2011-05-19 2017-11-17 甲骨文国际公司 用于通过压缩和纵列存储进行自动数据放置的方法
US20120303633A1 (en) * 2011-05-26 2012-11-29 International Business Machines Corporation Systems and methods for querying column oriented databases
US10380269B2 (en) * 2011-06-07 2019-08-13 Entit Software Llc Sideways information passing
JP5508346B2 (ja) * 2011-06-13 2014-05-28 日本電信電話株式会社 分散データ管理システム、分散データ管理方法及び分散データ管理プログラム
US20120323971A1 (en) 2011-06-14 2012-12-20 Sybase, Inc. Optimizing data storage and access of an in-memory database
US9027022B2 (en) * 2011-06-16 2015-05-05 Argyle Data, Inc. Software virtual machine for acceleration of transactional data processing
US20120324456A1 (en) * 2011-06-16 2012-12-20 Microsoft Corporation Managing nodes in a high-performance computing system using a node registrar
US8725875B2 (en) 2011-06-21 2014-05-13 Intel Corporation Native cloud computing via network segmentation
CN102843403A (zh) * 2011-06-23 2012-12-26 盛大计算机(上海)有限公司 基于分布式文件系统的文件处理方法、系统及客户端
US9450838B2 (en) * 2011-06-27 2016-09-20 Microsoft Technology Licensing, Llc Resource management for cloud computing platforms
US8997107B2 (en) 2011-06-28 2015-03-31 Microsoft Technology Licensing, Llc Elastic scaling for cloud-hosted batch applications
WO2013006157A1 (en) 2011-07-01 2013-01-10 Hewlett-Packard Development Company, L.P. Method of and system for managing computing resources
CN102868542B (zh) * 2011-07-04 2018-02-16 中兴通讯股份有限公司 一种服务分发网络中服务质量的控制方法及系统
WO2013009503A2 (en) * 2011-07-08 2013-01-17 Yale University Query execution systems and methods
US20130013585A1 (en) * 2011-07-08 2013-01-10 Goetz Graefe Hash join and hash aggregation integration system
US10291721B2 (en) * 2011-07-15 2019-05-14 Vmware, Inc. Remote document signing
US8635411B2 (en) * 2011-07-18 2014-01-21 Arm Limited Data processing apparatus and method for managing coherency of cached data
US8676951B2 (en) 2011-07-27 2014-03-18 Hitachi, Ltd. Traffic reduction method for distributed key-value store
JP6552196B2 (ja) 2011-08-02 2019-07-31 アジャイ ジャドハブ クラウドベースの分散永続性及びキャッシュデータモデル
CN102742251A (zh) * 2011-08-11 2012-10-17 华为技术有限公司 一种实现对称多处理系统的节点聚合系统
WO2013025556A1 (en) * 2011-08-12 2013-02-21 Splunk Inc. Elastic scaling of data volume
JP5342615B2 (ja) 2011-08-15 2013-11-13 株式会社日立システムズ 仮想サーバ制御システム及びプログラム
US8631131B2 (en) * 2011-09-07 2014-01-14 Red Hat Israel, Ltd. Virtual machine pool cache
US9298773B2 (en) * 2011-09-12 2016-03-29 Hewlett Packard Enterprise Development Lp Nested complex sequence pattern queries over event streams
US9043310B2 (en) * 2011-11-08 2015-05-26 International Business Machines Corporation Accessing a dimensional data model when processing a query
WO2013072959A1 (en) * 2011-11-15 2013-05-23 Hitachi, Ltd. Computer system and data migration method
ES2427645B1 (es) 2011-11-15 2014-09-02 Telefónica, S.A. Método para gestionar el rendimiento en aplicaciones de múltiples capas implantadas en una infraestructura de tecnología de información
US20130124545A1 (en) 2011-11-15 2013-05-16 Business Objects Software Limited System and method implementing a text analysis repository
US8812895B2 (en) * 2011-11-21 2014-08-19 Verizon Patent And Licensing Inc. System redundancy and site recovery
US9122535B2 (en) 2011-11-22 2015-09-01 Netapp, Inc. Optimizing distributed data analytics for shared storage
US9483491B2 (en) 2011-11-29 2016-11-01 Egnyte, Inc. Flexible permission management framework for cloud attached file systems
CN102496060A (zh) 2011-12-07 2012-06-13 高汉中 基于神经网络的云端智能机系统
US8824787B2 (en) 2011-12-07 2014-09-02 Dunlop Sports Co., Ltd. Silhouette correction method and system and silhouette extraction method and system
TWI461929B (zh) 2011-12-09 2014-11-21 Promise Tecnnology Inc 雲端數據儲存系統
JP6129865B2 (ja) 2011-12-09 2017-05-17 エンパイア テクノロジー ディベロップメント エルエルシー ゲームコンテンツデータの予測的なキャッシング
WO2013096887A1 (en) 2011-12-23 2013-06-27 Amiato, Inc. Scalable analysis platform for semi-structured data
US8938475B2 (en) * 2011-12-27 2015-01-20 Sap Se Managing business objects data sources
US9110947B1 (en) 2011-12-30 2015-08-18 Teradata Us, Inc. Column-oriented task execution in a row-partitioned database system
US8756609B2 (en) 2011-12-30 2014-06-17 International Business Machines Corporation Dynamically scaling multi-tier applications vertically and horizontally in a cloud environment
US8904008B2 (en) 2012-01-09 2014-12-02 Microsoft Corporation Assignment of resources in virtual machine pools
US8732118B1 (en) * 2012-01-13 2014-05-20 Amazon Technologies, Inc. Distributed performance of data aggregation operations
US20130185729A1 (en) 2012-01-13 2013-07-18 Rutgers, The State University Of New Jersey Accelerating resource allocation in virtualized environments using workload classes and/or workload signatures
US9009319B2 (en) * 2012-01-18 2015-04-14 Rackspace Us, Inc. Optimizing allocation of on-demand resources using performance
US9239851B1 (en) * 2012-07-12 2016-01-19 Cross Commerce Media, Inc. Advanced database systems and methods
JP5817558B2 (ja) 2012-01-27 2015-11-18 富士通株式会社 情報処理装置、分散処理システム、キャッシュ管理プログラムおよび分散処理方法
US9116812B2 (en) * 2012-01-27 2015-08-25 Intelligent Intellectual Property Holdings 2 Llc Systems and methods for a de-duplication cache
WO2013119195A1 (en) 2012-02-06 2013-08-15 Empire Technology Development Llc Multicore computer system with cache use based adaptive scheduling
US8553552B2 (en) * 2012-02-08 2013-10-08 Radisys Corporation Stateless load balancer in a multi-node system for transparent processing with packet preservation
US20130218837A1 (en) 2012-02-16 2013-08-22 Verizon Patent And Licensing Inc. Cloud data synchronization with local data
US9946563B2 (en) * 2012-02-21 2018-04-17 Disney Enterprises, Inc. Batch scheduler management of virtual machines
US9268590B2 (en) 2012-02-29 2016-02-23 Vmware, Inc. Provisioning a cluster of distributed computing platform based on placement strategy
JP5957965B2 (ja) * 2012-03-02 2016-07-27 日本電気株式会社 仮想化システム、負荷分散装置、負荷分散方法、及び負荷分散プログラム
US10031783B2 (en) * 2012-03-02 2018-07-24 Vmware, Inc. Execution of a distributed deployment plan for a multi-tier application in a cloud infrastructure
JP2013196421A (ja) 2012-03-21 2013-09-30 Nec Corp 仮想化システム、仮想サーバ、メモリ管理方法及びメモリ管理プログラム
EP2828742A4 (en) * 2012-03-22 2016-05-18 Tier 3 Inc SUPPLY IN FLEXIBLE MEMORY
US20130263117A1 (en) * 2012-03-28 2013-10-03 International Business Machines Corporation Allocating resources to virtual machines via a weighted cost ratio
US8595262B1 (en) * 2012-03-29 2013-11-26 Amazon Technologies, Inc. Resource resolution in computing environments using directed graphs
US9639575B2 (en) * 2012-03-30 2017-05-02 Khalifa University Of Science, Technology And Research Method and system for processing data queries
US9020890B2 (en) * 2012-03-30 2015-04-28 Commvault Systems, Inc. Smart archiving and data previewing for mobile devices
US20130262433A1 (en) * 2012-04-02 2013-10-03 James Qiu Filtering a Distributed Join
US9501550B2 (en) * 2012-04-18 2016-11-22 Renmin University Of China OLAP query processing method oriented to database and HADOOP hybrid platform
US9465829B2 (en) 2012-04-30 2016-10-11 Sap Se Partial merge
US9124612B2 (en) * 2012-05-15 2015-09-01 Splunk Inc. Multi-site clustering
US8954419B2 (en) * 2012-05-22 2015-02-10 Oracle International Corporation Method for serial and condition-based execution of operators by parallel processes
US8904402B2 (en) * 2012-05-30 2014-12-02 Red Hat, Inc. Controlling capacity in a multi-tenant platform-as-a-service environment in a cloud computing system
US8965921B2 (en) * 2012-06-06 2015-02-24 Rackspace Us, Inc. Data management and indexing across a distributed database
US10341435B2 (en) 2012-06-12 2019-07-02 Centurylink Intellectual Property Llc High performance cloud storage
US9355146B2 (en) * 2012-06-29 2016-05-31 International Business Machines Corporation Efficient partitioned joins in a database with column-major layout
US10339056B2 (en) 2012-07-03 2019-07-02 Sandisk Technologies Llc Systems, methods and apparatus for cache transfers
EP2682878A1 (en) * 2012-07-04 2014-01-08 Software AG Method of processing relational queries in a database system and corresponding database system
US9396008B2 (en) * 2012-07-13 2016-07-19 Ca, Inc. System and method for continuous optimization of computing systems with automated assignment of virtual machines and physical machines to hosts
US9529808B1 (en) * 2012-07-16 2016-12-27 Tintri Inc. Efficient and flexible organization and management of file metadata
US10528262B1 (en) * 2012-07-26 2020-01-07 EMC IP Holding Company LLC Replication-based federation of scalable data across multiple sites
CN104756078B (zh) * 2012-08-20 2018-07-13 唐纳德·凯文·卡梅伦 处理资源分配的装置和方法
US9563480B2 (en) 2012-08-21 2017-02-07 Rackspace Us, Inc. Multi-level cloud computing system
US9594823B2 (en) * 2012-08-22 2017-03-14 Bitvore Corp. Data relationships storage platform
US9396231B2 (en) * 2012-09-04 2016-07-19 Salesforce.Com, Inc. Facilitating dynamically controlled fetching of data at client computing devices in an on-demand services environment
US20140067852A1 (en) * 2012-09-06 2014-03-06 salesforce.com,inc. Mechanism for facilitating scaling and efficient management of database systems and resources in an on-demand services environment
US9164702B1 (en) * 2012-09-07 2015-10-20 Google Inc. Single-sided distributed cache system
US10169446B1 (en) 2012-09-10 2019-01-01 Amazon Technologies, Inc. Relational modeler and renderer for non-relational data
US9268605B2 (en) * 2012-09-12 2016-02-23 Salesforce.Com, Inc. Mechanism for facilitating sliding window resource tracking in message queues for fair management of resources for application servers in an on-demand services environment
US9106721B2 (en) 2012-10-02 2015-08-11 Nextbit Systems Application state synchronization across multiple devices
US9292568B2 (en) * 2012-10-10 2016-03-22 Dell Products L.P. Method and system for dynamically optimizing client queries to read-mostly servers
US9405579B2 (en) 2012-10-11 2016-08-02 International Business Machines Corporation Seamless extension of local computing power
TW201416873A (zh) 2012-10-19 2014-05-01 Apacer Technology Inc 網路儲存系統的檔案分享方法
US9514208B2 (en) * 2012-10-30 2016-12-06 Vekatachary Srinivasan Method and system of stateless data replication in a distributed database system
US9847907B2 (en) * 2012-11-26 2017-12-19 Amazon Technologies, Inc. Distributed caching cluster management
US9449040B2 (en) * 2012-11-26 2016-09-20 Amazon Technologies, Inc. Block restore ordering in a streaming restore system
WO2014087518A1 (ja) 2012-12-06 2014-06-12 株式会社 日立製作所 ネットワークシステム及びその運用方法
US9654354B2 (en) * 2012-12-13 2017-05-16 Level 3 Communications, Llc Framework supporting content delivery with delivery services network
US9268834B2 (en) * 2012-12-13 2016-02-23 Microsoft Technology Licensing, Llc Distributed SQL query processing using key-value storage system
US9189285B2 (en) * 2012-12-14 2015-11-17 Microsoft Technology Licensing, Llc Scalable services deployment
US9152642B2 (en) * 2012-12-21 2015-10-06 Zetta, Inc. Systems and methods for on-demand data storage
US9021452B2 (en) * 2012-12-27 2015-04-28 Commvault Systems, Inc. Automatic identification of storage requirements, such as for use in selling data storage management solutions
US10346259B2 (en) * 2012-12-28 2019-07-09 Commvault Systems, Inc. Data recovery using a cloud-based remote data recovery center
US9081826B2 (en) * 2013-01-07 2015-07-14 Facebook, Inc. System and method for distributed database query engines
US9703584B2 (en) * 2013-01-08 2017-07-11 Commvault Systems, Inc. Virtual server agent load balancing
US9158812B2 (en) * 2013-01-30 2015-10-13 Oracle International Corporation Enhancing parallelism in evaluation ranking/cumulative window functions
US9665477B2 (en) * 2013-02-01 2017-05-30 International Business Machines Corporation Allocating additional requested storage space for a data set in a first managed space in a second managed space
US9553773B2 (en) 2013-02-05 2017-01-24 Cisco Technology, Inc. Learning machine based computation of network join times
US9336272B1 (en) * 2013-02-13 2016-05-10 Amazon Technologies, Inc. Global query hint specification
US10339157B2 (en) * 2013-02-13 2019-07-02 Facebook, Inc. Hive table links
US9928287B2 (en) * 2013-02-24 2018-03-27 Technion Research & Development Foundation Limited Processing query to graph database
US9454573B1 (en) * 2013-02-25 2016-09-27 Emc Corporation Parallel processing database system with a shared metadata store
US9275110B2 (en) * 2013-03-01 2016-03-01 Paraccel Llc Disk-based hash join process
US9049193B2 (en) * 2013-03-05 2015-06-02 Vmware, Inc. Method and system for distributing resource-availability information within a distrubited computer system
US9773041B2 (en) * 2013-03-06 2017-09-26 Oracle International Corporation Methods and apparatus of shared expression evaluation across RDBMS and storage layer
US10248670B1 (en) * 2013-03-14 2019-04-02 Open Text Corporation Method and system for migrating content between enterprise content management systems
US20140280964A1 (en) * 2013-03-15 2014-09-18 Gravitant, Inc. Systems, methods and computer readable mediums for implementing cloud service brokerage platform functionalities
US10296462B2 (en) 2013-03-15 2019-05-21 Oracle International Corporation Method to accelerate queries using dynamically generated alternate data formats in flash cache
US10019481B2 (en) * 2013-03-15 2018-07-10 Oracle International Corporation Adaptive selection of a distribution method during execution of parallel join operations
US9639562B2 (en) * 2013-03-15 2017-05-02 Oracle International Corporation Automatically determining an optimal database subsection
US9118538B1 (en) * 2013-03-15 2015-08-25 Emc Corporation Method and system for configuring resources to enable resource monitoring
US9176895B2 (en) * 2013-03-16 2015-11-03 Intel Corporation Increased error correction for cache memories through adaptive replacement policies
US9645811B2 (en) * 2013-04-01 2017-05-09 Oc Acquisition Llc Fault tolerance for a distributed computing system
US9172621B1 (en) * 2013-04-01 2015-10-27 Amazon Technologies, Inc. Unified account metadata management
US9495395B2 (en) * 2013-04-11 2016-11-15 Oracle International Corporation Predictive diagnosis of SLA violations in cloud services by seasonal trending and forecasting with thread intensity analytics
US9304663B1 (en) * 2013-04-12 2016-04-05 Groupon, Inc. Centralized, scalable, resource monitoring system
US9213726B2 (en) * 2013-04-15 2015-12-15 Amazon Technologies, Inc. Database cost tracing and analysis
US9690829B2 (en) 2013-04-15 2017-06-27 Vmware, Inc. Dynamic load balancing during distributed query processing using query operator motion
US9448966B2 (en) * 2013-04-26 2016-09-20 Futurewei Technologies, Inc. System and method for creating highly scalable high availability cluster in a massively parallel processing cluster of machines in a network
US9208032B1 (en) * 2013-05-15 2015-12-08 Amazon Technologies, Inc. Managing contingency capacity of pooled resources in multiple availability zones
US9582297B2 (en) * 2013-05-16 2017-02-28 Vmware, Inc. Policy-based data placement in a virtualized computing environment
CN203261358U (zh) 2013-05-28 2013-10-30 马传志 一种基于遗传算法的云计算服务器群
CN103279351B (zh) * 2013-05-31 2016-06-29 北京高森明晨信息科技有限公司 一种任务调度的方法及装置
US9280551B2 (en) * 2013-06-03 2016-03-08 International Business Machines Corporation De-duplication deployment planning
US9213706B2 (en) * 2013-06-13 2015-12-15 DataGravity, Inc. Live restore for a data intelligent storage system
US8849764B1 (en) * 2013-06-13 2014-09-30 DataGravity, Inc. System and method of data intelligent storage
US9146979B2 (en) * 2013-06-13 2015-09-29 Sap Se Optimization of business warehouse queries by calculation engines
JP6132980B2 (ja) * 2013-06-19 2017-05-24 株式会社日立製作所 非集中的な分散型コンピューティング・システム
US20140379725A1 (en) * 2013-06-19 2014-12-25 Microsoft Corporation On demand parallelism for columnstore index build
US9600500B1 (en) * 2013-06-21 2017-03-21 Amazon Technologies, Inc. Single phase transaction commits for distributed database transactions
US10282350B1 (en) * 2013-06-21 2019-05-07 Amazon Technologies, Inc. Data store optimizer
US20140379691A1 (en) * 2013-06-21 2014-12-25 Microsoft Corporation Database query processing with reduce function configuration
GB2515501A (en) * 2013-06-25 2014-12-31 Ibm Replication for on-line hot-standby database
US20150006254A1 (en) * 2013-06-26 2015-01-01 Landvoice Data, LLC Systems apparatus and methods for real estate sales lead generation
US8706798B1 (en) * 2013-06-28 2014-04-22 Pepperdata, Inc. Systems, methods, and devices for dynamic resource monitoring and allocation in a cluster system
EP3017386B1 (en) * 2013-07-02 2020-04-15 Convida Wireless, LLC Mechanisms for semantics publishing and discovery
US9659046B2 (en) * 2013-07-31 2017-05-23 Oracle Inernational Corporation Probing a hash table using vectorized instructions
US9256631B2 (en) * 2013-07-31 2016-02-09 Oracle International Corporation Building a hash table using vectorized instructions
US9338226B2 (en) * 2013-08-12 2016-05-10 Fred Korangy Actor system and method for analytics and processing of big data
US10133797B1 (en) * 2013-08-16 2018-11-20 Amazon Technologies, Inc. Distributed heterogeneous system for data warehouse management
US10089142B2 (en) * 2013-08-21 2018-10-02 Hasso-Plattner-Institut Fur Softwaresystemtechnik Gmbh Dynamic task prioritization for in-memory databases
US9489423B1 (en) * 2013-08-22 2016-11-08 Amazon Technologies, Inc. Query data acquisition and analysis
US11423377B1 (en) * 2013-08-26 2022-08-23 Amazon Technologies, Inc. Lendable computing resources
US9870269B1 (en) * 2013-09-05 2018-01-16 Amazon Technologies, Inc. Job allocation in a clustered environment
US9471711B2 (en) * 2013-09-23 2016-10-18 Teradata Us, Inc. Schema-less access to stored data
US9424300B2 (en) * 2013-09-25 2016-08-23 International Business Machines Corporation Data allocation containers in a partitioned table of a computer database system for holding data based on usage
US9379982B1 (en) * 2013-09-30 2016-06-28 Juniper Networks, Inc. Adaptive stateless load balancing
US10031761B2 (en) * 2013-10-11 2018-07-24 International Business Machines Corporation Pluggable cloud enablement boot device and method
US9740797B2 (en) 2013-10-14 2017-08-22 Inha-Industry Partnership Institute Counting bloom filter
US10552745B2 (en) * 2013-10-18 2020-02-04 Netflix, Inc. Predictive auto scaling engine
US10642800B2 (en) * 2013-10-25 2020-05-05 Vmware, Inc. Multi-tenant distributed computing and database
US20150120555A1 (en) * 2013-10-29 2015-04-30 Elwha Llc Exchange authorization analysis infused with network-acquired data stream information
US20150120224A1 (en) * 2013-10-29 2015-04-30 C3 Energy, Inc. Systems and methods for processing data relating to energy usage
US9880933B1 (en) * 2013-11-20 2018-01-30 Amazon Technologies, Inc. Distributed in-memory buffer cache system using buffer cache nodes
US10776325B2 (en) * 2013-11-26 2020-09-15 Ab Initio Technology Llc Parallel access to data in a distributed file system
US10198292B2 (en) * 2013-11-27 2019-02-05 Actian Sub Iii, Inc. Scheduling database queries based on elapsed time of queries
US20150163721A1 (en) * 2013-12-11 2015-06-11 Jdsu Uk Limited Method and apparatus for processing data
US20150172204A1 (en) * 2013-12-13 2015-06-18 International Business Machines Corporation Dynamically Change Cloud Environment Configurations Based on Moving Workloads
US9471510B2 (en) * 2013-12-20 2016-10-18 Netapp, Inc. System and method for cache monitoring in storage systems
US9569493B2 (en) * 2013-12-31 2017-02-14 International Business Machines Corporatin Avoidance of intermediate data skew in a massive parallel processing environment
US9256534B2 (en) * 2014-01-06 2016-02-09 International Business Machines Corporation Data shuffling in a non-uniform memory access device
US9514184B2 (en) * 2014-01-14 2016-12-06 Dropbox, Inc. Systems and methods for a high speed query infrastructure
US9535956B2 (en) * 2014-01-31 2017-01-03 Oracle International Corporation Efficient set operation execution using a single group-by operation
US9870390B2 (en) * 2014-02-18 2018-01-16 Oracle International Corporation Selecting from OR-expansion states of a query
US9576039B2 (en) 2014-02-19 2017-02-21 Snowflake Computing Inc. Resource provisioning systems and methods
US10120902B2 (en) 2014-02-20 2018-11-06 Citus Data Bilgi Islemleri Ticaret A.S. Apparatus and method for processing distributed relational algebra operators in a distributed database
US9836505B2 (en) * 2014-03-13 2017-12-05 Sybase, Inc. Star and snowflake join query performance
US9792328B2 (en) * 2014-03-13 2017-10-17 Sybase, Inc. Splitting of a join operation to allow parallelization
US9454574B2 (en) * 2014-03-28 2016-09-27 Sybase, Inc. Bloom filter costing estimation
WO2015183301A1 (en) * 2014-05-30 2015-12-03 Hitachi Data Systems Corporation Metadata favored replication in active topologies
US9996597B2 (en) * 2014-06-06 2018-06-12 The Mathworks, Inc. Unified mapreduce framework for large-scale data processing
CN106537345B (zh) * 2014-06-13 2020-10-13 皮沃塔尔软件公司 在多进程计算环境中精确跟踪内存使用
US10860237B2 (en) * 2014-06-24 2020-12-08 Oracle International Corporation Storage integrated snapshot cloning for database
US9705815B2 (en) * 2014-06-27 2017-07-11 Juniper Networks, Inc. Graph database for services planning and configuration in network services domain
US9335989B2 (en) * 2014-07-13 2016-05-10 International Business Machines Corporation Building a pattern to define a topology and application environment using software components and software updates/fixes from external repositories from multiple vendors
US9621354B2 (en) * 2014-07-17 2017-04-11 Cisco Systems, Inc. Reconstructable content objects
US9747331B2 (en) * 2014-10-06 2017-08-29 International Business Machines Corporation Limiting scans of loosely ordered and/or grouped relations in a database
US9922103B2 (en) * 2014-10-21 2018-03-20 Bank Of America Corporation Copying datasets between data integration systems
US9628350B2 (en) * 2014-11-05 2017-04-18 Amazon Technologies, Inc. Dynamic scaling of storage volumes for storage client file systems
US9256467B1 (en) * 2014-11-11 2016-02-09 Amazon Technologies, Inc. System for managing and scheduling containers
US9417897B1 (en) * 2014-12-05 2016-08-16 Amazon Technologies, Inc. Approaches for managing virtual instance data
US9984081B2 (en) * 2015-01-30 2018-05-29 Oracle International Corporation Workload aware data placement for join-based query processing in a cluster
US10574745B2 (en) * 2015-03-31 2020-02-25 Western Digital Technologies, Inc. Syncing with a local paired device to obtain data from a remote server using point-to-point communication
US9632846B2 (en) 2015-04-02 2017-04-25 Microsoft Technology Licensing, Llc Complex event processor for historic/live/replayed data
US9990392B2 (en) * 2015-04-07 2018-06-05 Sap Se Distributed transaction processing in MPP databases
US9848041B2 (en) * 2015-05-01 2017-12-19 Amazon Technologies, Inc. Automatic scaling of resource instance groups within compute clusters
US20160373405A1 (en) * 2015-06-16 2016-12-22 Amazon Technologies, Inc. Managing dynamic ip address assignments
US9798526B2 (en) * 2015-12-22 2017-10-24 Sap Se Software development using multi-domain decision management
US10585889B2 (en) * 2015-12-23 2020-03-10 Intel Corporation Optimizing skewed joins in big data
US20170270154A1 (en) * 2016-03-18 2017-09-21 At&T Intellectual Property I, L.P. Methods and apparatus to manage database metadata
US10055305B2 (en) * 2016-04-28 2018-08-21 Netapp, Inc. Techniques to perform system management processing for database systems
US10735394B2 (en) * 2016-08-05 2020-08-04 Oracle International Corporation Caching framework for a multi-tenant identity and data security management cloud service
US10325021B2 (en) 2017-06-19 2019-06-18 GM Global Technology Operations LLC Phrase extraction text analysis method and system
US10380112B2 (en) * 2017-07-31 2019-08-13 International Business Machines Corporation Joining two data tables on a join attribute
US10379942B2 (en) * 2017-09-27 2019-08-13 International Business Machines Corporation Efficient transfer of objects between containers on the same vault
US10397317B2 (en) * 2017-09-29 2019-08-27 Oracle International Corporation Boomerang join: a network efficient, late-materialized, distributed join technique
US20220335005A1 (en) * 2021-04-20 2022-10-20 Pure Storage, Inc. Storage-deferred copying between different file systems

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20100235385A1 (en) * 2009-03-10 2010-09-16 Fujitsu Limited Semi-structured data retrieval method, and structured data retrieval device
CN102243629A (zh) * 2010-05-12 2011-11-16 北京安华金和科技有限公司 一种基于多级视图和触发器的数据库透明加解密方法
CN102567378A (zh) * 2010-12-28 2012-07-11 上海杉达学院 基于异构数据的信息检索系统
CN102779114A (zh) * 2011-05-12 2012-11-14 商业对象软件有限公司 利用自动规则生成的非结构化数据支持

Cited By (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107679096A (zh) * 2017-09-08 2018-02-09 北京京东尚科信息技术有限公司 数据集市间指标共享的方法和装置
CN107679096B (zh) * 2017-09-08 2020-06-05 北京京东尚科信息技术有限公司 数据集市间指标共享的方法和装置
CN109685375A (zh) * 2018-12-26 2019-04-26 重庆誉存大数据科技有限公司 一种基于半结构化文本数据的企业风险规则引擎运算方法
CN109685375B (zh) * 2018-12-26 2020-10-30 重庆誉存大数据科技有限公司 一种基于半结构化文本数据的企业风险规则引擎运算方法
CN113507464A (zh) * 2021-07-06 2021-10-15 深圳市吉芯微半导体有限公司 基于虚拟设备的数据访问方法、装置、设备及存储介质
CN113507464B (zh) * 2021-07-06 2023-10-13 深圳市吉芯微半导体有限公司 基于虚拟设备的数据访问方法、装置、设备及存储介质
CN114511149A (zh) * 2022-02-16 2022-05-17 长沙祥云瑞风信息技术有限公司 一种分层分布式气象预测平台、方法、介质及设备
CN114511149B (zh) * 2022-02-16 2022-12-02 长沙祥云瑞风信息技术有限公司 一种分层分布式气象预测平台、方法、介质及设备

Also Published As

Publication number Publication date
US10366102B2 (en) 2019-07-30
JP7130600B2 (ja) 2022-09-05
US20210390117A1 (en) 2021-12-16
EP3910480B1 (en) 2024-04-03
US11734303B2 (en) 2023-08-22
CN106104526A (zh) 2016-11-09
JP6730189B2 (ja) 2020-07-29
JP7163430B2 (ja) 2022-10-31
EP3828723A1 (en) 2021-06-02
EP3722958B1 (en) 2023-04-05
JP2021077406A (ja) 2021-05-20
US9665633B2 (en) 2017-05-30
CA2939919A1 (en) 2015-08-27
DE202015009861U1 (de) 2020-10-23
CA3025939C (en) 2023-08-01
JP2017509066A (ja) 2017-03-30
US20170235750A1 (en) 2017-08-17
EP3108386B1 (en) 2021-06-23
US11238061B2 (en) 2022-02-01
US11250023B2 (en) 2022-02-15
US11429639B2 (en) 2022-08-30
US20210205120A1 (en) 2021-07-08
AU2015219105B2 (en) 2020-03-19
DE202015009860U1 (de) 2020-10-22
US11216484B2 (en) 2022-01-04
US20150234896A1 (en) 2015-08-20
US20230185824A1 (en) 2023-06-15
US11977560B2 (en) 2024-05-07
WO2015126968A2 (en) 2015-08-27
US20150234688A1 (en) 2015-08-20
US20210049189A1 (en) 2021-02-18
WO2015126968A3 (en) 2015-10-15
US20220129480A1 (en) 2022-04-28
US10762106B2 (en) 2020-09-01
US11868369B2 (en) 2024-01-09
US20200226147A1 (en) 2020-07-16
US11048721B2 (en) 2021-06-29
CA2939908A1 (en) 2015-08-27
US11269921B2 (en) 2022-03-08
US11010407B2 (en) 2021-05-18
US11354334B2 (en) 2022-06-07
EP3108364A4 (en) 2017-11-22
US10534792B2 (en) 2020-01-14
US10949446B2 (en) 2021-03-16
US20220035834A1 (en) 2022-02-03
US20200218733A1 (en) 2020-07-09
US11782950B2 (en) 2023-10-10
CN106233277B (zh) 2019-07-12
EP3108375A1 (en) 2016-12-28
CA2939947A1 (en) 2015-08-27
CN106233263B (zh) 2019-12-24
CA2939903A1 (en) 2015-08-27
US11755617B2 (en) 2023-09-12
JP2017512338A (ja) 2017-05-18
US10776390B2 (en) 2020-09-15
EP3108385B1 (en) 2021-06-30
US11176168B2 (en) 2021-11-16
US20200327143A1 (en) 2020-10-15
AU2015219106A1 (en) 2016-09-01
US20200210449A1 (en) 2020-07-02
US20210342365A1 (en) 2021-11-04
EP3108363A1 (en) 2016-12-28
CN110308994A (zh) 2019-10-08
CN109564564A (zh) 2019-04-02
US11687563B2 (en) 2023-06-27
US11429638B2 (en) 2022-08-30
US20220019599A1 (en) 2022-01-20
EP3916562A1 (en) 2021-12-01
US10891306B2 (en) 2021-01-12
US20210073245A1 (en) 2021-03-11
US20220067068A1 (en) 2022-03-03
US20220129478A1 (en) 2022-04-28
US20210103601A1 (en) 2021-04-08
US11573978B2 (en) 2023-02-07
US10733208B1 (en) 2020-08-04
US11334597B2 (en) 2022-05-17
WO2015126973A3 (en) 2015-11-12
WO2015126973A2 (en) 2015-08-27
US20210089554A1 (en) 2021-03-25
EP3108374A2 (en) 2016-12-28
US20210357425A1 (en) 2021-11-18
US20230205783A1 (en) 2023-06-29
US11734307B2 (en) 2023-08-22
US11599556B2 (en) 2023-03-07
US20210103600A1 (en) 2021-04-08
US10846304B2 (en) 2020-11-24
US11341162B2 (en) 2022-05-24
US11157515B2 (en) 2021-10-26
US20150234931A1 (en) 2015-08-20
US20220156283A1 (en) 2022-05-19
AU2017274448A1 (en) 2018-12-13
US11269920B2 (en) 2022-03-08
AU2015218936A1 (en) 2016-09-01
AU2017274448B2 (en) 2020-02-20
AU2015219105A1 (en) 2016-09-01
CA2939906C (en) 2022-10-25
US10838978B2 (en) 2020-11-17
JP2017506394A (ja) 2017-03-02
US11620308B2 (en) 2023-04-04
US20210103602A1 (en) 2021-04-08
JP2017506396A (ja) 2017-03-02
DE202015009873U1 (de) 2020-12-11
US11157516B2 (en) 2021-10-26
US11544287B2 (en) 2023-01-03
US11734304B2 (en) 2023-08-22
WO2015126961A1 (en) 2015-08-27
US20200151193A1 (en) 2020-05-14
US10776391B1 (en) 2020-09-15
US20200210448A1 (en) 2020-07-02
CA2939947C (en) 2022-07-12
WO2015127076A1 (en) 2015-08-27
US11321352B2 (en) 2022-05-03
US20220050857A1 (en) 2022-02-17
US11188562B2 (en) 2021-11-30
US20170123854A1 (en) 2017-05-04
US11409768B2 (en) 2022-08-09
EP3108374B1 (en) 2020-12-16
DE202015009784U1 (de) 2020-02-12
CA3025939A1 (en) 2017-12-07
EP3108385A1 (en) 2016-12-28
CN106030573B (zh) 2019-12-24
US20180349457A1 (en) 2018-12-06
US10838979B2 (en) 2020-11-17
CN106233253A (zh) 2016-12-14
JP2019194882A (ja) 2019-11-07
AU2015219106B2 (en) 2020-03-26
US20150234894A1 (en) 2015-08-20
US20240012836A1 (en) 2024-01-11
CA2939919C (en) 2024-01-30
EP3828723B1 (en) 2023-10-25
WO2015126962A1 (en) 2015-08-27
US11269919B2 (en) 2022-03-08
EP3465485A1 (en) 2019-04-10
US20220207054A1 (en) 2022-06-30
EP3926474A1 (en) 2021-12-22
US20220156281A1 (en) 2022-05-19
CN106233255A (zh) 2016-12-14
EP3108386A1 (en) 2016-12-28
US20200364237A1 (en) 2020-11-19
US11487786B2 (en) 2022-11-01
US10866966B2 (en) 2020-12-15
US10055472B2 (en) 2018-08-21
US20240111787A1 (en) 2024-04-04
US11163794B2 (en) 2021-11-02
US20220138224A1 (en) 2022-05-05
DE202015009785U1 (de) 2020-02-12
CN106233253B (zh) 2019-12-24
US11238060B2 (en) 2022-02-01
CN106104526B (zh) 2020-02-04
US20230244693A1 (en) 2023-08-03
US20220027385A1 (en) 2022-01-27
AU2015219103A1 (en) 2016-09-01
US20230042949A1 (en) 2023-02-09
EP3465485A4 (en) 2019-12-25
US20220129479A1 (en) 2022-04-28
US20210124761A1 (en) 2021-04-29
US20190236080A1 (en) 2019-08-01
AU2015219101B2 (en) 2020-07-09
JP7431902B2 (ja) 2024-02-15
US20210248160A1 (en) 2021-08-12
US20210157820A1 (en) 2021-05-27
EP3809270A1 (en) 2021-04-21
CN106233255B (zh) 2019-12-20
US10997201B2 (en) 2021-05-04
US20210049187A1 (en) 2021-02-18
US20220121681A1 (en) 2022-04-21
US20210286825A1 (en) 2021-09-16
US11232130B2 (en) 2022-01-25
CA2939903C (en) 2022-08-30
EP3108374A4 (en) 2017-12-13
US11347770B2 (en) 2022-05-31
CN106233263A (zh) 2016-12-14
US20200151194A1 (en) 2020-05-14
US11204943B2 (en) 2021-12-21
US11151160B2 (en) 2021-10-19
CN106233275B (zh) 2019-07-12
DE202015009772U1 (de) 2020-02-06
JP2020053071A (ja) 2020-04-02
US20210232598A1 (en) 2021-07-29
JP6901504B2 (ja) 2021-07-14
US20220114194A1 (en) 2022-04-14
US10019454B2 (en) 2018-07-10
US11036758B2 (en) 2021-06-15
EP3722958A1 (en) 2020-10-14
US20230289367A1 (en) 2023-09-14
US20210326354A1 (en) 2021-10-21
US20200210450A1 (en) 2020-07-02
US11372888B2 (en) 2022-06-28
EP3108385A4 (en) 2017-10-04
US11397747B2 (en) 2022-07-26
US20200151192A1 (en) 2020-05-14
US11093524B2 (en) 2021-08-17
EP3108364A2 (en) 2016-12-28
US20220067067A1 (en) 2022-03-03
US20230046201A1 (en) 2023-02-16
US11216485B2 (en) 2022-01-04
US11042567B1 (en) 2021-06-22
US20220292109A1 (en) 2022-09-15
JP2017512339A (ja) 2017-05-18
US20200201882A1 (en) 2020-06-25
JP6697392B2 (ja) 2020-05-20
WO2015126959A1 (en) 2015-08-27
US10776389B2 (en) 2020-09-15
US20210390115A1 (en) 2021-12-16
EP3108369A1 (en) 2016-12-28
US10325032B2 (en) 2019-06-18
US20200226148A1 (en) 2020-07-16
US11294933B2 (en) 2022-04-05
US20220156282A1 (en) 2022-05-19
US20210279252A1 (en) 2021-09-09
DE202017007211U1 (de) 2020-02-04
US20210042326A1 (en) 2021-02-11
AU2015219112B2 (en) 2019-11-21
US11397748B2 (en) 2022-07-26
US20200380014A1 (en) 2020-12-03
DE202015009778U1 (de) 2020-02-06
US11132380B2 (en) 2021-09-28
CA2939904C (en) 2022-08-30
JP6882893B2 (ja) 2021-06-02
US11263234B2 (en) 2022-03-01
US20200327144A1 (en) 2020-10-15
US11086900B2 (en) 2021-08-10
US20220358139A1 (en) 2022-11-10
US20200320096A1 (en) 2020-10-08
US20220284037A1 (en) 2022-09-08
US10776388B2 (en) 2020-09-15
US11042566B2 (en) 2021-06-22
US11126640B2 (en) 2021-09-21
US20230297589A1 (en) 2023-09-21
DE202015009777U1 (de) 2020-02-05
US11238062B2 (en) 2022-02-01
US20220277021A1 (en) 2022-09-01
US10795914B2 (en) 2020-10-06
US20240020315A1 (en) 2024-01-18
DE202015009874U1 (de) 2020-12-21
US20210049188A1 (en) 2021-02-18
JP2022166198A (ja) 2022-11-01
US11966417B2 (en) 2024-04-23
EP3108363A4 (en) 2017-12-13
US11853323B2 (en) 2023-12-26
US20150234902A1 (en) 2015-08-20
US20160275160A1 (en) 2016-09-22
US20200201883A1 (en) 2020-06-25
CA2939908C (en) 2023-08-29
AU2015219101A1 (en) 2016-09-01
AU2015219103B2 (en) 2020-04-02
JP7163268B2 (ja) 2022-10-31
US9842152B2 (en) 2017-12-12
DE202015009783U1 (de) 2020-02-12
US9576039B2 (en) 2017-02-21
CA2939904A1 (en) 2015-08-27
US20200257701A1 (en) 2020-08-13
US11645305B2 (en) 2023-05-09
JP2017507426A (ja) 2017-03-16
DE202015009779U1 (de) 2020-02-06
US20200201880A1 (en) 2020-06-25
CN106233275A (zh) 2016-12-14
US11615114B2 (en) 2023-03-28
US20200364236A1 (en) 2020-11-19
AU2015219112A1 (en) 2016-09-01
US20230376504A1 (en) 2023-11-23
CA2939906A1 (en) 2015-08-27
US11928129B1 (en) 2024-03-12
CA2939905C (en) 2023-09-12
US11494407B2 (en) 2022-11-08
US20200201881A1 (en) 2020-06-25
US20200257702A1 (en) 2020-08-13
CN106233277A (zh) 2016-12-14
US20200265066A1 (en) 2020-08-20
US11500900B2 (en) 2022-11-15
CN110297799A (zh) 2019-10-01
EP3108369B1 (en) 2021-05-12
US11475044B2 (en) 2022-10-18
WO2017210477A1 (en) 2017-12-07
DE202015009875U1 (de) 2020-12-23
US11106696B2 (en) 2021-08-31
US20150234922A1 (en) 2015-08-20
US10108686B2 (en) 2018-10-23
US11748375B2 (en) 2023-09-05
US20150234682A1 (en) 2015-08-20
US20150234914A1 (en) 2015-08-20
US20210271690A1 (en) 2021-09-02
US20200278983A1 (en) 2020-09-03
AU2015219117B2 (en) 2020-07-09
US20200364238A1 (en) 2020-11-19
AU2015219117A1 (en) 2016-09-01
EP3108386A4 (en) 2017-08-02
US20150237137A1 (en) 2015-08-20
US10831781B2 (en) 2020-11-10
US20210326356A1 (en) 2021-10-21
US11507598B2 (en) 2022-11-22
US10956445B1 (en) 2021-03-23
JP6542785B2 (ja) 2019-07-10
DE202015009859U1 (de) 2020-10-20
JP2017507424A (ja) 2017-03-16
JP2019522844A (ja) 2019-08-15
US10534794B2 (en) 2020-01-14
US20220292111A1 (en) 2022-09-15
AU2015218936B2 (en) 2020-05-21
WO2015126957A1 (en) 2015-08-27
US20220374451A1 (en) 2022-11-24
US11809451B2 (en) 2023-11-07
EP3108375A4 (en) 2017-12-06
US20200257703A1 (en) 2020-08-13
CN109564564B (zh) 2024-04-05
CA2939905A1 (en) 2015-08-27
US10534793B2 (en) 2020-01-14
EP3910480A1 (en) 2021-11-17
JP6643242B2 (ja) 2020-02-12
US20220035835A1 (en) 2022-02-03
US20190303389A1 (en) 2019-10-03
EP3108369A4 (en) 2017-08-09
US20210034640A1 (en) 2021-02-04
US20210191954A1 (en) 2021-06-24

Similar Documents

Publication Publication Date Title
CN106030573A (zh) 半结构化数据作为第一等级数据库元素的实现
Moniruzzaman Newsql: Towards next-generation scalable rdbms for online transaction processing (oltp) for big data management
Hasani et al. Lambda architecture for real time big data analytic
US20180203874A1 (en) Space-efficient secondary indexing on distributed data stores
Caldarola et al. Big data: A survey-the new paradigms, methodologies and tools
Das et al. A study on big data integration with data warehouse
Chrysafis et al. Foundationdb record layer: A multi-tenant structured datastore
US10831709B2 (en) Pluggable storage system for parallel query engines across non-native file systems
Hashem et al. An Integrative Modeling of BigData Processing.
Wang et al. Qserv: A distributed shared-nothing database for the LSST catalog
Sebaa et al. Query optimization in cloud environments: challenges, taxonomy, and techniques
Peng et al. An analysis platform of road traffic management system log data based on distributed storage and parallel computing techniques
Fong et al. Toward a scale-out data-management middleware for low-latency enterprise computing
Taori et al. Big Data Management
Gueidi et al. A nosql-based approach for real-time managing of embedded data bases
Lai et al. Nimbus: tuning filters service on Tweet streams
Gupta et al. Correlation and comparison of nosql specimen with relational data store
Singh NoSQL: A new horizon in big data
Johnson et al. Big data processing using Hadoop MapReduce programming model
Sharif et al. DEVELOPMENT OF A PROTOTYPE OF EVENT STREAM PROCESSING ACTIVITY LOGGER FOR MOBILE APPLICATION.
HOOSHMAND et al. Scalable RDBMS for Online Transaction Processing (OLTP) for Big Data Management
Liao et al. FIND-A Data Cloud Platform for Financial Data Services
Mostafa et al. Investigation cloud data storage

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
CB02 Change of applicant information

Address after: California, USA

Applicant after: SNOWFLAKE COMPUTING Inc.

Address before: California, USA

Applicant before: SNOWFLAKE COMPUTING Inc.

CB02 Change of applicant information
GR01 Patent grant
GR01 Patent grant
CP02 Change in the address of a patent holder

Address after: Montana

Patentee after: SNOWFLAKE COMPUTING Inc.

Address before: California, USA

Patentee before: SNOWFLAKE COMPUTING Inc.

CP02 Change in the address of a patent holder
CP03 Change of name, title or address

Address after: Montana

Patentee after: Snowflake Co.

Country or region after: U.S.A.

Address before: Montana

Patentee before: SNOWFLAKE COMPUTING Inc.

Country or region before: U.S.A.

CP03 Change of name, title or address