JP6750102B2 - マネージクエリサービス - Google Patents
マネージクエリサービス Download PDFInfo
- Publication number
- JP6750102B2 JP6750102B2 JP2019511461A JP2019511461A JP6750102B2 JP 6750102 B2 JP6750102 B2 JP 6750102B2 JP 2019511461 A JP2019511461 A JP 2019511461A JP 2019511461 A JP2019511461 A JP 2019511461A JP 6750102 B2 JP6750102 B2 JP 6750102B2
- Authority
- JP
- Japan
- Prior art keywords
- query
- service
- data
- computing
- schema
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000000034 method Methods 0.000 claims description 87
- 238000013500 data storage Methods 0.000 claims description 45
- 230000004044 response Effects 0.000 claims description 11
- 238000012544 monitoring process Methods 0.000 claims description 8
- 238000012545 processing Methods 0.000 description 43
- 238000007726 management method Methods 0.000 description 38
- 238000010586 diagram Methods 0.000 description 19
- 239000003795 chemical substances by application Substances 0.000 description 16
- 230000008569 process Effects 0.000 description 14
- 238000004891 communication Methods 0.000 description 11
- 230000006855 networking Effects 0.000 description 7
- 230000002093 peripheral effect Effects 0.000 description 6
- 230000004048 modification Effects 0.000 description 5
- 238000012986 modification Methods 0.000 description 5
- 238000012546 transfer Methods 0.000 description 5
- 238000004458 analytical method Methods 0.000 description 4
- 230000006870 function Effects 0.000 description 4
- 230000003993 interaction Effects 0.000 description 4
- 238000005516 engineering process Methods 0.000 description 3
- 238000005192 partition Methods 0.000 description 3
- 238000009877 rendering Methods 0.000 description 3
- 230000008901 benefit Effects 0.000 description 2
- 230000005540 biological transmission Effects 0.000 description 2
- 238000006243 chemical reaction Methods 0.000 description 2
- 238000013523 data management Methods 0.000 description 2
- 239000000835 fiber Substances 0.000 description 2
- 238000010801 machine learning Methods 0.000 description 2
- 230000003287 optical effect Effects 0.000 description 2
- 230000009467 reduction Effects 0.000 description 2
- 239000007787 solid Substances 0.000 description 2
- 238000012800 visualization Methods 0.000 description 2
- 230000004931 aggregating effect Effects 0.000 description 1
- 230000002776 aggregation Effects 0.000 description 1
- 238000004220 aggregation Methods 0.000 description 1
- 238000013475 authorization Methods 0.000 description 1
- 238000010276 construction Methods 0.000 description 1
- 238000001816 cooling Methods 0.000 description 1
- 238000007405 data analysis Methods 0.000 description 1
- 238000013461 design Methods 0.000 description 1
- 238000001514 detection method Methods 0.000 description 1
- 238000007667 floating Methods 0.000 description 1
- 238000005111 flow chemistry technique Methods 0.000 description 1
- 239000012530 fluid Substances 0.000 description 1
- 238000011331 genomic analysis Methods 0.000 description 1
- 230000036541 health Effects 0.000 description 1
- 229920001690 polydopamine Polymers 0.000 description 1
- 230000003068 static effect Effects 0.000 description 1
- 230000001360 synchronised effect Effects 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F9/00—Arrangements for program control, e.g. control units
- G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
- G06F9/46—Multiprogramming arrangements
- G06F9/50—Allocation of resources, e.g. of the central processing unit [CPU]
- G06F9/5005—Allocation of resources, e.g. of the central processing unit [CPU] to service a request
- G06F9/5011—Allocation of resources, e.g. of the central processing unit [CPU] to service a request the resources being hardware resources other than CPUs, Servers and Terminals
- G06F9/5022—Mechanisms to release resources
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/24—Querying
- G06F16/245—Query processing
- G06F16/2453—Query optimisation
- G06F16/24534—Query rewriting; Transformation
- G06F16/24542—Plan optimisation
- G06F16/24545—Selectivity estimation or determination
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/21—Design, administration or maintenance of databases
- G06F16/211—Schema design and management
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/24—Querying
- G06F16/245—Query processing
- G06F16/2453—Query optimisation
- G06F16/24534—Query rewriting; Transformation
- G06F16/24549—Run-time optimisation
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/24—Querying
- G06F16/245—Query processing
- G06F16/2455—Query execution
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/24—Querying
- G06F16/245—Query processing
- G06F16/2455—Query execution
- G06F16/24553—Query execution of query operations
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/24—Querying
- G06F16/245—Query processing
- G06F16/2458—Special types of queries, e.g. statistical queries, fuzzy queries or distributed queries
- G06F16/2471—Distributed queries
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/24—Querying
- G06F16/248—Presentation of query results
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/25—Integrating or interfacing systems involving database management systems
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/27—Replication, distribution or synchronisation of data between databases or within a distributed database system; Distributed database system architectures therefor
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/28—Databases characterised by their database models, e.g. relational or object models
- G06F16/282—Hierarchical databases, e.g. IMS, LDAP data stores or Lotus Notes
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/90—Details of database functions independent of the retrieved data types
- G06F16/903—Querying
- G06F16/90335—Query processing
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F9/00—Arrangements for program control, e.g. control units
- G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
- G06F9/46—Multiprogramming arrangements
- G06F9/50—Allocation of resources, e.g. of the central processing unit [CPU]
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F9/00—Arrangements for program control, e.g. control units
- G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
- G06F9/46—Multiprogramming arrangements
- G06F9/50—Allocation of resources, e.g. of the central processing unit [CPU]
- G06F9/5005—Allocation of resources, e.g. of the central processing unit [CPU] to service a request
- G06F9/5027—Allocation of resources, e.g. of the central processing unit [CPU] to service a request the resource being a machine, e.g. CPUs, Servers, Terminals
- G06F9/5044—Allocation of resources, e.g. of the central processing unit [CPU] to service a request the resource being a machine, e.g. CPUs, Servers, Terminals considering hardware capabilities
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F9/00—Arrangements for program control, e.g. control units
- G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
- G06F9/46—Multiprogramming arrangements
- G06F9/50—Allocation of resources, e.g. of the central processing unit [CPU]
- G06F9/5005—Allocation of resources, e.g. of the central processing unit [CPU] to service a request
- G06F9/5027—Allocation of resources, e.g. of the central processing unit [CPU] to service a request the resource being a machine, e.g. CPUs, Servers, Terminals
- G06F9/505—Allocation of resources, e.g. of the central processing unit [CPU] to service a request the resource being a machine, e.g. CPUs, Servers, Terminals considering the load
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F9/00—Arrangements for program control, e.g. control units
- G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
- G06F9/46—Multiprogramming arrangements
- G06F9/50—Allocation of resources, e.g. of the central processing unit [CPU]
- G06F9/5005—Allocation of resources, e.g. of the central processing unit [CPU] to service a request
- G06F9/5027—Allocation of resources, e.g. of the central processing unit [CPU] to service a request the resource being a machine, e.g. CPUs, Servers, Terminals
- G06F9/5055—Allocation of resources, e.g. of the central processing unit [CPU] to service a request the resource being a machine, e.g. CPUs, Servers, Terminals considering software capabilities, i.e. software resources associated or available to the machine
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F9/00—Arrangements for program control, e.g. control units
- G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
- G06F9/46—Multiprogramming arrangements
- G06F9/50—Allocation of resources, e.g. of the central processing unit [CPU]
- G06F9/5061—Partitioning or combining of resources
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F9/00—Arrangements for program control, e.g. control units
- G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
- G06F9/46—Multiprogramming arrangements
- G06F9/50—Allocation of resources, e.g. of the central processing unit [CPU]
- G06F9/5083—Techniques for rebalancing the load in a distributed system
- G06F9/5088—Techniques for rebalancing the load in a distributed system involving task migration
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/10—Protocols in which an application is distributed across nodes in the network
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/10—Protocols in which an application is distributed across nodes in the network
- H04L67/1001—Protocols in which an application is distributed across nodes in the network for accessing one among a plurality of replicated servers
- H04L67/1004—Server selection for load balancing
- H04L67/1008—Server selection for load balancing based on parameters of servers, e.g. available memory or workload
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/10—Protocols in which an application is distributed across nodes in the network
- H04L67/1001—Protocols in which an application is distributed across nodes in the network for accessing one among a plurality of replicated servers
- H04L67/1029—Protocols in which an application is distributed across nodes in the network for accessing one among a plurality of replicated servers using data related to the state of servers by a load balancer
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/10—Protocols in which an application is distributed across nodes in the network
- H04L67/1001—Protocols in which an application is distributed across nodes in the network for accessing one among a plurality of replicated servers
- H04L67/1031—Controlling of the operation of servers by a load balancer, e.g. adding or removing servers that serve requests
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/24—Querying
- G06F16/245—Query processing
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F2209/00—Indexing scheme relating to G06F9/00
- G06F2209/50—Indexing scheme relating to G06F9/50
- G06F2209/501—Performance criteria
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F2209/00—Indexing scheme relating to G06F9/00
- G06F2209/50—Indexing scheme relating to G06F9/50
- G06F2209/5011—Pool
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F2209/00—Indexing scheme relating to G06F9/00
- G06F2209/50—Indexing scheme relating to G06F9/50
- G06F2209/503—Resource availability
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F2209/00—Indexing scheme relating to G06F9/00
- G06F2209/50—Indexing scheme relating to G06F9/50
- G06F2209/508—Monitor
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F9/00—Arrangements for program control, e.g. control units
- G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
- G06F9/46—Multiprogramming arrangements
- G06F9/50—Allocation of resources, e.g. of the central processing unit [CPU]
- G06F9/5005—Allocation of resources, e.g. of the central processing unit [CPU] to service a request
- G06F9/5027—Allocation of resources, e.g. of the central processing unit [CPU] to service a request the resource being a machine, e.g. CPUs, Servers, Terminals
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- Databases & Information Systems (AREA)
- General Physics & Mathematics (AREA)
- Data Mining & Analysis (AREA)
- Software Systems (AREA)
- Computational Linguistics (AREA)
- Computer Networks & Wireless Communication (AREA)
- Signal Processing (AREA)
- Computing Systems (AREA)
- Computer Hardware Design (AREA)
- Operations Research (AREA)
- Fuzzy Systems (AREA)
- Mathematical Physics (AREA)
- Probability & Statistics with Applications (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
- Paper (AREA)
- Orthopedics, Nursing, And Contraception (AREA)
- Debugging And Monitoring (AREA)
- User Interface Of Digital Computer (AREA)
Description
Claims (20)
- システムであって、
少なくとも1つのプロセッサによって実行される場合、前記少なくとも1つのプロセッサに、少なくとも、
1つまたは複数のリモートデータストア内の1つまたは複数のデータセットを示すスキーマを受信し、
前記スキーマを、クエリを実行するように構成されたコンピューティングリソースのプールとは別に格納し、
前記1つまたは複数のリモートデータストア内の前記1つまたは複数のデータセットに送信された第1のクエリを受信し、前記1つまたは複数のデータセットは、クエリを実行するように構成された前記コンピューティングリソースのプールとは別に格納され、
前記第1のクエリの前記受信に応答して、
クエリを実行するように構成された前記コンピューティングリソースのプールから前記第1のクエリを実行するための1つまたは複数のコンピューティングリソースをプロビジョニングし、
前記リモートデータストアに前記別に格納された1つまたは複数のデータセットに関して前記第1のクエリを実行するために、前記プロビジョニングされたコンピューティングリソースに前記第1のクエリをルーティングし、前記プロビジョニングされたコンピューティングリソースは、前記第1のクエリの実行の一部として、前記1つまたは複数のデータセットを示す前記別に格納されたスキーマを取得し、
前記プロビジョニングされたコンピューティングリソースで生成された前記第1のクエリの結果を提供する、
ための方法を実行させるプログラム命令を格納するためのメモリを含む、前記システム。 - 前記1つまたは複数のデータセットを示す前記スキーマは、メタデータストアに格納され、
前記プロビジョニングされたコンピューティングリソースが、前記メタデータストア内の前記スキーマにアクセスして前記スキーマを取得する、請求項1に記載のシステム。 - 前記第1のクエリ及び前記スキーマが、同じユーザインターフェースを介して受信される、請求項2に記載のシステム。
- 前記少なくとも1つのプロセッサが、ネットワークベースのマネージクエリサービスの一部として実装され、少なくとも1つの前記データセットが、ネットワークベースのデータストレージサービスに格納され、前記スキーマが、ネットワークベースのデータカタログサービスに格納され、前記プロビジョニングされたコンピューティングリソースが、仮想コンピューティングサービスの一部として実装され、前記マネージクエリサービス、データストレージサービス、データカタログサービス、及び仮想計算サービスが、同じプロバイダネットワークの一部として提供される、請求項3に記載のシステム。
- 方法であって、
少なくとも1つのプロセッサが、1つまたは複数のリモートデータストア内の1つまたは複数のデータセットを示すスキーマを受信し、
前記少なくとも1つのプロセッサが、前記スキーマを、クエリを実行するように構成されたコンピューティングリソースのプールとは別に格納し、
少なくとも1つのプロセッサが、前記1つまたは複数のリモートデータストア内の前記1つまたは複数のデータセットに送信された第1のクエリを受信することであって、前記1つまたは複数のデータセットは、クエリを実行するように構成された前記コンピューティングリソースのプールとは別に格納される、前記受信することと、
前記第1のクエリを受信することに応答して、
前記少なくとも1つのプロセッサが、クエリを実行するように構成された前記コンピューティングリソースのプールから前記第1のクエリを実行するための1つまたは複数のコンピューティングリソースをプロビジョニングすることと、
前記少なくとも1つのプロセッサが、前記リモートデータストアに前記別に格納されたデータセットに関して前記第1のクエリを実行するために、前記プロビジョニングされたコンピューティングリソースに前記第1のクエリをルーティングすることであって、前記プロビジョニングされたコンピューティングリソースは、前記第1のクエリの実行の一部として、前記1つまたは複数のデータセットを示す前記別に格納されたスキーマを取得する、前記ルーティングすることと、
を含む、前記方法。 - 前記1つまたは複数のコンピューティングリソースを前記プロビジョニングすることが、前記第1のクエリを実行するための特定のクエリエンジンを実装する1つまたは複数のコンピューティングリソースを選択することを備える、請求項5に記載の方法。
- 前記特定のクエリエンジンが、前記第1のクエリで指示される、請求項6に記載の方法。
- 少なくともある前記データセットが、別の前記データセットとは異なるデータフォーマットに従って格納され、前記少なくとも一方のデータセットが、他方の前記データセットとは異なるリモートデータストアに格納される、請求項5に記載の方法。
- 前記第1のクエリの1つまたは複数のクエリ実行メトリックを監視することと、
前記監視することに基づいて、前記第1のクエリの実行メトリックが、クエリ実行制限を超えていると判定することと、
前記コンピューティングリソースで前記第1のクエリの実行を停止することとをさらに含む、請求項5に記載の方法。 - 前記1つまたは複数のデータセットを示す前記スキーマは、メタデータストアに格納され、
前記プロビジョニングされたコンピューティングリソースが、前記メタデータストア内の前記スキーマにアクセスして前記スキーマを取得する、請求項5に記載の方法。 - 前記第1のクエリが、プログラムインターフェースを介して受信され、前記方法が、前記プログラムインターフェースを介して前記プロビジョニングされたコンピューティングリソースで生成された前記第1のクエリの結果を返すことをさらに含む、請求項5に記載の方法。
- 前記第1のクエリが、前記第1のクエリの結果の宛先を示し、前記方法が、前記プロビジョニングされたコンピューティングリソースで生成された前記第1のクエリの結果を、前記結果の宛先に送信することをさらに含む、請求項5に記載の方法。
- 前記第1のクエリが、前記受信すること、前記プロビジョニングすること、及び前記ルーティングすることを実行するネットワークベースのサービスのサービスエンドポイントで受信され、前記第1のクエリが、第1のクライアントから受信され、複数の他のクエリが、前記データセットとは異なる1つまたは複数のデータセットにアクセスする複数の他のクライアントから、前記サービスエンドポイントで受信され、前記ネットワークベースのサービスが、前記他の受信したクエリに対して、前記受信すること、前記プロビジョニングすること、及び前記ルーティングすることを実行し、前記サービスエンドポイントは前記少なくとも1つのプロセッサである、請求項5に記載の方法。
- 1つまたは複数のコンピューティングデバイスによって実行されると、前記1つまたは複数のコンピューティングデバイスに、
1つまたは複数のリモートデータストア内の1つまたは複数のデータセットを示すスキーマを受信することと、
前記スキーマを、クエリを実行するように構成されたコンピューティングリソースのプールとは別に格納することと、
前記1つまたは複数のリモートデータストア内の前記1つまたは複数のデータセットに送信された第1のクエリを受信することであって、前記1つまたは複数のデータセットは、クエリを実行するように構成された前記コンピューティングリソースのプールとは別に格納される、前記受信することと、
前記第1のクエリを受信することに応答して、
クエリを実行するように構成された前記コンピューティングリソースのプールから前記第1のクエリを実行するための1つまたは複数のコンピューティングリソースを選択することと、
前記選択されたコンピューティングリソースを前記コンピューティングリソースのプールから削除することと、
前記削除されたコンピューティングリソースを前記第1のクエリと関連付けることと、
前記リモートデータストアに前記別に格納されたデータセットに関して前記第1のクエリを実行するために、前記選択された1つまたは複数のコンピューティングリソースに前記第1のクエリをルーティングすることであって、前記選択された1つまたは複数のコンピューティングリソースは、前記第1のクエリの実行の一部として、前記1つまたは複数のデータセットを示す前記別に格納されたスキーマを取得する、前記ルーティングすることと、
を実施させるプログラム命令を格納する、非一時的コンピュータ可読記憶媒体。 - 前記プログラム命令が、前記1つまたは複数のコンピューティングデバイスに、
前記第1のクエリの1つまたは複数のクエリ実行メトリックを監視することと、
前記監視することに基づいて、前記第1のクエリの実行メトリックが、クエリ実行制限を超えていると判定することと、
前記コンピューティングリソースで前記第1のクエリの実行を停止することとを実施させる、請求項14に記載の非一時的コンピュータ可読記憶媒体。 - 前記第1のクエリが、構造化照会言語(SQL)に従ってフォーマットされる、請求項14に記載の非一時的コンピュータ可読記憶媒体。
- 前記第1のクエリが、プログラムインターフェースを介して受信され、前記プログラム命令が、前記1つまたは複数のコンピューティングデバイスに、前記プログラムインターフェースを介して前記選択されたコンピューティングリソースで生成された前記第1のクエリの結果を返すことをさらに実施させる、請求項14に記載の非一時的コンピュータ可読記憶媒体。
- 前記1つまたは複数のデータセットを示す前記スキーマは、メタデータストアに格納され、
前記選択されたコンピューティングリソースが、前記メタデータストア内の前記スキーマにアクセスして前記スキーマを取得する、請求項14に記載の非一時的コンピュータ可読記憶媒体。 - 前記第1のクエリ及び前記スキーマが、同じユーザインターフェースを介して受信される、請求項18に記載の非一時的コンピュータ可読記憶媒体。
- 前記1つまたは複数のコンピューティングデバイスが、ネットワークベースのマネージクエリサービスの一部として実装され、少なくとも1つの前記データセットが、ネットワークベースのデータストレージサービスに格納され、前記スキーマが、ネットワークベースのデータカタログサービスに格納され、前記選択されたコンピューティングリソースが、仮想コンピューティングサービスの一部として実装され、前記マネージクエリサービス、データストレージサービス、データカタログサービス、及び仮想コンピューティングサービスが、同じプロバイダネットワークの一部として提供される、請求項19に記載の非一時的コンピュータ可読記憶媒体。
Applications Claiming Priority (5)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US201662382477P | 2016-09-01 | 2016-09-01 | |
US62/382,477 | 2016-09-01 | ||
US15/470,829 | 2017-03-27 | ||
US15/470,829 US10803060B2 (en) | 2016-09-01 | 2017-03-27 | Managed query service |
PCT/US2017/049640 WO2018045185A1 (en) | 2016-09-01 | 2017-08-31 | Managed query service |
Publications (2)
Publication Number | Publication Date |
---|---|
JP2019534496A JP2019534496A (ja) | 2019-11-28 |
JP6750102B2 true JP6750102B2 (ja) | 2020-09-02 |
Family
ID=61242674
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
JP2019511461A Active JP6750102B2 (ja) | 2016-09-01 | 2017-08-31 | マネージクエリサービス |
Country Status (7)
Country | Link |
---|---|
US (9) | US20180060133A1 (ja) |
EP (1) | EP3507716A1 (ja) |
JP (1) | JP6750102B2 (ja) |
CN (1) | CN109643312B (ja) |
AU (1) | AU2017321715B2 (ja) |
SG (1) | SG11201901511QA (ja) |
WO (1) | WO2018045185A1 (ja) |
Families Citing this family (177)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US9229983B2 (en) | 2012-11-30 | 2016-01-05 | Amazon Technologies, Inc. | System-wide query optimization |
US11487771B2 (en) * | 2014-06-25 | 2022-11-01 | Microsoft Technology Licensing, Llc | Per-node custom code engine for distributed query processing |
US9600312B2 (en) | 2014-09-30 | 2017-03-21 | Amazon Technologies, Inc. | Threading as a service |
US9146764B1 (en) | 2014-09-30 | 2015-09-29 | Amazon Technologies, Inc. | Processing event messages for user requests to execute program code |
US9678773B1 (en) | 2014-09-30 | 2017-06-13 | Amazon Technologies, Inc. | Low latency computational capacity provisioning |
US9413626B2 (en) | 2014-12-05 | 2016-08-09 | Amazon Technologies, Inc. | Automatic management of resource sizing |
US9588790B1 (en) | 2015-02-04 | 2017-03-07 | Amazon Technologies, Inc. | Stateful virtual compute system |
US9733967B2 (en) | 2015-02-04 | 2017-08-15 | Amazon Technologies, Inc. | Security protocols for low latency execution of program code |
US11132213B1 (en) | 2016-03-30 | 2021-09-28 | Amazon Technologies, Inc. | Dependency-based process of pre-existing data sets at an on demand code execution environment |
US10102040B2 (en) | 2016-06-29 | 2018-10-16 | Amazon Technologies, Inc | Adjusting variable limit on concurrent code executions |
US10681071B1 (en) | 2016-08-02 | 2020-06-09 | ThreatConnect, Inc. | Enrichment and analysis of cybersecurity threat intelligence and orchestrating application of threat intelligence to selected network security events |
US20180060133A1 (en) | 2016-09-01 | 2018-03-01 | Amazon Technologies, Inc. | Event-driven resource pool management |
US11269939B1 (en) | 2016-09-26 | 2022-03-08 | Splunk Inc. | Iterative message-based data processing including streaming analytics |
US10353965B2 (en) | 2016-09-26 | 2019-07-16 | Splunk Inc. | Data fabric service system architecture |
US11321321B2 (en) | 2016-09-26 | 2022-05-03 | Splunk Inc. | Record expansion and reduction based on a processing task in a data intake and query system |
US11003714B1 (en) | 2016-09-26 | 2021-05-11 | Splunk Inc. | Search node and bucket identification using a search node catalog and a data store catalog |
US11620336B1 (en) | 2016-09-26 | 2023-04-04 | Splunk Inc. | Managing and storing buckets to a remote shared storage system based on a collective bucket size |
US11593377B2 (en) | 2016-09-26 | 2023-02-28 | Splunk Inc. | Assigning processing tasks in a data intake and query system |
US11604795B2 (en) | 2016-09-26 | 2023-03-14 | Splunk Inc. | Distributing partial results from an external data system between worker nodes |
US10984044B1 (en) | 2016-09-26 | 2021-04-20 | Splunk Inc. | Identifying buckets for query execution using a catalog of buckets stored in a remote shared storage system |
US11232100B2 (en) | 2016-09-26 | 2022-01-25 | Splunk Inc. | Resource allocation for multiple datasets |
US11586627B2 (en) | 2016-09-26 | 2023-02-21 | Splunk Inc. | Partitioning and reducing records at ingest of a worker node |
US11243963B2 (en) | 2016-09-26 | 2022-02-08 | Splunk Inc. | Distributing partial results to worker nodes from an external data system |
US11663227B2 (en) | 2016-09-26 | 2023-05-30 | Splunk Inc. | Generating a subquery for a distinct data intake and query system |
US11562023B1 (en) | 2016-09-26 | 2023-01-24 | Splunk Inc. | Merging buckets in a data intake and query system |
US11860940B1 (en) | 2016-09-26 | 2024-01-02 | Splunk Inc. | Identifying buckets for query execution using a catalog of buckets |
US11442935B2 (en) | 2016-09-26 | 2022-09-13 | Splunk Inc. | Determining a record generation estimate of a processing task |
US11281706B2 (en) | 2016-09-26 | 2022-03-22 | Splunk Inc. | Multi-layer partition allocation for query execution |
US11416528B2 (en) | 2016-09-26 | 2022-08-16 | Splunk Inc. | Query acceleration data store |
US11163758B2 (en) | 2016-09-26 | 2021-11-02 | Splunk Inc. | External dataset capability compensation |
US11294941B1 (en) | 2016-09-26 | 2022-04-05 | Splunk Inc. | Message-based data ingestion to a data intake and query system |
US11126632B2 (en) | 2016-09-26 | 2021-09-21 | Splunk Inc. | Subquery generation based on search configuration data from an external data system |
US11106734B1 (en) | 2016-09-26 | 2021-08-31 | Splunk Inc. | Query execution using containerized state-free search nodes in a containerized scalable environment |
US20180089324A1 (en) | 2016-09-26 | 2018-03-29 | Splunk Inc. | Dynamic resource allocation for real-time search |
US11567993B1 (en) | 2016-09-26 | 2023-01-31 | Splunk Inc. | Copying buckets from a remote shared storage system to memory associated with a search node for query execution |
US10977260B2 (en) | 2016-09-26 | 2021-04-13 | Splunk Inc. | Task distribution in an execution node of a distributed execution environment |
US11461334B2 (en) | 2016-09-26 | 2022-10-04 | Splunk Inc. | Data conditioning for dataset destination |
US11580107B2 (en) | 2016-09-26 | 2023-02-14 | Splunk Inc. | Bucket data distribution for exporting data to worker nodes |
US11550847B1 (en) | 2016-09-26 | 2023-01-10 | Splunk Inc. | Hashing bucket identifiers to identify search nodes for efficient query execution |
US11874691B1 (en) | 2016-09-26 | 2024-01-16 | Splunk Inc. | Managing efficient query execution including mapping of buckets to search nodes |
US11599541B2 (en) | 2016-09-26 | 2023-03-07 | Splunk Inc. | Determining records generated by a processing task of a query |
US10726009B2 (en) * | 2016-09-26 | 2020-07-28 | Splunk Inc. | Query processing using query-resource usage and node utilization data |
US11222066B1 (en) | 2016-09-26 | 2022-01-11 | Splunk Inc. | Processing data using containerized state-free indexing nodes in a containerized scalable environment |
US11615104B2 (en) | 2016-09-26 | 2023-03-28 | Splunk Inc. | Subquery generation based on a data ingest estimate of an external data system |
US11250056B1 (en) | 2016-09-26 | 2022-02-15 | Splunk Inc. | Updating a location marker of an ingestion buffer based on storing buckets in a shared storage system |
US10776355B1 (en) | 2016-09-26 | 2020-09-15 | Splunk Inc. | Managing, storing, and caching query results and partial query results for combination with additional query results |
US12013895B2 (en) | 2016-09-26 | 2024-06-18 | Splunk Inc. | Processing data using containerized nodes in a containerized scalable environment |
US10956415B2 (en) | 2016-09-26 | 2021-03-23 | Splunk Inc. | Generating a subquery for an external data system using a configuration file |
US11314753B2 (en) | 2016-09-26 | 2022-04-26 | Splunk Inc. | Execution of a query received from a data intake and query system |
US11023463B2 (en) | 2016-09-26 | 2021-06-01 | Splunk Inc. | Converting and modifying a subquery for an external data system |
US10326657B1 (en) | 2016-09-30 | 2019-06-18 | Juniper Networks, Inc. | Multi vendor device support in network management systems |
US10230585B1 (en) | 2016-09-30 | 2019-03-12 | Juniper Networks, Inc. | Multi vendor device support in network management systems |
US10397130B2 (en) * | 2016-11-11 | 2019-08-27 | Vmware, Inc. | Multi-cloud resource reservations |
US11663205B2 (en) * | 2017-05-04 | 2023-05-30 | Salesforce, Inc. | Technologies for asynchronous querying |
US10956435B2 (en) * | 2017-05-05 | 2021-03-23 | Servicenow, Inc. | Global search |
US10678580B2 (en) * | 2017-05-09 | 2020-06-09 | Vmware, Inc. | Methods and apparatus to publish internal commands as an application programming interface in a cloud infrastructure |
US11372858B2 (en) * | 2017-05-18 | 2022-06-28 | Oracle International Corporation | Estimated query performance |
US12061822B1 (en) | 2017-06-12 | 2024-08-13 | Pure Storage, Inc. | Utilizing volume-level policies in a storage system |
US12086650B2 (en) | 2017-06-12 | 2024-09-10 | Pure Storage, Inc. | Workload placement based on carbon emissions |
US11989429B1 (en) | 2017-06-12 | 2024-05-21 | Pure Storage, Inc. | Recommending changes to a storage system |
US11210133B1 (en) * | 2017-06-12 | 2021-12-28 | Pure Storage, Inc. | Workload mobility between disparate execution environments |
US12086651B2 (en) | 2017-06-12 | 2024-09-10 | Pure Storage, Inc. | Migrating workloads using active disaster recovery |
US10713248B2 (en) * | 2017-07-23 | 2020-07-14 | AtScale, Inc. | Query engine selection |
US11989194B2 (en) | 2017-07-31 | 2024-05-21 | Splunk Inc. | Addressing memory limits for partition tracking among worker nodes |
US11921672B2 (en) | 2017-07-31 | 2024-03-05 | Splunk Inc. | Query execution at a remote heterogeneous data store of a data fabric service |
US10579431B2 (en) * | 2017-08-12 | 2020-03-03 | Facebook, Inc. | Systems and methods for distributed management of computing resources |
CN109428912B (zh) * | 2017-08-24 | 2020-07-10 | 阿里巴巴集团控股有限公司 | 一种分布式系统资源分配方法、装置及系统 |
US11113413B2 (en) * | 2017-08-25 | 2021-09-07 | Immuta, Inc. | Calculating differentially private queries using local sensitivity on time variant databases |
US10313413B2 (en) * | 2017-08-28 | 2019-06-04 | Banjo, Inc. | Detecting events from ingested communication signals |
US11947489B2 (en) | 2017-09-05 | 2024-04-02 | Robin Systems, Inc. | Creating snapshots of a storage volume in a distributed storage system |
US10896182B2 (en) | 2017-09-25 | 2021-01-19 | Splunk Inc. | Multi-partitioning determination for combination operations |
US11151137B2 (en) | 2017-09-25 | 2021-10-19 | Splunk Inc. | Multi-partition operation in combination operations |
US10778806B2 (en) * | 2017-10-10 | 2020-09-15 | Facebook, Inc. | Shard sandboxing |
US11017455B1 (en) * | 2017-11-10 | 2021-05-25 | Core Scientific, Inc. | Dynamic computer marketplace system and method |
US10456673B1 (en) * | 2017-11-17 | 2019-10-29 | Amazon Technologies, Inc. | Resource selection for hosted game sessions |
US10891290B2 (en) * | 2017-12-22 | 2021-01-12 | Teradata Us, Inc. | Query plan searching and optimization |
US11748203B2 (en) | 2018-01-11 | 2023-09-05 | Robin Systems, Inc. | Multi-role application orchestration in a distributed storage system |
US11200402B2 (en) * | 2018-01-26 | 2021-12-14 | GICSOFT, Inc. | Application execution based on object recognition |
US11762706B1 (en) * | 2018-02-01 | 2023-09-19 | Vmware, Inc. | Computing environment pooling |
US10949252B1 (en) * | 2018-02-13 | 2021-03-16 | Amazon Technologies, Inc. | Benchmarking machine learning models via performance feedback |
CN110321214A (zh) | 2018-03-29 | 2019-10-11 | 阿里巴巴集团控股有限公司 | 一种数据查询方法、装置及设备 |
US11334543B1 (en) | 2018-04-30 | 2022-05-17 | Splunk Inc. | Scalable bucket merging for a data intake and query system |
US20190361999A1 (en) * | 2018-05-23 | 2019-11-28 | Microsoft Technology Licensing, Llc | Data analysis over the combination of relational and big data |
US11030204B2 (en) | 2018-05-23 | 2021-06-08 | Microsoft Technology Licensing, Llc | Scale out data storage and query filtering using data pools |
US10922316B2 (en) | 2018-06-13 | 2021-02-16 | Amazon Technologies, Inc. | Using computing resources to perform database queries according to a dynamically determined query size |
US10853115B2 (en) | 2018-06-25 | 2020-12-01 | Amazon Technologies, Inc. | Execution of auxiliary functions in an on-demand network code execution system |
US11146569B1 (en) | 2018-06-28 | 2021-10-12 | Amazon Technologies, Inc. | Escalation-resistant secure network services using request-scoped authentication information |
US10824624B2 (en) * | 2018-07-12 | 2020-11-03 | Bank Of America Corporation | System for analyzing, optimizing, and remediating a proposed data query prior to query implementation |
US11099870B1 (en) | 2018-07-25 | 2021-08-24 | Amazon Technologies, Inc. | Reducing execution times in an on-demand network code execution system using saved machine states |
CN109032803B (zh) | 2018-08-01 | 2021-02-12 | 创新先进技术有限公司 | 数据处理方法和装置、客户端 |
US11356532B1 (en) * | 2018-08-10 | 2022-06-07 | Meta Platforms, Inc. | Systems and methods for packaging web resources |
US12013856B2 (en) | 2018-08-13 | 2024-06-18 | Amazon Technologies, Inc. | Burst performance of database queries according to query size |
US10997250B2 (en) * | 2018-09-24 | 2021-05-04 | Salesforce.Com, Inc. | Routing of cases using unstructured input and natural language processing |
US10924398B2 (en) * | 2018-09-25 | 2021-02-16 | Ebay Inc. | Time-series data monitoring with sharded server |
US11099917B2 (en) * | 2018-09-27 | 2021-08-24 | Amazon Technologies, Inc. | Efficient state maintenance for execution environments in an on-demand code execution system |
US11243953B2 (en) | 2018-09-27 | 2022-02-08 | Amazon Technologies, Inc. | Mapreduce implementation in an on-demand network code execution system and stream data processing system |
US20200125664A1 (en) * | 2018-10-19 | 2020-04-23 | Sap Se | Network virtualization for web application traffic flows |
CN111125207B (zh) * | 2018-10-30 | 2021-03-12 | 亿度慧达教育科技(北京)有限公司 | 一种数据获取方法、装置、连接器及presto引擎 |
CN109408580B (zh) * | 2018-10-31 | 2020-10-20 | 北京百分点信息科技有限公司 | 一种跨数据源的sql编译装置及方法 |
US10938821B2 (en) * | 2018-10-31 | 2021-03-02 | Dell Products L.P. | Remote access controller support registration system |
US11093620B2 (en) | 2018-11-02 | 2021-08-17 | ThreatConnect, Inc. | Ahead of time application launching for cybersecurity threat intelligence of network security events |
US11943093B1 (en) | 2018-11-20 | 2024-03-26 | Amazon Technologies, Inc. | Network connection recovery after virtual machine transition in an on-demand network code execution system |
IT201800021343A1 (it) * | 2018-12-28 | 2020-06-28 | Telecom Italia Spa | Sistema per fornire un servizio |
US11010188B1 (en) | 2019-02-05 | 2021-05-18 | Amazon Technologies, Inc. | Simulated data object storage using on-demand computation of data objects |
US11307898B2 (en) | 2019-02-26 | 2022-04-19 | Sap Se | Server resource balancing using a dynamic-sharing strategy |
US11126466B2 (en) | 2019-02-26 | 2021-09-21 | Sap Se | Server resource balancing using a fixed-sharing strategy |
US11042402B2 (en) * | 2019-02-26 | 2021-06-22 | Sap Se | Intelligent server task balancing based on server capacity |
US11861386B1 (en) | 2019-03-22 | 2024-01-02 | Amazon Technologies, Inc. | Application gateways in an on-demand network code execution system |
US11327970B1 (en) | 2019-03-25 | 2022-05-10 | Amazon Technologies, Inc. | Context dependent execution time prediction for redirecting queries |
US11966870B2 (en) | 2019-04-18 | 2024-04-23 | Oracle International Corporation | System and method for determination of recommendations and alerts in an analytics environment |
WO2020220216A1 (en) | 2019-04-29 | 2020-11-05 | Splunk Inc. | Search time estimate in data intake and query system |
EP3963472A1 (en) * | 2019-04-30 | 2022-03-09 | Oracle International Corporation | System and method for saas/paas resource usage and allocation in an analytic applications environment |
US11715051B1 (en) | 2019-04-30 | 2023-08-01 | Splunk Inc. | Service provider instance recommendations using machine-learned classifications and reconciliation |
US11119809B1 (en) | 2019-06-20 | 2021-09-14 | Amazon Technologies, Inc. | Virtualization-based transaction handling in an on-demand network code execution system |
US11308100B2 (en) | 2019-06-25 | 2022-04-19 | Amazon Technologies, Inc. | Dynamically assigning queries to secondary query processing resources |
US11190609B2 (en) | 2019-06-28 | 2021-11-30 | Amazon Technologies, Inc. | Connection pooling for scalable network services |
US11159528B2 (en) | 2019-06-28 | 2021-10-26 | Amazon Technologies, Inc. | Authentication to network-services using hosted authentication information |
US12019633B2 (en) * | 2019-07-19 | 2024-06-25 | International Business Machines Corporation | Providing multi-tier query execution options in a serverless query environment |
CN112445602A (zh) * | 2019-08-27 | 2021-03-05 | 阿里巴巴集团控股有限公司 | 资源调度方法、装置、系统及电子设备 |
US11216446B2 (en) * | 2019-08-29 | 2022-01-04 | Snowflake Inc. | Identifying software regressions based on query retry attempts in a database environment |
US10915418B1 (en) * | 2019-08-29 | 2021-02-09 | Snowflake Inc. | Automated query retry in a database environment |
US11409626B2 (en) * | 2019-08-29 | 2022-08-09 | Snowflake Inc. | Decoupling internal and external tasks in a database environment |
CN112540843B (zh) * | 2019-09-20 | 2024-05-07 | 杭州海康威视数字技术股份有限公司 | 资源的分配方法、装置、存储设备及存储介质 |
US11442931B2 (en) * | 2019-09-27 | 2022-09-13 | Amazon Technologies, Inc. | Enabling federated query access to Heterogeneous data sources |
US11494380B2 (en) | 2019-10-18 | 2022-11-08 | Splunk Inc. | Management of distributed computing framework components in a data fabric service system |
WO2021167659A1 (en) * | 2019-11-14 | 2021-08-26 | Trideum Corporation | Systems and methods of monitoring and controlling remote assets |
US11119826B2 (en) | 2019-11-27 | 2021-09-14 | Amazon Technologies, Inc. | Serverless call distribution to implement spillover while avoiding cold starts |
CN110928721B (zh) * | 2020-01-22 | 2020-06-19 | 北京懿医云科技有限公司 | 任务执行方法与装置、电子设备、存储介质 |
US11922222B1 (en) | 2020-01-30 | 2024-03-05 | Splunk Inc. | Generating a modified component for a data intake and query system using an isolated execution environment image |
US11048716B1 (en) * | 2020-01-31 | 2021-06-29 | Snowflake Inc. | Managed virtual warehouses for tasks |
US11714682B1 (en) | 2020-03-03 | 2023-08-01 | Amazon Technologies, Inc. | Reclaiming computing resources in an on-demand code execution system |
US11863573B2 (en) * | 2020-03-06 | 2024-01-02 | ThreatConnect, Inc. | Custom triggers for a network security event for cybersecurity threat intelligence |
US10860609B1 (en) | 2020-03-25 | 2020-12-08 | Snowflake Inc. | Distributed stop operator for query processing |
US11520616B2 (en) * | 2020-05-01 | 2022-12-06 | International Business Machines Corporation | Virtual server creation monitoring and resource allocation system |
US11537616B1 (en) | 2020-06-29 | 2022-12-27 | Amazon Technologies, Inc. | Predicting query performance for prioritizing query execution |
US20220043822A1 (en) * | 2020-08-04 | 2022-02-10 | International Business Machines Corporation | Shadow experiments for serverless multi-tenant cloud services |
US11687833B2 (en) * | 2020-08-27 | 2023-06-27 | Google Llc | Data management forecasting from distributed tracing |
RU2751441C1 (ru) * | 2020-09-11 | 2021-07-13 | Федеральное государственное бюджетное образовательное учреждение высшего образования «Московский государственный университет имени М.В.Ломоносова» (МГУ) | Способ формирования вычислительного комплекса |
US11740980B2 (en) | 2020-09-22 | 2023-08-29 | Robin Systems, Inc. | Managing snapshot metadata following backup |
US11586624B2 (en) * | 2020-09-28 | 2023-02-21 | Databricks, Inc. | Integrated native vectorized engine for computation |
US11743188B2 (en) | 2020-10-01 | 2023-08-29 | Robin Systems, Inc. | Check-in monitoring for workflows |
CN111930780B (zh) * | 2020-10-12 | 2020-12-18 | 上海冰鉴信息科技有限公司 | 数据查询方法及系统 |
US11500830B2 (en) | 2020-10-15 | 2022-11-15 | International Business Machines Corporation | Learning-based workload resource optimization for database management systems |
US11704313B1 (en) | 2020-10-19 | 2023-07-18 | Splunk Inc. | Parallel branch operation using intermediary nodes |
US11750451B2 (en) * | 2020-11-04 | 2023-09-05 | Robin Systems, Inc. | Batch manager for complex workflows |
US11593270B1 (en) | 2020-11-25 | 2023-02-28 | Amazon Technologies, Inc. | Fast distributed caching using erasure coded object parts |
US11550713B1 (en) | 2020-11-25 | 2023-01-10 | Amazon Technologies, Inc. | Garbage collection in distributed systems using life cycled storage roots |
US11762860B1 (en) | 2020-12-10 | 2023-09-19 | Amazon Technologies, Inc. | Dynamic concurrency level management for database queries |
US11782918B2 (en) * | 2020-12-11 | 2023-10-10 | International Business Machines Corporation | Selecting access flow path in complex queries |
US11880364B2 (en) * | 2021-01-25 | 2024-01-23 | Snowflake Inc. | Predictive resource allocation for distributed query execution |
US11138038B1 (en) * | 2021-01-29 | 2021-10-05 | Snowflake Inc. | Adaptive freepool size prediction |
US11755621B2 (en) | 2021-05-10 | 2023-09-12 | Argo AI, LLC | Systems and methods for atomic publication of distributed writes to a distributed data warehouse |
US11853324B2 (en) * | 2021-05-10 | 2023-12-26 | Argo AI, LLC | Systems and methods for atomic publication of distributed writes to a distributed data warehouse |
US11681698B2 (en) | 2021-05-10 | 2023-06-20 | Argo AI, LLC | Systems and methods for atomic publication of distributed writes to a distributed data warehouse |
CN113222449A (zh) * | 2021-05-27 | 2021-08-06 | 湖北文理学院 | 标准化作业有效执行度评估方法及装置 |
CN115550354A (zh) * | 2021-06-11 | 2022-12-30 | 腾讯云计算(北京)有限责任公司 | 一种数据处理方法、装置及计算机可读存储介质 |
US11985144B2 (en) | 2021-06-25 | 2024-05-14 | ThreatConnect, Inc. | Browser extension for cybersecurity threat intelligence and response |
US11388210B1 (en) | 2021-06-30 | 2022-07-12 | Amazon Technologies, Inc. | Streaming analytics using a serverless compute system |
CN113434556B (zh) * | 2021-07-22 | 2022-05-31 | 支付宝(杭州)信息技术有限公司 | 一种数据处理方法和系统 |
US12072939B1 (en) | 2021-07-30 | 2024-08-27 | Splunk Inc. | Federated data enrichment objects |
CN113918561A (zh) * | 2021-09-10 | 2022-01-11 | 上海跬智信息技术有限公司 | 基于云上分析场景的混合查询方法和系统、存储介质 |
US11954473B2 (en) | 2021-09-20 | 2024-04-09 | Microstrategy Incorporated | Deployment architecture for multi-tenant cloud computing systems |
US11995476B1 (en) | 2021-09-22 | 2024-05-28 | Amazon Technologies, Inc. | Client-configurable retention periods for machine learning service-managed resources |
US11893038B2 (en) * | 2021-10-21 | 2024-02-06 | Treasure Data, Inc. | Data type based visual profiling of large-scale database tables |
US20230125765A1 (en) * | 2021-10-21 | 2023-04-27 | International Business Machines Corporation | Container pool management |
US11968280B1 (en) | 2021-11-24 | 2024-04-23 | Amazon Technologies, Inc. | Controlling ingestion of streaming data to serverless function executions |
US12015603B2 (en) | 2021-12-10 | 2024-06-18 | Amazon Technologies, Inc. | Multi-tenant mode for serverless code execution |
US11579663B1 (en) | 2021-12-13 | 2023-02-14 | Dell Products L.P. | Modular information handling system with automated housing cover removal |
US11907042B2 (en) | 2021-12-13 | 2024-02-20 | Dell Products L.P. | Reduction of high battery voltage by ratios using a main board for power supply of processing unit based on battery voltage changes over time |
US11915207B2 (en) | 2021-12-13 | 2024-02-27 | Dell Products L.P. | Modular information handling system with automated display removal |
US11829223B2 (en) | 2021-12-13 | 2023-11-28 | Dell Products L.P. | Information handling system battery disposition automated using performance metrics |
US11861342B2 (en) | 2022-01-28 | 2024-01-02 | Microstrategy Incorporated | Enhanced cloud-computing environment deployment |
US20230267148A1 (en) * | 2022-02-22 | 2023-08-24 | Bank Of America Corporation | Automated Query Analysis and Remediation Tool |
US12093272B1 (en) | 2022-04-29 | 2024-09-17 | Splunk Inc. | Retrieving data identifiers from queue for search of external data system |
US11924115B2 (en) * | 2022-05-20 | 2024-03-05 | Ipco 2012 Limited | Systems and methods for use in balancing network resources |
CN115277657B (zh) * | 2022-05-30 | 2023-06-13 | 上海上讯信息技术股份有限公司 | 一种数据库协议运维的方法及设备 |
US11947555B1 (en) * | 2022-09-30 | 2024-04-02 | Amazon Technologies, Inc. | Intelligent query routing across shards of scalable database tables |
Family Cites Families (60)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US6216109B1 (en) * | 1994-10-11 | 2001-04-10 | Peoplesoft, Inc. | Iterative repair optimization with particular application to scheduling for integrated capacity and inventory planning |
US6366915B1 (en) * | 1998-11-04 | 2002-04-02 | Micron Technology, Inc. | Method and system for efficiently retrieving information from multiple databases |
US6314447B1 (en) * | 1999-10-04 | 2001-11-06 | Sony Corporation | System uses local registry and load balancing procedure for identifying processing capabilities of a remote device to perform a processing task |
US6473750B1 (en) * | 1999-10-15 | 2002-10-29 | Microsoft Corporation | Adaptive query execution in a distributed database system |
US6859926B1 (en) | 2000-09-14 | 2005-02-22 | International Business Machines Corporation | Apparatus and method for workload management using class shares and tiers |
US20030187841A1 (en) * | 2002-03-28 | 2003-10-02 | International Business Machines Corporation | Method and structure for federated web service discovery search over multiple registries with result aggregation |
US7243093B2 (en) * | 2002-11-27 | 2007-07-10 | International Business Machines Corporation | Federated query management |
JP2004287801A (ja) * | 2003-03-20 | 2004-10-14 | Sony Computer Entertainment Inc | 情報処理システム、情報処理装置、分散情報処理方法及びコンピュータプログラム |
US7406461B1 (en) * | 2004-06-11 | 2008-07-29 | Seisint, Inc. | System and method for processing a request to perform an activity associated with a precompiled query |
US7870565B2 (en) * | 2005-06-30 | 2011-01-11 | Intel Corporation | Systems and methods for secure host resource management |
US7634590B2 (en) * | 2005-10-12 | 2009-12-15 | Computer Associates Think, Inc. | Resource pool monitor |
US7613742B2 (en) | 2006-05-02 | 2009-11-03 | Mypoints.Com Inc. | System and method for providing three-way failover for a transactional database |
US7788544B2 (en) * | 2006-05-03 | 2010-08-31 | Computer Associates Think, Inc. | Autonomous system state tolerance adjustment for autonomous management systems |
US20080033964A1 (en) | 2006-08-07 | 2008-02-07 | Bea Systems, Inc. | Failure recovery for distributed search |
US10122593B2 (en) | 2007-02-20 | 2018-11-06 | Oracle America, Inc. | Method and system for managing computing resources using an electronic leasing agent |
US8782075B2 (en) * | 2007-05-08 | 2014-07-15 | Paraccel Llc | Query handling in databases with replicated data |
US8429096B1 (en) * | 2008-03-31 | 2013-04-23 | Amazon Technologies, Inc. | Resource isolation through reinforcement learning |
JP5238432B2 (ja) * | 2008-09-26 | 2013-07-17 | 株式会社東芝 | メタデータ収集装置、ならびにその方法およびプログラム |
US8145652B2 (en) * | 2008-10-09 | 2012-03-27 | International Business Machines Corporation | Automated propagation of non-conflicting queries in distributed databases |
US8285710B2 (en) * | 2008-10-09 | 2012-10-09 | International Business Machines Corporation | Automated query path reporting in distributed databases |
US20100094891A1 (en) * | 2008-10-13 | 2010-04-15 | Bid Solve, Inc. | Client-Server System for Multi-Resource Searching |
US8819106B1 (en) * | 2008-12-12 | 2014-08-26 | Amazon Technologies, Inc. | Managing distributed execution of programs |
US8296419B1 (en) * | 2009-03-31 | 2012-10-23 | Amazon Technologies, Inc. | Dynamically modifying a cluster of computing nodes used for distributed execution of a program |
US8429097B1 (en) | 2009-08-12 | 2013-04-23 | Amazon Technologies, Inc. | Resource isolation using reinforcement learning and domain-specific constraints |
US9495429B2 (en) | 2010-07-09 | 2016-11-15 | Daniel Paul Miranker | Automatic synthesis and presentation of OLAP cubes from semantically enriched data sources |
JP5417287B2 (ja) | 2010-09-06 | 2014-02-12 | 株式会社日立製作所 | 計算機システム、及び、計算機システムの制御方法 |
EP2702522A4 (en) * | 2011-04-29 | 2015-03-25 | Hewlett Packard Development Co | SYSTEMS AND METHOD FOR IN-STORAGE PROCESSING OF EVENTS |
US9052941B1 (en) * | 2011-05-27 | 2015-06-09 | Amazon Technologies, Inc. | Automated testing of online functionality providers |
US8881142B1 (en) | 2011-06-21 | 2014-11-04 | Amazon Technologies, Inc. | Determining and using probable instance lifetimes |
US9275102B2 (en) | 2011-07-20 | 2016-03-01 | International Business Machines Corporation | System load query governor |
US8959223B2 (en) * | 2011-09-29 | 2015-02-17 | International Business Machines Corporation | Automated high resiliency system pool |
US9372827B2 (en) | 2011-09-30 | 2016-06-21 | Commvault Systems, Inc. | Migration of an existing computing system to new hardware |
JP5865668B2 (ja) * | 2011-10-21 | 2016-02-17 | クラリオン株式会社 | 情報端末、プログラムおよび検索方法 |
US9026864B2 (en) * | 2012-02-29 | 2015-05-05 | Red Hat, Inc. | Offloading health-checking policy |
US9240025B1 (en) | 2012-03-27 | 2016-01-19 | Amazon Technologies, Inc. | Dynamic pricing of network-accessible resources for stateful applications |
US9294236B1 (en) | 2012-03-27 | 2016-03-22 | Amazon Technologies, Inc. | Automated cloud resource trading system |
US8676622B1 (en) | 2012-05-01 | 2014-03-18 | Amazon Technologies, Inc. | Job resource planner for cloud computing environments |
US8775282B1 (en) * | 2012-05-18 | 2014-07-08 | Amazon Technologies, Inc. | Capacity management of draining-state platforms providing network-accessible resources |
US9621435B2 (en) | 2012-09-07 | 2017-04-11 | Oracle International Corporation | Declarative and extensible model for provisioning of cloud based services |
US9203866B2 (en) | 2012-09-07 | 2015-12-01 | Oracle International Corporation | Overage framework for cloud services |
US9058219B2 (en) * | 2012-11-02 | 2015-06-16 | Amazon Technologies, Inc. | Custom resources in a resource stack |
US9449040B2 (en) * | 2012-11-26 | 2016-09-20 | Amazon Technologies, Inc. | Block restore ordering in a streaming restore system |
US9229983B2 (en) | 2012-11-30 | 2016-01-05 | Amazon Technologies, Inc. | System-wide query optimization |
US10552774B2 (en) * | 2013-02-11 | 2020-02-04 | Amazon Technologies, Inc. | Cost-minimizing task scheduler |
US9342557B2 (en) | 2013-03-13 | 2016-05-17 | Cloudera, Inc. | Low latency query engine for Apache Hadoop |
US9208032B1 (en) | 2013-05-15 | 2015-12-08 | Amazon Technologies, Inc. | Managing contingency capacity of pooled resources in multiple availability zones |
US8977600B2 (en) | 2013-05-24 | 2015-03-10 | Software AG USA Inc. | System and method for continuous analytics run against a combination of static and real-time data |
US9384359B2 (en) | 2013-08-01 | 2016-07-05 | Palo Alto Research Center Incorporated | Information firewall |
US10198292B2 (en) | 2013-11-27 | 2019-02-05 | Actian Sub Iii, Inc. | Scheduling database queries based on elapsed time of queries |
US20150163223A1 (en) * | 2013-12-09 | 2015-06-11 | International Business Machines Corporation | Managing Resources In A Distributed Computing Environment |
US9576039B2 (en) * | 2014-02-19 | 2017-02-21 | Snowflake Computing Inc. | Resource provisioning systems and methods |
US20170132042A1 (en) * | 2014-04-23 | 2017-05-11 | Hewlett Packard Enterprise Development Lp | Selecting a platform configuration for a workload |
US10733190B2 (en) * | 2015-02-17 | 2020-08-04 | Telefonaktiebolaget Lm Ericsson (Publ) | Method and device for deciding where to execute subqueries of an analytics continuous query |
US9787709B2 (en) | 2015-06-17 | 2017-10-10 | Bank Of America Corporation | Detecting and analyzing operational risk in a network environment |
US20170142157A1 (en) * | 2015-11-13 | 2017-05-18 | International Business Machines Corporation | Optimization of cloud compliance services based on events and trends |
US9760477B1 (en) * | 2016-04-12 | 2017-09-12 | Linkedin Corporation | Self-healing job executor pool |
CA3021963C (en) * | 2016-04-28 | 2024-05-28 | Snowflake Computing Inc. | Multi-cluster warehouse |
US10153941B2 (en) * | 2016-05-17 | 2018-12-11 | Microsoft Technology Licensing, Llc | Distributed operational control in computing systems |
US20180060133A1 (en) | 2016-09-01 | 2018-03-01 | Amazon Technologies, Inc. | Event-driven resource pool management |
US10545492B2 (en) * | 2016-09-26 | 2020-01-28 | Rockwell Automation Technologies, Inc. | Selective online and offline access to searchable industrial automation data |
-
2017
- 2017-03-27 US US15/470,837 patent/US20180060133A1/en not_active Abandoned
- 2017-03-27 US US15/470,829 patent/US10803060B2/en active Active
- 2017-03-27 US US15/470,834 patent/US20180060132A1/en not_active Abandoned
- 2017-03-27 US US15/470,841 patent/US10762086B2/en active Active
- 2017-03-27 US US15/470,843 patent/US10614066B2/en active Active
- 2017-05-05 US US15/588,373 patent/US11803546B2/en active Active
- 2017-08-31 EP EP17765532.1A patent/EP3507716A1/en not_active Withdrawn
- 2017-08-31 WO PCT/US2017/049640 patent/WO2018045185A1/en unknown
- 2017-08-31 CN CN201780053646.8A patent/CN109643312B/zh active Active
- 2017-08-31 AU AU2017321715A patent/AU2017321715B2/en active Active
- 2017-08-31 SG SG11201901511QA patent/SG11201901511QA/en unknown
- 2017-08-31 JP JP2019511461A patent/JP6750102B2/ja active Active
-
2020
- 2020-04-03 US US16/839,849 patent/US11403297B2/en active Active
- 2020-08-28 US US17/006,522 patent/US11461329B2/en active Active
- 2020-10-09 US US17/067,495 patent/US11461330B2/en active Active
Also Published As
Publication number | Publication date |
---|---|
US20180060133A1 (en) | 2018-03-01 |
US20210097080A1 (en) | 2021-04-01 |
US10614066B2 (en) | 2020-04-07 |
US11403297B2 (en) | 2022-08-02 |
US10762086B2 (en) | 2020-09-01 |
CN109643312B (zh) | 2023-08-11 |
CN109643312A (zh) | 2019-04-16 |
US20180060132A1 (en) | 2018-03-01 |
US20210049175A1 (en) | 2021-02-18 |
SG11201901511QA (en) | 2019-03-28 |
US10803060B2 (en) | 2020-10-13 |
US20180060395A1 (en) | 2018-03-01 |
EP3507716A1 (en) | 2019-07-10 |
WO2018045185A1 (en) | 2018-03-08 |
US11461330B2 (en) | 2022-10-04 |
AU2017321715B2 (en) | 2020-06-18 |
AU2017321715A1 (en) | 2019-03-21 |
US11803546B2 (en) | 2023-10-31 |
US20200233869A1 (en) | 2020-07-23 |
US11461329B2 (en) | 2022-10-04 |
JP2019534496A (ja) | 2019-11-28 |
US20180060400A1 (en) | 2018-03-01 |
US20180060393A1 (en) | 2018-03-01 |
US20180060394A1 (en) | 2018-03-01 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
JP6750102B2 (ja) | マネージクエリサービス | |
US10936589B1 (en) | Capability-based query planning for heterogenous processing nodes | |
US11487760B2 (en) | Query plan management associated with a shared pool of configurable computing resources | |
US10447772B2 (en) | Managed function execution for processing data streams in real time | |
US10970303B1 (en) | Selecting resources hosted in different networks to perform queries according to available capacity | |
US9996565B2 (en) | Managing an index of a table of a database | |
US11055352B1 (en) | Engine independent query plan optimization | |
Zheng et al. | Service-generated big data and big data-as-a-service: an overview | |
US10002170B2 (en) | Managing a table of a database | |
US10944814B1 (en) | Independent resource scheduling for distributed data processing programs | |
US9185008B1 (en) | Operational reporting in a computing environment |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
A621 | Written request for application examination |
Free format text: JAPANESE INTERMEDIATE CODE: A621 Effective date: 20190225 |
|
A977 | Report on retrieval |
Free format text: JAPANESE INTERMEDIATE CODE: A971007 Effective date: 20200127 |
|
A131 | Notification of reasons for refusal |
Free format text: JAPANESE INTERMEDIATE CODE: A131 Effective date: 20200212 |
|
A521 | Request for written amendment filed |
Free format text: JAPANESE INTERMEDIATE CODE: A523 Effective date: 20200512 |
|
TRDD | Decision of grant or rejection written | ||
A01 | Written decision to grant a patent or to grant a registration (utility model) |
Free format text: JAPANESE INTERMEDIATE CODE: A01 Effective date: 20200714 |
|
A61 | First payment of annual fees (during grant procedure) |
Free format text: JAPANESE INTERMEDIATE CODE: A61 Effective date: 20200812 |
|
R150 | Certificate of patent or registration of utility model |
Ref document number: 6750102 Country of ref document: JP Free format text: JAPANESE INTERMEDIATE CODE: R150 |
|
R250 | Receipt of annual fees |
Free format text: JAPANESE INTERMEDIATE CODE: R250 |
|
R250 | Receipt of annual fees |
Free format text: JAPANESE INTERMEDIATE CODE: R250 |