CN102708121A - 异构源上的动态分布式查询执行 - Google Patents
异构源上的动态分布式查询执行 Download PDFInfo
- Publication number
- CN102708121A CN102708121A CN2012100393069A CN201210039306A CN102708121A CN 102708121 A CN102708121 A CN 102708121A CN 2012100393069 A CN2012100393069 A CN 2012100393069A CN 201210039306 A CN201210039306 A CN 201210039306A CN 102708121 A CN102708121 A CN 102708121A
- Authority
- CN
- China
- Prior art keywords
- data
- program
- assembly
- cost
- data source
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 claims description 38
- 230000009471 action Effects 0.000 claims description 9
- 238000003860 storage Methods 0.000 description 15
- 230000008569 process Effects 0.000 description 12
- 238000010586 diagram Methods 0.000 description 11
- 238000006243 chemical reaction Methods 0.000 description 10
- 230000000712 assembly Effects 0.000 description 9
- 238000000429 assembly Methods 0.000 description 9
- 238000013500 data storage Methods 0.000 description 9
- 230000006870 function Effects 0.000 description 9
- 238000009826 distribution Methods 0.000 description 8
- 230000015654 memory Effects 0.000 description 8
- 238000005457 optimization Methods 0.000 description 8
- 238000004891 communication Methods 0.000 description 7
- 238000004458 analytical method Methods 0.000 description 6
- 238000005516 engineering process Methods 0.000 description 5
- 230000007246 mechanism Effects 0.000 description 5
- 238000004364 calculation method Methods 0.000 description 4
- 230000005540 biological transmission Effects 0.000 description 3
- 238000007728 cost analysis Methods 0.000 description 3
- 238000013499 data model Methods 0.000 description 3
- 230000004048 modification Effects 0.000 description 3
- 238000012986 modification Methods 0.000 description 3
- 238000007781 pre-processing Methods 0.000 description 3
- 238000012545 processing Methods 0.000 description 3
- 238000007493 shaping process Methods 0.000 description 3
- 238000013528 artificial neural network Methods 0.000 description 2
- 230000008901 benefit Effects 0.000 description 2
- 230000008878 coupling Effects 0.000 description 2
- 238000010168 coupling process Methods 0.000 description 2
- 238000005859 coupling reaction Methods 0.000 description 2
- 238000013461 design Methods 0.000 description 2
- 230000004927 fusion Effects 0.000 description 2
- 230000010354 integration Effects 0.000 description 2
- 238000007726 management method Methods 0.000 description 2
- 230000002093 peripheral effect Effects 0.000 description 2
- 239000007787 solid Substances 0.000 description 2
- 238000012706 support-vector machine Methods 0.000 description 2
- 241001074085 Scophthalmus aquosus Species 0.000 description 1
- 238000009825 accumulation Methods 0.000 description 1
- 230000002776 aggregation Effects 0.000 description 1
- 238000004220 aggregation Methods 0.000 description 1
- 238000013473 artificial intelligence Methods 0.000 description 1
- 230000015572 biosynthetic process Effects 0.000 description 1
- 230000008859 change Effects 0.000 description 1
- 230000000052 comparative effect Effects 0.000 description 1
- 230000006835 compression Effects 0.000 description 1
- 238000007906 compression Methods 0.000 description 1
- 239000012141 concentrate Substances 0.000 description 1
- 238000010219 correlation analysis Methods 0.000 description 1
- 238000013481 data capture Methods 0.000 description 1
- 230000007547 defect Effects 0.000 description 1
- 238000009795 derivation Methods 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 238000011156 evaluation Methods 0.000 description 1
- 239000000284 extract Substances 0.000 description 1
- 230000002349 favourable effect Effects 0.000 description 1
- 238000001914 filtration Methods 0.000 description 1
- 239000012634 fragment Substances 0.000 description 1
- 230000008676 import Effects 0.000 description 1
- 230000003993 interaction Effects 0.000 description 1
- 230000002452 interceptive effect Effects 0.000 description 1
- 238000010801 machine learning Methods 0.000 description 1
- 238000013507 mapping Methods 0.000 description 1
- 239000011159 matrix material Substances 0.000 description 1
- 230000005055 memory storage Effects 0.000 description 1
- NJPPVKZQTLUDBO-UHFFFAOYSA-N novaluron Chemical compound C1=C(Cl)C(OC(F)(F)C(OC(F)(F)F)F)=CC=C1NC(=O)NC(=O)C1=C(F)C=CC=C1F NJPPVKZQTLUDBO-UHFFFAOYSA-N 0.000 description 1
- 230000004044 response Effects 0.000 description 1
- 230000009466 transformation Effects 0.000 description 1
- 230000007704 transition Effects 0.000 description 1
- 238000012384 transportation and delivery Methods 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/24—Querying
- G06F16/245—Query processing
- G06F16/2458—Special types of queries, e.g. statistical queries, fuzzy queries or distributed queries
- G06F16/2471—Distributed queries
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/25—Integrating or interfacing systems involving database management systems
- G06F16/256—Integrating or interfacing systems involving database management systems in federated or virtual databases
Abstract
Description
Claims (10)
Applications Claiming Priority (4)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US201161444169P | 2011-02-18 | 2011-02-18 | |
US61/444,169 | 2011-02-18 | ||
US13/154,400 US20120215763A1 (en) | 2011-02-18 | 2011-06-06 | Dynamic distributed query execution over heterogeneous sources |
US13/154,400 | 2011-06-06 |
Publications (1)
Publication Number | Publication Date |
---|---|
CN102708121A true CN102708121A (zh) | 2012-10-03 |
Family
ID=46653607
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN2012100393069A Pending CN102708121A (zh) | 2011-02-18 | 2012-02-20 | 异构源上的动态分布式查询执行 |
Country Status (4)
Country | Link |
---|---|
US (1) | US20120215763A1 (zh) |
EP (1) | EP2676192A4 (zh) |
CN (1) | CN102708121A (zh) |
WO (1) | WO2012112980A2 (zh) |
Cited By (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN103455641A (zh) * | 2013-09-29 | 2013-12-18 | 方正国际软件有限公司 | 交叉多次检索的系统和方法 |
WO2015172478A1 (zh) * | 2014-05-15 | 2015-11-19 | 中兴通讯股份有限公司 | 一种分布式存储系统中管理异构副本的方法及装置 |
CN105912624A (zh) * | 2016-04-07 | 2016-08-31 | 北京中安智达科技有限公司 | 分布式部署的异构数据库的查询方法 |
CN108885635A (zh) * | 2016-04-28 | 2018-11-23 | 微软技术许可有限责任公司 | 分层声明式转换的分布式执行 |
Families Citing this family (40)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US8819060B2 (en) * | 2010-11-19 | 2014-08-26 | Salesforce.Com, Inc. | Virtual objects in an on-demand database environment |
US8996463B2 (en) * | 2012-07-26 | 2015-03-31 | Mongodb, Inc. | Aggregation framework system architecture and method |
US11544288B2 (en) | 2010-12-23 | 2023-01-03 | Mongodb, Inc. | Systems and methods for managing distributed database deployments |
US10977277B2 (en) | 2010-12-23 | 2021-04-13 | Mongodb, Inc. | Systems and methods for database zone sharding and API integration |
US10262050B2 (en) | 2015-09-25 | 2019-04-16 | Mongodb, Inc. | Distributed database systems and methods with pluggable storage engines |
US10346430B2 (en) | 2010-12-23 | 2019-07-09 | Mongodb, Inc. | System and method for determining consensus within a distributed database |
US9805108B2 (en) | 2010-12-23 | 2017-10-31 | Mongodb, Inc. | Large distributed database clustering systems and methods |
US10698775B2 (en) | 2016-05-31 | 2020-06-30 | Mongodb, Inc. | Method and apparatus for reading and writing committed data |
US10997211B2 (en) | 2010-12-23 | 2021-05-04 | Mongodb, Inc. | Systems and methods for database zone sharding and API integration |
US11615115B2 (en) | 2010-12-23 | 2023-03-28 | Mongodb, Inc. | Systems and methods for managing distributed database deployments |
US10872095B2 (en) | 2012-07-26 | 2020-12-22 | Mongodb, Inc. | Aggregation framework system architecture and method |
US11403317B2 (en) | 2012-07-26 | 2022-08-02 | Mongodb, Inc. | Aggregation framework system architecture and method |
US11544284B2 (en) | 2012-07-26 | 2023-01-03 | Mongodb, Inc. | Aggregation framework system architecture and method |
US9244971B1 (en) * | 2013-03-07 | 2016-01-26 | Amazon Technologies, Inc. | Data retrieval from heterogeneous storage systems |
US10339133B2 (en) | 2013-11-11 | 2019-07-02 | International Business Machines Corporation | Amorphous data preparation for efficient query formulation |
US9372891B2 (en) * | 2013-12-13 | 2016-06-21 | Red Hat, Inc. | System and method for querying hybrid multi data sources |
US20150379083A1 (en) * | 2014-06-25 | 2015-12-31 | Microsoft Corporation | Custom query execution engine |
US11487771B2 (en) | 2014-06-25 | 2022-11-01 | Microsoft Technology Licensing, Llc | Per-node custom code engine for distributed query processing |
MY186962A (en) * | 2014-07-23 | 2021-08-26 | Mimos Berhad | A system for querying heterogeneous data sources and a method thereof |
US11474874B2 (en) | 2014-08-14 | 2022-10-18 | Qubole, Inc. | Systems and methods for auto-scaling a big data system |
US10031939B2 (en) * | 2014-09-30 | 2018-07-24 | Microsoft Technology Licensing, Llc | Automated supplementation of data model |
US10459987B2 (en) * | 2015-02-06 | 2019-10-29 | Red Hat, Inc. | Data virtualization for workflows |
US11436667B2 (en) | 2015-06-08 | 2022-09-06 | Qubole, Inc. | Pure-spot and dynamically rebalanced auto-scaling clusters |
US10673623B2 (en) | 2015-09-25 | 2020-06-02 | Mongodb, Inc. | Systems and methods for hierarchical key management in encrypted distributed databases |
US11080207B2 (en) | 2016-06-07 | 2021-08-03 | Qubole, Inc. | Caching framework for big-data engines in the cloud |
US10621050B2 (en) | 2016-06-27 | 2020-04-14 | Mongodb, Inc. | Method and apparatus for restoring data from snapshots |
US10606664B2 (en) | 2016-09-07 | 2020-03-31 | Qubole Inc. | Heterogeneous auto-scaling big-data clusters in the cloud |
CN106371848B (zh) * | 2016-09-09 | 2019-08-02 | 浪潮软件股份有限公司 | 一种web开发框架支持Odata的实现方法 |
GB2556924A (en) | 2016-11-25 | 2018-06-13 | Infosum Ltd | Accessing databases |
CN114490630A (zh) | 2017-04-25 | 2022-05-13 | 华为技术有限公司 | 一种查询处理方法、数据源注册方法及查询引擎 |
US10733024B2 (en) | 2017-05-24 | 2020-08-04 | Qubole Inc. | Task packing scheduling process for long running applications |
US10866868B2 (en) | 2017-06-20 | 2020-12-15 | Mongodb, Inc. | Systems and methods for optimization of database operations |
US11228489B2 (en) | 2018-01-23 | 2022-01-18 | Qubole, Inc. | System and methods for auto-tuning big data workloads on cloud platforms |
CN108319722B (zh) * | 2018-02-27 | 2020-12-04 | 北京小度信息科技有限公司 | 数据访问方法、装置、电子设备及计算机可读存储介质 |
CN110377598B (zh) * | 2018-04-11 | 2023-04-07 | 西安邮电大学 | 一种基于智能制造过程的多源异构数据存储方法 |
CN108932345A (zh) * | 2018-07-27 | 2018-12-04 | 北京中关村科金技术有限公司 | 一种基于dremio实现跨数据源分布式查询系统和方法 |
US10515106B1 (en) * | 2018-10-01 | 2019-12-24 | Infosum Limited | Systems and methods for processing a database query |
US11144360B2 (en) | 2019-05-31 | 2021-10-12 | Qubole, Inc. | System and method for scheduling and running interactive database queries with service level agreements in a multi-tenant processing system |
US11704316B2 (en) | 2019-05-31 | 2023-07-18 | Qubole, Inc. | Systems and methods for determining peak memory requirements in SQL processing engines with concurrent subtasks |
CN111475498A (zh) * | 2020-04-03 | 2020-07-31 | 深圳市泰和安科技有限公司 | 一种异质消防数据的处理方法、装置及存储介质 |
Citations (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US5943666A (en) * | 1997-09-15 | 1999-08-24 | International Business Machines Corporation | Method and apparatus for optimizing queries across heterogeneous databases |
CN1735888A (zh) * | 2003-01-10 | 2006-02-15 | 汤姆森特许公司 | 用于访问数据库的方法和设备 |
CN1783086A (zh) * | 2004-12-03 | 2006-06-07 | 国际商业机器公司 | 用于在数据库管理系统中的查询管理的系统和方法 |
CN101052944A (zh) * | 2004-03-29 | 2007-10-10 | 微软公司 | 用于关系数据库中存储数据的细化访问控制的系统和方法 |
Family Cites Families (8)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US6105017A (en) * | 1997-09-15 | 2000-08-15 | International Business Machines Corporation | Method and apparatus for deferring large object retrievals from a remote database in a heterogeneous database system |
US5953719A (en) * | 1997-09-15 | 1999-09-14 | International Business Machines Corporation | Heterogeneous database system with dynamic commit procedure control |
US6233586B1 (en) * | 1998-04-01 | 2001-05-15 | International Business Machines Corp. | Federated searching of heterogeneous datastores using a federated query object |
US7136859B2 (en) * | 2001-03-14 | 2006-11-14 | Microsoft Corporation | Accessing heterogeneous data in a standardized manner |
US7660820B2 (en) * | 2002-11-12 | 2010-02-09 | E.Piphany, Inc. | Context-based heterogeneous information integration system |
US7472112B2 (en) * | 2003-06-23 | 2008-12-30 | Microsoft Corporation | Distributed query engine pipeline method and system |
US7730034B1 (en) * | 2007-07-19 | 2010-06-01 | Amazon Technologies, Inc. | Providing entity-related data storage on heterogeneous data repositories |
US8082273B2 (en) * | 2007-11-19 | 2011-12-20 | Teradata Us, Inc. | Dynamic control and regulation of critical database resources using a virtual memory table interface |
-
2011
- 2011-06-06 US US13/154,400 patent/US20120215763A1/en not_active Abandoned
-
2012
- 2012-02-20 EP EP12747386.6A patent/EP2676192A4/en not_active Withdrawn
- 2012-02-20 WO PCT/US2012/025789 patent/WO2012112980A2/en active Application Filing
- 2012-02-20 CN CN2012100393069A patent/CN102708121A/zh active Pending
Patent Citations (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US5943666A (en) * | 1997-09-15 | 1999-08-24 | International Business Machines Corporation | Method and apparatus for optimizing queries across heterogeneous databases |
CN1735888A (zh) * | 2003-01-10 | 2006-02-15 | 汤姆森特许公司 | 用于访问数据库的方法和设备 |
CN101052944A (zh) * | 2004-03-29 | 2007-10-10 | 微软公司 | 用于关系数据库中存储数据的细化访问控制的系统和方法 |
CN1783086A (zh) * | 2004-12-03 | 2006-06-07 | 国际商业机器公司 | 用于在数据库管理系统中的查询管理的系统和方法 |
Cited By (7)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN103455641A (zh) * | 2013-09-29 | 2013-12-18 | 方正国际软件有限公司 | 交叉多次检索的系统和方法 |
CN103455641B (zh) * | 2013-09-29 | 2017-02-22 | 北大医疗信息技术有限公司 | 交叉多次检索的系统和方法 |
WO2015172478A1 (zh) * | 2014-05-15 | 2015-11-19 | 中兴通讯股份有限公司 | 一种分布式存储系统中管理异构副本的方法及装置 |
CN105095294A (zh) * | 2014-05-15 | 2015-11-25 | 中兴通讯股份有限公司 | 一种分布式存储系统中管理异构副本的方法及装置 |
CN105912624A (zh) * | 2016-04-07 | 2016-08-31 | 北京中安智达科技有限公司 | 分布式部署的异构数据库的查询方法 |
CN105912624B (zh) * | 2016-04-07 | 2019-05-24 | 北京中安智达科技有限公司 | 分布式部署的异构数据库的查询方法 |
CN108885635A (zh) * | 2016-04-28 | 2018-11-23 | 微软技术许可有限责任公司 | 分层声明式转换的分布式执行 |
Also Published As
Publication number | Publication date |
---|---|
EP2676192A2 (en) | 2013-12-25 |
US20120215763A1 (en) | 2012-08-23 |
WO2012112980A3 (en) | 2012-11-01 |
WO2012112980A2 (en) | 2012-08-23 |
EP2676192A4 (en) | 2017-01-18 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
CN102708121A (zh) | 异构源上的动态分布式查询执行 | |
CN107463635B (zh) | 一种图片数据查询的方法和分布式NewSQL数据库系统 | |
US20210374610A1 (en) | Efficient duplicate detection for machine learning data sets | |
Ramírez‐Gallego et al. | Fast‐mRMR: Fast minimum redundancy maximum relevance algorithm for high‐dimensional big data | |
US20190286659A1 (en) | Generating neighborhood convolutions according to relative importance | |
CN102385513B (zh) | 反应式编程的编程语言支持 | |
CN102541992B (zh) | 用于高效地查询数据库的同态定理 | |
US20080313131A1 (en) | Parameter-sensitive plans for structural scenarios | |
CN102508852B (zh) | 数据模型对偶化 | |
CN102567457A (zh) | 对象模型到键值数据模型的映射 | |
Kumar | An encyclopedic overview of ‘big data’analytics | |
CN111831330B (zh) | 用于联邦学习的异构计算系统设备交互方案 | |
US8826248B2 (en) | Enabling computational process as a dynamic data source for bi reporting systems | |
US20200110602A1 (en) | Scalable cloud-based time series analysis | |
US11687839B2 (en) | System and method for generating and optimizing artificial intelligence models | |
CN102591925A (zh) | 以多维数据为中心的服务协议 | |
CN102541993A (zh) | 用于分布式计算的电子表格模型 | |
CN102929637A (zh) | 反应性表达式生成和优化 | |
CN102591710B (zh) | 共享对象表示 | |
CN103823881A (zh) | 分布式数据库的性能优化的方法及装置 | |
CN102402420B (zh) | 解析可观察集合 | |
CN116048817A (zh) | 数据处理控制方法、装置、计算机设备和存储介质 | |
US20220300821A1 (en) | Hybrid model and architecture search for automated machine learning systems | |
US11588728B2 (en) | Tree structure-based smart inter-computing routing model | |
CN110851452B (zh) | 数据表连接处理方法及装置、电子设备和存储介质 |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
C06 | Publication | ||
PB01 | Publication | ||
REG | Reference to a national code |
Ref country code: HK Ref legal event code: DE Ref document number: 1174995 Country of ref document: HK |
|
SE01 | Entry into force of request for substantive examination | ||
SE01 | Entry into force of request for substantive examination | ||
ASS | Succession or assignment of patent right |
Owner name: MICROSOFT TECHNOLOGY LICENSING LLC Free format text: FORMER OWNER: MICROSOFT CORP. Effective date: 20150805 |
|
C41 | Transfer of patent application or patent right or utility model | ||
TA01 | Transfer of patent application right |
Effective date of registration: 20150805 Address after: Washington State Applicant after: Micro soft technique license Co., Ltd Address before: Washington State Applicant before: Microsoft Corp. |
|
WD01 | Invention patent application deemed withdrawn after publication | ||
WD01 | Invention patent application deemed withdrawn after publication |
Application publication date: 20121003 |
|
REG | Reference to a national code |
Ref country code: HK Ref legal event code: WD Ref document number: 1174995 Country of ref document: HK |