CN101403978B - 用于机器集群的并行编程的基础构造 - Google Patents
用于机器集群的并行编程的基础构造 Download PDFInfo
- Publication number
- CN101403978B CN101403978B CN2008101660272A CN200810166027A CN101403978B CN 101403978 B CN101403978 B CN 101403978B CN 2008101660272 A CN2008101660272 A CN 2008101660272A CN 200810166027 A CN200810166027 A CN 200810166027A CN 101403978 B CN101403978 B CN 101403978B
- Authority
- CN
- China
- Prior art keywords
- function
- vector
- user
- node
- symbol
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F8/00—Arrangements for software engineering
- G06F8/40—Transformation of program code
- G06F8/41—Compilation
- G06F8/45—Exploiting coarse grain parallelism in compilation, i.e. parallelism between groups of instructions
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/24—Querying
- G06F16/245—Query processing
- G06F16/2453—Query optimisation
- G06F16/24532—Query optimisation of parallel queries
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Computational Linguistics (AREA)
- Data Mining & Analysis (AREA)
- Databases & Information Systems (AREA)
- Software Systems (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
- Multi Processors (AREA)
Abstract
Description
Claims (24)
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US11/906,293 US7917574B2 (en) | 2007-10-01 | 2007-10-01 | Infrastructure for parallel programming of clusters of machines |
US11/906,293 | 2007-10-01 |
Publications (2)
Publication Number | Publication Date |
---|---|
CN101403978A CN101403978A (zh) | 2009-04-08 |
CN101403978B true CN101403978B (zh) | 2012-07-11 |
Family
ID=40139122
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN2008101660272A Active CN101403978B (zh) | 2007-10-01 | 2008-09-28 | 用于机器集群的并行编程的基础构造 |
Country Status (6)
Country | Link |
---|---|
US (1) | US7917574B2 (zh) |
EP (1) | EP2045719A3 (zh) |
CN (1) | CN101403978B (zh) |
AR (1) | AR068645A1 (zh) |
BR (1) | BRPI0805054B1 (zh) |
CA (1) | CA2639853C (zh) |
Families Citing this family (71)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US7590620B1 (en) | 2004-06-18 | 2009-09-15 | Google Inc. | System and method for analyzing data records |
US7756919B1 (en) | 2004-06-18 | 2010-07-13 | Google Inc. | Large-scale data processing in a distributed and parallel processing enviornment |
US20090043750A1 (en) | 2007-08-07 | 2009-02-12 | Barsness Eric L | Query Optimization in a Parallel Computer System with Multiple Networks |
US8171047B2 (en) * | 2007-08-07 | 2012-05-01 | International Business Machines Corporation | Query execution and optimization utilizing a combining network in a parallel computer system |
US20090043745A1 (en) | 2007-08-07 | 2009-02-12 | Eric L Barsness | Query Execution and Optimization with Autonomic Error Recovery from Network Failures in a Parallel Computer System with Multiple Networks |
US20090043728A1 (en) | 2007-08-07 | 2009-02-12 | Barsness Eric L | Query Optimization in a Parallel Computer System to Reduce Network Traffic |
US9501302B1 (en) * | 2008-06-06 | 2016-11-22 | Amdocs Software Systems Limited | System, method, and computer program for combining results of event processing received from a plurality of virtual servers |
US8312037B1 (en) | 2008-08-28 | 2012-11-13 | Amazon Technologies, Inc. | Dynamic tree determination for data processing |
US8150889B1 (en) * | 2008-08-28 | 2012-04-03 | Amazon Technologies, Inc. | Parallel processing framework |
US8239847B2 (en) * | 2009-03-18 | 2012-08-07 | Microsoft Corporation | General distributed reduction for data parallel computing |
US8510538B1 (en) | 2009-04-13 | 2013-08-13 | Google Inc. | System and method for limiting the impact of stragglers in large-scale parallel data processing |
US8447954B2 (en) * | 2009-09-04 | 2013-05-21 | International Business Machines Corporation | Parallel pipelined vector reduction in a data processing system |
US9171338B2 (en) | 2009-09-30 | 2015-10-27 | Evan V Chrapko | Determining connectivity within a community |
US20110099164A1 (en) | 2009-10-23 | 2011-04-28 | Haim Zvi Melman | Apparatus and method for search and retrieval of documents and advertising targeting |
CN102141995B (zh) * | 2010-01-29 | 2013-06-12 | 国际商业机器公司 | 简化并行计算系统中的传输的系统与方法 |
WO2012019111A2 (en) * | 2010-08-06 | 2012-02-09 | Frederick Furtek | A method and apparatus for a compiler and related components for stream-based computations for a general-purpose, multiple-core system |
CN102760073B (zh) * | 2011-04-29 | 2014-10-22 | 中兴通讯股份有限公司 | 一种任务调度方法、系统及装置 |
US8875157B2 (en) | 2011-09-09 | 2014-10-28 | Microsoft Corporation | Deployment of pre-scheduled tasks in clusters |
CN102693297B (zh) * | 2012-05-16 | 2015-03-11 | 华为技术有限公司 | 数据处理方法、节点和提取、转换和加载etl系统 |
EP2901285B1 (en) * | 2012-09-28 | 2020-12-02 | Sqream Technologies Ltd | A system and a method for executing sql basic operators on compressed data without decompression process |
US9578043B2 (en) | 2015-03-20 | 2017-02-21 | Ashif Mawji | Calculating a trust score |
US20170235792A1 (en) | 2016-02-17 | 2017-08-17 | Www.Trustscience.Com Inc. | Searching for entities based on trust score and geography |
US9679254B1 (en) | 2016-02-29 | 2017-06-13 | Www.Trustscience.Com Inc. | Extrapolating trends in trust scores |
US9577911B1 (en) * | 2016-03-21 | 2017-02-21 | Black Cloud Analytics, Inc. | Distributed computation system incorporating agent network, paths and associated probes |
US9721296B1 (en) | 2016-03-24 | 2017-08-01 | Www.Trustscience.Com Inc. | Learning an entity's trust model and risk tolerance to calculate a risk score |
US20180203724A1 (en) * | 2017-01-17 | 2018-07-19 | International Business Machines Corporation | Fast task dispatching using a dispatching processor |
US10877898B2 (en) | 2017-11-16 | 2020-12-29 | Alibaba Group Holding Limited | Method and system for enhancing flash translation layer mapping flexibility for performance and lifespan improvements |
US10496548B2 (en) | 2018-02-07 | 2019-12-03 | Alibaba Group Holding Limited | Method and system for user-space storage I/O stack with user-space flash translation layer |
WO2019222958A1 (en) | 2018-05-24 | 2019-11-28 | Alibaba Group Holding Limited | System and method for flash storage management using multiple open page stripes |
US10921992B2 (en) | 2018-06-25 | 2021-02-16 | Alibaba Group Holding Limited | Method and system for data placement in a hard disk drive based on access frequency for improved IOPS and utilization efficiency |
US11816043B2 (en) | 2018-06-25 | 2023-11-14 | Alibaba Group Holding Limited | System and method for managing resources of a storage device and quantifying the cost of I/O requests |
CN109144944A (zh) * | 2018-07-31 | 2019-01-04 | 佛山科学技术学院 | 一种并发性能最优的程序组带宽调度方法 |
US10996886B2 (en) | 2018-08-02 | 2021-05-04 | Alibaba Group Holding Limited | Method and system for facilitating atomicity and latency assurance on variable sized I/O |
US11327929B2 (en) | 2018-09-17 | 2022-05-10 | Alibaba Group Holding Limited | Method and system for reduced data movement compression using in-storage computing and a customized file system |
US10977122B2 (en) | 2018-12-31 | 2021-04-13 | Alibaba Group Holding Limited | System and method for facilitating differentiated error correction in high-density flash devices |
US11061735B2 (en) | 2019-01-02 | 2021-07-13 | Alibaba Group Holding Limited | System and method for offloading computation to storage nodes in distributed system |
US11132291B2 (en) | 2019-01-04 | 2021-09-28 | Alibaba Group Holding Limited | System and method of FPGA-executed flash translation layer in multiple solid state drives |
US11200337B2 (en) | 2019-02-11 | 2021-12-14 | Alibaba Group Holding Limited | System and method for user data isolation |
US10970212B2 (en) | 2019-02-15 | 2021-04-06 | Alibaba Group Holding Limited | Method and system for facilitating a distributed storage system with a total cost of ownership reduction for multiple available zones |
US11061834B2 (en) | 2019-02-26 | 2021-07-13 | Alibaba Group Holding Limited | Method and system for facilitating an improved storage system by decoupling the controller from the storage medium |
US10891065B2 (en) | 2019-04-01 | 2021-01-12 | Alibaba Group Holding Limited | Method and system for online conversion of bad blocks for improvement of performance and longevity in a solid state drive |
US10922234B2 (en) | 2019-04-11 | 2021-02-16 | Alibaba Group Holding Limited | Method and system for online recovery of logical-to-physical mapping table affected by noise sources in a solid state drive |
US10908960B2 (en) | 2019-04-16 | 2021-02-02 | Alibaba Group Holding Limited | Resource allocation based on comprehensive I/O monitoring in a distributed storage system |
US11169873B2 (en) | 2019-05-21 | 2021-11-09 | Alibaba Group Holding Limited | Method and system for extending lifespan and enhancing throughput in a high-density solid state drive |
US20210019285A1 (en) * | 2019-07-16 | 2021-01-21 | Citrix Systems, Inc. | File download using deduplication techniques |
US10860223B1 (en) | 2019-07-18 | 2020-12-08 | Alibaba Group Holding Limited | Method and system for enhancing a distributed storage system by decoupling computation and network tasks |
US11074124B2 (en) | 2019-07-23 | 2021-07-27 | Alibaba Group Holding Limited | Method and system for enhancing throughput of big data analysis in a NAND-based read source storage |
US11617282B2 (en) | 2019-10-01 | 2023-03-28 | Alibaba Group Holding Limited | System and method for reshaping power budget of cabinet to facilitate improved deployment density of servers |
US11126561B2 (en) | 2019-10-01 | 2021-09-21 | Alibaba Group Holding Limited | Method and system for organizing NAND blocks and placing data to facilitate high-throughput for random writes in a solid state drive |
US11449455B2 (en) | 2020-01-15 | 2022-09-20 | Alibaba Group Holding Limited | Method and system for facilitating a high-capacity object storage system with configuration agility and mixed deployment flexibility |
US11150986B2 (en) | 2020-02-26 | 2021-10-19 | Alibaba Group Holding Limited | Efficient compaction on log-structured distributed file system using erasure coding for resource consumption reduction |
US11200114B2 (en) | 2020-03-17 | 2021-12-14 | Alibaba Group Holding Limited | System and method for facilitating elastic error correction code in memory |
US11385833B2 (en) | 2020-04-20 | 2022-07-12 | Alibaba Group Holding Limited | Method and system for facilitating a light-weight garbage collection with a reduced utilization of resources |
US11281575B2 (en) | 2020-05-11 | 2022-03-22 | Alibaba Group Holding Limited | Method and system for facilitating data placement and control of physical addresses with multi-queue I/O blocks |
US11494115B2 (en) | 2020-05-13 | 2022-11-08 | Alibaba Group Holding Limited | System method for facilitating memory media as file storage device based on real-time hashing by performing integrity check with a cyclical redundancy check (CRC) |
US11461262B2 (en) | 2020-05-13 | 2022-10-04 | Alibaba Group Holding Limited | Method and system for facilitating a converged computation and storage node in a distributed storage system |
US11218165B2 (en) | 2020-05-15 | 2022-01-04 | Alibaba Group Holding Limited | Memory-mapped two-dimensional error correction code for multi-bit error tolerance in DRAM |
US11556277B2 (en) | 2020-05-19 | 2023-01-17 | Alibaba Group Holding Limited | System and method for facilitating improved performance in ordering key-value storage with input/output stack simplification |
US11507499B2 (en) | 2020-05-19 | 2022-11-22 | Alibaba Group Holding Limited | System and method for facilitating mitigation of read/write amplification in data compression |
US11263132B2 (en) | 2020-06-11 | 2022-03-01 | Alibaba Group Holding Limited | Method and system for facilitating log-structure data organization |
US11422931B2 (en) | 2020-06-17 | 2022-08-23 | Alibaba Group Holding Limited | Method and system for facilitating a physically isolated storage unit for multi-tenancy virtualization |
US11354200B2 (en) | 2020-06-17 | 2022-06-07 | Alibaba Group Holding Limited | Method and system for facilitating data recovery and version rollback in a storage device |
US11354233B2 (en) | 2020-07-27 | 2022-06-07 | Alibaba Group Holding Limited | Method and system for facilitating fast crash recovery in a storage device |
US11372774B2 (en) | 2020-08-24 | 2022-06-28 | Alibaba Group Holding Limited | Method and system for a solid state drive with on-chip memory integration |
US11487465B2 (en) | 2020-12-11 | 2022-11-01 | Alibaba Group Holding Limited | Method and system for a local storage engine collaborating with a solid state drive controller |
US11734115B2 (en) | 2020-12-28 | 2023-08-22 | Alibaba Group Holding Limited | Method and system for facilitating write latency reduction in a queue depth of one scenario |
US11416365B2 (en) | 2020-12-30 | 2022-08-16 | Alibaba Group Holding Limited | Method and system for open NAND block detection and correction in an open-channel SSD |
US11726699B2 (en) | 2021-03-30 | 2023-08-15 | Alibaba Singapore Holding Private Limited | Method and system for facilitating multi-stream sequential read performance improvement with reduced read amplification |
US11461173B1 (en) | 2021-04-21 | 2022-10-04 | Alibaba Singapore Holding Private Limited | Method and system for facilitating efficient data compression based on error correction code and reorganization of data placement |
US11476874B1 (en) | 2021-05-14 | 2022-10-18 | Alibaba Singapore Holding Private Limited | Method and system for facilitating a storage server with hybrid memory for journaling and data storage |
CN114385623A (zh) * | 2021-11-30 | 2022-04-22 | 北京达佳互联信息技术有限公司 | 数据表获取方法、设备、装置、存储介质及程序产品 |
Citations (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20040098359A1 (en) * | 2002-11-14 | 2004-05-20 | David Bayliss | Method and system for parallel processing of database queries |
CN1512729A (zh) * | 2002-12-31 | 2004-07-14 | 联想(北京)有限公司 | 网络设备自适应负载均衡的方法 |
CN1735058A (zh) * | 2004-08-02 | 2006-02-15 | 华为技术有限公司 | 级联通信网的通信保证方法 |
Family Cites Families (13)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US246323A (en) * | 1881-08-30 | Door-spring | ||
US98655A (en) * | 1870-01-04 | Eoyal s | ||
US98359A (en) * | 1869-12-28 | Improved bedstead and lounge | ||
US174290A (en) * | 1876-02-29 | Improvement in sole and heel plates for boots and shoes | ||
JP3269849B2 (ja) * | 1992-05-29 | 2002-04-02 | 株式会社日立製作所 | 並列データベース処理システムとその検索方法 |
JP3266351B2 (ja) * | 1993-01-20 | 2002-03-18 | 株式会社日立製作所 | データベース管理システムおよび問合せの処理方法 |
JP3747525B2 (ja) | 1996-08-28 | 2006-02-22 | 株式会社日立製作所 | 並列データベースシステム検索方法 |
US6081801A (en) * | 1997-06-30 | 2000-06-27 | International Business Machines Corporation | Shared nothing parallel execution of procedural constructs in SQL |
US6763519B1 (en) * | 1999-05-05 | 2004-07-13 | Sychron Inc. | Multiprogrammed multiprocessor system with lobally controlled communication and signature controlled scheduling |
WO2005098655A2 (en) * | 2004-02-21 | 2005-10-20 | Datallegro, Inc. | Ultra-shared-nothing parallel database |
US8630973B2 (en) | 2004-05-03 | 2014-01-14 | Sap Ag | Distributed processing system for calculations based on objects from massive databases |
US8230426B2 (en) * | 2004-10-06 | 2012-07-24 | Digipede Technologies, Llc | Multicore distributed processing system using selection of available workunits based on the comparison of concurrency attributes with the parallel processing characteristics |
US20070174290A1 (en) | 2006-01-19 | 2007-07-26 | International Business Machines Corporation | System and architecture for enterprise-scale, parallel data mining |
-
2007
- 2007-10-01 US US11/906,293 patent/US7917574B2/en active Active
-
2008
- 2008-09-25 CA CA2639853A patent/CA2639853C/en active Active
- 2008-09-28 CN CN2008101660272A patent/CN101403978B/zh active Active
- 2008-09-30 BR BRPI0805054-6A patent/BRPI0805054B1/pt active IP Right Grant
- 2008-10-01 EP EP08253196A patent/EP2045719A3/en not_active Ceased
- 2008-10-01 AR ARP080104286A patent/AR068645A1/es active IP Right Grant
Patent Citations (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20040098359A1 (en) * | 2002-11-14 | 2004-05-20 | David Bayliss | Method and system for parallel processing of database queries |
CN1512729A (zh) * | 2002-12-31 | 2004-07-14 | 联想(北京)有限公司 | 网络设备自适应负载均衡的方法 |
CN1735058A (zh) * | 2004-08-02 | 2006-02-15 | 华为技术有限公司 | 级联通信网的通信保证方法 |
Also Published As
Publication number | Publication date |
---|---|
CA2639853A1 (en) | 2009-04-01 |
US7917574B2 (en) | 2011-03-29 |
CA2639853C (en) | 2014-08-12 |
CN101403978A (zh) | 2009-04-08 |
EP2045719A3 (en) | 2009-06-24 |
EP2045719A2 (en) | 2009-04-08 |
AR068645A1 (es) | 2009-11-25 |
US20090089544A1 (en) | 2009-04-02 |
BRPI0805054A2 (pt) | 2009-07-21 |
BRPI0805054B1 (pt) | 2019-11-12 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
CN101403978B (zh) | 用于机器集群的并行编程的基础构造 | |
CA2681154C (en) | An infrastructure for parallel programming of clusters of machines | |
Dobre et al. | Parallel programming paradigms and frameworks in big data era | |
CN103177057B (zh) | 用于内存列存储数据库的多核算法 | |
US20180210934A1 (en) | Systems and methods for interest-driven business intelligence systems including event-oriented data | |
US7885969B2 (en) | System and method for executing compute-intensive database user-defined programs on an attached high-performance parallel computer | |
CN108475276A (zh) | 用于多模型数据库的存储器内键-值存储 | |
Fiore et al. | A big data analytics framework for scientific data management | |
Saldhi et al. | Big data analysis using Hadoop cluster | |
Manghi et al. | Entity deduplication in big data graphs for scholarly communication | |
Liu et al. | Kodiak: Leveraging materialized views for very low-latency analytics over high-dimensional web-scale data | |
Martin et al. | Multi-temperate logical data warehouse design for large-scale healthcare data | |
Albertini et al. | Image classification in greenplum database using deep learning | |
Khosla et al. | Big data technologies | |
Ma et al. | dmapply: A functional primitive to express distributed machine learning algorithms in R | |
Xu et al. | E= MC3: Managing uncertain enterprise data in a cluster-computing environment | |
Gu et al. | Octopus-DF: Unified DataFrame-based cross-platform data analytic system | |
Li | Introduction to Big Data | |
Wrembel | Data integration revitalized: From data warehouse through data lake to data mesh | |
Minukhin et al. | Enhancing the performance of distributed big data processing systems using Hadoop and PolyBase | |
Dobos et al. | Graywulf: A platform for federated scientific databases and services | |
Revathi et al. | Auto JSON: An Automatic Transformation Model for Converting Relational Database to Non-relational Documents | |
Morari et al. | GEMS: Graph Database Engine for Multithreaded Systems. | |
Dobrzelecki et al. | Managing and analysing Genomic Data using HPC and Clouds | |
Jibril et al. | GTPC: Towards a Hybrid OLTP-OLAP Graph Benchmark |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
C06 | Publication | ||
PB01 | Publication | ||
C10 | Entry into substantive examination | ||
SE01 | Entry into force of request for substantive examination | ||
ASS | Succession or assignment of patent right |
Owner name: ACCENTURE GLOBAL SERVICES GMBH Free format text: FORMER OWNER: ACCENTURE INTERNATIONAL GMBH Effective date: 20101208 Owner name: ACCENTURE INTERNATIONAL GMBH Free format text: FORMER OWNER: ACCENTURE GLOBAL SERVICES GMBH Effective date: 20101208 |
|
C41 | Transfer of patent application or patent right or utility model | ||
COR | Change of bibliographic data |
Free format text: CORRECT: ADDRESS; FROM: LUXEMBOURG, LUXEMBOURG TO: DUBLIN, IRELAND Free format text: CORRECT: ADDRESS; FROM: SCHAFFHAUSEN, SWITZERLAND TO: LUXEMBOURG, LUXEMBOURG |
|
TA01 | Transfer of patent application right |
Effective date of registration: 20101208 Address after: Dublin, Ireland Applicant after: ACCENTURE GLOBAL SERVICES Ltd. Address before: Luxemburg Luxemburg Applicant before: Accenture international LLC Effective date of registration: 20101208 Address after: Luxemburg Luxemburg Applicant after: Accenture international LLC Address before: Schaffhausen Applicant before: ACCENTURE GLOBAL SERVICES Ltd. |
|
C14 | Grant of patent or utility model | ||
GR01 | Patent grant |