EP2442265A3 - Method and server cluster for MapReducing FLOW services and large documents - Google Patents

Method and server cluster for MapReducing FLOW services and large documents Download PDF

Info

Publication number
EP2442265A3
EP2442265A3 EP11192312.4A EP11192312A EP2442265A3 EP 2442265 A3 EP2442265 A3 EP 2442265A3 EP 11192312 A EP11192312 A EP 11192312A EP 2442265 A3 EP2442265 A3 EP 2442265A3
Authority
EP
European Patent Office
Prior art keywords
server cluster
mapreducing
intermediate results
documents
reducing
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Withdrawn
Application number
EP11192312.4A
Other languages
German (de)
French (fr)
Other versions
EP2442265A2 (en
Inventor
Bhaskar Reddy Byreddy
Ramu Ramaiah
Vinay Punnoose
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Software AG
Original Assignee
Software AG
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Software AG filed Critical Software AG
Publication of EP2442265A2 publication Critical patent/EP2442265A2/en
Publication of EP2442265A3 publication Critical patent/EP2442265A3/en
Withdrawn legal-status Critical Current

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q10/00—Administration; Management
    • G06Q10/06—Resources, workflows, human or project management; Enterprise or organisation planning; Enterprise or organisation modelling
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F2209/00—Indexing scheme relating to G06F9/00
    • G06F2209/50—Indexing scheme relating to G06F9/50
    • G06F2209/5017—Task decomposition

Landscapes

  • Engineering & Computer Science (AREA)
  • Business, Economics & Management (AREA)
  • Human Resources & Organizations (AREA)
  • Economics (AREA)
  • Strategic Management (AREA)
  • Entrepreneurship & Innovation (AREA)
  • Operations Research (AREA)
  • Physics & Mathematics (AREA)
  • Educational Administration (AREA)
  • Marketing (AREA)
  • Development Economics (AREA)
  • Quality & Reliability (AREA)
  • Tourism & Hospitality (AREA)
  • Game Theory and Decision Science (AREA)
  • General Business, Economics & Management (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Multi Processors (AREA)
  • Computer And Data Communications (AREA)
  • Stored Programmes (AREA)
  • Information Transfer Between Computers (AREA)

Abstract

The present invention refers to a method for MapReducing the processing of an Electronic Data Interchange (EDI) document (1, the method comprising the following steps:
a. mapping the EDI document (1) into a plurality of intermediate documents (10, 11);
b. processing the intermediate documents (10, 11) to produce a plurality of intermediate results (20-23);
c. reducing the plurality of intermediate results (20-23) to produce a plurality of reduced intermediate results (30, 31); and
d. reducing the reduced intermediate results (30,31) to produce a final result (2) representing the processed EDI document (1);
e. wherein steps a. and d. are performed by a master server (M1) of a server cluster and wherein steps b. and c. are performed by a plurality of slave servers (S1, S2) of the server cluster, each slave server (S1, S2) processing one or more intermediate documents (10, 11) and reducing one or more intermediate results (20-23)..
EP11192312.4A 2008-10-31 2009-10-02 Method and server cluster for MapReducing FLOW services and large documents Withdrawn EP2442265A3 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
IN1869KO2008 2008-10-31
EP09172073A EP2182478A1 (en) 2008-10-31 2009-10-02 Method and server cluster for MapReducing FLOW services and large documents

Related Parent Applications (1)

Application Number Title Priority Date Filing Date
EP09172073.0 Division 2009-10-02

Publications (2)

Publication Number Publication Date
EP2442265A2 EP2442265A2 (en) 2012-04-18
EP2442265A3 true EP2442265A3 (en) 2013-10-09

Family

ID=41409232

Family Applications (2)

Application Number Title Priority Date Filing Date
EP09172073A Withdrawn EP2182478A1 (en) 2008-10-31 2009-10-02 Method and server cluster for MapReducing FLOW services and large documents
EP11192312.4A Withdrawn EP2442265A3 (en) 2008-10-31 2009-10-02 Method and server cluster for MapReducing FLOW services and large documents

Family Applications Before (1)

Application Number Title Priority Date Filing Date
EP09172073A Withdrawn EP2182478A1 (en) 2008-10-31 2009-10-02 Method and server cluster for MapReducing FLOW services and large documents

Country Status (3)

Country Link
US (1) US8682998B2 (en)
EP (2) EP2182478A1 (en)
CN (1) CN101727481A (en)

Families Citing this family (19)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9619291B2 (en) * 2009-12-20 2017-04-11 Yahoo! Inc. System and method for a task management library to execute map-reduce applications in a map-reduce framework
US8918388B1 (en) * 2010-02-26 2014-12-23 Turn Inc. Custom data warehouse on top of mapreduce
CN102236581B (en) * 2010-04-30 2013-08-14 国际商业机器公司 Mapping reduction method and system thereof for data center
CN102456031B (en) * 2010-10-26 2016-08-31 腾讯科技（深圳）有限公司 A kind of Map Reduce system and the method processing data stream
US8656453B2 (en) 2010-11-10 2014-02-18 Software Ag Security systems and/or methods for cloud computing environments
US9307048B2 (en) 2010-12-28 2016-04-05 Microsoft Technology Licensing, Llc System and method for proactive task scheduling of a copy of outlier task in a computing environment
US8560779B2 (en) 2011-05-20 2013-10-15 International Business Machines Corporation I/O performance of data analytic workloads
JP5613118B2 (en) * 2011-07-22 2014-10-22 インターナショナル・ビジネス・マシーンズ・コーポレーションＩｎｔｅｒｎａｔｉｏｎａｌ Ｂｕｓｉｎｅｓｓ Ｍａｃｈｉｎｅｓ Ｃｏｒｐｏｒａｔｉｏｎ Conversion rule generation support apparatus, method, and program
US9262216B2 (en) 2012-02-14 2016-02-16 Microsoft Technologies Licensing, LLC Computing cluster with latency control
JP5853866B2 (en) * 2012-06-05 2016-02-09 富士通株式会社 Allocation program, allocation device, and allocation method
US20130339972A1 (en) * 2012-06-18 2013-12-19 Zhuoyao Zhang Determining an allocation of resources to a program having concurrent jobs
US8875227B2 (en) * 2012-10-05 2014-10-28 International Business Machines Corporation Privacy aware authenticated map-reduce
US9973418B2 (en) 2013-11-12 2018-05-15 Software Ag Techniques for change propagation across broker territories
US9003062B1 (en) 2014-01-23 2015-04-07 Software Ag Framework for exchanging large B2B transactional in-order messages using distributed file system (DFS) and associated method
CN104391748A (en) * 2014-11-21 2015-03-04 浪潮电子信息产业股份有限公司 Mapreduce calculation process optimization method
US10198185B2 (en) * 2014-12-31 2019-02-05 Samsung Electronics Co., Ltd. Computing system with processing and method of operation thereof
US10922347B2 (en) * 2016-01-28 2021-02-16 Hyland Switzerland Sàrl Hierarchical dictionary with statistical filtering based on word frequency
US10362109B2 (en) * 2016-03-30 2019-07-23 Task Performance Group, Inc. Cloud operating system and method
US11954525B1 (en) * 2022-09-21 2024-04-09 Zhejiang Lab Method and apparatus of executing collaborative job for spark faced to multiple K8s clusters

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20070038659A1 (en) * 2005-08-15 2007-02-15 Google, Inc. Scalable user clustering based on set similarity
US20080082374A1 (en) * 2004-03-19 2008-04-03 Kennis Peter H Methods and systems for mapping transaction data to common ontology for compliance monitoring
US20080086442A1 (en) * 2006-10-05 2008-04-10 Yahoo! Inc. Mapreduce for distributed database processing
US20080120314A1 (en) * 2006-11-16 2008-05-22 Yahoo! Inc. Map-reduce with merge to process multiple relational datasets

Family Cites Families (18)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
AU662805B2 (en) * 1992-04-06 1995-09-14 Addison M. Fischer A method for processing information among computers which may exchange messages
US5742806A (en) * 1994-01-31 1998-04-21 Sun Microsystems, Inc. Apparatus and method for decomposing database queries for database management system including multiprocessor digital data processing system
US6205482B1 (en) * 1998-02-19 2001-03-20 Ameritech Corporation System and method for executing a request from a client application
US6092189A (en) * 1998-04-30 2000-07-18 Compaq Computer Corporation Channel configuration program server architecture
US6314468B1 (en) * 1998-09-03 2001-11-06 Mci Worldcom, Inc. System and method for managing transmission of electronic data between trading partners
US20020010659A1 (en) * 2000-04-28 2002-01-24 David Cruse Inventory management and/or control
US6751787B1 (en) * 2000-10-13 2004-06-15 Intervoice Limited Partnership Graphical programming language for representations of concurrent operations
US7043687B2 (en) * 2000-12-27 2006-05-09 G. E. Information Services, Inc. Document/message management
US7305614B2 (en) * 2001-07-17 2007-12-04 International Business Machines Corporation Interoperable retrieval and deposit using annotated schema to interface between industrial document specification languages
US9818136B1 (en) * 2003-02-05 2017-11-14 Steven M. Hoffberg System and method for determining contingent relevance
US7331036B1 (en) * 2003-05-02 2008-02-12 Intervoice Limited Partnership System and method to graphically facilitate speech enabled user interfaces
US7756919B1 (en) * 2004-06-18 2010-07-13 Google Inc. Large-scale data processing in a distributed and parallel processing enviornment
US7650331B1 (en) * 2004-06-18 2010-01-19 Google Inc. System and method for efficient large-scale data processing
US7650353B2 (en) * 2005-12-16 2010-01-19 Microsoft Corporation XML specification for electronic data interchange (EDI)
US7703099B2 (en) * 2006-02-24 2010-04-20 Microsoft Corporation Scalable transformation and configuration of EDI interchanges
US7680764B2 (en) * 2006-06-21 2010-03-16 Oracle International Corporation Parallel population of an XML index
US20080168109A1 (en) * 2007-01-09 2008-07-10 Microsoft Corporation Automatic map updating based on schema changes
US8726290B2 (en) * 2008-06-12 2014-05-13 Yahoo! Inc. System and/or method for balancing allocation of data among reduce processes by reallocation

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20080082374A1 (en) * 2004-03-19 2008-04-03 Kennis Peter H Methods and systems for mapping transaction data to common ontology for compliance monitoring
US20070038659A1 (en) * 2005-08-15 2007-02-15 Google, Inc. Scalable user clustering based on set similarity
US20080086442A1 (en) * 2006-10-05 2008-04-10 Yahoo! Inc. Mapreduce for distributed database processing
US20080120314A1 (en) * 2006-11-16 2008-05-22 Yahoo! Inc. Map-reduce with merge to process multiple relational datasets

Non-Patent Citations (2)

* Cited by examiner, † Cited by third party
Title
DEAN ET AL: "MapReduce: Simplified Data Processing on Large Clusters", 6 December 2004 (2004-12-06), pages 1 - 13, XP002503560, Retrieved from the Internet <URL:http://labs.google.com/papers/mapreduce-osdi04.pdf> [retrieved on 20081111] *
MICHAL LACLAVÃK ET AL: "Towards Large Scale Semantic Annotation Built on MapReduce Architecture", COMPUTATIONAL SCIENCE Â ICCS 2008; [LECTURE NOTES IN COMPUTER SCIENCE], SPRINGER BERLIN HEIDELBERG, BERLIN, HEIDELBERG, vol. 5103, 23 June 2008 (2008-06-23), pages 331 - 338, XP019090691, ISBN: 978-3-540-69388-8 *

Also Published As

Publication number Publication date
US8682998B2 (en) 2014-03-25
CN101727481A (en) 2010-06-09
US20100115046A1 (en) 2010-05-06
EP2442265A2 (en) 2012-04-18
EP2182478A1 (en) 2010-05-05

Similar Documents

Publication Publication Date Title
EP2442265A3 (en) Method and server cluster for MapReducing FLOW services and large documents
EP1871109A3 (en) Sub-frame metadata distribution server
WO2008115713A3 (en) System and technique for editing and classifying documents
EP1643425A3 (en) RFID server internals design
EP2199942A3 (en) Methods and systems for enabling community-tested security features for legacy applications
EP2846226A3 (en) Method and system for providing haptic effects based on information complementary to multimedia content
ATE523861T1 (en) IMAGE ENHANCEMENT
EP2477414A3 (en) Method for assembling a video stream, system and computer software
EP2051533A3 (en) 3D image rendering apparatus and method
WO2012049124A3 (en) Methods and systems for producing compounded ultrasound images
EP1959681A3 (en) Image processing device and method, recording medium, and program
EP2495680A3 (en) Information processing system, information processor, image forming apparatus, and information processing method
EP2680140A3 (en) A method, an apparatus and a computer program product for extending an application in a client device
EP1770556A3 (en) Method And Apparatus For Publishing Content Through Blog
WO2010013257A3 (en) Real-time processing of service applications such as mortgages, loans or insurances
EP2161685A3 (en) Pipelined image processing engine
EP2306301A3 (en) Image processing system, image processing method and image processing program
EP2348447A3 (en) A computer implemented method for generating a set of identifiers from a private key, computer implemented method and computing device
EP2257038A3 (en) Image processing apparatus, image processing method, and computer program
EP2293516A3 (en) Method, apparatus and system for processing composite service and replacing service and invoking service
WO2007132381A3 (en) System and method for generating intraoperative 3-dimensional images using non-contrast image data
EP2555144A3 (en) Structured document development, management and generation
EP2241967A3 (en) Information processing apparatus, control method, and program
EP3229160A3 (en) Method for configuring a medical instrument, system for con-figuring a medical instrument, computer program product and computer readable medium
EP2276265A3 (en) Image processing apparatus and image processing method

Legal Events

Date Code Title Description
PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

17P Request for examination filed

Effective date: 20111207

AC Divisional application: reference to earlier application

Ref document number: 2182478

Country of ref document: EP

Kind code of ref document: P

AK Designated contracting states

Kind code of ref document: A2

Designated state(s): AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO SE SI SK SM TR

PUAL Search report despatched

Free format text: ORIGINAL CODE: 0009013

AK Designated contracting states

Kind code of ref document: A3

Designated state(s): AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO SE SI SK SM TR

RIC1 Information provided on ipc code assigned before grant

Ipc: G06Q 10/06 20120101AFI20130905BHEP

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: THE APPLICATION IS DEEMED TO BE WITHDRAWN

18D Application deemed to be withdrawn

Effective date: 20140410