IN2014CH00923A - - Google Patents

Info

Publication number
IN2014CH00923A
IN2014CH00923A IN923CH2014A IN2014CH00923A IN 2014CH00923 A IN2014CH00923 A IN 2014CH00923A IN 923CH2014 A IN923CH2014 A IN 923CH2014A IN 2014CH00923 A IN2014CH00923 A IN 2014CH00923A
Authority
IN
India
Prior art keywords
data
error
restart
received
parallel processing
Prior art date
Application number
Inventor
V Kota Sastry
K Mittapalli Srinivas
Original Assignee
Ibm
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Ibm filed Critical Ibm
Publication of IN2014CH00923A publication Critical patent/IN2014CH00923A/en

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F9/00—Arrangements for program control, e.g. control units
    • G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
    • G06F9/30—Arrangements for executing machine instructions, e.g. instruction decode
    • G06F9/38—Concurrent instruction execution, e.g. pipeline, look ahead
    • G06F9/3861—Recovery, e.g. branch miss-prediction, exception handling
    • G06F9/3863—Recovery, e.g. branch miss-prediction, exception handling using multiple copies of the architectural state, e.g. shadow registers
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F11/00—Error detection; Error correction; Monitoring
    • G06F11/07—Responding to the occurrence of a fault, e.g. fault tolerance
    • G06F11/0703—Error or fault processing not based on redundancy, i.e. by taking additional measures to deal with the error or fault not making use of redundancy in operation, in hardware, or in data representation
    • G06F11/0793—Remedial or corrective actions
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F11/00—Error detection; Error correction; Monitoring
    • G06F11/004—Error avoidance
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F11/00—Error detection; Error correction; Monitoring
    • G06F11/07—Responding to the occurrence of a fault, e.g. fault tolerance
    • G06F11/0703—Error or fault processing not based on redundancy, i.e. by taking additional measures to deal with the error or fault not making use of redundancy in operation, in hardware, or in data representation
    • G06F11/0706—Error or fault processing not based on redundancy, i.e. by taking additional measures to deal with the error or fault not making use of redundancy in operation, in hardware, or in data representation the processing taking place on a specific hardware platform or in a specific software environment
    • G06F11/0709—Error or fault processing not based on redundancy, i.e. by taking additional measures to deal with the error or fault not making use of redundancy in operation, in hardware, or in data representation the processing taking place on a specific hardware platform or in a specific software environment in a distributed system consisting of a plurality of standalone computer nodes, e.g. clusters, client-server systems
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F11/00—Error detection; Error correction; Monitoring
    • G06F11/07—Responding to the occurrence of a fault, e.g. fault tolerance
    • G06F11/14—Error detection or correction of the data by redundancy in operation
    • G06F11/1402—Saving, restoring, recovering or retrying
    • G06F11/1471—Saving, restoring, recovering or retrying involving logging of persistent data for recovery
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/25—Integrating or interfacing systems involving database management systems
    • G06F16/254—Extract, transform and load [ETL] procedures, e.g. ETL data flows in data warehouses
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F9/00—Arrangements for program control, e.g. control units
    • G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
    • G06F9/30—Arrangements for executing machine instructions, e.g. instruction decode
    • G06F9/38—Concurrent instruction execution, e.g. pipeline, look ahead
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F9/00—Arrangements for program control, e.g. control units
    • G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
    • G06F9/30—Arrangements for executing machine instructions, e.g. instruction decode
    • G06F9/38—Concurrent instruction execution, e.g. pipeline, look ahead
    • G06F9/3836—Instruction issuing, e.g. dynamic instruction scheduling or out of order instruction execution
    • G06F9/3851—Instruction issuing, e.g. dynamic instruction scheduling or out of order instruction execution from multiple instruction streams, e.g. multistreaming
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F9/00—Arrangements for program control, e.g. control units
    • G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
    • G06F9/30—Arrangements for executing machine instructions, e.g. instruction decode
    • G06F9/38—Concurrent instruction execution, e.g. pipeline, look ahead
    • G06F9/3861—Recovery, e.g. branch miss-prediction, exception handling
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F9/00—Arrangements for program control, e.g. control units
    • G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
    • G06F9/30—Arrangements for executing machine instructions, e.g. instruction decode
    • G06F9/38—Concurrent instruction execution, e.g. pipeline, look ahead
    • G06F9/3867—Concurrent instruction execution, e.g. pipeline, look ahead using instruction pipelines

Abstract

ABSTRACT OF THE DISCLOSURE AVOIDING RESTART ON ERROR IN DATA INTEGRATION According to one embodiment of the present invention, a system avoids restart on an error in a data integration process. The system processes data received from a data source in accordance with a parallel processing pipeline and partitioning scheme and submits said processed data to a destination. In response to an indication of an error, the system pauses receiving of data and saves unprocessed data received from the source. After correction of the error, the system resumes processing of the received and saved data in an order of the parallel processing pipeline and partitioning scheme. Embodiments of the present invention further include a method and computer program product for avoiding restart on an error in a data integration process in substantially the same manners described above.
IN923CH2014 2013-03-14 2014-02-24 IN2014CH00923A (en)

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
US13/803,442 US9116842B2 (en) 2013-03-14 2013-03-14 Avoiding restart on error in data integration

Publications (1)

Publication Number Publication Date
IN2014CH00923A true IN2014CH00923A (en) 2015-05-08

Family

ID=51534182

Family Applications (1)

Application Number Title Priority Date Filing Date
IN923CH2014 IN2014CH00923A (en) 2013-03-14 2014-02-24

Country Status (2)

Country Link
US (2) US9116842B2 (en)
IN (1) IN2014CH00923A (en)

Families Citing this family (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US10007891B2 (en) * 2015-09-18 2018-06-26 Sap Se Re-processing requests in automated warehouses
CN106776153B (en) * 2015-11-25 2020-04-14 华为技术有限公司 Job control method and server
US10769134B2 (en) 2016-10-28 2020-09-08 Microsoft Technology Licensing, Llc Resumable and online schema transformations
CN113297038B (en) * 2020-04-07 2022-07-19 阿里巴巴集团控股有限公司 Monitoring and data processing method, device and equipment, monitoring system and data center
US11947411B2 (en) * 2022-02-25 2024-04-02 Bank Of America Corporation Systems and methods for evaluating, validating, correcting, and loading data feeds based on artificial intelligence input

Family Cites Families (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5819021A (en) 1995-12-11 1998-10-06 Ab Initio Software Corporation Overpartitioning system and method for increasing checkpoints in component-based parallel applications
US6584581B1 (en) * 1999-12-06 2003-06-24 Ab Initio Software Corporation Continuous flow checkpointing data processing
US7058634B2 (en) * 2002-02-06 2006-06-06 United Devices, Inc. Distributed blast processing architecture and associated systems and methods
US7039663B1 (en) 2002-04-19 2006-05-02 Network Appliance, Inc. System and method for checkpointing and restarting an asynchronous transfer of data between a source and destination snapshot
US9116759B2 (en) * 2011-02-18 2015-08-25 Ab Initio Technology Llc Restarting data processing systems

Also Published As

Publication number Publication date
US9116843B2 (en) 2015-08-25
US20140281699A1 (en) 2014-09-18
US9116842B2 (en) 2015-08-25
US20140380094A1 (en) 2014-12-25

Similar Documents

Publication Publication Date Title
MX2019005085A (en) Blockchain data processing method and apparatus.
EP3335176A4 (en) A computer implemented method for processing a financial transaction and a system therefor
EP3272117A4 (en) Image processing apparatus, image processing system, method for image processing, and computer program
MX2018000565A (en) Optimizing media fingerprint retention to improve system resource utilization.
PT3619921T (en) Audio processor, system, method and computer program for audio rendering
EP3096236A4 (en) Information processing system, server system, information processing program, and information processing method
EP3398043A4 (en) System and method for acquiring, processing, and updating global information
MX2017011315A (en) Glass sheet acquisition and positioning system.
IN2014CH00923A (en)
EP3398044A4 (en) System and method for acquiring, processing and updating global information
EP3397932A4 (en) System and method for acquiring, processing and updating global information
PH12018500868A1 (en) Method, system, and device for process triggering
EP3254263A4 (en) System, method and computer program for an access control system
EP3506406A4 (en) Fuel cell system, control method for fuel cell system, and computer program
TW201614490A (en) Mobile terminal, server, system and method of executing application based on particular zone
MX2015015883A (en) Systems and methods for cement evaluation.
EP3433772A4 (en) System, method, and computer program for creating an internal conforming structure
MX2016005405A (en) Communication device, communication system, communication method, and communication program.
EP3506407A4 (en) Fuel cell system, control method for fuel cell system, and computer program
EP2975523A4 (en) Database system, program, and data processing method
EP3295659A4 (en) Information processing system, information processing apparatus, information processing method, and information processing program
EP3559796C0 (en) Method for creating a data backup of a virtualization automation solution, computer program with an implementation of the method and virtualization server operating according to the process
SE1751327A1 (en) System and method for optical inspection of an object
EA201790340A1 (en) METHOD OF CARRIAGE OF CARRIAGE OF TRANSPORTATION MEANS, SUITABLE FOR TRANSPORTATION OF GOODS, AND TRANSPORTATION MEANS
EP3475852A4 (en) Method and system for flexible, high performance structured data processing