SG11201805106QA - High throughput, high reliability data processing system - Google Patents

High throughput, high reliability data processing system

Info

Publication number
SG11201805106QA
SG11201805106QA SG11201805106QA SG11201805106QA SG11201805106QA SG 11201805106Q A SG11201805106Q A SG 11201805106QA SG 11201805106Q A SG11201805106Q A SG 11201805106QA SG 11201805106Q A SG11201805106Q A SG 11201805106QA SG 11201805106Q A SG11201805106Q A SG 11201805106QA
Authority
SG
Singapore
Prior art keywords
volatile memory
international
data entity
computing device
data
Prior art date
Application number
SG11201805106QA
Inventor
Ben Thomas
Original Assignee
Ab Initio Technology Llc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Ab Initio Technology Llc filed Critical Ab Initio Technology Llc
Publication of SG11201805106QA publication Critical patent/SG11201805106QA/en

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F11/00—Error detection; Error correction; Monitoring
    • G06F11/07—Responding to the occurrence of a fault, e.g. fault tolerance
    • G06F11/16—Error detection or correction of the data by redundancy in hardware
    • G06F11/20—Error detection or correction of the data by redundancy in hardware using active fault-masking, e.g. by switching out faulty elements or by switching in spare elements
    • G06F11/2053—Error detection or correction of the data by redundancy in hardware using active fault-masking, e.g. by switching out faulty elements or by switching in spare elements where persistent mass storage functionality or persistent mass storage control functionality is redundant
    • G06F11/2056—Error detection or correction of the data by redundancy in hardware using active fault-masking, e.g. by switching out faulty elements or by switching in spare elements where persistent mass storage functionality or persistent mass storage control functionality is redundant by mirroring
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F11/00—Error detection; Error correction; Monitoring
    • G06F11/07—Responding to the occurrence of a fault, e.g. fault tolerance
    • G06F11/16—Error detection or correction of the data by redundancy in hardware
    • G06F11/20—Error detection or correction of the data by redundancy in hardware using active fault-masking, e.g. by switching out faulty elements or by switching in spare elements
    • G06F11/2053—Error detection or correction of the data by redundancy in hardware using active fault-masking, e.g. by switching out faulty elements or by switching in spare elements where persistent mass storage functionality or persistent mass storage control functionality is redundant
    • G06F11/2056—Error detection or correction of the data by redundancy in hardware using active fault-masking, e.g. by switching out faulty elements or by switching in spare elements where persistent mass storage functionality or persistent mass storage control functionality is redundant by mirroring
    • G06F11/2071—Error detection or correction of the data by redundancy in hardware using active fault-masking, e.g. by switching out faulty elements or by switching in spare elements where persistent mass storage functionality or persistent mass storage control functionality is redundant by mirroring using a plurality of controllers
    • G06F11/2079—Bidirectional techniques
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F11/00—Error detection; Error correction; Monitoring
    • G06F11/07—Responding to the occurrence of a fault, e.g. fault tolerance
    • G06F11/16—Error detection or correction of the data by redundancy in hardware
    • G06F11/1658—Data re-synchronization of a redundant component, or initial sync of replacement, additional or spare unit
    • G06F11/1662—Data re-synchronization of a redundant component, or initial sync of replacement, additional or spare unit the resynchronized component or unit being a persistent storage device
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F11/00—Error detection; Error correction; Monitoring
    • G06F11/07—Responding to the occurrence of a fault, e.g. fault tolerance
    • G06F11/16—Error detection or correction of the data by redundancy in hardware
    • G06F11/1666—Error detection or correction of the data by redundancy in hardware where the redundant component is memory or memory area
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F11/00—Error detection; Error correction; Monitoring
    • G06F11/07—Responding to the occurrence of a fault, e.g. fault tolerance
    • G06F11/16—Error detection or correction of the data by redundancy in hardware
    • G06F11/20—Error detection or correction of the data by redundancy in hardware using active fault-masking, e.g. by switching out faulty elements or by switching in spare elements
    • G06F11/2053—Error detection or correction of the data by redundancy in hardware using active fault-masking, e.g. by switching out faulty elements or by switching in spare elements where persistent mass storage functionality or persistent mass storage control functionality is redundant
    • G06F11/2056—Error detection or correction of the data by redundancy in hardware using active fault-masking, e.g. by switching out faulty elements or by switching in spare elements where persistent mass storage functionality or persistent mass storage control functionality is redundant by mirroring
    • G06F11/2082—Data synchronisation
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F11/00—Error detection; Error correction; Monitoring
    • G06F11/07—Responding to the occurrence of a fault, e.g. fault tolerance
    • G06F11/16—Error detection or correction of the data by redundancy in hardware
    • G06F11/20—Error detection or correction of the data by redundancy in hardware using active fault-masking, e.g. by switching out faulty elements or by switching in spare elements
    • G06F11/2053—Error detection or correction of the data by redundancy in hardware using active fault-masking, e.g. by switching out faulty elements or by switching in spare elements where persistent mass storage functionality or persistent mass storage control functionality is redundant
    • G06F11/2094—Redundant storage or storage space
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F12/00—Accessing, addressing or allocating within memory systems or architectures
    • G06F12/02—Addressing or allocation; Relocation
    • G06F12/0223—User address space allocation, e.g. contiguous or non contiguous base addressing
    • G06F12/023—Free address space management
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
    • G06F3/0601—Interfaces specially adapted for storage systems
    • G06F3/0628—Interfaces specially adapted for storage systems making use of a particular technique
    • G06F3/0646—Horizontal data movement in storage systems, i.e. moving data in between storage devices or systems
    • G06F3/065—Replication mechanisms
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00—Network arrangements or protocols for supporting network services or applications
    • H04L67/01—Protocols
    • H04L67/10—Protocols in which an application is distributed across nodes in the network
    • H04L67/1095—Replication or mirroring of data, e.g. scheduling or transport for data synchronisation between network nodes
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00—Network arrangements or protocols for supporting network services or applications
    • H04L67/01—Protocols
    • H04L67/10—Protocols in which an application is distributed across nodes in the network
    • H04L67/1097—Protocols in which an application is distributed across nodes in the network for distributed storage of data in networks, e.g. transport arrangements for network file system [NFS], storage area networks [SAN] or network attached storage [NAS]
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F12/00—Accessing, addressing or allocating within memory systems or architectures
    • G06F12/02—Addressing or allocation; Relocation
    • G06F12/0223—User address space allocation, e.g. contiguous or non contiguous base addressing
    • G06F12/023—Free address space management
    • G06F12/0253—Garbage collection, i.e. reclamation of unreferenced memory
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F2201/00—Indexing scheme relating to error detection, to error correction, and to monitoring
    • G06F2201/855—Details of asynchronous mirroring using a journal to transfer not-yet-mirrored changes

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Quality & Reliability (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Signal Processing (AREA)
  • Human Computer Interaction (AREA)
  • Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
  • Hardware Redundancy (AREA)
  • Retry When Errors Occur (AREA)
  • Techniques For Improving Reliability Of Storages (AREA)

Abstract

a116c VOLATILE MEMORY VOLATILE MEMORY NON-VOLATILE MEMORY VOLATILE MEMORY 112 122b NOMVOLATILE MEMORY NON-VOLATILE r MEMORY FIG. 1B W O 20 17 / 1055 29 Al (12) INTERNATIONAL APPLICATION PUBLISHED UNDER THE PATENT COOPERATION TREATY (PCT) (19) World Intellectual Property Organization International Bureau (10) International Publication Number (43) International Publication Date WO 2017/105529 Al 22 June 2017 (22.06.2017) WIPO I PCT 11111111111110110111111111110101111101101011111111111111101110111111111110111111 (51) International Patent Classification: G06F 11/20 (2006.01) (21) International Application Number: PCT/US2016/017108 (22) International Filing Date: 9 February 2016 (09.02.2016) (25) Filing Language: English (26) Publication Language: English (30) Priority Data: 62/268,090 16 December 2015 (16.12.2015) US 15/019,003 9 February 2016 (09.02.2016) US (71) Applicant: AB INITIO TECHNOLOGY LLC [US/US]; 201 Spring Street, Lexington, MA 02421 (US). (72) Inventor: THOMAS, Ben; 2 Appletree Lane, Bedford, MA 01730 (US). (74) Agent: RUDOY, Daniel, G.; Wolf, Greenfield & Sacks, P.C., 600 Atlantic Avenue, Boston, MA 02210-2206 (US). (81) Designated States (unless otherwise indicated, for every kind of national protection available): AE, AG, AL, AM, AO, AT, AU, AZ, BA, BB, BG, BH, BN, BR, BW, BY, BZ, CA, CH, CL, CN, CO, CR, CU, CZ, DE, DK, DM, DO, DZ, EC, EE, EG, ES, FI, GB, GD, GE, GH, GM, GT, HN, HR, HU, ID, IL, IN, IR, IS, JP, KE, KG, KN, KP, KR, KZ, LA, LC, LK, LR, LS, LU, LY, MA, MD, ME, MG, MK, MN, MW, MX, MY, MZ, NA, NG, NI, NO, NZ, OM, PA, PE, PG, PH, PL, PT, QA, RO, RS, RU, RW, SA, SC, SD, SE, SG, SK, SL, SM, ST, SV, SY, TH, TJ, TM, TN, TR, TT, TZ, UA, UG, US, UZ, VC, VN, ZA, ZM, ZW. (84) Designated States (unless otherwise indicated, for every kind of regional protection available): ARIPO (BW, GH, GM, KE, LR, LS, MW, MZ, NA, RW, SD, SL, ST, SZ, TZ, UG, ZM, ZW), Eurasian (AM, AZ, BY, KG, KZ, RU, TJ, TM), European (AL, AT, BE, BG, CH, CY, CZ, DE, DK, EE, ES, FI, FR, GB, GR, HR, HU, IE, IS, IT, LT, LU, LV, MC, MK, MT, NL, NO, PL, PT, RO, RS, SE, SI, SK, SM, TR), OAPI (BF, BJ, CF, CG, CI, CM, GA, GN, GQ, GW, KM, ML, MR, NE, SN, TD, TG). Published: with international search report (Art. 21(3)) (54) Title: HIGH THROUGHPUT, HIGH RELIABILITY DATA PROCESSING SYSTEM (57) : A data processing system configured to store a plurality of data entities in volatile memories of multiple different computing devices. The data processing system comprises a first computing device having a first volatile memory configured to store a first data entity; and a second computing device having a second volatile memory configured to store a copy of the first data entity. The first computing device is configured to perform: receiving an indication to update the first data entity; after receiving the indica - tion, updating the first data entity in the first volatile memory, and providing to the second computing device an indication to update the copy of the first data entity; and providing an indication that the first data entity has been updated, after receiving information from the second computing device indicating that the copy of the first data entity has been updated in the second volatile memory.
SG11201805106QA 2015-12-16 2016-02-09 High throughput, high reliability data processing system SG11201805106QA (en)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
US201562268090P 2015-12-16 2015-12-16
PCT/US2016/017108 WO2017105529A1 (en) 2015-12-16 2016-02-09 High throughput, high reliability data processing system
US15/019,003 US10025680B2 (en) 2015-12-16 2016-02-09 High throughput, high reliability data processing system

Publications (1)

Publication Number Publication Date
SG11201805106QA true SG11201805106QA (en) 2018-07-30

Family

ID=55456900

Family Applications (1)

Application Number Title Priority Date Filing Date
SG11201805106QA SG11201805106QA (en) 2015-12-16 2016-02-09 High throughput, high reliability data processing system

Country Status (7)

Country Link
US (1) US10025680B2 (en)
JP (1) JP6626976B2 (en)
KR (1) KR102105478B1 (en)
AU (1) AU2016373662B2 (en)
CA (1) CA3008830C (en)
SG (1) SG11201805106QA (en)
WO (1) WO2017105529A1 (en)

Families Citing this family (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
AU2016373662B2 (en) * 2015-12-16 2019-07-11 Ab Initio Technology Llc High throughput, high reliability data processing system
CN107948750B (en) * 2017-12-15 2019-11-01 中广热点云科技有限公司 Set-top box automatically updates the method and its system of the rendition list
CN114521256A (en) * 2019-09-16 2022-05-20 阿韦瓦软件有限责任公司 Computerized system and method for bidirectional file sharing and synchronization over and through a network

Family Cites Families (34)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6343299B1 (en) 1998-11-16 2002-01-29 International Business Machines Corporation Method and apparatus for random update synchronization among multiple computing devices
US6823355B1 (en) 2000-05-31 2004-11-23 International Business Machines Corporation Synchronous replication of transactions in a distributed system
US6934755B1 (en) * 2000-06-02 2005-08-23 Sun Microsystems, Inc. System and method for migrating processes on a network
US6941410B1 (en) * 2000-06-02 2005-09-06 Sun Microsystems, Inc. Virtual heap for a virtual machine
US7571215B2 (en) 2001-07-16 2009-08-04 Bea Systems, Inc. Data replication protocol
US6917951B2 (en) 2001-07-26 2005-07-12 Microsoft Corporation System and method for replicating data in resource sets
US7149761B2 (en) 2001-11-13 2006-12-12 Tadpole Technology Plc System and method for managing the synchronization of replicated version-managed databases
US6990603B2 (en) * 2002-01-02 2006-01-24 Exanet Inc. Method and apparatus for securing volatile data in power failure in systems having redundancy
US7606881B2 (en) 2002-04-25 2009-10-20 Oracle International Corporation System and method for synchronization of version annotated objects
US7284107B2 (en) * 2004-04-30 2007-10-16 Microsoft Corporation Special-use heaps
US7680839B1 (en) 2004-09-30 2010-03-16 Symantec Operating Corporation System and method for resynchronizing mirrored volumes
US7707165B1 (en) 2004-12-09 2010-04-27 Netapp, Inc. System and method for managing data versions in a file system
US20070067359A1 (en) 2005-09-21 2007-03-22 Lenovo (Singapore) Pte. Ltd. Centralized system for versioned data synchronization
US10410308B2 (en) 2006-04-14 2019-09-10 Fuzzmed, Inc. System, method, and device for personal medical care, intelligent analysis, and diagnosis
US8997048B1 (en) * 2007-02-14 2015-03-31 Oracle America, Inc. Method and apparatus for profiling a virtual machine
EP2208148B1 (en) 2007-09-28 2014-06-25 Apertio Limited System and method for replication and synchronisation
US8832023B2 (en) * 2009-01-30 2014-09-09 Apple Inc. System for managing distributed assets and metadata
JP4951652B2 (en) * 2009-06-24 2012-06-13 株式会社日立製作所 Computer system remote copy method and computer system
US8055615B2 (en) 2009-08-25 2011-11-08 Yahoo! Inc. Method for efficient storage node replacement
US8074107B2 (en) 2009-10-26 2011-12-06 Amazon Technologies, Inc. Failover and recovery for replicated data instances
JP5380695B2 (en) * 2010-02-23 2014-01-08 株式会社日立製作所 Memory management method, computer system, and memory management program
US8832674B2 (en) * 2011-02-24 2014-09-09 Software Ag Usa, Inc. Off-heap direct-memory data stores, methods of creating and/or managing off-heap direct-memory data stores, and/or systems including off-heap direct-memory data store
US9519555B2 (en) * 2011-05-23 2016-12-13 Microsoft Technology Licensing, Llc Synchronous replication in a distributed storage environment
WO2013039494A1 (en) * 2011-09-14 2013-03-21 Hewlett-Packard Development Company, L.P. Imparting durability to a transactional memory system
US9449014B2 (en) 2011-11-29 2016-09-20 Dell Products L.P. Resynchronization of replicated data
US9286162B2 (en) * 2012-02-02 2016-03-15 Netapp, Inc. System and method for guaranteeing consistent data synchronization from a volatile data source
AU2013277351A1 (en) 2012-06-18 2015-01-22 Actifio, Inc. Enhanced data management virtualization system
US9021050B2 (en) * 2012-08-31 2015-04-28 Yume, Inc. Network service system and method with off-heap caching
US9135164B2 (en) 2013-03-15 2015-09-15 Virident Systems Inc. Synchronous mirroring in non-volatile memory systems
US9575844B2 (en) * 2013-03-15 2017-02-21 Skyera, Llc Mass storage device and method of operating the same to back up data stored in volatile memory
US9436559B2 (en) * 2014-01-17 2016-09-06 Hitachi, Ltd. Storage apparatus and method for controlling cache of storage apparatus
JP6093320B2 (en) * 2014-02-28 2017-03-08 日本電信電話株式会社 Distributed processing system
US20160041917A1 (en) * 2014-08-05 2016-02-11 Diablo Technologies, Inc. System and method for mirroring a volatile memory of a computer system
AU2016373662B2 (en) * 2015-12-16 2019-07-11 Ab Initio Technology Llc High throughput, high reliability data processing system

Also Published As

Publication number Publication date
JP6626976B2 (en) 2019-12-25
AU2016373662A1 (en) 2018-07-05
CA3008830A1 (en) 2017-06-22
JP2019504401A (en) 2019-02-14
AU2016373662B2 (en) 2019-07-11
US10025680B2 (en) 2018-07-17
WO2017105529A1 (en) 2017-06-22
KR20180095004A (en) 2018-08-24
CA3008830C (en) 2020-09-22
US20170180473A1 (en) 2017-06-22
KR102105478B1 (en) 2020-04-28

Similar Documents

Publication Publication Date Title
SG11201900116RA (en) Communication flow for verification and identification check
CA3015496A1 (en) Voice control of a media playback system
SG11201804771WA (en) Systems and methods for providing financial data to financial instruments in a distributed ledger system
SG11201806404SA (en) Systems and methods for storing and sharing transactional data using distributed computer systems
SG11201904942YA (en) Blockchain-based service execution method and apparatus, and electronic device
SG11201907679TA (en) Business verification method and apparatus
SG11201903787YA (en) Exploiting input data sparsity in neural network compute units
SG11201900269XA (en) Channel sensing for independent links
SG11201809963XA (en) Application framework using blockchain-based asset ownership
SG11201804482UA (en) Search and retrieval data processing system for computing near real-time data aggregations
SG11201810221YA (en) Fidelity estimation for quantum computing systems
SG11201906476TA (en) Login information processing method and device
SG11201903958SA (en) Intuitive occluded object indicator
SG11201809795VA (en) Memory access techniques in memory devices with multiple partitions
SG11201811095UA (en) Multi-level storage in ferroelectric memory
SG11201901138XA (en) Facial recognition-based authentication
SG11201804758QA (en) Aqueous pharmaceutical formulation comprising anti-pd-1 antibody avelumab
SG11201806825RA (en) A data source system agnostic fact category partitioned information repository and methods for the insertion and retrieval of data using the information repository
SG11201903684RA (en) Neural network compute tile
SG11201803751VA (en) Method and system for use of a blockchain in a transaction processing network
SG11201909943SA (en) System and method for high accuracy location determination and parking
SG11201807307VA (en) System and method for aerial system discrimination and action
SG11201906413XA (en) Exposure apparatus
SG11201805103VA (en) Method and system for service enablement
SG11201901168UA (en) Apparatuses and methods including ferroelectric memory and for operating ferroelectric memory