WO2014014906A3 - A method and process for enabling distributing cache data sources for query processing and distributed disk caching of large data and analysis requests - Google Patents

A method and process for enabling distributing cache data sources for query processing and distributed disk caching of large data and analysis requests Download PDF

Info

Publication number
WO2014014906A3
WO2014014906A3 PCT/US2013/050673 US2013050673W WO2014014906A3 WO 2014014906 A3 WO2014014906 A3 WO 2014014906A3 US 2013050673 W US2013050673 W US 2013050673W WO 2014014906 A3 WO2014014906 A3 WO 2014014906A3
Authority
WO
WIPO (PCT)
Prior art keywords
ability
processing
distributed disk
large data
distributed
Prior art date
Application number
PCT/US2013/050673
Other languages
French (fr)
Other versions
WO2014014906A8 (en
WO2014014906A2 (en
Inventor
Simon Byford MOSS
Elizabeth Winters ELKINS
Douglas Wiley BACHELOR
Raul Hugo CURBELO
Thomas C. FOUNTAIN
Original Assignee
Pneuron Corp.
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Pneuron Corp. filed Critical Pneuron Corp.
Priority to EP13819950.0A priority Critical patent/EP2873008A4/en
Priority to CA2918472A priority patent/CA2918472C/en
Publication of WO2014014906A2 publication Critical patent/WO2014014906A2/en
Publication of WO2014014906A8 publication Critical patent/WO2014014906A8/en
Publication of WO2014014906A3 publication Critical patent/WO2014014906A3/en
Priority to IL236764A priority patent/IL236764A0/en

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F12/00—Accessing, addressing or allocating within memory systems or architectures
    • G06F12/02—Addressing or allocation; Relocation
    • G06F12/08—Addressing or allocation; Relocation in hierarchically structured memory systems, e.g. virtual memory systems
    • G06F12/12—Replacement control
    • G06F12/121—Replacement control using replacement algorithms
    • G06F12/123—Replacement control using replacement algorithms with age lists, e.g. queue, most recently used [MRU] list or least recently used [LRU] list
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/10—File systems; File servers
    • G06F16/17—Details of further file system functions
    • G06F16/172—Caching, prefetching or hoarding of files
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/25—Integrating or interfacing systems involving database management systems
    • G06F16/254—Extract, transform and load [ETL] procedures, e.g. ETL data flows in data warehouses
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F12/00—Accessing, addressing or allocating within memory systems or architectures
    • G06F12/02—Addressing or allocation; Relocation
    • G06F12/08—Addressing or allocation; Relocation in hierarchically structured memory systems, e.g. virtual memory systems
    • G06F12/0802—Addressing of a memory level in which the access to the desired data or data block requires associative addressing means, e.g. caches
    • G06F12/0866—Addressing of a memory level in which the access to the desired data or data block requires associative addressing means, e.g. caches for peripheral storage systems, e.g. disk cache
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F2212/00—Indexing scheme relating to accessing, addressing or allocation within memory systems or architectures
    • G06F2212/46—Caching storage objects of specific type in disk cache
    • G06F2212/463—File

Abstract

A method and system for large data and distributed disk cache processing in a Pneuron platform (100). The system and method include three specific interoperable but distributed functions: the adapter/cache Pneuron (14) and distributed disk files (34), a dynamic memory mapping tree (50), and distributed disk file cleanup (28). The system allows for large data processing considerations and the ability to access and acquire information from large data files (102) and rapidly distribute and provide the information to subsequent Pneurons (104) for processing. The system also provides the ability to store large result sets, the ability to deal with sequential as well as asynchronous parallel processing, the ability to address large unstructured data; web logs, email, web pages, etc., as well as the ability to handle failures to large block processing.
PCT/US2013/050673 2012-07-16 2013-07-16 A method and process for enabling distributing cache data sources for query processing and distributed disk caching of large data and analysis requests WO2014014906A2 (en)

Priority Applications (3)

Application Number Priority Date Filing Date Title
EP13819950.0A EP2873008A4 (en) 2012-07-16 2013-07-16 A method and process for enabling distributing cache data sources for query processing and distributed disk caching of large data and analysis requests
CA2918472A CA2918472C (en) 2012-07-16 2013-07-16 A method and process for enabling distributing cache data sources for query processing and distributed disk caching of large data and analysis requests
IL236764A IL236764A0 (en) 2012-07-16 2015-01-18 A method and process for enabling distributing cache data sources for query processing and distributed disk caching of large data and analysis requests

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US201261672028P 2012-07-16 2012-07-16
US61/672,028 2012-07-16

Publications (3)

Publication Number Publication Date
WO2014014906A2 WO2014014906A2 (en) 2014-01-23
WO2014014906A8 WO2014014906A8 (en) 2014-04-10
WO2014014906A3 true WO2014014906A3 (en) 2014-05-30

Family

ID=49949358

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/US2013/050673 WO2014014906A2 (en) 2012-07-16 2013-07-16 A method and process for enabling distributing cache data sources for query processing and distributed disk caching of large data and analysis requests

Country Status (4)

Country Link
EP (1) EP2873008A4 (en)
CA (1) CA2918472C (en)
IL (1) IL236764A0 (en)
WO (1) WO2014014906A2 (en)

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2017089105A1 (en) 2015-11-27 2017-06-01 Asml Netherlands B.V. Metrology target, method and apparatus, computer program and lithographic system

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20060242155A1 (en) * 2005-04-20 2006-10-26 Microsoft Corporation Systems and methods for providing distributed, decentralized data storage and retrieval
US20100070600A1 (en) * 2007-03-26 2010-03-18 Henning G Schulzrinne Methods and media for exchanging data between nodes of disconnected networks
US7685083B2 (en) * 2002-02-01 2010-03-23 John Fairweather System and method for managing knowledge

Family Cites Families (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7689599B1 (en) * 2005-01-31 2010-03-30 Symantec Operating Corporation Repair of inconsistencies between data and metadata stored on a temporal volume using transaction log replay
US8473582B2 (en) 2009-12-16 2013-06-25 International Business Machines Corporation Disconnected file operations in a scalable multi-node file system cache for a remote cluster file system

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7685083B2 (en) * 2002-02-01 2010-03-23 John Fairweather System and method for managing knowledge
US20060242155A1 (en) * 2005-04-20 2006-10-26 Microsoft Corporation Systems and methods for providing distributed, decentralized data storage and retrieval
US20100070600A1 (en) * 2007-03-26 2010-03-18 Henning G Schulzrinne Methods and media for exchanging data between nodes of disconnected networks

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
XMLNEWS.ORG: "XML Basics", 27 June 2012 (2012-06-27), XP055188490, Retrieved from the Internet <URL:http://web.archive.org/web/20120627074440/http://www.xmlnews.org/docs/xml-basics.html> [retrieved on 20140211] *

Also Published As

Publication number Publication date
CA2918472A1 (en) 2014-01-23
WO2014014906A8 (en) 2014-04-10
EP2873008A2 (en) 2015-05-20
WO2014014906A2 (en) 2014-01-23
EP2873008A4 (en) 2016-06-29
IL236764A0 (en) 2015-03-31
CA2918472C (en) 2018-05-29

Similar Documents

Publication Publication Date Title
WO2010077972A3 (en) Method and apparatus to implement a hierarchical cache system with pnfs
TW200504507A (en) Method, system and computer program product for implementing copy-on-write of a file
EP4318410A3 (en) Distributed application architectures using blockchain and distributed file systems
WO2014042889A3 (en) Software-defined network attachable storage system and method
ATE512412T1 (en) SYSTEM AND METHOD FOR CAPACING NETWORK FILE SYSTEMS
GB2550800A (en) Managing data in storage according to a log structure
WO2009158688A3 (en) Presenting dynamic folders
NO20052613L (en) Method, system and arrangement for providing workbook areas as data sources
BR112017022547A2 (en) Extended memory access method, apparatus and system
BRPI0418438A (en) method and system for a moving object-enabled grid virtual machine
TWI456418B (en) File system hinting
EP2615566A3 (en) Unified local storage supporting file and cloud object access
EA200900001A2 (en) METHOD AND DEVICE FOR MANAGING COMPUTER FILE SYSTEM USING TREES FILE SYSTEM
GB2491730A (en) Transmission of map-reduce data based on a storage network or a storage network file system
GB201302917D0 (en) Hybrid backup and restore of very large file system using metadata image backup and traditional backup
WO2006029032A3 (en) Methods, systems, and computer program products for implementing single-node and cluster snapshots
WO2009132144A3 (en) Network storage server with integrated encryption, compression and deduplication capability
WO2010088148A3 (en) Systems and methods for managing files on a storage device
PH12017500241B1 (en) File access method, device and storage system
WO2012036938A3 (en) Directory leasing
WO2006026680A3 (en) Systems and methods for organizing and mapping data
WO2011035121A3 (en) Systems and methods for providing advanced search result page content
EP2274686A4 (en) Deletion in data file forwarding framework
BR112013032304A2 (en) cloud signature download method, cloud signature download system, and computer storage medium
CA2902868C (en) Managing operations on stored data units

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 13819950

Country of ref document: EP

Kind code of ref document: A2

WWE Wipo information: entry into national phase

Ref document number: 236764

Country of ref document: IL

WWE Wipo information: entry into national phase

Ref document number: 2013819950

Country of ref document: EP

121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 13819950

Country of ref document: EP

Kind code of ref document: A2

ENP Entry into the national phase

Ref document number: 2918472

Country of ref document: CA