EP3180699A4 - Metadata index search in file system - Google Patents

Metadata index search in file system Download PDF

Info

Publication number
EP3180699A4
EP3180699A4 EP15835487.8A EP15835487A EP3180699A4 EP 3180699 A4 EP3180699 A4 EP 3180699A4 EP 15835487 A EP15835487 A EP 15835487A EP 3180699 A4 EP3180699 A4 EP 3180699A4
Authority
EP
European Patent Office
Prior art keywords
file system
index search
metadata index
metadata
search
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
EP15835487.8A
Other languages
German (de)
French (fr)
Other versions
EP3180699A1 (en
Inventor
Stephen Morgan
Masood Mortazavi
Gopinath Palani
Guangyu Shi
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Huawei Technologies Co Ltd
Original Assignee
Huawei Technologies Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Huawei Technologies Co Ltd filed Critical Huawei Technologies Co Ltd
Publication of EP3180699A1 publication Critical patent/EP3180699A1/en
Publication of EP3180699A4 publication Critical patent/EP3180699A4/en
Ceased legal-status Critical Current

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/10—File systems; File servers
    • G06F16/18—File system types
    • G06F16/182—Distributed file systems
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/10—File systems; File servers
    • G06F16/13—File access structures, e.g. distributed indices
    • G06F16/137—Hash-based
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/10—File systems; File servers
    • G06F16/14—Details of searching files based on file metadata
    • G06F16/148—File search processing

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Data Mining & Analysis (AREA)
  • Databases & Information Systems (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Library & Information Science (AREA)
  • Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
EP15835487.8A 2014-08-28 2015-08-27 Metadata index search in file system Ceased EP3180699A4 (en)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
US201462043257P 2014-08-28 2014-08-28
US14/831,292 US20160063021A1 (en) 2014-08-28 2015-08-20 Metadata Index Search in a File System
PCT/CN2015/088283 WO2016029865A1 (en) 2014-08-28 2015-08-27 Metadata index search in file system

Publications (2)

Publication Number Publication Date
EP3180699A1 EP3180699A1 (en) 2017-06-21
EP3180699A4 true EP3180699A4 (en) 2017-07-12

Family

ID=55398769

Family Applications (1)

Application Number Title Priority Date Filing Date
EP15835487.8A Ceased EP3180699A4 (en) 2014-08-28 2015-08-27 Metadata index search in file system

Country Status (4)

Country Link
US (1) US20160063021A1 (en)
EP (1) EP3180699A4 (en)
CN (1) CN106663056B (en)
WO (1) WO2016029865A1 (en)

Families Citing this family (34)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US10235374B2 (en) * 2016-03-08 2019-03-19 International Business Machines Corporation Key-value store for managing user files based on pairs of key-value pairs
US10241685B2 (en) * 2016-08-17 2019-03-26 Oracle International Corporation Externally managed I/O starvation avoidance in a computing device
WO2018129500A1 (en) * 2017-01-09 2018-07-12 President And Fellows Of Harvard College Optimized navigable key-value store
US20180349095A1 (en) * 2017-06-06 2018-12-06 ScaleFlux, Inc. Log-structured merge tree based data storage architecture
US10635654B2 (en) * 2017-06-12 2020-04-28 Samsung Electronics Co., Ltd. Data journaling for large solid state storage devices with low DRAM/SRAM
WO2019006551A1 (en) * 2017-07-06 2019-01-10 Open Text Sa Ulc System and method of managing indexing for search index partitions
US10649852B1 (en) * 2017-07-14 2020-05-12 EMC IP Holding Company LLC Index metadata for inode based backups
US11615083B1 (en) 2017-11-22 2023-03-28 Amazon Technologies, Inc. Storage level parallel query processing
CN108009646B (en) * 2017-11-30 2021-11-12 深圳市轱辘车联数据技术有限公司 Vehicle data processing method and server
CN108763413B (en) * 2018-05-23 2021-07-23 唐山高新技术产业园区兴荣科技有限公司 Data searching and positioning method based on data storage format
CN108984686B (en) * 2018-07-02 2021-03-30 中国电子科技集团公司第五十二研究所 Distributed file system indexing method and device based on log merging
US11615142B2 (en) * 2018-08-20 2023-03-28 Salesforce, Inc. Mapping and query service between object oriented programming objects and deep key-value data stores
US10942909B2 (en) * 2018-09-25 2021-03-09 Salesforce.Com, Inc. Efficient production and consumption for data changes in a database under high concurrency
CN111400266B (en) * 2019-01-02 2023-05-02 阿里巴巴集团控股有限公司 Data processing method and system, and diagnosis processing method and device for operation event
US11176000B2 (en) 2019-01-25 2021-11-16 International Business Machines Corporation Methods and systems for custom metadata driven data protection and identification of data
US11093448B2 (en) 2019-01-25 2021-08-17 International Business Machines Corporation Methods and systems for metadata tag inheritance for data tiering
US11210266B2 (en) 2019-01-25 2021-12-28 International Business Machines Corporation Methods and systems for natural language processing of metadata
US11914869B2 (en) 2019-01-25 2024-02-27 International Business Machines Corporation Methods and systems for encryption based on intelligent data classification
US11113238B2 (en) 2019-01-25 2021-09-07 International Business Machines Corporation Methods and systems for metadata tag inheritance between multiple storage systems
US11030054B2 (en) 2019-01-25 2021-06-08 International Business Machines Corporation Methods and systems for data backup based on data classification
US11113148B2 (en) 2019-01-25 2021-09-07 International Business Machines Corporation Methods and systems for metadata tag inheritance for data backup
US11100048B2 (en) 2019-01-25 2021-08-24 International Business Machines Corporation Methods and systems for metadata tag inheritance between multiple file systems within a storage system
US11194795B2 (en) 2019-04-16 2021-12-07 Snowflake Inc. Automated maintenance of external tables in database systems
US11520818B2 (en) * 2019-04-30 2022-12-06 EMC IP Holding Company LLC Method, apparatus and computer program product for managing metadata of storage object
US11860869B1 (en) 2019-06-28 2024-01-02 Amazon Technologies, Inc. Performing queries to a consistent view of a data set across query engine types
US11455305B1 (en) 2019-06-28 2022-09-27 Amazon Technologies, Inc. Selecting alternate portions of a query plan for processing partial results generated separate from a query engine
CN110928498B (en) * 2019-11-15 2023-11-10 浙江大华技术股份有限公司 Directory traversal method, device, equipment and storage medium
CN111399777B (en) * 2020-03-16 2023-05-16 平凯星辰(北京)科技有限公司 Differential key value data storage method based on data value classification
CN111400322B (en) * 2020-03-25 2023-10-03 抖音视界有限公司 Method, apparatus, electronic device and medium for storing data
CN111597148B (en) * 2020-05-14 2023-09-19 杭州果汁数据科技有限公司 Distributed metadata management method for distributed file system
CA3154638A1 (en) * 2021-03-19 2022-09-19 Shinydocs Corporation System and method of updating content server metadata
US11720557B2 (en) * 2021-04-07 2023-08-08 Druva Inc. System and method for on-demand search of a large dataset
US11797508B1 (en) * 2023-06-02 2023-10-24 Black Cape Inc. Systems and methods for geospatial correlation
CN117311645B (en) * 2023-11-24 2024-02-06 武汉纺织大学 LSM storage metadata read amplification optimization method

Family Cites Families (15)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
DE60236161D1 (en) * 2001-07-20 2010-06-10 Gracenote Inc AUTOMATIC IDENTIFICATION OF SOUND RECORDS
JP4381012B2 (en) * 2003-03-14 2009-12-09 ヒューレット・パッカード・カンパニー Data search system and data search method using universal identifier
US7574435B2 (en) * 2006-05-03 2009-08-11 International Business Machines Corporation Hierarchical storage management of metadata
CN101354726B (en) * 2008-09-17 2010-09-29 中国科学院计算技术研究所 Method for managing memory metadata of cluster file system
US9542424B2 (en) * 2009-06-30 2017-01-10 Hasso-Plattner-Institut Fur Softwaresystemtechnik Gmbh Lifecycle-based horizontal partitioning
US8200641B2 (en) * 2009-09-11 2012-06-12 Dell Products L.P. Dictionary for data deduplication
US20110218978A1 (en) * 2010-02-22 2011-09-08 Vertica Systems, Inc. Operating on time sequences of data
CN101944134B (en) * 2010-10-18 2012-08-15 江苏大学 Metadata server of mass storage system and metadata indexing method
CN102364474B (en) * 2011-11-17 2014-08-20 中国科学院计算技术研究所 Metadata storage system for cluster file system and metadata management method
US8843441B1 (en) * 2012-01-17 2014-09-23 Amazon Technologies, Inc. System and method for maintaining a master replica for reads and writes in a data store
CN103229173B (en) * 2012-12-26 2016-08-03 华为技术有限公司 Metadata management method and system
CN103019953B (en) * 2012-12-28 2015-06-03 华为技术有限公司 Construction system and construction method for metadata
CN103294785B (en) * 2013-05-17 2016-01-06 华中科技大学 A kind of packet-based metadata server cluster management method
US9811580B2 (en) * 2013-10-10 2017-11-07 International Business Machines Corporation Policy based automatic physical schema management
CN103942301B (en) * 2014-04-16 2017-02-15 华中科技大学 Distributed file system oriented to access and application of multiple data types

Non-Patent Citations (3)

* Cited by examiner, † Cited by third party
Title
See also references of WO2016029865A1 *
YU HUA ET AL: "Scalable and Adaptive Metadata Management in Ultra Large-Scale File Systems", DISTRIBUTED COMPUTING SYSTEMS, 2008. ICDCS '08. THE 28TH INTERNATIONAL CONFERENCE ON, IEEE, PISCATAWAY, NJ, USA, 17 June 2008 (2008-06-17), pages 403 - 410, XP031303699, ISBN: 978-0-7695-3172-4 *
YU HUA ET AL: "SmartStore", HIGH PERFORMANCE COMPUTING NETWORKING, STORAGE AND ANALYSIS, ACM, 2 PENN PLAZA, SUITE 701 NEW YORK NY 10121-0701 USA, 14 November 2009 (2009-11-14), pages 1 - 12, XP058111857, ISBN: 978-1-60558-744-8, DOI: 10.1145/1654059.1654070 *

Also Published As

Publication number Publication date
US20160063021A1 (en) 2016-03-03
CN106663056B (en) 2020-02-14
WO2016029865A1 (en) 2016-03-03
EP3180699A1 (en) 2017-06-21
CN106663056A (en) 2017-05-10

Similar Documents

Publication Publication Date Title
EP3180699A4 (en) Metadata index search in file system
HK1223697A1 (en) Voice searching metadata through media content
EP3234813A4 (en) System on chip configuration metadata
EP3241301A4 (en) Encrypted file storage
GB201517138D0 (en) Systems and methods for determining whether to merge search queries based on contextual information
EP3274813A4 (en) Access files
EP3230180A4 (en) Storage and retrieval system
EP3224744A4 (en) Versioned file system with global lock
EP3204869A4 (en) Systems and methods to manage file access
EP3127000A4 (en) Scalable file storage service
EP3103025A4 (en) Content based organization of file systems
EP3289492A4 (en) Enhanced metadata collection and output
EP3180700A4 (en) Flushing in file system
EP3206137A4 (en) Search system
GB2538586B (en) Index tree search method and computer
EP3161704A4 (en) Composite document access
EP3182911A4 (en) Specimen retrieval systems
HK1225826A1 (en) Metadata automated system
EP3039573A4 (en) Contextual searches for documents
EP3114587A4 (en) Virtual file system and method with bi-directional media file synchronization
EP3221109A4 (en) File translator system
EP3241106A4 (en) Endless search result page
GB201708335D0 (en) System and method for searching structured data files
GB201514187D0 (en) Metadata
EP3095049A4 (en) Organization of metadata for data objects

Legal Events

Date Code Title Description
STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: THE INTERNATIONAL PUBLICATION HAS BEEN MADE

PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: REQUEST FOR EXAMINATION WAS MADE

17P Request for examination filed

Effective date: 20170314

AK Designated contracting states

Kind code of ref document: A1

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

AX Request for extension of the european patent

Extension state: BA ME

A4 Supplementary search report drawn up and despatched

Effective date: 20170612

RIC1 Information provided on ipc code assigned before grant

Ipc: G06F 17/30 20060101AFI20170606BHEP

DAV Request for validation of the european patent (deleted)
DAX Request for extension of the european patent (deleted)
STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: EXAMINATION IS IN PROGRESS

17Q First examination report despatched

Effective date: 20191128

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: EXAMINATION IS IN PROGRESS

REG Reference to a national code

Ref country code: DE

Ref legal event code: R003

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: THE APPLICATION HAS BEEN REFUSED

18R Application refused

Effective date: 20210614