CN110914814B - 分布式存储环境的认知文件和对象管理 - Google Patents

分布式存储环境的认知文件和对象管理 Download PDF

Info

Publication number
CN110914814B
CN110914814B CN201880047167.XA CN201880047167A CN110914814B CN 110914814 B CN110914814 B CN 110914814B CN 201880047167 A CN201880047167 A CN 201880047167A CN 110914814 B CN110914814 B CN 110914814B
Authority
CN
China
Prior art keywords
files
groups
query
central cluster
cluster
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201880047167.XA
Other languages
English (en)
Chinese (zh)
Other versions
CN110914814A (zh
Inventor
S.巴拉钱德兰
张睿
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
International Business Machines Corp
Original Assignee
International Business Machines Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by International Business Machines Corp filed Critical International Business Machines Corp
Publication of CN110914814A publication Critical patent/CN110914814A/zh
Application granted granted Critical
Publication of CN110914814B publication Critical patent/CN110914814B/zh
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/10—File systems; File servers
    • G06F16/14—Details of searching files based on file metadata
    • G06F16/144—Query formulation
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/10—File systems; File servers
    • G06F16/17—Details of further file system functions
    • G06F16/172—Caching, prefetching or hoarding of files
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/10—File systems; File servers
    • G06F16/18—File system types
    • G06F16/182—Distributed file systems
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/10—File systems; File servers
    • G06F16/16—File or folder operations, e.g. details of user interfaces specifically adapted to file systems
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/10—File systems; File servers
    • G06F16/18—File system types
    • G06F16/182—Distributed file systems
    • G06F16/184—Distributed file systems implemented as replicated file system

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Data Mining & Analysis (AREA)
  • Databases & Information Systems (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Human Computer Interaction (AREA)
  • Mathematical Physics (AREA)
  • Library & Information Science (AREA)
  • Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
CN201880047167.XA 2017-07-26 2018-07-17 分布式存储环境的认知文件和对象管理 Active CN110914814B (zh)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
US15/660,715 2017-07-26
US15/660,715 US10884980B2 (en) 2017-07-26 2017-07-26 Cognitive file and object management for distributed storage environments
PCT/IB2018/055296 WO2019021114A1 (en) 2017-07-26 2018-07-17 MANAGING FILES AND COGNITIVE OBJECTS FOR DISTRIBUTED MEMORY ENVIRONMENTS

Publications (2)

Publication Number Publication Date
CN110914814A CN110914814A (zh) 2020-03-24
CN110914814B true CN110914814B (zh) 2024-03-29

Family

ID=65038006

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201880047167.XA Active CN110914814B (zh) 2017-07-26 2018-07-17 分布式存储环境的认知文件和对象管理

Country Status (6)

Country Link
US (1) US10884980B2 (https=)
JP (1) JP7062750B2 (https=)
CN (1) CN110914814B (https=)
DE (1) DE112018002955T5 (https=)
GB (1) GB2579313A (https=)
WO (1) WO2019021114A1 (https=)

Families Citing this family (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US10817515B2 (en) 2017-07-26 2020-10-27 International Business Machines Corporation Cognitive data filtering for storage environments
CN111858146B (zh) * 2019-04-26 2024-05-28 伊姆西Ip控股有限责任公司 用于恢复数据的方法、设备和计算机程序产品
JP7385214B2 (ja) * 2020-01-30 2023-11-22 日本電信電話株式会社 データ管理システムおよびデータ管理方法
JP7376894B2 (ja) * 2020-01-30 2023-11-09 日本電信電話株式会社 データ管理システム、データ管理装置、自発移動条件判定装置、自発移動先選択装置、および、データ管理方法、並びに、プログラム
CN113553166A (zh) * 2020-04-26 2021-10-26 广州汽车集团股份有限公司 一种跨平台高性能计算集成方法及系统
US20230377016A1 (en) * 2022-05-18 2023-11-23 Coupang Corp. Methods and systems for optimizing filters in product searching
US12182076B2 (en) * 2022-12-28 2024-12-31 International Business Machines Corporation Increasing resource utilization in cloud computing clusters

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7590747B2 (en) * 2000-03-03 2009-09-15 Intel Corporation Distributed storage cluster architecture
CN101946249A (zh) * 2008-02-13 2011-01-12 微软公司 使用相关用户的数据来增强web搜索
US8099401B1 (en) * 2007-07-18 2012-01-17 Emc Corporation Efficiently indexing and searching similar data
CN104318340A (zh) * 2014-09-25 2015-01-28 中国科学院软件研究所 基于文本履历信息的信息可视化方法及智能可视分析系统

Family Cites Families (37)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP3177999B2 (ja) * 1991-04-25 2001-06-18 カシオ計算機株式会社 システム構成図作成装置
US6470389B1 (en) 1997-03-14 2002-10-22 Lucent Technologies Inc. Hosting a network service on a cluster of servers using a single-address image
US6205481B1 (en) 1998-03-17 2001-03-20 Infolibria, Inc. Protocol for distributing fresh content among networked cache servers
US6675159B1 (en) 2000-07-27 2004-01-06 Science Applic Int Corp Concept-based search and retrieval system
US7171469B2 (en) 2002-09-16 2007-01-30 Network Appliance, Inc. Apparatus and method for storing data in a proxy cache in a network
JP2004178217A (ja) 2002-11-26 2004-06-24 Sony Corp ファイル管理装置、ファイル管理方法、ファイル管理プログラム及び、ファイル管理プログラムを記録したコンピュータ読み取り可能なプログラム格納媒体
JP4561044B2 (ja) 2003-05-09 2010-10-13 株式会社エクォス・リサーチ データファイルの送信方法および送信プログラム
US7831581B1 (en) 2004-03-01 2010-11-09 Radix Holdings, Llc Enhanced search
US7844691B2 (en) 2004-12-30 2010-11-30 Xstor Systems, Inc. Scalable distributed storage and delivery
US20070022120A1 (en) 2005-07-25 2007-01-25 Microsoft Corporation Caching and modifying portions of a multi-dimensional database on a user device
US7835578B2 (en) 2006-04-19 2010-11-16 Sarnoff Corporation Automated video-to-text system
JP2008299796A (ja) 2007-06-04 2008-12-11 Toshiba Corp データベースシステム及びその回答方法
US7890488B2 (en) * 2007-10-05 2011-02-15 Yahoo! Inc. System and method for caching posting lists
US7437686B1 (en) * 2007-11-16 2008-10-14 International Business Machines Corporation Systems, methods and computer program products for graphical user interface presentation to implement filtering of a large unbounded hierarchy to avoid repetitive navigation
US10719149B2 (en) 2009-03-18 2020-07-21 Touchtunes Music Corporation Digital jukebox device with improved user interfaces, and associated methods
CN101550180A (zh) * 2009-04-28 2009-10-07 杭州华锦药业股份有限公司 一种促吞噬肽液相合成方法
CA2797764A1 (en) 2010-04-30 2011-11-03 Now Technologies (Ip) Limited Content management apparatus
US9699503B2 (en) 2010-09-07 2017-07-04 Opentv, Inc. Smart playlist
US8661449B2 (en) 2011-06-17 2014-02-25 Microsoft Corporation Transactional computation on clusters
US9886188B2 (en) * 2011-08-25 2018-02-06 International Business Machines Corporation Manipulating multiple objects in a graphic user interface
US9152622B2 (en) 2012-11-26 2015-10-06 Language Weaver, Inc. Personalized machine translation via online adaptation
CN103020158B (zh) * 2012-11-26 2016-09-07 中兴通讯股份有限公司 一种报表创建方法、装置和系统
US9405811B2 (en) 2013-03-08 2016-08-02 Platfora, Inc. Systems and methods for interest-driven distributed data server systems
US9075960B2 (en) 2013-03-15 2015-07-07 Now Technologies (Ip) Limited Digital media content management apparatus and method
US20140365241A1 (en) 2013-06-05 2014-12-11 ESO Solutions, Inc. System for pre-hospital patient information exchange and methods of using same
US10242045B2 (en) 2013-10-30 2019-03-26 Dropbox, Inc. Filtering content using synchronization data
CN104866497B (zh) 2014-02-24 2018-06-15 华为技术有限公司 分布式文件系统列式存储的元数据更新方法、装置、主机
EP3143526A4 (en) * 2014-05-12 2017-10-04 Diffeo, Inc. Entity-centric knowledge discovery
EP2966562A1 (en) 2014-07-09 2016-01-13 Nexenta Systems, Inc. Method to optimize inline i/o processing in tiered distributed storage systems
CN105550180B (zh) 2014-10-29 2019-02-12 北京奇虎科技有限公司 数据处理的方法、装置及系统
CN104484404B (zh) 2014-12-15 2017-11-07 中国科学院东北地理与农业生态研究所 一种改善分布式文件系统中地理栅格数据文件处理方法
EP3238106B1 (en) 2015-03-17 2020-10-07 Cloudera, Inc. Compaction policy
CN104767813B (zh) 2015-04-08 2018-06-08 江苏国盾科技实业有限责任公司 基于openstack的公众行大数据服务平台
US9774993B1 (en) 2016-05-17 2017-09-26 International Business Machines Corporation System, method, and recording medium for geofence filtering
CN106056427A (zh) 2016-05-25 2016-10-26 中南大学 一种基于Spark的大数据混合模型的移动推荐方法
CN106527993B (zh) 2016-11-09 2019-08-30 北京搜狐新媒体信息技术有限公司 一种分布式系统中的海量文件储存方法及装置
US10817515B2 (en) 2017-07-26 2020-10-27 International Business Machines Corporation Cognitive data filtering for storage environments

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7590747B2 (en) * 2000-03-03 2009-09-15 Intel Corporation Distributed storage cluster architecture
US8099401B1 (en) * 2007-07-18 2012-01-17 Emc Corporation Efficiently indexing and searching similar data
CN101946249A (zh) * 2008-02-13 2011-01-12 微软公司 使用相关用户的数据来增强web搜索
CN104318340A (zh) * 2014-09-25 2015-01-28 中国科学院软件研究所 基于文本履历信息的信息可视化方法及智能可视分析系统

Also Published As

Publication number Publication date
CN110914814A (zh) 2020-03-24
US10884980B2 (en) 2021-01-05
WO2019021114A1 (en) 2019-01-31
JP7062750B2 (ja) 2022-05-06
JP2020528614A (ja) 2020-09-24
DE112018002955T5 (de) 2020-05-07
GB202002252D0 (en) 2020-04-01
US20190034445A1 (en) 2019-01-31
GB2579313A (en) 2020-06-17

Similar Documents

Publication Publication Date Title
CN110914814B (zh) 分布式存储环境的认知文件和对象管理
CN110914817B (zh) 用于存储环境的认知数据过滤
CN103959264B (zh) 在存储云中使用去重复来管理不可变冗余文件
US9766791B2 (en) Predictive caching and fetch priority
US10891165B2 (en) Frozen indices
US9607004B2 (en) Storage device data migration
US10671606B2 (en) Materialized query tables with shared data
CN111201763B (zh) 基于文件系统内容的安全性
CN115336237B (zh) 远程存储的文件的预测性供应
CN111684779B (zh) 分层存储管理系统中的数据迁移
US11455309B2 (en) Partition key adjustment based on query workload
US11307984B2 (en) Optimized sorting of variable-length records
US20220027335A1 (en) Active-active system index management
US11977540B2 (en) Data virtualization in natural language
KR102544635B1 (ko) Component와 BaaS 기반의 웹사이트 빌더 서비스를 제공하기 위한 시스템
KR102914994B1 (ko) 위치 정보에 기초한 검색 수행
US20190164066A1 (en) Dynamic run-time corpus builder
US20180203932A1 (en) Enhanced information retrieval

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant