CN104281414B - 分布式文件系统及其小文件访问方法 - Google Patents

分布式文件系统及其小文件访问方法 Download PDF

Info

Publication number
CN104281414B
CN104281414B CN201310289242.2A CN201310289242A CN104281414B CN 104281414 B CN104281414 B CN 104281414B CN 201310289242 A CN201310289242 A CN 201310289242A CN 104281414 B CN104281414 B CN 104281414B
Authority
CN
China
Prior art keywords
file
small documents
access
interface
big
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201310289242.2A
Other languages
English (en)
Chinese (zh)
Other versions
CN104281414A (zh
Inventor
邹同亮
缪敬
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
ZTE Corp
Original Assignee
Nanjing ZTE New Software Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Nanjing ZTE New Software Co Ltd filed Critical Nanjing ZTE New Software Co Ltd
Priority to CN201310289242.2A priority Critical patent/CN104281414B/zh
Priority to PCT/CN2014/076906 priority patent/WO2014166446A1/fr
Publication of CN104281414A publication Critical patent/CN104281414A/zh
Application granted granted Critical
Publication of CN104281414B publication Critical patent/CN104281414B/zh
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/10—File systems; File servers
    • G06F16/13—File access structures, e.g. distributed indices
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
    • G06F3/0601—Interfaces specially adapted for storage systems
    • G06F3/0628—Interfaces specially adapted for storage systems making use of a particular technique
    • G06F3/0655—Vertical data movement, i.e. input-output transfer; data movement between one or more hosts and one or more storage devices
    • G06F3/0659—Command handling arrangements, e.g. command buffers, queues, command scheduling

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Human Computer Interaction (AREA)
  • Data Mining & Analysis (AREA)
  • Databases & Information Systems (AREA)
  • Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
CN201310289242.2A 2013-07-10 2013-07-10 分布式文件系统及其小文件访问方法 Active CN104281414B (zh)

Priority Applications (2)

Application Number Priority Date Filing Date Title
CN201310289242.2A CN104281414B (zh) 2013-07-10 2013-07-10 分布式文件系统及其小文件访问方法
PCT/CN2014/076906 WO2014166446A1 (fr) 2013-07-10 2014-05-06 Procédé, système et support de stockage informatique de traitement d'accès à un fichier

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201310289242.2A CN104281414B (zh) 2013-07-10 2013-07-10 分布式文件系统及其小文件访问方法

Publications (2)

Publication Number Publication Date
CN104281414A CN104281414A (zh) 2015-01-14
CN104281414B true CN104281414B (zh) 2018-07-06

Family

ID=51688958

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201310289242.2A Active CN104281414B (zh) 2013-07-10 2013-07-10 分布式文件系统及其小文件访问方法

Country Status (2)

Country Link
CN (1) CN104281414B (fr)
WO (1) WO2014166446A1 (fr)

Families Citing this family (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105630810B (zh) * 2014-10-30 2019-05-21 曙光信息产业股份有限公司 一种对于海量小文件在分布式存储系统中上载的方法
CN106293490A (zh) * 2015-05-12 2017-01-04 中兴通讯股份有限公司 数据存储、读取的方法、装置及系统
CN106682003B (zh) * 2015-11-06 2019-09-20 中国电信股份有限公司 分布式存储命名空间的路径分割映射方法和装置
CN105404691A (zh) * 2015-12-14 2016-03-16 曙光信息产业股份有限公司 一种文件存储的方法及装置
KR101736406B1 (ko) * 2016-05-30 2017-05-29 주식회사 인피니플럭스 데이터 복제 방법 및 그 장치
CN107480039B (zh) * 2017-09-22 2020-12-04 郑州云海信息技术有限公司 一种分布式存储系统的小文件读写性能测试方法及装置
CN109947703A (zh) * 2017-11-09 2019-06-28 北京京东尚科信息技术有限公司 文件系统、文件存储方法、存储装置和计算机可读介质
CN108133151B (zh) * 2018-02-08 2020-07-28 北京指掌易科技有限公司 文件加密装置、文件处理方法及移动终端设备
CN109451069B (zh) * 2018-12-29 2021-01-29 江苏鼎峰信息技术有限公司 基于分布式存储的网络数据文件库存储及查询方法
CN109918354B (zh) * 2019-03-01 2022-11-04 浪潮商用机器有限公司 一种基于hdfs的磁盘定位方法、装置、设备及介质
CN112860641A (zh) * 2021-01-29 2021-05-28 西藏宁算科技集团有限公司 基于hadoop的小文件存储方法及其装置

Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101515267A (zh) * 2008-02-19 2009-08-26 北京新岸线网络技术有限公司 网络媒体智能编目系统
CN102567312A (zh) * 2011-12-30 2012-07-11 北京理工大学 一种基于分布式并行计算框架的机器翻译方法

Family Cites Families (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101055578A (zh) * 2006-04-12 2007-10-17 龙搜（北京）科技有限公司 基于规则的文档内容挖掘器

Patent Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101515267A (zh) * 2008-02-19 2009-08-26 北京新岸线网络技术有限公司 网络媒体智能编目系统
CN102567312A (zh) * 2011-12-30 2012-07-11 北京理工大学 一种基于分布式并行计算框架的机器翻译方法

Also Published As

Publication number Publication date
CN104281414A (zh) 2015-01-14
WO2014166446A1 (fr) 2014-10-16

Similar Documents

Publication Publication Date Title
CN104281414B (zh) 分布式文件系统及其小文件访问方法
CN107169083B (zh) 公安卡口海量车辆数据存储与检索方法及装置、电子设备
CN102129435B (zh) 数据存储业务控制方法及系统
CN105677250B (zh) 对象存储系统中的对象数据的更新方法和更新装置
US9697258B2 (en) Supporting enhanced content searches in an online content-management system
CN105787093B (zh) 一种基于LSM-Tree结构的日志文件系统的构建方法
US20140012867A1 (en) Method And Process For Enabling Distributing Cache Data Sources For Query Processing And Distributed Disk Caching Of Large Data And Analysis Requests
JP7374232B2 (ja) コンテキスト付きのコンテンツ・アイテム共有
CN103020255A (zh) 分级存储方法和装置
CN100424699C (zh) 一种属性可扩展的对象文件系统
US9411526B1 (en) Filesystem management
US11687508B2 (en) Accessing historical content items of a content management system through placeholders
Sultana et al. A file provenance system
CN107408239B (zh) 通过多个邮箱在通信应用中进行海量数据管理的架构
CN106462591A (zh) 使用存储器中的智能索引的分区过滤
JP2021521502A (ja) コンテンツアイテム内のコンテキストで表示されるコメントプレビュー
CN118193482A (zh) 一种空间数据存储管理装置
US11809381B2 (en) Accessing network based content items by a mobile device while offline
CN104375781B (zh) 数据存取方法及装置
CN106874457A (zh) 一种通过虚拟目录来提升元数据集群性能的方法
Luan et al. Towards effective 3D model management on hadoop
CN111538789B (zh) 数据同步方法、装置、电子设备及存储介质
Wu et al. Research on web map tile services based on GeoWebCache and MongoDB
Jeon et al. Pixelsior: photo management as a platform service for mobile apps
Chen et al. Massive Small File Storage Scheme Based on Association Rule Mining

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
TA01 Transfer of patent application right
TA01 Transfer of patent application right

Effective date of registration: 20180511

Address after: 210012 No. 68, Bauhinia Road, Ningnan street, Yuhuatai District, Nanjing, Jiangsu

Applicant after: Nanjing Zhongxing Software Co., Ltd.

Address before: 518057 Zhongxing building, science and technology south road, Nanshan District hi tech Industrial Park, Guangdong, Shenzhen

Applicant before: ZTE Corporation

GR01 Patent grant
GR01 Patent grant
TR01 Transfer of patent right
TR01 Transfer of patent right

Effective date of registration: 20190904

Address after: 518057 Nanshan District science and Technology Industrial Park, Guangdong high tech Industrial Park, ZTE building

Patentee after: ZTE Corporation

Address before: 210012 Nanjing, Yuhuatai District, South Street, Bauhinia Road, No. 68

Patentee before: Nanjing Zhongxing Software Co., Ltd.