HK1205581A1 - Hadoop distributed file system and management method thereof hadoop - Google Patents

Hadoop distributed file system and management method thereof hadoop

Info

Publication number
HK1205581A1
HK1205581A1 HK15106146.3A HK15106146A HK1205581A1 HK 1205581 A1 HK1205581 A1 HK 1205581A1 HK 15106146 A HK15106146 A HK 15106146A HK 1205581 A1 HK1205581 A1 HK 1205581A1
Authority
HK
Hong Kong
Prior art keywords
hadoop
file system
management method
distributed file
hadoop distributed
Prior art date
Application number
HK15106146.3A
Other languages
Chinese (zh)
Inventor
劉磊
Original Assignee
Alibaba Group Holding Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Alibaba Group Holding Ltd filed Critical Alibaba Group Holding Ltd
Publication of HK1205581A1 publication Critical patent/HK1205581A1/en

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/10File systems; File servers
    • G06F16/18File system types
    • G06F16/182Distributed file systems
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/10File systems; File servers
    • G06F16/11File system administration, e.g. details of archiving or snapshots

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Data Mining & Analysis (AREA)
  • Databases & Information Systems (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
HK15106146.3A 2013-11-05 2015-06-29 Hadoop distributed file system and management method thereof hadoop HK1205581A1 (en)

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201310544570.2A CN104615606B (en) 2013-11-05 2013-11-05 A kind of Hadoop distributed file systems and its management method

Publications (1)

Publication Number Publication Date
HK1205581A1 true HK1205581A1 (en) 2015-12-18

Family

ID=53150056

Family Applications (1)

Application Number Title Priority Date Filing Date
HK15106146.3A HK1205581A1 (en) 2013-11-05 2015-06-29 Hadoop distributed file system and management method thereof hadoop

Country Status (2)

Country Link
CN (1) CN104615606B (en)
HK (1) HK1205581A1 (en)

Families Citing this family (16)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106294445B (en) * 2015-05-27 2019-08-13 华为技术有限公司 The method and device of data storage based on across computer room Hadoop cluster
CN105337765B (en) * 2015-10-10 2018-10-12 上海新炬网络信息技术股份有限公司 A kind of distribution hadoop cluster automatic fault diagnosis repair system
CN105847392A (en) * 2016-04-25 2016-08-10 乐视控股(北京)有限公司 HDFS writing method and device
CN106027638B (en) * 2016-05-18 2019-04-12 华中科技大学 A kind of hadoop data distributing method based on hybrid coding
CN106528351A (en) * 2016-12-29 2017-03-22 北京奇虎科技有限公司 Data backup method and device
CN107657027B (en) * 2017-09-27 2021-09-21 北京小米移动软件有限公司 Data storage method and device
CN110535898B (en) * 2018-05-25 2022-10-04 许继集团有限公司 Method for storing and complementing copies and selecting nodes in big data storage and management system
CN109981741A (en) * 2019-02-26 2019-07-05 启迪云计算有限公司 A kind of maintaining method of distributed memory system
CN110198346B (en) * 2019-05-06 2020-10-27 北京三快在线科技有限公司 Data reading method and device, electronic equipment and readable storage medium
CN110532271A (en) * 2019-08-30 2019-12-03 北京浪潮数据技术有限公司 Distributed storage method, control system and the device realized based on DHT algorithm
CN110674099A (en) * 2019-09-25 2020-01-10 新华三大数据技术有限公司 Copy balancing method and device, storage medium and electronic equipment
CN110825704B (en) 2019-09-27 2023-09-01 华为云计算技术有限公司 Data reading method, data writing method and server
CN111400326B (en) * 2020-02-28 2023-09-12 深圳市赛为智能股份有限公司 Smart city data management system and method thereof
CN112083888A (en) * 2020-09-10 2020-12-15 北京金山云网络技术有限公司 File storage method and device and electronic equipment
CN115934670B (en) * 2023-03-09 2023-05-05 智者四海(北京)技术有限公司 Method and device for verifying copy placement strategy of HDFS (Hadoop distributed File System) multi-machine room
CN115982101B (en) * 2023-03-17 2023-06-02 智者四海(北京)技术有限公司 Machine room data migration method and device based on multi-machine room copy placement strategy

Family Cites Families (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8275815B2 (en) * 2008-08-25 2012-09-25 International Business Machines Corporation Transactional processing for clustered file systems
CN103095769B (en) * 2011-11-04 2015-12-09 阿里巴巴集团控股有限公司 Across method of data synchronization and the system of machine room
CN102693324B (en) * 2012-01-09 2015-03-18 西安电子科技大学 Distributed database synchronization system, synchronization method and node management method
CN102946323A (en) * 2012-10-24 2013-02-27 曙光信息产业(北京)有限公司 Realizing method for location awareness of compute node cabinet in HDFS (Hadoop Distributed File System) and realizing system thereof
CN103118133B (en) * 2013-02-28 2015-09-02 浙江大学 Based on the mixed cloud storage means of the file access frequency

Also Published As

Publication number Publication date
CN104615606B (en) 2018-04-06
CN104615606A (en) 2015-05-13

Similar Documents

Publication Publication Date Title
HK1205581A1 (en) Hadoop distributed file system and management method thereof hadoop
HK1219161A1 (en) Wear-together-information provision system and read-information management system
EP2990962A4 (en) Database management method and system
GB201316957D0 (en) Operation management system and operation management method
ZA201505639B (en) Train network management system and method
EP2972527A4 (en) Network telemetry system and method
HUE061173T2 (en) Application method and application system
EP2887222A4 (en) Management system and management program
EP2947950A4 (en) Network access system and method
GB2526996B (en) Systems and methods for document and material management
SG11201600209VA (en) Data bandwidth management system and method
EP2854028A4 (en) Associated plugin management method, device and system
EP3000203A4 (en) Methods and systems for creating and managing network groups
EP3057058A4 (en) Vehicle management system and vehicle management method
EP3057059A4 (en) Vehicle management system and vehicle management method
GB201513384D0 (en) Computer system, and resource management method
EP2966746A4 (en) Energy management system and energy management method
HK1200250A1 (en) Method and system for resource sharing
EP3008615A4 (en) Network management systems and methods
GB2531187B (en) Georeferencing method and system
ZA201500407B (en) Spectrum management system and method
EP3048529A4 (en) Cloud system data management method
TWI563840B (en) Media file management method and system
EP3020020A4 (en) Systems and methods for knowledge management
GB201305411D0 (en) System and method