CN111142788B - 一种数据迁移方法、装置和计算机可读存储介质 - Google Patents
一种数据迁移方法、装置和计算机可读存储介质 Download PDFInfo
- Publication number
- CN111142788B CN111142788B CN201911204966.6A CN201911204966A CN111142788B CN 111142788 B CN111142788 B CN 111142788B CN 201911204966 A CN201911204966 A CN 201911204966A CN 111142788 B CN111142788 B CN 111142788B
- Authority
- CN
- China
- Prior art keywords
- migration
- file
- target
- task
- files
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 230000005012 migration Effects 0.000 title claims abstract description 500
- 238000013508 migration Methods 0.000 title claims abstract description 500
- 238000000034 method Methods 0.000 title claims abstract description 50
- 238000004590 computer program Methods 0.000 claims description 14
- 238000012545 processing Methods 0.000 claims description 11
- 230000009286 beneficial effect Effects 0.000 abstract description 2
- 238000004140 cleaning Methods 0.000 abstract 1
- 238000005516 engineering process Methods 0.000 description 10
- 238000004891 communication Methods 0.000 description 8
- 238000010586 diagram Methods 0.000 description 7
- 238000013500 data storage Methods 0.000 description 5
- 230000007704 transition Effects 0.000 description 5
- 230000003044 adaptive effect Effects 0.000 description 4
- 230000002776 aggregation Effects 0.000 description 4
- 238000004220 aggregation Methods 0.000 description 4
- 230000008569 process Effects 0.000 description 3
- 230000007547 defect Effects 0.000 description 2
- 238000012986 modification Methods 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 230000001360 synchronised effect Effects 0.000 description 2
- 238000013461 design Methods 0.000 description 1
- 230000006870 function Effects 0.000 description 1
- 239000004973 liquid crystal related substance Substances 0.000 description 1
- 238000007726 management method Methods 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 230000000750 progressive effect Effects 0.000 description 1
- 238000011084 recovery Methods 0.000 description 1
- 238000013509 system migration Methods 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
- G06F3/0601—Interfaces specially adapted for storage systems
- G06F3/0602—Interfaces specially adapted for storage systems specifically adapted to achieve a particular effect
- G06F3/061—Improving I/O performance
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
- G06F3/0601—Interfaces specially adapted for storage systems
- G06F3/0628—Interfaces specially adapted for storage systems making use of a particular technique
- G06F3/0646—Horizontal data movement in storage systems, i.e. moving data in between storage devices or systems
- G06F3/0647—Migration mechanisms
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
- G06F3/0601—Interfaces specially adapted for storage systems
- G06F3/0668—Interfaces specially adapted for storage systems adopting a particular infrastructure
- G06F3/067—Distributed or networked storage systems, e.g. storage area networks [SAN], network attached storage [NAS]
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
Description
Claims (9)
Priority Applications (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201911204966.6A CN111142788B (zh) | 2019-11-29 | 2019-11-29 | 一种数据迁移方法、装置和计算机可读存储介质 |
PCT/CN2020/103695 WO2021103596A1 (zh) | 2019-11-29 | 2020-07-23 | 一种数据迁移方法、装置和计算机可读存储介质 |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201911204966.6A CN111142788B (zh) | 2019-11-29 | 2019-11-29 | 一种数据迁移方法、装置和计算机可读存储介质 |
Publications (2)
Publication Number | Publication Date |
---|---|
CN111142788A CN111142788A (zh) | 2020-05-12 |
CN111142788B true CN111142788B (zh) | 2021-10-15 |
Family
ID=70517371
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN201911204966.6A Active CN111142788B (zh) | 2019-11-29 | 2019-11-29 | 一种数据迁移方法、装置和计算机可读存储介质 |
Country Status (2)
Country | Link |
---|---|
CN (1) | CN111142788B (zh) |
WO (1) | WO2021103596A1 (zh) |
Families Citing this family (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN111142788B (zh) * | 2019-11-29 | 2021-10-15 | 浪潮电子信息产业股份有限公司 | 一种数据迁移方法、装置和计算机可读存储介质 |
CN111966301B (zh) * | 2020-08-25 | 2023-01-10 | 苏州浪潮智能科技有限公司 | 分布式对象存储系统的迁移速度控制方法、装置及介质 |
CN113741810B (zh) * | 2021-07-30 | 2023-08-11 | 苏州浪潮智能科技有限公司 | 一种数据迁移方法及装置 |
CN115904263B (zh) * | 2023-03-10 | 2023-05-23 | 浪潮电子信息产业股份有限公司 | 一种数据迁移方法、系统、设备及计算机可读存储介质 |
CN116980641B (zh) * | 2023-09-22 | 2023-12-15 | 江西云眼视界科技股份有限公司 | 视频迁移的异步处理方法、系统、计算机及存储介质 |
Citations (10)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN103297481A (zh) * | 2012-03-05 | 2013-09-11 | 中兴通讯股份有限公司 | 互联交换方法和装置 |
CN103500073A (zh) * | 2013-10-08 | 2014-01-08 | 浪潮(北京)电子信息产业有限公司 | 一种数据块迁移方法及装置 |
CN103677959A (zh) * | 2013-12-16 | 2014-03-26 | 国家计算机网络与信息安全管理中心 | 一种基于组播的虚拟机集群迁移方法及系统 |
CN103733175A (zh) * | 2013-08-09 | 2014-04-16 | 华为技术有限公司 | 一种文件处理方法、装置及存储设备 |
CN104331253A (zh) * | 2014-10-30 | 2015-02-04 | 浪潮电子信息产业股份有限公司 | 一种对象存储系统中对象迁移的计算方法 |
CN105045873A (zh) * | 2015-07-17 | 2015-11-11 | 深圳市腾讯计算机系统有限公司 | 一种数据文件的推送方法、装置及系统 |
CN107506500A (zh) * | 2017-10-09 | 2017-12-22 | 郑州云海信息技术有限公司 | 一种数据迁移的控制方法及相关装置 |
CN107844590A (zh) * | 2017-11-17 | 2018-03-27 | 郑州云海信息技术有限公司 | 小文件迁移方法、装置、设备及计算机可读存储介质 |
CN108536539A (zh) * | 2018-04-26 | 2018-09-14 | 东北大学 | 一种工业分布式数据采集系统中的任务调度方法 |
CN109343793A (zh) * | 2018-09-11 | 2019-02-15 | 阿里巴巴集团控股有限公司 | 数据迁移方法及装置 |
Family Cites Families (7)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20080016390A1 (en) * | 2006-07-13 | 2008-01-17 | David Maxwell Cannon | Apparatus, system, and method for concurrent storage pool migration and backup |
CN103136043B (zh) * | 2013-01-28 | 2016-05-25 | 华为技术有限公司 | 一种异步io的迁移方法、系统和网络节点 |
CN103530388A (zh) * | 2013-10-22 | 2014-01-22 | 浪潮电子信息产业股份有限公司 | 一种云存储系统中提升性能的数据处理方法 |
US20160196089A1 (en) * | 2015-01-07 | 2016-07-07 | Netapp, Inc. | System and method for adaptive data transfers with limited resources |
CN105843820B (zh) * | 2015-01-16 | 2019-10-08 | 阿里巴巴集团控股有限公司 | 数据迁移方法及装置 |
CN105978949A (zh) * | 2016-04-27 | 2016-09-28 | 乐视控股(北京)有限公司 | 离线数据上传方法及装置 |
CN111142788B (zh) * | 2019-11-29 | 2021-10-15 | 浪潮电子信息产业股份有限公司 | 一种数据迁移方法、装置和计算机可读存储介质 |
-
2019
- 2019-11-29 CN CN201911204966.6A patent/CN111142788B/zh active Active
-
2020
- 2020-07-23 WO PCT/CN2020/103695 patent/WO2021103596A1/zh active Application Filing
Patent Citations (10)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN103297481A (zh) * | 2012-03-05 | 2013-09-11 | 中兴通讯股份有限公司 | 互联交换方法和装置 |
CN103733175A (zh) * | 2013-08-09 | 2014-04-16 | 华为技术有限公司 | 一种文件处理方法、装置及存储设备 |
CN103500073A (zh) * | 2013-10-08 | 2014-01-08 | 浪潮(北京)电子信息产业有限公司 | 一种数据块迁移方法及装置 |
CN103677959A (zh) * | 2013-12-16 | 2014-03-26 | 国家计算机网络与信息安全管理中心 | 一种基于组播的虚拟机集群迁移方法及系统 |
CN104331253A (zh) * | 2014-10-30 | 2015-02-04 | 浪潮电子信息产业股份有限公司 | 一种对象存储系统中对象迁移的计算方法 |
CN105045873A (zh) * | 2015-07-17 | 2015-11-11 | 深圳市腾讯计算机系统有限公司 | 一种数据文件的推送方法、装置及系统 |
CN107506500A (zh) * | 2017-10-09 | 2017-12-22 | 郑州云海信息技术有限公司 | 一种数据迁移的控制方法及相关装置 |
CN107844590A (zh) * | 2017-11-17 | 2018-03-27 | 郑州云海信息技术有限公司 | 小文件迁移方法、装置、设备及计算机可读存储介质 |
CN108536539A (zh) * | 2018-04-26 | 2018-09-14 | 东北大学 | 一种工业分布式数据采集系统中的任务调度方法 |
CN109343793A (zh) * | 2018-09-11 | 2019-02-15 | 阿里巴巴集团控股有限公司 | 数据迁移方法及装置 |
Non-Patent Citations (1)
Title |
---|
"如何使用qos管理分配存储iops";weixin_34090562;《https://blog.csdn.net/weixin_34090562/article/details/90455390》;20170704;第1-4页 * |
Also Published As
Publication number | Publication date |
---|---|
WO2021103596A1 (zh) | 2021-06-03 |
CN111142788A (zh) | 2020-05-12 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
CN111142788B (zh) | 一种数据迁移方法、装置和计算机可读存储介质 | |
CN112905326B (zh) | 任务处理方法及装置 | |
JP6669961B2 (ja) | プロセッサ、再構成可能回路の制御方法及びプログラム | |
CN108415772B (zh) | 一种基于容器的资源调整方法、装置和介质 | |
CN106528290A (zh) | 移动终端的资源调度方法及移动终端 | |
WO2021169618A1 (zh) | 一种虚拟机的迁移方法、装置、设备及介质 | |
CN114048006A (zh) | 虚拟机动态迁移方法、装置以及存储介质 | |
CN106095417B (zh) | 一种前景应用程序界面刷新同步方法及系统 | |
CN115004168A (zh) | 数据推送方法、装置、服务器及存储介质 | |
CN112015326A (zh) | 集群数据处理方法、装置、设备及存储介质 | |
CN116467235B (zh) | 一种基于dma的数据处理方法、装置、电子设备及介质 | |
CN111159124B (zh) | Linux内核文件系统异步写缓存方法、装置及介质 | |
CN111176570B (zh) | 一种厚置备卷创建方法、装置、设备及介质 | |
CN114816766B (zh) | 一种计算资源分配方法及其相关组件 | |
CN113703678B (zh) | 一种存储桶索引重分裂的方法、装置、设备和介质 | |
CN116303132A (zh) | 一种数据缓存方法、装置、设备以及存储介质 | |
CN116450290A (zh) | 计算机资源的管理方法、装置、云服务器及存储介质 | |
CN111966301B (zh) | 分布式对象存储系统的迁移速度控制方法、装置及介质 | |
CN114745338A (zh) | 流量控制方法、装置、存储介质以及服务器 | |
CN113821174A (zh) | 存储处理方法、装置、网卡设备及存储介质 | |
CN114416326A (zh) | 大数据管控方法、装置、管控系统及可读存储介质 | |
CN110955644A (zh) | 一种存储系统的io控制方法、装置、设备及存储介质 | |
CN113032369A (zh) | 一种数据迁移方法、装置及介质 | |
US20240320896A1 (en) | Multi-gpu-based image rendering method and apparatus, and readable storage medium | |
CN114564307B (zh) | 一种内存分配方法、装置、设备和计算机可读存储介质 |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PB01 | Publication | ||
PB01 | Publication | ||
SE01 | Entry into force of request for substantive examination | ||
SE01 | Entry into force of request for substantive examination | ||
GR01 | Patent grant | ||
GR01 | Patent grant | ||
EE01 | Entry into force of recordation of patent licensing contract |
Application publication date: 20200512 Assignee: INSPUR (BEIJING) ELECTRONIC INFORMATION INDUSTRY Co.,Ltd. Assignor: INSPUR ELECTRONIC INFORMATION INDUSTRY Co.,Ltd. Contract record no.: X2022990000833 Denomination of invention: A data migration method, device and computer readable storage medium Granted publication date: 20211015 License type: Common License Record date: 20221024 |
|
EE01 | Entry into force of recordation of patent licensing contract | ||
EE01 | Entry into force of recordation of patent licensing contract |
Application publication date: 20200512 Assignee: Inspur(Jinan)Data Technology Co.,Ltd Assignor: INSPUR ELECTRONIC INFORMATION INDUSTRY Co.,Ltd. Contract record no.: X2022110000054 Denomination of invention: A data migration method, device and computer readable storage medium Granted publication date: 20211015 License type: Common License Record date: 20221024 |
|
EE01 | Entry into force of recordation of patent licensing contract |