CN1934568B - 将源数据迁移成目标数据的方法、系统和程序 - Google Patents
将源数据迁移成目标数据的方法、系统和程序 Download PDFInfo
- Publication number
- CN1934568B CN1934568B CN2005800080043A CN200580008004A CN1934568B CN 1934568 B CN1934568 B CN 1934568B CN 2005800080043 A CN2005800080043 A CN 2005800080043A CN 200580008004 A CN200580008004 A CN 200580008004A CN 1934568 B CN1934568 B CN 1934568B
- Authority
- CN
- China
- Prior art keywords
- source data
- data
- migration
- request
- write
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Expired - Fee Related
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F12/00—Accessing, addressing or allocating within memory systems or architectures
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/07—Responding to the occurrence of a fault, e.g. fault tolerance
- G06F11/16—Error detection or correction of the data by redundancy in hardware
- G06F11/20—Error detection or correction of the data by redundancy in hardware using active fault-masking, e.g. by switching out faulty elements or by switching in spare elements
- G06F11/2053—Error detection or correction of the data by redundancy in hardware using active fault-masking, e.g. by switching out faulty elements or by switching in spare elements where persistent mass storage functionality or persistent mass storage control functionality is redundant
- G06F11/2056—Error detection or correction of the data by redundancy in hardware using active fault-masking, e.g. by switching out faulty elements or by switching in spare elements where persistent mass storage functionality or persistent mass storage control functionality is redundant by mirroring
- G06F11/2082—Data synchronisation
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F13/00—Interconnection of, or transfer of information or other signals between, memories, input/output devices or central processing units
- G06F13/14—Handling requests for interconnection or transfer
- G06F13/16—Handling requests for interconnection or transfer for access to memory bus
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/10—File systems; File servers
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F17/00—Digital computing or data processing equipment or methods, specially adapted for specific functions
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y10—TECHNICAL SUBJECTS COVERED BY FORMER USPC
- Y10S—TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y10S707/00—Data processing: database and file management or data structures
- Y10S707/99951—File or database maintenance
- Y10S707/99952—Coherency, e.g. same view to multiple users
- Y10S707/99953—Recoverability
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y10—TECHNICAL SUBJECTS COVERED BY FORMER USPC
- Y10S—TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y10S707/00—Data processing: database and file management or data structures
- Y10S707/99951—File or database maintenance
- Y10S707/99952—Coherency, e.g. same view to multiple users
- Y10S707/99955—Archiving or backup
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Data Mining & Analysis (AREA)
- Databases & Information Systems (AREA)
- Quality & Reliability (AREA)
- Mathematical Physics (AREA)
- Software Systems (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Applications Claiming Priority (3)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| US10/865,625 US7613889B2 (en) | 2004-06-10 | 2004-06-10 | System, method, and program for determining if write data overlaps source data within a data migration scheme |
| US10/865,625 | 2004-06-10 | ||
| PCT/EP2005/052097 WO2005122007A2 (en) | 2004-06-10 | 2005-05-10 | Method, system, and program for migrating source data to target data |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN1934568A CN1934568A (zh) | 2007-03-21 |
| CN1934568B true CN1934568B (zh) | 2012-03-28 |
Family
ID=34967457
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN2005800080043A Expired - Fee Related CN1934568B (zh) | 2004-06-10 | 2005-05-10 | 将源数据迁移成目标数据的方法、系统和程序 |
Country Status (6)
| Country | Link |
|---|---|
| US (1) | US7613889B2 (enExample) |
| EP (1) | EP1754172A2 (enExample) |
| JP (1) | JP4738413B2 (enExample) |
| KR (1) | KR100962883B1 (enExample) |
| CN (1) | CN1934568B (enExample) |
| WO (1) | WO2005122007A2 (enExample) |
Families Citing this family (38)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US7707186B2 (en) * | 2004-06-18 | 2010-04-27 | Emc Corporation | Method and apparatus for data set migration |
| US7945613B2 (en) * | 2007-12-05 | 2011-05-17 | International Business Machines Corporation | Method for non-disruptively associating applications and middleware components with information technology infrastructure |
| US8015380B2 (en) * | 2008-02-01 | 2011-09-06 | International Business Machines Corporation | Launching multiple concurrent memory moves via a fully asynchronoous memory mover |
| US8275963B2 (en) * | 2008-02-01 | 2012-09-25 | International Business Machines Corporation | Asynchronous memory move across physical nodes with dual-sided communication |
| US8327101B2 (en) * | 2008-02-01 | 2012-12-04 | International Business Machines Corporation | Cache management during asynchronous memory move operations |
| US8245004B2 (en) * | 2008-02-01 | 2012-08-14 | International Business Machines Corporation | Mechanisms for communicating with an asynchronous memory mover to perform AMM operations |
| US8095758B2 (en) * | 2008-02-01 | 2012-01-10 | International Business Machines Corporation | Fully asynchronous memory mover |
| US7930504B2 (en) * | 2008-02-01 | 2011-04-19 | International Business Machines Corporation | Handling of address conflicts during asynchronous memory move operations |
| US8356151B2 (en) * | 2008-02-01 | 2013-01-15 | International Business Machines Corporation | Reporting of partially performed memory move |
| CN101364186B (zh) * | 2008-09-27 | 2012-01-25 | 腾讯科技(深圳)有限公司 | 数据迁移方法、数据迁移服务器及数据接口服务器 |
| US8738872B2 (en) * | 2009-04-03 | 2014-05-27 | Peter Chi-Hsiung Liu | Methods for migrating data in a server that remains substantially available for use during such migration |
| US20110246714A1 (en) * | 2010-03-30 | 2011-10-06 | Lenovo (Singapore) Pte. Ltd. | Migrating client operating systems to remote storage |
| EP2569710A4 (en) * | 2010-05-13 | 2014-01-22 | Hewlett Packard Development Co | MIGRATION OF A FILE SYSTEM |
| CN101887456A (zh) * | 2010-06-30 | 2010-11-17 | 百视通网络电视技术发展有限责任公司 | 一种数据迁移系统和方法 |
| US8112665B1 (en) * | 2010-07-23 | 2012-02-07 | Netapp, Inc. | Methods and systems for rapid rollback and rapid retry of a data migration |
| US8825715B1 (en) * | 2010-10-29 | 2014-09-02 | Google Inc. | Distributed state/mask sets |
| CN102073462B (zh) * | 2010-11-29 | 2013-04-17 | 华为技术有限公司 | 虚拟存储迁移方法、系统和虚拟机监控器 |
| US9128942B1 (en) * | 2010-12-24 | 2015-09-08 | Netapp, Inc. | On-demand operations |
| WO2012117434A1 (en) * | 2011-02-28 | 2012-09-07 | Hitachi, Ltd. | Method for ensuring consistency between mirrored copies of control information |
| EP2633385A1 (en) * | 2011-03-02 | 2013-09-04 | Hitachi, Ltd. | Computer system and data migration method |
| US8515919B1 (en) * | 2011-05-13 | 2013-08-20 | Symantec Corporation | Techniques for optimizing data migration |
| US9189760B2 (en) * | 2012-11-19 | 2015-11-17 | Sap Se | System, method and computer readable medium for using performance indicators and predictive analysis for setting manufacturing equipment parameters |
| CN104021123B (zh) | 2013-02-28 | 2017-10-31 | 国际商业机器公司 | 用于数据迁移的方法和系统 |
| US9704118B2 (en) | 2013-03-11 | 2017-07-11 | Sap Se | Predictive analytics in determining key performance indicators |
| CN104932986A (zh) * | 2014-03-19 | 2015-09-23 | 中国移动通信集团公司 | 一种数据重分布方法及装置 |
| CN105446888B (zh) * | 2014-05-30 | 2018-10-12 | 华为技术有限公司 | 存储设备间移动数据的方法、控制器和存储系统 |
| US20160335025A1 (en) * | 2015-05-11 | 2016-11-17 | Kaminario Technologies Ltd. | Data migration system and method thereof |
| US10810031B2 (en) * | 2015-09-28 | 2020-10-20 | Red Hat Israel, Ltd. | Dirty memory tracking with assigned devices by exitless paravirtualization |
| US11068172B1 (en) * | 2015-09-30 | 2021-07-20 | EMC IP Holding Company LLC | Optimizing parallel data replication spanning physical storage devices |
| US10055166B1 (en) * | 2016-06-30 | 2018-08-21 | EMC IP Holding Company LLC | Method, data storage system and computer program product for managing data copying |
| US10769074B2 (en) * | 2017-11-09 | 2020-09-08 | Microsoft Technology Licensing, Llc | Computer memory content movement |
| US10459849B1 (en) * | 2018-08-31 | 2019-10-29 | Sas Institute Inc. | Scheduling operations in an access-controlled region of memory |
| JP7193732B2 (ja) * | 2019-04-08 | 2022-12-21 | 富士通株式会社 | 管理装置、情報処理システムおよび管理プログラム |
| US11221785B2 (en) | 2019-12-03 | 2022-01-11 | Western Digital Technologies, Inc. | Managing replication state for deleted objects |
| CN113127438B (zh) * | 2019-12-30 | 2023-07-28 | 北京百度网讯科技有限公司 | 用于存储数据的方法、装置、服务器和介质 |
| CN111858541A (zh) * | 2020-06-29 | 2020-10-30 | 广东浪潮大数据研究有限公司 | 一种分布式文件系统的数据迁移控制方法及相关装置 |
| KR102405890B1 (ko) * | 2020-09-28 | 2022-06-08 | 주식회사 데이타커맨드 | 데이터 초기 복제 방법 및 이를 수행하기 위한 컴퓨팅 장치 |
| US12197938B1 (en) * | 2021-12-10 | 2025-01-14 | Amazon Technologies, Inc. | Data migration with metadata |
Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| GB2351375A (en) * | 1999-03-25 | 2000-12-27 | Dell Usa Lp | Storage Domain Management System |
| US20040080558A1 (en) * | 2002-10-28 | 2004-04-29 | Blumenau Steven M. | Method and apparatus for monitoring the storage of data in a computer system |
Family Cites Families (30)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JPH0235537A (ja) * | 1988-07-25 | 1990-02-06 | Hitachi Ltd | 多重化ボリューム更新制御方式 |
| US5226159A (en) * | 1989-05-15 | 1993-07-06 | International Business Machines Corporation | File lock management in a distributed data processing system |
| US5544347A (en) * | 1990-09-24 | 1996-08-06 | Emc Corporation | Data storage system controlled remote data mirroring with respectively maintained data indices |
| US5263154A (en) | 1992-04-20 | 1993-11-16 | International Business Machines Corporation | Method and system for incremental time zero backup copying of data |
| JPH06119253A (ja) * | 1992-10-02 | 1994-04-28 | Toshiba Corp | 二重化メモリ制御装置 |
| JP3022011B2 (ja) * | 1992-11-27 | 2000-03-15 | 三洋電機株式会社 | データバックアップシステム |
| JP3138575B2 (ja) * | 1993-09-02 | 2001-02-26 | 日本電気株式会社 | フアイル複写移行方式 |
| US5727203A (en) * | 1995-03-31 | 1998-03-10 | Sun Microsystems, Inc. | Methods and apparatus for managing a database in a distributed object operating environment using persistent and transient cache |
| US5956712A (en) * | 1995-06-07 | 1999-09-21 | International Business Machines Corporation | Byte range locking in a distributed environment |
| US5680640A (en) * | 1995-09-01 | 1997-10-21 | Emc Corporation | System for migrating data by selecting a first or second transfer means based on the status of a data element map initialized to a predetermined state |
| US5933653A (en) * | 1996-05-31 | 1999-08-03 | Emc Corporation | Method and apparatus for mirroring data in a remote data storage system |
| US5822780A (en) * | 1996-12-31 | 1998-10-13 | Emc Corporation | Method and apparatus for hierarchical storage management for data base management systems |
| WO1999009513A2 (en) * | 1997-08-20 | 1999-02-25 | Powerquest Corporation | Computer partition manipulation during imaging |
| US6145066A (en) * | 1997-11-14 | 2000-11-07 | Amdahl Corporation | Computer system with transparent data migration between storage volumes |
| US6260124B1 (en) * | 1998-08-13 | 2001-07-10 | International Business Machines Corporation | System and method for dynamically resynchronizing backup data |
| JP2000222258A (ja) * | 1999-02-04 | 2000-08-11 | Internatl Business Mach Corp <Ibm> | データベースの構造を変更する方法、データベース・アクセス要求の制御方法、オンラインシステム、データベース運用支援ミドルウエアを格納する記憶媒体、及び、移行ユーティリティを格納する記憶媒体 |
| JP4175764B2 (ja) * | 2000-05-18 | 2008-11-05 | 株式会社日立製作所 | 計算機システム |
| US6546457B1 (en) * | 2000-09-29 | 2003-04-08 | Emc Corporation | Method and apparatus for reconfiguring striped logical devices in a disk array storage |
| US6502170B2 (en) * | 2000-12-15 | 2002-12-31 | Intel Corporation | Memory-to-memory compare/exchange instructions to support non-blocking synchronization schemes |
| US6745285B2 (en) * | 2000-12-18 | 2004-06-01 | Sun Microsystems, Inc. | System and method for synchronizing mirrored and striped disk writes |
| US6799258B1 (en) * | 2001-01-10 | 2004-09-28 | Datacore Software Corporation | Methods and apparatus for point-in-time volumes |
| US6496908B1 (en) * | 2001-05-18 | 2002-12-17 | Emc Corporation | Remote mirroring |
| US6640291B2 (en) * | 2001-08-10 | 2003-10-28 | Hitachi, Ltd. | Apparatus and method for online data migration with remote copy |
| JP4168626B2 (ja) * | 2001-12-06 | 2008-10-22 | 株式会社日立製作所 | 記憶装置間のファイル移行方法 |
| US6973549B1 (en) * | 2001-12-10 | 2005-12-06 | Incipient, Inc. | Locking technique for control and synchronization |
| US6907505B2 (en) * | 2002-07-31 | 2005-06-14 | Hewlett-Packard Development Company, L.P. | Immediately available, statically allocated, full-logical-unit copy with a transient, snapshot-copy-like intermediate stage |
| US7447860B1 (en) * | 2003-09-29 | 2008-11-04 | Emc Corporation | System and method for managing data associated with copying and recovery procedures in a data storage environment |
| JP4282464B2 (ja) * | 2003-12-17 | 2009-06-24 | 株式会社日立製作所 | リモートコピーシステム |
| US7222135B2 (en) * | 2003-12-29 | 2007-05-22 | Intel Corporation | Method, system, and program for managing data migration |
| US7421537B2 (en) * | 2004-03-22 | 2008-09-02 | Intel Corporation | Migrating data between storage volumes |
-
2004
- 2004-06-10 US US10/865,625 patent/US7613889B2/en not_active Expired - Fee Related
-
2005
- 2005-05-10 CN CN2005800080043A patent/CN1934568B/zh not_active Expired - Fee Related
- 2005-05-10 KR KR1020067025095A patent/KR100962883B1/ko not_active Expired - Fee Related
- 2005-05-10 WO PCT/EP2005/052097 patent/WO2005122007A2/en not_active Ceased
- 2005-05-10 EP EP05740105A patent/EP1754172A2/en not_active Withdrawn
- 2005-05-10 JP JP2007526410A patent/JP4738413B2/ja not_active Expired - Fee Related
Patent Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| GB2351375A (en) * | 1999-03-25 | 2000-12-27 | Dell Usa Lp | Storage Domain Management System |
| US20040080558A1 (en) * | 2002-10-28 | 2004-04-29 | Blumenau Steven M. | Method and apparatus for monitoring the storage of data in a computer system |
Also Published As
| Publication number | Publication date |
|---|---|
| WO2005122007A3 (en) | 2006-07-13 |
| JP2008502060A (ja) | 2008-01-24 |
| KR100962883B1 (ko) | 2010-06-09 |
| EP1754172A2 (en) | 2007-02-21 |
| US20050278492A1 (en) | 2005-12-15 |
| KR20070020052A (ko) | 2007-02-16 |
| CN1934568A (zh) | 2007-03-21 |
| US7613889B2 (en) | 2009-11-03 |
| JP4738413B2 (ja) | 2011-08-03 |
| WO2005122007A2 (en) | 2005-12-22 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN1934568B (zh) | 将源数据迁移成目标数据的方法、系统和程序 | |
| US9563636B2 (en) | Allowing writes to complete without obtaining a write lock to a file | |
| US7865473B2 (en) | Generating and indicating incremental backup copies from virtual copies of a data set | |
| US8086810B2 (en) | Rapid defragmentation of storage volumes | |
| US7330947B2 (en) | Method and apparatus for backing up data in virtual storage medium | |
| US9086818B2 (en) | Source-target relations mapping | |
| EP1636690B1 (en) | Managing a relationship between one target volume and one source volume | |
| US8627011B2 (en) | Managing metadata for data in a copy relationship | |
| WO2016117022A1 (ja) | ログの管理方法及び計算機システム | |
| JP4419884B2 (ja) | データ複製装置、方法及びプログラム並びに記憶システム | |
| US20060069888A1 (en) | Method, system and program for managing asynchronous cache scans | |
| US7047378B2 (en) | Method, system, and program for managing information on relationships between target volumes and source volumes when performing adding, withdrawing, and disaster recovery operations for the relationships | |
| CN101305341B (zh) | 存储数据集的多个版本的方法和系统 | |
| US8086580B2 (en) | Handling access requests to a page while copying an updated page of data to storage | |
| JP4644446B2 (ja) | 関係に関する追加動作を実行する時にターゲット・ボリュームとソース・ボリュームとの間の関係に関する情報を管理する方法、システム、およびプログラム | |
| KR101887663B1 (ko) | 더미 페이지를 이용한 데이터 처리 방법 및 장치 |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C14 | Grant of patent or utility model | ||
| GR01 | Patent grant | ||
| CF01 | Termination of patent right due to non-payment of annual fee |
Granted publication date: 20120328 Termination date: 20150510 |
|
| EXPY | Termination of patent right or utility model |