JP4669067B2 - 動的フラグメントマッピング - Google Patents
動的フラグメントマッピング Download PDFInfo
- Publication number
- JP4669067B2 JP4669067B2 JP2009527480A JP2009527480A JP4669067B2 JP 4669067 B2 JP4669067 B2 JP 4669067B2 JP 2009527480 A JP2009527480 A JP 2009527480A JP 2009527480 A JP2009527480 A JP 2009527480A JP 4669067 B2 JP4669067 B2 JP 4669067B2
- Authority
- JP
- Japan
- Prior art keywords
- fragment
- map
- computer
- actual
- data
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 239000012634 fragment Substances 0.000 title claims description 315
- 238000013507 mapping Methods 0.000 title description 28
- 238000000034 method Methods 0.000 claims description 55
- 230000006870 function Effects 0.000 description 44
- 238000010586 diagram Methods 0.000 description 23
- 230000004044 response Effects 0.000 description 11
- 238000004891 communication Methods 0.000 description 6
- 230000007704 transition Effects 0.000 description 6
- 230000008859 change Effects 0.000 description 3
- 238000007620 mathematical function Methods 0.000 description 3
- 230000003287 optical effect Effects 0.000 description 3
- 230000002596 correlated effect Effects 0.000 description 2
- 230000008569 process Effects 0.000 description 2
- 238000012545 processing Methods 0.000 description 2
- 238000007430 reference method Methods 0.000 description 2
- 230000008901 benefit Effects 0.000 description 1
- 238000007796 conventional method Methods 0.000 description 1
- 238000013500 data storage Methods 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 238000005192 partition Methods 0.000 description 1
- 230000007723 transport mechanism Effects 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F17/00—Digital computing or data processing equipment or methods, specially adapted for specific functions
- G06F17/40—Data acquisition and logging
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/27—Replication, distribution or synchronisation of data between databases or within a distributed database system; Distributed database system architectures therefor
- G06F16/278—Data partitioning, e.g. horizontal or vertical partitioning
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/22—Indexing; Data structures therefor; Storage structures
- G06F16/2282—Tablespace storage structures; Management thereof
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y10—TECHNICAL SUBJECTS COVERED BY FORMER USPC
- Y10S—TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y10S707/00—Data processing: database and file management or data structures
- Y10S707/99931—Database or file accessing
- Y10S707/99937—Sorting
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y10—TECHNICAL SUBJECTS COVERED BY FORMER USPC
- Y10S—TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y10S707/00—Data processing: database and file management or data structures
- Y10S707/99941—Database schema or data structure
- Y10S707/99942—Manipulating data structure, e.g. compression, compaction, compilation
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y10—TECHNICAL SUBJECTS COVERED BY FORMER USPC
- Y10S—TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y10S707/00—Data processing: database and file management or data structures
- Y10S707/99951—File or database maintenance
- Y10S707/99952—Coherency, e.g. same view to multiple users
- Y10S707/99953—Recoverability
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Databases & Information Systems (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- Data Mining & Analysis (AREA)
- General Physics & Mathematics (AREA)
- Software Systems (AREA)
- Computing Systems (AREA)
- Computer Hardware Design (AREA)
- Mathematical Physics (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Description
Claims (11)
- コンピュータ実行可能命令を格納したコンピュータ読み取り可能記録媒体であって、コンピュータによって前記コンピュータ実行可能命令が実行されると、
所定のサイズより大きいフラグメントを識別するステップと、
前記フラグメントが、実フラグメントマップにおいて2回以上参照されるかどうかを決定するステップと、
前記実フラグメントマップのサイズを大きくするステップと、
新しい実フラグメントを識別するために新しいトークンを選択するステップと、
前記新しいトークンを用いて前記実フラグメントマップのエントリを変更するステップと
を備えた方法を実行することを特徴とするコンピュータ読み取り可能記録媒体。 - 前記実フラグメントマップのサイズを大きくするステップは、実フラグメントマップのサイズを2倍にすることを特徴とする請求項1に記載のコンピュータ読み取り可能記録媒体。
- 前記新しいトークンと関連付けられたデータは、前記フラグメントから前記新しいフラグメントに移動されることを特徴とする請求項1に記載のコンピュータ読み取り可能記録媒体。
- 前記フラグメントは、データセットのサブセットであることを特徴とする請求項1に記載のコンピュータ読み取り可能記録媒体。
- 前記実フラグメントマップは、配列であることを特徴とする請求項1に記載のコンピュータ読み取り可能記録媒体。
- 前記実フラグメントマップの少なくとも1つのエントリを変更するステップをさらに備えたことを特徴とする請求項1に記載のコンピュータ読み取り可能記録媒体。
- コンピュータ実行可能命令を格納したコンピュータ読み取り可能記録媒体であって、コンピュータによって前記コンピュータ実行可能命令が実行されると、
既定のしきい値未満に縮小したサイズのフラグメントを識別するステップと、
実フラグメントマップのフラグメントに対するマージパートナーを識別するステップと、
前記マージパートナーの識別子を用いて前記実フラグメントマップの前記フラグメントに一致するエントリを変更するステップと、
前記実フラグメントマップを縮小できる場合には、前記実フラグメントマップのサイズを縮小させるステップと
を備えた方法を実行することを特徴とするコンピュータ読み取り可能記録媒体。 - 前記フラグメントと関連付けられたデータを、前記マージパートナーと関連付けられた物理的記憶装置に移動させるステップをさらに備えたことを特徴とする請求項7に記載のコンピュータ読み取り可能記録媒体。
- 前記フラグメントは、データセットのサブセットであることを特徴とする請求項7に記載のコンピュータ読み取り可能記録媒体。
- 前記実フラグメントマップのサイズを縮小させるステップは、前記実フラグメントマップの要素に、特定の識別子が繰り返される配列からなる基準パターンの繰り返しを含む場合、前記基準パターンの繰り返しを畳み込むことにより、前記要素の数を減少させることを特徴とする請求項7に記載のコンピュータ読み取り可能記録媒体。
- 前記実フラグメントマップの少なくとも1つのエントリを変更するステップをさらに備えたことを特徴とする請求項7に記載のコンピュータ読み取り可能記録媒体。
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US11/470,586 US7523288B2 (en) | 2006-09-06 | 2006-09-06 | Dynamic fragment mapping |
PCT/US2007/076257 WO2008030694A1 (en) | 2006-09-06 | 2007-08-18 | Dynamic fragment mapping |
Publications (2)
Publication Number | Publication Date |
---|---|
JP2010503117A JP2010503117A (ja) | 2010-01-28 |
JP4669067B2 true JP4669067B2 (ja) | 2011-04-13 |
Family
ID=39153420
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
JP2009527480A Active JP4669067B2 (ja) | 2006-09-06 | 2007-08-18 | 動的フラグメントマッピング |
Country Status (7)
Country | Link |
---|---|
US (1) | US7523288B2 (ja) |
EP (1) | EP2069979B1 (ja) |
JP (1) | JP4669067B2 (ja) |
KR (1) | KR101467589B1 (ja) |
CN (1) | CN101512526B (ja) |
TW (1) | TWI372981B (ja) |
WO (1) | WO2008030694A1 (ja) |
Families Citing this family (22)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US7992037B2 (en) * | 2008-09-11 | 2011-08-02 | Nec Laboratories America, Inc. | Scalable secondary storage systems and methods |
EP2605143A4 (en) * | 2010-08-13 | 2014-10-08 | Fujitsu Ltd | MEMORY CONTROL DEVICE, INFORMATION PROCESSING DEVICE AND CONTROL METHOD FOR A MEMORY CONTROL DEVICE |
GB2489405B (en) * | 2011-03-22 | 2018-03-07 | Advanced Risc Mach Ltd | Encrypting and storing confidential data |
KR20130014943A (ko) * | 2011-08-01 | 2013-02-12 | 삼성전자주식회사 | 임의의 메모리 집합을 지원하는 메모리 구성 장치 및 방법 |
US20140344235A1 (en) * | 2013-05-17 | 2014-11-20 | Emmanuel Zarpas | Determination of data modification |
CN103441937A (zh) * | 2013-08-21 | 2013-12-11 | 曙光信息产业(北京)有限公司 | 组播数据的发送方法和接收方法 |
US9405643B2 (en) | 2013-11-26 | 2016-08-02 | Dropbox, Inc. | Multi-level lookup architecture to facilitate failure recovery |
US9547706B2 (en) * | 2014-03-10 | 2017-01-17 | Dropbox, Inc. | Using colocation hints to facilitate accessing a distributed data storage system |
US20170255565A1 (en) * | 2016-03-02 | 2017-09-07 | Intel Corporation | Method and apparatus for providing a contiguously addressable memory region by remapping an address space |
US10509798B2 (en) * | 2016-05-11 | 2019-12-17 | Informatica Llc | Data flow design with static and dynamic elements |
CN106227678B (zh) * | 2016-07-21 | 2018-12-28 | 北京四维益友信息技术有限公司 | 一种虚拟存储介质的存取方法 |
CN108509438B (zh) * | 2017-02-24 | 2021-08-31 | 南京烽火星空通信发展有限公司 | 一种ElasticSearch分片扩展方法 |
WO2018199795A1 (en) | 2017-04-27 | 2018-11-01 | EMC IP Holding Company LLC | Best-effort deduplication of data |
US11402998B2 (en) | 2017-04-27 | 2022-08-02 | EMC IP Holding Company LLC | Re-placing data within a mapped-RAID environment comprising slices, storage stripes, RAID extents, device extents and storage devices |
WO2018199796A1 (en) | 2017-04-27 | 2018-11-01 | EMC IP Holding Company LLC | Consolidating temporally-related data within log-based storage |
WO2019022631A1 (en) * | 2017-07-27 | 2019-01-31 | EMC IP Holding Company LLC | STORING DATA IN DIFFERENTLY SIZED WAFERS WITHIN DIFFERENT STORAGE LEVELS |
CN107465573B (zh) * | 2017-08-04 | 2020-08-21 | 苏州浪潮智能科技有限公司 | 一种提高ssr客户端在线监控效能的方法 |
US11461287B2 (en) | 2017-10-26 | 2022-10-04 | EMC IP Holding Company LLC | Managing a file system within multiple LUNS while different LUN level policies are applied to the LUNS |
US11461250B2 (en) | 2017-10-26 | 2022-10-04 | EMC IP Holding Company LLC | Tuning data storage equipment based on comparing observed I/O statistics with expected I/O statistics which are defined by operating settings that control operation |
US11199968B2 (en) | 2017-10-26 | 2021-12-14 | EMC IP Holding Company LLC | Using recurring write quotas to optimize utilization of solid state storage in a hybrid storage array |
CN108776692A (zh) * | 2018-06-06 | 2018-11-09 | 北京京东尚科信息技术有限公司 | 用于处理信息的方法和装置 |
CN112306372B (zh) | 2019-07-31 | 2024-07-05 | 伊姆西Ip控股有限责任公司 | 用于处理数据的方法、设备和程序产品 |
Citations (9)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US5555404A (en) * | 1992-03-17 | 1996-09-10 | Telenor As | Continuously available database server having multiple groups of nodes with minimum intersecting sets of database fragment replicas |
JPH1131096A (ja) * | 1997-07-11 | 1999-02-02 | Anetsukusu Syst Kk | データ格納検索方式 |
US5881379A (en) * | 1996-05-20 | 1999-03-09 | International Business Machines Corporation | System, method, and program for using duplicated direct pointer sets in keyed database records to enhance data recoverability without logging |
JPH11110262A (ja) * | 1997-10-01 | 1999-04-23 | Toshiba Corp | 情報管理システム |
JP2001142751A (ja) * | 1999-11-12 | 2001-05-25 | Hitachi Ltd | データベース管理方法および装置並びにデータベース管理プログラムを記録した記憶媒体 |
US6523036B1 (en) * | 2000-08-01 | 2003-02-18 | Dantz Development Corporation | Internet database system |
JP2004021797A (ja) * | 2002-06-19 | 2004-01-22 | Hitachi Ltd | データベース管理方法および装置 |
WO2004025475A1 (ja) * | 2002-09-10 | 2004-03-25 | Annex Systems Incorporated | データベースの再編成システム、並びに、データベース |
JP2005533324A (ja) * | 2002-07-17 | 2005-11-04 | オラクル・インターナショナル・コーポレイション | モバイルアプリケーション用データをキャッシュするためのシステムおよび方法 |
Family Cites Families (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US6055604A (en) * | 1997-08-26 | 2000-04-25 | Hewlett-Packard Company | Forced transaction log posting using a least busy storage media without maintaining redundancy of the transaction log |
US6405284B1 (en) * | 1998-10-23 | 2002-06-11 | Oracle Corporation | Distributing data across multiple data storage devices in a data storage system |
US7162478B2 (en) * | 2001-02-28 | 2007-01-09 | International Business Machines Corporation | System and method for correlated fragmentations in databases |
US7237062B2 (en) * | 2004-04-02 | 2007-06-26 | Seagate Technology Llc | Storage media data structure system and method |
-
2006
- 2006-09-06 US US11/470,586 patent/US7523288B2/en not_active Expired - Fee Related
-
2007
- 2007-08-18 KR KR1020097004700A patent/KR101467589B1/ko active IP Right Grant
- 2007-08-18 EP EP07814240.3A patent/EP2069979B1/en active Active
- 2007-08-18 JP JP2009527480A patent/JP4669067B2/ja active Active
- 2007-08-18 WO PCT/US2007/076257 patent/WO2008030694A1/en active Application Filing
- 2007-08-18 CN CN2007800330122A patent/CN101512526B/zh active Active
- 2007-09-06 TW TW096133296A patent/TWI372981B/zh not_active IP Right Cessation
Patent Citations (9)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US5555404A (en) * | 1992-03-17 | 1996-09-10 | Telenor As | Continuously available database server having multiple groups of nodes with minimum intersecting sets of database fragment replicas |
US5881379A (en) * | 1996-05-20 | 1999-03-09 | International Business Machines Corporation | System, method, and program for using duplicated direct pointer sets in keyed database records to enhance data recoverability without logging |
JPH1131096A (ja) * | 1997-07-11 | 1999-02-02 | Anetsukusu Syst Kk | データ格納検索方式 |
JPH11110262A (ja) * | 1997-10-01 | 1999-04-23 | Toshiba Corp | 情報管理システム |
JP2001142751A (ja) * | 1999-11-12 | 2001-05-25 | Hitachi Ltd | データベース管理方法および装置並びにデータベース管理プログラムを記録した記憶媒体 |
US6523036B1 (en) * | 2000-08-01 | 2003-02-18 | Dantz Development Corporation | Internet database system |
JP2004021797A (ja) * | 2002-06-19 | 2004-01-22 | Hitachi Ltd | データベース管理方法および装置 |
JP2005533324A (ja) * | 2002-07-17 | 2005-11-04 | オラクル・インターナショナル・コーポレイション | モバイルアプリケーション用データをキャッシュするためのシステムおよび方法 |
WO2004025475A1 (ja) * | 2002-09-10 | 2004-03-25 | Annex Systems Incorporated | データベースの再編成システム、並びに、データベース |
Also Published As
Publication number | Publication date |
---|---|
TW200825800A (en) | 2008-06-16 |
CN101512526B (zh) | 2011-12-07 |
EP2069979B1 (en) | 2018-10-24 |
EP2069979A1 (en) | 2009-06-17 |
EP2069979A4 (en) | 2016-08-03 |
WO2008030694A1 (en) | 2008-03-13 |
JP2010503117A (ja) | 2010-01-28 |
US7523288B2 (en) | 2009-04-21 |
US20080059749A1 (en) | 2008-03-06 |
KR20090048624A (ko) | 2009-05-14 |
TWI372981B (en) | 2012-09-21 |
KR101467589B1 (ko) | 2014-12-02 |
CN101512526A (zh) | 2009-08-19 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
JP4669067B2 (ja) | 動的フラグメントマッピング | |
US11169978B2 (en) | Distributed pipeline optimization for data preparation | |
CN101719141B (zh) | 基于目录对象的文件处理方法和系统 | |
US11461304B2 (en) | Signature-based cache optimization for data preparation | |
CN103914483B (zh) | 文件存储方法、装置及文件读取方法、装置 | |
JP5499825B2 (ja) | データベース管理方法、データベースシステム、プログラム及びデータベースのデータ構造 | |
US10642815B2 (en) | Step editor for data preparation | |
KR101744892B1 (ko) | 시계열 계층 인덱싱을 이용한 데이터 검색 시스템 및 데이터 검색 방법 | |
EP3362808B1 (en) | Cache optimization for data preparation | |
US8271500B2 (en) | Minimal perfect hash functions using double hashing | |
WO2024078122A1 (zh) | 数据库表扫描的方法、装置以及设备 | |
CN104537023A (zh) | 一种反向索引记录的存储方法及装置 | |
US20210056090A1 (en) | Cache optimization for data preparation | |
CN108984780B (zh) | 基于支持重复键值树数据结构管理磁盘数据的方法和装置 | |
US11288447B2 (en) | Step editor for data preparation | |
US20220335030A1 (en) | Cache optimization for data preparation | |
CN115374127B (zh) | 数据存储方法及装置 | |
CN114201487A (zh) | 智能合约的存储装置和方法 | |
WO2008091054A1 (en) | Enhanced file system and method of managing files using the file system |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
A521 | Request for written amendment filed |
Free format text: JAPANESE INTERMEDIATE CODE: A523 Effective date: 20091218 |
|
RD13 | Notification of appointment of power of sub attorney |
Free format text: JAPANESE INTERMEDIATE CODE: A7433 Effective date: 20100126 |
|
A521 | Request for written amendment filed |
Free format text: JAPANESE INTERMEDIATE CODE: A821 Effective date: 20100126 |
|
A131 | Notification of reasons for refusal |
Free format text: JAPANESE INTERMEDIATE CODE: A131 Effective date: 20100305 |
|
A521 | Request for written amendment filed |
Free format text: JAPANESE INTERMEDIATE CODE: A523 Effective date: 20100604 |
|
A131 | Notification of reasons for refusal |
Free format text: JAPANESE INTERMEDIATE CODE: A131 Effective date: 20100716 |
|
A521 | Request for written amendment filed |
Free format text: JAPANESE INTERMEDIATE CODE: A523 Effective date: 20101014 |
|
TRDD | Decision of grant or rejection written | ||
A01 | Written decision to grant a patent or to grant a registration (utility model) |
Free format text: JAPANESE INTERMEDIATE CODE: A01 Effective date: 20110107 |
|
A01 | Written decision to grant a patent or to grant a registration (utility model) |
Free format text: JAPANESE INTERMEDIATE CODE: A01 |
|
A61 | First payment of annual fees (during grant procedure) |
Free format text: JAPANESE INTERMEDIATE CODE: A61 Effective date: 20110113 |
|
FPAY | Renewal fee payment (event date is renewal date of database) |
Free format text: PAYMENT UNTIL: 20140121 Year of fee payment: 3 |
|
R150 | Certificate of patent or registration of utility model |
Ref document number: 4669067 Country of ref document: JP Free format text: JAPANESE INTERMEDIATE CODE: R150 Free format text: JAPANESE INTERMEDIATE CODE: R150 |
|
R250 | Receipt of annual fees |
Free format text: JAPANESE INTERMEDIATE CODE: R250 |
|
R250 | Receipt of annual fees |
Free format text: JAPANESE INTERMEDIATE CODE: R250 |
|
S111 | Request for change of ownership or part of ownership |
Free format text: JAPANESE INTERMEDIATE CODE: R313113 |
|
R350 | Written notification of registration of transfer |
Free format text: JAPANESE INTERMEDIATE CODE: R350 |
|
R250 | Receipt of annual fees |
Free format text: JAPANESE INTERMEDIATE CODE: R250 |
|
R250 | Receipt of annual fees |
Free format text: JAPANESE INTERMEDIATE CODE: R250 |
|
R250 | Receipt of annual fees |
Free format text: JAPANESE INTERMEDIATE CODE: R250 |
|
R250 | Receipt of annual fees |
Free format text: JAPANESE INTERMEDIATE CODE: R250 |
|
R250 | Receipt of annual fees |
Free format text: JAPANESE INTERMEDIATE CODE: R250 |
|
R250 | Receipt of annual fees |
Free format text: JAPANESE INTERMEDIATE CODE: R250 |
|
R250 | Receipt of annual fees |
Free format text: JAPANESE INTERMEDIATE CODE: R250 |
|
R250 | Receipt of annual fees |
Free format text: JAPANESE INTERMEDIATE CODE: R250 |
|
R250 | Receipt of annual fees |
Free format text: JAPANESE INTERMEDIATE CODE: R250 |