WO2000065449A1 - Procede et systeme de gestion de fichiers dans un environnement reparti - Google Patents
Procede et systeme de gestion de fichiers dans un environnement reparti Download PDFInfo
- Publication number
- WO2000065449A1 WO2000065449A1 PCT/JP2000/002664 JP0002664W WO0065449A1 WO 2000065449 A1 WO2000065449 A1 WO 2000065449A1 JP 0002664 W JP0002664 W JP 0002664W WO 0065449 A1 WO0065449 A1 WO 0065449A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- file
- terminal
- information
- index
- meta
- Prior art date
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/10—File systems; File servers
- G06F16/18—File system types
- G06F16/182—Distributed file systems
Definitions
- the present invention relates to a file management method and a file management system in a distributed environment in which a plurality of terminals are connected via a network and information is recorded in respective memories of each terminal.
- the present invention relates to a file management system in which a user can use files distributed and managed in a plurality of terminals (information processing devices) connected by a network without being aware of a distributed environment.
- a file management system in a distributed environment connects terminals that are geographically or logically distributed by a network, and allows users to access managed files as if they access their terminal. It is configured so that it can be used. Shared files between multiple companies-Not only can management of geographically distant files within the same company be integrated, but also data access can be made more efficient and damage caused by failures can be distributed.
- an index can be created, and when accessing a file, the index can be referred to and the storage location of the required file can be known.
- the management method depends on how the indexes are arranged and managed in the system.
- INDEX has four methods: a non-overlapping management method, which does not have any index, and a partial overlap management method, in which the INDEX is held in several multiple terminals at once.
- the load concentrates on a specific terminal that has an index, the failure of this specific terminal causes an overall obstacle, and the access The starting point is all this specific terminal, which is a problem in that the processing speed increases.
- the problem of the single point method does not occur, but if the index changes, the indexes of all terminals must be updated, and at this time the load on the entire system is concentrated, and all evening terminals This is a problem in that the index of the entire system is enlarged because the index of all terminals is maintained.
- the problem is that the entire system stops due to the failure of a specific terminal.Even if the index is changed, only the local terminal needs to be changed.However, when accessing files managed by terminals other than the local terminal However, there is a problem in that the load for inquiring all other terminals is increased.
- partial overlap management method is an attempt that you'll solve the problem by balancing the problems in the trade-off relationship in which the three methods are faced, design is rather difficult: Mel.
- the present invention provides a file management method or a file management system capable of avoiding the problem that the load concentrates on a specific terminal, the problem of synchronization when updating a file, and the problem of accessing another terminal in the conventional system. It is intended to do so.
- the present invention provides a file management method in a distributed environment in which a plurality of terminals are connected to a network and information is recorded in each of the terminals in which the information is dispersed.
- One information access request from the user via the network is received.
- a file management method characterized by including a step of referring to the meta-index of the file recorded in the storage unit and updating and synchronizing the files of all other terminals whose storage locations are registered there. I do.
- the file management method includes a terminal key for designating a terminal where a file is stored. It is characterized by comprising an address specifying a position in a memory managed by the terminal file controller.
- an operator of one terminal further stores a plurality of distributed files in the memory. If they are used simultaneously, 1) the multiple files are copied continuously to a new area in the memory of the terminal to create an intermediate file, and the storage location information of the intermediate file is stored in the file index of each file. 2)
- the method includes a step of referring to the meta-index and opening an intermediate file in response to a subsequent access request to the file from the operator.
- the number of memory accesses within the own terminal can be suppressed and the load can be reduced.
- the file management method according to any one of the first to third aspects, further comprising:
- the access to the storage location registered in the meta-index storage It is characterized by including a step of providing a table for counting the access frequency, and a step of moving and erasing files as necessary for load balance between terminals.
- the file controller further includes a reference authority list for each terminal in the file controller, and a reference is made as necessary for load balancing.
- a step of setting such that the copy file cannot be set in the evening terminal is included.
- the file is at least one selected from a data file and a program file. It is characterized by being.
- the method includes a step of referring to the meta index and copying a file of information stored in the failed terminal from another terminal having no failure and performing a backup process.
- a second aspect of the present invention is a file management system in a distributed environment in which a plurality of terminals are connected via a network and information is recorded in respective memories of the dispersed terminals.
- Set up a file controller that manages files and controls the exchange of information with the network.
- This file controller has the following information: 1) The storage location of the original file that stores the information used in the terminal and the meta-index that is set to identify the information in the network.
- a meta-index storage for registering a meta-index containing information; and 2) a meta-record stored in the meta-index storage of the own file controller when a user requests access to one piece of information via a network.
- the file is stored in the meta index storage of the terminal, Referring to Le of main evening Indekkusu, it is there storage location comprising providing the updated synchronization synchronizing means other terminals of all the files that have been registered.
- a group is set, and a meta index is shared with the evening terminal within the group. It is characterized by comprising a group setting means.
- the storage location information is a terminal that designates a terminal in which the file is stored.
- the present invention described in claim 11 is characterized by comprising a key and an address specifying a position in a memory managed by the file controller of the one-minute terminal.
- the terminal when an operator of one terminal uses a plurality of distributed files in the memory at the same time, 1) the terminal The multiple files are successively copied to a new area in the memory to create an intermediate file, and the storage location information of the intermediate file is registered in the meta index of each file.
- a meta-index is referred to and a speed-up means for opening an intermediate file is included.
- the file management system according to any one of the eighth to eleventh aspects, wherein a file control system of each terminal is provided.
- the frequency table that counts the frequency of access to the storage locations registered in the meta-index storage unit, and moves and deletes files as necessary to balance the load between terminals.
- a balance means is provided.
- the file controller is further provided with a reference authority list for each terminal; Then, the balance means is configured so that, even if a file is copied to a terminal without reference authority as required for load balancing, the terminal cannot open the copy file. It is characterized by the following.
- the file is selected from a data file and a program file. It is characterized by at least one.
- the present invention described in claim 15 is the file management system according to any one of claims 8 to 13, wherein the file management system further includes a terminal connected to a network.
- backup processing means for performing a pack-up process by copying a file of information stored in the failure terminal with reference to the meta-index from another terminal having no failure and referring to the meta-index.
- FIG. 1 is a conceptual diagram of the embodiment.
- FIG. 2 is a block diagram showing the configuration of the file controller.
- FIG. 3 is an explanatory diagram showing a state where “material 1” is stored.
- FIG. 4 is an explanatory diagram showing a storage state after updating a file.
- FIG. 5 is an explanatory diagram for explaining the state of updating the main index.
- FIG. 6 is an explanatory diagram showing the state in the memory.
- FIG. 7 is an explanatory diagram showing a frequency table.
- FIG. 8 is a schematic diagram for explaining the principle of speeding up.
- FIG. 1 is a conceptual diagram of an embodiment of a file management system according to the present invention.
- the evening terminals 102, 103, and 104 connected by the network 101 are under the control of their respective operation systems (hereinafter referred to as OS).
- a file controller (hereinafter referred to as 0FC) 105 mounted on each terminal encapsulates these three ⁇ S as a whole. No matter which terminal the user accesses, the file stored in the terminal can only be opened through the file controller.
- FIG. 2 illustrates the configuration of the file controller.
- Reference numeral 201 denotes a meta-index DB, which is composed of a data index-night index 202 and a frequency table 203.
- information transmission means 210, synchronization means 204, high-speed means 205 within the own terminal, balance means 206, high-speed means 207, grouping means 2 08 controls the file through the OS of each terminal.
- the information transmitting means 210 When an access request for one piece of information from a user via a network is made to one terminal, the information transmitting means 210 in the one terminal first stores the information in the meta-index storage unit 202 of its own file controller. Reference is made to the recorded meta index. Then, open the file in one of the following ways, and send the information of the opened file to the user via the network.
- the method of opening the file is as follows: (i) If a file storing the above information exists in the own terminal, the file in the local terminal is opened prior to other operations.
- the file of the other terminal is opened without copying to the memory of the terminal itself, and the information is transmitted to the user. For example, this is performed when a rule such as adopting ⁇ a> described above or ⁇ c> described below is adopted when the information is requested five times.
- FIG. 3 shows that the same information, “Material 1”, is stored in Terminal 1 at 301 and Terminal 2 at 302.
- “Document 1” is stored at address B1 of Terminal 1 and at address B2 of Yuichi Minaru 2. These addresses are the addresses in memory assigned by the OS (operation system) of each terminal.
- the meta-index R of document 1 can be expressed as 303.
- T l, ⁇ 2 are terminal keys for Terminal 1 and Terminal 2.
- Terminal 1 accesses “Document 1”, and when the file in ⁇ 111 is updated, the file controller refers to R 1 (the meta-index of “Document 1” in Terminal 1), Update the ⁇ 2— ⁇ 2 file registered there. At this time, the address of the updated file is registered, and an absent bit is set (OFF) for the old file and ignored.
- Figure 4 shows the updated file and the old file that was turned off. In this way, multiple files in the distributed environment can be synchronized.
- a description will be given of the speed-up means 205 in the own terminal. 5 in FIG. 5 is an evening meta-index data of the information stored in terminal 1.
- Information Rl, R10:: 100 is registered with the name and address (address and size in memory).
- the frequency table of 203 stores the frequency of which terminal accesses the information (R k) from each terminal.
- the frequency of access to each terminal (Tl, ⁇ 2, ⁇ 3) when an access request to the information R1 is made is counted.
- Information R 1 is present every evening, and if the load of 1: is a problem, delete the infrequently used terminal 1 files. If the information is only in Terminal 1, move to Terminal 3, which is the most frequent location. Thus, the load can be balanced by referring to the frequency table.
- the high-speed means 207 will be described.
- a user requests access to information R 7 at terminal ⁇ 7, refer to the meta index. If there is a file storing information in your terminal, be sure to open the file in your terminal. If not (801 in Fig. 8), copy the file of the other terminal to the local terminal and write the storage location information to the meta index.
- Reference numeral 802 in FIG. 8 shows a state after copying. In this way, you can access the file copied to your terminal, so that you can do a quick drop-in.
- the grouping means 208 will be described. Here, a process for newly adding a terminal ( ⁇ ) to be subjected to file control according to the present invention is performed. The data created by merging the index of ⁇ with the index of the terminal group that has already been grouped is merged into the index of the new group as the index of the new group. Reply By doing this, the group PT / JP00 / 02664
- the storage location information of the file of the information stored in the failed terminal is searched by referring to the database index, and if there is no failure, another file is retrieved. Copy from the terminal and perform backup processing. In this way, the user can maintain a secure distributed environment without being aware of special backup processing and security processing.
- a user can operate a file stored in a distributed manner on a network as if it were a file of his own terminal. Furthermore, it can avoid the problem that the load is concentrated on a specific terminal, the problem of synchronization when updating files, and the problem of increased time cost due to access to other terminals.
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Data Mining & Analysis (AREA)
- Databases & Information Systems (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
- Information Transfer Between Computers (AREA)
Description
Claims
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
EP00919160A EP1225511A1 (de) | 1999-04-22 | 2000-04-24 | Verfahren und system zur akten-verwaltung in verteilten umgebungen |
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
JP11/114404 | 1999-04-22 | ||
JP11114404A JP2000305831A (ja) | 1999-04-22 | 1999-04-22 | 分散環境におけるファイル管理の方法、システム。 |
Publications (1)
Publication Number | Publication Date |
---|---|
WO2000065449A1 true WO2000065449A1 (fr) | 2000-11-02 |
Family
ID=14636846
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
PCT/JP2000/002664 WO2000065449A1 (fr) | 1999-04-22 | 2000-04-24 | Procede et systeme de gestion de fichiers dans un environnement reparti |
Country Status (5)
Country | Link |
---|---|
EP (1) | EP1225511A1 (ja) |
JP (1) | JP2000305831A (ja) |
CN (1) | CN1353836A (ja) |
TW (1) | TW473661B (ja) |
WO (1) | WO2000065449A1 (ja) |
Families Citing this family (19)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
WO2002086781A1 (fr) * | 2001-04-17 | 2002-10-31 | Nishimori, Koji | Procede et systeme d'automatisation d'un cadre de vie |
JP2004078415A (ja) | 2002-08-13 | 2004-03-11 | Nec Infrontia Corp | データバックアップ方法及びこの方法を実行するシステム |
CN1317662C (zh) * | 2002-10-31 | 2007-05-23 | 中兴通讯股份有限公司 | 一种分布式文件存取方法 |
US8706760B2 (en) | 2003-02-28 | 2014-04-22 | Microsoft Corporation | Method to delay locking of server files on edit |
US7406499B2 (en) * | 2003-05-09 | 2008-07-29 | Microsoft Corporation | Architecture for partition computation and propagation of changes in data replication |
US7984488B2 (en) * | 2004-04-09 | 2011-07-19 | Microsoft Corporation | Credential roaming in electronic computing systems |
US8131674B2 (en) * | 2004-06-25 | 2012-03-06 | Apple Inc. | Methods and systems for managing data |
US7769848B2 (en) * | 2004-09-22 | 2010-08-03 | International Business Machines Corporation | Method and systems for copying data components between nodes of a wireless sensor network |
CN101504702B (zh) * | 2005-03-10 | 2012-05-30 | 日本电信电话株式会社 | 存储系统和存储控制方法 |
CN100442282C (zh) * | 2005-08-16 | 2008-12-10 | 杭州华三通信技术有限公司 | 分布式系统中数据查询的方法及板间数据同步的方法 |
CN1988535B (zh) * | 2005-12-23 | 2010-08-11 | 腾讯科技(深圳)有限公司 | 文件存储同步方法、系统及客户端 |
EP1858228A1 (en) * | 2006-05-16 | 2007-11-21 | THOMSON Licensing | Network data storage system with distributed file management |
CN101296108B (zh) * | 2007-04-27 | 2012-12-12 | 华为技术有限公司 | 一种在结构化p2p中备份资源的方法和系统 |
CN101499073B (zh) * | 2008-01-29 | 2011-10-12 | 国际商业机器公司 | 基于访问频率的连续存储数据的存储管理方法和系统 |
CN101667179B (zh) * | 2008-09-03 | 2012-08-15 | 华为技术有限公司 | 移动搜索方法及其系统、搜索服务器同步元索引的方法 |
CN101741911B (zh) * | 2009-12-18 | 2014-04-30 | 中兴通讯股份有限公司 | 基于多副本协同的写操作方法、系统及节点 |
CN102375894B (zh) * | 2011-12-02 | 2013-08-28 | 曙光信息产业(北京)有限公司 | 一种管理不同类型文件系统的方法 |
US9607177B2 (en) * | 2013-09-30 | 2017-03-28 | Qualcomm Incorporated | Method for securing content in dynamically allocated memory using different domain-specific keys |
CN103595807B (zh) * | 2013-11-20 | 2016-06-15 | 中国银行股份有限公司 | 一种数据同步更新方法和装置 |
Citations (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US5873085A (en) * | 1995-11-20 | 1999-02-16 | Matsushita Electric Industrial Co. Ltd. | Virtual file management system |
-
1999
- 1999-04-22 JP JP11114404A patent/JP2000305831A/ja active Pending
-
2000
- 2000-04-24 CN CN00808249A patent/CN1353836A/zh active Pending
- 2000-04-24 WO PCT/JP2000/002664 patent/WO2000065449A1/ja not_active Application Discontinuation
- 2000-04-24 EP EP00919160A patent/EP1225511A1/de not_active Withdrawn
- 2000-09-19 TW TW089119255A patent/TW473661B/zh not_active IP Right Cessation
Patent Citations (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US5873085A (en) * | 1995-11-20 | 1999-02-16 | Matsushita Electric Industrial Co. Ltd. | Virtual file management system |
Non-Patent Citations (2)
Title |
---|
A.S. TANNENBAUM / TRANSLATED BY NOBUYUKI HIKICHI ET AL.: "Bunsan operating system -UNIX no tsugi ni kurumono-", KABUSHIKI KAISHA TOPPAN, 30 November 1995 (1995-11-30), (TOKYO), pages 645 - 649, XP002933768 * |
MAMORU MAEKAWA ET AL.: "Bunsan operating system - UNIX no tsugi ni kurumono-", KYORITSU SHUPPAN K.K., 25 December 1991 (1991-12-25), (TOKYO), pages 114 - 118, 159-163, 259-261, XP002933767 * |
Also Published As
Publication number | Publication date |
---|---|
EP1225511A1 (de) | 2002-07-24 |
JP2000305831A (ja) | 2000-11-02 |
CN1353836A (zh) | 2002-06-12 |
TW473661B (en) | 2002-01-21 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
WO2000065449A1 (fr) | Procede et systeme de gestion de fichiers dans un environnement reparti | |
CN106407040B (zh) | 一种远程数据复制方法及系统 | |
US6397309B2 (en) | System and method for reconstructing data associated with protected storage volume stored in multiple modules of back-up mass data storage facility | |
US7392234B2 (en) | Method and system for electronic file lifecycle management | |
CN100472463C (zh) | 用于对存储区中的选定数据执行操作的方法和设备 | |
JP3645270B2 (ja) | オンライン、実時間、データ移送の技術分野のためのシステム及び方法 | |
US7213116B2 (en) | Method and apparatus for mirroring objects between storage systems | |
CN1766885B (zh) | 提供受管理数据的系统及方法 | |
JP4568115B2 (ja) | ハードウェアベースのファイルシステムのための装置および方法 | |
US7266654B2 (en) | Storage system, server apparatus, and method for creating a plurality of snapshots | |
US20050216523A1 (en) | File management method in a distributed storage system | |
US20120059799A1 (en) | Managing objects for a data file | |
CN101120305A (zh) | 新型即时复制操作 | |
US20090112789A1 (en) | Policy based file management | |
US20070067583A1 (en) | Managing snapshot history in a data storage system | |
US20070239803A1 (en) | Remote mirroring method between tiered storage systems | |
US20090112811A1 (en) | Exposing storage resources with differing capabilities | |
JPH0713838A (ja) | エラーの回復方法及び装置 | |
JP2005031716A (ja) | データバックアップの方法及び装置 | |
US7549029B2 (en) | Methods for creating hierarchical copies | |
JP4937863B2 (ja) | 計算機システム、管理計算機及びデータ管理方法 | |
US7730351B2 (en) | Per file dirty region logging | |
JP4394467B2 (ja) | ストレージシステム、サーバ装置及び先行コピーデータ生成方法 | |
US20050138089A1 (en) | Data replication method | |
JP5446378B2 (ja) | ストレージシステム |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
WWE | Wipo information: entry into national phase |
Ref document number: 00808249.9 Country of ref document: CN |
|
AK | Designated states |
Kind code of ref document: A1 Designated state(s): CN KR US |
|
AL | Designated countries for regional patents |
Kind code of ref document: A1 Designated state(s): AT BE CH CY DE DK ES FI FR GB GR IE IT LU MC NL PT SE |
|
DFPE | Request for preliminary examination filed prior to expiration of 19th month from priority date (pct application filed before 20040101) | ||
121 | Ep: the epo has been informed by wipo that ep was designated in this application | ||
WWE | Wipo information: entry into national phase |
Ref document number: 2000919160 Country of ref document: EP |
|
WWE | Wipo information: entry into national phase |
Ref document number: 10030484 Country of ref document: US |
|
WWP | Wipo information: published in national office |
Ref document number: 2000919160 Country of ref document: EP |
|
WWW | Wipo information: withdrawn in national office |
Ref document number: 2000919160 Country of ref document: EP |