CN104657089A - Unified management method of placement groups on object storage device - Google Patents
Unified management method of placement groups on object storage device Download PDFInfo
- Publication number
- CN104657089A CN104657089A CN201510109078.1A CN201510109078A CN104657089A CN 104657089 A CN104657089 A CN 104657089A CN 201510109078 A CN201510109078 A CN 201510109078A CN 104657089 A CN104657089 A CN 104657089A
- Authority
- CN
- China
- Prior art keywords
- placement group
- placement
- storage device
- object storage
- osd
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
- G06F3/0601—Interfaces specially adapted for storage systems
- G06F3/0602—Interfaces specially adapted for storage systems specifically adapted to achieve a particular effect
- G06F3/0604—Improving or facilitating administration, e.g. storage management
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
The invention discloses a unified management method of placement groups on an object storage device (OSD), and belongs to the technical field of the object storage device. According to the technical scheme, the placement groups on the object storage device are correctly and effectively managed by using a method of a placement group set with time stamps; when the OSD is started, the placement groups which belong to the OSD are sequentially printed with the time stamps to be inserted into the set; when objects stored on the OSD are required to be treated, the placement groups in the set are sequentially traversed according to a time sequence; one placement group is taken out, is erased from the set after the treatment is completed, and then is printed with a new time stamp to be newly inserted into the set; dynamic insertion or erasing is realized by calling a placement group registration and unregistration method respectively to increase or decrease the placement groups. The placement group set with the time stamps is used to realize the correct and effective management of the placement groups on the object storage device.
Description
Technical field
The present invention relates to a kind of object storage device technical field, the Explore of Unified Management Ideas of the placement group specifically on a kind of object storage device.
Background technology
In order to reduce the integral operation amount of object storage system, improve system performance.In the process setting up mapping relations between storage object and object storage device, introduce a middle layer between storage object and object storage device, be referred to as placement group.Placement group is a logical concept, and the storage object belonging to a placement group will adopt same placement rule, namely be distributed on identical object storage device.
Object storage device (Object-Based Storage Device, OSD) be a smart machine being used for storage object, there are independently storage medium, processor, internal memory and network interface card etc., can manage independently himself safe, store and network service.It has been generally acknowledged that an object storage device is exactly a complete object storage device or storage server.
In the object storage system based on two-stage Hash, Hash and consistance Hash twice hash algorithm is adopted to realize the location of object.Namely for given object, first determined the placement group at place by the Hash result of its object oriented, and then use consistance Hash to determine the OSD at placement group place to placement group.This method can reduce the operand in subject positioning process, particularly when memory node delays machine, only needs the consistance Hash result recalculating placement group can find the OSD at place.
In sum, the storage object in object storage system on OSD belongs to the different placement group on OSD respectively.In units of placement group, the storage object on OSD is processed, the process of object on OSD can be realized efficiently.The efficiency of management of the upper placement group of OSD and correctness, be easy to the partial function of bottleneck, the even influential system becoming system.
Summary of the invention
Technical assignment of the present invention is to provide the Explore of Unified Management Ideas of the placement group on a kind of object storage device; Use the placement group set with timestamp, realize the correct of the placement group on object storage device and effectively manage.
Technical assignment of the present invention realizes in the following manner, the Explore of Unified Management Ideas of the placement group on a kind of object storage device, uses the method with the placement group set of timestamp to realize carrying out correctly effectively managing to the placement group on object storage device; When OSD starts, the placement group belonged on this OSD is stamped timestamp successively and is inserted in set; When needing the object that OSD stores to process, travel through the placement group in set successively according to time sequencing; Take out a placement group, erasing from set after having processed, then stamp new timestamp and reinsert in set; The increase of placement group or minimizing, call placement group registration and unregistration method respectively and realize dynamic insertion or erasing.
Placement group is registered: when OSD initialization or newly-increased placement group, need placement group to be inserted in set according to timestamp; Placement group is nullified: the placement group processed is erasing from set; Placement group iteration: process the placement group in set according to the order of timestamp successively, the placement group processed needs erasing from set, after then stamping new timestamp, reinserts in set.
(1), the code of structure and set is as follows:
struct Flusher{；
Utime_t flush_reg_stamp; // hour of log-on stabs;
}flusher；
The set< pair< time, placement group > > last_flush_pg;
(2), placement group register method, Implementation of pseudocode is as follows:
void reg_last_pg_flush(spg_t pgid, utime_t t) {；
last_flush_pg.insert(pair<utime_t,spg_t>(t, pgid))；
}；
(3), placement group cancellation method, Implementation of pseudocode is as follows:
void unreg_last_pg_flush(spg_t pgid, utime_t t) {；
pair<utime_t,spg_t> p(t, pgid)；
set<pair<utime_t,spg_t> >::iterator it = last_flush_pg.find(p)；
last_flush_pg.erase(it)；
}。
The Explore of Unified Management Ideas of the placement group on a kind of object storage device of the present invention, beneficial effect is: the unified management realizing placement group on object storage device, can realize the process of object on OSD efficiently.
Accompanying drawing explanation
Below in conjunction with accompanying drawing, the present invention is further described.
Accompanying drawing 1 is the placement group traversal schematic diagram of the Explore of Unified Management Ideas of placement group on a kind of object storage device.
Embodiment
Be described in detail below with reference to Figure of description and the Explore of Unified Management Ideas of specific embodiment to the placement group on a kind of object storage device of the present invention.
Embodiment 1:
The Explore of Unified Management Ideas of the placement group on a kind of object storage device of the present invention, uses the method with the placement group set of timestamp to realize carrying out correctly effectively managing to the placement group on object storage device; When OSD starts, the placement group belonged on this OSD is stamped timestamp successively and is inserted in set; When needing the object that OSD stores to process, travel through the placement group in set successively according to time sequencing; Take out a placement group, erasing from set after having processed, then stamp new timestamp and reinsert in set; The increase of placement group or minimizing, call placement group registration and unregistration method respectively and realize dynamic insertion or erasing.
Embodiment 2:
The Explore of Unified Management Ideas of the placement group on a kind of object storage device of the present invention, uses the method with the placement group set of timestamp to realize carrying out correctly effectively managing to the placement group on object storage device; When OSD starts, the placement group belonged on this OSD is stamped timestamp successively and is inserted in set; When needing the object that OSD stores to process, travel through the placement group in set successively according to time sequencing; Take out a placement group, erasing from set after having processed, then stamp new timestamp and reinsert in set; The increase of placement group or minimizing, call placement group registration and unregistration method respectively and realize dynamic insertion or erasing.
Placement group is registered: when OSD initialization or newly-increased placement group, need placement group to be inserted in set according to timestamp; Placement group is nullified: the placement group processed is erasing from set; Placement group iteration: process the placement group in set according to the order of timestamp successively, the placement group processed needs erasing from set, after then stamping new timestamp, reinserts in set.
(1), the code of structure and set is as follows:
struct Flusher{；
Utime_t flush_reg_stamp; // hour of log-on stabs;
}flusher；
The set< pair< time, placement group > > last_flush_pg;
(2), placement group register method, Implementation of pseudocode is as follows:
void reg_last_pg_flush(spg_t pgid, utime_t t) {；
last_flush_pg.insert(pair<utime_t,spg_t>(t, pgid))；
}；
(3), placement group cancellation method, Implementation of pseudocode is as follows:
void unreg_last_pg_flush(spg_t pgid, utime_t t) {；
pair<utime_t,spg_t> p(t, pgid)；
set<pair<utime_t,spg_t> >::iterator it = last_flush_pg.find(p)；
last_flush_pg.erase(it)；
}。
By embodiment above, described those skilled in the art can be easy to realize the present invention.But should be appreciated that the present invention is not limited to above-mentioned embodiment.On the basis of disclosed embodiment, described those skilled in the art can the different technical characteristic of combination in any, thus realizes different technical schemes.
Claims (3)
1. an Explore of Unified Management Ideas for the placement group on object storage device, is characterized in that using the method with the placement group set of timestamp to realize carrying out correctly effectively managing to the placement group on object storage device; When OSD starts, the placement group belonged on this OSD is stamped timestamp successively and is inserted in set; When needing the object that OSD stores to process, travel through the placement group in set successively according to time sequencing; Take out a placement group, erasing from set after having processed, then stamp new timestamp and reinsert in set; The increase of placement group or minimizing, call placement group registration and unregistration method respectively and realize dynamic insertion or erasing.
2. the Explore of Unified Management Ideas of the placement group on a kind of object storage device according to claim 1, is characterized in that placement group is registered: when OSD initialization or newly-increased placement group, needs placement group to be inserted in set according to timestamp; Placement group is nullified: the placement group processed is erasing from set; Placement group iteration: process the placement group in set according to the order of timestamp successively, the placement group processed needs erasing from set, after then stamping new timestamp, reinserts in set.
3. the Explore of Unified Management Ideas of the placement group on a kind of object storage device according to claim 1, it is characterized in that (1), structure and set code as follows:
struct Flusher{；
Utime_t flush_reg_stamp; // hour of log-on stabs;
}flusher；
The set< pair< time, placement group > > last_flush_pg;
(2), placement group register method, Implementation of pseudocode is as follows:
void reg_last_pg_flush(spg_t pgid, utime_t t) {；
last_flush_pg.insert(pair<utime_t,spg_t>(t, pgid))；
}；
(3), placement group cancellation method, Implementation of pseudocode is as follows:
void unreg_last_pg_flush(spg_t pgid, utime_t t) {；
pair<utime_t,spg_t> p(t, pgid)；
set<pair<utime_t,spg_t> >::iterator it = last_flush_pg.find(p)；
last_flush_pg.erase(it)；
}。
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201510109078.1A CN104657089B (en) | 2015-03-13 | 2015-03-13 | A kind of Explore of Unified Management Ideas of placement group on object storage device |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201510109078.1A CN104657089B (en) | 2015-03-13 | 2015-03-13 | A kind of Explore of Unified Management Ideas of placement group on object storage device |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN104657089A true CN104657089A (en) | 2015-05-27 |
| CN104657089B CN104657089B (en) | 2017-09-22 |
Family
ID=53248286
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201510109078.1A Active CN104657089B (en) | 2015-03-13 | 2015-03-13 | A kind of Explore of Unified Management Ideas of placement group on object storage device |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN104657089B (en) |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105553722A (en) * | 2015-12-16 | 2016-05-04 | 深圳市迪菲特科技股份有限公司 | Timestamp-based data exchange method, device and system |
| CN107506491A (en) * | 2017-09-26 | 2017-12-22 | 郑州云海信息技术有限公司 | The osd data distribution method and device of a kind of distributed file system |
| CN112486731A (en) * | 2020-11-03 | 2021-03-12 | 苏州浪潮智能科技有限公司 | Method, device, equipment and product for restoring distribution of placement groups |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102243884A (en) * | 2010-05-12 | 2011-11-16 | 杭州华三通信技术有限公司 | Method for storing streaming media data and apparatus thereof |
| US20120221607A1 (en) * | 2007-09-13 | 2012-08-30 | Google Inc. | Media plan managing |
| CN103905540A (en) * | 2014-03-25 | 2014-07-02 | 浪潮电子信息产业股份有限公司 | Object storage data distribution mechanism based on two-sage Hash |
-
2015
- 2015-03-13 CN CN201510109078.1A patent/CN104657089B/en active Active
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20120221607A1 (en) * | 2007-09-13 | 2012-08-30 | Google Inc. | Media plan managing |
| CN102243884A (en) * | 2010-05-12 | 2011-11-16 | 杭州华三通信技术有限公司 | Method for storing streaming media data and apparatus thereof |
| CN103905540A (en) * | 2014-03-25 | 2014-07-02 | 浪潮电子信息产业股份有限公司 | Object storage data distribution mechanism based on two-sage Hash |
Non-Patent Citations (1)
| Title |
|---|
| 梅玫: "基于两级映射体系的分布式存储子系统的设计与实现", 《中国优秀硕士学位论文全文数据库-信息科技辑》 * |
Cited By (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105553722A (en) * | 2015-12-16 | 2016-05-04 | 深圳市迪菲特科技股份有限公司 | Timestamp-based data exchange method, device and system |
| CN105553722B (en) * | 2015-12-16 | 2019-01-08 | 深圳市迪菲特科技股份有限公司 | A kind of method for interchanging data based on timestamp, apparatus and system |
| CN107506491A (en) * | 2017-09-26 | 2017-12-22 | 郑州云海信息技术有限公司 | The osd data distribution method and device of a kind of distributed file system |
| CN112486731A (en) * | 2020-11-03 | 2021-03-12 | 苏州浪潮智能科技有限公司 | Method, device, equipment and product for restoring distribution of placement groups |
| CN112486731B (en) * | 2020-11-03 | 2023-01-10 | 苏州浪潮智能科技有限公司 | Method, device, equipment and product for restoring distribution of placement groups |
Also Published As
| Publication number | Publication date |
|---|---|
| CN104657089B (en) | 2017-09-22 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| WO2019144553A1 (en) | Data storage method and apparatus, and storage medium | |
| CN108984744B (en) | Non-main chain block self-growing method | |
| CN104657089A (en) | Unified management method of placement groups on object storage device | |
| CN109005226A (en) | The acquisition methods of sensing data, acquisition system and relevant apparatus in server | |
| WO2019085466A1 (en) | Association test method and system, application server, and computer readable storage medium | |
| CN105912601A (en) | Partition storage method for distributed real-time memory database of energy management system | |
| CN108765142B (en) | Electronic device, multi-blockchain integration control method, and computer-readable storage medium | |
| CN109344268A (en) | Method, electronic equipment and the computer readable storage medium of graphic data base write-in | |
| CN114389889A (en) | File full life cycle management method and device based on block chain technology | |
| US20150199217A1 (en) | Entropy resource allocation management in virtualized environments | |
| CN102209016B (en) | Data processing method, device and data processing system | |
| CN109271247A (en) | Memory Optimize Method, device, computer installation and storage medium | |
| CN107704253A (en) | Text color transform method, system and the electronic installation of control | |
| CN104714983B (en) | The generation method and device of distributed index | |
| WO2021189905A1 (en) | Distributed data retrieval method and apparatus, and electronic device and storage medium | |
| CN104516823A (en) | Method and device for storing data | |
| CN109408035B (en) | Flow configuration method, storage medium and server of business system | |
| CN116304079A (en) | Timing-based profile data management method, apparatus, and readable storage medium | |
| CN105515786A (en) | Network card, server and pre-boot test method | |
| CN106547642A (en) | A kind of method and device of data backup memory | |
| CN108958926B (en) | Darwin streaming media server-based virtual memory pool design method | |
| US20180150405A1 (en) | Data type management | |
| CN107786661A (en) | Information synchronization method | |
| US10402391B2 (en) | Processing method, device and system for data of distributed storage system | |
| CN103279501B (en) | In batches to the method and apparatus that adds anti-importing coded lock in swf file |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant | ||
| TR01 | Transfer of patent right |
Effective date of registration: 20180807 Address after: 250100 S06 tower, 1036, Chao Lu Road, hi tech Zone, Ji'nan, Shandong. Patentee after: Shandong wave cloud Mdt InfoTech Ltd Address before: No. 1036, Shun Ya Road, Ji'nan high tech Zone, Shandong Province Patentee before: Inspur Group Co., Ltd. |
|
| TR01 | Transfer of patent right | ||
| CP03 | Change of name, title or address |
Address after: 250100 No. 1036 Tidal Road, Jinan High-tech Zone, Shandong Province, S01 Building, Tidal Science Park Patentee after: Inspur cloud Information Technology Co., Ltd Address before: 250100 Ji'nan science and technology zone, Shandong high tide Road, No. 1036 wave of science and Technology Park, building S06 Patentee before: SHANDONG LANGCHAO YUNTOU INFORMATION TECHNOLOGY Co.,Ltd. |
|
| CP03 | Change of name, title or address |