CN105389123A - Storage management method and system based on dual controllers - Google Patents
Storage management method and system based on dual controllers Download PDFInfo
- Publication number
- CN105389123A CN105389123A CN201510673430.4A CN201510673430A CN105389123A CN 105389123 A CN105389123 A CN 105389123A CN 201510673430 A CN201510673430 A CN 201510673430A CN 105389123 A CN105389123 A CN 105389123A
- Authority
- CN
- China
- Prior art keywords
- data
- controller
- master controller
- module
- cache
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
- G06F3/0601—Interfaces specially adapted for storage systems
- G06F3/0602—Interfaces specially adapted for storage systems specifically adapted to achieve a particular effect
- G06F3/0614—Improving the reliability of storage systems
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
- G06F3/0601—Interfaces specially adapted for storage systems
- G06F3/0628—Interfaces specially adapted for storage systems making use of a particular technique
- G06F3/0655—Vertical data movement, i.e. input-output transfer; data movement between one or more hosts and one or more storage devices
- G06F3/0656—Data buffering arrangements
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
- G06F3/0601—Interfaces specially adapted for storage systems
- G06F3/0668—Interfaces specially adapted for storage systems adopting a particular infrastructure
- G06F3/0671—In-line storage system
- G06F3/0673—Single storage device
- G06F3/0674—Disk device
- G06F3/0676—Magnetic disk device
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Memory System Of A Hierarchy Structure (AREA)
- Hardware Redundancy (AREA)
Abstract
The invention provides a storage management method and system based on dual controllers. The method comprises the following steps: an instruction analysis module in a master controller analyzes a received service request, the type of the service request is determined, and the type of the service request is sent to a caching module in the master controller; and the caching module in the master controller determines a corresponding data processing strategy according to the type of the service request to realize the synchronization of cached data among multiple controllers and improve the reliability of a multi-controller storage system.
Description
Technical field
The invention belongs to network storage field, particularly relate to a kind of memory management method based on dual controller and system.
Background technology
Prior art discloses a kind of buffer memory management method of dual control storage server, in ISCSI network storage server framework, cache management is carried out to dual control storage server, one piece of continuous space is marked off as independent cache module from the internal memory of linux system management, independent cache module is evenly divided into multiple cache blocks, physical disk is evenly divided into multiple disk logical block, a cache blocks can map the data of any one disk logical block, by cache blocks flag state, double-linked circular list is used to manage free buffer block respectively and use cache blocks.
Although such scheme discloses arrange independent cache module in dual control storage server, how not realize synchronously data cached between announcement dual control storage server.
Summary of the invention
The invention provides a kind of memory management method based on dual controller and system, to solve the problem.
The invention provides a kind of memory management method based on dual controller.Said method comprises the following steps:
Command analysis module in master controller is resolved the services request received, and determines service request type and described service request type is sent to the cache module in described master controller;
Cache module in described master controller, according to described service request type, determines corresponding data processing policy.
The present invention also provides a kind of storage management system based on dual controller, comprise application server, master controller, from controller; Wherein, described application server, described master controller, to be describedly interconnected between two from controller;
Described application server, for sending services request to master controller;
Command analysis module in master controller, for resolving the services request received, determining service request type and described service request type being sent to the cache module in master controller;
Cache module in master controller, for sending data synchronization request by the cache synchronization module in master controller to from the cache synchronization module in controller;
From the cache synchronization module controller, for according to the flag sign information of carrying in data synchronization request, by data write from the cache module controller.
By following scheme: the command analysis module in master controller is resolved the services request received, and determines service request type and described service request type is sent to the cache module in described master controller; Cache module in described master controller, according to described service request type, is determined corresponding data processing policy, is achieved between multi-controller synchronously data cached, improve storage system with multiple controllers reliability.
By following scheme: if described service request type is write data requests, then the cache module in described master controller sends data synchronization request by the cache synchronization module in described master controller to from the cache synchronization module in controller; Described from the cache synchronization module controller according to the flag sign information of carrying in data synchronization request, by described for data write from the cache module controller, avoid the problem of loss of data that single-point controller failure causes and service disruption, achieve between multi-controller synchronously data cached, improve storage system with multiple controllers reliability.
By following scheme: when described service request type is write data requests, cache module then in described master controller judge further write data type and according to data type information, determine corresponding data processing policy, achieve the synchronous processing scheme of carrying out differentiation according to data type, while the security of guarantee significant data, save system resource.
Accompanying drawing explanation
Accompanying drawing described herein is used to provide a further understanding of the present invention, and form a application's part, schematic description and description of the present invention, for explaining the present invention, does not form inappropriate limitation of the present invention.In the accompanying drawings:
Figure 1 shows that the memory management method processing flow chart based on dual controller of the embodiment of the present invention 1;
Figure 2 shows that the storage management system structural drawing based on dual controller of the embodiment of the present invention 2.
Embodiment
Hereinafter also describe the present invention in detail with reference to accompanying drawing in conjunction with the embodiments.It should be noted that, when not conflicting, the embodiment in the application and the feature in embodiment can combine mutually.
Figure 1 shows that the memory management method processing flow chart based on dual controller of the embodiment of the present invention 1, comprise the following steps:
Step 101: the command analysis module in master controller is resolved the services request received, and determines service request type and described service request type is sent to the cache module in described master controller;
Further, the command analysis module in master controller also comprises: application server sends services request to master controller before resolving the services request received.
Further, described service request type comprises: write data requests, read data request.
Further, the command analysis module in master controller is resolved the services request received, and determines service request type and before described service request type is sent to the cache module in described master controller, also comprises:
In advance at master controller, cache module, cache synchronization module, fault detection module are set respectively from controller.
Step 102: the cache module in described master controller, according to described service request type, determines corresponding data processing policy.
Further, the cache module in described master controller, according to described service request type, determines that the process of corresponding data processing policy is:
If described service request type is write data requests, then the cache module in described master controller sends data synchronization request by the cache synchronization module in described master controller to from the cache synchronization module in controller;
Described from the cache synchronization module controller according to the flag sign information of carrying in data synchronization request, by described from the cache module controller for data write.
Further, described flag sign information comprises renewal flag information, substitution indicia information, write-back flag information, zone bit lastest imformation.
Further, described from the cache synchronization module controller according to the flag sign information of carrying in data synchronization request, by described for data write after the cache module controller, also comprise:
Described from controller to the synchronous success response of described master controller return data, wherein, in described data syn-chronization success response, carry data syn-chronization complement mark.
Further, described from controller to described master controller return data sync response after, also comprise: described master controller is to the synchronous success response of application server feedback data.
Further, if the fault detection module in master controller judges that master controller breaks down, then switch to from controller and from controller, the data cache module transferred to disk management equipment by described.
Further, the cache module in described master controller, according to described service request type, determines that the process of corresponding data processing policy is:
When described service request type is write data requests, then the cache module in described master controller judges the data type of write further and according to data type information, determines corresponding data processing policy.
Further, the data type of said write comprises system configuration data, video monitoring data, web page access record data.
In the specific implementation, the data type of write can also comprise the data of other type, such as: memory management data, is not used at this protection domain limiting the present embodiment.
Further, when described service request type is write data requests, then the cache module in described master controller judges the data type of write further and according to data type information, determines that the process of corresponding data processing policy is:
If the data type of write is system configuration data or video monitoring data, then the cache module in described master controller sends data synchronization request by the cache synchronization module in described master controller to from the cache synchronization module in controller;
Described from the cache synchronization module controller according to the flag sign information of carrying in data synchronization request, by described from the cache module controller for data write.
Further, when described service request type is write data requests, then the cache module in described master controller judges the data type of write further and according to data type information, determines that the process of corresponding data processing policy is:
If the data type of write is web page access record data, then after the cache module in described master controller stores described web page access record data, no longer initiate data synchronization request to described from controller.
Figure 2 shows that the storage management system structural drawing based on dual controller of the embodiment of the present invention 2, comprise application server, master controller, from controller; Wherein, described application server, described master controller, to be describedly interconnected between two from controller;
Described application server, for sending services request to master controller;
Command analysis module in master controller, for resolving the services request received, determining service request type and described service request type being sent to the cache module in master controller;
Cache module in master controller, for sending data synchronization request by the cache synchronization module in master controller to from the cache synchronization module in controller;
From the cache synchronization module controller, for according to the flag sign information of carrying in data synchronization request, by data write from the cache module controller.
By following scheme: the command analysis module in master controller is resolved the services request received, and determines service request type and described service request type is sent to the cache module in described master controller; Cache module in described master controller, according to described service request type, is determined corresponding data processing policy, is achieved between multi-controller synchronously data cached, improve storage system with multiple controllers reliability.
By following scheme: if described service request type is write data requests, then the cache module in described master controller sends data synchronization request by the cache synchronization module in described master controller to from the cache synchronization module in controller; Described from the cache synchronization module controller according to the flag sign information of carrying in data synchronization request, by described for data write from the cache module controller, avoid the problem of loss of data that single-point controller failure causes and service disruption, achieve between multi-controller synchronously data cached, improve storage system with multiple controllers reliability.
By following scheme: when described service request type is write data requests, cache module then in described master controller judge further write data type and according to data type information, determine corresponding data processing policy, achieve the synchronous processing scheme of carrying out differentiation according to data type, while the security of guarantee significant data, save system resource.
The foregoing is only the preferred embodiments of the present invention, be not limited to the present invention, for a person skilled in the art, the present invention can have various modifications and variations.Within the spirit and principles in the present invention all, any amendment done, equivalent replacement, improvement etc., all should be included within protection scope of the present invention.
Claims (10)
1. based on a memory management method for dual controller, it is characterized in that, comprise the following steps:
Command analysis module in master controller is resolved the services request received, and determines service request type and described service request type is sent to the cache module in described master controller;
Cache module in described master controller, according to described service request type, determines corresponding data processing policy.
2. method according to claim 1, is characterized in that, described service request type comprises: write data requests, read data request.
3. method according to claim 1, it is characterized in that, command analysis module in master controller is resolved the services request received, and determines service request type and before described service request type is sent to the cache module in described master controller, also comprises:
In advance at master controller, cache module, cache synchronization module, fault detection module are set respectively from controller.
4. method according to claim 1, is characterized in that, the cache module in described master controller, according to described service request type, determines that the process of corresponding data processing policy is:
If described service request type is write data requests, then the cache module in described master controller sends data synchronization request by the cache synchronization module in described master controller to from the cache synchronization module in controller;
Described from the cache synchronization module controller according to the flag sign information of carrying in data synchronization request, by described from the cache module controller for data write.
5. method according to claim 4, is characterized in that, described flag sign information comprises renewal flag information, substitution indicia information, write-back flag information, zone bit lastest imformation.
6. method according to claim 4, is characterized in that, described from the cache synchronization module controller according to the flag sign information of carrying in data synchronization request, by described for data write after the cache module controller, also comprise:
Described from controller to the synchronous success response of described master controller return data, wherein, in described data syn-chronization success response, carry data syn-chronization complement mark;
Described master controller is to the synchronous success response of application server feedback data.
7. method according to claim 1, is characterized in that, the cache module in described master controller, according to described service request type, determines that the process of corresponding data processing policy is:
When described service request type is write data requests, then the cache module in described master controller judges the data type of write further and according to data type information, determines corresponding data processing policy.
8. method according to claim 7, is characterized in that, the data type of said write comprises system configuration data, video monitoring data, web page access record data.
9. method according to claim 7, it is characterized in that, if the data type of write is system configuration data or video monitoring data, then the cache module in described master controller sends data synchronization request by the cache synchronization module in described master controller to from the cache synchronization module in controller;
Described from the cache synchronization module controller according to the flag sign information of carrying in data synchronization request, by described from the cache module controller for data write.
10., based on a storage management system for dual controller, it is characterized in that, comprise application server, master controller, from controller; Wherein, described application server, described master controller, to be describedly interconnected between two from controller;
Described application server, for sending services request to master controller;
Command analysis module in master controller, for resolving the services request received, determining service request type and described service request type being sent to the cache module in master controller;
Cache module in master controller, for sending data synchronization request by the cache synchronization module in master controller to from the cache synchronization module in controller;
From the cache synchronization module controller, for according to the flag sign information of carrying in data synchronization request, by data write from the cache module controller.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201510673430.4A CN105389123A (en) | 2015-10-16 | 2015-10-16 | Storage management method and system based on dual controllers |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201510673430.4A CN105389123A (en) | 2015-10-16 | 2015-10-16 | Storage management method and system based on dual controllers |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN105389123A true CN105389123A (en) | 2016-03-09 |
Family
ID=55421442
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201510673430.4A Pending CN105389123A (en) | 2015-10-16 | 2015-10-16 | Storage management method and system based on dual controllers |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN105389123A (en) |
Cited By (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106528447A (en) * | 2016-10-25 | 2017-03-22 | 郑州云海信息技术有限公司 | Cache synchronization method for distributed SAN (Storage Area Network) |
| CN106874151A (en) * | 2017-01-23 | 2017-06-20 | 郑州云海信息技术有限公司 | A kind of method and device of synchronization caching |
| CN110618785A (en) * | 2018-12-24 | 2019-12-27 | 深圳创新科软件技术有限公司 | Dual-control storage system |
| WO2021109432A1 (en) * | 2019-12-06 | 2021-06-10 | 苏州浪潮智能科技有限公司 | Data transmission method, apparatus, and device, and storage medium |
| CN113472891A (en) * | 2021-07-15 | 2021-10-01 | 浪潮思科网络科技有限公司 | SDN controller cluster data processing method, device and medium |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101316221A (en) * | 2007-05-30 | 2008-12-03 | 深圳华为通信技术有限公司 | Notification message processing method and equipment |
| CN101840309A (en) * | 2009-10-28 | 2010-09-22 | 创新科存储技术有限公司 | Access control method and system of double control disk array in multipath environment |
| CN103488435A (en) * | 2013-09-24 | 2014-01-01 | 华为技术有限公司 | RAID (redundant arrays of independent disks) subsystem and data read-write method thereof |
| CN103870977A (en) * | 2012-12-18 | 2014-06-18 | 风网科技（北京）有限公司 | Method and system thereof for data synchronizing of mobile advertising platform |
| CN104881368A (en) * | 2015-05-07 | 2015-09-02 | 北京飞杰信息技术有限公司 | Cache synchronization method and system applied to double control storage system |
-
2015
- 2015-10-16 CN CN201510673430.4A patent/CN105389123A/en active Pending
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101316221A (en) * | 2007-05-30 | 2008-12-03 | 深圳华为通信技术有限公司 | Notification message processing method and equipment |
| CN101840309A (en) * | 2009-10-28 | 2010-09-22 | 创新科存储技术有限公司 | Access control method and system of double control disk array in multipath environment |
| CN103870977A (en) * | 2012-12-18 | 2014-06-18 | 风网科技（北京）有限公司 | Method and system thereof for data synchronizing of mobile advertising platform |
| CN103488435A (en) * | 2013-09-24 | 2014-01-01 | 华为技术有限公司 | RAID (redundant arrays of independent disks) subsystem and data read-write method thereof |
| CN104881368A (en) * | 2015-05-07 | 2015-09-02 | 北京飞杰信息技术有限公司 | Cache synchronization method and system applied to double control storage system |
Non-Patent Citations (2)
| Title |
|---|
| 吴昌松: "ISCSI双控制器存储系统缓存设计与实现", 《万方数据》 * |
| 程燕等: "Unix/Linux 系统自动化管理: 数据备份与同步篇", 《IBM中国官网》 * |
Cited By (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106528447A (en) * | 2016-10-25 | 2017-03-22 | 郑州云海信息技术有限公司 | Cache synchronization method for distributed SAN (Storage Area Network) |
| CN106874151A (en) * | 2017-01-23 | 2017-06-20 | 郑州云海信息技术有限公司 | A kind of method and device of synchronization caching |
| CN110618785A (en) * | 2018-12-24 | 2019-12-27 | 深圳创新科软件技术有限公司 | Dual-control storage system |
| WO2021109432A1 (en) * | 2019-12-06 | 2021-06-10 | 苏州浪潮智能科技有限公司 | Data transmission method, apparatus, and device, and storage medium |
| CN113472891A (en) * | 2021-07-15 | 2021-10-01 | 浪潮思科网络科技有限公司 | SDN controller cluster data processing method, device and medium |
| CN113472891B (en) * | 2021-07-15 | 2024-04-26 | 浪潮思科网络科技有限公司 | SDN controller cluster data processing method, equipment and medium |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN105389123A (en) | Storage management method and system based on dual controllers | |
| EP3620905B1 (en) | Method and device for identifying osd sub-health, and data storage system | |
| CN202798798U (en) | High availability system based on cloud computing technology | |
| CN104881333B (en) | A kind of storage system and its method used | |
| US9864527B1 (en) | Distributed data storage management | |
| US9342411B2 (en) | Reducing memory overhead of highly available, distributed, in-memory key-value caches | |
| US10776285B2 (en) | Data write method, apparatus, and system | |
| EP2733617A1 (en) | Data buffer device, data storage system and method | |
| US9043560B2 (en) | Distributed cache coherency protocol | |
| CN102611745B (en) | On-line file moving method, device and system | |
| US10534776B2 (en) | Proximity grids for an in-memory data grid | |
| EP2902922B1 (en) | Distributed file system and data backup method for distributed file system | |
| CN106133676A (en) | Storage system | |
| CN102521038A (en) | Virtual machine migration method and device based on distributed file system | |
| CN104111804A (en) | Distributed file system | |
| CN105306605B (en) | A kind of double host server systems | |
| US20160132410A1 (en) | Kernel state and user state data exchange method for disaster recovery of virtual container system | |
| CN106919473A (en) | A kind of data disaster recovery and backup systems and method for processing business | |
| CN105338078A (en) | Data storage method and device used for storing system | |
| CN105554074A (en) | NAS resource monitoring system and monitoring method based on RPC communication | |
| CN104468521A (en) | Online migration method, device and system | |
| US10452619B1 (en) | Decreasing a site cache capacity in a distributed file system | |
| CN112346647B (en) | Data storage method, device, equipment and medium | |
| CN105404565B (en) | A kind of dual-active data guard method and device | |
| CN111049886B (en) | Multi-region SDN controller data synchronization method, server and system |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| WD01 | Invention patent application deemed withdrawn after publication | ||
| WD01 | Invention patent application deemed withdrawn after publication |
Application publication date: 20160309 |