TW201433124A - Cloud group type data center dynamic storage allocation system and method - Google Patents

Cloud group type data center dynamic storage allocation system and method Download PDF

Info

Publication number
TW201433124A
TW201433124A TW102103882A TW102103882A TW201433124A TW 201433124 A TW201433124 A TW 201433124A TW 102103882 A TW102103882 A TW 102103882A TW 102103882 A TW102103882 A TW 102103882A TW 201433124 A TW201433124 A TW 201433124A
Authority
TW
Taiwan
Prior art keywords
storage
data
site
subsystem
room
Prior art date
Application number
TW102103882A
Other languages
Chinese (zh)
Other versions
TWI493933B (en
Inventor
Yi Xiao
jing-li Liu
xin-yi Xu
Wei-Ting Lin
xiang-ming Chen
Original Assignee
Chunghwa Telecom Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Chunghwa Telecom Co Ltd filed Critical Chunghwa Telecom Co Ltd
Priority to TW102103882A priority Critical patent/TWI493933B/en
Publication of TW201433124A publication Critical patent/TW201433124A/en
Application granted granted Critical
Publication of TWI493933B publication Critical patent/TWI493933B/en

Links

Landscapes

  • Information Retrieval, Db Structures And Fs Structures Therefor (AREA)

Abstract

The present invention provides a cloud group type data center dynamic storage allocation system and method, in which the storages of the cloud data center are configured and managed in a manner of grouping. The method makes use of (1) a 2U/4U standard storage server subsystem, (2) a 42U/35U standard storage rack subsystem, (3) a single site distributed storage rack subsystem, (4) a multipoint group type storage site subsystem, and (5) a cloud group type data center dynamic storage allocation management subsystem or the like architecture to proceed with integrated arrangement and scheduling management, so as to achieve the purposes of automated intelligent storage configuration and data backup.

Description

雲端群組式數據機房動態儲存配置系統及方法 Cloud group data room dynamic storage configuration system and method

本發明屬於一種雲端群組式數據機房中動態儲存配置系統及方法,係將雲端數據機房(Cloud Data Center)中之儲存體以群組式方式來進行配置與管理,來達到儲存體智慧型配置自動化與資料備援的目的。 The invention belongs to a dynamic storage configuration system and method in a cloud group data room, which configures and manages a storage body in a cloud data center in a group manner to achieve a smart configuration of a storage body. The purpose of automation and data backup.

動態資源調度和管理為雲端數據機房資源控管之目標,目前已有提及到關於failover之做法,其資料中心系統包括多個資料中心,每個資料中心包括一電腦和一儲存系統,每個電腦包含一個記憶體區域,用於儲存有關電腦間的運作優先權順序之資訊,以及另一個記憶體區域,用於儲存群集服務程式,當一電腦出現故障時,群集服務程式依據運作優先權順序資訊,從其餘電腦中,選擇一電腦接手故障電腦之工作,但其並未提及到儲存體資源調度做法,對於欲提供雲端服務之電信營運商而言,此做法明顯不足。本發明所提一種雲端群組式數據機房動態儲存配置系統及方法,可動態將機房儲存體群組化以服務特定應用需求,除可充分利用機房之既有儲存體資源,也可達到相互備援目的。 Dynamic resource scheduling and management is the goal of cloud data room resource control. At present, there is a reference to failover. The data center system includes multiple data centers. Each data center includes a computer and a storage system. The computer contains a memory area for storing information about the priority order of operations between computers, and another memory area for storing the cluster service program. When a computer fails, the cluster service program is based on the operational priority order. Information, from the rest of the computer, choose a computer to take over the work of the faulty computer, but it does not mention the storage resource scheduling practices, which is obviously insufficient for the telecom operators who want to provide cloud services. The cloud group-type data room dynamic storage configuration system and method can dynamically group the computer room storage groups to serve specific application requirements, in addition to fully utilizing the existing storage resources of the equipment room, and can also achieve mutual preparation. Aid.

於現在既有之技術中所提及之方法和系統中,其可針對單一機房內之虛擬資源進行供裝,不足處在於先前技術其只能局限在單一機房內進行資源管控,對於欲提供分散式之雲端服務在資源調度管控上,此做法明顯不足。本發明所提一種雲端群組式數據機房動態儲存配置系統及方法,可將分散各地之機房儲存體資源統一調度、集中管理,動態以服務特定儲存需 求將機房群組化,具備儲存系統資源調度之靈活性且可大幅降低儲存設備支出之功效。 In the methods and systems mentioned in the existing technology, it can be supplied for virtual resources in a single computer room. The disadvantage is that the prior art can only be limited to resource management and control in a single computer room, and is intended to provide dispersion. The cloud service of the type is obviously insufficient in the management of resource scheduling. The invention provides a cloud group-type data room dynamic storage configuration system and method, which can uniformly allocate and centrally manage the storage room resources of the distributed computer rooms, and dynamically serve specific storage needs. The grouping of the equipment room is required, and the flexibility of the storage system resource scheduling can be greatly reduced and the storage equipment expenditure can be greatly reduced.

本案發明人鑑於前述系統和方法之不足之處,乃亟思創新發明,並經長時間苦心孤詣潛心研究後,終於成功研發完成本件雲端群組式數據機房動態儲存配置系統及方法。 In view of the inadequacies of the foregoing systems and methods, the inventor of the present invention has invented and invented the invention, and after a long period of painstaking research, finally successfully developed and completed the dynamic storage configuration system and method of the cloud group-type data room.

本發明為一種雲端群組式數據機房中動態儲存配置系統及方法,係將雲端數據機房(Cloud Data Center)中之儲存體以群組式方式來進行配置與管理,來達到儲存體智慧型配置自動化與資料備援目的。 The invention relates to a dynamic storage configuration system and method in a cloud group data room, which is configured and managed in a group manner by a storage body in a cloud data center (Cloud Data Center) to achieve a smart configuration of a storage body. Automation and data backup purposes.

所謂雲端群組式機房動態儲存系統意指可將分散各地之機房儲存體資源統一調度、集中管理,可動態將機房儲存體群組化以服務特定應用需求,除可充分利用機房之既有儲存體資源,也可達到相互備援目的。而傳統數據機房之儲存系統皆屬獨立運作且擴充性較差,各機房儲存系統較分散且無法作群組化運作,並無法提供分散式、自動化的資源調度利用,因而無法有效節省儲存設備資本支出。相較於傳統數據機房,本發明具備儲存系統資源調度之靈活性且可大幅降低儲存設備支出之功效。 The so-called cloud group-type machine room dynamic storage system means that the storage resources of the distributed computer room can be uniformly scheduled and centralizedly managed, and the computer room storage group can be dynamically grouped to serve specific application requirements, in addition to fully utilizing the existing storage of the machine room. Physical resources can also achieve mutual assistance. The storage systems of traditional data rooms are independent and have poor expansion. The storage systems of the computer rooms are scattered and cannot be grouped, and they cannot provide decentralized and automated resource scheduling and utilization, thus failing to effectively save capital expenditure on storage devices. . Compared with the traditional data room, the invention has the flexibility of storage system resource scheduling and can greatly reduce the effect of storage device expenditure.

本發明運用雲端群組式數據機房動態儲存配置管理子系統,能夠將全區之儲存體予以有效整合,並將自動化配置之功能導入,整合成一個雲端群組式數據機房動態儲存服務系統,具儲存系統自動、最佳調度配置及跨多點Site之特性。本發明所提出的雲端群組式數據機房動態儲存配置系統及方法可精簡數據機房的儲存系統建置與管理維運成本。 The invention utilizes the cloud group type data room dynamic storage configuration management subsystem, can effectively integrate the storage bodies in the whole area, and introduces the functions of the automatic configuration into a cloud group type data room dynamic storage service system, Automatic storage system, optimal scheduling configuration and features across multiple sites. The cloud group data room dynamic storage configuration system and method proposed by the invention can simplify the storage system construction and management maintenance cost of the data room.

一種雲端群組式數據機房動態儲存配置系統及方法,係將雲端數據機房(Cloud Data Center)中之儲存體以群組式方式來進行配置與管理,並利用(1)2U/4U標準storage server子系統,(2)42U/35U標準storage rack子系統,(3)單一Site分散式storage rack子系統,(4)多點群組式storage site子系統,(5)雲端群組式數據機房動態儲存配置管理子系統等架構進行整合配置與調度管理,來達到儲存體智慧型配置自動化與資料備援的目的。 A cloud group-type data room dynamic storage configuration system and method, which configures and manages a storage body in a cloud data center in a group mode, and utilizes (1) 2U/4U standard storage server Subsystem, (2) 42U/35U standard storage rack subsystem, (3) single Site distributed storage rack subsystem, (4) multi-point group storage site subsystem, (5) cloud group data room dynamics Store configuration management subsystem and other architectures for integrated configuration and scheduling management to achieve storage intelligent configuration automation and data backup.

本發明之虛擬儲存系統具備儲存服務和資料的高可靠性、線上容量的擴展性、支援多資料副本(1份以上)、以及快取資料(Cache Data)本地存取等功能。雲端群組式數據機房儲存系統服務具有動態儲存配置機制,讓使用者能夠根據SLA模式進行動態配置,可基於各地Site機房儲存系統的即時使用情況,包括頻寬、剩餘儲存空間、電力等,按照本發明之全自動跨區智慧儲存型存取策略之動態配置用戶資料的實際儲存位置,以平衡儲存系統的資源。AP(Application Program)經常存取的資料配置於local site就近位置(採雙Active模式),備份的資料則配置於remote site。此虛擬儲存系統可支援多路徑傳輸檔案模式,使用者可從多個群組式storage site子系統同時獲得資料,以提高儲存系統整體效率。雲端群組式數據機房動態儲存配置管理子系統可以設定資料保護參數,動態調整指定儲存資料的安全性、可靠性和儲存之經濟性。動態儲存配置管理子系統也提供QoS分級的控制介面,供不同區域的客戶使用,動態配置虛擬儲存空間,也可向用戶提供一個的控制介面(GUI),觀察該客戶的儲存資料目前的使用情況。 The virtual storage system of the present invention has high reliability of storage services and data, scalability of online capacity, support for multiple data copies (one or more), and Cache Data local access. The cloud group-type data room storage system service has a dynamic storage configuration mechanism, which enables users to dynamically configure according to the SLA mode, and can be based on the instant use situation of the local site storage system, including bandwidth, remaining storage space, power, etc. The fully automatic cross-region intelligent storage access strategy of the present invention dynamically configures the actual storage location of the user data to balance the resources of the storage system. The data frequently accessed by the AP (Application Program) is placed in the local location (in dual active mode), and the backed up data is configured on the remote site. The virtual storage system can support the multi-path transmission file mode, and users can obtain data from multiple group storage site subsystems simultaneously to improve the overall efficiency of the storage system. The cloud group data room dynamic storage configuration management subsystem can set data protection parameters and dynamically adjust the security, reliability and storage economy of the specified storage data. The Dynamic Storage Configuration Management Subsystem also provides a QoS-leveled control interface for customers in different regions to dynamically configure virtual storage space. It can also provide users with a control interface (GUI) to observe the current usage of the customer's stored data. .

本發明之雲端群組式數據機房動態儲存配置管理子系統,其動態儲存配置管理方法,至少包括下列步驟:主要係執行用戶需求儲存系統服務分 類之步驟,依據用戶SLA分類及判別用戶儲存系統服務類別;依據用戶SLA分類提供以最佳儲存機房配置與服務指派之步驟,用以提供各自儲存服務所需資源之最佳配置與地點(如local雙Active機房、Active-Standby機房);主要提供機房儲存資源管理調度之步驟,利用全自動跨區智慧儲存型存取策略之動態配置用戶資料之設計演算法,用以負責群組化之分散式機房儲存資源的管理與調度;藉由各步驟之協調運作,達到機房儲存服務作業流程管理自動化的目的。 The dynamic group configuration management subsystem of the cloud group data room of the present invention, the dynamic storage configuration management method thereof, comprises at least the following steps: mainly performing user demand storage system service points The steps of classifying and classifying the user storage system service categories according to the user SLA; providing the optimal storage room configuration and service assignment steps according to the user SLA classification, to provide the optimal configuration and location of the resources required for the respective storage services (eg, Local dual Active room, Active-Standby room; mainly provides the steps of the storage resource management scheduling of the computer room, and uses the automatic cross-region intelligent storage access policy to dynamically configure the user data design algorithm to be responsible for grouping. Management and scheduling of storage resources in the computer room; through the coordinated operation of each step, the purpose of automation of the operation management of the storage service of the computer room is achieved.

本發明之全自動跨區智慧儲存型存取策略之動態配置用戶資料之設計演算法,是先將用戶帳號分類成不同的area code與site code,再利用智慧型存取模式,在分析系統/網路使用現狀下,計算出最佳之儲存地點進行存取。 The design algorithm of the dynamic configuration user data of the automatic cross-region intelligent storage type access strategy of the present invention first classifies the user account into different area code and site code, and then utilizes the intelligent access mode in the analysis system/ Under the current situation of network usage, calculate the best storage location for access.

根據上述,本發明可歸納如下:一種雲端群組式數據機房動態儲存配置系統,至少包括:一單一Site分散式儲存機櫃(storage rack)子系統,為Cluster DFS(Distributed File System:分散式檔案系統)之軟體系統,不綁定storage rack或storage server子系統,在單一Site內以多個storage rack子系統提供單點動態儲存服務,無縫地連接多個storage rack子系統資源,建構成一個單點local的虛擬的儲存池(Storage Pool);一多點群組式儲存機房(storage site)子系統,係將多個單一Site分散式storage rack子系統建構成一個整體的多點群組式storage site子系統,可以解決tier4/tier3機房和tier2機房儲存服務系統發展的不平衡,以及整合全國性網路的機房(Site)電力資源和儲存系統資源;以及一雲端群組式數據機房動態儲存配置管理子系統,能將全區多點群組式storage site子 系統資源連接起來,建構成一個集中儲存配置管理的虛擬儲存系統;其中,藉由該多點群組式storage site子系統配合該雲端群組式數據機房動態儲存配置管理子系統能支援跨區(2點storage site以上)形成全區整合的儲存配置管理,若近台(local site:本地機房)系統提供之虛擬機(Virtual Machine,VM)服務發生問題時,該雲端群組式數據機房動態儲存配置管理子系統可支援虛擬機從近台另一虛擬機映像檔(VM Image)啟動,若整個近台系統與網路連線發生問題時,本系統可支援遠端機房儲存系統(remote site storage)中之虛擬機映像檔,使之重新啟動,故不會有近台與網路間單一故障(Single Failure)的發生,且能夠將全區之儲存體予以有效整合,並將全自動跨區智慧儲存型存取策略功能導入,整合成該雲端群組式數據機房動態儲存配置系統,具儲存系統全自動、最佳調度配置及跨多點Site之特性,來達到儲存體智慧型配置自動化與資料備援之目的。 According to the above, the present invention can be summarized as follows: A cloud grouped data room dynamic storage configuration system includes at least: a single site distributed storage rack subsystem, which is a Cluster DFS (Distributed File System: Distributed File System). Software system, without the storage rack or storage server subsystem, provides a single point dynamic storage service with multiple storage rack subsystems in a single site, seamlessly connects multiple storage rack subsystem resources, and constructs a single Point local virtual storage pool (Storage Pool); a multi-point group storage storage room (storage site) subsystem, is to build multiple single site distributed storage rack subsystem to form a whole multi-point group storage The site subsystem can solve the imbalance of the development of storage service systems in the tier4/tier3 equipment room and the tier2 equipment room, as well as the power resources and storage system resources of the nationwide network (Site); and the dynamic storage configuration of a cloud group data room. Management subsystem, can be a multi-point group storage site The system resources are connected to form a virtual storage system for centralized storage configuration management; wherein the multi-point group storage site subsystem cooperates with the cloud group data room dynamic storage configuration management subsystem to support the span ( 2 points storage site above) to form a centralized storage configuration management. If there is a problem with the virtual machine (VM) service provided by the local site (local machine room) system, the cloud group data room dynamic storage The configuration management subsystem can support the virtual machine to boot from another virtual machine image (VM Image). If the whole system has problems with the network connection, the system can support the remote site storage system (remote site storage). The virtual machine image file in the system is restarted, so there will be no single failure between the network and the network, and the storage of the entire area can be effectively integrated, and the automatic cross-region will be The intelligent storage access policy function is imported into the cloud group-type data room dynamic storage configuration system, with automatic storage system, optimal scheduling configuration and cross-multiple Point to the characteristics of the site to achieve the purpose of intelligent storage configuration and data backup.

在本發明中,其中該storage rack子系統,為動態儲存之storage rack系統,係以標準機箱(Rack)內建標準storage server子系統與交換器,對外提供雲端儲存服務。 In the present invention, the storage rack subsystem is a storage rack system for dynamic storage, and the standard storage cabinet (Rack) has a built-in standard storage server subsystem and a switch to provide a cloud storage service.

在本發明中,其中該storage server子系統,為動態儲存系統,係以標準伺服器及內置硬碟為儲存體建置之最小基本單元,對外提供雲端儲存服務。 In the present invention, the storage server subsystem is a dynamic storage system, which is a minimum basic unit built by a standard server and a built-in hard disk as a storage medium, and provides a cloud storage service to the outside.

在本發明中,其中該單一Site分散式storage rack子系統,包含負載平衡器、資料快取伺服器及架設於多個機櫃當中的各儲存節點之分散式儲存系統三個部分,其中該負載平衡器係負責根據伺服器連線狀況,了解其負載狀況,並且依據網路封包內埠號(Port Number)判斷並配合位址轉換(NAT) 功能,加以分析並將連線分配至該資料快取伺服器進行第一層快取資料處理;如果快取資料未命中,則再透過該負載平衡器將資料的請求即時分配到應用程式伺服器進行資料處理,並且將資料儲存或寫入至該分散式儲存系統。 In the present invention, the single Site distributed storage rack subsystem includes a load balancer, a data cache server, and a distributed storage system of each storage node installed in a plurality of cabinets, wherein the load balancing The device is responsible for understanding the load status based on the server connection status, and judging and matching the address translation (NAT) according to the port number in the network packet. Function, analyze and distribute the connection to the data cache server for the first layer of cache data processing; if the cache data is missing, then the data balance request is instantly distributed to the application server through the load balancer Data processing is performed and data is stored or written to the decentralized storage system.

在本發明中,其中該分散式儲存系統係由中介資料(Metadata)伺服器群模組、系統監控模組以及數據儲存伺服器群模組所組成,其中該Metadata伺服器群模組主要係由至少三台之伺服器所組成,能夠管理整體儲存系統空間,將文件名稱轉換為Metadata數據,執行高層次的POSIX(Portable Operating System Interface:可移植作業系統介面)功能;該系統監控模組主要係由至少三台之伺服器所組成,能夠監控整體儲存系統,當該數據儲存伺服器群模的伺服器設備發生故障與檢修或者新伺服器添加以擴展儲存空間時,系該統監控模組會進行檢測並且維護一個有效的集群映射;以及該數據儲存伺服器群模組係由多個伺服器所組成,並進而與其他模組結合成為多個機櫃(rack)架構。 In the present invention, the distributed storage system is composed of a Metadata server group module, a system monitoring module, and a data storage server group module, wherein the Metadata server group module is mainly composed of It consists of at least three servers that can manage the overall storage system space, convert file names into Metadata data, and perform high-level POSIX (Portable Operating System Interface) functions; It consists of at least three servers that can monitor the overall storage system. When the server device of the data storage server group module fails and is repaired or a new server is added to expand the storage space, the system will monitor the system. The detection and maintenance of an effective cluster mapping; and the data storage server cluster module is composed of a plurality of servers, and in turn combined with other modules into a plurality of rack architecture.

一種雲端群組式數據機房動態儲存配置方法,至少包括下列步驟:一、執行用戶需求儲存系統服務分類之步驟,依據用戶SLA(Service Level Agreement:服務層級協議)分類及判別用戶儲存系統服務類別;二、依據用戶SLA分類提供以最佳儲存機房配置與服務指派之步驟,用以提供各自儲存服務所需資源之最佳配置與地點;三、提供機房儲存資源管理調度之步驟,利用一全自動跨區智慧儲存型存取策略之動態配置用戶資料之設計演算法,用以執行群組化分散式機房儲存資源的管理與調度;以及四、藉由各步驟之協調運作,達到雲端群組式數據機房儲存服務作業流程管理自動 化的目的。 A cloud group-type data room dynamic storage configuration method includes at least the following steps: 1. Performing a user service storage system service classification step, classifying and determining a user storage system service category according to a user SLA (Service Level Agreement); Second, according to the user SLA classification to provide the best storage room configuration and service assignment steps to provide the best configuration and location of the resources required for their respective storage services; Third, provide the computer room storage resource management scheduling steps, the use of a fully automatic Dynamically configuring user data design algorithms for cross-region smart storage access policies to perform management and scheduling of grouped distributed computer room storage resources; and fourth, by coordinating operations of various steps to achieve cloud grouping Data room storage service operation flow management automatically Purpose.

在本發明中,其中該全自動跨區智慧儲存型存取策略之動態配置用戶資料之設計演算法,係先將用戶帳號分類成不同的區碼(area code),再進一步將其對應至最近的本地機房(local site),亦即算出用戶之儲存前置服務碼(area code:site code(機房碼));當用戶的資料存入儲存服務系統時,系統會先認證出其儲存前置服務碼,故資料會先存進相對應主要機房site(primary)的儲存資源中,並會立即用異地同步備援模式再存進同一area code的下一個順位之site code(HA secondary(High Availability:高可用性第二選擇))機房,最後再採用異地非同步備援模式,利用schedule機制周期性的存進下一個順位area code的相同數字之site code遠端資料備份(remote backup)機房;當用戶要存取原先的資料時,在經過服務認證後,系統會先解譯其儲存前置服務碼,即算出其對應的資料的area code及site code,然後才會對相對應的primary site進行存取服務;當primary site發生問題時,會再算出其對應的異地同步備援(HA secondary)資料的area code及site code,故用戶會對HA secondary的site繼續發出存取動作;若HA secondary的機房(site)還是失效時,系統會算出備份資料其對應的異地非同步備援(remote backup)資料的area code及site code,用戶才會對remote backup的機房(site)發出最後的存取動作。 In the present invention, the design algorithm of the dynamic configuration user data of the automatic cross-region intelligent storage type access policy first classifies the user account into different area codes, and further correspondingly to the nearest area code (area code). The local site (local site) calculates the user's storage pre-service code (area code: site code). When the user's data is stored in the storage service system, the system first authenticates the storage pre-location. Service code, so the data will be stored in the storage resource of the primary (primary) corresponding to the main equipment room, and will be stored in the next location code of the same area code (HA secondary). : High-availability second option)) The equipment room, and finally the off-site asynchronous backup mode, using the schedule mechanism to periodically store the same number of the same level of the site code remote code backup (remote backup) room; When the user wants to access the original data, after the service is authenticated, the system will first interpret the stored pre-service code, that is, calculate the area code and site code of the corresponding data, and then The corresponding primary site will be accessed. When the primary site has a problem, the corresponding area code and site code of the corresponding HA secondary data will be calculated. Therefore, the user will continue the HA secondary site. If the HA secondary server room (site) is still invalid, the system will calculate the area code and site code of the corresponding remote backup data of the backup data, and the user will work on the remote backup room. (site) issues the last access action.

本發明雲端群組式數據機房動態儲存配置系統及方法與其他習用技術相互比較時,更具備下列優點: The cloud group data room dynamic storage configuration system and method of the present invention have the following advantages when compared with other conventional technologies:

1.運用本發明之storage server儲存系統,能夠儲存大量而且分散式的資料,將儲存的資料做分散式儲存能夠降低資料損毀或是因機器故 障而導致資料遺失的風險。並且由於為分散式資料儲存,能夠平行處理存取資料之速度,以提升效能,如Amazon S3之應用。 1. Using the storage server storage system of the present invention, it is possible to store a large amount of distributed data, and to store the stored data in a distributed manner to reduce data corruption or because of the machine. The risk of data loss due to obstacles. And because of the decentralized data storage, the speed of accessing data can be processed in parallel to improve performance, such as the application of Amazon S3.

2.本發明之storage rack機架,能夠將storage server做統一的放置與安裝,將storage server做一致性的管理,在分散式機房的領域中,此為不可或缺之配備。 2. The storage rack of the present invention can uniformly place and install the storage server, and manage the storage server in a consistent manner. In the field of the distributed computer room, this is an indispensable device.

3.運用本發明之單一Site分散式storage rack子系統,可以提供單點local的虛擬的儲存池(Storage Pool),讓用戶在不需要知道資源所屬的伺服器位置的條件之下,進行資料夾與檔案的瀏覽並存取該目錄下的所有資源。 3. Using the single site distributed storage rack subsystem of the present invention, a single point local virtual storage pool (Storage Pool) can be provided, so that the user can carry out the folder without knowing the location of the server to which the resource belongs. Browse with the file and access all resources under this directory.

4.運用本發明之單一Site分散式storage rack子系統,可以提供單點動態儲存服務,無縫地連接多個storage rack子系統資源,當系統內的軟硬體故障或維修時,該動態儲存服務可以持續提供服務。 4. The single site distributed storage rack subsystem of the present invention can provide a single point dynamic storage service and seamlessly connect multiple storage rack subsystem resources. When the software and hardware in the system are faulty or repaired, the dynamic storage The service can continue to provide services.

5.運用本發明之單一Site分散式storage rack子系統,可以提供資料的平行讀取、儲存空間無限擴充、異地備援之功能。 5. The single-site distributed storage rack subsystem of the invention can provide parallel reading of data, unlimited expansion of storage space, and remote backup function.

6.運用本發明之多點群組式storage site子系統,可提供具有QoS網路應用服務,例如CDN應用服務。 6. The QoS network application service, such as a CDN application service, can be provided by using the multi-point group storage site subsystem of the present invention.

7.運用本發明之多點群組式storage site子系統,可提供資料異地備援的功能,充分整合及運用全區網路的Site電力資源和儲存系統資源。 7. The multi-point group storage site subsystem of the present invention can provide the function of data backup and backup, fully integrate and utilize the site power resources and storage system resources of the whole area network.

8.運用本發明之全自動跨區智慧儲存型存取策略之設計演算法,用戶儲存資料可利用本智慧型存取模式進行動態配置,在分析系統/網路使用現狀下,計算出最佳之儲存地點後,進行智慧型存取。 8. Using the design algorithm of the automatic cross-region intelligent storage access strategy of the present invention, the user stored data can be dynamically configured by using the smart access mode, and the best calculation is performed under the analysis system/network usage status. After the storage location, intelligent access is performed.

綜上所述,本案不僅於技術思想上確屬創新,並具備習用之傳統方法所不及之上述多項功效,已充分符合新穎性及進步性之法定發明專利要件,爰依法提出申請,懇請 貴局核准本件發明專利申請案,以勵發明,至感德便。 To sum up, this case is not only innovative in terms of technical thinking, but also has many of the above-mentioned functions that are not in the traditional methods of the past. It has fully complied with the statutory invention patent requirements of novelty and progressiveness, and applied for it according to law. Approved this invention patent application, in order to invent invention, to the sense of virtue.

為了使本發明的目的、技術方案及優點更加清楚明白,下面結合附圖及實施例,對本發明進行進一步詳細說明。應當理解,此處所描述的具體實施例僅用以解釋本發明,但並不用於限定本發明。 The present invention will be further described in detail below with reference to the accompanying drawings and embodiments. It is understood that the specific embodiments described herein are merely illustrative of the invention and are not intended to limit the invention.

本發明為一種雲端群組式數據機房動態儲存配置系統及方法,係將雲端數據機房(Cloud Data Center)中之儲存體以群組式方式來進行配置與管理,並利用(1)2U/4U標準storage server子系統,(2)42U/35U標準storage rack子系統,(3)單一Site分散式storage rack子系統5,(4)多點群組式storage site子系統,(5)雲端群組式數據機房動態儲存配置管理子系統6等架構進行整合配置與調度管理,來達到儲存體智慧型配置自動化與資料備援的目的。 The invention relates to a cloud group data room dynamic storage configuration system and method, which is to configure and manage a storage body in a cloud data center in a group mode, and utilize (1) 2U/4U. Standard storage server subsystem, (2) 42U/35U standard storage rack subsystem, (3) single Site distributed storage rack subsystem 5, (4) multi-point group storage site subsystem, (5) cloud group The data storage room dynamic storage configuration management subsystem 6 and other architectures for integrated configuration and scheduling management to achieve the purpose of storage smart configuration automation and data backup.

本發明所提出雲端群組式數據機房動態儲存配置系統之設計,包含之子系統與功能如下:2U/4U標準storage server子系統:動態儲存系統以標準2U/4U伺服器及內置硬碟為儲存體建置之最小基本單元,對外提供雲端儲存服務,例如:2U server配上12顆SATA HD或4U server配上24顆SATA HD;42U/35U標準storage rack子系統:動態儲存storage rack子系統以標準42U/35U機箱(Rack)內建2U/4U標準storage server子系統與交換器,對外 提供雲端儲存服務;單一Site分散式storage rack子系統5:Cluster DFS(Distributed File System)之軟體系統,不綁定storage rack或storage server子系統,單一Site內以多個storage rack子系統提供單點動態儲存服務,無縫地連接多個storage rack子系統資源,建構成一個單點local的虛擬的儲存池(Storage Pool);多點群組式storage site子系統:將多個單一Site分散式storage rack子系統建構成一個整體的多點群組式storage site子系統,此子系統可以解決tier4/tier3機房和tier2機房儲存服務系統發展的不平衡,以及整合全區網路的Site電力資源和儲存系統資源;雲端群組式數據機房動態儲存配置管理子系統6:此子系統需能將全區多點群組式storage site子系統資源利用網路管理介面連接起來,建構成一個web化之集中儲存配置管理的虛擬儲存池系統,且位於每個Site的使用者AP(Application Program)均能依據SLA動態存取的雲端群組式數據機房所提供的虛擬儲存服務。多點群組式storage site子系統配合動態儲存配置管理子系統能支援跨區(2點以上)形成全區整合的儲存配置管理,若近台虛擬機(VM)發生問題時,動態儲存配置管理子系統可支援虛擬機從近台另一虛擬機映像檔(VM Image)啟動,若整個近台系統與網路發生問題時,此系統可支援遠端儲存系統中之虛擬機映像檔,使之重新啟動,故不會有近台與網路間單一故障(Single Failure)的發生。 The design of the dynamic group configuration system of the cloud group data room proposed by the invention comprises the following subsystems and functions: 2U/4U standard storage server subsystem: the dynamic storage system uses a standard 2U/4U server and a built-in hard disk as a storage body. The minimum basic unit is built to provide cloud storage services, for example: 2U server with 12 SATA HD or 4U server with 24 SATA HD; 42U/35U standard storage rack subsystem: dynamic storage storage rack subsystem to standard 42U/35U chassis (Rack) built-in 2U/4U standard storage server subsystem and switch, external Provides cloud storage service; single site distributed storage rack subsystem 5: Cluster DFS (Distributed File System) software system, does not bind storage rack or storage server subsystem, provides single point in multiple sites with multiple storage rack subsystems Dynamic storage service, seamlessly connecting multiple storage rack subsystem resources to form a single point local virtual storage pool (Storage Pool); multi-point group storage site subsystem: multiple single site distributed storage The rack subsystem is built into an overall multi-point group storage site subsystem, which can solve the imbalance of tier4/tier3 equipment room and tier2 equipment storage service system development, and integrate the site power resources and storage of the whole area network. System resources; cloud grouped data room dynamic storage configuration management subsystem 6: This subsystem needs to be able to connect the entire multi-point group storage site subsystem resources with the network management interface to form a webized concentration Store the virtual storage pool system of configuration management, and the user program (AP) of each site can be based on SLA dynamics. Virtual storage service provided by the cloud grouped data room accessed. The multi-point group storage site subsystem and the dynamic storage configuration management subsystem can support cross-region (more than 2 points) to form a comprehensive storage configuration management. If there is a problem in the near virtual machine (VM), dynamic storage configuration management The subsystem can support the virtual machine to boot from another virtual machine image (VM Image). If the entire system and the network have problems, the system can support the virtual machine image in the remote storage system. Restart, so there will be no single failure between the network and the network.

請參閱附圖一所示,為本發明之2U storage server子系統1示意圖,一般標準大小為寬19英吋、高為3.5英吋,可放入寬為19英吋機架當中。目 前主流CPU為使用一顆處理器(Quad-core),但是可支援至兩顆處理器,在運算處理能力方面,能提供所需的速度。記憶體可選用1GB、2GB、4GB或8GB,並提供16個記憶體插槽,最高可達到128GB,做為storage server而言,一般印象裡記憶體非關鍵性之因素,而硬碟之容量才是,然而,硬碟的容量大小固然重要,記憶體的容量也不容忽視,記憶體容量越大,則能當做storage的緩衝空間則越大,在整體之storage效能方面,佔了舉足輕重的地位,緩衝空間越大,則能夠暫存越多的資料,分擔硬碟讀取或寫入之負擔。Storage Controller方面,配備RAID控制卡,可做到RAID 0/1/5/6不同等級之資料備援機制。硬碟則是提供至少可放置12顆3.5吋之熱插拔的SATA/SAS HDD,至於一顆硬碟的容量,以往為1TB,目前主流則為2TB,未來則有可能以3TB為主流配備,如此則能大大地提昇storage server本身的capacity,並能以相同大小的伺服器,儲存更多的資料。 Please refer to FIG. 1 , which is a schematic diagram of the 2U storage server subsystem 1 of the present invention. The general standard size is 19 inches wide and 3.5 inches high, and can be placed in a 19 inch wide rack. Head The former mainstream CPU uses one processor (Quad-core), but can support up to two processors, providing the required speed in terms of computing power. The memory can be 1GB, 2GB, 4GB or 8GB, and provides 16 memory slots up to 128GB. As a storage server, the memory is not a critical factor in the memory, and the capacity of the hard disk is Yes, however, the size of the hard disk is important, and the capacity of the memory cannot be ignored. The larger the memory capacity, the larger the buffer space that can be used as the storage, and it plays a pivotal role in the overall storage performance. The larger the buffer space, the more data can be temporarily stored, sharing the burden of hard disk reading or writing. For the Storage Controller, it is equipped with a RAID controller card, which can achieve RAID 0/1/5/6 different levels of data backup mechanism. The hard disk is provided with at least 12 3.5-inch hot-swappable SATA/SAS HDDs. As for the capacity of one hard disk, it is 1TB in the past, and the current mainstream is 2TB. In the future, it is possible to use 3TB as the mainstream. This can greatly improve the capacity of the storage server itself, and can store more data with the same size server.

請參閱附圖二所示,為本發明之4U storage server子系統2示意圖,一般標準大小為寬19英吋、高為7英吋,可放入寬為19英吋之機架當中。由於大小為2U storage server的兩倍,故預設配置的之CPU為兩顆處理器,每一顆處理器可為Quad-core。記憶體最高可達到192GB,故所能使用的記憶體容量也較2U storage server多。而所能容納之硬碟數也為2U storage server的兩倍,也就是24顆的3.5吋Hot-Swap(SAS/SATA)硬碟。其同樣具備RAID控制卡提供備援之機制,其等級一樣有RAID 0/1/5/6可供選擇。 Please refer to FIG. 2, which is a schematic diagram of the 4U storage server subsystem 2 of the present invention. The general standard size is 19 inches wide and 7 inches high, and can be placed in a rack of 19 inches wide. Since the size is twice that of the 2U storage server, the default configuration of the CPU is two processors, each of which can be Quad-core. The memory can reach up to 192GB, so the memory capacity that can be used is more than that of the 2U storage server. The number of hard disks that can be accommodated is twice that of the 2U storage server, which is 24 3.5-inch Hot-Swap (SAS/SATA) hard drives. It also has a RAID controller card to provide backup mechanism, the same level of RAID 0/1/5/6 is available.

請參閱附圖三所示,為本發明之42U標準storage rack子系統3示意圖,此42U標準機架,長約40英吋、寬約24英吋、高則約為78英吋。機架本身為可拆裝式組合,包含Lockable Doors、Removable Side Panels、Perforated Doors、Easy Leveling Castors、Adjustable Mounting Posts、Square Mounting Tabs以及Cable Access,可自行調整隔板之高度放置storage server,提供電源、通風口以及網路孔,根據需求自行依設計放置不同廠牌或是不同高度的storage server,並提供機架穩定器、底板、接地套件,對於安裝或是機架的擺設固定提供更加完善的保護。 Please refer to FIG. 3, which is a schematic diagram of the 42U standard storage rack subsystem 3 of the present invention. The 42U standard rack is about 40 inches long, about 24 inches wide, and about 78 inches high. The rack itself is a detachable combination that includes Lockable Doors, Removable Side Panels, and Perforated Doors, Easy Leveling Castors, Adjustable Mounting Posts, Square Mounting Tabs, and Cable Access, you can adjust the height of the partition to place the storage server, provide power, vents and network holes, and place different labels or different designs according to your needs. A high-level storage server with rack stabilizers, backplanes, and grounding kits for added protection for installation or rack mounting.

請參閱附圖四所示,為本發明之35U標準storage rack子系統4示意圖,此為35U標準機架,長約40英吋、寬約24英吋、高度則約為68英吋。機架本身與42U機架一樣,為可拆裝式組合,能夠很容易地將Side Panel組裝或是拆卸而不需要工具。提供風扇、底座滾輪等等的組件,讓安裝更加容易。 Referring to Figure 4, there is shown a schematic diagram of a 35U standard storage rack subsystem 4 of the present invention. This is a 35U standard rack having a length of about 40 inches, a width of about 24 inches, and a height of about 68 inches. The rack itself, like the 42U rack, is a detachable combination that makes it easy to assemble or disassemble the Side Panel without the need for tools. Components such as fans, base rollers, and the like are provided to make installation easier.

請參閱圖1所示,為本發明之單一Site分散式storage rack子系統5架構圖,包含負載平衡器51、資料快取伺服器52及架設於多個機櫃當中的各儲存節點之分散式儲存系統53三個部分。其中負載平衡器51負責根據伺服器連線狀況,了解其負載狀況,並且依據網路封包內埠號(Port Number)判斷並配合位址轉換(NAT)功能,加以分析並將連線分配到資料快取伺服器52進行第一層快取資料處理;如果快取資料未命中,則再透過負載平衡器將資料的請求即時分配到應用程式伺服器AP 54進行資料處理,並且將資料儲存或寫入至分散式儲存系統53。本發明之單一Site分散式storage rack子系統不僅可以減輕儲存設備的負擔,也可以增加資料存取的速度。 Please refer to FIG. 1 , which is a schematic diagram of a single Site distributed storage rack subsystem 5 of the present invention, including a load balancer 51 , a data cache server 52 , and distributed storage of storage nodes installed in a plurality of cabinets. System 53 has three parts. The load balancer 51 is responsible for understanding the load status according to the server connection status, and judging and matching the address conversion (NAT) function according to the port number in the network packet, analyzing and distributing the connection to the data. The cache server 52 performs the first layer cache data processing; if the cache data is missed, the data request is immediately distributed to the application server AP 54 through the load balancer for data processing, and the data is stored or written. Into the decentralized storage system 53. The single Site distributed storage rack subsystem of the present invention can not only reduce the burden on the storage device, but also increase the speed of data access.

本發明之分散式儲存系統53包含Metadata伺服器群模組531、系統監控模組532以及數據儲存伺服器群模組533等3種主要模組,其中: The distributed storage system 53 of the present invention comprises three main modules: a Metadata server group module 531, a system monitoring module 532, and a data storage server group module 533, wherein:

1. Metadata伺服器群模組531:Metadata伺服器群模組主要可由3~5 台之伺服器所組成,能夠管理整體儲存系統空間,將文件名稱轉換為Metadata數據,執行高層次的POSIX功能。 1. Metadata server group module 531: Metadata server group module can be mainly 3~5 It consists of a server that manages the overall storage system space, converts file names to Metadata data, and performs high-level POSIX functions.

2.系統監控模組532:系統監控模組主要可由3~5台之伺服器所組成,能夠監控整體儲存系統,當數據儲存伺服器群模的伺服器設備發生故障與檢修或者新伺服器添加以擴展儲存空間時,系統監控模組會進行檢測並且維護一個有效的集群映射。 2. System monitoring module 532: The system monitoring module can be mainly composed of 3~5 servers, which can monitor the overall storage system, when the server of the data storage server group mode fails and repairs or the new server is added. To extend storage space, the system monitoring module detects and maintains a valid cluster map.

3.數據儲存伺服器群模組533:數據儲存伺服器群模組係由多個伺服器所組成,並進而與其他模組結合成為多個rack架構。本模組主要是協助進行資料的讀和寫,用戶操作的資料都是由對象存儲集群管理與儲存。 3. Data Storage Server Group Module 533: The data storage server group module is composed of a plurality of servers, and is combined with other modules to form a plurality of rack structures. This module is mainly to assist in the reading and writing of data. The data of user operations are managed and stored by the object storage cluster.

請參閱圖2所示,為本發明之多點群組式storage site子系統架構圖,是將多個單一Site分散式storage rack子系統5建構成一個整體的多點群組式storage site子系統,每單一Site分散式storage rack子系統5皆包含Firewall/IPS安全防禦設備,可防止異常訊務流量的入侵與破壞。 Referring to FIG. 2, the multi-point group storage site subsystem architecture diagram of the present invention is a multi-point group storage site subsystem in which a plurality of single site distributed storage rack subsystems 5 are constructed as a whole. Each single-site distributed storage rack subsystem 5 includes a Firewall/IPS security defense device to prevent intrusion and destruction of abnormal traffic.

此多點群組式storage site子系統須經由雲端群組式數據機房動態儲存配置管理子系統6連接起來,配合雲端群組式數據機房動態儲存配置管理子系統6即能支援跨區(2點以上)管理,形成全區整合的儲存配置管理圖,若近台虛擬機(VM)發生問題時,動態儲存配置管理子系統6可支援虛擬機從近台另一虛擬機映像檔(VM Image)啟動,若整個近台系統與網路發生問題時,此系統可支援遠端儲存系統中之虛擬機映像檔,使之重新啟動,故不會有近台與網路間單一故障(Single Failure)的發生。 The multi-point group storage site subsystem must be connected via the cloud group data room dynamic storage configuration management subsystem 6 to support the cross-region (2 points) in conjunction with the cloud group data room dynamic storage configuration management subsystem 6. The above) management forms a storage configuration management map integrated in the whole area. If there is a problem in the near virtual machine (VM), the dynamic storage configuration management subsystem 6 can support the virtual machine from another virtual machine image file (VM Image). Startup, if there is a problem with the entire system and the network, the system can support the virtual machine image in the remote storage system and restart it, so there will be no single failure between the near network and the network (Single Failure). happened.

對於每個Site的AP均能夠根據SLA模式進行動態配置,提供CDN應 用服務。另外,此子系統亦可以解決tier4/tier3機房和tier2機房儲存服務系統發展的不平衡,可動態地將較重要且經常使用之資料存在tier3/tier4的Site,而將較不重要或是較少使用之資料儲存於tier2的Site,或是將備份資料存放在tier2的Site,達到資料異地備援的目的,亦充分整合及運用全區網路的Site電力資源和儲存系統資源。 The AP for each site can be dynamically configured according to the SLA mode, and the CDN should be provided. Use the service. In addition, this subsystem can also solve the imbalance of tier4/tier3 room and tier2 room storage service system development, and can dynamically store more important and frequently used data in tier3/tier4 site, which will be less important or less. The data used is stored in the tier2 site, or the backup data is stored in the tier2 site to achieve the purpose of data backup, and the site power resources and storage system resources of the entire network are fully integrated and utilized.

請參閱圖3所示,本發明之動態儲存配置管理方法,至少包括下列步驟:主要係執行用戶需求儲存系統服務分類61之步驟,依據用戶SLA分類及判別用戶儲存系統服務類別;依據用戶SLA分類提供以最佳儲存機房配置與服務指派62之步驟,用以提供各自儲存服務所需資源之最佳配置與地點(如local雙Active機房、Active-Standby機房);主要提供機房儲存資源管理調度63之步驟,利用全自動跨區智慧儲存型存取策略之動態配置用戶資料之設計演算法,用以負責群組化之分散式機房儲存資源的管理與調度;藉由各步驟之協調運作,達到機房儲存服務作業流程管理自動化的目的。 Referring to FIG. 3, the dynamic storage configuration management method of the present invention includes at least the following steps: mainly performing the steps of the user demand storage system service classification 61, classifying and discriminating the user storage system service category according to the user SLA; classifying according to the user SLA The steps of providing the optimal storage room configuration and service assignment 62 to provide the best configuration and location of the resources required for the respective storage services (such as the local dual Active room and the Active-Standby room); The step of using a fully automatic cross-region intelligent storage access policy to dynamically configure the user data design algorithm to manage and schedule the distributed storage room storage resources of the group; The purpose of computer room storage service operation process management automation.

本發明之全自動跨區智慧儲存型存取策略之動態配置用戶資料之設計演算法,請參閱附圖五所示,此演算法是先將用戶帳號分類成不同的area code,如userA、userB分配到area code:02,userC、userD分配到area code:07。再進一步將user對應至最近的local site的機房,如userA、userB分配到area code:02中的site code:01與02,userC、userD分配到area code:07中的site code:01與02。故userA、userB、userC、userD的儲存前置服務碼分別為02:01、02:02、07:01與07:02等。 For the design algorithm of the dynamic configuration user data of the automatic cross-region intelligent storage access policy of the present invention, as shown in FIG. 5, the algorithm first classifies the user accounts into different area codes, such as userA and userB. Assigned to area code:02, userC, userD is assigned to area code:07. Further, the user is corresponding to the computer room of the nearest local site, for example, userA and userB are assigned to site code: 01 and 02 in area code: 02, and userC and userD are assigned to site code: 01 and 02 in area code: 07. Therefore, the storage pre-service codes of userA, userB, userC, and userD are 02:01, 02:02, 07:01, and 07:02, respectively.

當userA的dataA資料存入本服務系統時,系統會先認證出其儲存前置服務碼為02:01,故會先存進area code:02、site code:01機房的資源,並 會立即用異地同步備援模式再存進同一area code的下一個順位之site code機房(這裡即是site code:02機房),最後再採用異地非同步備援模式,利用schedule機制周期性的存進下一個順位area code(這裡即是area code:07)的相同數字之site code遠端資料備份機房(這裡即是site code:01機房)。其他userB的dB、userC的dC、userD的dD資料存取方式與userA之演算法相同,請參考附圖五所示。 When the dataA data of userA is stored in the service system, the system will first verify that the storage pre-service code is 02:01, so it will save the resources of area code:02, site code:01, and It will immediately use the remote synchronous backup mode and then deposit it into the next code site code room of the same area code (here is the site code: 02 machine room), and finally use the off-site asynchronous backup mode, using the schedule mechanism to periodically save Go to the next number of site code (here is area code: 07) the same number of site code remote data backup machine room (here is site code: 01 machine room). The other userB's dB, userC's dC, and userD's dD data access methods are the same as those of userA. Please refer to Figure 5.

爾後當userA要存取原先的dataA資料時,在經過服務認證後,系統會先算出其對應的primary data的area code:site code為02:01,然後,userA就會對02:01的site服務進行存取。當02:01 site發生問題時(如網路中斷、線路壅塞、主機失效、儲存體異常...等等),此時系統的全自動跨區智慧儲存型存取策略之動態配置用戶資料之設計演算法會再算出其對應的HA(High Availability)secondary data的area code:site code為02:02,故userA會對02:02的site繼續發出存取動作。若02:02的site還是失效時,系統的全自動跨區智慧儲存型存取策略之動態配置用戶資料之設計演算法會算出最後一步(即用到備份資料),其對應的remote backup data的area code:site code為07:01,userA會對07:01的site發出最後的存取動作(由於07:01是remote backup的site,其上data會有非同步時間差的議題,故此動作要配合snapshot做檔案的修正)。其他userB的dB、userC的dC、userD的dD智慧型資料存取方式與資料備份存取方式與userA之演算法相同,請參考附圖五所示。 Then, when userA wants to access the original dataA data, after the service authentication, the system will first calculate the corresponding primary data of the area code: site code is 02:01, then userA will serve the 02:01 site service. Access. When there is a problem with the 02:01 site (such as network interruption, line congestion, host failure, storage abnormality, etc.), the system automatically configures the user profile of the automatic cross-region intelligent storage access policy. The design algorithm will calculate the corresponding area code:site code of the corresponding High Availability secondary data of 02:02, so userA will continue to issue access operations to the 02:02 site. If the site of 02:02 is still invalid, the design algorithm of the dynamic configuration user data of the automatic cross-region intelligent storage access strategy of the system will calculate the final step (that is, the backup data is used), and the corresponding remote backup data Area code:site code is 07:01, userA will send the last access action to the site of 07:01 (since 07:01 is the site of remote backup, the data will have the problem of non-synchronization time difference, so the action should match Snapshot to make file corrections). Other userB's dB, userC's dC, userD's dD intelligent data access mode and data backup access mode are the same as userA's algorithm, please refer to Figure 5.

本發明之虛擬儲存系統具備儲存服務和資料的高可靠性、線上容量的擴展性、支援多資料副本(1份以上)、以及快取資料(Cache Data)本地存取等 功能。雲端群組式數據機房儲存系統服務具有動態儲存配置機制,讓使用者能夠根據SLA模式進行動態配置,可基於各地Site機房儲存系統的即時使用情況,包括頻寬、剩餘儲存空間、電力等,按照本發明之全自動跨區智慧儲存型存取策略之動態配置用戶資料的實際儲存位置,以平衡儲存系統的資源。AP經常存取的資料配置於local site就近位置(採雙Active模式),備份的資料則配置於remote site。此虛擬儲存系統可支援多路徑傳輸檔案模式,使用者可從多個群組式storage site子系統同時獲得資料,以提高儲存系統整體效率。雲端群組式數據機房動態儲存配置管理子系統6可以設定資料保護參數,動態調整指定儲存資料的安全性、可靠性和儲存之經濟性。雲端群組式數據機房動態儲存配置管理子系統6也提供QoS分級的控制介面,供不同區域的客戶使用動態配置虛擬儲存空間,也可向用戶提供一個的控制介面(GUI),觀察該客戶的儲存資料目前的使用情況。 The virtual storage system of the present invention has high reliability of storage services and data, scalability of online capacity, support for multiple data copies (more than one copy), and local access of cache data (Cache Data). Features. The cloud group-type data room storage system service has a dynamic storage configuration mechanism, which enables users to dynamically configure according to the SLA mode, and can be based on the instant use situation of the local site storage system, including bandwidth, remaining storage space, power, etc. The fully automatic cross-region intelligent storage access strategy of the present invention dynamically configures the actual storage location of the user data to balance the resources of the storage system. The data frequently accessed by the AP is configured in the local location (in the dual active mode), and the backed up data is configured in the remote site. The virtual storage system can support the multi-path transmission file mode, and users can obtain data from multiple group storage site subsystems simultaneously to improve the overall efficiency of the storage system. The cloud group data room dynamic storage configuration management subsystem 6 can set data protection parameters and dynamically adjust the security, reliability and storage economy of the specified storage materials. The cloud grouped data room dynamic storage configuration management subsystem 6 also provides a QoS hierarchical control interface for customers in different regions to dynamically configure the virtual storage space, and also provides a control interface (GUI) to the user to observe the customer's Store the current usage of the data.

以上該僅為本發明之較佳實施例,並非用來限定本發明之實施範圍;如果不脫離本發明之精神和範圍,對本發明進行修改或者等同替換,均應涵蓋在本發明申請專利範圍的保護範圍當中。 The above is only the preferred embodiment of the present invention, and is not intended to limit the scope of the present invention; the modifications and equivalents of the present invention are intended to be included in the scope of the present invention without departing from the spirit and scope of the invention. Within the scope of protection.

1‧‧‧2U storage server子系統 1‧‧‧2U storage server subsystem

2‧‧‧4U storage server子系統 2‧‧‧4U storage server subsystem

3‧‧‧42U標準storage rack子系統 3‧‧‧42U standard storage rack subsystem

4‧‧‧35U標準storage rack子系統 4‧‧‧35U standard storage rack subsystem

5‧‧‧單一Site分散式storage rack子系統 5‧‧‧Single Site Distributed Storage rack Subsystem

51‧‧‧負載平衡器 51‧‧‧Load balancer

52‧‧‧資料快取伺服器 52‧‧‧Data cache server

53‧‧‧分散式儲存系統 53‧‧‧Distributed storage system

531‧‧‧Metadata伺服器群模組 531‧‧‧Metadata Server Group Module

532‧‧‧系統監控模組 532‧‧‧System Monitoring Module

533‧‧‧數據儲存伺服器群模組 533‧‧‧Data Storage Server Group Module

54‧‧‧AP 54‧‧‧AP

55‧‧‧DB 55‧‧‧DB

6‧‧‧雲端群組式數據機房動態儲存配置管理子系統 6‧‧‧Cloud Group Data Room Dynamic Storage Configuration Management Subsystem

61‧‧‧用戶需求儲存系統服務分類 61‧‧‧User Demand Storage System Service Classification

62‧‧‧最佳儲存機房配置與服務指派 62‧‧‧Best storage room configuration and service assignment

63‧‧‧機房儲存資源管理調度 63‧‧‧Computer room storage resource management scheduling

請參閱以下有關本發明之詳細說明及其附圖,將可進一步瞭解本發明之技術內容及其目的功效;有關附圖為:圖1 係為單一Site分散式storage rack子系統架構圖;圖2 係為多點群組式storage site子系統架構圖;圖3 係為本發明之動態儲存配置管理方法流程圖; 附圖一 係為本發明之2U storage server子系統示意圖;附圖二 係為本發明之4U storage server子系統示意圖;附圖三 係為本發明之42U標準storage rack子系統示意圖;附圖四 係為本發明之35U標準storage rack子系統示意圖;附圖五 係為全自動跨區智慧儲存型存取策略之動態配置用戶資料之設計演算法。 The following is a detailed description of the present invention and its accompanying drawings, which will further understand the technical contents of the present invention and its effects; the related drawings are: FIG. 1 is a single Site distributed storage rack subsystem architecture diagram; The system is a multi-point group storage site subsystem architecture diagram; FIG. 3 is a flowchart of the dynamic storage configuration management method of the present invention; 1 is a schematic diagram of a 2U storage server subsystem of the present invention; FIG. 2 is a schematic diagram of a 4U storage server subsystem of the present invention; and FIG. 3 is a schematic diagram of a 42U standard storage rack subsystem of the present invention; The schematic diagram of the 35U standard storage rack subsystem of the present invention; FIG. 5 is a design algorithm for dynamically configuring user data of the automatic cross-region intelligent storage access strategy.

51‧‧‧負載平衡器 51‧‧‧Load balancer

52‧‧‧資料快取伺服器 52‧‧‧Data cache server

53‧‧‧分散式儲存系統 53‧‧‧Distributed storage system

531‧‧‧Metadata伺服器群模組 531‧‧‧Metadata Server Group Module

532‧‧‧系統監控模組 532‧‧‧System Monitoring Module

533‧‧‧數據儲存伺服器群模組 533‧‧‧Data Storage Server Group Module

54‧‧‧AP 54‧‧‧AP

55‧‧‧DB 55‧‧‧DB

Claims (7)

一種雲端群組式數據機房動態儲存配置系統,至少包括:一單一Site分散式儲存機櫃(storage rack)子系統,為Cluster DFS(Distributed File System:分散式檔案系統)之軟體系統,不綁定storage rack或storage server子系統,在單一Site內以多個storage rack子系統提供單點動態儲存服務,無縫地連接多個storage rack子系統資源,建構成一個單點local的虛擬的儲存池(Storage Pool);一多點群組式儲存機房(storage site)子系統,係將多個單一Site分散式storage rack子系統建構成一個整體的多點群組式storage site子系統,可以解決tier4/tier3機房和tier2機房儲存服務系統發展的不平衡,以及整合全國性網路的機房(Site)電力資源和儲存系統資源;以及一雲端群組式數據機房動態儲存配置管理子系統,能將全區多點群組式storage site子系統資源連接起來,建構成一個集中儲存配置管理的虛擬儲存系統;其中,藉由該多點群組式storage site子系統配合該雲端群組式數據機房動態儲存配置管理子系統能支援跨區(2點storage site以上)形成全區整合的儲存配置管理,若近台(local site:本地機房)系統提供之虛擬機(Virtual Machine,VM)服務發生問題時,該雲端群組式數據機房動態儲存配置管理子系統可支援虛擬機從近台另一虛擬機映像檔(VM Image)啟動,若整個近台系統與網路連線發生問題時,本系統可支援遠端機房儲存系統(remote site storage)中之虛擬機映像檔,使之重新啟動,故不會有近台與網路間單一故障(Single Failure)的發生,且能夠將全區之儲存體予 以有效整合,並將全自動跨區智慧儲存型存取策略功能導入,整合成該雲端群組式數據機房動態儲存配置系統,具儲存系統全自動、最佳調度配置及跨多點Site之特性,來達到儲存體智慧型配置自動化與資料備援之目的。 A cloud group-type data room dynamic storage configuration system includes at least: a single site distributed storage rack subsystem, which is a software system of a Cluster DFS (Distributed File System), which is not bound to a storage system. The rack or storage server subsystem provides a single point dynamic storage service with multiple storage rack subsystems in a single site, seamlessly connecting multiple storage rack subsystem resources, and constructing a single point local virtual storage pool (Storage) Pool); a multi-point group storage site subsystem, which is constructed by constructing a single multi-site distributed storage rack subsystem to form a holistic multi-point group storage site subsystem, which can solve tier4/tier3 The imbalance between the development of the storage service system in the equipment room and the tier2 room, as well as the integration of the nationwide network (Site) power resources and storage system resources; and the cloud group-type data room dynamic storage configuration management subsystem, which can The point group storage site subsystem resources are connected to form a virtual storage system for centralized storage configuration management; The multi-point group storage site subsystem cooperates with the cloud group data room dynamic storage configuration management subsystem to support cross-region (above 2 storage sites) to form a comprehensive storage configuration management, if near (local site: local machine room) When the virtual machine (VM) service provided by the system has a problem, the cloud grouped data room dynamic storage configuration management subsystem can support the virtual machine from another virtual machine image file ( VM Image) starts. If there is a problem with the connection between the entire system and the network, the system can support the virtual machine image file in the remote site storage system to restart it, so it will not be near. Single failure between the station and the network, and the storage of the entire area can be given With effective integration, the automatic cross-region intelligent storage access policy function is imported and integrated into the cloud group-type data room dynamic storage configuration system, with automatic storage system, optimal scheduling configuration and characteristics across multiple sites. To achieve the purpose of intelligent storage configuration and data backup for storage. 如申請專利範圍第1項所述之雲端群組式數據機房動態儲存配置系統,其中該storage rack子系統,為動態儲存之storage rack系統,係以標準機箱(Rack)內建標準storage server子系統與交換器,對外提供雲端儲存服務。 For example, the cloud group type data room dynamic storage configuration system described in claim 1 wherein the storage rack subsystem is a dynamic storage storage rack system, and the standard chassis (Rack) has a built-in standard storage server subsystem. With the switch, the cloud storage service is provided externally. 如申請專利範圍第1項所述之雲端群組式數據機房動態儲存配置系統,其中該storage server子系統,為動態儲存系統,係以標準伺服器及內置硬碟為儲存體建置之最小基本單元,對外提供雲端儲存服務。 The cloud group-type data room dynamic storage configuration system according to the first aspect of the patent application, wherein the storage server subsystem is a dynamic storage system, and the minimum basic configuration is implemented by using a standard server and a built-in hard disk as a storage medium. Unit, providing cloud storage services to the outside world. 如申請專利範圍第1項所述之雲端群組式數據機房動態儲存配置系統,其中該單一Site分散式storage rack子系統,包含負載平衡器、資料快取伺服器及架設於多個機櫃當中的各儲存節點之分散式儲存系統三個部分,其中該負載平衡器係負責根據伺服器連線狀況,了解其負載狀況,並且依據網路封包內埠號(Port Number)判斷並配合位址轉換(NAT)功能,加以分析並將連線分配至該資料快取伺服器進行第一層快取資料處理;如果快取資料未命中,則再透過該負載平衡器將資料的請求即時分配到應用程式伺服器進行資料處理,並且將資料儲存或寫入至該分散式儲存系統。 The cloud group-type data room dynamic storage configuration system described in claim 1, wherein the single-site distributed storage rack subsystem includes a load balancer, a data cache server, and a plurality of cabinets. Three parts of the distributed storage system of each storage node, wherein the load balancer is responsible for understanding the load status according to the connection status of the server, and judging and matching the address conversion according to the port number in the network packet ( NAT) function, analyze and distribute the connection to the data cache server for the first layer cache data processing; if the cache data is missing, then the data balance request is instantly distributed to the application through the load balancer The server performs data processing and stores or writes data to the distributed storage system. 如申請專利範圍第4項所述之雲端群組式數據機房動態儲存配置系統,其中該分散式儲存系統係由中介資料(Metadata)伺服器群模組、系統監控 模組以及數據儲存伺服器群模組所組成,其中該Metadata伺服器群模組主要係由至少三台之伺服器所組成,能夠管理整體儲存系統空間,將文件名稱轉換為Metadata數據,執行高層次的POSIX(Portable Operating System Interface:可移植作業系統介面)功能;該系統監控模組主要係由至少三台之伺服器所組成,能夠監控整體儲存系統,當該數據儲存伺服器群模的伺服器設備發生故障與檢修或者新伺服器添加以擴展儲存空間時,系該統監控模組會進行檢測並且維護一個有效的集群映射;以及該數據儲存伺服器群模組係由多個伺服器所組成,並進而與其他模組結合成為多個機櫃(rack)架構。 The cloud group-type data room dynamic storage configuration system described in claim 4, wherein the distributed storage system is controlled by a metadata (Metadata) server group module and system. The module and the data storage server group module, wherein the Metadata server group module is mainly composed of at least three servers, can manage the overall storage system space, convert file names into Metadata data, and execute high. POSIX (Portable Operating System Interface) function; the system monitoring module is mainly composed of at least three servers, which can monitor the overall storage system, when the data storage server group mode servo When the device fails and is repaired or a new server is added to expand the storage space, the system monitors and maintains an effective cluster mapping; and the data storage server group module is composed of multiple servers. It is combined with other modules to form multiple rack architectures. 一種雲端群組式數據機房動態儲存配置方法,至少包括下列步驟:一、執行用戶需求儲存系統服務分類之步驟,依據用戶SLA(Service Level Agreement:服務層級協議)分類及判別用戶儲存系統服務類別;二、依據用戶SLA分類提供以最佳儲存機房配置與服務指派之步驟,用以提供各自儲存服務所需資源之最佳配置與地點;三、提供機房儲存資源管理調度之步驟,利用一全自動跨區智慧儲存型存取策略之動態配置用戶資料之設計演算法,用以執行群組化分散式機房儲存資源的管理與調度;以及四、藉由各步驟之協調運作,達到雲端群組式數據機房儲存服務作業流程管理自動化的目的。 A cloud group-type data room dynamic storage configuration method includes at least the following steps: 1. Performing a user service storage system service classification step, classifying and determining a user storage system service category according to a user SLA (Service Level Agreement); Second, according to the user SLA classification to provide the best storage room configuration and service assignment steps to provide the best configuration and location of the resources required for their respective storage services; Third, provide the computer room storage resource management scheduling steps, the use of a fully automatic Dynamically configuring user data design algorithms for cross-region smart storage access policies to perform management and scheduling of grouped distributed computer room storage resources; and fourth, by coordinating operations of various steps to achieve cloud grouping Data room storage service operation process management automation purposes. 如申請專利範圍第6項所述之雲端群組式數據機房動態儲存配置方法,其中該全自動跨區智慧儲存型存取策略之動態配置用戶資料之設計演算法,係先將用戶帳號分類成不同的區碼(area code),再進一步將其對應 至最近的本地機房(local site),亦即算出用戶之儲存前置服務碼(area code:site code(機房碼));當用戶的資料存入儲存服務系統時,系統會先認證出其儲存前置服務碼,故資料會先存進相對應主要機房site(primary)的儲存資源中,並會立即用異地同步備援模式再存進同一area code的下一個順位之site code(HA secondary(High Availability:高可用性第二選擇))機房,最後再採用異地非同步備援模式,利用schedule機制周期性的存進下一個順位area code的相同數字之site code遠端資料備份(remote backup)機房;當用戶要存取原先的資料時,在經過服務認證後,系統會先解譯其儲存前置服務碼,即算出其對應的資料的area code及site code,然後才會對相對應的primary site進行存取服務;當primary site發生問題時,會再算出其對應的異地同步備援(HA secondary)資料的area code及site code,故用戶會對HA secondary的site繼續發出存取動作;若HA secondary的機房(site)還是失效時,系統會算出備份資料其對應的異地非同步備援(remote backup)資料的area code及site code,用戶才會對remote backup的機房(site)發出最後的存取動作。 For example, the dynamic grouping configuration method of the cloud group data room according to the sixth aspect of the patent application scope, wherein the design algorithm of the dynamic configuration user data of the automatic cross-region intelligent storage type access policy first classifies the user account into Different area codes, and further corresponding to them To the nearest local site, the user's storage pre-service code (area code: site code) is calculated; when the user's data is stored in the storage service system, the system first authenticates the storage. The pre-service code, so the data will be stored in the storage resource of the primary (primary) corresponding to the main equipment room, and will be immediately stored in the same location code of the same area code (HA secondary (synchronous backup mode). High Availability: High-availability second option)) The equipment room, and finally the off-site asynchronous backup mode, using the schedule mechanism to periodically store the same number of the next level of the same site code remote data backup (remote backup) room When the user wants to access the original data, after the service is authenticated, the system will first interpret the stored pre-service code, that is, calculate the area code and site code of the corresponding data, and then the corresponding primary Site access service; when there is a problem with the primary site, it will calculate the corresponding area code and site code of the corresponding HA secondary data, so the user will HA seconda The site of ry continues to issue access actions; if the site of the HA secondary is still invalid, the system will calculate the area code and site code of the corresponding remote backup data of the backup data. The remote backup's site sends the last access action.
TW102103882A 2013-02-01 2013-02-01 The Dynamic Storage Configuration System and Method of Cloud Group Group Data Room TWI493933B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
TW102103882A TWI493933B (en) 2013-02-01 2013-02-01 The Dynamic Storage Configuration System and Method of Cloud Group Group Data Room

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
TW102103882A TWI493933B (en) 2013-02-01 2013-02-01 The Dynamic Storage Configuration System and Method of Cloud Group Group Data Room

Publications (2)

Publication Number Publication Date
TW201433124A true TW201433124A (en) 2014-08-16
TWI493933B TWI493933B (en) 2015-07-21

Family

ID=51797549

Family Applications (1)

Application Number Title Priority Date Filing Date
TW102103882A TWI493933B (en) 2013-02-01 2013-02-01 The Dynamic Storage Configuration System and Method of Cloud Group Group Data Room

Country Status (1)

Country Link
TW (1) TWI493933B (en)

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
TWI580217B (en) * 2015-02-05 2017-04-21 物聯智慧科技(深圳)有限公司 Management server and the operation method thereof and server system
TWI587217B (en) * 2016-03-07 2017-06-11 威聯通科技股份有限公司 Electronic apparatus and method for expanding storage capacity of electronic apparatus
TWI645300B (en) * 2014-11-12 2018-12-21 鴻海精密工業股份有限公司 Storage management system, management device and method thereof
TWI710915B (en) * 2017-02-27 2020-11-21 大陸商騰訊科技(深圳)有限公司 Resource processing method based on internet data center, related devices and communication system

Families Citing this family (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107967173A (en) * 2016-10-20 2018-04-27 阿里巴巴集团控股有限公司 A kind of methods, devices and systems of scheduling of resource
TWI661313B (en) * 2018-02-26 2019-06-01 中華電信股份有限公司 System and method for allocation of cloud resources

Family Cites Families (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
TW201220073A (en) * 2010-11-09 2012-05-16 Chunghwa Telecom Co Ltd utilizing flexibility of cloud computing technologies to support system resources so that the size of data accessing space and the CPU number can be changed with high mobility
TWI446288B (en) * 2011-06-28 2014-07-21 Chunghwa Telecom Co Ltd User requirements service optimization classification system and method

Cited By (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
TWI645300B (en) * 2014-11-12 2018-12-21 鴻海精密工業股份有限公司 Storage management system, management device and method thereof
TWI580217B (en) * 2015-02-05 2017-04-21 物聯智慧科技(深圳)有限公司 Management server and the operation method thereof and server system
US10193965B2 (en) 2015-02-05 2019-01-29 Throughtek Technology (Shenzhen) Co., Ltd. Management server and operation method thereof and server system
TWI587217B (en) * 2016-03-07 2017-06-11 威聯通科技股份有限公司 Electronic apparatus and method for expanding storage capacity of electronic apparatus
US10178172B2 (en) 2016-03-07 2019-01-08 Qnap Systems, Inc. Electronic apparatus and method for expanding storage capacity of electronic apparatus
TWI710915B (en) * 2017-02-27 2020-11-21 大陸商騰訊科技(深圳)有限公司 Resource processing method based on internet data center, related devices and communication system

Also Published As

Publication number Publication date
TWI493933B (en) 2015-07-21

Similar Documents

Publication Publication Date Title
TWI493933B (en) The Dynamic Storage Configuration System and Method of Cloud Group Group Data Room
KR101242458B1 (en) Intelligent virtual storage service system and method thereof
US9137148B2 (en) Information processing system and information processing apparatus
US9237195B2 (en) Virtual storage appliance gateway
WO2017162179A1 (en) Load rebalancing method and apparatus for use in storage system
JP6121527B2 (en) Computer system and resource management method
US7565508B2 (en) Allocating clusters to storage partitions in a storage system
US20120278669A1 (en) Runtime dynamic performance skew elimination
JP2005216151A (en) Resource operation management system and resource operation management method
US7716419B2 (en) Storage system and load balancing method thereof
US8713218B2 (en) Non-disruptive configuration of a virtualization controller in a data storage system
US20170199694A1 (en) Systems and methods for dynamic storage allocation among storage servers
WO2017167106A1 (en) Storage system
CN104184837A (en) High-availability cloud computing all-in-one machine
CN113849136B (en) Automatic FC block storage processing method and system based on domestic platform
Dufrasne et al. IBM DS8870 Architecture and Implementation (release 7.5)
Dufrasne et al. Ibm system storage ds8700 architecture and implementation
Tulloch et al. Introducing Windows Server 2012 R2
EP4281853A1 (en) Method and system for distributed lvm
Mitchell Introduction to VMware vSAN™ for VMware Cloud Providers™
JP6398417B2 (en) Storage device, storage system, and storage control program
US9143410B1 (en) Techniques for monitoring guest domains configured with alternate I/O domains
Mitchell Introduction to VMware vSAN™ for VMware vCloud Air™ Network
Dufrasne et al. IBM XIV Storage System Architecture and Implementation
Salapura et al. Enabling enterprise-level workloads in the enterprise-class cloud

Legal Events

Date Code Title Description
MM4A Annulment or lapse of patent due to non-payment of fees