CN102724292A - Real-time database cluster architecture of control system of accelerator and establishment method thereof - Google Patents
Real-time database cluster architecture of control system of accelerator and establishment method thereof Download PDFInfo
- Publication number
- CN102724292A CN102724292A CN2012101632194A CN201210163219A CN102724292A CN 102724292 A CN102724292 A CN 102724292A CN 2012101632194 A CN2012101632194 A CN 2012101632194A CN 201210163219 A CN201210163219 A CN 201210163219A CN 102724292 A CN102724292 A CN 102724292A
- Authority
- CN
- China
- Prior art keywords
- real
- oracle
- control system
- accelerator control
- architecture
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 16
- 239000013307 optical fiber Substances 0.000 claims abstract description 11
- 238000005192 partition Methods 0.000 claims description 22
- 239000004744 fabric Substances 0.000 claims description 13
- 238000000638 solvent extraction Methods 0.000 claims description 12
- 239000000835 fiber Substances 0.000 claims description 9
- 238000005070 sampling Methods 0.000 claims description 4
- 238000005516 engineering process Methods 0.000 abstract description 4
- 230000006870 function Effects 0.000 abstract description 4
- 230000004044 response Effects 0.000 description 4
- 230000002354 daily effect Effects 0.000 description 2
- 230000003203 everyday effect Effects 0.000 description 2
- 238000012423 maintenance Methods 0.000 description 2
- 238000011084 recovery Methods 0.000 description 2
- OKLGKGPAZUNROU-YUMQZZPRSA-N 2-amino-2-deoxyisochorismic acid Chemical compound N[C@@H]1[C@@H](OC(=C)C(O)=O)C=CC=C1C(O)=O OKLGKGPAZUNROU-YUMQZZPRSA-N 0.000 description 1
- 238000007796 conventional method Methods 0.000 description 1
- 238000013500 data storage Methods 0.000 description 1
- 238000010586 diagram Methods 0.000 description 1
- 230000009977 dual effect Effects 0.000 description 1
- 238000000605 extraction Methods 0.000 description 1
- 238000002347 injection Methods 0.000 description 1
- 239000007924 injection Substances 0.000 description 1
- 238000005259 measurement Methods 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 238000012545 processing Methods 0.000 description 1
- 230000000717 retained effect Effects 0.000 description 1
- 239000000243 solution Substances 0.000 description 1
- 238000012795 verification Methods 0.000 description 1
Images
Landscapes
- Computer And Data Communications (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
The invention relates to a real-time database cluster architecture of a control system of an accelerator and an establishment method thereof. The architecture comprises a plurality of Oracle database servers connected with the control system of the accelerator through an IP (Internet protocol) network; and an SAN (storage area network) storage network system connected with the Oracle database servers through at least one optical fiber switcher, wherein the SAN storage network system comprises a core storage device connected with the optical fiber switcher. According to the architecture disclosed by the invention, an Oracle RAC (real application cluster) technology is taken as a start point, by adopting the plurality of the Oracle database servers and an Oracle cluster technology thereof, the high usability of the whole database cluster architecture is effectively improved, the architecture further has the functions of load equalization, fault tolerance and seamless switching, and the influence caused by error in hardware and software of the architecture is minimized; and furthermore, a high-capacity and high-speed data backup system is provided for the control system of the accelerator by adopting the SAN storage network system, and data protection can be realized to the greatest extent.
Description
Technical Field
The invention relates to a real-time database cluster structure of an accelerator control system and an establishing method thereof.
Background
The accelerator control system is a large-scale distributed real-time control system, implements comprehensive operation control on equipment such as a linear accelerator, an intensifier, a storage ring and the like, and generally comprises a magnet power supply system control, a vacuum system control, a beam measurement system control, a high-frequency system control, an injection and extraction system control, a timing system control, a safety interlocking system control and the like.
In the operation process of the accelerator control system, real-time data required to be collected every second are recorded by more than ten thousand, the data volume generated every day can reach GB level, the operation data recorded in one year is near TB level, even the data volume of a single table can reach hundreds of billions of records, the record number can be increased along with time, and a data file breaks through hundreds of GB quickly, so that the operation efficiency of a database is influenced, and the maintenance difficulty of the database is increased.
Therefore, it is very difficult to manage these massive real-time collected data by using the conventional method, and especially, a large amount of I/O competition is brought by concurrent access to the database in a multi-user environment, so that the access efficiency is very low. Therefore, how to improve the high availability and response speed of the accelerator control system real-time database becomes a big problem.
Disclosure of Invention
In order to solve the problems of the prior art, the present invention aims to provide a real-time database cluster architecture of an accelerator control system and a method for establishing the same, so as to improve the high availability and response speed of a real-time database.
One of the real-time database cluster architecture of the accelerator control system of the present invention comprises:
a plurality of Oracle database servers connected with the accelerator control system through an IP network; and
the SAN storage network system is connected with the Oracle database server through at least one optical fiber switch; wherein,
the SAN storage network system includes a core storage device connected to the fabric switch.
In the above real-time database cluster architecture of the accelerator control system, the architecture further includes a gateway device connected to the IP network and connected to the fabric switch.
In the real-time database cluster architecture of the accelerator control system, the SAN storage network system further includes a tape library connected to the fabric switch.
In the above real-time database cluster architecture of the accelerator control system, the tape library comprises tape drives with fibre-optic interfaces.
In the real-time database cluster architecture of the accelerator control system, the core storage device includes an optical fiber hard disk, a global hot spare disk and an independent redundant disk array.
In the real-time database cluster architecture of the accelerator control system, the Oracle database server includes a fibre channel card connected to the fibre switch.
The second method for establishing the real-time database cluster architecture of the accelerator control system comprises the following steps:
step one, building a real-time database cluster structure, comprising:
connecting a plurality of Oracle database servers to the accelerator control system through an IP network; and
connecting the Oracle database server to a SAN storage network system having a core storage device through at least one fabric switch;
partitioning a data table used for recording the operating data of the accelerator control system in the Oracle database server by adopting an Oracle partitioning tool according to preset sampling time to form a partitioning table;
and thirdly, setting a multi-level backup strategy of the Oracle database server by adopting an Oracle RMAN tool so as to backup the data in the Oracle database server to the core storage device according to the multi-level backup strategy.
In the method for establishing the real-time database cluster architecture of the accelerator control system, the first step further includes connecting a gateway device to the IP network, and connecting the gateway device to the fabric switch.
In the method for establishing the real-time database cluster architecture of the accelerator control system, the second step further includes maintaining the partition table by using an Oracle partition tool.
By adopting the technical solution, the invention takes Oracle RAC technology as a starting point, and effectively improves the high availability of the whole database cluster architecture by adopting a plurality of Oracle database servers and Oracle cluster technology thereof, so that the architecture has the functions of load balancing, fault tolerance and seamless switching, and the influence caused by hardware and software errors of the architecture is minimized; and a large-capacity and high-speed data backup system is provided for the accelerator control system by adopting the SAN storage network system, so that data protection is realized to the maximum extent. The invention also partitions the data table with huge data volume in the Oracle database server by adopting an Oracle partitioning tool, so that the operations of adding, inquiring and the like to the data table can be decomposed into different partitions of the data table to be processed in parallel, and the response speed of the table is further improved; meanwhile, the database files, the filing logs and the control files are backed up and restored by adopting an Oracle RMAN tool, so that online hot backup and multi-level incremental backup are easily realized.
Drawings
Fig. 1 is a schematic structural diagram of a real-time database cluster architecture of an accelerator control system according to the present invention.
Detailed Description
The preferred embodiments of the present invention will be described in detail below with reference to the accompanying drawings.
As shown in fig. 1, one embodiment of the present invention, namely, a real-time database cluster architecture of an accelerator control system, includes:
four Oracle database servers 1 connected to an accelerator control system (not shown) through an IP network 4, each Oracle database server 1 including a fiber channel card (not shown) connected to a fiber switch 2;
SAN memory network system 3 connected with Oracle database server 1 through two optical fiber switches 2; and
and a gateway device 5 connected to the IP network 4 and connected to the fabric switch 2.
The SAN storage network system 3 includes a core storage device 31 and a tape library 32 connected to the fabric switch 2, wherein: the core storage device 31 includes a fiber hard disk, a global hot spare disk and an independent redundant disk array (not shown); the tape library 32 comprises tape drives (not shown) with fiber optic interfaces.
In this embodiment, four HP 580G3PC machines are used as the Oracle database server 1, the SAN storage network system 3 is used as the data storage device, two optical fiber switches 2 are used as the connecting component, each Oracle database server 1 adopts a Xeon processor, has 32 GRAMs and 3 gigabit ethernet ports, and is accessed to the SAN storage network system 3 by adding a dual optical fiber channel card.
In this embodiment, the EMC CX-80 disk array is used as the core storage device 31, and the EMCCX-80 disk array adopts a fully redundant high-reliability architecture, so that the whole core storage device 31 does not have any single point of failure from the host access end to the back-end extension end, thereby ensuring high availability of data; meanwhile, 35 blocks of 300GB optical fiber hard disks are configured in the entire core storage device 31, the bare capacity of the system can reach 10.5TB, and the actual available space of the core storage device 31 can reach more than 8TB except the space occupied by the verification data of the global hot spare Disk and the Redundant Array of Independent Disks (RAID).
In this embodiment, a tape library 32 of the ADIC Scalar i500 type is adopted, and the tape library 32 is configured with two LTO3 tape drives with optical fiber interfaces, and there are 36 tape slots in total, which can provide a complete backup space for all data in the core storage device 31; meanwhile, the function module of backup software of the system is matched, the LAN-Free of data backup (namely, data can be directly backed up without passing through a local area network) can be realized, a high-capacity and high-speed data backup system is realized, and data protection is realized to the maximum extent.
Since the application based on the file sharing method needs to be used in the IP network 4 while the SAN storage network system 3 is built, the present embodiment employs one EMC NS40G NAS type gateway device 5. The gateway device itself is not equipped with a hard disk, is connected to a core storage device 31 utilizing a back end through an SAN network, and divides a part of special space on the core storage device 31 for the gateway device 5 to use; the data processor X-Blade of the EMC NS40G NAS-type gateway device 5 may simulate one or more file servers of Windows or Unix platforms, and provide a high-speed and large-capacity file sharing space for servers and terminals of the user IP network.
The second method for establishing the real-time database cluster architecture of the accelerator control system comprises the following steps:
step one, build the real-time database cluster architecture like the above-mentioned structure, include:
connecting four Oracle database servers 1 to an accelerator control system through an IP network 4;
connecting the Oracle database server 1 to a SAN storage network system 32 with a core storage device 31 through two fabric switches 2; and
connecting a gateway device 5 to the IP network 4, and connecting the gateway device 5 to the optical fiber switch 2;
partitioning a data table used for recording the running data of the accelerator control system in the Oracle database server 1 by adopting an Oracle partitioning tool according to preset sampling time to form a partitioning table; and maintaining a partition table by adopting an Oracle partition tool;
and step three, setting a multi-level backup strategy of the Oracle database server 1 by adopting an Oracle RMAN tool so as to backup the data in the Oracle database server 1 to the core storage device 31 according to the multi-level backup strategy.
In the second step, since the size of the data table recording all the operation data of the accelerator control system is as high as hundreds of GB, the more average the value distribution of the partition keys is, the more equal the space size of each partition is, and the more balanced the disk I/O load is; in this embodiment, a preset sampling time is used as a partition key, and a Local index is used to partition different partitions in a one-month time range, while partition data of approximately 2 years is retained. The second step can be realized by adopting an own Oracle partitioning tool of the Oracle database server 1, and meanwhile, the partition table can be maintained by adopting methods provided by the Oracle partitioning tool, such as moving partitions, adding partitions, splitting partitions, deleting partitions, combining partitions, merging partitions, exchanging table partitions and the like.
In step three, the Oracle RMAN tool is a tool carried by the Oracle database server 1, and there are two modes of operation by this tool when backing up data: incremental and complete, therefore, a multi-level backup strategy can be set by utilizing an Oracle RMAN tool to realize daily backup and maintenance of the data table; for example, the multi-level backup strategy includes: the method comprises the steps of performing full backup of a database (comprising all data and read-only table space) every half year, performing zero-level backup (not comprising read-only table space) every month, performing primary backup every week and performing secondary backup every day. The correct backup strategy can not only ensure the 24 × 7 high-performance operation of the database server, but also ensure the rapidity and reliability of backup and recovery. The multi-stage backup strategy is adopted to reduce the time required by daily backup and ensure good recovery of the system.
In conclusion, the invention improves the high availability and the response speed of the database cluster architecture of the accelerator control system, and enables the architecture to have the functions of load balancing, fault switching and concurrent processing.
The above embodiments are merely preferred embodiments of the present invention, which are not intended to limit the scope of the present invention, and various changes may be made in the above embodiments of the present invention. All simple and equivalent changes and modifications made according to the claims and the content of the specification of the present application fall within the scope of the claims of the present patent application. The invention has not been described in detail in order to avoid obscuring the invention.
Claims (9)
1. A real-time database cluster architecture for an accelerator control system, the architecture comprising:
a plurality of Oracle database servers connected with the accelerator control system through an IP network; and
the SAN storage network system is connected with the Oracle database server through at least one optical fiber switch; wherein,
the SAN storage network system includes a core storage device connected to the fabric switch.
2. The real-time database cluster architecture of accelerator control systems of claim 1, further comprising a gateway device connected on the IP network and connected with the fabric switch.
3. The real-time database cluster architecture of accelerator control systems of claim 1 or 2, wherein the SAN storage network system further comprises a tape library connected to the fabric switch.
4. The real-time database cluster architecture of accelerator control systems of claim 3, wherein the tape library comprises tape drives with fiber optic interfaces.
5. A real-time database cluster architecture for an accelerator control system according to claim 1, 2 or 4, wherein the core storage devices comprise fibre-optic hard disks, global hot spare disks and redundant array of independent disks.
6. The real-time database cluster architecture of accelerator control systems of claim 5, wherein the Oracle database server comprises a fibre channel card connected to the fibre switch.
7. A method for establishing a real-time database cluster architecture of an accelerator control system is characterized by comprising the following steps:
step one, building a real-time database cluster structure, comprising:
connecting a plurality of Oracle database servers to the accelerator control system through an IP network; and
connecting the Oracle database server to a SAN storage network system having a core storage device through at least one fabric switch;
partitioning a data table used for recording the operating data of the accelerator control system in the Oracle database server by adopting an Oracle partitioning tool according to preset sampling time to form a partitioning table;
and thirdly, setting a multi-level backup strategy of the Oracle database server by adopting an Oracle RMAN tool so as to backup the data in the Oracle database server to the core storage device according to the multi-level backup strategy.
8. The method for establishing a real-time database cluster architecture of an accelerator control system according to claim 7, wherein the first step further comprises connecting a gateway device to the IP network and connecting the gateway device to the fabric switch.
9. The method for establishing the real-time database cluster architecture of the accelerator control system according to claim 7 or 8, wherein the second step further comprises maintaining the partition table by using an Oracle partition tool.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN2012101632194A CN102724292A (en) | 2012-05-22 | 2012-05-22 | Real-time database cluster architecture of control system of accelerator and establishment method thereof |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN2012101632194A CN102724292A (en) | 2012-05-22 | 2012-05-22 | Real-time database cluster architecture of control system of accelerator and establishment method thereof |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN102724292A true CN102724292A (en) | 2012-10-10 |
Family
ID=46949953
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN2012101632194A Pending CN102724292A (en) | 2012-05-22 | 2012-05-22 | Real-time database cluster architecture of control system of accelerator and establishment method thereof |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN102724292A (en) |
Cited By (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103186673A (en) * | 2013-03-30 | 2013-07-03 | 马钢控制技术有限责任公司 | Massive data storage and inquiry method |
| CN104049690A (en) * | 2014-06-10 | 2014-09-17 | 浪潮电子信息产业股份有限公司 | Model design method by using critical application host to cope with high concurrent business |
| CN104852969A (en) * | 2015-04-24 | 2015-08-19 | 昆明船舶设备集团有限公司 | Highly reliable RAC and HANS system fusion |
| CN105045527A (en) * | 2015-06-16 | 2015-11-11 | 重庆本原致创科技发展有限公司 | Optimization method and system for data storage of large-scale community |
| CN108123975A (en) * | 2016-11-30 | 2018-06-05 | 天津易遨在线科技有限公司 | A kind of distributed search optimizes server cluster framework |
| CN110597658A (en) * | 2019-08-16 | 2019-12-20 | 上海爱数信息技术股份有限公司 | Tape backup system supporting cluster and method thereof |
| CN114138750A (en) * | 2021-12-03 | 2022-03-04 | 无锡星凝互动科技有限公司 | AI consultation database cluster building method and system |
| CN115801986A (en) * | 2021-09-08 | 2023-03-14 | 河南中核五院研究设计有限公司 | Multi-level hardware architecture for long-term storage of special material monitoring data |
Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1698033A (en) * | 2001-11-30 | 2005-11-16 | 甲骨文国际公司 | System and method for actively managing an enterprise of configurable components |
| CN102012947A (en) * | 2010-12-16 | 2011-04-13 | 创新科存储技术有限公司 | Method and system for online backup of database |
-
2012
- 2012-05-22 CN CN2012101632194A patent/CN102724292A/en active Pending
Patent Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1698033A (en) * | 2001-11-30 | 2005-11-16 | 甲骨文国际公司 | System and method for actively managing an enterprise of configurable components |
| CN102012947A (en) * | 2010-12-16 | 2011-04-13 | 创新科存储技术有限公司 | Method and system for online backup of database |
Non-Patent Citations (1)
| Title |
|---|
| 颜靓: "Oracle高可用技术在贵州地税数据中心中的集成应用", 《湖北大学硕士学位论文》 * |
Cited By (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103186673A (en) * | 2013-03-30 | 2013-07-03 | 马钢控制技术有限责任公司 | Massive data storage and inquiry method |
| CN104049690A (en) * | 2014-06-10 | 2014-09-17 | 浪潮电子信息产业股份有限公司 | Model design method by using critical application host to cope with high concurrent business |
| CN104852969A (en) * | 2015-04-24 | 2015-08-19 | 昆明船舶设备集团有限公司 | Highly reliable RAC and HANS system fusion |
| CN105045527A (en) * | 2015-06-16 | 2015-11-11 | 重庆本原致创科技发展有限公司 | Optimization method and system for data storage of large-scale community |
| CN108123975A (en) * | 2016-11-30 | 2018-06-05 | 天津易遨在线科技有限公司 | A kind of distributed search optimizes server cluster framework |
| CN110597658A (en) * | 2019-08-16 | 2019-12-20 | 上海爱数信息技术股份有限公司 | Tape backup system supporting cluster and method thereof |
| CN115801986A (en) * | 2021-09-08 | 2023-03-14 | 河南中核五院研究设计有限公司 | Multi-level hardware architecture for long-term storage of special material monitoring data |
| CN114138750A (en) * | 2021-12-03 | 2022-03-04 | 无锡星凝互动科技有限公司 | AI consultation database cluster building method and system |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN102724292A (en) | Real-time database cluster architecture of control system of accelerator and establishment method thereof | |
| CN102521072B (en) | Virtual tape library equipment and data recovery method | |
| CN203982354U (en) | A kind of redundant storage system | |
| JP2015528962A (en) | High availability computer system | |
| CN102508913A (en) | Cloud computing system with data cube storage index structure | |
| Sun et al. | A novel approach to data deduplication over the engineering-oriented cloud systems | |
| CN102226892B (en) | Disk fault tolerance processing method and device thereof | |
| CN104135514A (en) | Integrated virtualized storing system | |
| CN102404201B (en) | Method of realizing maximum bandwidth of Lustre concurrent file system | |
| CN105187502A (en) | Method and system based on distributed elastic block storage | |
| CN102681790A (en) | Data dump device and method and system for data dump by same | |
| CN102243610A (en) | Operating system test method and test system | |
| US8996805B2 (en) | Shared cache module and method thereof | |
| CN106383861A (en) | Data synchronization method and apparatus used for databases | |
| CN106055276A (en) | Decentralized cluster storage system | |
| Donskov et al. | Data acquisition system of the OKA experiment | |
| CN112015337A (en) | System for connecting distributed NAS storage equipment based on block chain technology | |
| Ab Karim et al. | Ext4, XFS, BtrFS and ZFS Linux file systems on RADOS Block Devices (RBD): I/O performance, flexibility and ease of use comparisons | |
| CN203054824U (en) | Server storage system | |
| Patil | A study on evolution of storage infrastructure | |
| CN104113439A (en) | Automatic data recovery method of cloud storage system | |
| CN104166046A (en) | Transient signal processing method and transient signal processing system | |
| RU2716040C2 (en) | METHOD FOR CONSTRUCTING HIGH-PERFORMANCE FAULT-TOLERANT DATA STORAGE SYSTEMS BASED ON DISTRIBUTED FILE SYSTEMS AND NVMe OVER FABRICS | |
| CN201789513U (en) | High usable VTL (Virtual Tape Library) system capable of fast recovery | |
| CN112199329A (en) | Double-machine operation and maintenance data filing and cleaning method and equipment based on fortress machine |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C02 | Deemed withdrawal of patent application after publication (patent law 2001) | ||
| WD01 | Invention patent application deemed withdrawn after publication |
Application publication date: 20121010 |