CN105550238A - Architecture system of database appliance - Google Patents
Architecture system of database appliance Download PDFInfo
- Publication number
- CN105550238A CN105550238A CN201510893660.1A CN201510893660A CN105550238A CN 105550238 A CN105550238 A CN 105550238A CN 201510893660 A CN201510893660 A CN 201510893660A CN 105550238 A CN105550238 A CN 105550238A
- Authority
- CN
- China
- Prior art keywords
- node
- data
- storage
- architecture system
- computing node
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/10—File systems; File servers
- G06F16/18—File system types
- G06F16/182—Distributed file systems
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/10—File systems; File servers
- G06F16/18—File system types
- G06F16/182—Distributed file systems
- G06F16/1824—Distributed file systems implemented using Network-attached Storage [NAS] architecture
- G06F16/183—Provision of network file services by network file servers, e.g. by using NFS, CIFS
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/21—Design, administration or maintenance of databases
- G06F16/211—Schema design and management
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Databases & Information Systems (AREA)
- Data Mining & Analysis (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
The invention discloses an architecture system of a database appliance. The system comprises a calculation node for executing data calculation, inquiry and updating operation, a storage node for providing a data storage service for the calculation node, and a network node for allowing the calculation node and the storage node to perform data interaction through a remote direct memory access (RDMA) protocol. In data interaction between the storage node and the calculation node, according to RDMA, data is directly transmitted into a storage region of a computer through the network without affecting the operation system of the storage node or the calculation node, so that few processing functions of the computer are used, and the execution efficiency is improved. Operations of replication by an external storer and text exchange are saved, so that less internal storage bandwidth is used and fewer CPU cycles are occupied, application system performance is improved, and the resource use ratio is improved.
Description
Technical field
The present invention relates to department of computer science to unify database technical field, particularly relate to a kind of architecture system of database all-in-one.
Background technology
At present, large data will change the decision mode of the mankind and the socioeconomic method of operation deeply.The famous research firm Mai Kenxi in the whole world points out in nearest research report, current data has penetrated into each industry and operation function field, become the important factor of production gradually, large data will promote productivity dynamics and innovation, utilization for mass data will imply that the arrival of a new ripple increase in productivity and consumer surplus's tide, enter today of information age in the whole world, data have become the national strategy resource of equal importance with water, oil, rock gas comprehensively.
Large data all-in-one machine (BigDataAppliance) be a kind of aim at mass data analyzing and processing and product that the soft and hardware that designs combines, by one group of integrated server, memory device, operating system, data base management system (DBMS) and some be data query, process, analysis purposes and to install in advance especially and the software optimized forms, provide solution for medium to large-scale data warehouse market (usual data volume is in TB to PB rank).
Now commercially main database all-in-one is the all-in-one of the inscriptions on bones or tortoise shells (Oracle) company, but, the framework of the all-in-one of the inscriptions on bones or tortoise shells is complicated, closed, carry out between memory node and computing node in the process of data interaction, data need via respective CPU perform external memory storage copy with text exchange operation after just can arrive at respective memory block, these processing procedures need to take too much memory bandwidth and cpu cycle, reduce execution efficiency and resource utilization.
Summary of the invention
In view of this, the invention provides a kind of architecture system of database all-in-one, to improve execution efficiency and the resource utilization of database all-in-one.
For solving the problems of the technologies described above, the invention provides a kind of architecture system of database all-in-one, comprising:
Calculate for performing data, inquiry and the computing node of renewal rewards theory;
For providing the memory node of operational data storage for described computing node;
For making the network node being carried out data interaction between described computing node and described memory node by rdma protocol.
Preferably, described computing node is provided with oracle database software.
Preferably, described computing node is OracleRAC node.
Preferably, described network node is the switch supporting how concurrent link at a high speed.
Preferably, the described switch supporting how concurrent link is at a high speed wireless bandwidth switch.
Preferably, described memory node is distributed file system.
The architecture system of a kind of database all-in-one provided by the invention above, comprise computing node, memory node and network node, wherein, computing node calculating for performing data, inquiring about and renewal rewards theory, memory node is used for providing operational data storage for described computing node, especially, network node is for making the network node being carried out data interaction between above-mentioned computing node and memory node by rdma protocol.Carry out between memory node and computing node in the process of data interaction, RDMA directly imports data into the memory block of computing machine by network, and the operating system of memory node or computing node is not had any impact, so just do not need the processing capacity using how many computing machines, improve execution efficiency, which eliminate external memory storage to copy and text exchange operation, thus it can liberate memory bandwidth and cpu cycle for improvement of application system performance, improves resource utilization simultaneously.
Accompanying drawing explanation
In order to be illustrated more clearly in the embodiment of the present invention or technical scheme of the prior art, be briefly described to the accompanying drawing used required in embodiment or description of the prior art below, apparently, accompanying drawing in the following describes is only embodiments of the invention, for those of ordinary skill in the art, under the prerequisite not paying creative work, other accompanying drawing can also be obtained according to the accompanying drawing provided.
The structural representation of the architecture system of a kind of database all-in-one that Fig. 1 provides for the embodiment of the present invention;
A kind of application scenarios figure based on Fig. 1 that Fig. 2 provides for the embodiment of the present invention.
Embodiment
Below in conjunction with the accompanying drawing in the embodiment of the present invention, be clearly and completely described the technical scheme in the embodiment of the present invention, obviously, described embodiment is only the present invention's part embodiment, instead of whole embodiments.Based on the embodiment in the present invention, those of ordinary skill in the art, not making the every other embodiment obtained under creative work prerequisite, belong to the scope of protection of the invention.
Core of the present invention is to provide a kind of architecture system of database all-in-one, to improve execution efficiency and the resource utilization of database all-in-one.
In order to make those skilled in the art person understand the present invention program better, below in conjunction with the drawings and specific embodiments, the present invention is described in further detail.
Show the structural representation of the architecture system of a kind of database all-in-one that the embodiment of the present invention provides with reference to figure 1 and Fig. 2, Fig. 1, Fig. 2 shows a kind of application scenarios figure based on Fig. 1, and particularly, this architecture system 100 can comprise following content:
Calculate for performing data, inquiry and the computing node 101 of renewal rewards theory;
For providing the memory node 103 of operational data storage for computing node 101;
For making the network node 102 being carried out data interaction between computing node 101 and memory node 103 by rdma protocol.
Computing node 101 is used for installing corresponding oracle database software, and this computing node 101 is OracleRAC node further.Wherein, RAC, full name realapplicationclusters, be translated into " Real Application Clusters ", and being the new technology adopted in Oracle new edition database, is the one of high availability, is also the core technology that oracle database supports grid computing environment.In specific implementation process, can with reference to the installation to oracle database software in computing node of following codes implement:
./runInstaller-silent-responseFile/export/home/oracle/database/response/dd.rsp
It should be noted that, above-mentioned code be only used to be convenient to those skilled in the art understand and implement technical scheme provided by the present invention and for example, those skilled in the art can write according to actual conditions, and the present invention does not do considered critical at this.Lower same.
Network node 102 for data are transferred to memory node 103 from computing node 101 rapidly, and by the data fast transport on memory node 103 to computing node 101.It can adopt is the switch supporting how concurrent link at a high speed, in actual applications, wireless bandwidth (Infiniband) switch can being adopted as network node 102, transmitting for providing the data based on rdma protocol between computing node 101 and memory node 103.
Memory node 103 adopts distributed file system, and the storage of this locality is converted to block device, is then supplied to the computing node 101 on upper strata.In specific implementation process, can with reference to the installation of following codes implement distributed file system:
yuminstallceph-deploy。
To sum up, transmit due to the data between computing node 101 and memory node 103 and use RMDA (RemoteDirectMemoryAccess--full name remote direct data accesses) agreement, this technology produces to solve the delay of servers' data process in Internet Transmission.Therefore, carry out between memory node 103 and computing node 101 in the process of data interaction, RDMA directly imports data into the memory block of computing machine by network, and the operating system of memory node 103 or computing node 101 is not had any impact, so just do not need the processing capacity using how many computing machines, improve execution efficiency, which eliminate external memory storage to copy and operate with text exchange simultaneously, thus it can liberate memory bandwidth and cpu cycle for improvement of application system performance, improves resource utilization.
Above the architecture system of a kind of database all-in-one provided by the present invention is described in detail.Apply specific case herein to set forth principle of the present invention and embodiment, the explanation of above embodiment just understands method of the present invention and core concept thereof for helping.It should be pointed out that for those skilled in the art, under the premise without departing from the principles of the invention, can also carry out some improvement and modification to the present invention, these improve and modify and also fall in the protection domain of the claims in the present invention.
Claims (6)
1. an architecture system for database all-in-one, is characterized in that, comprising:
Calculate for performing data, inquiry and the computing node of renewal rewards theory;
For providing the memory node of operational data storage for described computing node;
For making the network node being carried out data interaction between described computing node and described memory node by rdma protocol.
2. architecture system as claimed in claim 1, it is characterized in that, described computing node is provided with oracle database software.
3. architecture system as claimed in claim 2, it is characterized in that, described computing node is OracleRAC node.
4. architecture system as claimed in claim 1, is characterized in that, described network node is the switch supporting how concurrent link at a high speed.
5. architecture system as claimed in claim 4, is characterized in that, the described switch supporting how concurrent link is at a high speed wireless bandwidth switch.
6. the architecture system as described in claim 1 to 5 any one, is characterized in that, described memory node is distributed file system.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201510893660.1A CN105550238A (en) | 2015-11-27 | 2015-11-27 | Architecture system of database appliance |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201510893660.1A CN105550238A (en) | 2015-11-27 | 2015-11-27 | Architecture system of database appliance |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN105550238A true CN105550238A (en) | 2016-05-04 |
Family
ID=55829427
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201510893660.1A Pending CN105550238A (en) | 2015-11-27 | 2015-11-27 | Architecture system of database appliance |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN105550238A (en) |
Cited By (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106776815A (en) * | 2016-11-24 | 2017-05-31 | 上海交通大学 | RDMA based on multi-mode switching friendly SPARQL querying methods |
| CN107391342A (en) * | 2017-07-21 | 2017-11-24 | 郑州云海信息技术有限公司 | A kind of database all-in-one and its monitoring method |
| CN108491274A (en) * | 2018-04-02 | 2018-09-04 | 深圳市华傲数据技术有限公司 | Optimization method, device, storage medium and the equipment of distributed data management |
| CN108762673A (en) * | 2018-05-24 | 2018-11-06 | 浪潮电子信息产业股份有限公司 | A kind of remote data access processing system |
| CN114661637A (en) * | 2022-02-28 | 2022-06-24 | 中国科学院上海天文台 | Data processing system and method for radio astronomical data intensive scientific operation |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102937997A (en) * | 2012-11-26 | 2013-02-20 | 曙光信息产业(北京)有限公司 | Data processing system |
| CN103873559A (en) * | 2014-02-13 | 2014-06-18 | 南京斯坦德通信股份有限公司 | Database all-in-one machine capable of realizing high-speed storage |
| WO2015034584A1 (en) * | 2013-09-05 | 2015-03-12 | Google Inc. | Isolating clients of distributed storage systems |
-
2015
- 2015-11-27 CN CN201510893660.1A patent/CN105550238A/en active Pending
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102937997A (en) * | 2012-11-26 | 2013-02-20 | 曙光信息产业(北京)有限公司 | Data processing system |
| WO2015034584A1 (en) * | 2013-09-05 | 2015-03-12 | Google Inc. | Isolating clients of distributed storage systems |
| CN103873559A (en) * | 2014-02-13 | 2014-06-18 | 南京斯坦德通信股份有限公司 | Database all-in-one machine capable of realizing high-speed storage |
Cited By (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106776815A (en) * | 2016-11-24 | 2017-05-31 | 上海交通大学 | RDMA based on multi-mode switching friendly SPARQL querying methods |
| CN106776815B (en) * | 2016-11-24 | 2020-07-14 | 上海交通大学 | RDMA friendly SPARQ L query method based on multi-mode switching |
| CN107391342A (en) * | 2017-07-21 | 2017-11-24 | 郑州云海信息技术有限公司 | A kind of database all-in-one and its monitoring method |
| CN108491274A (en) * | 2018-04-02 | 2018-09-04 | 深圳市华傲数据技术有限公司 | Optimization method, device, storage medium and the equipment of distributed data management |
| CN108762673A (en) * | 2018-05-24 | 2018-11-06 | 浪潮电子信息产业股份有限公司 | A kind of remote data access processing system |
| CN114661637A (en) * | 2022-02-28 | 2022-06-24 | 中国科学院上海天文台 | Data processing system and method for radio astronomical data intensive scientific operation |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN109643312B (en) | Hosted query service | |
| Dayal et al. | Flexpath: Type-based publish/subscribe system for large-scale science analytics | |
| CN105550238A (en) | Architecture system of database appliance | |
| CN103078941B (en) | A kind of method for scheduling task of distributed computing system | |
| Xu et al. | Dynamic resource provisioning for workflow scheduling under uncertainty in edge computing environment | |
| WO2016165392A1 (en) | Genetic algorithm-based cloud computing resource scheduling method | |
| US20190034833A1 (en) | Model Training Method and Apparatus | |
| Lu et al. | Research on Hadoop cloud computing model and its applications | |
| Essa et al. | Mobile agent based new framework for improving big data analysis | |
| CN102662639A (en) | Mapreduce-based multi-GPU (Graphic Processing Unit) cooperative computing method | |
| CN109150738A (en) | Industry internet method for managing resource and system, readable storage medium storing program for executing and terminal | |
| CN102254024A (en) | Mass data processing system and method | |
| CN106168993B (en) | Real-time simulation analysis system for power grid | |
| CN103442036A (en) | System integrating design development, post production and data storage and based on cloud platform | |
| JP2015007968A (en) | Systems and methods for synchronizing geographic information system (gis) network models | |
| Liu et al. | On construction of an energy monitoring service using big data technology for smart campus | |
| Li et al. | Wide-area spark streaming: Automated routing and batch sizing | |
| CN112214541A (en) | Deep decoupling and data cooperation method for power monitoring data | |
| CN112035563A (en) | Real-time database system based on shared storage | |
| CN203301532U (en) | Cloud desktop system | |
| CN104299170B (en) | Intermittent energy source mass data processing method | |
| CN104346441B (en) | A kind of power distribution network information data dynamic integrity exchange method | |
| Saab et al. | Energy efficiency in mobile cloud computing: Total offloading selectively works. does selective offloading totally work? | |
| Datta et al. | ANGELS: A framework for mobile grids | |
| Li et al. | Innovation in advanced manufacturing driven by supercomputing |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20160504 |
|
| RJ01 | Rejection of invention patent application after publication |