CN106803218A - A kind of big data tutoring system based on virtualization and cloud computing - Google Patents

A kind of big data tutoring system based on virtualization and cloud computing Download PDF

Info

Publication number
CN106803218A
CN106803218A CN201710161632.XA CN201710161632A CN106803218A CN 106803218 A CN106803218 A CN 106803218A CN 201710161632 A CN201710161632 A CN 201710161632A CN 106803218 A CN106803218 A CN 106803218A
Authority
CN
China
Prior art keywords
server
experiment
template
software
cloud computing
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201710161632.XA
Other languages
Chinese (zh)
Inventor
雷建军
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Xi'an Excellent Information Technology Co Ltd
Original Assignee
Xi'an Excellent Information Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Xi'an Excellent Information Technology Co Ltd filed Critical Xi'an Excellent Information Technology Co Ltd
Priority to CN201710161632.XA priority Critical patent/CN106803218A/en
Publication of CN106803218A publication Critical patent/CN106803218A/en
Pending legal-status Critical Current

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06QINFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q50/00Systems or methods specially adapted for specific business sectors, e.g. utilities or tourism
    • G06Q50/10Services
    • G06Q50/20Education
    • GPHYSICS
    • G09EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09BEDUCATIONAL OR DEMONSTRATION APPLIANCES; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND, DEAF OR MUTE; MODELS; PLANETARIA; GLOBES; MAPS; DIAGRAMS
    • G09B19/00Teaching not covered by other main groups of this subclass
    • G09B19/0053Computers, e.g. programming

Abstract

The present invention relates to a kind of big data tutoring system based on virtualization and cloud computing, including server, management terminal and learning terminal, server includes server host and storage array, connected by optical fiber switch between server host and storage array, management terminal is connected by gigabit switch and server with storage array, and learning terminal is linked by gigabit switch and server;Instructional template and software are provided with server, server is provided with virtualization software and cloud management software, server resource is carried out pond by server by virtualization software, and the virtual machine created by using instructional template batch is supplied to learning terminal to use in the form of cloud issue.Server cluster possesses powerful calculating disposal ability;The resource such as CPU, internal memory, disk can be configured on demand needed for Client application, and thin-client can be greatly saved computer room construction input;System scale can linearly expand, and the quantity and burden for greatly reducing computer room administrator greatly improve efficiency of teaching.

Description

A kind of big data tutoring system based on virtualization and cloud computing
Technical field
Impart knowledge to students and be the present invention relates to computer teaching field, more particularly to a kind of big data based on virtualization and cloud computing System.
Background technology
Since 21 century, the life style of people, working method have quietly been changed in information technology particularly internet And the mode of thinking.In the camp of Chinese IT industry future development, a series of guiding such as ecommerce, E-Government, social networks Type application is magnanimity big data base support and cloud computing engine behind.The cost of storage 1TB namely about 1000GB data is big It it is approximately 1,600,000,000 dollars, nowadays storing on cloud only need to be less than 100 dollar, but data for storing, if do not entered with cloud computing Row is excavated and analyzed, just simply ossified data, without too big value.
With the continuous project verification of relevant item, the database professional technician demand related to cloud computing exists huge Breach.Contribution in socio-economic development becomes increasingly conspicuous, and in face of new situation and task, science and engineering quasi-tradition specialty is obtaining difficult When the opportunity to develop for obtaining, unprecedented severe challenge and many problem demanding prompt solutions are also faced with.
The content of the invention
The technical problem to be solved in the present invention is a kind of big data tutoring system based on virtualization and cloud computing of design, solution Certainly existing technical problem.
In order to solve the above technical problems, the big data tutoring system based on virtualization and cloud computing of the invention includes service Device, management terminal and learning terminal, the server include server host and storage array, the server host and storage Connected by optical fiber switch between array, the management terminal is connected by gigabit switch and server with storage array, The learning terminal is connected by gigabit switch and server;Instructional template and software, server are provided with the server Virtualization software and cloud management software are installed, server resource is carried out pond by server by virtualization software, and is passed through The virtual machine that teaching of use template batch is created is supplied to learning terminal to use in the form of cloud issue.
Further, the virtualization software is VMware VSphere, and the cloud management software is VMware vCenter。
Further, the model Dell PowerEdge12G R720 of the server host.
Further, the storage array model Dell SCv2020FC.
Further, the optical fiber switch model Bocade300.
Further, gigabit switch model Huawei H3C S5500-48P-WiNet, the management terminal model It is association T4900C.
Further, the teaching software includes (SuSE) Linux OS experiment pattern, oracle database infrastest mould Plate, RAC cluster High Availabitities experiment pattern, Data Guard disaster tolerances experiment pattern, GoldenGate disaster tolerances experiment pattern, Oracle Performance Optimal Experimental template, MySQL system administrations experiment pattern, MySQL exploitation experiment pattern, MySQL clusters experiment pattern, MySQL performances optimization template, Hadoop clusters build with management misconduct template, HDFS distributed file systems experiment pattern, YARN resource managements experiment pattern, MapReduce Computational frames experiment pattern, HBase NoSQL database experiments template, Spark environment compile with deployment experiment pattern, Scala and Python experiment pattern, SparkSQL inquiries experiment pattern, Spark Streaming Stream Processings experiment pattern, Spark MLib machine learning experiment pattern, the treatment of Spark GraphX figures Experiment pattern and Hive data warehouse experiment patterns.
Beneficial effects of the present invention:
1) server cluster has carried out pond to whole computer resources, possesses powerful calculating disposal ability;
2) resource such as CPU, internal memory, disk can be configured on demand needed for Client application, embody the advantage of cloud computing;
3) computing capability and resource concentrate on server, and thin-client can be greatly saved computer room construction input;
4) system scale can linearly expand, and batch supports the teaching and real training requirement of multiple specialties and class student;
5) the experimental situation deployment based on virtual machine template, greatly reduces the quantity and burden of computer room administrator;
6) experimental situation of different courses can quickly be disposed by template, greatly improve efficiency of teaching.
Brief description of the drawings
Specific embodiment of the invention is further elucidated below in conjunction with the accompanying drawings.
Fig. 1 is the topological diagram of the big data tutoring system based on virtualization and cloud computing of the invention.
Specific embodiment
With reference to Fig. 1, the big data tutoring system based on virtualization and cloud computing of the invention includes server, management terminal And learning terminal, the server includes server host and storage array, logical between the server host and storage array Optical fiber switch connection is crossed, the management terminal is connected by gigabit switch and server with storage array, the study is eventually End is connected by gigabit switch and server;Instructional template and software are provided with the server, server is provided with virtually Change software and cloud management software, server resource is carried out pond by server by virtualization software, and by using teaching mould The virtual machine that plate batch is created is supplied to learning terminal to use in the form of cloud issue.
In the present embodiment, four Dell PowerEdge12G R720 server hosts of standard configuration scheme, every clothes Business device configures 2 E5-2650V2 processors, and the model processor monolithic includes 8 kernels, and 16 threads, GFLOPS reaches 166.4, single server provides the thread of 16 kernel 32, the calculating performance that GFLOPS is 332.8.Four group of planes entirety GFLOPS can 1331.2 are reached, teaching and the need of scientific research of database, big data and virtualization and the experiment of cloud computing real training can be very well met Ask.Internal memory aspect, every server configures 128G internal memories, removes EXSi virtualization systems and retains outside 8G, can provide 120G to User virtual machine is used, and single server can simultaneously create and run 30 4G or 60 client machine systems of 2G.A group of planes four Server removes the resource consumptions such as cloud computing service, and 100 4G or 200 client machine systems of 2G can be provided altogether.
For the storage of data, it is contemplated that the high concurrent degree of tutoring system, to eliminate I/O focuses, it is ensured that performance, system Using DellSCv2020FC high-performance storage arrays, storage array and server host are connected by optical fiber switch. SCv2020FC server storages are configured with 24 pieces of 15K high speed SAS disks, and every piece of capacity of disk is 600G, and whole volume reaches 14.4T, can very well meet memory requirement of the big data teaching to mass data.In terms of data redundancy, SCv2020FC storage branch Hold RAID5/6, RAID10 and RAID10DM (double-mirror).
For the efficiency of transmission of data, exchanged using high performance Brocade300 optical fiber between server and storage Machine, the interchanger can provide the transmittability of up to 8.5Gbit/Sec full duplexs, it is sufficient to meet system high concurrent and database Strict demand with the transmission of big data project big data quantity to systematic function.
For the safety of system data, in addition to every server and storage provide redundancy by RAID10, VMware numbers The need for reliable backup of system metadata and user data is also provided according to center virtualization software, being perfectly safe for data can be accomplished.
Further, the virtualization software is VMware VSphere, and the cloud management software is VMware vCenter.Virtualization software is vSphere6.0, and it is industry market share that cloud management software uses vCenter6.0, vSphere Rate highest virtualization product, with good stability, it is easy to use and management, it is compatible good the features such as, its Main Function is right Server resource is virtualized, it is necessary to be directed to every server installation and deployment.VCenter is disposed based on vSphere, there is provided cloud Issue and the function of cloud management.
Further, the teaching software includes (SuSE) Linux OS experiment pattern, oracle database infrastest mould Plate, RAC cluster High Availabitities experiment pattern, Data Guard disaster tolerances experiment pattern, GoldenGate disaster tolerances experiment pattern, Oracle Performance Optimal Experimental template, MySQL system administrations experiment pattern, MySQL exploitation experiment pattern, MySQL clusters experiment pattern, MySQL performances optimization template, Hadoop clusters build with management misconduct template, HDFS distributed file systems experiment pattern, YARN resource managements experiment pattern, MapReduce Computational frames experiment pattern, HBase NoSQL database experiments template, Spark environment compile with deployment experiment pattern, Scala and Python experiment pattern, SparkSQL inquiries experiment pattern, Spark Streaming Stream Processings experiment pattern, Spark MLib machine learning experiment pattern, the treatment of Spark GraphX figures Experiment pattern and Hive data warehouse experiment patterns.
By taking the teaching of 1 oracle database as an example:
Virtual machine configuration:Per user distribute a virtual server, main configuration parameters be 4GB internal memories, 2 core cpus, 50GB disk spaces, 1 piece of Microsoft Loopback Adapter.
Experimental situation:Virtual machine template installs Oracle Linux Enterprise 6.4, has uploaded Oracle Database 11gR2 enterprise versions install mirror image.
The content of courses:Oracle database infrastest class is the important component of oracle database teaching, content Installation of the Oracle 11gR2 Database Systems in production practices link, management and application method are covered, and combines production Empirical summary has been done in the actual treatment to FAQs and failure, is the complete of the basic O&M of oracle database and management Process.
By taking 2RAC High Availabitity experimental teachings as an example:
Virtual machine configuration:Two virtual servers are distributed per user, every server main configuration parameters are 4G internal memories, 2 Individual core cpu, 50G disk spaces, two pieces of Microsoft Loopback Adapters.30GB shared disks are distributed per user in addition.
Experimental situation:Two virtual server templates have been respectively mounted Oracle Linux Enterprise6.4, and management is used Oracle Database 11gR2 enterprise versions are uploaded on virtual server mirror image has been installed.
The content of courses:The experiment of RAC High Availabitities is the advanced experiment course of oracle database, and experiment content is related to Installation, deployment, configuration and the management of Oracle RAC (Real Application Cluster).The collection of RAC+DG, RAC+GG Group plus disaster recovery database structure are widely used in the key production system of every profession and trade, grasp the deployment of RAC And management for DBA it is critical that.
It is only above the citing for the content of courses, it is of the invention to be technically characterized in that based on virtualization and cloud computing skill Art, server cluster has carried out pond to whole computer resources, possesses powerful calculating disposal ability, needed for Client application The resources such as CPU, internal memory, disk can be configured on demand, embody the advantage of cloud computing, and computing capability and resource concentrate on server, Thin-client can be greatly saved computer room construction input, and system scale can linearly expand, and batch supports that multiple specialties and class are learned Raw practice teaching requirement, the experimental situation deployment based on virtual machine template greatly reduces the quantity of computer room administrator and bears Load.
Elaborate many details in order to fully understand the present invention in the above description.But above description is only Presently preferred embodiments of the present invention, the present invention can be implemented with being much different from other manner described here, therefore this Invention is not limited by specific implementation disclosed above.Any those skilled in the art are not departing from the technology of the present invention simultaneously In the case of aspects, all make many possible to technical solution of the present invention using the methods and techniques content of the disclosure above Change and modify, or the Equivalent embodiments for being revised as equivalent variations.Every content without departing from technical solution of the present invention, according to this The technical spirit of invention still falls within skill of the present invention to any simple modification, equivalent variation and modification made for any of the above embodiments In the range of the protection of art scheme.

Claims (7)

1. a kind of based on the big data tutoring system virtualized with cloud computing, it is characterised in that:Including server, management terminal and Learning terminal, the server includes server host and storage array, passes through between the server host and storage array Optical fiber switch is connected, and the management terminal is connected by gigabit switch and server with storage array, the learning terminal Connected by gigabit switch and server;Instructional template and software are provided with the server, server is provided with virtualization Server resource is carried out pond by software and cloud management software, server by virtualization software, and by using instructional template The virtual machine that batch is created is supplied to learning terminal to use in the form of cloud issue.
2. according to claim 1 based on the big data tutoring system virtualized with cloud computing, it is characterised in that:The void Planization software is VMware VSphere, and the cloud management software is VMware vCenter.
3. according to claim 1 based on the big data tutoring system virtualized with cloud computing, it is characterised in that:The clothes The model Dell PowerEdge12G R720 of business device main frame.
4. according to claim 1 based on the big data tutoring system virtualized with cloud computing, it is characterised in that:It is described to deposit Storage array model Dell SCv2020FC.
5. according to claim 1 based on the big data tutoring system virtualized with cloud computing, it is characterised in that:The light Fine interchanger model Bocade300.
6. according to claim 1 based on the big data tutoring system virtualized with cloud computing, it is characterised in that:Described thousand Million interchanger model Huawei H3C S5500-48P-WiNet, the management terminal model associates T4900C.
7. according to claim 1 based on the big data tutoring system virtualized with cloud computing, it is characterised in that:The religion Learning software includes (SuSE) Linux OS experiment pattern, oracle database infrastest template, RAC clusters High Availabitity experiment mould Plate, Data Guard disaster tolerances experiment pattern, GoldenGate disaster tolerances experiment pattern, Oracle performance Optimal Experimentals template, MySQL System administration experiment pattern, MySQL exploitations experiment pattern, MySQL clusters experiment pattern, MySQL performances optimization template, Hadoop Cluster build with management misconduct template, HDFS distributed file systems experiment pattern, YARN resource managements experiment pattern, MapReduce Computational frames experiment pattern, HBase NoSQL database experiments template, the compiling of Spark environment and deployment experiment mould Plate, Scala and Python experiment pattern, SparkSQL inquiries experiment pattern, the experiment of SparkStreaming Stream Processings Template, Spark MLib machine learning experiment pattern, Spark GraphX figures treatment experiment pattern and the experiment of Hive data warehouses Template.
CN201710161632.XA 2017-03-17 2017-03-17 A kind of big data tutoring system based on virtualization and cloud computing Pending CN106803218A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201710161632.XA CN106803218A (en) 2017-03-17 2017-03-17 A kind of big data tutoring system based on virtualization and cloud computing

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201710161632.XA CN106803218A (en) 2017-03-17 2017-03-17 A kind of big data tutoring system based on virtualization and cloud computing

Publications (1)

Publication Number Publication Date
CN106803218A true CN106803218A (en) 2017-06-06

Family

ID=58988138

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201710161632.XA Pending CN106803218A (en) 2017-03-17 2017-03-17 A kind of big data tutoring system based on virtualization and cloud computing

Country Status (1)

Country Link
CN (1) CN106803218A (en)

Cited By (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107341745A (en) * 2017-06-16 2017-11-10 浙江网新恒天软件有限公司 A kind of colleges and universities' Experimental Establishment intelligent cloud management system based on cloud computing
CN108460436A (en) * 2018-03-06 2018-08-28 浙江庆发管业科技有限公司 A kind of electro-fusion welding record system and query scheme
CN108665396A (en) * 2018-05-14 2018-10-16 有时数联科技(北京)有限公司 A kind of big data education practical training method and system
CN108961897A (en) * 2018-07-04 2018-12-07 北京四航科技有限公司 A kind of virtual learning system and method
CN108958947A (en) * 2018-09-17 2018-12-07 北京市计算中心 A kind of big data all-in-one machine and its application method
CN109002343A (en) * 2017-06-07 2018-12-14 中兴通讯股份有限公司 A kind of method and device for realizing virtual machine batch creation
CN109284298A (en) * 2018-11-09 2019-01-29 上海晏鼠计算机技术股份有限公司 A kind of contents production system handled based on machine learning and big data
CN110334088A (en) * 2019-07-11 2019-10-15 江苏曲速教育科技有限公司 Educational data management system
CN111373366A (en) * 2017-11-21 2020-07-03 亚马逊科技公司 Generating and deploying machine learning model software packages
CN115714937A (en) * 2022-11-03 2023-02-24 北京邮电大学 All-optical switching distributed reinforcement learning system and method based on array waveguide grating

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103220364A (en) * 2013-04-27 2013-07-24 清华大学 Cloud-based system management training platform architecture
CN103841207A (en) * 2014-03-18 2014-06-04 上海电机学院 College experiment teaching platform system based on cloud desktop and constructing method thereof
CN103888530A (en) * 2014-03-18 2014-06-25 成都盛思睿信息技术有限公司 Experiment teaching system based on cloud desktop
CN105160954A (en) * 2015-09-28 2015-12-16 广东顺德中山大学卡内基梅隆大学国际联合研究院 Cloud computing experimental teaching system and construction method thereof
CN206863814U (en) * 2017-03-17 2018-01-09 西安优盛信息技术有限公司 A kind of big data tutoring system based on virtualization and cloud computing

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103220364A (en) * 2013-04-27 2013-07-24 清华大学 Cloud-based system management training platform architecture
CN103841207A (en) * 2014-03-18 2014-06-04 上海电机学院 College experiment teaching platform system based on cloud desktop and constructing method thereof
CN103888530A (en) * 2014-03-18 2014-06-25 成都盛思睿信息技术有限公司 Experiment teaching system based on cloud desktop
CN105160954A (en) * 2015-09-28 2015-12-16 广东顺德中山大学卡内基梅隆大学国际联合研究院 Cloud computing experimental teaching system and construction method thereof
CN206863814U (en) * 2017-03-17 2018-01-09 西安优盛信息技术有限公司 A kind of big data tutoring system based on virtualization and cloud computing

Non-Patent Citations (2)

* Cited by examiner, † Cited by third party
Title
王焱;: "基于VMware vSphere的云计算智能虚拟实验平台设计" *
罗婕等: "基于虚拟化技术建设高效绿色计算机实验教学平台" *

Cited By (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109002343A (en) * 2017-06-07 2018-12-14 中兴通讯股份有限公司 A kind of method and device for realizing virtual machine batch creation
CN109002343B (en) * 2017-06-07 2023-08-25 中兴通讯股份有限公司 Method and device for realizing batch creation of virtual machines
CN107341745A (en) * 2017-06-16 2017-11-10 浙江网新恒天软件有限公司 A kind of colleges and universities' Experimental Establishment intelligent cloud management system based on cloud computing
CN111373366A (en) * 2017-11-21 2020-07-03 亚马逊科技公司 Generating and deploying machine learning model software packages
CN108460436A (en) * 2018-03-06 2018-08-28 浙江庆发管业科技有限公司 A kind of electro-fusion welding record system and query scheme
CN108665396A (en) * 2018-05-14 2018-10-16 有时数联科技(北京)有限公司 A kind of big data education practical training method and system
CN108961897A (en) * 2018-07-04 2018-12-07 北京四航科技有限公司 A kind of virtual learning system and method
CN108958947A (en) * 2018-09-17 2018-12-07 北京市计算中心 A kind of big data all-in-one machine and its application method
CN109284298A (en) * 2018-11-09 2019-01-29 上海晏鼠计算机技术股份有限公司 A kind of contents production system handled based on machine learning and big data
CN110334088A (en) * 2019-07-11 2019-10-15 江苏曲速教育科技有限公司 Educational data management system
CN115714937A (en) * 2022-11-03 2023-02-24 北京邮电大学 All-optical switching distributed reinforcement learning system and method based on array waveguide grating

Similar Documents

Publication Publication Date Title
CN106803218A (en) A kind of big data tutoring system based on virtualization and cloud computing
Barroso et al. The datacenter as a computer: Designing warehouse-scale machines
US20170249215A1 (en) Fault tolerant distributed tasks using distributed file systems
CN206863814U (en) A kind of big data tutoring system based on virtualization and cloud computing
Tang et al. A survey on spark ecosystem: Big data processing infrastructure, machine learning, and applications
US11386059B2 (en) Optimized identification of performance regression
Zaharia et al. The datacenter needs an operating system
US9841989B2 (en) Parallel data processing system, computer, and parallel data processing method
US20150193526A1 (en) Schemaless data access management
Prout et al. Enabling on-demand database computing with MIT SuperCloud database management system
Tu et al. Accelerating Parallel Analysis of Scientific Simulation Data via Zazen.
Bonner et al. Exploring the evolution of big data technologies
US11550755B2 (en) High performance space efficient distributed storage
Panda et al. High-performance big data computing
Xu et al. Exploiting analytics shipping with virtualized MapReduce on HPC backend storage servers
Elmore et al. Who’s driving this cloud? towards efficient migration for elastic and autonomic multitenant databases
Vaidya et al. Critical study of performance parameters on distributed file systems using MapReduce
Poess et al. Large scale data warehouses on grid: Oracle database 10 g and HP proliant servers
Assaf et al. SQL server 2017 administration inside out
Liu et al. Building a research data science platform from industrial machines
Bradberry et al. Practical Cassandra: a developer's approach
Rattanaopas et al. A comparison of orc-compress performance with big data workload on virtualization
Vaidya et al. Comparative analysis of various distributed file systems & performance evaluation using map reduce implementation
Korotkevitch SQL Server Advanced Troubleshooting and Performance Tuning
Naik et al. A Hadoop Framework Require to Process Big data very easily and efficiently

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
RJ01 Rejection of invention patent application after publication

Application publication date: 20170606