CN108306916A - Big data multi-internet integration scientific research all-in-one machine stage apparatus - Google Patents

Big data multi-internet integration scientific research all-in-one machine stage apparatus Download PDF

Info

Publication number
CN108306916A
CN108306916A CN201710025727.9A CN201710025727A CN108306916A CN 108306916 A CN108306916 A CN 108306916A CN 201710025727 A CN201710025727 A CN 201710025727A CN 108306916 A CN108306916 A CN 108306916A
Authority
CN
China
Prior art keywords
layer
data
big data
scientific research
stage apparatus
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201710025727.9A
Other languages
Chinese (zh)
Inventor
郑建平
杨晓红
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Jiangsu Cloud Fusion Mdt Infotech Ltd
Original Assignee
Jiangsu Cloud Fusion Mdt Infotech Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Jiangsu Cloud Fusion Mdt Infotech Ltd filed Critical Jiangsu Cloud Fusion Mdt Infotech Ltd
Priority to CN201710025727.9A priority Critical patent/CN108306916A/en
Publication of CN108306916A publication Critical patent/CN108306916A/en
Pending legal-status Critical Current

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00Network arrangements or protocols for supporting network services or applications
    • H04L67/01Protocols
    • H04L67/10Protocols in which an application is distributed across nodes in the network
    • H04L67/1097Protocols in which an application is distributed across nodes in the network for distributed storage of data in networks, e.g. transport arrangements for network file system [NFS], storage area networks [SAN] or network attached storage [NAS]
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L41/00Arrangements for maintenance, administration or management of data switching networks, e.g. of packet switching networks
    • H04L41/06Management of faults, events, alarms or notifications
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L41/00Arrangements for maintenance, administration or management of data switching networks, e.g. of packet switching networks
    • H04L41/08Configuration management of networks or network elements
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L43/00Arrangements for monitoring or testing data switching networks
    • H04L43/08Monitoring or testing based on specific metrics, e.g. QoS, energy consumption or environmental parameters
    • H04L43/0876Network utilisation, e.g. volume of load or congestion level
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00Network arrangements or protocols for supporting network services or applications
    • H04L67/50Network services
    • H04L67/54Presence management, e.g. monitoring or registration for receipt of user log-on information, or the connection status of the users
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/10File systems; File servers
    • G06F16/18File system types
    • G06F16/182Distributed file systems
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/27Replication, distribution or synchronisation of data between databases or within a distributed database system; Distributed database system architectures therefor
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/06Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
    • G06F3/0601Interfaces specially adapted for storage systems
    • G06F3/0602Interfaces specially adapted for storage systems specifically adapted to achieve a particular effect
    • G06F3/0604Improving or facilitating administration, e.g. storage management
    • G06F3/0607Improving or facilitating administration, e.g. storage management by facilitating the process of upgrading existing storage systems, e.g. for improving compatibility between host and storage device
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/06Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
    • G06F3/0601Interfaces specially adapted for storage systems
    • G06F3/0628Interfaces specially adapted for storage systems making use of a particular technique
    • G06F3/0662Virtualisation aspects
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/06Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
    • G06F3/0601Interfaces specially adapted for storage systems
    • G06F3/0668Interfaces specially adapted for storage systems adopting a particular infrastructure
    • G06F3/067Distributed or networked storage systems, e.g. storage area networks [SAN], network attached storage [NAS]

Abstract

The present invention provides a kind of big data multi-internet integration scientific research all-in-one machine stage apparatus, is related to big data processing field.The big data multi-internet integration scientific research all-in-one machine stage apparatus, including cProc clouds processing platform, application layer, virtual resource layer and cubic data library, cProc clouds processing platform is bi-directionally connected with Storm cloud storage systems, HBase distributed data bases and HDFS distributed file systems respectively, cProc clouds processing platform is also tested all-in-one machine with big data real 3 and is bi-directionally connected, and big data experiment all-in-one machine is bi-directionally connected with distributed computer.The big data multi-internet integration scientific research all-in-one machine stage apparatus, big data is stored by the cooperation of Storm clouds stocking system, HBas distributed data bases and HDFS distributed file systems, reduces hardware and the input cost of personal management, storage capacity is big, strong applicability, reliability are high.

Description

Big data multi-internet integration scientific research all-in-one machine stage apparatus
Technical field
Big data processing technology field of the present invention, specially a kind of big data multi-internet integration scientific research all-in-one machine stage apparatus.
Background technology
Data refer to the symbol that is recorded and can be differentiated to objective event, be to the property of objective things, state with And the combination of phy symbol or these phy symbols that correlation etc. is recorded.It is symbol that is identifiable, being abstracted.It Refer not only to number in the narrow sense, can also be word with definite meaning, letter, the combination of numerical chracter, figure, image, The abstract representation of the attribute of video, audio etc. and objective things, quantity, position and its correlation.For example, " 0,1, 2... ", " the moon, rain, decline, temperature " " dossier of student, traffic condition of cargo " etc. is all data, and data are by processing Just become information afterwards.
A large amount of experimental data is usually will produce during the student experimenting of major colleges and universities, the processing of these big datas is often It often needs to use big data experiment all-in-one machine, big data experiment all-in-one machine is virtually big with a small amount of machine by application container technology Amount experiment cluster possesses more set clusters for a large amount of students and tests simultaneously, and the experimental situation of each student is not only mutual Experiment is easily and efficiently completed in isolation, and experiment is not interfered each other, even if some experimental situation is destroyed to other people Do not influence.
It is all using the storing mechanism of itself and outer that current big data experiment all-in-one machine is most of for the storage of data The storage device set carries out, but such storage mode hardware and the input cost of personal management are high, and storage capacity is small, applicability Difference.
Invention content
(1) the technical issues of solving
In view of the deficiencies of the prior art, the present invention provides a kind of big data multi-internet integration scientific research all-in-one machine stage apparatus, It solves current big data experiment all-in-one machine to be stored using the storing mechanism and external storage device of itself, hardware and people The input cost of member's management is high, and storage capacity is small, problem poor for applicability.
(2) technical solution
In order to achieve the above object, the present invention is achieved by the following technical programs:A kind of big data multi-internet integration scientific research All-in-one machine stage apparatus, including cProc clouds processing platform, application layer, virtual resource layer and cubic data library, the cProc clouds Processing platform is bi-directionally connected with Storm cloud storage systems, HBase distributed data bases and HDFS distributed file systems respectively, The cProc clouds processing platform is also bi-directionally connected with big data experiment all-in-one machine, the big data experiment all-in-one machine and distribution Computer bidirectional connects.
The Storm cloud storage systems include management and monitoring center, the management and monitoring center respectively with metadata management Server, the connection of data memory node server and client side's two-wire.
The management and monitoring center includes configuration center and monitoring center, and the configuration center includes volume configuration, node ginseng Number configuration, storage parameter configuration, user's quotas administered, QoS management and alarm device, the monitoring center include memory space prison Control, device status monitoring, program state monitoring, disk state monitoring, traffic monitoring and warning comprehensively.
The HBase distributed data bases and cubic data library constitute management level, and management level respectively with process layer and deposit Reservoir connects, and accumulation layer is made of Storm cloud storage systems and HDFS distributed file systems, and process layer is drawn by MapReduce Composition is held up, process layer is also connect with operation layer.
Preferably, the cProc clouds processing platform is built on cloud storage system, and cProc cloud processing platforms are to industry Business layer directly provides the distributed data processing platform of external development interface and data transmission interface.
Preferably, the cubic data library is the index that field is established with the structure of B+ trees, the word of each B+ tree constructions As soon as segment index is equivalent to a data plane, such a global data table and the index of its multiple significant field constitute one Similar to cubical data organizational structure.
Preferably, the MapReduce engines are made of JobTrackers and TaskTrackers.
Preferably, the HDFS distributed file systems are by providing Metadata Service NameNode for it and providing memory block DataNode constitute.
Preferably, the operation layer and accumulation layer are also connect with application layer and virtual resource layer respectively, and application layer is intelligence Energy terminal, notebook, PC machine or thin client, the virtual resource layer are Internet resources.
Preferably, the application layer, operation layer, process layer, management level, accumulation layer and virtual resource layer are to data processing It monitors cooperation layer simultaneously application layer, operation layer, process layer, management level, accumulation layer and virtual resource layer are monitored and are coordinated, And monitoring cooperation layer is made of Zookeeper and Chukwa.
(3) advantageous effect
The present invention provides a kind of big data multi-internet integration scientific research all-in-one machine stage apparatus.Has following advantageous effect:
1, the big data multi-internet integration scientific research all-in-one machine stage apparatus, passes through Storm clouds stocking system, HBas distribution numbers Big data is stored according to the cooperation in library and HDFS distributed file systems, Stor cloud storage systems using cloud computing technology, Network communication technology and distributed file system technology play cheap, degraded performance hardware store node organization management Come, HBas distributed data bases can be obtained apart from some time nearest data, or once obtain all data, HDFS points Data can both be merged abbreviation by cloth file system, and data can also be divided into multiple junior units, reduce hardware and personnel The input cost of management, storage capacity is big, strong applicability, and reliability is high.
2, the big data multi-internet integration scientific research all-in-one machine stage apparatus, it includes metadata pipe that Storm cloud stocking systems, which use, The structure for managing server (management node), data memory node server (memory node) and client node constitutes a void Quasi- mass storage volume, effectively provides high-performance, highly reliable storage system, and data money is timely extracted convenient for user Material.
3, big data multi-internet integration scientific research all-in-one machine stage apparatus, in the management and monitoring that Storm cloud stocking systems provide The heart can be managed each node, including equipment running status, disk operating status, service online situation and exception The functions such as alarm;In addition, network management monitoring center is also provided with such as FTP accounts addition client-side management and configuration tool, it is convenient for User timely understands the real-time status of data, is managed to data convenient for user.
Description of the drawings
Fig. 1 is present system schematic diagram;
Fig. 2 is the structure diagram of Storm clouds stocking system of the present invention;
Fig. 3 is cProc Organization Charts of the present invention
Specific implementation mode
Following will be combined with the drawings in the embodiments of the present invention, and technical solution in the embodiment of the present invention carries out clear, complete Site preparation describes, it is clear that described embodiments are only a part of the embodiments of the present invention, instead of all the embodiments.It is based on Embodiment in the present invention, it is obtained by those of ordinary skill in the art without making creative efforts every other Embodiment shall fall within the protection scope of the present invention.
- 2 are please referred to Fig.1, the embodiment of the present invention provides a kind of big data multi-internet integration scientific research all-in-one machine stage apparatus, including CProc clouds processing platform, application layer, virtual resource layer and cubic data library, cProc clouds processing platform are deposited with Storm clouds respectively Storage system, HBase distributed data bases and HDFS distributed file systems are bi-directionally connected, and cProc clouds processing platform is also counted with big All-in-one machine is bi-directionally connected according to the experiment, and big data experiment all-in-one machine is bi-directionally connected with distributed computer.
In the present invention:CProc cloud processing platforms are built on cloud storage system, and cProc cloud processing platforms are to business Layer directly provides the distributed data processing platform of external development interface and data transmission interface, and cProc cloud processing platforms are one The parallel programming model and Computational frame of kind processing mass data, for the parallel computation to large-scale dataset.
CProc Organization Charts are as shown in figure 3, cProc cloud processing platforms are that a kind of efficient distribution of processing mass data is soft The cloud processing platform of set of hardware, the platform can excavate useful information from TB or even PB grades of data, and to these Magnanimity information carries out quick, efficient processing, and cProc cloud processing platforms are supported and relational database mixed mode, the overwhelming majority Mass data deposits in distributed platform and carries out distributed treatment, and the very high data of a small amount of requirement of real-time deposit in relationship number According to library, various types of business demands are supported to meet, support support inquiry, statistics, analysis business;Sustainable depth data is dug Pick and Intellectual analysis business, it is desirable that 50% or more is reached to stsndard SQL specification support, provides Attributions selection, classification in advance The data mining algorithms such as survey, regression forecasting, clustering, association analysis, time series analysis provide food two-dimensional code scanning work( Can, various information can be realized and be traced to the source, after being parsed by cProc cloud processing platforms, data query and inspection can be greatly increased The business such as rope, can allow system platform have data be put in storage in real time, the advantages such as real-time query, query result real-time Transmission, pass through After cProc analyzes metadata, inquiry and the recall precision of data can be greatly speeded up.
In the present invention:HDFS distributed file systems are by providing Metadata Service NameNode for it and providing memory block DataNode is constituted, and HDFS distributed file systems are the bottom layer realization parts of cloud processing platform Hadoop frames of increasing income, and are suitble to The distributed file system on common hardware is operated in, there is high fault tolerance, the data access of handling capacity can be improved, be very suitable for In the application on large-scale dataset.
In the present invention:HBase distributed data bases are one sparse similar to the distributed data base of Bigtable, long Phase storage, multidimensional, the index of the mapping table of sequence, this table is row keyword, row keyword and timestamp, all data The more new capital in library is a timestamp label, and each more new capital is a new version, and HBase can retain a certain number of versions This, this value can set, and client can be obtained apart from some time nearest data, or once obtain all numbers According to.
Storm cloud storage systems include management and monitoring center, management and monitoring center respectively with metadata management server, number It is connected according to memory node server and client side's two-wire.
Management and monitoring center includes configuration center and monitoring center, and configuration center includes volume configuration, node parameter configuration, deposits Parameter configuration, user's quotas administered, QoS management and alarm device are stored up, monitoring center includes memory space monitoring, equipment state prison Control, program state monitoring, disk state monitoring, traffic monitoring and warning comprehensively.
In the present invention:Management and monitoring center has the virtual management for providing storage rack, Ke Yijian in use The operating status for measuring each node server, the operating status to disk and service condition monitoring, to volume management server Setting and account management, to the function of System Operation Log management and audit.
In the present invention:Storm cloud stocking systems be directed to the characteristics of most data-intensive applications from many aspects into Optimization is gone, to reach the optimum balance of cost, reliability and performance under certain scale.Storm clouds stocking system with It is ultralow price, excellent performance, highly reliable, green energy conservation, limitless volumes, on-line automatic flexible, easy-to-use general etc. many Overwhelming dominance obtains the consistent praise of user.
In the present invention:All nodes of Stor cloud storage systems are connected by way of network, wherein storage section Point uses cheap computer node, is carried out with adaptive replica management technology fault-tolerant, and all memory nodes concurrently act as pair Outer service function, client are mounted to different storage node accesses cloud storage systems respectively, by increasing or reducing storage section The mode of point, you can it is fault-tolerant as a result of the progress of adaptive replica management technology to be stretched online to storage system, be During system stretches online, system external is not influenced, service is provided.
For the user of Stor cloud storages, magnanimity cloud storage system can be mapped to one by Stor clients Local magnanimity disk (window client) is either mapped to a catalogue (linuxn client) for this disk or catalogue Read-write operation, you can realize cloud storage system data read-write.Simultaneously as Stor file system supports POSIX interfaces rule Model need not do secondary development for current general application and can be used.
HBase distributed data bases and cubic data library constitute management level, and management level respectively with process layer and accumulation layer Connection, accumulation layer are made of Storm cloud storage systems and HDFS distributed file systems, and process layer is by MapReduce engine groups At process layer is also connect with operation layer, and operation layer and accumulation layer are also connect with application layer and virtual resource layer respectively, and application layer For intelligent terminal, notebook, PC machine or thin client, virtual resource layer is Internet resources, application layer, operation layer, process layer, Cooperation layer is monitored while management level, accumulation layer and virtual resource layer are to data processing to application layer, operation layer, process layer, pipe Reason layer, accumulation layer and virtual resource layer are monitored and coordinate, and monitor cooperation layer and be made of Zookeeper and Chukwa.
In the present invention:MapReduce engines are made of JobTrackers and TaskTrackers.
In the present invention:Cubic data library is the index that field is established with the structure of B+ trees, the field of each B+ tree constructions As soon as index is equivalent to a data plane, such a global data table and the index of its multiple significant field constitute a class It is similar to cubical data organizational structure.
In conclusion the big data multi-internet integration scientific research all-in-one machine stage apparatus, passes through Storm clouds stocking system, HBas The cooperation of distributed data base and HDFS distributed file systems stores big data, and Stor cloud storage systems use cloud meter Calculation technology, network communication technology and distributed file system technology, by cheap, degraded performance hardware store node organization Management is got up, and HBas distributed data bases can be obtained apart from some time nearest data, or once obtain all data, Data can both be merged abbreviation by HDFS distributed file systems, and data can also be divided into multiple junior units, reduce hardware With the input cost of personal management, storage capacity is big, strong applicability, and reliability is high.
Meanwhile it includes metadata management server (management node), data memory node clothes that Storm cloud stocking systems, which use, Be engaged in device (memory node) and client node structure constitute a virtual mass storage volume, effectively provide high-performance, Highly reliable storage system timely extracts data information convenient for user.
Secondly, the management and monitoring center that Storm cloud stocking systems provide can be managed each node, including set The functions such as standby operating status, disk operating status, service online situation and abnormality alarming;In addition, network management monitoring center also carries For just like client-side managements and configuration tools such as the additions of FTP accounts, the real-time status of data timely being understood convenient for user, just Data are managed in user.
It although an embodiment of the present invention has been shown and described, for the ordinary skill in the art, can be with Understanding without departing from the principles and spirit of the present invention can carry out these embodiments a variety of variations, modification, replace And modification, the scope of the present invention is defined by the appended.

Claims (7)

1. a kind of big data multi-internet integration scientific research all-in-one machine stage apparatus, including cProc clouds processing platform, application layer, virtual money Active layer and cubic data library, it is characterised in that:The cProc clouds processing platform divides with Storm cloud storage systems, HBase respectively Cloth database and HDFS distributed file systems are bi-directionally connected, and the cProc clouds processing platform also tests one with big data Machine is bi-directionally connected, and the big data experiment all-in-one machine is bi-directionally connected with distributed computer;
The Storm cloud storage systems include management and monitoring center, the management and monitoring center respectively with metadata management service Device, the connection of data memory node server and client side's two-wire;
The management and monitoring center includes configuration center and monitoring center, and the configuration center includes that volume configures, node parameter is matched Set, store parameter configuration, user's quotas administered, QoS management and alarm device, the monitoring center include memory space monitoring, Device status monitoring, program state monitoring, disk state monitoring, traffic monitoring and warning comprehensively;
The HBase distributed data bases and cubic data library constitute management level, and management level respectively with process layer and accumulation layer Connection, accumulation layer are made of Storm cloud storage systems and HDFS distributed file systems, and process layer is by MapReduce engine groups At process layer is also connect with operation layer.
2. big data multi-internet integration scientific research all-in-one machine stage apparatus according to claim 1, it is characterised in that:It is described CProc cloud processing platforms are built on cloud storage system, and cProc cloud processing platforms are that external exploitation is directly provided to operation layer The distributed data processing platform of interface and data transmission interface.
3. big data multi-internet integration scientific research all-in-one machine stage apparatus according to claim 1, it is characterised in that:Described cube Database is the index that field is established with the structure of B+ trees, and the field index of each B+ tree constructions is equivalent to a data and puts down The index of face, such a global data table and its multiple significant field just constitutes one and is similar to cubical data organization Structure.
4. big data multi-internet integration scientific research all-in-one machine stage apparatus according to claim 1, it is characterised in that:It is described MapReduce engines are made of JobTrackers and TaskTrackers.
5. big data multi-internet integration scientific research all-in-one machine stage apparatus according to claim 1, it is characterised in that:The HDFS Distributed file system is constituted by providing Metadata Service NameNode for it with the DataNode for providing memory block.
6. big data multi-internet integration scientific research all-in-one machine stage apparatus according to claim 1, it is characterised in that:The business Layer and accumulation layer are also connect with application layer and virtual resource layer respectively, and application layer is intelligent terminal, notebook, PC machine or thin Client computer, the virtual resource layer are Internet resources.
7. big data multi-internet integration scientific research all-in-one machine stage apparatus according to claim 1, it is characterised in that:The application While layer, operation layer, process layer, management level, accumulation layer and virtual resource layer are to data processing monitor cooperation layer to application layer, Operation layer, process layer, management level, accumulation layer and virtual resource layer are monitored and coordinate, and monitor cooperation layer by Zookeeper It is formed with Chukwa.
CN201710025727.9A 2017-01-13 2017-01-13 Big data multi-internet integration scientific research all-in-one machine stage apparatus Pending CN108306916A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201710025727.9A CN108306916A (en) 2017-01-13 2017-01-13 Big data multi-internet integration scientific research all-in-one machine stage apparatus

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201710025727.9A CN108306916A (en) 2017-01-13 2017-01-13 Big data multi-internet integration scientific research all-in-one machine stage apparatus

Publications (1)

Publication Number Publication Date
CN108306916A true CN108306916A (en) 2018-07-20

Family

ID=62872142

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201710025727.9A Pending CN108306916A (en) 2017-01-13 2017-01-13 Big data multi-internet integration scientific research all-in-one machine stage apparatus

Country Status (1)

Country Link
CN (1) CN108306916A (en)

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109359151A (en) * 2018-10-29 2019-02-19 上海船舶工艺研究所(中国船舶工业集团公司第十研究所) A kind of body section logistics big data Visualization Platform
CN109684412A (en) * 2018-12-25 2019-04-26 成都虚谷伟业科技有限公司 A kind of distributed data base system
CN112650747A (en) * 2021-01-20 2021-04-13 天元大数据信用管理有限公司 Big data management method in financial wind control service scene

Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102221927A (en) * 2011-05-27 2011-10-19 深圳中电数码显示有限公司 Touch triple play multimedia integrated machine device and touch realization method thereof
US20140195466A1 (en) * 2013-01-08 2014-07-10 Purepredictive, Inc. Integrated machine learning for a data management product
CN104391989A (en) * 2014-12-16 2015-03-04 浪潮电子信息产业股份有限公司 Distributed ETL all-in-one machine system
CN104506632A (en) * 2014-12-25 2015-04-08 中国科学院电子学研究所 Resource sharing system and method based on distributed multi-center
CN105205729A (en) * 2015-09-22 2015-12-30 许继集团有限公司 Power system energy efficiency public service cloud platform based on cloud computing
CN105554123A (en) * 2015-12-17 2016-05-04 北京华油信通科技有限公司 High-capacity-aware cloud computing platform system
CN105933461A (en) * 2016-07-18 2016-09-07 合肥赑歌数据科技有限公司 Big data platform system and operation method thereof
CN106326331A (en) * 2016-06-29 2017-01-11 河南许继仪表有限公司 Intelligent power utilization data service system based on cloud computation

Patent Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102221927A (en) * 2011-05-27 2011-10-19 深圳中电数码显示有限公司 Touch triple play multimedia integrated machine device and touch realization method thereof
US20140195466A1 (en) * 2013-01-08 2014-07-10 Purepredictive, Inc. Integrated machine learning for a data management product
CN104391989A (en) * 2014-12-16 2015-03-04 浪潮电子信息产业股份有限公司 Distributed ETL all-in-one machine system
CN104506632A (en) * 2014-12-25 2015-04-08 中国科学院电子学研究所 Resource sharing system and method based on distributed multi-center
CN105205729A (en) * 2015-09-22 2015-12-30 许继集团有限公司 Power system energy efficiency public service cloud platform based on cloud computing
CN105554123A (en) * 2015-12-17 2016-05-04 北京华油信通科技有限公司 High-capacity-aware cloud computing platform system
CN106326331A (en) * 2016-06-29 2017-01-11 河南许继仪表有限公司 Intelligent power utilization data service system based on cloud computation
CN105933461A (en) * 2016-07-18 2016-09-07 合肥赑歌数据科技有限公司 Big data platform system and operation method thereof

Non-Patent Citations (4)

* Cited by examiner, † Cited by third party
Title
""分布式文件管理一体机设计与研发"" *
南京云创大数据: ""数据立方大数据一体机"", pages 1 - 12, Retrieved from the Internet <URL:http://www.cstor.cn/proTextdetail_121.html> *
张东;亓开元;吴楠;辛国茂;刘正伟;颜秉珩;郭锋;: "云海大数据一体机体系结构和关键技术", no. 02 *
饶玮;周爱华;常涛;谢若承;蒋静;: "基于分布式存储的多类型数据管理技术研究", no. 05 *

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109359151A (en) * 2018-10-29 2019-02-19 上海船舶工艺研究所(中国船舶工业集团公司第十研究所) A kind of body section logistics big data Visualization Platform
CN109684412A (en) * 2018-12-25 2019-04-26 成都虚谷伟业科技有限公司 A kind of distributed data base system
CN112650747A (en) * 2021-01-20 2021-04-13 天元大数据信用管理有限公司 Big data management method in financial wind control service scene

Similar Documents

Publication Publication Date Title
US20230334030A1 (en) System and method for slowly changing dimension and metadata versioning in a multidimensional database environment
US10860598B2 (en) Systems and methods for interest-driven business intelligence systems including event-oriented data
Phaneendra et al. Big Data-solutions for RDBMS problems-A survey
US9747127B1 (en) Worldwide distributed job and tasks computational model
Gürcan et al. Real-time processing of big data streams: Lifecycle, tools, tasks, and challenges
CN107315776A (en) A kind of data management system based on cloud computing
CN104205039A (en) Interest-driven business intelligence systems and methods of data analysis using interest-driven data pipelines
US20150081353A1 (en) Systems and Methods for Interest-Driven Business Intelligence Systems Including Segment Data
CN107590181A (en) A kind of intelligent analysis system of big data
CN107408114A (en) Based on transactions access pattern-recognition connection relation
CN110928740A (en) Centralized visualization method and system for operation and maintenance data of cloud computing center
CN112148718A (en) Big data support management system for city-level data middling station
CN109977125A (en) A kind of big data safety analysis plateform system based on network security
CN108306916A (en) Big data multi-internet integration scientific research all-in-one machine stage apparatus
Sogodekar et al. Big data analytics: hadoop and tools
US9767222B2 (en) Information sets for data management
CN208207819U (en) A kind of big data analysis processing system based on extended node cluster
Abdelhafez Big data technologies and analytics: A review of emerging solutions
CN108399208A (en) A kind of information display system of big data
Lee et al. A big data management system for energy consumption prediction models
CN112181972A (en) Data management method and device based on big data and computer equipment
US9275059B1 (en) Genome big data indexing
CN108304549A (en) A kind of big data Intelligent processing system
CN108363756A (en) A kind of intelligent transportation big data processing system
Krstić et al. Testing the performance of NoSQL databases via the database benchmark tool

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination