CN108306916A - Big data multi-internet integration scientific research all-in-one machine stage apparatus - Google Patents
Big data multi-internet integration scientific research all-in-one machine stage apparatus Download PDFInfo
- Publication number
- CN108306916A CN108306916A CN201710025727.9A CN201710025727A CN108306916A CN 108306916 A CN108306916 A CN 108306916A CN 201710025727 A CN201710025727 A CN 201710025727A CN 108306916 A CN108306916 A CN 108306916A
- Authority
- CN
- China
- Prior art keywords
- layer
- data
- big data
- scientific research
- stage apparatus
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/10—Protocols in which an application is distributed across nodes in the network
- H04L67/1097—Protocols in which an application is distributed across nodes in the network for distributed storage of data in networks, e.g. transport arrangements for network file system [NFS], storage area networks [SAN] or network attached storage [NAS]
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L41/00—Arrangements for maintenance, administration or management of data switching networks, e.g. of packet switching networks
- H04L41/06—Management of faults, events, alarms or notifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L41/00—Arrangements for maintenance, administration or management of data switching networks, e.g. of packet switching networks
- H04L41/08—Configuration management of networks or network elements
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L43/00—Arrangements for monitoring or testing data switching networks
- H04L43/08—Monitoring or testing based on specific metrics, e.g. QoS, energy consumption or environmental parameters
- H04L43/0876—Network utilisation, e.g. volume of load or congestion level
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/50—Network services
- H04L67/54—Presence management, e.g. monitoring or registration for receipt of user log-on information, or the connection status of the users
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/10—File systems; File servers
- G06F16/18—File system types
- G06F16/182—Distributed file systems
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/27—Replication, distribution or synchronisation of data between databases or within a distributed database system; Distributed database system architectures therefor
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
- G06F3/0601—Interfaces specially adapted for storage systems
- G06F3/0602—Interfaces specially adapted for storage systems specifically adapted to achieve a particular effect
- G06F3/0604—Improving or facilitating administration, e.g. storage management
- G06F3/0607—Improving or facilitating administration, e.g. storage management by facilitating the process of upgrading existing storage systems, e.g. for improving compatibility between host and storage device
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
- G06F3/0601—Interfaces specially adapted for storage systems
- G06F3/0628—Interfaces specially adapted for storage systems making use of a particular technique
- G06F3/0662—Virtualisation aspects
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
- G06F3/0601—Interfaces specially adapted for storage systems
- G06F3/0668—Interfaces specially adapted for storage systems adopting a particular infrastructure
- G06F3/067—Distributed or networked storage systems, e.g. storage area networks [SAN], network attached storage [NAS]
Abstract
The present invention provides a kind of big data multi-internet integration scientific research all-in-one machine stage apparatus, is related to big data processing field.The big data multi-internet integration scientific research all-in-one machine stage apparatus, including cProc clouds processing platform, application layer, virtual resource layer and cubic data library, cProc clouds processing platform is bi-directionally connected with Storm cloud storage systems, HBase distributed data bases and HDFS distributed file systems respectively, cProc clouds processing platform is also tested all-in-one machine with big data real 3 and is bi-directionally connected, and big data experiment all-in-one machine is bi-directionally connected with distributed computer.The big data multi-internet integration scientific research all-in-one machine stage apparatus, big data is stored by the cooperation of Storm clouds stocking system, HBas distributed data bases and HDFS distributed file systems, reduces hardware and the input cost of personal management, storage capacity is big, strong applicability, reliability are high.
Description
Technical field
Big data processing technology field of the present invention, specially a kind of big data multi-internet integration scientific research all-in-one machine stage apparatus.
Background technology
Data refer to the symbol that is recorded and can be differentiated to objective event, be to the property of objective things, state with
And the combination of phy symbol or these phy symbols that correlation etc. is recorded.It is symbol that is identifiable, being abstracted.It
Refer not only to number in the narrow sense, can also be word with definite meaning, letter, the combination of numerical chracter, figure, image,
The abstract representation of the attribute of video, audio etc. and objective things, quantity, position and its correlation.For example, " 0,1,
2... ", " the moon, rain, decline, temperature " " dossier of student, traffic condition of cargo " etc. is all data, and data are by processing
Just become information afterwards.
A large amount of experimental data is usually will produce during the student experimenting of major colleges and universities, the processing of these big datas is often
It often needs to use big data experiment all-in-one machine, big data experiment all-in-one machine is virtually big with a small amount of machine by application container technology
Amount experiment cluster possesses more set clusters for a large amount of students and tests simultaneously, and the experimental situation of each student is not only mutual
Experiment is easily and efficiently completed in isolation, and experiment is not interfered each other, even if some experimental situation is destroyed to other people
Do not influence.
It is all using the storing mechanism of itself and outer that current big data experiment all-in-one machine is most of for the storage of data
The storage device set carries out, but such storage mode hardware and the input cost of personal management are high, and storage capacity is small, applicability
Difference.
Invention content
(1) the technical issues of solving
In view of the deficiencies of the prior art, the present invention provides a kind of big data multi-internet integration scientific research all-in-one machine stage apparatus,
It solves current big data experiment all-in-one machine to be stored using the storing mechanism and external storage device of itself, hardware and people
The input cost of member's management is high, and storage capacity is small, problem poor for applicability.
(2) technical solution
In order to achieve the above object, the present invention is achieved by the following technical programs:A kind of big data multi-internet integration scientific research
All-in-one machine stage apparatus, including cProc clouds processing platform, application layer, virtual resource layer and cubic data library, the cProc clouds
Processing platform is bi-directionally connected with Storm cloud storage systems, HBase distributed data bases and HDFS distributed file systems respectively,
The cProc clouds processing platform is also bi-directionally connected with big data experiment all-in-one machine, the big data experiment all-in-one machine and distribution
Computer bidirectional connects.
The Storm cloud storage systems include management and monitoring center, the management and monitoring center respectively with metadata management
Server, the connection of data memory node server and client side's two-wire.
The management and monitoring center includes configuration center and monitoring center, and the configuration center includes volume configuration, node ginseng
Number configuration, storage parameter configuration, user's quotas administered, QoS management and alarm device, the monitoring center include memory space prison
Control, device status monitoring, program state monitoring, disk state monitoring, traffic monitoring and warning comprehensively.
The HBase distributed data bases and cubic data library constitute management level, and management level respectively with process layer and deposit
Reservoir connects, and accumulation layer is made of Storm cloud storage systems and HDFS distributed file systems, and process layer is drawn by MapReduce
Composition is held up, process layer is also connect with operation layer.
Preferably, the cProc clouds processing platform is built on cloud storage system, and cProc cloud processing platforms are to industry
Business layer directly provides the distributed data processing platform of external development interface and data transmission interface.
Preferably, the cubic data library is the index that field is established with the structure of B+ trees, the word of each B+ tree constructions
As soon as segment index is equivalent to a data plane, such a global data table and the index of its multiple significant field constitute one
Similar to cubical data organizational structure.
Preferably, the MapReduce engines are made of JobTrackers and TaskTrackers.
Preferably, the HDFS distributed file systems are by providing Metadata Service NameNode for it and providing memory block
DataNode constitute.
Preferably, the operation layer and accumulation layer are also connect with application layer and virtual resource layer respectively, and application layer is intelligence
Energy terminal, notebook, PC machine or thin client, the virtual resource layer are Internet resources.
Preferably, the application layer, operation layer, process layer, management level, accumulation layer and virtual resource layer are to data processing
It monitors cooperation layer simultaneously application layer, operation layer, process layer, management level, accumulation layer and virtual resource layer are monitored and are coordinated,
And monitoring cooperation layer is made of Zookeeper and Chukwa.
(3) advantageous effect
The present invention provides a kind of big data multi-internet integration scientific research all-in-one machine stage apparatus.Has following advantageous effect:
1, the big data multi-internet integration scientific research all-in-one machine stage apparatus, passes through Storm clouds stocking system, HBas distribution numbers
Big data is stored according to the cooperation in library and HDFS distributed file systems, Stor cloud storage systems using cloud computing technology,
Network communication technology and distributed file system technology play cheap, degraded performance hardware store node organization management
Come, HBas distributed data bases can be obtained apart from some time nearest data, or once obtain all data, HDFS points
Data can both be merged abbreviation by cloth file system, and data can also be divided into multiple junior units, reduce hardware and personnel
The input cost of management, storage capacity is big, strong applicability, and reliability is high.
2, the big data multi-internet integration scientific research all-in-one machine stage apparatus, it includes metadata pipe that Storm cloud stocking systems, which use,
The structure for managing server (management node), data memory node server (memory node) and client node constitutes a void
Quasi- mass storage volume, effectively provides high-performance, highly reliable storage system, and data money is timely extracted convenient for user
Material.
3, big data multi-internet integration scientific research all-in-one machine stage apparatus, in the management and monitoring that Storm cloud stocking systems provide
The heart can be managed each node, including equipment running status, disk operating status, service online situation and exception
The functions such as alarm;In addition, network management monitoring center is also provided with such as FTP accounts addition client-side management and configuration tool, it is convenient for
User timely understands the real-time status of data, is managed to data convenient for user.
Description of the drawings
Fig. 1 is present system schematic diagram;
Fig. 2 is the structure diagram of Storm clouds stocking system of the present invention;
Fig. 3 is cProc Organization Charts of the present invention
Specific implementation mode
Following will be combined with the drawings in the embodiments of the present invention, and technical solution in the embodiment of the present invention carries out clear, complete
Site preparation describes, it is clear that described embodiments are only a part of the embodiments of the present invention, instead of all the embodiments.It is based on
Embodiment in the present invention, it is obtained by those of ordinary skill in the art without making creative efforts every other
Embodiment shall fall within the protection scope of the present invention.
- 2 are please referred to Fig.1, the embodiment of the present invention provides a kind of big data multi-internet integration scientific research all-in-one machine stage apparatus, including
CProc clouds processing platform, application layer, virtual resource layer and cubic data library, cProc clouds processing platform are deposited with Storm clouds respectively
Storage system, HBase distributed data bases and HDFS distributed file systems are bi-directionally connected, and cProc clouds processing platform is also counted with big
All-in-one machine is bi-directionally connected according to the experiment, and big data experiment all-in-one machine is bi-directionally connected with distributed computer.
In the present invention:CProc cloud processing platforms are built on cloud storage system, and cProc cloud processing platforms are to business
Layer directly provides the distributed data processing platform of external development interface and data transmission interface, and cProc cloud processing platforms are one
The parallel programming model and Computational frame of kind processing mass data, for the parallel computation to large-scale dataset.
CProc Organization Charts are as shown in figure 3, cProc cloud processing platforms are that a kind of efficient distribution of processing mass data is soft
The cloud processing platform of set of hardware, the platform can excavate useful information from TB or even PB grades of data, and to these
Magnanimity information carries out quick, efficient processing, and cProc cloud processing platforms are supported and relational database mixed mode, the overwhelming majority
Mass data deposits in distributed platform and carries out distributed treatment, and the very high data of a small amount of requirement of real-time deposit in relationship number
According to library, various types of business demands are supported to meet, support support inquiry, statistics, analysis business;Sustainable depth data is dug
Pick and Intellectual analysis business, it is desirable that 50% or more is reached to stsndard SQL specification support, provides Attributions selection, classification in advance
The data mining algorithms such as survey, regression forecasting, clustering, association analysis, time series analysis provide food two-dimensional code scanning work(
Can, various information can be realized and be traced to the source, after being parsed by cProc cloud processing platforms, data query and inspection can be greatly increased
The business such as rope, can allow system platform have data be put in storage in real time, the advantages such as real-time query, query result real-time Transmission, pass through
After cProc analyzes metadata, inquiry and the recall precision of data can be greatly speeded up.
In the present invention:HDFS distributed file systems are by providing Metadata Service NameNode for it and providing memory block
DataNode is constituted, and HDFS distributed file systems are the bottom layer realization parts of cloud processing platform Hadoop frames of increasing income, and are suitble to
The distributed file system on common hardware is operated in, there is high fault tolerance, the data access of handling capacity can be improved, be very suitable for
In the application on large-scale dataset.
In the present invention:HBase distributed data bases are one sparse similar to the distributed data base of Bigtable, long
Phase storage, multidimensional, the index of the mapping table of sequence, this table is row keyword, row keyword and timestamp, all data
The more new capital in library is a timestamp label, and each more new capital is a new version, and HBase can retain a certain number of versions
This, this value can set, and client can be obtained apart from some time nearest data, or once obtain all numbers
According to.
Storm cloud storage systems include management and monitoring center, management and monitoring center respectively with metadata management server, number
It is connected according to memory node server and client side's two-wire.
Management and monitoring center includes configuration center and monitoring center, and configuration center includes volume configuration, node parameter configuration, deposits
Parameter configuration, user's quotas administered, QoS management and alarm device are stored up, monitoring center includes memory space monitoring, equipment state prison
Control, program state monitoring, disk state monitoring, traffic monitoring and warning comprehensively.
In the present invention:Management and monitoring center has the virtual management for providing storage rack, Ke Yijian in use
The operating status for measuring each node server, the operating status to disk and service condition monitoring, to volume management server
Setting and account management, to the function of System Operation Log management and audit.
In the present invention:Storm cloud stocking systems be directed to the characteristics of most data-intensive applications from many aspects into
Optimization is gone, to reach the optimum balance of cost, reliability and performance under certain scale.Storm clouds stocking system with
It is ultralow price, excellent performance, highly reliable, green energy conservation, limitless volumes, on-line automatic flexible, easy-to-use general etc. many
Overwhelming dominance obtains the consistent praise of user.
In the present invention:All nodes of Stor cloud storage systems are connected by way of network, wherein storage section
Point uses cheap computer node, is carried out with adaptive replica management technology fault-tolerant, and all memory nodes concurrently act as pair
Outer service function, client are mounted to different storage node accesses cloud storage systems respectively, by increasing or reducing storage section
The mode of point, you can it is fault-tolerant as a result of the progress of adaptive replica management technology to be stretched online to storage system, be
During system stretches online, system external is not influenced, service is provided.
For the user of Stor cloud storages, magnanimity cloud storage system can be mapped to one by Stor clients
Local magnanimity disk (window client) is either mapped to a catalogue (linuxn client) for this disk or catalogue
Read-write operation, you can realize cloud storage system data read-write.Simultaneously as Stor file system supports POSIX interfaces rule
Model need not do secondary development for current general application and can be used.
HBase distributed data bases and cubic data library constitute management level, and management level respectively with process layer and accumulation layer
Connection, accumulation layer are made of Storm cloud storage systems and HDFS distributed file systems, and process layer is by MapReduce engine groups
At process layer is also connect with operation layer, and operation layer and accumulation layer are also connect with application layer and virtual resource layer respectively, and application layer
For intelligent terminal, notebook, PC machine or thin client, virtual resource layer is Internet resources, application layer, operation layer, process layer,
Cooperation layer is monitored while management level, accumulation layer and virtual resource layer are to data processing to application layer, operation layer, process layer, pipe
Reason layer, accumulation layer and virtual resource layer are monitored and coordinate, and monitor cooperation layer and be made of Zookeeper and Chukwa.
In the present invention:MapReduce engines are made of JobTrackers and TaskTrackers.
In the present invention:Cubic data library is the index that field is established with the structure of B+ trees, the field of each B+ tree constructions
As soon as index is equivalent to a data plane, such a global data table and the index of its multiple significant field constitute a class
It is similar to cubical data organizational structure.
In conclusion the big data multi-internet integration scientific research all-in-one machine stage apparatus, passes through Storm clouds stocking system, HBas
The cooperation of distributed data base and HDFS distributed file systems stores big data, and Stor cloud storage systems use cloud meter
Calculation technology, network communication technology and distributed file system technology, by cheap, degraded performance hardware store node organization
Management is got up, and HBas distributed data bases can be obtained apart from some time nearest data, or once obtain all data,
Data can both be merged abbreviation by HDFS distributed file systems, and data can also be divided into multiple junior units, reduce hardware
With the input cost of personal management, storage capacity is big, strong applicability, and reliability is high.
Meanwhile it includes metadata management server (management node), data memory node clothes that Storm cloud stocking systems, which use,
Be engaged in device (memory node) and client node structure constitute a virtual mass storage volume, effectively provide high-performance,
Highly reliable storage system timely extracts data information convenient for user.
Secondly, the management and monitoring center that Storm cloud stocking systems provide can be managed each node, including set
The functions such as standby operating status, disk operating status, service online situation and abnormality alarming;In addition, network management monitoring center also carries
For just like client-side managements and configuration tools such as the additions of FTP accounts, the real-time status of data timely being understood convenient for user, just
Data are managed in user.
It although an embodiment of the present invention has been shown and described, for the ordinary skill in the art, can be with
Understanding without departing from the principles and spirit of the present invention can carry out these embodiments a variety of variations, modification, replace
And modification, the scope of the present invention is defined by the appended.
Claims (7)
1. a kind of big data multi-internet integration scientific research all-in-one machine stage apparatus, including cProc clouds processing platform, application layer, virtual money
Active layer and cubic data library, it is characterised in that:The cProc clouds processing platform divides with Storm cloud storage systems, HBase respectively
Cloth database and HDFS distributed file systems are bi-directionally connected, and the cProc clouds processing platform also tests one with big data
Machine is bi-directionally connected, and the big data experiment all-in-one machine is bi-directionally connected with distributed computer;
The Storm cloud storage systems include management and monitoring center, the management and monitoring center respectively with metadata management service
Device, the connection of data memory node server and client side's two-wire;
The management and monitoring center includes configuration center and monitoring center, and the configuration center includes that volume configures, node parameter is matched
Set, store parameter configuration, user's quotas administered, QoS management and alarm device, the monitoring center include memory space monitoring,
Device status monitoring, program state monitoring, disk state monitoring, traffic monitoring and warning comprehensively;
The HBase distributed data bases and cubic data library constitute management level, and management level respectively with process layer and accumulation layer
Connection, accumulation layer are made of Storm cloud storage systems and HDFS distributed file systems, and process layer is by MapReduce engine groups
At process layer is also connect with operation layer.
2. big data multi-internet integration scientific research all-in-one machine stage apparatus according to claim 1, it is characterised in that:It is described
CProc cloud processing platforms are built on cloud storage system, and cProc cloud processing platforms are that external exploitation is directly provided to operation layer
The distributed data processing platform of interface and data transmission interface.
3. big data multi-internet integration scientific research all-in-one machine stage apparatus according to claim 1, it is characterised in that:Described cube
Database is the index that field is established with the structure of B+ trees, and the field index of each B+ tree constructions is equivalent to a data and puts down
The index of face, such a global data table and its multiple significant field just constitutes one and is similar to cubical data organization
Structure.
4. big data multi-internet integration scientific research all-in-one machine stage apparatus according to claim 1, it is characterised in that:It is described
MapReduce engines are made of JobTrackers and TaskTrackers.
5. big data multi-internet integration scientific research all-in-one machine stage apparatus according to claim 1, it is characterised in that:The HDFS
Distributed file system is constituted by providing Metadata Service NameNode for it with the DataNode for providing memory block.
6. big data multi-internet integration scientific research all-in-one machine stage apparatus according to claim 1, it is characterised in that:The business
Layer and accumulation layer are also connect with application layer and virtual resource layer respectively, and application layer is intelligent terminal, notebook, PC machine or thin
Client computer, the virtual resource layer are Internet resources.
7. big data multi-internet integration scientific research all-in-one machine stage apparatus according to claim 1, it is characterised in that:The application
While layer, operation layer, process layer, management level, accumulation layer and virtual resource layer are to data processing monitor cooperation layer to application layer,
Operation layer, process layer, management level, accumulation layer and virtual resource layer are monitored and coordinate, and monitor cooperation layer by Zookeeper
It is formed with Chukwa.
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201710025727.9A CN108306916A (en) | 2017-01-13 | 2017-01-13 | Big data multi-internet integration scientific research all-in-one machine stage apparatus |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201710025727.9A CN108306916A (en) | 2017-01-13 | 2017-01-13 | Big data multi-internet integration scientific research all-in-one machine stage apparatus |
Publications (1)
Publication Number | Publication Date |
---|---|
CN108306916A true CN108306916A (en) | 2018-07-20 |
Family
ID=62872142
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN201710025727.9A Pending CN108306916A (en) | 2017-01-13 | 2017-01-13 | Big data multi-internet integration scientific research all-in-one machine stage apparatus |
Country Status (1)
Country | Link |
---|---|
CN (1) | CN108306916A (en) |
Cited By (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN109359151A (en) * | 2018-10-29 | 2019-02-19 | 上海船舶工艺研究所(中国船舶工业集团公司第十研究所) | A kind of body section logistics big data Visualization Platform |
CN109684412A (en) * | 2018-12-25 | 2019-04-26 | 成都虚谷伟业科技有限公司 | A kind of distributed data base system |
CN112650747A (en) * | 2021-01-20 | 2021-04-13 | 天元大数据信用管理有限公司 | Big data management method in financial wind control service scene |
Citations (8)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN102221927A (en) * | 2011-05-27 | 2011-10-19 | 深圳中电数码显示有限公司 | Touch triple play multimedia integrated machine device and touch realization method thereof |
US20140195466A1 (en) * | 2013-01-08 | 2014-07-10 | Purepredictive, Inc. | Integrated machine learning for a data management product |
CN104391989A (en) * | 2014-12-16 | 2015-03-04 | 浪潮电子信息产业股份有限公司 | Distributed ETL all-in-one machine system |
CN104506632A (en) * | 2014-12-25 | 2015-04-08 | 中国科学院电子学研究所 | Resource sharing system and method based on distributed multi-center |
CN105205729A (en) * | 2015-09-22 | 2015-12-30 | 许继集团有限公司 | Power system energy efficiency public service cloud platform based on cloud computing |
CN105554123A (en) * | 2015-12-17 | 2016-05-04 | 北京华油信通科技有限公司 | High-capacity-aware cloud computing platform system |
CN105933461A (en) * | 2016-07-18 | 2016-09-07 | 合肥赑歌数据科技有限公司 | Big data platform system and operation method thereof |
CN106326331A (en) * | 2016-06-29 | 2017-01-11 | 河南许继仪表有限公司 | Intelligent power utilization data service system based on cloud computation |
-
2017
- 2017-01-13 CN CN201710025727.9A patent/CN108306916A/en active Pending
Patent Citations (8)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN102221927A (en) * | 2011-05-27 | 2011-10-19 | 深圳中电数码显示有限公司 | Touch triple play multimedia integrated machine device and touch realization method thereof |
US20140195466A1 (en) * | 2013-01-08 | 2014-07-10 | Purepredictive, Inc. | Integrated machine learning for a data management product |
CN104391989A (en) * | 2014-12-16 | 2015-03-04 | 浪潮电子信息产业股份有限公司 | Distributed ETL all-in-one machine system |
CN104506632A (en) * | 2014-12-25 | 2015-04-08 | 中国科学院电子学研究所 | Resource sharing system and method based on distributed multi-center |
CN105205729A (en) * | 2015-09-22 | 2015-12-30 | 许继集团有限公司 | Power system energy efficiency public service cloud platform based on cloud computing |
CN105554123A (en) * | 2015-12-17 | 2016-05-04 | 北京华油信通科技有限公司 | High-capacity-aware cloud computing platform system |
CN106326331A (en) * | 2016-06-29 | 2017-01-11 | 河南许继仪表有限公司 | Intelligent power utilization data service system based on cloud computation |
CN105933461A (en) * | 2016-07-18 | 2016-09-07 | 合肥赑歌数据科技有限公司 | Big data platform system and operation method thereof |
Non-Patent Citations (4)
Title |
---|
""分布式文件管理一体机设计与研发"" * |
南京云创大数据: ""数据立方大数据一体机"", pages 1 - 12, Retrieved from the Internet <URL:http://www.cstor.cn/proTextdetail_121.html> * |
张东;亓开元;吴楠;辛国茂;刘正伟;颜秉珩;郭锋;: "云海大数据一体机体系结构和关键技术", no. 02 * |
饶玮;周爱华;常涛;谢若承;蒋静;: "基于分布式存储的多类型数据管理技术研究", no. 05 * |
Cited By (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN109359151A (en) * | 2018-10-29 | 2019-02-19 | 上海船舶工艺研究所(中国船舶工业集团公司第十研究所) | A kind of body section logistics big data Visualization Platform |
CN109684412A (en) * | 2018-12-25 | 2019-04-26 | 成都虚谷伟业科技有限公司 | A kind of distributed data base system |
CN112650747A (en) * | 2021-01-20 | 2021-04-13 | 天元大数据信用管理有限公司 | Big data management method in financial wind control service scene |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US20230334030A1 (en) | System and method for slowly changing dimension and metadata versioning in a multidimensional database environment | |
US10860598B2 (en) | Systems and methods for interest-driven business intelligence systems including event-oriented data | |
Phaneendra et al. | Big Data-solutions for RDBMS problems-A survey | |
US9747127B1 (en) | Worldwide distributed job and tasks computational model | |
Gürcan et al. | Real-time processing of big data streams: Lifecycle, tools, tasks, and challenges | |
CN107315776A (en) | A kind of data management system based on cloud computing | |
CN104205039A (en) | Interest-driven business intelligence systems and methods of data analysis using interest-driven data pipelines | |
US20150081353A1 (en) | Systems and Methods for Interest-Driven Business Intelligence Systems Including Segment Data | |
CN107590181A (en) | A kind of intelligent analysis system of big data | |
CN107408114A (en) | Based on transactions access pattern-recognition connection relation | |
CN110928740A (en) | Centralized visualization method and system for operation and maintenance data of cloud computing center | |
CN112148718A (en) | Big data support management system for city-level data middling station | |
CN109977125A (en) | A kind of big data safety analysis plateform system based on network security | |
CN108306916A (en) | Big data multi-internet integration scientific research all-in-one machine stage apparatus | |
Sogodekar et al. | Big data analytics: hadoop and tools | |
US9767222B2 (en) | Information sets for data management | |
CN208207819U (en) | A kind of big data analysis processing system based on extended node cluster | |
Abdelhafez | Big data technologies and analytics: A review of emerging solutions | |
CN108399208A (en) | A kind of information display system of big data | |
Lee et al. | A big data management system for energy consumption prediction models | |
CN112181972A (en) | Data management method and device based on big data and computer equipment | |
US9275059B1 (en) | Genome big data indexing | |
CN108304549A (en) | A kind of big data Intelligent processing system | |
CN108363756A (en) | A kind of intelligent transportation big data processing system | |
Krstić et al. | Testing the performance of NoSQL databases via the database benchmark tool |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PB01 | Publication | ||
PB01 | Publication | ||
SE01 | Entry into force of request for substantive examination | ||
SE01 | Entry into force of request for substantive examination |