CN107526818A - One kind is based on enterprise's private clound big data processing system and method - Google Patents
One kind is based on enterprise's private clound big data processing system and method Download PDFInfo
- Publication number
- CN107526818A CN107526818A CN201710751692.7A CN201710751692A CN107526818A CN 107526818 A CN107526818 A CN 107526818A CN 201710751692 A CN201710751692 A CN 201710751692A CN 107526818 A CN107526818 A CN 107526818A
- Authority
- CN
- China
- Prior art keywords
- data
- data processing
- database
- enterprise
- soa
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/25—Integrating or interfacing systems involving database management systems
- G06F16/254—Extract, transform and load [ETL] procedures, e.g. ETL data flows in data warehouses
Abstract
The invention discloses one kind to be based on enterprise's private clound big data processing system, including data acquisition and management, database, SOA buses, interior business and external service, flow data processing module and data standard access interface are provided with inside the data acquisition and management, flow data processing module is acquired to the signal source that data collection station is sent, other data terminals are connected by wire with data standard access interface, the flow data processing module and data standard access interface will be collected into data be passed into database in it is standby, signal two-way circulates between database and data processing and displaying, connected between the database and common support and SOA by adapter, signal two-way circulates.Enterprise's private clound big data processing system and method should be based on, and pass through the unified planning in networking so that each system, mutual application data realize Real-Time Sharing, and then improve operating efficiency.
Description
Technical field
The present invention relates to big data processing equipment technical field, is specially that one kind is based on enterprise's private clound big data processing system
System and method.
Background technology
Enterprise's private clound, using multinomial new technologies such as cloud computing, enterprise calculation, real-time commercial analysis, big data management,
Innovative service development model is explored, integrating society storage resources, improves resource utilization, reduces resource consumption, support green
And sustainable development, meet the operation demand that Enterprise Management Transform is fast, service quality is high, input cost is low, comprehensive curstomer-oriented
Service and Value creation, make health, multi-win, sustainable business zoology environment.Traditional business system be in each it is independent,
Technical Architecture is different, data dictionary disunity, it is impossible to is effectively integrated, simplifies operation, simple flow, uniform data and answer
With, it is impossible to fully excavating the value of available data makes it play maximum efficiency, and then reduces operating efficiency.
The content of the invention
It is an object of the invention to provide one kind to be based on enterprise's private clound big data processing system and method, existing to solve
Technological deficiency and inaccessiable technical requirements.
To achieve the above object, the present invention provides following technical scheme：One kind is based on enterprise's private clound big data processing system
System, including data acquisition and management, database, SOA buses, interior business and external service, in the data acquisition and management
Portion is provided with flow data processing module and data standard access interface, the signal that flow data processing module is sent to data collection station
Source is acquired, and other data terminals are connected by wire with data standard access interface, the flow data processing module sum
According to standard access interface will be collected into data be passed into database in standby, signal between database and data processing and displaying
Two-way circulate, connected between the database and common support and SOA by adapter, signal two-way circulates, the SOA assemblies
Including ESB and BPM platform, pass through adapter between SOA buses and interior business and external service
Connection, signal bi-directional, the interior business are passed through signal unidirectional delivery to internal user, external service by private clound
Public cloud or mixed cloud are by signal unidirectional delivery to external user.
Preferably, it is described
A. by Data Collection, the data gathered pass through data acquisition and management device for data collection station and other data terminals
It is transferred in database, time series data storage, memory data grid, high-speed data access and DMP of the data in database
Encryption is compiled in the presence of processing module；
B. the data in database by circuit board be delivered to data processing with displaying in, data by information processing model storehouse,
Data Mining Tools and data publication displaying, by touch display screen, are retrieved to desired information；
C. database and common support are connected by adapter with SOA buses, the user authority management being provided with inside common support
Data can be protected with interactive service engine；
D.SOA buses are delivered to terminal and used for external user and internal user after signal is converted by adapter.
Preferably, the mass data processing function by platform, there is provided the dynamic infinite scalability of platform data；
Pass through the standard data interface of platform, there is provided platform is uniformly accessed into new-old system, is provided strong support for subsequent expansion.
Preferably, the integration IT safe practices, on the basis of ensureing modules safety, the peace of whole platform is realized
Entirely.
Preferably, the ETL instruments provided by platform, and multiple industries such as built-in manufacture, retail, logistics
Analysis model, quickly data can be extracted, counted, be analyzed, data are provided and supported for business decision and integrated service.
The beneficial effect that is reached of the present invention is：The present invention is based on the basis of SOA Technical Architectures, with reference to cloud computing technology and
Big data high-speed processing technology, and using the modularity of differentiation, the original some technical enablers of Hitachi are incorporated basic skill
Art platform, form complete intelligent cloud service platform；Privately owned cloud system based on SOA buses, with reference to big data high speed processing,
The module such as data processing and displaying, common support, data acquisition and management, integrated use management, passes through unified bottom data
The unified APIs interfaces of transmission technology and upper strata, whole system is set to realize that unified data acquisition, data storage, data are adjusted
Degree, perfect platform technology is provided for upper-layer service exploitation.
Brief description of the drawings
Fig. 1 is based on enterprise's private clound big data processing system structural representation for the present invention is a kind of.
Embodiment
Below in conjunction with the accompanying drawing in the embodiment of the present invention, the technical scheme in the embodiment of the present invention is carried out clear, complete
Site preparation describes, it is clear that described embodiment is only part of the embodiment of the present invention, rather than whole embodiments.It is based on
Embodiment in the present invention, those of ordinary skill in the art are obtained every other under the premise of creative work is not made
Embodiment, belong to the scope of protection of the invention.
Referring to Fig. 1, the present invention provides a kind of technical scheme：One kind is based on enterprise's private clound big data processing system, wraps
Data acquisition and management, database, SOA buses, interior business and external service are included, is provided with inside the data acquisition and management
Flow data processing module and data standard access interface, the signal source that flow data processing module is sent to data collection station are carried out
Collection, other data terminals are connected by wire with data standard access interface, the flow data processing module and data standard
Access interface will be collected into data be passed into database in standby, signal bidirectional flow between database and data processing and displaying
It is logical, connected between the database and common support and SOA by adapter, signal two-way circulates, and the SOA assemblies include enterprise
Industry service bus and BPM platform, are connected between SOA buses and interior business and external service by adapter, letter
Signal unidirectional delivery is passed through public cloud by number bi-directional, the interior business by private clound to internal user, external service
Or mixed cloud by signal unidirectional delivery to external user.
A. by Data Collection, the data gathered pass through data acquisition and management device for data collection station and other data terminals
It is transferred in database, time series data storage, memory data grid, high-speed data access and DMP of the data in database
Encryption is compiled in the presence of processing module；
B. the data in database by circuit board be delivered to data processing with displaying in, data by information processing model storehouse,
Data Mining Tools and data publication displaying, by touch display screen, are retrieved to desired information；
C. database and common support are connected by adapter with SOA buses, the user authority management being provided with inside common support
Data can be protected with interactive service engine；
D.SOA buses are delivered to terminal and used for external user and internal user after signal is converted by adapter.
Pass through the mass data processing function of platform, there is provided the dynamic infinite scalability of platform data；Pass through platform
Standard data interface, there is provided platform is uniformly accessed into new-old system, is provided strong support for subsequent expansion.
IT safe practices are integrated, on the basis of ensureing modules safety, realize the safety of whole platform.
The ETL instruments provided by platform, and the analysis model of multiple industries such as built-in manufacture, retail, logistics, energy
It is enough that quickly data are extracted, counted, are analyzed, data are provided and supported for business decision and integrated service.
It is of the invention a kind of that big data treatment technology, not only big is passed through based on enterprise's private clound big data processing system and method
Width improves data access speed and reduces the disk space shared by data storage, reduces enterprise on hardware costs
Input；By existing Intellectual analysis model, help enterprise fast, accurately and comprehensively to grasp enterprise operation situation, improve enterprise
Decision-making capability；The a variety of issue forms of information and the user interface General Promotion Consumer's Experience of close friend, establish good corporate image；
Enterprise's O＆M difficulty is reduced by brand-new unified operation platform and saves O＆M cost.
Finally it should be noted that：The preferred embodiments of the present invention are the foregoing is only, are not intended to limit the invention, although
The present invention is described in detail with reference to the foregoing embodiments, for those skilled in the art, it still can be right
Technical scheme described in foregoing embodiments is modified, or carries out equivalent substitution to which part technical characteristic.It is all
Within the spirit and principles in the present invention, any modification, equivalent substitution and improvements made etc., the protection of the present invention should be included in
Within the scope of.
Claims (5)
1. one kind is based on enterprise's private clound big data processing system, including data acquisition and management, database, SOA buses, inside
Business and external service, it is characterised in that：Flow data processing module and data standard are provided with inside the data acquisition and management
Access interface, flow data processing module are acquired to the signal source that data collection station is sent, and other data terminals are by leading
Line is connected with data standard access interface, and the flow data processing module and data standard access interface will be collected into obtain data biography
Standby in entering into database, signal two-way circulates between database and data processing and displaying, the database and common support
It is connected between SOA by adapter, signal two-way circulates, and the SOA assemblies include ESB and operation flow pipe
Platform, connected between SOA buses and interior business and external service by adapter, signal bi-directional, the internal industry
Business is unidirectionally passed signal signal unidirectional delivery by public cloud or mixed cloud to internal user, external service by private clound
Pass external user.
2. one kind according to claim 1 is based on enterprise's private clound big data processing method, it is characterised in that：It is described
A. by Data Collection, the data gathered pass through data acquisition and management device for data collection station and other data terminals
It is transferred in database, time series data storage, memory data grid, high-speed data access and DMP of the data in database
Encryption is compiled in the presence of processing module；
B. the data in database by circuit board be delivered to data processing with displaying in, data by information processing model storehouse,
Data Mining Tools and data publication displaying, by touch display screen, are retrieved to desired information；
C. database and common support are connected by adapter with SOA buses, the user authority management being provided with inside common support
Data can be protected with interactive service engine；
D.SOA buses are delivered to terminal and used for external user and internal user after signal is converted by adapter.
3. one kind according to claim 1 is based on enterprise's private clound big data processing system, it is characterised in that：It is described to pass through
The mass data processing function of platform, there is provided the dynamic infinite scalability of platform data；By the standard data interface of platform,
There is provided platform to be uniformly accessed into new-old system, provided strong support for subsequent expansion.
4. one kind according to claim 1 is based on enterprise's private clound big data processing system, it is characterised in that：The integration
IT safe practices, on the basis of ensureing modules safety, realize the safety of whole platform.
5. one kind according to claim 1 is based on enterprise's private clound big data processing system, it is characterised in that：It is described to pass through
The ETL instruments that platform provides, and the analysis model of multiple industries such as built-in manufacture, retail, logistics, being capable of quick logarithm
According to being extracted, counting, analyzing, data are provided and supported for business decision and integrated service.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710751692.7A CN107526818A (en) | 2017-08-28 | 2017-08-28 | One kind is based on enterprise's private clound big data processing system and method |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710751692.7A CN107526818A (en) | 2017-08-28 | 2017-08-28 | One kind is based on enterprise's private clound big data processing system and method |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN107526818A true CN107526818A (en) | 2017-12-29 |
Family
ID=60682317
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201710751692.7A Pending CN107526818A (en) | 2017-08-28 | 2017-08-28 | One kind is based on enterprise's private clound big data processing system and method |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN107526818A (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111932395A (en) * | 2020-08-11 | 2020-11-13 | 清华大学 | Manufacturing digital system based on hybrid cloud architecture |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105933361A (en) * | 2016-07-13 | 2016-09-07 | 何钟柱 | Big data security protection cloud system based on trusted calculation |
| CN106200593A (en) * | 2016-08-29 | 2016-12-07 | 中国重型机械研究院股份公司 | A kind of intelligent casting process control system and control method thereof |
| CN106713375A (en) * | 2015-07-21 | 2017-05-24 | 中国移动通信集团重庆有限公司 | Method and device for allocating cloud resources |
-
2017
- 2017-08-28 CN CN201710751692.7A patent/CN107526818A/en active Pending
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106713375A (en) * | 2015-07-21 | 2017-05-24 | 中国移动通信集团重庆有限公司 | Method and device for allocating cloud resources |
| CN105933361A (en) * | 2016-07-13 | 2016-09-07 | 何钟柱 | Big data security protection cloud system based on trusted calculation |
| CN106200593A (en) * | 2016-08-29 | 2016-12-07 | 中国重型机械研究院股份公司 | A kind of intelligent casting process control system and control method thereof |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111932395A (en) * | 2020-08-11 | 2020-11-13 | 清华大学 | Manufacturing digital system based on hybrid cloud architecture |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| Wang et al. | Research on power Internet of Things architecture for smart grid demand | |
| CN105869092A (en) | Intelligent campus management platform | |
| CN106055881A (en) | Cloud platform for medical data processing | |
| Gomes et al. | Towards an infrastructure to support big data for a smart city project | |
| CN106845946A (en) | A kind of financial data access analysis system and application method | |
| CN108710644A (en) | One kind is about government affairs big data processing method | |
| CN105978738A (en) | Distributed energy consumption monitoring unit based on smart Internet of things and monitoring method | |
| CN111737364A (en) | Safe multi-party data fusion and federal sharing method, device, equipment and medium | |
| CN107526818A (en) | One kind is based on enterprise's private clound big data processing system and method | |
| CN208079095U (en) | A kind of elevator long distance information integrated system | |
| CN111625573A (en) | Big data analysis system | |
| CN204374961U (en) | Medical inspection information acquisition system | |
| CN204731786U (en) | Adopt the large data analysis system of computing machine verification code technology | |
| CN204374960U (en) | Medical inspection information unification collecting device | |
| CN113705623A (en) | Rail transit station classification method and device | |
| CN204129769U (en) | Information management system | |
| CN105208069B (en) | Brain function network data cloud system | |
| CN209313939U (en) | The multi-computer switching device and electronic equipment of more remote channels | |
| CN111131230A (en) | Big data analysis system adopting computer verification code technology | |
| Zhong et al. | Discussion and application of blockchain technology in information management of internet of things in smart lab | |
| CN206470818U (en) | Cloud platform business integration system | |
| CN110856208A (en) | Network type resource environment data acquisition communication platform | |
| CN103873329A (en) | Conventional data interface system | |
| CN109165276A (en) | Self-service questionnaire logic design method and system based on natural language | |
| CN116916064A (en) | Video data processing method based on picture frame extraction, terminal equipment and storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20171229 |
|
| RJ01 | Rejection of invention patent application after publication |