CN106126351A - A kind of data resource sharing based on message queue management system - Google Patents
A kind of data resource sharing based on message queue management system Download PDFInfo
- Publication number
- CN106126351A CN106126351A CN201610431536.8A CN201610431536A CN106126351A CN 106126351 A CN106126351 A CN 106126351A CN 201610431536 A CN201610431536 A CN 201610431536A CN 106126351 A CN106126351 A CN 106126351A
- Authority
- CN
- China
- Prior art keywords
- data
- platform
- resource
- user
- management
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F9/00—Arrangements for program control, e.g. control units
- G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
- G06F9/46—Multiprogramming arrangements
- G06F9/54—Interprogram communication
- G06F9/546—Message passing systems or structures, e.g. queues
Landscapes
- Engineering & Computer Science (AREA)
- Software Systems (AREA)
- Theoretical Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Management, Administration, Business Operations System, And Electronic Commerce (AREA)
- Information Transfer Between Computers (AREA)
Abstract
The present invention discloses a kind of data resource sharing based on message queue management system, relate to computer data management technology, utilize active MQ and FTP technology, one data sharing management platform is proposed, user, by this platform configuration data source to be downloaded and data deposit position, can realize data and be automatically downloaded to specify position, and platform carries out complete monitoring to this process simultaneously, pass through exception handling, it is ensured that security of system is the most properly functioning.This Data Resources Management System provides propelling movement download function to the content such as file, picture, has the biggest lifting in safe and stable, efficiency；Support the docking of conventional IDI extraction tool, support the data transmission of multiple data sources, it is achieved the transmission of different pieces of information resource is shared, and facilitates user's use to information resources, improves the utilization rate of data message.
Description
Technical field
The present invention relates to computer data management technology, a kind of data resource sharing based on message queue
Management system.
Background technology
Along with the development of national information engineering construction, government and each functional department all establish respective internal applications
And information resources, and these application systems are by different manufacturers on different platforms, use different language to develop
, it is difficulty with information sharing each other, result in e-government development, define substantial amounts of information island.It is visible,
Due to the limitation of initial stage system Construction between business enterprice sector, it is achieved the shared of data is relatively difficult, therefore, it is achieved different
The demand of the data sharing between application system is the most urgent.How to get through this barrier, some application systems dispersion built
Integrate, it is achieved the data transmission between department is downloaded and just become important.
Summary of the invention
The present invention is directed to demand and the weak point of current technology development, it is provided that a kind of data resource based on message queue
Sharing Management system.
A kind of data resource sharing based on message queue of the present invention management system, solves above-mentioned technical problem and uses
Technical scheme as follows: described a kind of data resource sharing based on message queue management system, propose one data sharing management
Platform, its system architecture mainly includes data normalization layer, Internet, MQ engine, Surveillance center, interface layer and application layer；
Wherein, described data normalization layer is the data supporting layer of data sharing management platform, including propping up of data sharing management platform
Support storehouse and shared data resource；Reliable data transmission is realized by described Internet；Described MQ engine is data sharing pipe
The core of platform, mainly includes MQ message queue, realizes transmitting and the automatization of data by it；In described monitoring
The heart is mainly responsible for transmission and the ruuning situation of data sharing management platform of monitoring data, can grasp system in real time by it
Ruuning situation；Described interface layer docks third party's instrument, applies or service, it is provided that the passage of data downloading client；Described should
Provide a user with visualization interface with layer, facilitate user to customize or use data resource；
Preferably, described interface layer docking IDI extraction tool and information resources service platform.
Preferably, described data sharing management platform mainly includes that FMQ manages module, data resource management module, user
Authority management module, operation monitoring module and system management module；Wherein, described FMQ management module is responsible for MQ configuration, FTP
Configuration, data are downloaded and incremental data is downloaded；Described resource management module is mainly responsible for disposition data source information and data
Resource information；Described user authority management module is mainly responsible for the user logging in platform is realized the control that data permission accesses；
Described operation monitoring module is responsible for using the situation of data, platform ruuning situation, system exception to carry out in real time user in system
Monitoring；Described system management module is mainly responsible for that platform user is accessed menu and function carries out control of authority.
Preferably, described MQ configuration mainly configures the address of MQ；FTP has been configured to FTP address and user's configuration；
Data download the full dose download realizing data resource, and the full dose carrying out data by formulating the time period of resource and download is downloaded；
Incremental data is downloaded the main increment realizing data by configuring timing tasks timing and is downloaded.
A kind of data resource sharing based on message queue of the present invention management system compared with prior art has
Provide the benefit that: this Data Resources Management System provides propelling movement download function to the content such as file, picture, safe and stable,
The biggest lifting is had in efficiency；Support the docking of conventional IDI extraction tool, support the data transmission of multiple data sources, to entirety
Message and resource supplying process provide monitoring, it is achieved asynchronous, the distributed treatment of data resource and active push function；User
Having only to the path deposited by the data sharing management customized resource to be downloaded of platform and download, data are passed through by system automatically
The mode of full dose or increment is pushed to user, it is achieved the transmission of different pieces of information resource is shared, and facilitates user to information resources
Use；Pushing different from traditional message, the resource transmission of the accessory class such as text, picture supported by this platform so that user obtains
Mode and the content of data are abundanter；
The present invention utilizes offer service platform safely and efficiently for data so that data message between enterprise or government's various piece
Share, reduce information redundancy；Unified interdepartmental data consistency；By monitoring in real time and statistics, provide directly perceived for decision-making level
Information show, and then for upper strata work arrangements and strategy provide foundation.
Figure of description
Accompanying drawing 1 is the system architecture schematic diagram of described data resource sharing management system；
Accompanying drawing 2 is the operation schematic diagram of described data resource sharing management system.
Detailed description of the invention
For making the object, technical solutions and advantages of the present invention clearer, below in conjunction with specific embodiment, to this
Bright described a kind of data resource sharing based on message queue management system further describes.
For the problem that data sharing between business enterprice sector is relatively difficult, the invention discloses a kind of based on message queue
Data resource sharing management system, is improved traditional MQ message push service, is relied on the skills such as big data, FTP, MQ
Art, proposes a data sharing management platform, manages function by platform configuration, and user can customize the number that oneself needs easily
According to resource；System provides the propelling movement download function to the content such as file, picture, automatically by data by full dose or the side of increment
Formula is pushed to user；Further, support the docking of conventional IDI extraction tool, support the data transmission of multiple data sources, to entirety
Message and resource supplying process provide monitoring, it is achieved asynchronous, the distributed treatment of data resource and active push function, finally
Realize transmitting data resources to share.
Embodiment:
A kind of data resource sharing based on message queue management system described in the present embodiment, user shares pipe by logon data
Platform sets the path that resource to be downloaded and download are deposited, can the active push of pending file, and in form of a message
Notify user；Realize sharing of different pieces of information source；As shown in Figure 1, its system architecture mainly include data normalization layer,
Internet, MQ engine, Surveillance center, interface layer and the several aspect of application layer；Wherein, described data normalization layer is that data are total to
Enjoy the data supporting layer of management platform, including support storehouse and the shared data resource of data sharing management platform, for difference
User provides unified data resource；Reliable data transmission is realized by described Internet；Described MQ engine is data sharing pipe
The core of platform, mainly includes MQ message queue, the activeMQ Open Framework of the apache that MQ message queue uses, it is achieved
Message push function, realizes transmitting and the automatization of data by it；Described Surveillance center is mainly responsible for monitoring data
Transmission and data sharing management platform ruuning situation, running situation can be grasped in real time by it；Described interface
Layer docks third party's instrument, applies or service, it is provided that the passage of data downloading client；Described application layer provides a user with visually
Change interface, facilitate user to customize or use data resource.
In data resource sharing management system described in the present embodiment, described interface layer docking IDI extraction tool and information
Resource service platform.
In data resource sharing management system described in the present embodiment, described data normalization layer is that data sharing manages platform
Data supporting layer, unified data resource can be provided for each department of enterprise by this layer, it is ensured that data consistent
Property, reduce the redundancy of data, improve the quality of data；Reliable data transmission is ensured by Internet；Described MQ engine is that user is total to
Enjoy the tie of data, mainly comprise MQ message queue, the active MQ Open Framework of the apache that MQ message queue uses, real
Existing message push function；By interface layer docking third party's instrument, applying or service, interface layer is also that data download client simultaneously
The passage of end；And grasp running situation in real time by Surveillance center, in order to noting abnormalities in time processes；By application
The visualization interface of layer, facilitates user to customize and uses data resource.
Accompanying drawing 2 is the operation schematic diagram of described data resource sharing management system, and as shown in Figure 2, user is by described
The data sharing management customized resource requirement of platform, after system start-up downloading task, data sharing management platform passes through data standard
Change layer search qualified data resource, and data resource is carried out arrange packing cache in the way of file；Then,
By MQ engine by file push to ftp server, message queue stores the ID of data resource；Ftp server is main
It it is the terminal of data download.Client is recipient's (machine receiving file that user specifies) of data resource, works as message
When queue has the data resource needed for user, client then by the ID of data resource in message queue from ftp server
Download data resource to local, it is achieved the automatic download of data.
The data sharing management platform that described data resource sharing management system proposes, as user's subscription data resource,
Manager distributes authority, the door of configuration data resource for user, and its structure mainly includes that FMQ manages module, data resource pipe
Reason module, user authority management module, operation monitoring module and system management module；
Wherein, described FMQ management module is responsible for MQ configuration, FTP configuration, data download and incremental data is downloaded；MQ configures main
If the address of configuration MQ；FTP has been configured to FTP address and user's configuration；Data download the full dose realizing data resource
Downloading, by formulating resource and the time period of download, the full dose that can realize data is downloaded；Incremental data is downloaded main by joining
The increment realizing data putting timed task timing is downloaded；
Described resource management module is mainly responsible for disposition data source information and data asset information, and data source information mainly includes
The contents such as the address of data base, type, version, data asset information mainly creates and provides the data asset information downloaded；Institute
State user authority management module to be mainly responsible for the user logging in platform is realized the control that data permission accesses, it is ensured that the peace of data
Full use, family rights management comprises user's management, access authorization for resource management；Described operation monitoring module is responsible for making user in system
Monitor in real time with the situation of data, platform ruuning situation, system exception, data usage trend etc. can be provided the user and determine
Plan content, the problem that the system that can find in time again is run is to process in time；Described system management module is mainly responsible for platform
User accesses menu and function carries out control of authority, and realizes the management function in terms of other platforms.
Data resource sharing management system described in the present embodiment, in the specific implementation, needs to build data sharing management flat
The parts such as platform, MQ engine, FIP server, client, support storehouse.Resource-sharing management platform AM/BAM separates, AM/BAM resource
Sharing Management Platform deployment on different server, uses windows, linux operating system can；Used by background server
Machine performance is determined with specific reference to user's usage amount, generally uses the server of high requirement.Supporting storehouse is data sharing management
The basis that platform runs, uses MySql data base, is deployed in the server that performance is general, and guarantees data sharing pipe
Platform has the access rights to this server.MQ engine and FIP can dispose cluster, MQ server requirement high concurrent and
High-throughput, ftp server needs bigger hard drive space on this basis.The file that client primary recipient is downloaded, service
Device has certain hard drive space disclosure satisfy that to deposit file.
Above-mentioned detailed description of the invention is only the concrete case of the present invention, and the scope of patent protection of the present invention includes but not limited to
Above-mentioned detailed description of the invention, any that meet claims of the present invention and any person of an ordinary skill in the technical field
The suitably change being done it or replacement, all should fall into the scope of patent protection of the present invention.
Claims (4)
1. data resource sharing based on a message queue management system, it is characterised in that propose a data sharing management flat
Platform, its system architecture mainly includes data normalization layer, Internet, MQ engine, Surveillance center, interface layer and application layer；Its
In, described data normalization layer is the data supporting layer of data sharing management platform, including the support of data sharing management platform
Storehouse and shared data resource；Reliable data transmission is realized by described Internet；Described MQ engine is data sharing management
The core of platform, mainly includes MQ message queue, realizes transmitting and the automatization of data by it；Described Surveillance center
The main transmission being responsible for monitoring data and the ruuning situation of data sharing management platform, can grasp system in real time by it and transport
Market condition；Described interface layer docks third party's instrument, applies or service, it is provided that the passage of data downloading client；Described application
Layer provides a user with visualization interface.
A kind of data resource sharing based on message queue management system, it is characterised in that institute
State interface layer docking IDI extraction tool and information resources service platform.
A kind of data resource sharing based on message queue management system, it is characterised in that institute
State data sharing management platform and mainly include that FMQ manages module, data resource management module, user authority management module, operation
Monitoring module and system management module；Wherein, described FMQ management module be responsible for MQ configuration, FTP configuration, data download and
Incremental data is downloaded；Described resource management module is mainly responsible for disposition data source information and data asset information；Described user
Authority management module is mainly responsible for the user logging in platform is realized the control that data permission accesses；Described operation monitoring module is born
User in system is used the situation of data, platform ruuning situation, system exception to monitor in real time by duty；Described system administration mould
Block is mainly responsible for that platform user is accessed menu and function carries out control of authority.
A kind of data resource sharing based on message queue management system, it is characterised in that institute
State MQ configuration and mainly configure the address of MQ；FTP has been configured to FTP address and user's configuration；Data are downloaded and are realized data
The full dose of resource is downloaded, and the full dose carrying out data by formulating the time period of resource and download is downloaded；Incremental data is downloaded main
Downloaded by the increment realizing data of configuring timing tasks timing.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610431536.8A CN106126351B (en) | 2016-06-17 | 2016-06-17 | A kind of data resource sharing management system based on message queue |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610431536.8A CN106126351B (en) | 2016-06-17 | 2016-06-17 | A kind of data resource sharing management system based on message queue |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN106126351A true CN106126351A (en) | 2016-11-16 |
| CN106126351B CN106126351B (en) | 2019-06-04 |
Family
ID=57469951
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201610431536.8A Active CN106126351B (en) | 2016-06-17 | 2016-06-17 | A kind of data resource sharing management system based on message queue |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN106126351B (en) |
Cited By (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108984725A (en) * | 2018-07-11 | 2018-12-11 | 浪潮软件股份有限公司 | A kind of inter-network lock method of data synchronization |
| CN109981354A (en) * | 2019-03-07 | 2019-07-05 | 浪潮软件集团有限公司 | A kind of intelligence based on business model is deployed to ensure effective monitoring and control of illegal activities method for early warning |
| CN111416763A (en) * | 2020-02-21 | 2020-07-14 | 北京值得买科技股份有限公司 | Message pushing method |
| CN111556019A (en) * | 2020-03-27 | 2020-08-18 | 天津市普迅电力信息技术有限公司 | Vehicle-mounted machine data encryption transmission and processing method under distributed environment |
| CN114710311A (en) * | 2022-02-11 | 2022-07-05 | 浙江高信技术股份有限公司 | Multi-project message management method and system |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20060130069A1 (en) * | 2004-12-10 | 2006-06-15 | Microsoft Corporation | Reliably transferring queued application messages |
| CN103024014A (en) * | 2012-12-03 | 2013-04-03 | 北京京东世纪贸易有限公司 | Method and system for distributing and processing mass data passing through message queues |
| CN103136249A (en) * | 2011-11-30 | 2013-06-05 | 北京航天长峰科技工业集团有限公司 | System and method of multiplex mode isomerous data integration |
| CN103139251A (en) * | 2011-11-29 | 2013-06-05 | 神州数码信息系统有限公司 | Method of city-level data sharing exchange platform technology |
-
2016
- 2016-06-17 CN CN201610431536.8A patent/CN106126351B/en active Active
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20060130069A1 (en) * | 2004-12-10 | 2006-06-15 | Microsoft Corporation | Reliably transferring queued application messages |
| CN103139251A (en) * | 2011-11-29 | 2013-06-05 | 神州数码信息系统有限公司 | Method of city-level data sharing exchange platform technology |
| CN103136249A (en) * | 2011-11-30 | 2013-06-05 | 北京航天长峰科技工业集团有限公司 | System and method of multiplex mode isomerous data integration |
| CN103024014A (en) * | 2012-12-03 | 2013-04-03 | 北京京东世纪贸易有限公司 | Method and system for distributing and processing mass data passing through message queues |
Cited By (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108984725A (en) * | 2018-07-11 | 2018-12-11 | 浪潮软件股份有限公司 | A kind of inter-network lock method of data synchronization |
| CN109981354A (en) * | 2019-03-07 | 2019-07-05 | 浪潮软件集团有限公司 | A kind of intelligence based on business model is deployed to ensure effective monitoring and control of illegal activities method for early warning |
| CN111416763A (en) * | 2020-02-21 | 2020-07-14 | 北京值得买科技股份有限公司 | Message pushing method |
| CN111556019A (en) * | 2020-03-27 | 2020-08-18 | 天津市普迅电力信息技术有限公司 | Vehicle-mounted machine data encryption transmission and processing method under distributed environment |
| CN111556019B (en) * | 2020-03-27 | 2022-06-14 | 天津市普迅电力信息技术有限公司 | Vehicle-mounted machine data encryption transmission and processing method under distributed environment |
| CN114710311A (en) * | 2022-02-11 | 2022-07-05 | 浙江高信技术股份有限公司 | Multi-project message management method and system |
| CN114710311B (en) * | 2022-02-11 | 2024-01-02 | 浙江高信技术股份有限公司 | Multi-project message management method and system |
Also Published As
| Publication number | Publication date |
|---|---|
| CN106126351B (en) | 2019-06-04 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN106126351A (en) | A kind of data resource sharing based on message queue management system | |
| EP3985511A1 (en) | Orchestration of meshes | |
| CN109559258B (en) | Educational resource public service system | |
| DE102022212157A1 (en) | INTENT-BASED CLUSTER MANAGEMENT | |
| CA2936074C (en) | On-premises agent for mobile cloud service | |
| CN105024865B (en) | Cloud joint services | |
| CN109191008A (en) | A kind of micro services frame system for fish quality supervisory systems | |
| US10306023B2 (en) | Pre-formed instructions for a mobile cloud service | |
| US20160019030A1 (en) | Application model for implementing composite applications | |
| Merlino et al. | Stack4things: Integrating iot with openstack in a smart city context | |
| DE102022203247A1 (en) | Disintermediate attestation in a MEC service MESH framework | |
| CN105809356A (en) | Information system resource management method based on application integrated cloud platform | |
| CN105094799A (en) | Hybrid applications operating between on-premise and cloud platforms | |
| WO2015134341A1 (en) | Communicating status regarding application of compliance policy updates | |
| US20170317961A1 (en) | Email notifications | |
| DE112020007229T5 (en) | FEDERED MEC FRAMEWORK FOR AUTOMOTIVE SERVICES | |
| Grandinetti | Pervasive cloud computing technologies: future outlooks and interdisciplinary perspectives: future outlooks and interdisciplinary perspectives | |
| Gallidabino et al. | Deploying stateful web components on multiple devices with liquid. js for Polymer | |
| US20190199659A1 (en) | Real-time trigger for event-based electronic communication system messaging | |
| Exposito et al. | Smart SOA platforms in cloud computing architectures | |
| US10140958B2 (en) | Managing multiple systems in a computer device | |
| Anand et al. | Practical edge analytics: Architectural approach and use cases | |
| CN103873343A (en) | Resource management method, client and system | |
| CN112698840A (en) | Architecture system for realizing bank cloud platform service | |
| US20200348991A1 (en) | Quick actions |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |