CN114385684A - BaaS platform data service publishing method and system - Google Patents
BaaS platform data service publishing method and system Download PDFInfo
- Publication number
- CN114385684A CN114385684A CN202111657597.3A CN202111657597A CN114385684A CN 114385684 A CN114385684 A CN 114385684A CN 202111657597 A CN202111657597 A CN 202111657597A CN 114385684 A CN114385684 A CN 114385684A
- Authority
- CN
- China
- Prior art keywords
- data
- directory
- service
- baas platform
- module
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/24—Querying
- G06F16/245—Query processing
- G06F16/2455—Query execution
- G06F16/24552—Database cache management
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/25—Integrating or interfacing systems involving database management systems
- G06F16/252—Integrating or interfacing systems involving database management systems between a Database Management System and a front-end application
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/27—Replication, distribution or synchronisation of data between databases or within a distributed database system; Distributed database system architectures therefor
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/28—Databases characterised by their database models, e.g. relational or object models
- G06F16/283—Multi-dimensional databases or data warehouses, e.g. MOLAP or ROLAP
Abstract
The invention relates to the technical field of data connection release, in particular to a BaaS platform data service release method and a system thereof; the method comprises the steps of firstly carrying out data communication connection through a distributed database connector, then caching the acquired data, then carrying out message pushing on the cached data, then forming a data directory by the pushed data, and then issuing the data; according to the invention, through data communication connection, the acquired data is cached, then message pushing is carried out, a data directory is formed, and then publishing is carried out; the invention has large cache data, fast data storage and transmission and high message pushing and releasing efficiency.
Description
Technical Field
The invention relates to the technical field of data connection release, in particular to a BaaS platform data service release method and a system thereof.
Background
As a leading-edge new technology of a digital era, a blockchain is leading a new global technological change and industrial change, and promoting the information internet to be shifted to a value internet.
The block chain industry has been developed for many years, and has preliminarily formed an industrial ecological prototype with three directions of infrastructure, industrial application and comprehensive service, particularly, in recent years, financial applications such as digital currency and the like are infiltrated and diffused to non-financial fields, a Baas platform of a block data command and dispatch center mainly connects original data such as stock business system data resources of various commission office offices and local states through data interfaces, at present, the Baas platform uses a unified API and an SDK to connect storage of a back end, and the traditional middleware is adopted to integrate back end service into application through local physical service, but the middleware has no customized micro service, and data transmission is slow, and pushing and releasing information are often untimely.
Disclosure of Invention
The invention mainly solves the technical problem of providing a data service publishing method of a BaaS platform, which caches the acquired data through data communication connection, pushes messages, forms a data directory and then publishes the data; a data service release system of the BaaS platform is also provided.
In order to solve the technical problems, the invention adopts a technical scheme that: the BaaS platform data service release method comprises the following steps:
step S1, data communication connection is carried out through the distributed database connector;
step S2, caching the acquired data;
step S3, message pushing is carried out on the cached data;
step S4, forming a data directory by the pushed data;
and step S5, distributing the data.
As a modification of the present invention, the method further includes step S6;
and step S6, the client calls data, the user of the client is audited, and the authorized user can issue the data directory and call the interface data.
A BaaS platform data service release system, comprising:
a distributed database connector for data communication connection;
the data caching module is used for caching the acquired data;
the message queue module is used for carrying out message pushing on the cached data;
the data directory module is used for forming a data directory by the pushed data;
and the standard data service interface publishing module is used for publishing the data.
As an improvement of the invention, the distributed database connector accesses the heterogeneous data stored in the distributed database and the data warehouse in a long connection mode, a short connection mode, an SQL statement mode and a file transmission mode.
As a further improvement of the invention, the heterogeneous data comprises structured data, semi-structured data and unstructured data.
As a further improvement of the invention, the data catalog module shelves the data into the data catalog after cleaning the original data.
As a further improvement of the present invention, the data catalog module reviews and verifies the data, deletes duplicate information and corrects existing errors.
As a further improvement of the invention, the standard data service interface publishing module packs the data into the service directory and delivers the service directory to the bus.
As a further improvement of the invention, the service directory comprises a message directory, a structured data service, a database directory and a file directory.
As a further improvement of the invention, the system also comprises a permission management module which is used for auditing the permission of the user of the client.
The invention has the beneficial effects that: compared with the prior art, the method has the advantages that through data communication connection, the acquired data are cached, then message pushing is carried out, a data directory is formed, and then issuing is carried out; the invention has large cache data, fast data storage and transmission and high message pushing and releasing efficiency.
Drawings
FIG. 1 is a block diagram of the steps of the present invention;
FIG. 2 is a block diagram illustrating steps of a first embodiment of the present invention;
FIG. 3 is a schematic flow diagram of the system of the present invention.
Detailed Description
In order to make the objects, technical solutions and advantages of the present invention more apparent, the present invention is described in further detail below with reference to the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are merely illustrative of the invention and are not intended to limit the invention.
Referring to fig. 1 to fig. 3, a data service distribution method for a BaaS platform according to the present invention includes the following steps:
step S1, data communication connection is carried out through the distributed database connector;
step S2, caching the acquired data;
step S3, message pushing is carried out on the cached data;
step S4, forming a data directory by the pushed data;
and step S5, distributing the data.
According to the invention, through data communication connection, the acquired data is cached, then message pushing is carried out, a data directory is formed, and then publishing is carried out; the invention has large cache data, fast data storage and transmission and high message pushing and releasing efficiency.
The present invention provides an embodiment, as shown in fig. 2, which includes: step S1, data communication connection is carried out through the distributed database connector;
step S2, caching the acquired data;
step S3, message pushing is carried out on the cached data;
step S4, forming a data directory by the pushed data;
step S5, releasing the data;
and step S6, the client calls data, the user of the client is audited, and the authorized user can issue the data directory and call the interface data.
The invention has the function of authority management, when the client is called, the authorization of the user can be carried out, the authorized user can carry out the next operation, and the authorized user can carry out the release of the directory and the calling of the interface.
The invention also provides a data service release system of the BaaS platform, which comprises the following steps:
a distributed database connector for data communication connection;
the data caching module is used for caching the acquired data;
the message queue module is used for carrying out message pushing on the cached data;
the data directory module is used for forming a data directory by the pushed data;
and the standard data service interface publishing module is used for publishing the data.
In the invention, the distributed database connector accesses the heterogeneous data stored in the distributed database and the data warehouse in a long connection mode, a short connection mode, an SQL statement mode and a file transmission mode, wherein the heterogeneous data comprises structured data, semi-structured data and unstructured data; in particular, the distributed database connector mainly functions to solve access to various heterogeneous data (structured data, semi-structured data, unstructured data) in the distributed database, and is a data source way of the BaaS platform, by which an application can be allowed to access various heterogeneous data stored in the distributed database and the data warehouse in a long connection, a short connection, an SQL statement and file transmission way.
In the invention, the data cache module has the main function of reducing the times of using the distributed database connector by caching data in the data cache of the BaaS platform, thereby reducing the access pressure of the distributed database and the network pressure of data in a data area.
The message queue module mainly has the functions of solving the problems of application coupling, asynchronous messages, traffic cutting and the like, and helping the system to realize functional components with high performance, high availability, scalability and consistency; in the BaaS platform, the purpose is mainly to cater for future large-scale concurrent access to the data area.
In the invention, the data catalog module shelves the data as the data catalog after cleaning the original data, and the data catalog module rechecks and checks the data, deletes repeated information and corrects the existing errors; specifically, the data directory module mainly works to clean original data, put the data on shelf as a data directory, and the work focus is to review and verify the data, delete duplicate information, correct existing errors, and provide data consistency, and then put "clean" data on shelf as a data directory.
In the invention, a standard data service interface publishing module packs data into a service directory and delivers the service directory to a bus, wherein the service directory comprises a message directory, a structured data service, a database directory and a file directory; specifically, the standard data service interface publishing module mainly functions to classify data directories according to four large directory types of data: the message directory, the structured data service, the database directory and the file directory are packaged into four service directories to be delivered to the micro-service bus.
The invention also comprises a permission management module which is used for checking the permission of the user of the client; the corresponding data service interface can be automatically generated by utilizing the data interface which is accessed by the user with the authority through combining the user authority control and allowing the user to define the business model.
In specific application, when other systems are accessed, the distributed database connector is firstly used for connection, the obtained data are stored in the data cache module, and the data cache function is a data stream pipeline for processing stream data and is a main support function of the BaaS service; then, data required by other services are pushed to a platform requiring services through a message pushing function of the platform to complete message pushing, the message pushing function is mainly realized by a message queue module, and the message queue module is an important component and mainly solves the problems of application coupling, asynchronous messages, traffic cut and the like, so that a high-performance, high-availability, scalable and final consistency framework is realized; after the data is pushed by the message queue module, a data directory is formed immediately, the data directory module encapsulates various resources for the second time, and the client can directly operate a corresponding model by calling the Restful API to realize the calling of the data; after the data catalog is formed, the data catalog is issued through a standard data service interface issuing module, and after the data catalog is issued, other platforms or services can call the current data interface, so that a complete data circulation of the Bass platform is formed finally.
The above description is only an embodiment of the present invention, and not intended to limit the scope of the present invention, and all modifications of equivalent structures and equivalent processes performed by the present specification and drawings, or directly or indirectly applied to other related technical fields, are included in the scope of the present invention.
Claims (10)
1. A BaaS platform data service release method is characterized by comprising the following steps:
step S1, data communication connection is carried out through the distributed database connector;
step S2, caching the acquired data;
step S3, message pushing is carried out on the cached data;
step S4, forming a data directory by the pushed data;
and step S5, distributing the data.
2. The BaaS platform data service release method according to claim 1, further comprising step S6;
and step S6, the client calls data, the user of the client is audited, and the authorized user can issue the data directory and call the interface data.
3. A data service release system of a BaaS platform is characterized by comprising:
a distributed database connector for data communication connection;
the data caching module is used for caching the acquired data;
the message queue module is used for carrying out message pushing on the cached data;
the data directory module is used for forming a data directory by the pushed data;
and the standard data service interface publishing module is used for publishing the data.
4. The BaaS platform data service distribution system according to claim 3, wherein the distributed database connector accesses heterogeneous data stored in the distributed database and the data warehouse in a long connection mode, a short connection mode, an SQL statement mode and a file transmission mode.
5. The BaaS platform data service publishing system according to claim 4, wherein the heterogeneous data comprises structured data, semi-structured data, and unstructured data.
6. The BaaS platform data service release system of claim 5, wherein the data catalog module is configured to wash raw data and then rack the data as a data catalog.
7. The BaaS platform data service distribution system of claim 6, wherein the data directory module performs review and verification of data, deletion of duplicate information, and correction of existing errors.
8. The BaaS platform data service publishing system of claim 7, wherein the standard data service interface publishing module packages data into a service directory and delivers the service directory to a bus.
9. The BaaS platform data service publishing system recited in claim 8, wherein the service directory comprises a message directory, a structured data service, a database directory, and a file directory.
10. The BaaS platform data service release system according to claim 3, further comprising an authority management module, configured to audit authority of a user of the client.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111657597.3A CN114385684A (en) | 2021-12-30 | 2021-12-30 | BaaS platform data service publishing method and system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111657597.3A CN114385684A (en) | 2021-12-30 | 2021-12-30 | BaaS platform data service publishing method and system |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN114385684A true CN114385684A (en) | 2022-04-22 |
Family
ID=81199636
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202111657597.3A Pending CN114385684A (en) | 2021-12-30 | 2021-12-30 | BaaS platform data service publishing method and system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN114385684A (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN117390105A (en) * | 2023-12-11 | 2024-01-12 | 中核武汉核电运行技术股份有限公司 | Service input method and system of industrial service open platform |
-
2021
- 2021-12-30 CN CN202111657597.3A patent/CN114385684A/en active Pending
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN117390105A (en) * | 2023-12-11 | 2024-01-12 | 中核武汉核电运行技术股份有限公司 | Service input method and system of industrial service open platform |
| CN117390105B (en) * | 2023-12-11 | 2024-03-01 | 中核武汉核电运行技术股份有限公司 | Service input method and system of industrial service open platform |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US7873684B2 (en) | Automatic and dynamic provisioning of databases | |
| CN101969468B (en) | Inquiry server cluster system and inquiry method | |
| CN102981823B (en) | A kind of domain driven development plug-in system | |
| CN109889567B (en) | Implementation method of Internet of things platform supporting mass equipment access | |
| CN103246659A (en) | Method and device for key value data query | |
| CN104980441A (en) | Tenant authentication mechanism realizing method | |
| CN105405070A (en) | Distributed memory power grid system construction method | |
| CN105843955A (en) | Data migration system | |
| CN102137161B (en) | File-level data sharing and storing system based on fiber channel | |
| CN104144202A (en) | Hadoop distributed file system access method, system and device | |
| Li et al. | The overview of big data storage and management | |
| CN104753706A (en) | Distributed cluster configuration management method and distributed cluster configuration management device | |
| CN114385684A (en) | BaaS platform data service publishing method and system | |
| CN113282589A (en) | Data acquisition method and device | |
| CN111506552A (en) | Dynamic database design method and system of tree structure | |
| CN104123135A (en) | Method and device for unifying background interfaces | |
| CN105162837A (en) | Method and system for improving I/O throughput rate in massive data storage environment | |
| CN112115206A (en) | Method and device for processing object storage metadata | |
| CN111459980A (en) | Monitoring data storage and query method and device | |
| CN113378219A (en) | Processing method and system of unstructured data | |
| CN111143357A (en) | High-speed data query platform based on shared memory | |
| CN105389368A (en) | Method for managing metadata of database cluster of MPP architecture | |
| CN104239530A (en) | Method and device for parallel query of HBase tables | |
| CN112015790A (en) | Data processing method and device | |
| CN104636345A (en) | Database reading and writing method based on distributed cache |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |