WO2021143462A1

WO2021143462A1 - Front end processor-based data exchange system and method

Info

Publication number: WO2021143462A1
Application number: PCT/CN2020/137992
Authority: WO
Inventors: 曾新科; 朱胜; 贺毅刚; 陈立; 贾西贝
Original assignee: 深圳市华傲数据技术有限公司
Priority date: 2020-01-15
Filing date: 2020-12-21
Publication date: 2021-07-22
Also published as: CN111258780A

Abstract

A front end processor-based data exchange system and method. Said system comprises: an exchange control area, provided with exchange channels; and a plurality of production systems, each production system being bridged and adapted to one front end processor, and a library table, a file and a service in the production system being pushed to the front end processor according to a given rule, and a library table, a file and a service in a front end processor corresponding to a certain production system performing data exchange with a front end processor corresponding to another production system by means of the exchange channels. By arranging a front end processor to acquire data shared by a certain production system, and sending said data to an exchange control area, and then providing same to a front end processor of another production system for use of service requirements of other production systems, cross-network gate and cross-network data exchange can be realized, providing the technical guarantee of data sharing for an efficient electronic government service.

Description

System and method for data exchange based on front-end processor

Technical field

The present invention relates to the field of technical computer technology, in particular to a system and method for data exchange based on a front-end processor.

Background technique

Smart government is the advanced stage of e-government, and it is to maximize the efficiency of e-government. In the development and growth of smart government, the sharing and utilization of government information resources among different departments is of vital importance. However, for the time being, data between different departments cannot be shared across networks and gatekeepers.

Summary of the invention

In order to overcome the above-mentioned problems in the prior art at least to a certain extent, the present invention provides a system and method for data exchange based on a front-end processor.

In the first aspect, the present invention discloses a system for data exchange based on a front end processor, including:

Exchange control area, with exchange channel;

Multiple production systems;

In addition, each of the production systems is bridged and adapted to a front-end processor, and the library tables, files, and services in the production system are pushed to the front-end processor according to a given rule;

The library tables, files and services in the front end processor corresponding to a certain production system exchange data with the front end processor corresponding to another production system through the exchange channel.

Further, in the above system, the production system is a data provider and/or a data demander.

Further, in the above system, the switching control area is provided with a routing control unit, a flow control unit, and an abnormal recovery unit.

Further, in the above system, the exchange control area is provided with an exchange instance record library and a big data center;

The exchange instance record library records task instances, exchange reconciliation, exchange monitoring and exchange statistics; the big data center includes library table data and file data.

Further, in the above system, the exchange channel includes a library table exchange channel, a file exchange channel, and a service exchange channel;

In addition, the library table exchange channel, the file exchange channel, and the service exchange channel are all encrypted by security.

Further, in the foregoing system, the front-end processor is composed of a department front-end and a platform front-end, and both are deployed in a departmental computer room environment;

Wherein, the front-end of the department is a front-end set in the department where the production system is located;

The platform front-end refers to a front-end processor set on the platform where the exchange control area is located.

Further, in the above system, the front-end processor is composed of department front-end and platform front-end;

The front-end of the department is a front-end set in the department where the production system is located;

The platform front-end is a front-end processor deployed in the e-government extranet environment of the shared exchange platform where the exchange control area is located.

Further, in the above system, the platform front-end is a virtualization front-end.

Further, in the above system, the front-end processor is the front-end of the platform and is deployed in the computer room environment of the department where the production system is located or the government service platform computer room environment.

In the second aspect, the present invention also discloses a method for data exchange based on a front end processor, and the method is based on any of the above-mentioned data exchange systems.

The present invention collects data shared by a certain production system by arranging the front-end processor, and sends it to the exchange control area, that is, the control area where the exchange control platform is located, and then provides the front-end processor of another production system for the business needs of other production systems. Use, and then realize the data exchange across the gatekeeper, across the network. Provide technical support for data sharing for high-efficiency e-government.

It should be understood that the above general description and the following detailed description are only exemplary and explanatory, and cannot limit the present invention.

Description of the drawings

The drawings here are incorporated into the specification and constitute a part of the specification, show embodiments consistent with the present invention, and together with the specification are used to explain the principle of the present invention.

FIG. 1 is a structural block diagram of a system for data exchange based on a front end processor according to an embodiment of the present invention;

2 is a working principle diagram of the first mode of accessing department data to the front-end processor in the system for data exchange based on the front-end processor according to the embodiment of the present invention;

FIG. 3 is a working principle diagram of the second mode of accessing department data to the front-end processor in the system for data exchange based on the front-end processor according to the embodiment of the present invention;

Fig. 4 is a flow chart of the request/response flow of data exchange at the application layer in the system for data exchange based on the front end processor according to the busy embodiment.

Detailed ways

It should be understood that the specific embodiments described here are only used to explain the present invention, but not used to limit the present invention.

Before discussing the exemplary embodiments in more detail, it should be mentioned that the specific structure and functional details of some exemplary embodiments disclosed herein are only representative, and are used to describe exemplary embodiments of the present invention. Purpose. However, the present invention can be embodied in many alternative forms, and should not be construed as being limited only to the embodiments set forth herein.

Referring to Figure 1, Figure 1 shows a structural block diagram of a system for data exchange based on a front end processor in an embodiment of the present invention, including:

Exchange control areas and multiple production systems. Among them, the exchange control area is provided with an exchange channel; and, each production system is bridged and adapted to a front-end processor, and the library tables, files and services in the production system are pushed to the front-end processor according to a given rule; a certain production system The library tables, files and services in the FEP corresponding to the system exchange data with the FEP corresponding to another production system through the exchange channel.

In this embodiment, data shared by a certain production system is collected by arranging a front-end processor, and sent to the exchange control area, that is, the control area where the exchange control platform is located, and then to the front-end processor of another production system for services of other production systems. Need to use, and then realize the data exchange across the gatekeeper, across the network. Provide technical support for data sharing for high-efficiency e-government.

In specific implementation, sometimes, a certain production system can be the data provider, but this role can also be changed. At other times, the production system can also be the data requester. The entire system connects the Dole production system to the exchange control area through the front-end computer to complete data sharing.

In one embodiment, the switching control area is provided with a routing control unit, a flow control unit, and an abnormal recovery unit. The three units are explained below:

1) Routing control unit: Cross-data center messaging platforms are connected through unified routing, unified service discovery and load balancing modules, to realize the application's nearest access to the messaging platform, automatically discover the location of the consumer, unified routing module processing, and route to the consumer for local consumption

2) Flow control unit: For a certain type of business service visits are over-frequent, the visits can be monitored in real time by setting the number of visits;

3) Abnormal recovery unit: Through the exploration of the service, abnormal services can be found and an alarm can be automatically issued. The administrator can manually start and stop the service, and the data flow can be automatically restored after the business service is normal.

Further, in the above system, the exchange control area is provided with an exchange instance record library and a big data center; the exchange instance record library records task instances, exchange reconciliation, exchange monitoring and exchange statistics; the big data center includes database table data and files data. The functions of the aforementioned routing control unit, flow control unit and abnormal recovery unit realize data exchange with the exchange instance record library and the big data center.

In one embodiment, in the above system, the exchange channel includes a library table exchange channel, a file exchange channel, and a service exchange channel; and the library table exchange channel, file exchange channel, and service exchange channel are all encrypted by security.

Further, in the above-mentioned system, the setting of the front-end processor has the following three forms:

1). It is composed of department front and platform front, which are deployed in the department computer room environment; among them, the department front is the front-end computer set in the department where the production system is located; the platform front refers to the front-end set in the exchange control area The front-end processor of the platform.

2) Front-end processor is composed of department front-end and platform front-end; department front-end is the front-end processor set in the department where the production system is located; platform front-end is deployed in the shared exchange platform where the exchange control area is located. The front-end computer of the network environment. Preferably, the platform front-end is virtualization front-end.

3) The front-end computer is the front-end of the platform and is deployed in the computer room environment of the department where the production system is located or the government service platform computer room environment.

The deployment of the front-end processor is an important link to ensure the efficient work of the shared platform. In order to standardize the deployment of the front-end processor of the shared platform, accelerate the implementation and operation and maintenance efficiency of the shared platform, the front-end processor prefers physical hardware equipment.

As the entrance for information exchange between the access unit and the sharing platform, the front-end processor should maintain unblocked network communication; the files in the front-end processor file exchange directory should be pushed by the access unit to the corresponding directory in the front-end processor in accordance with the specifications; Taking into account some specific factors of partial access, such as small amount of data, low data exchange frequency, etc., the deployment method of virtual machine front-end machine will be provided as an alternative.

In one embodiment, the production system may be various units of a government department. Data exchange is the realization of multi-level exchange capabilities through the construction of data transmission channels supporting the shared exchange system of various government departments, providing more flexible and convenient exchange services, and better serving data sharing and exchange services in the big data environment. It meets the needs of supporting various complex sharing exchanges across departments and levels, and has the capability of large data volume, multi-user, high concurrency and other complex sharing exchanges.

Front-end computers are divided into various departments and local front-end computers. The production libraries of each department and each place provide support for the department’s application business in the business production environment, in order to avoid the pressure on the business production environment in the process of providing external data exchange, and to ensure the safety and stability of the production data, the business production environment Is not open to the outside world. Through the bridging system, each department or place will migrate the data that needs to be exchanged to the front-end computer environment to provide external access, exchange and other services. As the source end of the entire data unified exchange and sharing platform, the front-end processor provides data source support for the data sharing and exchange platform. Whether its construction is standard and standardized directly affects the service effect of the entire shared exchange platform.

The vertical approval system of each department is deployed on the internal office network of each department, physically or logically isolated from the government extranet. Therefore, the interface between the shared exchange platform and the vertical approval system of various departments mainly adopts the front-end processor for exchange.

Under normal circumstances, in order not to affect the operation of the original business system, a front-end computer is deployed in the business unit, and the business department adopts automatic or manual methods to import the exchanged data to the front-end computer to achieve departmental data access , Mainly includes two data access modes:

Mode 1: File to database

Referring to Figure 2, Figure 2 is a working principle diagram of the first mode of departmental data access front-end processor.

The business department is responsible for packaging the data of the business system into files (such as XML files, TXT files, CSV files, Excel files), and sending them to a certain file directory of the front-end machine of the business department, using the exchange bridging tool on the front-end machine to configure FileReader The file adapter, data conversion component and DB Worker nAdapter database adapter parse the data in the file, convert the business data format into a standard exchange data format, and merge it into the pre-exchange database to realize departmental data access.

This model is suitable for departments where the business network and the government extranet are physically separated, but the business department needs to provide incremental data files.

Mode two: database to database

Referring to FIG. 3, FIG. 3 is a working principle diagram of the second mode of accessing department data to the front-end processor in the system for data exchange based on the front-end processor according to the embodiment of the present invention. The business database is directly connected to the front-end exchange database (only for network intercommunication), and the exchange bridge system on the front-end computer is used to configure database adapters, data conversion components and database adapters, and establish a data synchronization mechanism on the business database to extract increments in real time Data, the business data format is converted into a standard-compliant exchange data format and merged into the pre-exchange database to achieve departmental data access.

The access method is shown in Figure 3. This method is suitable for departments where the business network is logically isolated from the government extranet, and directly operates the business database (establishing a data synchronization extraction mechanism).

In addition, in one embodiment, the front end processor of the production system is also provided with a switching unit node, which is used to cache data resources with a high exchange frequency, and the data resources cached on the switching unit pass through the exchange control area. The scheduling of data exchange will reduce the pressure of data exchange on the front-end processor and ensure the stability and speed of data exchange.

In another embodiment, the front-end processor also provides a security mechanism to ensure the integrity and confidentiality of the data exchange information. The front-end data exchange is integrated with the security authentication platform to protect the exchanged information content from interception or illegal modification. Preferably, the front end processor can also track the details of data exchange through data service log records. By monitoring the operating status and log analysis, the auditing, troubleshooting, development and debugging, and transaction tracking of the operating conditions are strengthened to ensure the security of the front-end machine data exchange. ,

In an embodiment, the process of data exchange encryption authentication at the application layer can be referred to as shown in FIG. 4, which includes the following steps:

Step 1. Receive the json request data sent by the requester through the API link data stream channel;

Step 2. Perform identity authentication and authority control on the requesting party;

Step 3. Record the request log and store the request json data

Step 4. Parse the requested json data;

Step 5. Verify the digital signature;

Step 6. Decrypt the encrypted data in the json data;

Step 7. Perform business processing according to the parsed plaintext request;

Step 8. Encrypt the processed response data as needed;

Step 9. Perform digital signature;

Step 10. Encapsulate the data into json format and send it through the data stream channel;

Step 11. Write the response log and store the response log file.

The steps involved in the security system include: step 2, step 5, step 6, step 8, and step 9. In addition to login authentication, it also includes the encryption and decryption process of data.

In another embodiment, the system for data exchange based on the front-end processor can be clouded, storage, nodes, and front-end processors can be expanded as needed, and the cloud server can be adjusted through the WEB management interface, and then the exchange control area and the front-end processor can be adjusted. The machine is configured and finally goes online. Convenient and fast, and save manpower and physical costs. Moreover, it can also automatically create a server, automatically configure, automatically install, and automatically go online through an automated operation and maintenance program. That is to say, in this embodiment, on the one hand, in combination with the high confidentiality and high sensitivity requirements of government affairs, the front-end processor is not only used as a segmented data processing process for the flexible service capability of the data production system itself. On the other hand, it enhances the "thermal expansion" capability of fixed-point directional timing.

Although the embodiments of the present invention have been shown and described above, it can be understood that the above-mentioned embodiments are exemplary and cannot be construed as limiting the present invention. Those of ordinary skill in the art can comment on the above-mentioned embodiments within the scope of the present invention. The embodiment undergoes changes, modifications, substitutions, and modifications.

On the other hand, the present invention also provides a method for data exchange based on a front-end processor. The method is based on the above-mentioned system for data exchange based on a front-end processor. Since the structure and working principle of the system have been described above, The applicant will not repeat it here. Where relevant, refer to each other.

In the description of this specification, descriptions with reference to the terms "one embodiment", "some embodiments", "examples", "specific examples", or "some examples" etc. mean specific features described in conjunction with the embodiment or example , Structures, materials or features are included in at least one embodiment or example of the present invention. In this specification, the schematic representations of the above-mentioned terms do not necessarily refer to the same embodiment or example. Moreover, the described specific features, structures, materials or characteristics can be combined in any one or more embodiments or examples in a suitable manner.

Claims

A system for data exchange based on a front-end processor, which is characterized in that it includes:

Exchange control area, with exchange channel;

Multiple production systems;

In addition, each of the production systems is bridged and adapted to a front-end processor, and the library tables, files, and services in the production system are pushed to the front-end processor according to a given rule;

The library tables, files and services in the front end processor corresponding to a certain production system exchange data with the front end processor corresponding to another production system through the exchange channel; and

The front end processor of the production system is also provided with a switching unit node, which is used to buffer data resources with a high switching frequency, and the data resources buffered on the switching unit are used for data exchange through the scheduling of the switching control area.
The system of claim 1, wherein:

The production system is a data provider and/or a data demander.
The system of claim 2, wherein:

The switching control area is provided with a routing control unit, a flow control unit and an abnormal recovery unit.
The system of claim 3, wherein:

The exchange control area is provided with an exchange instance record library and a big data center;

The exchange instance record library records task instances, exchange reconciliation, exchange monitoring and exchange statistics; the big data center includes library table data and file data.
The system of claim 4, wherein:

The exchange channel includes a library table exchange channel, a file exchange channel, and a service exchange channel;

In addition, the library table exchange channel, the file exchange channel, and the service exchange channel are all encrypted by security.
The system of claim 5, wherein:

The front-end processor is composed of a department front-end and a platform front-end, both of which are deployed in the departmental computer room environment;

Wherein, the front-end of the department is a front-end set in the department where the production system is located;

The platform front-end refers to a front-end processor set on the platform where the exchange control area is located;

and

The front end processor of the production system is also provided with a switching unit node, which is used to buffer data resources with a high switching frequency, and the data resources buffered on the switching unit are used for data exchange through the scheduling of the switching control area.
The system of claim 5, wherein:

The front-end processor is composed of department front-end and platform front-end;

The front-end of the department is a front-end set in the department where the production system is located;

The platform front-end is a front-end processor deployed in the e-government extranet environment of the shared exchange platform where the exchange control area is located.
The system according to claim 7, wherein:

The platform front-end is virtualization front-end.
The system of claim 5, wherein:

The front-end processor is the front-end of the platform and is deployed in the computer room environment of the department where the production system is located or the government service platform computer room environment.
A method for data exchange based on front-end processor, which is characterized in that:

The method is based on a data exchange system according to any one of claims 1-9.