Heterogeneous GIS platform service central control system under super-integration framework
Technical Field
The invention relates to the field of service central control, in particular to a heterogeneous GIS platform service central control system under a super-fusion architecture.
Background
With the rapid development of internet technology, a large number of applications are emerging in succession, and all applications are mainly interactive and large-user-volume applications, the main model of which is generally B/S, C/S, and in the face of the load pressure brought by the large user volume, a large-scale server cluster composed of a large number of high-performance servers becomes the key of a load-bearing system. At present, the number of servers included in a large-scale server cluster is thousands of servers, and with the complication of applications, the large-scale server cluster has developed to a promiscuous mode, that is, a single server may provide a plurality of different services, and different servers may also adopt different operating systems. However, at present, large-scale server clusters are still controlled by SSH, VNC, etc., and this traditional control method enters a target host through VNC remote connection or SSH, and then inputs a control command to implement control of the target host, and its main disadvantages are: the difference of operating systems between servers cannot be shielded, and the portability is poor; the efficiency is extremely low by independently controlling the servers. That is, there are multiple sets of GIS service engines in a project, but each GIS has a good field, and there is an advantage of a specific service in the project.
Disclosure of Invention
The technical problem to be solved by the invention is to provide a heterogeneous GIS platform service central control system under a super-fusion framework aiming at the defect that the prior art cannot realize that the same set of service central control interface is adapted to the interfaces and functions of all known GIS service manufacturers.
The technical scheme adopted by the invention for solving the technical problems is as follows: constructing a heterogeneous GIS platform service central control system under a super-fusion framework, wherein the heterogeneous GIS platform service central control system comprises a plurality of business application systems used for calling the service central control system to carry out GIS service operation and maintenance management, and further comprises:
the service central control system is used for setting a plurality of GIS service access modes and accessing a GIS service engine system, and comprises the steps of constructing a service package according to a GIS service template package provided by the service central control system in a first access mode, uploading the service package obtained by construction to the service central control system and registering corresponding service types, thereby completing the access of the service package; or under a second access mode, based on the received service central control access application, calling the Server Server to perform interface verification, thereby completing the access of the Server Server; after the service central control system finishes the access of the GIS service of the corresponding type, the operation and maintenance management of the GIS service is also carried out;
the heterogeneous GIS platform service central control system further comprises a GIS service engine system, wherein the GIS service engine system comprises a plurality of GIS service engines and is used for providing construction of bottom layer GIS service for the heterogeneous GIS platform service central control system.
Further, the operation and maintenance management of the GIS service includes:
and the service central control system issues, manages, monitors and counts the accessed GIS service.
Further, in the first access mode, the service package is constructed according to a GIS service template package provided by the service central control system, and the uploading of the service package to be constructed to the service central control system for registering the corresponding service type specifically includes:
the GIS service engine system carries out customization development or modification on the service package according to a GIS service template package provided by a service central control system, so that the corresponding service type can be identified by the service central control system;
and the constructed service package is registered through an API (application program interface) of the service central control, so that the access of the customized service package is completed.
Further, in the first access mode, when the currently accessed GIS service is judged to comprise secret-related data or secret-related operation according to preset secret-related data and secret-related operation judgment standards, a service package generated in the first access mode is made into a Docker container mirror image through a mirror image construction tool; the generated Docker container mirror image is registered in a mirror image warehouse for unified management;
when the service central control system initiates an instruction comprising secret-related data or secret-related operation service, the service central control system directly calls a communication interface of the container management software, and then the container management software calls a corresponding container mirror image in the mirror image warehouse to complete the delivery of the container and generate service, namely complete the access of the service mirror image.
Further, in the second access mode, the calling the Server to perform interface verification, so as to complete the access of the Server specifically:
when the service central control system receives a service central control access request, the legitimacy of the request is verified by obtaining the access authority parameters, and under the condition that the access to the Server is permitted, a Rest-API interface of the Server is called, and the parameters necessary for accessing information are configured, so that the access of the Server is completed.
Further, in the case of granting access, the reset-API interface of the call Server specifically is:
according to the interface access specification, transforming a management interface of the Server to be accessed;
registering the reconstructed management interface to the service central control system through an API (application programming interface) of the service central control system;
after the registration and verification of the manager interface are completed, the Server manager interface layer association of the service central control system is carried out; after the service central control system receives the instruction of issuing the service, the management interface is called to realize the calling of the third-party Server, and then the service issuing of the relevant type is completed.
Further, after the service release of the relevant type is completed, the method further includes:
the generated service will register to the API gateway, and the API gateway performs reverse proxy, load balancing and
and (5) monitoring.
Further, the registered interface types include:
the service release interface is used for providing GIS service release or updating GIS service operation;
a service management interface for providing GIS service management;
the service monitoring interface is used for providing service running state, server state and cluster node monitoring;
and the management log type interface is used for providing a management log type interface for recording the management operation log of the Server Server.
Furthermore, the GIS service engines of different types are registered to the service central control system in the form of micro-service under the service central control system, so that independent deployment of the GIS service engines and effective isolation of server resources are realized.
Furthermore, the underlying interface differentiation and the functional underlying differentiation of each GIS service engine are adapted based on the java web, and the service addresses accessed externally are unified, wherein the service addresses comprise two-stage identification service addresses, and the structure specifically comprises: http:// IP port/place identity/service engine identity/service name/; wherein: the service engine identification is controlled by the service central control system and is generated by enumeration.
The heterogeneous GIS platform service central control system under the super-fusion framework has the following beneficial effects:
1. the micro-service architecture is adopted to realize independent deployment and flexible expansion of each GIS service engine, and the GIS service engines are registered in a service central control system in the form of micro-service, so that the server resources of each GIS service engine are effectively isolated, and the capabilities of unified scheduling, management, elastic expansion and the like can be realized through service management;
2. server resources required by service operation are uniformly managed by the platform, and intelligent distribution and elastic expansion and contraction capabilities are provided; when a certain service engine is crashed or crashed, the load balancing node of the node can be elastically expanded by the central service controller immediately so as to ensure the normal operation of the platform;
3. and an access standard based on three modes of a service template packet, a service mirror image and a Server is set, and each large GIS service manufacturer can select the most appropriate mode to access the platform according to the actual condition of the manufacturer.
Drawings
The invention will be further described with reference to the accompanying drawings and examples, in which:
FIG. 1 is a system structure diagram of a heterogeneous GIS platform service central control system under a super-integration framework of the invention;
FIG. 2 is a functional structure diagram of a heterogeneous GIS platform service central control system under a super-fusion framework of the invention;
fig. 3 is a flow chart of the execution of the first access mode;
fig. 4 is a flow chart of the execution of the second access mode;
FIG. 5 is a schematic diagram of a list of types of registration interfaces;
fig. 6 is a schematic diagram of application scenarios and advantages corresponding to different access modes.
Detailed Description
For a more clear understanding of the technical features, objects and effects of the present invention, embodiments of the present invention will now be described in detail with reference to the accompanying drawings.
In an embodiment of the present invention, as shown in fig. 1, a heterogeneous GIS platform service central control system under a super-fusion architecture includes:
(1) multiple service application systems for calling service central control system to perform GIS service operation and maintenance management
A system; specifically, the execution function of the business system can also be understood as business processing work for real life, such as real estate authority registration process, martian weather early warning analysis, and the like. It should be noted that, when the service of the corresponding type has been released, the corresponding service application system calls the service that has been released and shared in the service central control system to perform service integration, where as shown in fig. 1, in an embodiment, a unified service release management and a unified operation and maintenance management system may be used to perform service release and operation and maintenance management.
The service central control system is used for setting a plurality of GIS service access modes and accessing a GIS service engine system, and comprises the steps of constructing a service package according to a GIS service template package provided by the service central control system in a first access mode, uploading the service package obtained by construction to the service central control system and registering corresponding service types, thereby completing the access of the service package; or under a second access mode, based on the received service central control access application, calling the Server Server to perform interface verification, thereby completing the access of the Server Server; after the service central control system finishes the access of the GIS service of the corresponding type, the operation and maintenance management of the GIS service is also carried out; in an embodiment, the operation and maintenance management is, specifically, a service central control system issues, manages, monitors, and counts the accessed GIS service.
It should be noted that, since each third-party service registration to the service central control system has a corresponding registration type, such as a map service and a thematic map service type, a specific example is described as follows:
the smooth and rich GIS service is registered in a service central control system, the corresponding registration type is the service of the place name and the address class, and the subsequent operation and maintenance management of the GIS service is carried out according to the registration type.
Please refer to fig. 3, which is an execution flowchart of a first access method, wherein the accessing of the service package by the customized service template package in the first access method specifically includes:
firstly, a GIS service engine system customizes, develops or reforms a service package according to a GIS service template package provided by a service central control system, so that a corresponding service type can be identified by a service central control system;
secondly, the service package to be generated is uploaded to a service central control system through an API (application program interface) of the service central control system, after the registration of the corresponding service type is completed, the access of the customized service package is completed, and finally, when the GIS operation and maintenance management is carried out, the service central control system completes all issues of issuing, management, load balancing, operation and maintenance monitoring and the like of the service.
As shown in fig. 4, which is an execution flowchart of the second access method, when the Server is called to perform interface verification, so as to complete the access of the Server, the method includes:
firstly, after the service central control system receives a service central control access request (it should be noted that an access application is initiated to the service central control system by a third party user), access permission parameters are obtained. After the application is successful, the token suffix needs to be carried by other subsequent requests, and the server side can verify the validity of the request by acquiring the token parameter, so that the embodiment considers acquiring the sc _ token to determine the validity of the request;
secondly, the Server is checked by the service central control system to pass, and the Server is accessed by calling the Rest-API interface of the Server and configuring the parameters necessary for accessing the information under the condition that the GIS service is permitted to access. When the access is permitted, the management interface of the Server to be accessed is customized, developed or modified according to an interface access specification (in an embodiment, the interface access specification can be a management API access specification); then, registering the reformed management interface to the service central control system through an API (application programming interface) of the service central control system; it should be noted that, the registered interface types may refer to fig. 5, and specifically include:
(21) the service pre-operation type interface is used for providing pre-operation and condition verification before GIS service release, in one embodiment, the pre-operation comprises file uploading, data source inquiry and judgment on whether server resources are sufficient or not;
(22) the service release interface is used for providing GIS service release or updating GIS service operation;
(23) the service management interface is used for providing editing, starting, stopping, deleting, cloning and other operations of the GIS service;
(24) the service monitoring interface is used for providing service running state, server state and cluster node monitoring; it should be noted that, the current server may be understood as a hardware server, for example, a service a runs on a server a, and the foregoing server state monitoring is to monitor conditions of CPU, memory, disk occupation, and the like of the server a, and further provide a reference basis for threshold judgment for the capabilities of the service central control system such as elastic expansion, load balancing, and the like;
(25) the safety verification interface is used for providing the server operation authority control;
(26) a service log class interface for recording service runtime log information (non-access log);
(27) and the management log type interface is used for recording the management operation of the server.
It should be noted that, when performing interface registration, interfaces of the service publishing class, the service management class, the service monitoring class, and the management log class are necessary, and the remaining interfaces may selectively select one or more of the interfaces for registration.
After the registration and verification of the manager interface are completed, the association of a Server manager interface layer of the service central control system is required; referring to fig. 2, the functional structure of the whole system is divided into three layers, which are:
and the API layer comprises several functional modules of service monitoring, service publishing, service authority, service management and unified operation and maintenance, and is mainly used for providing REST-API capability for the outside. Wherein, the externally provided REST API capability is divided into: issuing, managing, authorizing, monitoring, operating and maintaining services; therefore, the operation and maintenance management of the GIS service is realized at the layer.
The adaptive layer comprises a registration center, an intensive center, a treatment center, a gateway center and a system configuration function module, on one hand, the adaptive layer is used for solving the problem of adaptation with a third-party GIS service engine, and specifically comprises adaptation of registration access and adaptation of interface intensification, wherein adaptation is carried out on the bottom layer interface differentiation and the function bottom layer differentiation of each GIS service engine based on JavaWeb, service addresses for external access are unified, the service addresses comprise two-stage identification service addresses, and the structure specifically comprises the following steps: http:// IP port/place identification/service engine identification/service name/; wherein: the service engine identifier is controlled by a service central control system and is generated by enumeration, for example, the gio service engine is S1, the ESRI service engine is S2, the shunfeng service engine is S3, the custom service (mobile signaling service) is S4, and the like, and differential shielding is realized from a URL level currently. It should be noted that adaptation of bottom layer interface differentiation and function differentiation is realized by a standard document and combining with the existing mainstream structure of the market, and the scheme is accessed and invoked according to the standard, so that the service central control system controls the issuing and management of the third-party service. On the other hand, the system is used for providing functions related to service administration, service gateway and system configuration; the registration center realizes the registration, unloading, authorization and other access functions of the third-party GIS service engine (namely, the service pack access in the first access mode and the Server access in the first access mode are realized in the same layer); matching the service types of the configuration and the release to the corresponding Server by the intensification center, and if the map service is configured to be a GeoGlobe Server, the map service is released based on the GeoGlobe Server when the map service is released; the management center is used for uniformly releasing, managing, monitoring, authorizing, fusing, limiting current and other functions of the integrated service provided by the outside; the gateway center is a service gateway; the system configuration is used for configuring relevant levels of system built-in such as single sign-on, authority and the like aiming at the system.
And a container layer, which includes several functional modules, namely a reverse proxy, load balancing, container arrangement, mirror management and elastic scaling, and is mainly used for providing service operating environment management and hosting capabilities of each third-party service engine (that is, container generation and mirror management are both implemented in this layer in the second embodiment described later).
Specifically, in the second access mode, a user can initiate a service central control access application through the platform, after the service central control access application is approved by the platform, the sc _ token parameter (namely, the access right parameter) is obtained, and under the condition of access permission, a Rest-API interface is called and the necessary parameters of access information are configured, wherein the scheme must meet the interface specification of the integrated Server; or the access of the Server can be carried out based on the issuing and managing interface exposed by the Server to the central control service platform. And finally, the central control service platform calls the service Server through an interface to realize the release and management of the service.
Under the functional architecture shown in fig. 2, after the service central control system receives the instruction for issuing the GIS service, the method includes:
firstly, calling a manager interface to realize the calling of a third-party Server Server;
then, completing service release of related types;
finally, the generated service will be registered to the API gateway, and the API gateway will perform reverse proxy and load
And balancing and monitoring are carried out, so that the third-party service is completely hosted in a service central control system from the aspects of issuing, managing, monitoring and disaster tolerance, and complete capabilities of managing, monitoring, operating and maintaining and the like are effectively provided. In addition, under the second access mode, the Server operates independently, and does not occupy system resources.
(2) GIS service engine system, as shown in FIG. 1, the GIS service engine system disclosed in the present invention
The system is composed of a plurality of GIS service engines, for example, a GeoGlobe service engine and an ArcGIS service engine shown in fig. 1 (it should be noted that the GeoGlobe service engine is global massive seamless spatial data organization, management and visualization software developed by the information technology limited of wu da gio under a network environment, and the ArcGIS service engine is a service engine of an ESRI company), and the main function of the engine system is to provide a construction of a bottom GIS service for a heterogeneous GIS platform service central control system.
Example 2:
referring to fig. 3, when it is determined that the currently accessed GIS service includes secret-related data or secret-related operation according to preset secret-related data and secret-related operation determination criteria, a mirror image construction tool is used to make a service package generated in a first access manner into a Docker container mirror image, in an embodiment, a container mirror image is generated based on Dockerfile, where: the Dockerfile is a text file used for constructing the mirror image, and the text content in the file is a piece of instruction and description required for constructing the mirror image; the generated Docker container mirror image is registered to a mirror image warehouse and is managed in a unified way by the mirror image warehouse; finally, when the service central control system initiates an instruction including secret-related data or secret-related operation service, the service central control system directly calls a communication interface of the container management software (it needs to be explained that the communication interface is based on the current communication interface, integrated calling between the service central control system and the container management software is performed, such as creating a capacity interface for arranging containers such as a Docker container and a container cluster required by GIS service operation), and then the container management software calls a corresponding container mirror image in a mirror image warehouse to complete delivery of the container and generate service, i.e. completing access of the service mirror image, in one embodiment, K8S container management software is adopted, and is a brand-new distributed architecture software based on a container technology, and on the basis of the Docker technology, a series of complete functions such as deployment operation, resource scheduling, service discovery, dynamic expansion and contraction are provided for containerized applications, the convenience of large-scale container cluster management is improved.
Specifically, when the mirror image service is generated, the service central control system directly calls a communication access interface of K8S software, and then the K8S software calls a pre-registered mirror image in a mirror image warehouse to complete container delivery and service generation, wherein after the service is generated, an API gateway finds and automatically registers an agent module and a management module to perform reverse agent, load balancing, monitoring, management and other matters.
Referring to fig. 6, it is a schematic diagram of a list of application scenarios corresponding to different access modes and advantages thereof, where in the first access mode, i.e., the customized service package access mode, the application scenarios are not limited, and advantages thereof are that compatibility with the system is highest, and server resources are uniformly managed by the service central control system, which provides capabilities of intelligent allocation and flexible expansion. Under the mode of making service mirror image access, the application scene of the method corresponds to the service containing product authorization or the service containing secret-related data or secret-related operation, and the method has the advantages that the mirror image content is in a 'black box' mode, and the secret-related data and the secret-related operation in the service can be fully protected. The access mode of the integrated Server Server has the advantages that the Server Server operates independently and does not occupy the resources of a central service control system, and an application scene of the access mode corresponds to a complete Server Server system and has an independent service arrangement mechanism or more than 10 service types.
The invention discloses a heterogeneous GIS platform service central control system under a super-fusion framework, which adopts a micro-service framework to realize independent deployment and flexible expansion of each GIS service engine and registers the GIS service engine to a service central control system in the form of micro-service, thereby realizing effective isolation of server resources of each GIS service engine and realizing the capabilities of unified scheduling, management, elastic expansion and the like through service management; server resources required by service operation are uniformly managed by the platform, and intelligent distribution and elastic expansion and contraction capabilities are provided; when a certain service engine is crashed or crashed, the load balancing node of the node can be elastically expanded by the central service controller immediately so as to ensure the normal operation of the platform; and an access standard based on three modes of a service template packet, a service mirror image and a Server is set, and each large GIS service manufacturer can select the most appropriate mode to access the platform according to the actual condition of the manufacturer.
While the present invention has been described with reference to the embodiments shown in the drawings, the present invention is not limited to the embodiments, which are illustrative and not restrictive, and it will be apparent to those skilled in the art that various changes and modifications can be made therein without departing from the spirit and scope of the invention as defined in the appended claims.