CN108418862B

CN108418862B - Micro-service management method and system based on artificial intelligence service cloud platform

Info

Publication number: CN108418862B
Application number: CN201810095720.9A
Authority: CN
Inventors: 焦少帅; 蔡晓胜; 陈桓; 张良杰
Original assignee: Kingdee Software China Co Ltd
Current assignee: Kingdee Software China Co Ltd
Priority date: 2018-01-31
Filing date: 2018-01-31
Publication date: 2021-01-22
Anticipated expiration: 2038-01-31
Also published as: CN108418862A

Abstract

The application relates to a micro-service management method and system based on an artificial intelligence service cloud platform. The method comprises the following steps: acquiring operation index parameters of a target micro-service instance through a container scheduling center; when the operation index parameter meets the container extension condition, a container is created, and the micro-service instance is operated through the created container; the running micro-service instance and the target micro-service instance belong to the same micro-service type; receiving a micro-service registration request sent by the micro-service instance through a micro-service registration center, and generating a corresponding micro-service registration record; synchronizing the microservice registration record to a microservice forwarding center; and distributing part of the micro-service requests corresponding to the micro-service types to the micro-service instances operated by the created container according to the micro-service registration records through the micro-service forwarding center. The method facilitates the unified management and expansion of the artificial intelligence service cloud platform, and enhances the expansibility of the artificial intelligence service cloud platform.

Description

Micro-service management method and system based on artificial intelligence service cloud platform

Technical Field

The application relates to the field of artificial intelligence, in particular to a micro-service management method and system based on an artificial intelligence service cloud platform.

Background

With the development of artificial intelligence, the research range related to artificial intelligence is wider and wider, and the functions which can be realized by the artificial intelligence service developed along with the development are more and more, and the artificial intelligence service mainly comprises voice recognition, image recognition, natural language processing and recommendation systems and the like. The artificial intelligence service brings great convenience to the life of people and improves the life quality of people. Currently, an artificial intelligence service is directly deployed in an Application server on a physical machine, and provides a corresponding API (Application Programming Interface) to implement a corresponding function through invocation.

The deployment method enables the artificial intelligence services to be mutually independent, each artificial intelligence service can provide diversified service functions, and the artificial intelligence services are more and more complex along with the increase of the provided service functions. When a service function is added, a large amount of modification needs to be performed on the basis of the existing artificial intelligence service, so that the expansion of the service function is inconvenient. Furthermore, when a plurality of artificial intelligence services form a corresponding artificial intelligence service cloud platform, the expansion of the artificial intelligence service cloud platform requires the expansion of the whole artificial intelligence service, which is inconvenient for the expansion of the service functions of the artificial intelligence service cloud platform, thereby resulting in low expansibility of the artificial intelligence service cloud platform.

Disclosure of Invention

Therefore, in order to solve the above technical problems, a micro-service management method and system based on an artificial intelligence service cloud platform are needed to be provided, which can enhance the expansibility of the artificial intelligence service cloud platform.

A micro-service management method based on an artificial intelligence service cloud platform, the method comprising:

acquiring operation index parameters of a target micro-service instance through a container scheduling center; when the operation index parameter meets the container extension condition, a container is created, and the micro-service instance is operated through the created container; the running micro-service instance and the target micro-service instance belong to the same micro-service type;

receiving a micro-service registration request sent by the micro-service instance through a micro-service registration center, and generating a corresponding micro-service registration record; synchronizing the microservice registration record to a microservice forwarding center;

and distributing part of the micro-service requests corresponding to the micro-service types to the micro-service instances operated by the created container according to the micro-service registration records through the micro-service forwarding center.

A micro-service management system based on an artificial intelligence service cloud platform, the system comprising: the system comprises a container scheduling center, a micro-service registration center and a micro-service forwarding center;

the container scheduling center is used for acquiring the operation index parameters of the target micro-service instance; when the operation index parameter meets the container extension condition, a container is created, and the micro-service instance is operated through the created container; the running micro-service instance and the target micro-service instance belong to the same micro-service type;

the micro-service registration center is used for receiving the micro-service registration request sent by the micro-service instance and generating a corresponding micro-service registration record; synchronizing the microservice registration record to a microservice forwarding center;

and the micro-service forwarding center is used for distributing part of micro-service requests corresponding to the micro-service types to the micro-service instances operated by the created container according to the micro-service registration records.

A computer-readable storage medium, on which a computer program is stored which, when executed by a processor, carries out the steps of:

A server comprising a memory and a processor, the memory storing a computer program, wherein the processor when executing the computer program performs the steps of:

According to the micro-service management method, the system, the computer readable storage medium and the server based on the artificial intelligence service cloud platform, the operation index parameters of the target micro-service instance are obtained in real time through the container scheduling center, the corresponding container is created in real time when the obtained operation index parameters meet the preset extension conditions, the micro-service instance running in the created container and the corresponding target micro-service instance belong to the same micro-service type, the micro-service instance is extended through the method, and the expansibility of the artificial intelligence service cloud platform is enhanced. Furthermore, the micro-service registration center registers the expanded micro-service instances and synchronizes the registered micro-service registration records to the micro-service forwarding center, so that the micro-service forwarding center distributes part of micro-service requests of corresponding service types to the corresponding micro-service instances according to the synchronized micro-service registration records, the load balance of the micro-service instances is realized, the response efficiency of the micro-service requests is improved, the management and the expansion of the micro-services are facilitated, the unified management and the expansion of the artificial intelligent service cloud platform are facilitated, and the expansibility of the artificial intelligent service cloud platform is further enhanced.

Drawings

FIG. 1 is a diagram of an application environment of a micro-service management method based on an artificial intelligence service cloud platform in one embodiment;

FIG. 2 is a schematic flow chart illustrating a method for micro-service management based on an artificial intelligence service cloud platform in one embodiment;

FIG. 3 is a schematic flow chart of a micro-service management method based on an artificial intelligence service cloud platform in another embodiment;

FIG. 4 is a schematic flowchart of a micro-service management method based on an artificial intelligence service cloud platform in another embodiment;

FIG. 5 is a block flow diagram of a method for micro-service management based on an artificial intelligence service cloud platform in one embodiment;

FIG. 6 is a block diagram of a micro-service management device based on an artificial intelligence service cloud platform according to an embodiment;

FIG. 7 is a block diagram of a micro-service management device based on an artificial intelligence service cloud platform in another embodiment;

FIG. 8 is a block diagram of a micro-service management device based on an artificial intelligence service cloud platform in another embodiment;

FIG. 9 is a block diagram of a micro-service management device based on an artificial intelligence service cloud platform according to still another embodiment;

FIG. 10 is a diagram showing an internal structure of a computer device according to an embodiment.

Detailed Description

In order to make the objects, technical solutions and advantages of the present application more apparent, the present application is described in further detail below with reference to the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are merely illustrative of the present application and are not intended to limit the present application.

The service management method based on the artificial intelligence service cloud platform can be applied to the application environment shown in fig. 1. Wherein the terminal 110 communicates with the server 120 through a network. The terminal 110 may be, but is not limited to, various personal computers, notebook computers, smart phones, tablet computers, and portable wearable devices, and the server 120 may be an independent server or a server cluster composed of a plurality of servers. The server 120 may have a container scheduling center, a service registration center, and a service forwarding center running thereon. The container scheduling center, the service registration center and the service forwarding center may specifically operate on the same server, or may respectively operate on different servers.

In one embodiment, as shown in fig. 2, a micro-service management method based on an artificial intelligence service cloud platform is provided, which is described by taking the method as an example applied to the server in fig. 1, and includes the following steps:

s202, acquiring operation index parameters of a target micro-service instance through a container scheduling center; creating a container when the operation index parameter meets the container extension condition, and operating the micro-service instance through the created container; the running microservice instance is of the same microservice type as the target microservice instance.

Wherein the container is a thin version of an operating system. The container contains the basic environment needed by the micro-service instance to run. The container may be, for example, a Docker container, where the Docker is an open-source micro service instance container engine, and based on the micro service instance container engine, the micro service instance and the corresponding dependent package may be packaged and stored in a portable container, and then the container in which the micro service instance is stored is distributed to any Linux machine, or the container in which the micro service instance is stored is virtualized.

A container scheduling center is a computer program that manages and schedules containers. The container scheduling center can realize the automatic deployment of the container for operating the micro-service instance according to the operation index parameters of the micro-service instance. The container scheduling center may specifically implement creation and deletion of containers. When the container scheduling center creates the container, firstly, the mirror image of the micro-service instance running in the created container is obtained, a corresponding container is created according to the obtained mirror image, and the corresponding micro-service instance is run through the created container. The container scheduling center may be, for example, k8s (Kubernetes, open source large-scale container cluster management system).

A microservice is a variant of an SOA (Service-Oriented-Architecture). The microservice treats a service instance as a collection of loosely coupled services. In the microservice architecture, services are fine-grained, and the protocol between services is lightweight. The service instance is decomposed into a plurality of different micro service instances, so that the modularity of the micro service architecture is improved, and the service instance is easier to understand, develop and test.

A microservice instance is a computer program that provides basic service functionality. The micro-service instance may specifically be a service program that implements a specific service function. The micro-service instance can be a face recognition micro-service instance, a speech synthesis micro-service instance, an image recognition micro-service instance, a character recognition micro-service instance and the like. The target micro-service instance is a micro-service instance that obtains the corresponding operation index parameter. The target microservice instance may be any microservice instance. The micro-service type is the service type to which the micro-service instance belongs. The microservice type is used to differentiate microservice instances of different service functions. The micro service type may specifically represent a service function implemented for a micro service instance, such as a face recognition micro service, a speech synthesis micro service, or a text recognition micro service.

The operation index parameter is an index parameter generated during operation. The operation index parameters may specifically include index parameters generated when a container of the micro service instance operates, and index parameters generated when a service node where the micro service instance is located operates. The operation index parameter may be at least one of a CPU (Central Processing Unit) utilization rate, a memory utilization rate, a call amount, and the like. The service nodes are servers that make up a server cluster. The container expansion condition is a constraint condition for expanding the container. The container expansion condition is the basis for the container scheduling center to judge whether to expand the container. The container extension condition is used to compare with the operating parameters of the microservice instance to determine whether to create a container to run the corresponding microservice instance.

Specifically, the container scheduling center respectively obtains the respective corresponding operation index parameters of the container for operating the target micro-service instance and the service node where the target micro-service instance is located, and compares the respectively obtained operation index parameters corresponding to the container and the service node with the container extension conditions. And when the operation index parameters meet the container extension conditions, creating a container for operating the corresponding micro service instance through a container scheduling center. The micro-service instance running in the created container is of the same micro-service type as the target micro-service instance.

In one embodiment, the container scheduling center performs comprehensive analysis on the operation index parameters corresponding to the container and the service node, and compares the operation index parameters of the comprehensive analysis with the container expansion conditions to obtain corresponding comparison results. And when the comprehensively analyzed operation index parameters meet the container extension conditions, acquiring the mirror image of the target micro-service instance through the container scheduling center, creating a corresponding container according to the acquired mirror image, wherein the micro-service instance operated in the created container and the target micro-service instance belong to the same micro-service type.

In one embodiment, a container for running a target micro-service instance and an operation index parameter corresponding to each service node in a server cluster where the target micro-service instance is located are respectively obtained through a container scheduling center, the index parameter of the container is compared with a container expansion condition, and when the index parameter of the container meets the container expansion condition, a container for running the corresponding micro-service instance is created. And determining the deployment position of the created container according to the operation index parameter of each service node through the container scheduling center.

S204, receiving a micro-service registration request sent by a micro-service instance through a micro-service registration center, and generating a corresponding micro-service registration record; and synchronizing the micro-service registration record to a micro-service forwarding center.

The micro-service registration center is a computer program for registering micro-service instances. A microservice registration request is a request to trigger a registration operation for a microservice instance. The micro-service registration request may specifically include a micro-service type to which the registered micro-service instance belongs, an identifier of a service node where the registered micro-service instance is located, and a service node port number corresponding to the registered micro-service instance. The microservice registration record is a record generated at registration time that corresponds to the registered microservice instance. The micro-service registration record may specifically record a micro-service type to which the registered micro-service instance belongs, an identifier of a service node where the registered micro-service instance is located, and a service node port number corresponding to the registered micro-service instance. A microservice forwarding center is a computer program that forwards service requests. The microservice forwarding center may be configured to distribute received service requests to corresponding microservice instances.

Specifically, a micro-service registration request sent by a micro-service instance running in a created container is received through a micro-service registration center, the micro-service type of the registered micro-service instance, the identification of a service node where the registered micro-service instance is located and a service node port number corresponding to the registered micro-service instance are obtained according to the received micro-service registration request, and a corresponding micro-service registration record is generated according to the obtained micro-service type, the identification of the service node and the service node port number; and synchronizing the micro-service registration record generated corresponding to the micro-service registration request to a micro-service forwarding center.

In one embodiment, a micro-service registration center receives a micro-service registration request sent by a micro-service instance running in a created container, analyzes the received micro-service registration request, obtains the micro-service type of the registered micro-service instance, the identifier of the service node where the registered micro-service instance is located and the port number of the service node corresponding to the registered micro-service instance, and generates a corresponding micro-service registration record according to the analyzed micro-service registration request.

In one embodiment, a micro-service registration request sent by a micro-service instance running in a created container is received through a micro-service registration center, a micro-service type to which the registered micro-service instance belongs, an identifier of a service node where the registered micro-service instance is located and a service node port number corresponding to the registered micro-service instance are inquired correspondingly according to the received micro-service registration request, and a corresponding micro-service registration record is generated according to the inquired micro-service type, the identifier of the service node and the service node port number.

The identification of the service node is used to uniquely identify the corresponding service node. The service node identifier may be a character string composed of at least one of numeric, symbolic and alphabetical characters. The service node port number is the port number of the service node. The service node port number is used to uniquely identify the port of the service node. The service node corresponds to more than one port, and each port corresponds to a unique port number.

And S206, distributing part of micro-service requests corresponding to micro-service types to the micro-service instances operated by the created container according to the micro-service registration records through the micro-service forwarding center.

Wherein, the micro-service request is a parameter requesting to realize the corresponding micro-service function. The object data processed by the micro-service instance in response to the received micro-service request is included in the micro-service request. The micro-service request may specifically be a target image for implementing face recognition, a target character sequence for performing character recognition, or voice data for performing voice recognition, and the like.

Specifically, a micro-service registration record synchronized by the micro-service registration center is received by the micro-service forwarding center, and when the received micro-service request corresponds to the micro-service type to which the micro-service instance operated by the created container belongs, part of the received micro-service request is distributed to the micro-service instance operated by the created container according to the synchronized micro-service registration record.

In one embodiment, a micro-service registration record synchronized by a micro-service registration center is received through a micro-service forwarding center, the synchronized micro-service registration record is stored locally, when a micro-service request is received, a micro-service type corresponding to the micro-service request is determined, a micro-service instance corresponding to the micro-service type is determined according to the synchronized micro-service registration record, and the received micro-service request is sent to the determined micro-service instance.

According to the micro-service management method based on the artificial intelligence service cloud platform, the operation index parameters of the target micro-service instance are obtained in real time through the container scheduling center, the corresponding container is created in real time when the obtained operation index parameters meet the preset extension conditions, the micro-service instance running in the created container and the corresponding target micro-service instance belong to the same micro-service type, the expansion of the micro-service instance is achieved through the method, and the expansibility of the artificial intelligence service cloud platform is enhanced. Furthermore, the micro-service registration center registers the expanded micro-service instances and synchronizes the registered micro-service registration records to the micro-service forwarding center, so that the micro-service forwarding center distributes part of micro-service requests of corresponding service types to the corresponding micro-service instances according to the synchronized micro-service registration records, the load balance of the micro-service instances is realized, the response efficiency of the micro-service requests is improved, the management and the expansion of the micro-service instances are facilitated, the unified management and the expansion of the artificial intelligent service cloud platform are facilitated, and the expansibility of the artificial intelligent service cloud platform is further enhanced.

In an embodiment, the micro-service management method based on the artificial intelligence service cloud platform further includes: receiving a micro-service request of a client through a load balancer, acquiring a request path parameter corresponding to the micro-service request, and sending the micro-service request and the request path parameter to a micro-service forwarding center; step S206 includes: analyzing the received request path parameters through a micro-service forwarding center to obtain a corresponding micro-service type; inquiring a corresponding micro-service registration record list according to the obtained micro-service type, and selecting a micro-service registration record from the inquired micro-service registration record list; and distributing the micro-service request to the micro-service instance corresponding to the selected micro-service registration record.

The load balancer is a computer program that implements a load balancing function. The load balancer is used for distributing the received micro-service request to any micro-service forwarding center of more than one micro-service forwarding center. The load balancer is used for balancing the number of the micro-service requests received by each micro-service forwarding center. The request path parameter is a path parameter for sending a corresponding micro service request when the client requests the micro service. In other words, the request path parameters are the path parameters for the load balancer to receive the microservice request. The request path parameter may include an identifier of a service node where the load balancer is located, a service node port number corresponding to the load balancer, and a micro-service type corresponding to the micro-service request. The request path parameters corresponding to the service requests of the same micro service type are the same. The micro-service registration record list is a collection of micro-service registration records consisting of micro-service registration records.

Specifically, a micro-service request of a client is received through a load balancer, corresponding request path parameters are obtained according to the received micro-service request, and the obtained request path parameters and the micro-service request are sent to a micro-service forwarding center. Receiving a request path parameter and a micro-service request sent by a load balancer through a micro-service forwarding center, and analyzing the received request path parameter to obtain a corresponding micro-service type; and inquiring a micro-service registration record list corresponding to the micro-service type obtained by analysis from the micro-service registration records synchronized with the micro-service registration center, selecting any micro-service registration record from the inquired micro-service registration record list, determining a corresponding micro-service instance according to the selected micro-service registration record, and sending the received micro-service request to the determined micro-service instance.

In one embodiment, there is more than one microservice forwarding center. The method comprises the steps of receiving a micro-service request of a client through a load balancer, obtaining request path parameters corresponding to the micro-service request, selecting a micro-service forwarding center from more than one micro-service forwarding centers, and sending the obtained micro-service request and the corresponding request path parameters to the selected micro-service forwarding center.

In an embodiment, when a micro service forwarding center is selected from more than one micro service forwarding centers through a load balancer, the load balancer may randomly select the micro service forwarding center from a plurality of micro service forwarding centers, may select the micro service forwarding center from the plurality of micro service forwarding centers in a traversal polling manner, and may select the micro service forwarding center according to the current respective load of the plurality of micro service forwarding centers.

In the embodiment, the micro-service request and the corresponding request path parameter of the client are obtained through the load balancer, the obtained micro-service request and the obtained request path parameter are sent to the micro-service forwarding center, the request path parameter is analyzed through the micro-service forwarding center to obtain the corresponding micro-service type, the received micro-service request is sent to the micro-service instance correspondingly determined according to the micro-service type, the received micro-service request is responded in time through the determined micro-service instance, the response efficiency of the micro-service request is improved, the management efficiency of the micro-service instance is improved, and therefore the management efficiency of the artificial intelligent service cloud platform is improved.

In one embodiment, the micro-service registration record includes a micro-service type to which the registered micro-service instance belongs, an identifier of a service node where the registered micro-service instance is located, and a service node port number corresponding to the registered micro-service instance; distributing the micro-service request to the micro-service instance corresponding to the selected micro-service registration record, comprising: determining a corresponding micro-service instance according to the service node identifier and the service node port number recorded in the selected micro-service registration record; and distributing the micro-service request to the determined micro-service instance.

Specifically, after a micro-service registration record is selected from the inquired micro-service registration record list through the micro-service forwarding center, the identifier of the service node and the corresponding service node port number of the record corresponding to the micro-service type are obtained from the selected micro-service registration record, the corresponding micro-service instance is determined according to the obtained identifier of the service node and the service node port number, and the received micro-service request is sent to the determined micro-service instance.

In one embodiment, the micro service instances run through the created container have corresponding micro service instance ports, the micro service instance ports are the basis for data interaction among the micro service instances, and the micro service registration center and the micro service forwarding center access and call the corresponding micro service instances through the micro service instance ports. When the micro service instance is registered through the micro service registration center, the port number of the micro service instance port is mapped to the service node port number of the service node where the micro service instance is located, and the port number of the corresponding micro service instance port can be correspondingly determined according to the service node port number, so that the corresponding micro service instance is determined. And respectively mapping the port number of the micro service instance port corresponding to each micro service instance running on the same service node to different service node port numbers of the same service node.

In one embodiment, a heartbeat data packet sent by a registered micro service instance is received through a micro service registration center, and when the heartbeat data packet sent by the micro service instance is not received within a preset time period, it indicates that a container running the micro service instance is deleted, a micro service registration record of the micro service instance is correspondingly deleted, or a mark of abnormal operation is added in the micro service registration record corresponding to the micro service instance.

In the embodiment, the micro-service forwarding center selects the micro-service registration records from the synchronous micro-service registration records according to the micro-service types obtained by analysis, determines the selected micro-service instances according to the service nodes and the service node port numbers recorded in the selected micro-service registration records, and sends the micro-service requests to the determined micro-service instances, so that the response efficiency of the micro-service requests is improved, the manageability and the expandability of the micro-service instances are improved, and the manageability and the expandability of the artificial intelligent service cloud platform are enhanced.

As shown in FIG. 3, in one embodiment, when the microservice instance running through the created container is a generic language microservice instance; receiving a micro-service registration request sent by a micro-service instance through a micro-service registration center, and generating a corresponding micro-service registration record; the micro-service management method based on the artificial intelligence service cloud platform further comprises the following steps:

s302, when the micro-service instance operated by the created container is a heterogeneous language micro-service instance, receiving a micro-service registration request sent by the micro-service instance through a heterogeneous language registration agent center registered in a micro-service registration center, and generating a corresponding micro-service registration record.

Wherein the heterogeneous languages are other languages different from the common language. The heterogeneous language is a computer language different from the computer language applied in the micro-service management method based on the artificial intelligence service cloud platform. The heterogeneous language may be at least one of Python (object-oriented interpreted computer programming language), nodjs (transliterated scripting language), and Php (Hypertext Preprocessor). The general language is a basic computer language for realizing the micro-service management method based on the artificial intelligence service cloud platform. The general language may specifically be Java (object oriented programming language).

A heterogeneous language microservice instance is a computer program written and run based on a heterogeneous language. A heterogeneous language registry is a computer program that registers heterogeneous language microservice instances. The heterogeneous language registration agent center is a bridge for data interaction between the micro-service registration center and the corresponding heterogeneous language micro-service instance. The heterogeneous language registration agent center registers itself in the micro-service registration center, registers the heterogeneous language micro-service instance which runs in the created container and belongs to the specified micro-service type, and stores the micro-service registration record generated correspondingly in the local, thereby realizing the registration of the heterogeneous language micro-service instance in the micro-service registration center.

Specifically, when the micro-service instance operated by the created container is a heterogeneous language micro-service instance, the micro-service instance sends a micro-service registration request to a heterogeneous language registration agent center registered in the micro-service registration center, receives the micro-service registration request sent by the micro-service instance through the heterogeneous language registration agent center, acquires a micro-service type to which the registered micro-service instance belongs, an identifier of a service node where the registered micro-service instance is located and a service node port number corresponding to the registered micro-service instance according to the received micro-service registration request, and generates a corresponding micro-service registration record according to the acquired micro-service type, identifier of the service node and the service node port number.

In one embodiment, a container creating instruction is received through a container scheduling center, a corresponding container is created according to the received container creating instruction, and a heterogeneous language registration agent center is operated through the created container. And receiving a registration request sent by the heterogeneous language registration agent center through the micro service registration center, and generating registration information corresponding to the registered heterogeneous language registration agent center according to the received registration request.

S304, distributing the micro-service request corresponding to the micro-service type to the heterogeneous language registration agent center through the micro-service forwarding center according to the registration information of the heterogeneous language registration agent center synchronized by the micro-service registration center.

Specifically, the heterogeneous language registration agent center is registered through the micro-service registration center to generate corresponding registration information, and the generated registration information is synchronized to the micro-service forwarding center. And receiving the micro-service request through the micro-service forwarding center, and distributing the received micro-service request to the heterogeneous language registration agent center according to the registration information of the heterogeneous language registration agent center synchronized by the micro-service registration center when the micro-service type corresponding to the received micro-service request is the same as the micro-service type to which the micro-service instance registered in the heterogeneous language registration agent center belongs.

S306, distributing part of micro-service requests corresponding to micro-service types to the micro-service instances operated by the created container according to the generated micro-service registration records through the heterogeneous language registration agent center.

Specifically, a heterogeneous language registration agent center receives a micro-service request distributed by a micro-service forwarding center, the micro-service type corresponding to the received micro-service request is the same as the micro-service type to which a registered micro-service instance belongs, and the received partial micro-service request is distributed to the micro-service instance operated through a created container according to a micro-service registration record correspondingly generated when the micro-service instance is registered. In this embodiment, the micro service instance run through the created container and the micro service instance registered through the heterogeneous language registration agent center are both heterogeneous language micro service instances.

In the embodiment, when the micro-service instance operated by the created container is the heterogeneous language micro-service instance, the heterogeneous language registration agent center registered in the micro-service registration center indirectly registers the micro-service instance operated by the created container in the micro-service registration center, so that the expansion of the heterogeneous language micro-service instance is realized, the expansibility of the heterogeneous language micro-service instance is improved, and the expansibility of the artificial intelligent service cloud platform is improved. The heterogeneous language registration agent center receives the micro-service request which is sent by the micro-service forwarding center and corresponds to the micro-service type of the registered heterogeneous language micro-service instance, and distributes the received micro-service request to the registered heterogeneous language micro-service instance according to the micro-service registration record correspondingly generated during registration, so that the load balance of the heterogeneous language micro-service instance is realized, the response efficiency of the micro-service request is improved, the manageability and the expandability of the heterogeneous language micro-service instance are improved, the unified management of the artificial intelligent service cloud platform on the heterogeneous language micro-service instance is facilitated, and the expandability of the artificial intelligent service cloud platform is further enhanced.

In an embodiment, the micro-service management method based on the artificial intelligence service cloud platform further includes: receiving a micro-service request of a client through a load balancer, acquiring a request path parameter corresponding to the micro-service request, and sending the micro-service request and the request path parameter to a micro-service forwarding center; step S304 includes: analyzing the received request path parameters through a micro-service forwarding center to obtain a corresponding micro-service type; inquiring corresponding registration information according to the obtained micro service type; the inquired registration information is the registration information of a heterogeneous language registration agent center synchronized by the micro-service registration center; and distributing the micro-service request to the inquired heterogeneous language registration agent center.

Specifically, a micro-service request of a client is received through a load balancer, corresponding request path parameters are obtained according to the received micro-service request, and the obtained request path parameters and the micro-service request are sent to a micro-service forwarding center. Receiving a request path parameter and a micro-service request sent by a load balancer through a micro-service forwarding center, and analyzing the received request path parameter to obtain a corresponding micro-service type; and inquiring registration information corresponding to the analyzed micro service type from the registration information which is synchronous with the micro service registration center and corresponds to the heterogeneous language registration agent center, determining the corresponding heterogeneous language registration agent center according to the inquired registration information, and sending the received micro service request to the determined heterogeneous language registration agent center.

In one embodiment, the heterogeneous language registration agent center is registered through the micro-service registration center to generate corresponding registration information, and the generated registration information is synchronized to the micro-service forwarding center. And sending the micro-service request corresponding to the micro-service type to a heterogeneous language registration agent center through the micro-service forwarding center according to the synchronous registration information. And distributing the received micro-service request to the registered heterogeneous language micro-service instance through the heterogeneous language registration agency center.

In the embodiment, the received micro-service request and the correspondingly obtained request path parameter are sent to the micro-service forwarding center through the load balancer, so that the micro-service forwarding center analyzes the request path parameter to obtain the corresponding micro-service type, and sends the received micro-service request to the heterogeneous language registration agent center correspondingly determined according to the synchronous registration information and the micro-service type obtained through analysis, so that the heterogeneous language registration agent center distributes the received micro-service request to the registered heterogeneous language micro-service instance, and the received micro-service request is responded in time through the heterogeneous language micro-service instance, so that the response efficiency of the micro-service request is improved, the management efficiency of the heterogeneous language micro-service instance is improved, and the management efficiency of the artificial intelligent service cloud platform is improved.

In one embodiment, the registration information includes a micro-service type to which a micro-service instance registered in the heterogeneous language registration agent center belongs, an identifier of a service node where the registered heterogeneous language registration agent center is located, and a service node port number corresponding to the registered heterogeneous language registration agent center; distributing the microservice request to the queried heterogeneous language registry, comprising: determining a corresponding heterogeneous language registration agent center according to the service node identifier and the service node port number recorded in the inquired registration information; and distributing the micro-service request to the determined heterogeneous language registration agent center.

Specifically, after the registration information corresponding to the analyzed micro service type is inquired from the registration information which is synchronized by the micro service register center and corresponds to the heterogeneous language register agent center through the micro service forwarding center, the identification of the service node and the corresponding service node port number which are recorded corresponding to the micro service type are obtained from the inquired registration information, the corresponding heterogeneous language register agent center is determined according to the obtained identification of the service node and the service node port number, and the received micro service request is sent to the determined heterogeneous language register agent center.

In the embodiment, the micro-service forwarding center queries the registration information corresponding to the micro-service type obtained through analysis from the synchronous registration information of the micro-service registration center according to the micro-service type obtained through analysis, determines the queried heterogeneous language registration agent center according to the service node and the service node port number recorded in the queried registration information, and sends the micro-service request to the queried heterogeneous language registration agent center so as to distribute the micro-service request to the corresponding heterogeneous language micro-service instance through the heterogeneous language registration agent center, so that the response efficiency of the micro-service request is improved, the manageability and the expandability of the heterogeneous language micro-service instance are improved, and the manageability and the expandability of the artificial intelligent service cloud platform are enhanced.

In one embodiment, the micro-service registration record includes a micro-service type to which the registered micro-service instance belongs, an identifier of a service node where the registered micro-service instance is located, and a service node port number corresponding to the registered micro-service instance; step S306 includes: inquiring a corresponding micro-service registration record list according to the received micro-service request; selecting a micro-service registration record from the inquired micro-service registration record list; determining a corresponding micro-service instance according to the service node identifier and the service node port number recorded in the selected micro-service registration record; and distributing the micro-service request to the determined micro-service instance.

Specifically, after receiving a micro-service request sent by a micro-service forwarding center through a heterogeneous language registration agent center, querying a micro-service registration record correspondingly generated when a heterogeneous language micro-service instance is registered according to the received micro-service request, and obtaining a corresponding micro-service registration record list; selecting a micro-service registration record for responding to the micro-service request from the inquired micro-service registration record list, determining a corresponding micro-service instance according to the identification of the service node and the port number of the service node recorded in the selected micro-service registration record, and sending the received micro-service request to the determined micro-service instance so that the micro-service instance responds to the received micro-service instance.

In one embodiment, when the micro service registration record is selected from the queried micro service registration record list through the heterogeneous language registration agent center, the specific selection method includes: randomly selecting a micro-service registration record from the inquired micro-service registration record list; selecting a micro-service registration record from the inquired micro-service registration record list in a traversing polling mode; and selecting the micro-service registration record according to the current load of the micro-service instance corresponding to each micro-service registration record in the inquired micro-service registration record list.

In one embodiment, a heartbeat data packet sent by a registered heterogeneous language micro-service instance is received through a heterogeneous language registration agent center, and when the heartbeat data packet sent by the heterogeneous language micro-service instance is not received within a preset time length, it indicates that a container running the heterogeneous language micro-service instance is deleted, a micro-service registration record of the heterogeneous language micro-service instance is correspondingly deleted, or a mark of abnormal operation is added in the micro-service registration record corresponding to the heterogeneous language micro-service instance.

In one embodiment, a micro-service discovery request is sent to a registered heterogeneous language micro-service instance through a heterogeneous language registration agent center according to a preset period, the micro-service discovery request is used for inquiring whether the corresponding heterogeneous language micro-service instance is in a normal operation state or not, receiving operation data fed back by the heterogeneous language micro-service instance corresponding to the micro-service discovery request, when the operation data fed back by the heterogeneous language micro-service instance is not received within a preset time length, indicating that the corresponding heterogeneous language micro-service instance is in an abnormal operation state, and deleting a micro-service registration record of the heterogeneous language micro-service instance for drinking. The method realizes the detection of the operating state of the registered heterogeneous language micro-service instance by the heterogeneous language registration agent center, so that the micro-service request is conveniently distributed to the heterogeneous language micro-service instance which normally operates, and the micro-service request is ensured to be responded in time.

In one embodiment, a heartbeat data packet sent by a registered heterogeneous language registration agent center is received through a micro service registration center, and when the heartbeat data packet sent by the heterogeneous language registration agent center is not received within a preset time length, the condition that the heterogeneous language registration agent center is in an abnormal operation state is indicated, the registration information of the heterogeneous language registration agent center is correspondingly deleted, or a label with abnormal operation is added in the registration information corresponding to the heterogeneous language registration agent center.

In the embodiment, the heterogeneous language registration agent center determines the corresponding micro service instance according to the service node identifier and the service node port number recorded in the selected micro service registration record, and sends the micro service request to the correspondingly determined micro service instance, so that the micro service instance can respond to the received micro service request in time, and the response efficiency of the micro service request is improved. The micro service instance responding to the micro service request is determined through the method, so that the unified management of the micro service instance is facilitated, the cost for managing and maintaining the micro service instance is reduced, the unified management of the artificial intelligent service cloud platform is facilitated, and the expansibility of the artificial intelligent service cloud platform is enhanced.

In an embodiment, the micro-service management method based on the artificial intelligence service cloud platform further includes: and when the operation index parameter meets the container reduction condition, deleting the container for operating the target micro-service instance through the container scheduling center.

Wherein the container reduction condition is a constraint condition that the container scheduling center deletes the container to reduce the number of containers. The container expansion condition is the basis for the container scheduling center to judge whether to delete the container. The container extension condition is used to compare with the operating parameters of the microservice instance to determine whether to delete the container that operates the corresponding microservice instance.

Specifically, a container for operating a target micro-service instance and a service node where the target micro-service instance is located are respectively obtained through a container scheduling center, and the obtained operation index parameters corresponding to the container and the service node are compared with a container expansion condition; and when the acquired operation index parameters meet the container reduction conditions, deleting the container for operating the target micro-service instance.

In the above embodiment, the container scheduling center deletes the container meeting the container reduction condition according to the acquired operation index parameter and the container reduction condition corresponding to the target micro-service instance, so as to delete the corresponding target micro-service instance. The target micro-service instances are reduced to a proper number according to the operation index parameters, the pressure of the system responding to micro-service requests is dynamically balanced, the target micro-service instances in an idle state are reduced, the calling efficiency of the target micro-service instances is improved, the management of the target micro-service instances is facilitated, and the manageability of the artificial intelligent service cloud platform is further enhanced.

As shown in fig. 4, in a specific embodiment, a micro service management method based on an artificial intelligence service cloud platform is provided, and the method specifically includes the following steps:

s402, acquiring operation index parameters of a target micro-service instance through a container scheduling center; creating a container when the operation index parameter meets the container extension condition, and operating the micro-service instance through the created container; the running microservice instance is of the same microservice type as the target microservice instance.

S404, when the micro-service instance operated by the created container is a universal language micro-service instance; receiving a micro-service registration request sent by a micro-service instance through a micro-service registration center, and generating a corresponding micro-service registration record; and synchronizing the micro-service registration record to a micro-service forwarding center.

S406, receiving the micro-service request of the client through the load balancer, obtaining a request path parameter corresponding to the micro-service request, and sending the micro-service request and the request path parameter to a micro-service forwarding center.

And S408, distributing part of the micro-service requests corresponding to the micro-service types to the micro-service instances operated by the created container according to the micro-service registration records through the micro-service forwarding center.

S410, when the micro-service instance operated by the created container is a heterogeneous language micro-service instance, receiving a micro-service registration request sent by the micro-service instance through a heterogeneous language registration agent center registered in a micro-service registration center, and generating a corresponding micro-service registration record.

S412, receiving the micro-service request of the client through the load balancer, obtaining a request path parameter corresponding to the micro-service request, and sending the micro-service request and the request path parameter to the micro-service forwarding center.

And S414, distributing the micro-service request corresponding to the micro-service type to the heterogeneous language registration agent center through the micro-service forwarding center according to the registration information of the heterogeneous language registration agent center synchronized by the micro-service registration center.

And S416, distributing part of the micro-service requests corresponding to the micro-service types to the micro-service instances operated by the created container through the heterogeneous language registration agent center according to the generated micro-service registration records.

In the embodiment, the corresponding container is created by the container scheduling center according to the operation index parameter and the container extension condition which are obtained corresponding to the target micro-service instance, and the micro-service instance running in the created container and the target micro-service instance belong to the same micro-service type, so that the extension of the target micro-service instance is realized, and the expansibility of the artificial intelligence service cloud platform is enhanced. Furthermore, the micro-service registration center registers the expanded target micro-service instance and synchronizes the generated micro-service registration record to the micro-service forwarding center, so that the micro-service forwarding center sends the micro-service request to the micro-service instance according to the micro-service registration record, the response efficiency of the micro-service request is improved, the unified management of the artificial intelligent service cloud platform is facilitated, and the expansibility of the artificial intelligent service cloud platform is enhanced. When the target micro-service instance is the heterogeneous language micro-service instance, the heterogeneous language micro-service instance is registered through a heterogeneous language registration agent center registered in a micro-service registration center, so that the micro-service request sent by the micro-service forwarding center is sent to the micro-service instance according to the generated micro-service registration record, the expansibility of the heterogeneous language micro-service instance is enhanced, and the expansibility of the artificial intelligent service cloud platform is further enhanced.

As shown in fig. 5, in a specific embodiment, a micro service management method based on an artificial intelligence service cloud platform is provided, and the method specifically includes the following steps:

the method comprises the steps of obtaining operation index parameters of a target micro-service instance through a container scheduling center, creating a corresponding container according to the obtained operation index parameters, wherein the micro-service instance operated in the created container and the target micro-service instance belong to the same micro-service type. The target micro-service instance in this embodiment may be an artificial intelligence micro-service instance, and the target micro-service instance may specifically be a face recognition micro-service instance, a speech synthesis micro-service instance, a text recognition micro-service instance, or another artificial intelligence micro-service instance. The general language in this embodiment may be Java. When the target microservice instance is a heterogeneous language microservice instance, the target microservice instance may specifically be a python-based microservice instance, a nodejs-based microservice instance, a php-based microservice instance, or a microservice instance based on other languages.

When the micro-service instance running through the created container is a generic language micro-service instance; receiving a micro-service registration request sent by a micro-service instance through a micro-service registration center, generating a corresponding micro-service registration record, and finishing a micro-service registration process; synchronizing the generated micro-service registration record to a micro-service forwarding center; and sending a micro-service discovery request to the registered micro-service instance according to a preset period, and receiving the operation data correspondingly fed back by the micro-service instance to complete the service discovery process. When the micro-service instance operated by the created container is a heterogeneous language micro-service instance, receiving a micro-service registration request sent by the micro-service instance through a heterogeneous language registration agent center registered in a micro-service registration center, generating a corresponding micro-service registration record, and finishing a micro-service registration process; and sending a micro-service discovery request to the registered micro-service instance according to a preset period, and receiving the operation data correspondingly fed back by the micro-service instance to complete the service discovery process. The method comprises the steps that registration information generated when a heterogeneous language registration agent center is registered is synchronized to a micro-service forwarding center through a micro-service registration center, the agent registration process is completed, a micro-service discovery request is sent to the registered heterogeneous language registration agent center according to a preset period, and operation data correspondingly fed back by the heterogeneous language registration agent center is received, so that the agent discovery process is completed.

The method comprises the steps of receiving a micro-service request sent by a client through a load balancer, obtaining a request path parameter corresponding to the micro-service request, and sending the obtained micro-service request and the request path parameter to a micro-service forwarding center.

And analyzing the received request path parameters through the micro-service forwarding center to obtain the corresponding micro-service type. When the micro-service instance corresponding to the micro-service type obtained by analysis is a general language micro-service instance, inquiring a corresponding micro-service registration record list according to the obtained micro-service type through a micro-service forwarding center, and selecting a micro-service registration record from the inquired micro-service registration record list; and distributing the received micro-service request to the micro-service instance corresponding to the selected micro-service registration record.

When the micro service instance corresponding to the micro service type obtained by analysis is a heterogeneous language micro service instance, inquiring corresponding registration information according to the obtained micro service type through a micro service forwarding center; the inquired registration information is the registration information of a heterogeneous language registration agent center synchronized by the micro-service registration center; and distributing the received micro-service request to the inquired heterogeneous language registration agent center. And distributing part of the micro-service requests corresponding to the micro-service types to the micro-service instances operated by the created container through the heterogeneous language registration agent center according to the generated micro-service registration records.

In the embodiment, the artificial intelligence service instances forming the artificial intelligence service cloud platform are micro-serviced into the corresponding micro-service instances, so that the stability of the micro-service instances is improved, the unified management of the artificial intelligence service cloud platform is facilitated, the management and maintenance cost of the artificial intelligence service cloud platform is reduced, and the expansibility of the artificial intelligence service cloud platform is correspondingly enhanced.

It should be understood that, although the steps in the flowcharts of fig. 2 to 5 are shown in sequence as indicated by the arrows, the steps are not necessarily performed in sequence as indicated by the arrows. The steps are not performed in the exact order shown and described, and may be performed in other orders, unless explicitly stated otherwise. Moreover, at least some of the steps in fig. 2-5 may include multiple sub-steps or multiple stages that are not necessarily performed at the same time, but may be performed at different times, and the order of performing the sub-steps or stages is not necessarily sequential, but may be performed in turn or alternately with other steps or at least some of the sub-steps or stages of other steps.

In one embodiment, as shown in fig. 6, there is provided a micro service management system 600 based on an artificial intelligence service cloud platform, including: a container scheduling center 601, a micro service registration center 602, and a micro service forwarding center 603, wherein:

the container scheduling center 601 is used for acquiring the operation index parameters of the target micro-service instance; creating a container when the operation index parameter meets the container extension condition, and operating the micro-service instance through the created container; the running microservice instance is of the same microservice type as the target microservice instance. The container scheduling center 601 is further configured to manage and schedule the micro-service registration center 602 operated through the container and the micro-service forwarding center 603 operated through the container in the micro-service management system based on the artificial intelligence service cloud platform.

The micro-service registration center 602 is configured to receive a micro-service registration request sent by a micro-service instance, and generate a corresponding micro-service registration record; the microservice registration record is synchronized to the microservice forwarding center 603.

And the micro-service forwarding center 603 is configured to distribute, according to the micro-service registration record, part of the micro-service requests corresponding to the micro-service type to the micro-service instances running through the created container.

According to the micro-service management system based on the artificial intelligence service cloud platform, the operation index parameters of the target micro-service instance are obtained in real time through the container scheduling center, the corresponding container is created in real time when the obtained operation index parameters meet the preset extension conditions, the micro-service instance running in the created container and the corresponding target micro-service instance belong to the same micro-service type, the expansion of the micro-service instance is achieved through the method, and the expansibility of the artificial intelligence service cloud platform is enhanced. Furthermore, the micro-service registration center registers the expanded micro-service instances and synchronizes the registered micro-service registration records to the micro-service forwarding center, so that the micro-service forwarding center distributes part of micro-service requests of corresponding service types to the corresponding micro-service instances according to the synchronized micro-service registration records, the load balance of the micro-service instances is realized, the response efficiency of the micro-service requests is improved, the management and the expansion of the micro-service instances are facilitated, the unified management and the expansion of the artificial intelligent service cloud platform are facilitated, and the expansibility of the artificial intelligent service cloud platform is further enhanced.

As shown in fig. 7, in an embodiment, the micro service management system 600 based on the artificial intelligence service cloud platform further includes: a load balancer 604;

the load balancer 604 is configured to receive a micro service request from a client, obtain a request path parameter corresponding to the micro service request, and send the micro service request and the request path parameter to the micro service forwarding center 603.

The micro service forwarding center 603 is further configured to analyze the received request path parameter to obtain a corresponding micro service type; inquiring a corresponding micro-service registration record list according to the obtained micro-service type, and selecting a micro-service registration record from the inquired micro-service registration record list; and distributing the micro-service request to the micro-service instance corresponding to the selected micro-service registration record.

The container scheduling center 601 is further configured to manage and schedule the load balancer 604 running through the container in the micro-service management system based on the artificial intelligence service cloud platform.

In one embodiment, the micro-service registration record includes a micro-service type to which the registered micro-service instance belongs, an identifier of a service node where the registered micro-service instance is located, and a service node port number corresponding to the registered micro-service instance; the micro-service forwarding center 603 is further configured to determine a corresponding micro-service instance according to the service node identifier and the service node port number recorded in the selected micro-service registration record; and distributing the micro-service request to the determined micro-service instance.

As shown in fig. 8, in an embodiment, when the micro-service instance executed by the created container is a heterogeneous language micro-service instance, the micro-service management system 600 based on the artificial intelligence service cloud platform further includes: the heterogeneous language registry 605 registers with the microservice registry.

The heterogeneous language registration agent center 605 is configured to receive a micro-service registration request sent by a micro-service instance, and generate a corresponding micro-service registration record; the micro service forwarding center 603 is further configured to distribute the micro service request corresponding to the micro service type to the heterogeneous language registration agent center 605 according to the registration information of the heterogeneous language registration agent center 605 synchronized by the micro service registration center 602; the heterogeneous language registration agent center 605 is further configured to distribute, according to the generated micro-service registration record, a part of the micro-service requests corresponding to the micro-service type to the micro-service instances running through the created container.

As shown in fig. 9, in an embodiment, the micro service management system 600 based on the artificial intelligence service cloud platform further includes: a load balancer 604; the load balancer 604 is configured to receive a micro service request from a client, obtain a request path parameter corresponding to the micro service request, and send the micro service request and the request path parameter to the micro service forwarding center 603; the micro service forwarding center 603 is further configured to analyze the received request path parameter to obtain a corresponding micro service type; inquiring corresponding registration information according to the obtained micro service type; the inquired registration information is the registration information of the heterogeneous language registration agent center 605 synchronized by the micro service registration center 602; the microservice request is distributed to the queried heterogeneous language registry 605.

In one embodiment, the registration information includes a micro-service type to which a micro-service instance registered in the heterogeneous language registration agent center belongs, an identifier of a service node where the registered heterogeneous language registration agent center is located, and a service node port number corresponding to the registered heterogeneous language registration agent center; the micro service forwarding center 603 is further configured to determine a corresponding heterogeneous language registration agent center according to the service node identifier and the service node port number recorded in the queried registration information; and distributing the micro-service request to the determined heterogeneous language registration agent center.

In one embodiment, the micro-service registration record includes a micro-service type to which the registered micro-service instance belongs, an identifier of a service node where the registered micro-service instance is located, and a service node port number corresponding to the registered micro-service instance; the heterogeneous language registration agent center 605 is further configured to query a corresponding micro-service registration record list according to the received micro-service request; selecting a micro-service registration record from the inquired micro-service registration record list; determining a corresponding micro-service instance according to the service node identifier and the service node port number recorded in the selected micro-service registration record; and distributing the micro-service request to the determined micro-service instance.

In one embodiment, the container scheduling center 601 is further configured to delete the container running the target microservice instance when the operation index parameter meets the container reduction condition.

In one embodiment, a computer device is provided, which may be a server, and its internal structure diagram may be as shown in fig. 10. The computer device includes a processor, a memory, and a network interface connected by a system bus. Wherein the processor of the computer device is configured to provide computing and control capabilities. The memory of the computer device comprises a nonvolatile storage medium and an internal memory. The non-volatile storage medium stores an operating system and a computer program. The internal memory provides an environment for the operation of an operating system and computer programs in the non-volatile storage medium. The network interface of the computer device is used for communicating with an external terminal or server through a network connection. The computer program is executed by a processor to realize a micro-service management method based on an artificial intelligence service cloud platform.

Those skilled in the art will appreciate that the architecture shown in fig. 10 is merely a block diagram of some of the structures associated with the disclosed aspects and is not intended to limit the computing devices to which the disclosed aspects apply, as particular computing devices may include more or less components than those shown, or may combine certain components, or have a different arrangement of components.

In one embodiment, a computer readable storage medium is provided, on which a computer program is stored, and the computer program, when executed by a processor, implements the steps of the micro service management method based on the artificial intelligence service cloud platform in the embodiments.

In one embodiment, a server is provided, which includes a memory and a processor, where the memory stores a computer program, and the processor implements the steps of the micro-service management method based on an artificial intelligence service cloud platform in the foregoing embodiments when executing the computer program.

It will be understood by those skilled in the art that all or part of the processes of the methods of the embodiments described above can be implemented by hardware instructions of a computer program, which can be stored in a non-volatile computer-readable storage medium, and when executed, can include the processes of the embodiments of the methods described above. Any reference to memory, storage, database, or other medium used in the embodiments provided herein may include non-volatile and/or volatile memory, among others. Non-volatile memory can include read-only memory (ROM), Programmable ROM (PROM), Electrically Programmable ROM (EPROM), Electrically Erasable Programmable ROM (EEPROM), or flash memory. Volatile memory can include Random Access Memory (RAM) or external cache memory.

The technical features of the above embodiments can be arbitrarily combined, and for the sake of brevity, all possible combinations of the technical features in the above embodiments are not described, but should be considered as the scope of the present specification as long as there is no contradiction between the combinations of the technical features.

The above-mentioned embodiments only express several embodiments of the present application, and the description thereof is more specific and detailed, but not construed as limiting the scope of the invention. It should be noted that, for a person skilled in the art, several variations and modifications can be made without departing from the concept of the present application, which falls within the scope of protection of the present application. Therefore, the protection scope of the present patent shall be subject to the appended claims.

Claims

1. A micro-service management method based on an artificial intelligence service cloud platform, the method comprising:

acquiring operation index parameters of a target micro-service instance through a container scheduling center; the operation index parameters comprise a container for operating the target micro-service instance and operation index parameters corresponding to each service node in a server cluster where the target micro-service instance is located; when the operation index parameters corresponding to the container meet the container extension conditions, creating the container, and operating the micro-service instance through the created container; the running micro-service instance and the target micro-service instance belong to the same micro-service type; the operation index parameters corresponding to the service nodes in the server cluster are used for determining the deployment position of the created container;

when the micro-service instance operated by the created container is a universal language micro-service instance, receiving a micro-service registration request sent by the micro-service instance through a micro-service registration center, and generating a corresponding micro-service registration record; synchronizing the microservice registration record to a microservice forwarding center;

distributing part of micro-service requests corresponding to the micro-service types to micro-service instances running through the created container according to the micro-service registration records through the micro-service forwarding center;

when the micro-service instance operated by the created container is a heterogeneous language micro-service instance, receiving a micro-service registration request sent by the micro-service instance through a heterogeneous language registration agent center registered in the micro-service registration center, and generating a corresponding micro-service registration record;

distributing a micro-service request corresponding to the micro-service type to the heterogeneous language registration agent center through the micro-service forwarding center according to the registration information of the heterogeneous language registration agent center synchronized by the micro-service registration center;

and distributing part of the micro-service requests corresponding to the micro-service types to the micro-service instances operated by the created container according to the generated micro-service registration records through the heterogeneous language registration agent center.

2. The method of claim 1, further comprising:

receiving a micro-service request of a client through a load balancer, acquiring a request path parameter corresponding to the micro-service request, and sending the micro-service request and the request path parameter to a micro-service forwarding center;

the distributing, by the micro-service forwarding center and according to the micro-service registration record, a part of micro-service requests corresponding to the micro-service type to a micro-service instance running through a created container includes:

analyzing the received request path parameters through the micro-service forwarding center to obtain a corresponding micro-service type; inquiring a corresponding micro-service registration record list according to the obtained micro-service type, and selecting a micro-service registration record from the inquired micro-service registration record list; and distributing the micro-service request to the micro-service instance corresponding to the selected micro-service registration record.

3. The method according to claim 2, wherein the micro-service registration record includes a micro-service type to which the registered micro-service instance belongs, an identifier of a service node where the registered micro-service instance is located, and a service node port number corresponding to the registered micro-service instance;

the distributing the micro-service request to the micro-service instance corresponding to the selected micro-service registration record comprises:

determining a corresponding micro-service instance according to the service node identifier and the service node port number recorded in the selected micro-service registration record; distributing the microservice request to the determined microservice instance.

4. The method of claim 1, further comprising:

receiving heartbeat data packets sent by registered micro-service instances through the micro-service registration center;

and when the heartbeat data packet sent by the registered micro service instance is not received within a preset time length, deleting the micro service registration record corresponding to the registered micro service instance, or adding a mark of abnormal operation in the micro service registration record corresponding to the registered micro service instance.

5. The method of claim 1, further comprising:

the distributing, by the micro-service forwarding center, the micro-service request corresponding to the micro-service type to the heterogeneous language registration agent center according to the registration information of the heterogeneous language registration agent center synchronized by the micro-service registration center includes:

analyzing the received request path parameters through the micro-service forwarding center to obtain a corresponding micro-service type; inquiring corresponding registration information according to the obtained micro service type; the inquired registration information is the registration information of the heterogeneous language registration agent center synchronized by the micro service registration center; and distributing the micro-service request to the inquired heterogeneous language registration agent center.

6. The method according to claim 5, wherein the registration information includes a micro-service type to which a micro-service instance registered in the heterogeneous language registration agent center belongs, an identifier of a service node where the registered heterogeneous language registration agent center is located, and a service node port number corresponding to the registered heterogeneous language registration agent center;

the distributing the micro-service request to the inquired heterogeneous language registration agent center comprises the following steps: determining a corresponding heterogeneous language registration agent center according to the service node identifier and the service node port number recorded in the inquired registration information; and distributing the micro-service request to the determined heterogeneous language registration agent center.

7. The method according to claim 5, wherein the micro-service registration record includes a micro-service type to which the registered micro-service instance belongs, an identifier of a service node where the registered micro-service instance is located, and a service node port number corresponding to the registered micro-service instance;

the step of distributing part of the micro-service requests corresponding to the micro-service types to the micro-service instances operated by the created container according to the generated micro-service registration records comprises the following steps:

inquiring a corresponding micro-service registration record list according to the received micro-service request;

selecting a micro-service registration record from the inquired micro-service registration record list;

determining a corresponding micro-service instance according to the service node identifier and the service node port number recorded in the selected micro-service registration record;

distributing the microservice request to the determined microservice instance.

8. The method according to any one of claims 1 to 7, further comprising:

and when the operation index parameter meets a container reduction condition, deleting the container for operating the target micro-service instance through the container scheduling center.

9. A micro-service management system based on an artificial intelligence service cloud platform is characterized by comprising: the system comprises a container scheduling center, a micro-service registration center, a micro-service forwarding center and a heterogeneous language registration agent center registered in the micro-service registration center;

the container scheduling center is used for acquiring the operation index parameters of the target micro-service instance; the operation index parameters comprise a container for operating the target micro-service instance and operation index parameters corresponding to each service node in a server cluster where the target micro-service instance is located; when the operation index parameters corresponding to the container meet the container extension conditions, creating the container, and operating the micro-service instance through the created container; the running micro-service instance and the target micro-service instance belong to the same micro-service type; the operation index parameters corresponding to the service nodes in the server cluster are used for determining the deployment position of the created container;

the micro-service registration center is used for receiving a micro-service registration request sent by a micro-service instance and generating a corresponding micro-service registration record when the micro-service instance operated by the established container is a universal language micro-service instance; synchronizing the microservice registration record to a microservice forwarding center;

the microservice forwarding center is used for distributing part of microservice requests corresponding to the microservice types to microservice instances operated by the established container according to the microservice registration records;

the heterogeneous language registration agent center is used for receiving a micro-service registration request sent by a micro-service instance and generating a corresponding micro-service registration record when the micro-service instance operated by the created container is a heterogeneous language micro-service instance;

the micro-service forwarding center is further configured to distribute the micro-service request corresponding to the micro-service type to the heterogeneous language registration agent center according to the registration information of the heterogeneous language registration agent center synchronized by the micro-service registration center;

the heterogeneous language registration agent center is further used for distributing part of the micro-service requests corresponding to the micro-service types to the micro-service instances operated through the created container according to the generated micro-service registration records.

10. The system of claim 9, further comprising: a load balancer;

the load balancer is used for receiving a micro-service request of a client, acquiring a request path parameter corresponding to the micro-service request, and sending the micro-service request and the request path parameter to the micro-service forwarding center;

the micro-service forwarding center is also used for analyzing the received request path parameters to obtain the corresponding micro-service type; inquiring a corresponding micro-service registration record list according to the obtained micro-service type, and selecting a micro-service registration record from the inquired micro-service registration record list; and distributing the micro-service request to the micro-service instance corresponding to the selected micro-service registration record.

11. The system according to claim 10, wherein the micro-service registration record includes a micro-service type to which the registered micro-service instance belongs, an identifier of a service node where the registered micro-service instance is located, and a service node port number corresponding to the registered micro-service instance;

the micro-service forwarding center is also used for determining a corresponding micro-service instance according to the service node identifier and the service node port number recorded in the selected micro-service registration record; distributing the microservice request to the determined microservice instance.

12. The system of claim 9, wherein the microservice registry is further configured to receive heartbeat packets sent by registered microservice instances; and when the heartbeat data packet sent by the registered micro service instance is not received within a preset time length, deleting the micro service registration record corresponding to the registered micro service instance, or adding a mark of abnormal operation in the micro service registration record corresponding to the registered micro service instance.

13. The system of claim 9, further comprising: a load balancer;

the load balancer is used for receiving a micro-service request of a client, acquiring a request path parameter corresponding to the micro-service request, and sending the micro-service request and the request path parameter to a micro-service forwarding center;

the micro-service forwarding center is also used for analyzing the received request path parameters to obtain the corresponding micro-service type; inquiring corresponding registration information according to the obtained micro service type; the inquired registration information is the registration information of the heterogeneous language registration agent center synchronized by the micro service registration center; and distributing the micro-service request to the inquired heterogeneous language registration agent center.

14. The system according to claim 13, wherein the registration information includes a micro-service type to which a micro-service instance registered in the heterogeneous language registration agent center belongs, an identifier of a service node where the registered heterogeneous language registration agent center is located, and a service node port number corresponding to the registered heterogeneous language registration agent center;

the micro-service forwarding center is further used for determining a corresponding heterogeneous language registration agent center according to the service node identifier and the service node port number recorded in the inquired registration information; and distributing the micro-service request to the determined heterogeneous language registration agent center.

15. The system according to claim 13, wherein the micro-service registration record includes a micro-service type to which the registered micro-service instance belongs, an identifier of a service node where the registered micro-service instance is located, and a service node port number corresponding to the registered micro-service instance;

the heterogeneous language registration agent center is also used for inquiring a corresponding micro-service registration record list according to the received micro-service request; selecting a micro-service registration record from the inquired micro-service registration record list; determining a corresponding micro-service instance according to the service node identifier and the service node port number recorded in the selected micro-service registration record; distributing the microservice request to the determined microservice instance.

16. The system according to any of claims 9 to 15, wherein the container scheduling center is further configured to delete the container running the target microservice instance when the operation metric parameter meets a container reduction condition.

17. A computer-readable storage medium, on which a computer program is stored, which, when being executed by a processor, carries out the steps of the method of any one of claims 1 to 8.

18. A server comprising a memory and a processor, the memory storing a computer program, wherein the processor implements the steps of the method of any one of claims 1 to 8 when executing the computer program.