CN111741079A - An interface processing method and system based on microservice architecture - Google Patents

Abstract

The invention discloses an interface processing method and system based on a micro-service architecture, wherein the method comprises the following steps: each business system provides an access interface micro-service request to the interface service request center, and the interface service request center decomposes the access interface micro-service request to obtain a service request queue; the interface service dynamic dispatching center monitors the interface service of the service request queue and dynamically dispatches the service request; and according to the equipment type of the access interface micro-service request, the interface micro-service center deploys the micro-service corresponding to the equipment type. In the implementation of the invention, the dynamic decomposition and scheduling processing of the interface service task are realized, and the interface processing efficiency is improved.

Description

An interface processing method and system based on microservice architecture

technical field

The present invention relates to the technical field of power distribution network and micro-services, in particular to an interface processing method and system based on a micro-service architecture.

Background technique

At present, the micro-service architecture based on the restful interface specification has become the mainstream architecture of current Java development and is widely used. Through the micro-service of the interface or application, the large-scale access traffic generated by a large number of users can be decomposed, and the divide-and-conquer method can be adopted. Achieve the functional indicators required by users, and at the same time meet the user's non-functional quality requirements for high availability, high performance, scalability, scalability and security. In the current system, there are a large number of real-time and non-real-time data synchronization requirements, among which: the equipment file change information and equipment operation and maintenance information interfaces are low-frequency, once a day or weekly, and the equipment's real-time operation data interface is high-frequency, according to The frequency of equipment collection is generally set to 15 minutes, and the frequency of main transformers, high-voltage lines, and medium-voltage lines is 5 minutes or more. Due to the large amount of real-time and non-real-time data interaction, the data interface service has a large number of visits and lacks The monitoring and dynamic scheduling of interface services cannot be dynamically and intelligently scheduled according to the task data, data transmission volume, interface operation status, and server hardware resource operation status of each interface service, which may easily cause the problem of occupying a large amount of system resources and blocking interface service tasks. , the interface processing efficiency is low, affecting the daily application of the system.

SUMMARY OF THE INVENTION

The purpose of the present invention is to overcome the deficiencies of the prior art, and the present invention provides an interface processing method and system based on a micro-service architecture, which realizes dynamic decomposition and scheduling processing of interface service tasks and improves interface processing efficiency.

In order to solve the above technical problems, an embodiment of the present invention provides an interface processing method based on a micro-service architecture, including an interface service request center, an interface service dynamic dispatch center, and an interface micro-service center, and the method includes:

Each business system submits an access interface microservice request to the interface service request center, and the interface service request center decomposes the access interface microservice request to obtain a service request queue;

The interface service dynamic scheduling center performs interface service monitoring and service request dynamic scheduling on the service request queue;

According to the device type requested by the access interface microservice, the interface microservice center deploys the microservice corresponding to the device type.

Optionally, each business system submits an access interface micro-service request to the interface service request center, and the interface service request center decomposes the access interface micro-service request, and obtaining a service request queue includes:

Each business system submits an access interface microservice request to the interface service request center according to the incremental business data situation generated by its own system;

According to the characteristics of the incremental data block size, frequency, or data type of the access interface microservice request, the interface service request center decomposes the access interface microservice request to obtain a service request queue;

The interface service request center transmits the service request queue to the interface service dynamic dispatch center.

Optionally, the interface service request center decomposes the access interface micro-service request, and obtaining the service request queue further includes: when the access interface micro-service request increments and the data block size exceeds the limit, according to the access interface micro-service request. According to the region to which the object requested by the interface microservice belongs, or the device type, or the data type, or the data transmission frequency, the interface service request center decomposes the access interface microservice request to obtain a service request queue.

Optionally, the interface service dynamic dispatching center performing interface service monitoring and service request dynamic dispatching on the service request queue includes: the interface service dynamic dispatching center obtains each current service node by monitoring the operation of the distributed interface service. It can quickly sense changes in system traffic and identify system bottlenecks, providing a basis for dynamic scheduling of service requests.

Optionally, the interface service monitoring includes: monitoring of service requests, monitoring of service resources, and monitoring of microservices.

Optionally, the interface service monitoring and dynamic scheduling of service requests performed by the interface service dynamic scheduling center on the service request queue further include:

According to the FIFO logical sequence, the interface service dynamic dispatch center allocates the access interface microservice request to each microservice interface, and obtains a service request subqueue;

According to the dynamic adjustment policy, the interface service dynamic dispatch center dynamically adjusts the service request sub-queues in the execution of each micro-service interface to obtain a new service request sub-queue.

Optionally, according to the FIFO logical sequence, the interface service dynamic dispatch center allocates the access interface micro-service request to each micro-service interface, and obtains the service request sub-queue including: According to the FIFO logical sequence, the interface service dynamic dispatch center allocates the access interface microservice request to each microservice interface, and obtains the service request subqueue.

Optionally, according to the dynamic adjustment policy, the interface service dynamic dispatch center dynamically adjusts the service request sub-queues in the execution of each micro-service interface, and obtaining a new service request sub-queue includes:

The interface dynamic dispatch center activates the current access interface microservice request, and processes the access interface microservice request according to the FIFO order;

After the processing of the access interface microservice request is completed, the request processing completion information and the interface service request invocation status report and exception report information are returned.

In addition, an embodiment of the present invention also provides an interface processing system based on a micro-service architecture, the system comprising:

Service request decomposition module: used by each business system to submit an access interface microservice request to the interface service request center, and the interface service request center decomposes the access interface microservice request to obtain a service request queue;

Service dynamic scheduling module: used for the interface service dynamic scheduling center to perform interface service monitoring and service request dynamic scheduling on the service request queue;

Microservice deployment module: configured to deploy the microservice corresponding to the device type by the interface microservice center according to the device type requested by the access interface microservice.

In the implementation of the present invention, based on the micro-service architecture, the interface service request is dynamically decomposed into several service request queues that can be processed in parallel, and the dynamic allocation of the service request queue is realized according to the dynamic scheduling strategy of the interface service request, and the automation, Serialized, accurate and faster response time interface data processing, improve the batch processing efficiency of interface data, enhance the flexibility of configuration, reduce the overhead of additional resources, and improve user experience.

Description of drawings

In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the following briefly introduces the accompanying drawings that need to be used in the description of the embodiments or the prior art. Obviously, the accompanying drawings in the following description are only These are some embodiments of the present invention, and for those of ordinary skill in the art, other drawings can also be obtained from these drawings without creative effort.

1 is a schematic flowchart of an interface processing method based on a microservice architecture in an embodiment of the present invention;

FIG. 2 is a schematic structural composition diagram of an interface processing system based on a microservice architecture in an embodiment of the present invention.

Detailed ways

The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the accompanying drawings in the embodiments of the present invention. Obviously, the described embodiments are only a part of the embodiments of the present invention, but not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by those of ordinary skill in the art without creative efforts shall fall within the protection scope of the present invention.

Example 1

Please refer to FIG. 1. FIG. 1 is a schematic flowchart of an interface processing method based on a microservice architecture in an embodiment of the present invention.

As shown in Figure 1, an interface processing method based on a microservice architecture includes an interface service request center, an interface service dynamic dispatch center, and an interface microservice center. The method includes:

S11: Each business system submits an access interface microservice request to the interface service request center, and the interface service request center decomposes the access interface microservice request to obtain a service request queue;

In the specific implementation process of the present invention, each business system submits an access interface microservice request to the interface service request center, and the interface service request center decomposes the access interface microservice request to obtain a service request queue including: Each business system submits an access interface microservice request to the interface service request center according to the incremental business data generated by its own system; according to the incremental data block size, or frequency, or data type requested by the access interface microservice. The interface service request center decomposes the access interface micro-service request to obtain a service request queue; the interface service request center transmits the service request queue to the interface service dynamic dispatch center. It should be noted that, when the access interface microservice request increments and the data block size exceeds the limit, according to the region to which the object requested by the access interface microservice belongs, or the device type, or the data type, or the data transmission frequency, the The interface service request center decomposes the access interface microservice request to obtain a service request queue.

Specifically, each business system 1-N applies to the interface service request center to access the interface micro-service according to the incremental business data generated by its own system. It adopts the dynamic decomposition method to dynamically decompose the interface service requests into service request queues, and sends the service request queues to the interface service dynamic dispatch center. It should be noted that the principle of service request decomposition is to divide the interface service request according to the data corresponding to the service request, according to different regions, different device types, different data types, different data transmission frequencies, etc., according to the acquired incremental business system data block size. Decomposed into service request queues; for example: when the incremental data block size of a service request exceeds the limit of 50,000 lines, the service request limit is 10,000 lines, which can be determined according to the region, device type, data type, and data transmission frequency to which the service request data object belongs. The service request is decomposed into several service requests such as ①, ②, ③, ... and so on, and a service request queue is formed.

S12: The interface service dynamic scheduling center performs interface service monitoring and service request dynamic scheduling on the service request queue;

In the specific implementation process of the present invention, the interface service dynamic dispatch center performs interface service monitoring on the service request queue and the service request dynamic dispatch includes: the interface service dynamic dispatch center obtains the operation status of the distributed interface service by monitoring the operation of the distributed interface service. The current resource application status of each service node, and quickly perceive system traffic changes and identify system bottlenecks, providing a basis for dynamic scheduling of service requests; wherein, the interface service monitoring includes: monitoring of service requests and monitoring of service resources , and monitoring of microservices.

Specifically, the monitoring of service requests: dynamically monitor the queue length of each type of service request in the interface service request center, the queue length of the sub-service request to be executed corresponding to each micro-service interface, and the execution status of each service request in the sub-queue, Including the number of each sub-service request to be executed, to obtain the current task volume of each micro-service interface; monitoring of service resources: dynamically monitor the application of server resources corresponding to each micro-service, including server network bandwidth, I/O , CPU, memory, cache execution; Microservice monitoring: Monitor the request volume, service average request time, error rate, throughput rate, etc. of each microservice, and obtain the execution performance indicators of the microservice.

In addition, the interface service dynamic scheduling center performing interface service monitoring and service request dynamic scheduling on the service request queue further includes: according to the FIFO logical order, the interface service dynamic scheduling center allocates the access interface microservice request to each microservice interface, and obtain the service request sub-queue; according to the dynamic adjustment strategy, the interface service dynamic dispatch center dynamically adjusts the service request sub-queue in the execution of each micro-service interface, and obtains a new service request sub-queue; In the implementation of the present invention, the entire service request processing time is compressed and the resource utilization efficiency is improved.

Optionally, according to the FIFO logical sequence, the interface service dynamic dispatch center allocates the access interface micro-service request to each micro-service interface, and obtains the service request sub-queue including: According to the FIFO logical sequence, the interface service dynamic dispatch center allocates the access interface microservice request to each microservice interface, and obtains the service request subqueue.

Specifically, the interface service request center forms a service request queue of ①, ②, ③, ... ⑩ according to the service request rules, and sends the interface service queue to the interface service dynamic dispatch center, which monitors, The situation of service resource monitoring and micro-service monitoring is allocated to each micro-service according to the FIFO logical order to form a new service sub-request queue; service request allocation mainly considers the comprehensive evaluation of service request monitoring, service resource monitoring, and micro-service monitoring; among them , the execution strategy of service request monitoring includes: the number of service requests to be executed in each service request subqueue, the execution status of each service request, and the parameters of the estimated execution time of each service request; the execution strategy of service resource monitoring includes: Execution of network bandwidth, server CUP, and memory; the execution strategy of microservice monitoring includes indicators of average waiting time and throughput for each service request.

Optionally, according to the dynamic adjustment policy, the interface service dynamic dispatch center dynamically adjusts the service request sub-queues in the execution of each micro-service interface, and obtaining a new service request sub-queue includes: the The interface dynamic dispatch center activates the current access interface microservice request, and processes the access interface microservice request according to the FIFO order; after processing the access interface microservice request, returns to the request processing completion information and Interface service request invocation report and exception report information.

Specifically, the interface service requests of each service request subqueue are processed according to the FIFO logical order, the current interface service request is activated first, and the subsequent interface service requests are activated after the current interface service request task is processed, and the processing of each interface service request is completed. Then return the request processing completion information and the interface service request invocation report and exception report information; when the waiting time of a sub-service request queue is too long or the service request invocation is abnormal, the interface service request is reassigned through the service request dynamic scheduling, and inserted into The new subqueue is processed.

It should be noted that when a sub-service request sub-queue is too long and the waiting time for interface service requests is too long, the efficiency of the interface service will be affected. According to the interface service monitoring, the comprehensive evaluation interface for service request monitoring, service resource monitoring, and microservice monitoring , assign the service requests that are not executed in the sub-service request sub-queue to other micro-service nodes for processing; for the abnormal call of the interface service request, the system suspends the interface service request, and executes the request according to the abnormal log information of the interface service request. Roll back the program, reallocate through dynamic scheduling of service requests.

S13: According to the device type requested by the access interface microservice, the interface microservice center deploys a microservice corresponding to the device type.

In the implementation of the present invention, based on the micro-service architecture, the interface service request is dynamically decomposed into several service request queues that can be processed in parallel, and the dynamic allocation of the service request queue is realized according to the dynamic scheduling strategy of the interface service request, and the automation, Serialized, accurate and faster response time interface data processing, improve the batch processing efficiency of interface data, enhance the flexibility of configuration, reduce the overhead of additional resources, and improve user experience.

Embodiment 2

Please refer to FIG. 2. FIG. 2 is a schematic structural composition diagram of an interface processing system based on a microservice architecture in an embodiment of the present invention.

As shown in Figure 2, an interface processing system based on a microservice architecture, the system includes:

Service request decomposition module 11: used by each business system to submit an access interface microservice request to the interface service request center, and the interface service request center decomposes the access interface microservice request to obtain a service request queue;

Service dynamic scheduling module 12: used for the interface service dynamic scheduling center to perform interface service monitoring and service request dynamic scheduling on the service request queue;

Micro-service deployment module 13: configured to deploy the micro-service corresponding to the device type by the interface micro-service center according to the device type requested by the access interface micro-service.

Specifically, for the working principle of the system-related functional modules in the embodiment of the present invention, reference may be made to the relevant description of the method embodiment 1, and details are not repeated here.

In the implementation of the present invention, based on the micro-service architecture, the interface service request is dynamically decomposed into several service request queues that can be processed in parallel, and the dynamic allocation of the service request queue is realized according to the dynamic scheduling strategy of the interface service request, and the automation, Serialized, accurate and faster response time interface data processing, improve the batch processing efficiency of interface data, enhance the flexibility of configuration, reduce the overhead of additional resources, and improve user experience.

Those of ordinary skill in the art can understand that all or part of the steps in the various methods of the above embodiments can be completed by instructing relevant hardware through a program, and the program can be stored in a computer-readable storage medium, and the storage medium can include: Read Only Memory (ROM, Read Only Memory), Random Access Memory (RAM, Random Access Memory), magnetic disk or optical disk, etc.

In addition, the above has described in detail an interface processing method and system based on a micro-service architecture provided by the embodiments of the present invention. In this paper, specific examples should be used to illustrate the principles and implementations of the present invention. The description is only used to help understand the method of the present invention and its core idea; at the same time, for those skilled in the art, according to the idea of the present invention, there will be changes in the specific implementation and application scope. , the contents of this specification should not be construed as limiting the invention.

Claims (9)

1. An interface processing method based on a microservice architecture, comprising an interface service request center, an interface service dynamic dispatch center and an interface microservice center, wherein the method comprises: Each business system submits an access interface microservice request to the interface service request center, and the interface service request center decomposes the access interface microservice request to obtain a service request queue; The interface service dynamic scheduling center performs interface service monitoring and service request dynamic scheduling on the service request queue; According to the device type requested by the access interface microservice, the interface microservice center deploys the microservice corresponding to the device type. 2. The interface processing method based on a micro-service architecture according to claim 1, wherein each business system submits a request to the interface service request center for accessing the interface micro-service, and the interface service request center has a The access interface microservice request is decomposed, and the service request queue is obtained including: Each business system submits an access interface microservice request to the interface service request center according to the incremental business data situation generated by its own system; According to the characteristics of the incremental data block size, frequency, or data type of the access interface microservice request, the interface service request center decomposes the access interface microservice request to obtain a service request queue; The interface service request center transmits the service request queue to the interface service dynamic dispatch center. 3. The interface processing method based on a microservice architecture according to claim 1, wherein, according to the characteristics of the incremental data block size, or frequency, or data type requested by the access interface microservice, the The interface service request center decomposes the access interface microservice request, and obtaining the service request queue further includes: when the access interface microservice request increments and the data block size exceeds the limit, according to the access interface microservice request object belongs to area, or device type, or data type, or data transmission frequency, the interface service request center decomposes the access interface micro-service request to obtain a service request queue. 4. The interface processing method based on a micro-service architecture according to claim 1, wherein the interface service monitoring and dynamic scheduling of service requests performed by the interface service dynamic dispatch center on the service request queue comprises: the interface service By monitoring the operation of distributed interface services, the dynamic dispatch center obtains the current resource application status of each service node, and quickly senses system traffic changes and finds system bottlenecks, providing a basis for dynamic scheduling of service requests. 5 . The interface processing method based on a microservice architecture according to claim 4 , wherein the interface service monitoring comprises: monitoring service requests, monitoring service resources, and monitoring microservices. 6 . 6. The interface processing method based on micro-service architecture according to claim 1, wherein the interface service monitoring and dynamic scheduling of service requests performed by the interface service dynamic dispatch center on the service request queue further comprises: According to the FIFO logical sequence, the interface service dynamic dispatch center allocates the access interface microservice request to each microservice interface, and obtains a service request subqueue; According to the dynamic adjustment policy, the interface service dynamic dispatch center dynamically adjusts the service request sub-queues in the execution of each micro-service interface to obtain a new service request sub-queue. 7. The interface processing method based on a microservice architecture according to claim 6, wherein, according to the FIFO logic sequence, the interface service dynamic dispatch center allocates the access interface microservice request to each microservice interface, and Obtaining the service request sub-queue includes: based on the monitoring of service requests, the monitoring of service resources, and the monitoring of micro-services, according to the FIFO logical sequence, the interface service dynamic dispatch center allocates the access interface micro-service request to each micro-service. Service interface, and get service request subqueue. 8 . The interface processing method based on a micro-service architecture according to claim 6 , wherein, according to the dynamic adjustment policy, the interface service dynamic dispatch center performs the service requests in the execution of the respective micro-service interfaces. 9 . The subqueues are dynamically adjusted to obtain new service request subqueues including: The interface dynamic dispatch center activates the current access interface microservice request, and processes the access interface microservice request according to the FIFO order; After the processing of the access interface microservice request is completed, the request processing completion information and the interface service request invocation status report and exception report information are returned. 9. An interface processing system based on a microservice architecture, wherein the system comprises: Service request decomposition module: used by each business system to submit an access interface microservice request to the interface service request center, and the interface service request center decomposes the access interface microservice request to obtain a service request queue; Service dynamic scheduling module: used for the interface service dynamic scheduling center to perform interface service monitoring and service request dynamic scheduling on the service request queue; Microservice deployment module: configured to deploy the microservice corresponding to the device type by the interface microservice center according to the device type requested by the access interface microservice.

Images