WO2021258753A1

WO2021258753A1 - Service processing method and apparatus, and electronic device and storage medium

Info

Publication number: WO2021258753A1
Application number: PCT/CN2021/077022
Authority: WO
Inventors: 朱文龙
Original assignee: 广东浪潮智慧计算技术有限公司
Priority date: 2020-06-24
Filing date: 2021-02-20
Publication date: 2021-12-30
Also published as: CN111770157B; CN111770157A

Abstract

A service processing method and apparatus, and a device and a medium. The method comprises: receiving a web service request issued by a client; selecting a first target long connection in an idle state from a first-type connection pool that stores pre-established long connections for performing reception; using the first target long connection to send the web service request to a corresponding functional module for processing to obtain a processing result corresponding to the web service request; and selecting a second target long connection in an idle state from a second-type connection pool that stores pre-established long connections for performing sending, and returning the processing result to the client by means of the second target long connection. By means of the present application, there is no need for all modules to maintain a long connection with a node, thereby reducing the number of long connections of the node. After obtaining a processing result of each module, the processing result can be sent by means of a pre-established long connection in a second-type connection pool, thereby avoiding resource overheads required for continuously creating and destroying temporary connections, and reducing the connection creation time.

Description

Business processing method, device, electronic equipment and storage medium

This application claims the priority of a Chinese patent application filed with the Chinese Patent Office, the application number is 202010591007.0, and the invention title is "a business processing method, device, electronic equipment and storage medium" on June 24, 2020. The entire content of the application is approved The reference is incorporated in this application.

Technical field

This application relates to the field of computer technology, and more specifically, to a business processing method and device, an electronic device, and a computer-readable storage medium.

Background technique

In the architecture of traditional storage management software, different functional modules are split according to different back-end functions. As shown in Figure 1 and Figure 2, each module of all nodes in the cluster is connected to a single Rabbitmq (Rabbit Message Queue, Rabbit A program-to-program communication method developed by the company) A message service of the service node maintains a long connection. However, with the exception of modules that need to be executed periodically to collect information, such as performance and caching, other business modules are basically in an inactive state. When there is no request command, the module connection is in an empty running state, which wastes connection resources. At the same time, after each module processes the request, they temporarily apply to create a new connection to send the processing result. Each time a processing request is received, a new connection is created. The resource overhead is large. When the number of nodes and modules is large, it will cause a single Rabbitmq service node. a lot of pressure.

Therefore, how to solve the above-mentioned problems is what those skilled in the art need to focus on.

Summary of the invention

The purpose of this application is to provide a service processing method and device, an electronic device, and a computer-readable storage medium, which reduces the pressure on a single Rabbitmq node, reduces the connection creation time, and improves the message flow speed.

In order to achieve the above objective, this application provides a service processing method, including:

Receive web (network) service requests issued by the client;

Select a first target persistent connection in an idle state from the first type of connection pool, where the first type of connection pool stores a pre-established persistent connection for receiving;

Using the first target long connection to send the web service request to a corresponding function module for processing, and obtain a processing result corresponding to the web service request;

Select the idle second target persistent connection from the second type of connection pool, and return the processing result to the client through the second target persistent connection. The second type of connection pool stores pre-established connections. Long connection for sending.

Optionally, the using the first target persistent connection to send the web service request to a corresponding functional module for processing includes:

Parse the web service request to obtain the request operation code contained therein;

Determining a functional module for processing the web service request according to the request operation code;

The web service request is sent to the functional module through the first target persistent connection, so that the functional module can process the web service request.

Optionally, it also includes:

Performing state monitoring on the long connections in the first type connection pool and the second type connection pool;

If any long connection is detected to be disconnected, the disconnected long connection is reconnected.

Optionally, after the monitoring the status of the long connections in the first-type connection pool and the second-type connection pool, the method further includes:

If any long connection is detected to be disconnected, the corresponding disconnection times will be counted for the disconnected long connection;

When it is detected that the number of disconnections corresponding to any long connection is greater than the first preset threshold, the reconnection operation on the current long connection is prohibited within the preset time period.

Optionally, it also includes:

Through statistics of historical business processing data, a time curve that characterizes changes in business processing pressure is generated;

Based on the current number and maximum threshold of the long connections stored in the first type connection pool and the second type connection pool, add or release the long connections in the connection pool at a preset time node in combination with the time curve .

Optionally, the adding or releasing a long connection in the connection pool at a preset time node in combination with the time curve includes:

If it is determined according to the time curve that the service processing pressure of the preset time node is less than the second preset threshold, obtain the number of disconnections and the sending success rate corresponding to each long connection in the connection pool;

Combining the number of disconnections and the sending success rate, determine a third target persistent connection, and perform a release operation on the third target persistent connection.

Real-time monitoring of the number of business requests to be processed to obtain actual pressure data;

The long connection in the connection pool is added or released at a preset time node in combination with the time curve and the actual pressure data.

To achieve the above objective, this application provides a service processing device, including:

The request receiving module is used to receive web service requests issued by the client;

The first selection module is configured to select a first target persistent connection in an idle state from a first type of connection pool, and the first type of connection pool stores a pre-established persistent connection for receiving;

A request sending module, configured to use the first target persistent connection to send the web service request to a corresponding functional module for processing, and obtain a processing result corresponding to the web service request;

The second selection module is configured to select a second target persistent connection in an idle state from the second type of connection pool, and return the processing result to the client through the second target persistent connection, the second type of connection Pre-established long connections for sending are stored in the pool.

In order to achieve the above objective, this application provides an electronic device, including:

Memory, used to store computer programs;

The processor is used to implement the steps of any service processing method disclosed above when executing the computer program.

In order to achieve the above objective, this application provides a computer-readable storage medium with a computer program stored on the computer-readable storage medium. step.

It can be seen from the above solution that a service processing method provided by this application includes: receiving a web service request issued by a client; Pre-established persistent connections for receiving are stored in the pool; using the first target persistent connection, the web service request is sent to the corresponding functional module for processing, and the processing result corresponding to the web service request is obtained; Select the idle second target persistent connection from the second type of connection pool, and return the processing result to the client through the second target persistent connection. The second type of connection pool stores pre-established connections. Long connection for sending. It can be seen from the above that the first type of connection pool in this application saves pre-established long connections for unified reception of service requests, without requiring each module to maintain a long connection with a single Rabbitmq node, thereby reducing the long connection of a single Rabbitmq node. quantity. At the same time, after the results of each module are processed, they can be sent through the long connections established in the second type of connection pool, which avoids the resource overhead of constantly creating and destroying temporary connections, reduces the connection creation time, and improves the message flow speed.

The application also discloses a service processing device, an electronic device, and a computer-readable storage medium, which can also achieve the above technical effects.

It should be understood that the above general description and the following detailed description are only exemplary and cannot limit the application.

Description of the drawings

In order to more clearly describe the technical solutions in the embodiments of the present application or the prior art, the following will briefly introduce the drawings that need to be used in the description of the embodiments or the prior art. Obviously, the drawings in the following description are only These are some embodiments of the present application. For those of ordinary skill in the art, other drawings can be obtained based on these drawings without creative work.

Figure 1 is a schematic diagram of a message processing flow in related technologies;

Figure 2 is a schematic diagram of a single node service establishing a long connection with each module in the related technology;

FIG. 3 is a flowchart of a service processing method disclosed in an embodiment of the application;

FIG. 4 is a schematic diagram of the architecture of the service processing method disclosed in an embodiment of the application;

FIG. 5 is a flowchart of another service processing method disclosed in an embodiment of the application;

Fig. 6 is a structural diagram of a service processing device disclosed in an embodiment of the application;

FIG. 7 is a structural diagram of an electronic device disclosed in an embodiment of the application;

FIG. 8 is a structural diagram of another electronic device disclosed in an embodiment of the application.

detailed description

The technical solutions in the embodiments of the present application will be described clearly and completely in conjunction with the accompanying drawings in the embodiments of the present application. Obviously, the described embodiments are only a part of the embodiments of the present application, rather than all the embodiments. Based on the embodiments in this application, all other embodiments obtained by a person of ordinary skill in the art without creative work shall fall within the protection scope of this application.

In the prior art, each module of all nodes in the cluster maintains a long connection with a message service of a single rabbitmq service node, which wastes connection resources. At the same time, each module creates a new connection every time it receives a processing request, and the resource overhead is large. When the number of nodes and modules is large, it will cause a lot of pressure on a single Rabbitmq service node.

Therefore, the embodiment of the present application discloses a service processing method, which reduces the pressure on a single Rabbitmq service node, reduces the connection creation time, and improves the message flow speed.

Referring to FIG. 3 and FIG. 4, a service processing method disclosed in an embodiment of the present application includes:

S101: Receive a web service request issued by a client;

In the embodiment of the present application, a web service request issued by a client through a command-line interface (command-line interface) or a front-end page can be received. Specifically, web service requests may include, but are not limited to, requests such as data query, modification, and deletion.

S102: Select a first target persistent connection in an idle state from the first type of connection pool, where a pre-established persistent connection for receiving is stored in the first type of connection pool;

In this step, the first target persistent connection whose status is idle can be selected from the first type of connection pool, so as to use the persistent connection to send the request to the corresponding functional module. Among them, the first type of connection pool is used to maintain consumer long-term connections, which saves pre-established long-term connections for receiving, and is responsible for managing, storing, and releasing long-term connections. During initialization, a certain number of persistent connections are created in the first type of connection pool. The number of creations can be determined according to the preset minimum number of connections to ensure that there are at least the minimum number of persistent connections in the connection pool.

S103: Use the first target long connection to send the web service request to a corresponding function module for processing, and obtain a processing result corresponding to the web service request;

In a specific implementation, the first target persistent connection selected above can be used to send the web service request to the corresponding functional module for processing. It is understandable that this embodiment can parse the web service request to obtain the request operation code contained therein, and then determine the functional module used to process the web service request according to the current request operation code, and then pass the first target The long connection sends the web service request to the determined functional module so that the functional module can process the current web service request.

S104: Select an idle second target persistent connection from the second type of connection pool, and return the processing result to the client through the second target persistent connection. Established long connection for sending.

After the processing result corresponding to the current web service request is obtained by the functional module processing, the idle second target persistent connection can be selected from the second type of connection pool, and the processing result can be sent to the client through the second target persistent connection. Among them, the second type of connection pool stores pre-established long connections for sending, and is responsible for managing, storing, and releasing long connections. Similarly, long connections that are greater than or equal to the minimum number of connections can be created during initialization and stored in the second type of connection pool.

As a preferred implementation manner, the embodiment of the present application can also perform state monitoring on the long connections maintained in the first type connection pool and the second type connection pool at a fixed time or in real time. If any long connection is detected to be disconnected, the disconnected long connection is reconnected.

Further, if it is detected that any long connection is disconnected, the embodiment of the present application can count the number of disconnections corresponding to the connection for the disconnected long connection. If it is detected that the number of disconnections corresponding to any long connection is greater than the first preset threshold, it indicates that the connection is unstable and the performance is poor. The reconnection operation of the current long connection can be prohibited within the preset time period to avoid poor stability The resource waste caused by repeated reconnections of long connections.

The embodiment of the present application discloses another service processing method. Compared with the previous embodiment, this embodiment further illustrates and optimizes the technical solution. As shown in Figure 5, specific:

S201: Receive a web service request issued by a client;

S202: Select a first target persistent connection in an idle state from the first type of connection pool, where a pre-established persistent connection for receiving is stored in the first type of connection pool;

S203: Use the first target persistent connection to send the web service request to a corresponding functional module for processing, and obtain a processing result corresponding to the web service request;

S204: Select an idle second target persistent connection from the second type of connection pool, and return the processing result to the client through the second target persistent connection. Long connection established for sending;

S205: Generate a time curve that characterizes changes in business processing pressure by collecting statistics on historical business processing data;

In the embodiments of this application, as a preferred implementation manner, the connections in the connection pool can be adaptively adjusted according to actual business processing conditions. For example, the number of long connections can be added when the business processing pressure is high to reduce business Processing response time, reducing the number of long connections when the business processing pressure is small, and reducing resource consumption. Thus, the embodiment of the present application can collect historical business processing data, and generate a time curve that characterizes changes in business processing pressure by performing statistics on the historical data.

S206: Based on the current number and maximum threshold of persistent connections stored in the first type of connection pool and the second type of connection pool, add or add to the persistent connections in the connection pool at a preset time node in combination with the time curve Release operation.

It is understandable that after generating a time curve that characterizes changes in business processing pressure, a rough business processing pressure change rule can be learned based on the time curve, and the business processing pressure that may correspond to each time period or time node can be determined. Furthermore, based on the number of connections currently saved in the connection pool and the maximum threshold, the operation of adding or releasing long connections can be performed at a preset time node.

In a specific embodiment, the process of adding or releasing the long connections in the connection pool at the preset time node in combination with the time curve may specifically include: if it is determined according to the time curve that the service processing pressure of the preset time node is less than The second preset threshold is used to obtain the number of times of disconnection and the sending success rate corresponding to each long connection in the connection pool. Combining the number of times of disconnection and the transmission success rate of each persistent connection, the third target persistent connection is determined, and the third target persistent connection is released. That is, the embodiment of the present application can determine the time node with less business processing pressure according to the time curve. For example, the time node where the business processing pressure is less than the second preset threshold can be determined as the preset time node, and when the time node is reached Perform the connection release operation. When releasing a long connection, a long connection with a larger number of disconnections and/or a lower transmission success rate can be selected among all the long connections for release. The above-mentioned second preset threshold may be set according to specific conditions in actual implementation, and is not specifically limited here.

As a preferred situation, in addition to the time curve obtained based on historical data, the embodiment of the present application can also perform real-time monitoring of the number of service requests to be processed to obtain actual pressure data, which can then be combined with the time curve and actual pressure data at a preset time. The node adds or releases the long connection in the connection pool to avoid the adjustment of the long connection according to the original situation when the time curve is only used as the basis for adjustment. The impact of processing or resource overhead ensures the accuracy of long-term connection maintenance.

In a specific implementation, the above-mentioned process of adding or releasing long connections in the connection pool at a preset time node in combination with the time curve and actual pressure data may include: obtaining real-time monitored actual pressure data, and calculating the next time node The difference between the actual pressure data and the corresponding historical pressure data in the time curve is used to determine whether the difference is within the preset variation range. If it is, the actual pressure data is basically in line with the law of the time curve, and the long connection can be adjusted according to the adjustment strategy corresponding to the original time curve without modifying it; if not, the actual pressure data is different from the law of the time curve. Therefore, it is necessary to determine whether the next time node needs to perform the operation of adding a long connection or releasing the operation of the long connection according to the actual pressure data detected in real time.

The following describes a service processing device provided by an embodiment of the present application. The service processing device described below and the service processing method described above can be cross-referenced.

As shown in FIG. 6, a service processing apparatus provided by an embodiment of the present application includes:

The request receiving module 301 is used to receive web service requests issued by the client;

The first selection module 302 is configured to select a first target persistent connection in an idle state from a first type of connection pool, and the first type of connection pool stores a pre-established persistent connection for receiving;

The request sending module 303 is configured to use the first target persistent connection to send the web service request to a corresponding functional module for processing, and obtain a processing result corresponding to the web service request;

The second selection module 304 is configured to select a second target persistent connection in an idle state from the second type of connection pool, and return the processing result to the client through the second target persistent connection, the second type Pre-established long connections for sending are stored in the connection pool.

For the specific implementation process of the foregoing modules 301 to 304, reference may be made to the corresponding content disclosed in the foregoing embodiments, and details are not described herein again.

This application also provides an electronic device. As shown in FIG. 7, an electronic device provided by an embodiment of the application includes:

The memory 100 is used to store computer programs;

The processor 200 is configured to implement the steps provided in the foregoing embodiments when executing the computer program.

Specifically, the memory 100 includes a non-volatile storage medium and an internal memory. The non-volatile storage medium stores an operating system and computer-readable instructions, and the internal memory provides an environment for running the operating system and the computer-readable instructions in the non-volatile storage medium. In some embodiments, the processor 200 may be a central processing unit (CPU), controller, microcontroller, microprocessor, or other data processing chip, which provides computing and control capabilities for electronic devices, and executes the The computer program stored in the memory 100 can implement the steps of the service processing method disclosed in any of the foregoing embodiments.

On the basis of the foregoing embodiment, as a preferred implementation manner, referring to FIG. 8, the electronic device further includes:

The input interface 300 is connected to the processor 200 and is used to obtain externally imported computer programs, parameters and instructions, and store them in the memory 100 under the control of the processor 200. The input interface 300 can be connected to an input device to receive parameters or instructions manually input by the user. The input device may be a touch layer covered on the display screen, a button, a trackball, or a touch pad provided on the terminal housing, or a keyboard, a touch pad, or a mouse.

The display unit 400 is connected to the processor 200 and is used for displaying data processed by the processor 200 and for displaying a visualized user interface. The display unit 400 may be an LED display, a liquid crystal display, a touch liquid crystal display, an OLED (Organic Light-Emitting Diode, organic light-emitting diode) touch device, etc.

The network port 500 is connected to the processor 200 and is used to communicate with external terminal devices. The communication technology used in the communication connection can be wired communication technology or wireless communication technology, such as mobile high-definition link technology (MHL), universal serial bus (USB), high-definition multimedia interface (HDMI), wireless fidelity technology (WiFi), Bluetooth communication technology, low-power Bluetooth communication technology, communication technology based on IEEE802.11s, etc.

FIG. 8 only shows an electronic device with components 100-500. Those skilled in the art can understand that the structure shown in FIG. 8 does not constitute a limitation on the electronic device, and may include fewer or more components than shown in the figure. Components, or combinations of certain components, or different component arrangements.

This application also provides a computer-readable storage medium, which may include: U disk, mobile hard disk, read-only memory (Read-Only Memory, ROM), random access memory (Random Access Memory, RAM), magnetic Various media that can store program codes such as discs or optical discs. A computer program is stored on the storage medium, and when the computer program is executed by a processor, the steps of the service processing method disclosed in any of the foregoing embodiments are implemented.

The first type of connection pool in this application saves pre-established long connections for uniformly receiving service requests, without requiring each module to maintain a long connection with a single Rabbitmq node, thereby reducing the number of long connections for a single Rabbitmq node. At the same time, after the results of each module are processed, they can be sent through the long connections established in the second type of connection pool, which avoids the resource overhead of constantly creating and destroying temporary connections, reduces the connection creation time, and improves the message flow speed.

The various embodiments in the specification are described in a progressive manner, and each embodiment focuses on the differences from other embodiments, and the same or similar parts between the various embodiments can be referred to each other. For the system disclosed in the embodiment, since it corresponds to the method disclosed in the embodiment, the description is relatively simple, and the relevant part can be referred to the description of the method part. It should be pointed out that for those of ordinary skill in the art, without departing from the principles of this application, several improvements and modifications can be made to this application, and these improvements and modifications also fall within the protection scope of the claims of this application.

It should also be noted that in this specification, relational terms such as first and second are only used to distinguish one entity or operation from another entity or operation, and do not necessarily require or imply these entities or operations. There is any such actual relationship or sequence between operations. Moreover, the terms "including", "including" or any other variants thereof are intended to cover non-exclusive inclusion, so that a process, method, article, or device that includes a series of elements includes not only those elements, but also those that are not explicitly listed Other elements of, or also include elements inherent to this process, method, article or equipment. If there are no more restrictions, the element defined by the sentence "including a..." does not exclude the existence of other identical elements in the process, method, article, or equipment that includes the element.

Claims

A business processing method, characterized in that it comprises:

Receive web service requests issued by the client;

Select a first target persistent connection in an idle state from the first type of connection pool, where the first type of connection pool stores a pre-established persistent connection for receiving;

Using the first target long connection to send the web service request to a corresponding function module for processing, and obtain a processing result corresponding to the web service request;

Select the idle second target persistent connection from the second type of connection pool, and return the processing result to the client through the second target persistent connection. The second type of connection pool stores pre-established connections. Long connection for sending.
The service processing method according to claim 1, wherein the using the first target long connection to send the web service request to a corresponding functional module for processing includes:

Parse the web service request to obtain the request operation code contained therein;

Determining a functional module for processing the web service request according to the request operation code;

The web service request is sent to the functional module through the first target persistent connection, so that the functional module can process the web service request.
The service processing method according to claim 1, further comprising:

Performing state monitoring on the long connections in the first type connection pool and the second type connection pool;

If any long connection is detected to be disconnected, the disconnected long connection is reconnected.
The service processing method according to claim 3, wherein after the monitoring the status of the long connections in the first type connection pool and the second type connection pool, the method further comprises:

If any long connection is detected to be disconnected, the corresponding disconnection times will be counted for the disconnected long connection;

When it is detected that the number of disconnections corresponding to any long connection is greater than the first preset threshold, the reconnection operation on the current long connection is prohibited within the preset time period.
The service processing method according to any one of claims 1 to 4, further comprising:

Through statistics of historical business processing data, a time curve that characterizes changes in business processing pressure is generated;

Based on the current number and maximum threshold of the long connections stored in the first type connection pool and the second type connection pool, add or release the long connections in the connection pool at a preset time node in combination with the time curve .
The service processing method according to claim 5, wherein the adding or releasing the long connection in the connection pool at a preset time node in combination with the time curve comprises:

If it is determined according to the time curve that the service processing pressure of the preset time node is less than the second preset threshold, obtain the number of disconnections and the sending success rate corresponding to each long connection in the connection pool;

Combining the number of disconnections and the sending success rate, determine a third target persistent connection, and perform a release operation on the third target persistent connection.
The service processing method according to claim 5, wherein the adding or releasing the long connection in the connection pool at a preset time node in combination with the time curve comprises:

Real-time monitoring of the number of business requests to be processed to obtain actual pressure data;

The long connection in the connection pool is added or released at a preset time node in combination with the time curve and the actual pressure data.
A service processing device, characterized in that it comprises:

The request receiving module is used to receive web service requests issued by the client;

The first selection module is configured to select a first target persistent connection in an idle state from a first type of connection pool, and the first type of connection pool stores a pre-established persistent connection for receiving;

A request sending module, configured to use the first target persistent connection to send the web service request to a corresponding functional module for processing, and obtain a processing result corresponding to the web service request;

The second selection module is configured to select a second target persistent connection in an idle state from the second type of connection pool, and return the processing result to the client through the second target persistent connection, the second type of connection Pre-established long connections for sending are stored in the pool.
An electronic device, characterized in that it comprises:

Memory, used to store computer programs;

The processor is configured to implement the steps of the service processing method according to any one of claims 1 to 7 when the computer program is executed.
A computer-readable storage medium, characterized in that a computer program is stored on the computer-readable storage medium, and when the computer program is executed by a processor, it realizes the service processing method according to any one of claims 1 to 7 step.