CN112732952A

CN112732952A - Monitoring method and related device for functional module in distributed recommendation system

Info

Publication number: CN112732952A
Application number: CN201911034565.0A
Authority: CN
Inventors: 卓达城
Original assignee: Tencent Technology Shenzhen Co Ltd
Current assignee: Tencent Technology Shenzhen Co Ltd
Priority date: 2019-10-28
Filing date: 2019-10-28
Publication date: 2021-04-30
Anticipated expiration: 2039-10-28
Also published as: CN112732952B

Abstract

The embodiment of the present application discloses a monitoring method and a related device for a functional module in a distributed recommendation system. The method includes: simulating a failure of a first logical interface in a first functional module in a first recommendation system in a sandbox; Input a first request to the first recommendation system, determine the importance of the first functional module according to the first detailed information returned by the first recommendation system in response to the first request, and send the first request to the first server The information on the importance of the first functional module can improve the stability of the recommendation system by adopting the embodiments of the present application.

Description

Monitoring method and related device for functional module in distributed recommendation system

Technical Field

The present application relates to the field of computer technologies, and in particular, to a method and a related apparatus for monitoring a function module in a distributed recommendation system.

Background

The recommendation system recommends information such as articles and videos related to the user according to the attributes and habits of the user. For example, a user often watches videos of food categories, and the recommendation system recommends videos related to food for the user according to the video information often watched by the user and the user habit information. Or, a user often watches the articles and books with the lingering love, and the recommendation system can recommend the articles and books with the lingering love for the user according to the author information and the user habit information of the articles and books read by the user. Generally, a recommendation system includes a plurality of functional modules, such as a video recommendation module and an article recommendation module, however, when a fault occurs in one of the functional modules, the recommendation system may not be normally used, so that the stability of the recommendation system is poor, and how to improve the stability of the recommendation system is a problem that those skilled in the art are studying.

Disclosure of Invention

The embodiment of the application discloses a monitoring method and a related device for a functional module in a distributed recommendation system, which can improve the stability of the recommendation system.

In a first aspect, an embodiment of the present application provides a method for monitoring a function module in a distributed recommendation system, including:

simulating a first logic interface in a first functional module in a first recommendation system in the sandbox to be failed; the first functional module is used for realizing one or more functions of the first recommendation system, and the first logic interface is an interface which needs to be called when the first functional module realizes one or more functions of the first recommendation system;

inputting a first request to the first recommendation system, wherein the first request is used for requesting the first recommendation system to realize a first function, and the first function is one of the one or more functions;

determining the importance degree of the first function module according to first detailed information returned by the first recommendation system in response to the first request, wherein the first detailed information is used for describing the condition that the first recommendation system realizes the first function when the first logic interface fails;

and sending the information of the importance degree of the first function module to a first server so as to be used for monitoring the first function module in a second recommendation system running on the line by the first server according to the importance degree of the first function module, wherein the first recommendation system is a test version of the second recommendation system.

By adopting the method, the importance degrees of all the function modules in the first recommendation system can be tested in advance on line, then the importance degrees of all the modules are sent to the first server, the first server monitors all the function modules in the second recommendation system running on line according to the importance degrees of all the function modules, if one of the function modules is an important module, the first server monitors the function module in a key mode, and through the key monitoring mode, the important function modules can be ensured not to fail, the situation that the important function modules fail to cause the unavailability of the whole recommendation system is avoided, and therefore the stability of the whole recommendation system is improved.

In an alternative of the first aspect, determining the importance level of the first function module according to the first detailed information returned by the first recommendation system in response to the first request includes:

comparing the first detailed information with second detailed information, wherein the second detailed information is a condition that the first recommendation system responds to the first request to return to realize the first function when a first logic interface in the first function module in the first recommendation system does not have a fault;

if the difference value between the second process quantity and the first process quantity is larger than a preset threshold value, determining that the first function module belongs to a predefined important function module; the first process number is the number of processes completed in the process of realizing the first function indicated by the first detailed information, and the second process number is the number of processes completed in the process of realizing the first function indicated by the second detailed information.

In yet another alternative of the first aspect, determining the importance level of the first function module according to the first detailed information returned by the first recommendation system in response to the first request includes: and if the first detailed information indicates that the condition that the first recommendation system realizes the first function when the first logic interface fails is a first preset condition, determining that the first function module belongs to a predefined important function module.

In yet another alternative of the first aspect, the inputting a first request to the first recommendation system includes: and directing the input first request to the first recommendation system in the sandbox in a routing mode.

In yet another alternative of the first aspect, after determining the importance level of the first function module according to the first detailed information returned by the first recommendation system in response to the first request, the method further includes: and outputting the information of the first functional module in the first recommendation system, the information of the first logic interface, the first detailed information and the severity information.

In the method, by outputting the information of the functional module, the information of the logic interface, the first detailed information and the severity information, a developer can obtain the information more intuitively, and the first recommendation model is optimized and debugged according to the information.

In yet another alternative of the first aspect, before a failure of the first logical interface in the first functional module in the sandbox simulating the first recommendation system, the method further comprises:

generating a topological graph of each logic interface in the first recommendation system, wherein the topological graph is used for describing the mutual calling relationship among the logic interfaces in the first recommendation system;

the simulating a failure of a first logical interface in a first functional module in a first recommendation system in a sandbox comprises: simulating a first logic interface in a first functional module in a first recommendation system in the sandbox according to the topological graph, wherein the first logic interface is any one logic interface in the topological graph.

In the method, the topological graph of each logic interface of the whole recommendation system is generated, and the logic interfaces are simulated to have faults in sequence according to the topological graph, so that the situation that the same logic interface is repeatedly simulated to have faults or a certain logic interface is not simulated to have faults can be avoided, the time consumption is obviously reduced, and the operation cost is saved.

In yet another alternative of the first aspect, the generating a topological graph of the respective logical interfaces in the first recommendation system includes:

generating a plurality of requests, wherein each request in the plurality of requests is a request which is added with a request identity identification ID in a sampling mode through a Software Development Kit (SDK);

inputting a plurality of requests to the first recommendation system; each request in the plurality of requests is used for requesting the first recommendation system to realize one function in the one or more functions, wherein different requests in the plurality of requests are used for requesting the realized functions to be different;

when the collected request ID reaches a preset threshold value, a topology generating system generates a topology map of each function module in the first recommendation system according to a plurality of function modules and a plurality of logic interfaces in the first recommendation system, wherein any one of the plurality of modules is a function module responding to any one of the plurality of requests, the any one module is used for responding to the received request when the request ID exists in the received request, and reporting the request ID to the topology generating system, and any one of the plurality of logic interfaces is a logic interface responding to any one of the plurality of requests.

In a second aspect, an embodiment of the present application provides a method for monitoring a function module in a distributed recommendation system, including:

receiving information of the importance degree of a first functional module in a second recommendation system, which is sent by a second server;

if the first function module in the second recommendation system belongs to a predefined important function module, monitoring the running state of the first function module in the second recommendation system according to a first frequency;

and if the first function module in the second recommendation system does not belong to the predefined important function module, monitoring the running state of the first function module in the second recommendation system according to a second frequency, wherein the first frequency is greater than the second frequency.

By adopting the method, the first server monitors each function module in the second recommendation system running on the line according to the importance degree of each function module, if a certain function module is an important module, the first server monitors the function module in a key way, and by the key monitoring mode, the important function module can be ensured not to be out of order, the situation that the whole recommendation system is unavailable due to the failure of the important function module is avoided, and the stability of the whole recommendation system is improved.

In a third aspect, an embodiment of the present application provides a server, where the server includes a processor, a memory, and a communication interface, where the memory is used to store a computer program, and the processor calls the computer program to perform the following operations:

simulating a first logic interface in a first functional module in a first recommendation system in the sandbox to be failed; the first functional module is used for realizing one or more functions of the first recommendation system, and the first logic interface is an interface which needs to be called when the first functional module realizes the one or more functions of the first recommendation system;

and sending the information of the importance degree of the first function module to a first server through the communication interface so as to be used for monitoring the first function module in a second recommendation system running on the line by the first server according to the importance degree of the first function module, wherein the first recommendation system is a test version of the second recommendation system.

In the server, the importance degrees of all the function modules in the first recommendation system can be tested in advance on line, then the importance degrees of all the modules are sent to the first server, the first server monitors all the function modules in the second recommendation system running on line according to the importance degrees of all the function modules, if one of the function modules is an important module, the first server monitors the function module in a key mode, through the key monitoring mode, the important function modules can be ensured not to fail, the situation that the important function modules fail to cause the unavailability of the whole recommendation system is avoided, and therefore the stability of the whole recommendation system is improved.

In an alternative of the third aspect, the processor is configured to determine, according to the first detailed information returned by the first recommendation system in response to the first request, the importance degree of the first function module, specifically:

In yet another alternative of the third aspect, the processor is configured to determine, according to the first detailed information returned by the first recommendation system in response to the first request, the importance degree of the first function module, specifically:

and if the first detailed information indicates that the condition that the first recommendation system realizes the first function when the first logic interface fails is a first preset condition, determining that the first function module belongs to a predefined important function module.

In yet another alternative of the third aspect, the inputting a first request to the first recommendation system specifically includes: and directing the input first request to the first recommendation system in the sandbox in a routing mode.

In yet another alternative of the third aspect, the processor is further configured to output the information of the first functional module in the first recommendation system, the information of the first logical interface, the first detailed information, and the information of the severity after determining the importance of the first functional module according to the first detailed information returned by the first recommendation system in response to the first request.

In the server, by outputting the information of the functional module, the information of the logic interface, the first detailed information and the information of the severity, a developer can obtain the information more intuitively, and the first recommendation model is optimized and debugged according to the information.

In yet another alternative of the third aspect, the processor is further configured to:

before a first logic interface in a first functional module simulating a first recommendation system in a sandbox fails, generating a topological graph of each logic interface in the first recommendation system, wherein the topological graph is used for describing a mutual calling relationship among the logic interfaces in the first recommendation system;

simulating in a sandbox a failure of a first logical interface in a first functional module in a first recommendation system, comprising: simulating a first logic interface in a first functional module in a first recommendation system in the sandbox according to the topological graph, wherein the first logic interface is any one logic interface in the topological graph.

In the server, the topological graph of each logic interface of the whole recommendation system is generated, and the logic interfaces are simulated to have faults in sequence according to the topological graph, so that the situation that the same logic interface is repeatedly simulated to have faults or a certain logic interface is not simulated to have faults can be avoided, the time consumption is obviously reduced, and the operation cost is saved.

In yet another alternative of the third aspect, generating a topological graph of each logical interface in the first recommendation system specifically includes:

In a fourth aspect, an embodiment of the present application provides a server, including a processor, a memory and a communication interface, where the memory is used to store a computer program, and the processor calls the computer program to perform the following operations:

receiving information of the importance degree of the first function module in the second recommendation system, which is sent by the second server, through the communication interface;

In the server, the first server monitors each function module in the second recommendation system running on the line according to the importance degree of each function module, if a certain function module is an important module, the first server monitors the function module in a focused manner, and by the focused monitoring manner, the important function module can be ensured not to be out of order, the situation that the whole recommendation system is unavailable due to the failure of the important function module is avoided, and therefore the stability of the whole recommendation system is improved.

In a fifth aspect, an embodiment of the present application provides a monitoring system, where the system includes a first server and a second server, where: the second server is the server described in the first aspect or any one of the possible implementations of the first aspect, and the first server is the server described in the second aspect or any one of the possible implementations of the second aspect.

In a sixth aspect, the present application provides a computer-readable storage medium, which stores a computer program, and the computer program, when executed by a processor, causes the processor to implement the method for monitoring a functional module in a recommendation system according to the first aspect, the second aspect, the optional aspect of the first aspect, or the optional aspect of the second aspect.

By implementing the embodiment of the application, the importance degrees of all the functional modules in the first recommendation system can be tested in advance on line, then the importance degrees of all the modules are sent to the first server, the first server monitors all the functional modules in the second recommendation system running on line according to the importance degrees of all the functional modules, if one of the functional modules is an important module, the first server monitors the functional module in a key mode, through the key monitoring mode, the important functional modules can be ensured not to fail, the situation that the important functional modules fail to cause the whole recommendation system to be unavailable is avoided, and therefore the stability of the whole recommendation system is improved.

Drawings

In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings used in the embodiments of the present application or the background art will be briefly described below.

Fig. 1 is a system architecture diagram of a monitoring method for a functional module in a distributed recommendation system according to an embodiment of the present application;

fig. 2 is a schematic flowchart of a monitoring method for a functional module in a distributed recommendation system according to an embodiment of the present application;

FIG. 3 is a topological diagram of a part of functional modules in a first recommendation system according to an embodiment of the present application;

FIG. 4 is a topological diagram of functional modules in a first recommendation system according to an embodiment of the present application;

FIG. 5 is a schematic view of an interface provided by an embodiment of the present application;

fig. 6 is a schematic structural diagram of a server provided in an embodiment of the present application;

fig. 7 is a schematic structural diagram of another server provided in the embodiment of the present application;

fig. 8 is a schematic structural diagram of another server provided in the embodiment of the present application;

fig. 9 is a schematic structural diagram of another server provided in the embodiment of the present application.

Detailed Description

The technical solutions in the embodiments of the present application will be described below with reference to the accompanying drawings.

Referring to fig. 1, fig. 1 is a schematic system architecture diagram of a monitoring method for a function module in a distributed recommendation system according to an embodiment of the present application. The system comprises a sandbox environment 101, a first recommendation system 102 and a second recommendation system 103, wherein the sandbox environment 101 and the first recommendation system 102 are deployed on a second server, and the second recommendation system 103 is deployed on the first server, wherein the first server can be a single server or a server cluster, and the second server can be a single server or a server cluster; the first server may be the same server (i.e. the first recommendation system 102 and the second recommendation system 103 are deployed on the same server) or may be different servers (i.e. the first recommendation system 102 and the second recommendation system 103 are deployed on different servers). The sandbox environment 101 and the first recommendation system 102 are deployed on the same server. The second recommendation system 103 is an online running version of the first recommendation system 102, the first recommendation system 102 is a testing version of the second recommendation system 103, and the sandbox environment 101 is an independent operation environment similar to a sandbox, which can test systems, software or files in the sandbox environment. In the sandbox environment 101, the first recommendation system 102 is operated without affecting the online second recommendation system. The first recommendation system can be provided with a plurality of functional modules, each functional module is provided with one or more logic interfaces, and the second recommendation system is the same as the first recommendation system, so that the configuration conditions of the functional modules and the logic interfaces in the second recommendation system are the same as the configuration conditions of the functional modules and the logic interfaces of the first recommendation system. In the sandbox environment 101, the importance degree of a certain function module in the first recommendation system 102 is determined by simulating that a certain logic interface of the certain function module fails, and the importance degree information of the certain function module is sent to the first server, so that the first server monitors the certain function module in the second recommendation system running on the line according to the importance degree of the certain function module.

The first recommendation system in the embodiment of the application recommends related articles, videos, games, application programs, songs, commodities and other information which may be interested by a user for the user according to the attributes and habits of the user. For example, when traveling, the first recommendation system can recommend airline tickets, hotels and the like for the user; when ordering, the first recommendation system can recommend a proper restaurant for the user; when shopping, the first recommendation system can recommend commodities which the user may be interested in for the user; when the user watches news, the first recommending system can recommend news which the user may be interested in to the user; when watching videos, the first recommendation system can recommend videos which may be interesting to the user for the user.

Referring to fig. 2, fig. 2 is a flowchart illustrating a monitoring method for a functional module in a distributed recommendation system according to an embodiment of the present application, where the method may be implemented based on the architecture shown in fig. 1, and the method includes, but is not limited to, the following steps.

Step S201: the second server simulates in the sandbox that the first logical interface in the first functional module in the first recommendation system fails.

The first recommendation system is provided with a plurality of functional modules, each functional module is provided with one or more logic interfaces, the first functional module is any one of the functional modules in the first recommendation system, and the first functional module is used for realizing one or more functions of the first recommendation system. The first logical interface is an interface that the first functional module needs to call when implementing one or more functions of the first recommendation system, and specifically, which logical interface is not limited, depending on the choice. For example, the first recommendation system includes a video recommendation module, a news recommendation module, a novel recommendation module, and a music recommendation module, where two logic interfaces under the corresponding video recommendation module are a video publishing interface and a video deleting interface respectively, two logic interfaces under the corresponding news recommendation module are a news publishing interface and a news deleting interface respectively, three logic interfaces under the corresponding novel recommendation module are a novel reading interface, a novel publishing interface and a novel deleting interface respectively, and three logic interfaces under the corresponding music recommendation module are a music listening interface, a music publishing interface and a music deleting interface respectively.

A sandbox is a sandbox-like stand-alone operating environment in which systems, software, files, etc. may be tested. Meanwhile, the system, software or file is tested in the sandbox, so that the system, software and file outside the sandbox cannot be influenced. The sandbox can simulate that a first logic interface in a first functional module in the first recommendation system fails, for example, a video publishing interface in a video recommendation module in the first recommendation system fails; for example, simulating in a sandbox that a news deletion interface in a news recommender in a first recommender system fails; for example, a novel publishing interface in a novel recommendation module that simulates a first recommendation system fails in a sandbox. The sandbox simulation mode can effectively isolate the first recommendation system from the second recommendation system running on the line, and damage to the second recommendation system running on the line is prevented.

Optionally, before a failure occurs in a first logic interface in a first functional module in the simulation first recommendation system in the sandbox, a topological graph of each logic interface in the first recommendation system may also be generated, where the topological graph is used to describe a mutual call relationship between each logic interface in the first recommendation system. In this case, the failure of the first logical interface in the first functional module in the sandbox simulating the first recommendation system may specifically be: simulating in the sandbox according to the topology that a first logical interface in a first functional module in the first recommendation system fails.

In this embodiment of the application, an optional manner of generating the topology map of each logical interface in the first recommendation system may be as follows: generating a plurality of requests, wherein each request in the plurality of requests is a request which is added with a request identity Identification (ID) in a sampling mode through a Software Development Kit (SDK); inputting a plurality of requests to the first recommendation system; each request of the plurality of requests is for requesting the first recommendation system to implement one of the one or more functions, wherein different requests of the plurality of requests are for requesting different implemented functions. Then, when the collected request ID reaches a preset threshold value, a topology generating system generates a topology map of each function module in the first recommendation system according to a plurality of function modules and a plurality of logic interfaces in the first recommendation system, wherein any one of the plurality of modules is a function module that responds to any one of the plurality of requests, the any one module is used for responding to the received request when the request ID exists in the received request, and reporting the request ID to the topology generating system, and any one of the plurality of logic interfaces is a logic interface that responds to any one of the plurality of requests.

For example, the first recommendation system includes a video recommendation module, a news recommendation module, a novel recommendation module, and a music recommendation module, where two logic interfaces in the corresponding video recommendation module are a video publishing interface and a video deleting interface, two logic interfaces in the corresponding news recommendation module are a news publishing interface and a news deleting interface, three logic interfaces in the corresponding novel recommendation module are a novel reading interface, a novel publishing interface and a novel deleting interface, and three logic interfaces in the corresponding music recommendation module are a music listening interface, a music publishing interface and a music deleting interface. Meanwhile, a sensitive content module is provided in the first recommendation system, two logic interfaces in the corresponding sensitive content module are respectively a sensitive interface and a non-sensitive interface, as shown in fig. 3, a topological graph of each logic interface called by a part of function modules in the first recommendation system is provided, optionally, fig. 3 is one possible situation in the topological graph of each logic interface called by a part of function modules, and may also include other situations. Firstly, a request Identity (ID) is added in all requests in a sampling mode through a Software Development Kit (SDK) to generate a plurality of requests, such as a request for issuing a video and a request for deleting the video; the request ID of the request for releasing the video is FBSPQQ, and the request ID of the request for deleting the video is SCSPQQ; when a request for publishing a video (i.e. a first request) is sent to a first recommendation system, a video publishing interface in a video recommendation module and a non-sensitive interface in a sensitive content module in the corresponding first recommendation system respond to the request for publishing the video, and a video recommendation module and a sensitive content module report a request ID (i.e. FBSPQQ) in the request for publishing the video to a topology generation system, when a request for deleting the video (i.e. a first request) is sent to the first recommendation system, a video deleting interface in a video recommendation module in the corresponding first recommendation system responds to the request for deleting the video, and a video recommendation module reports a request ID (i.e. SCSPQQ) in the request for deleting the video to a topology generation system, the topology generation system reaches a preset threshold 2 when the collected request ID (FBSPQQ, SCSPQQ) reaches a preset threshold 2, and information of the video publishing interface is recommended according to the information of the video recommendation module, the information of the sensitive content module, the information of the non-sensitive interface and the video deleting interface generate topological graphs of all logic interfaces called by the video module, and the rest of the functional modules are analogized until the topological graphs of all logic interfaces called by all the functional modules in the first recommendation system are generated. Fig. 4 is a topological diagram of the logical interfaces invoked by the function modules in the first recommendation system. Optionally, fig. 4 is a possible case of a topology diagram of each logic interface called by each function module in the first recommendation system, and may also include other cases.

Step S202: the second server inputs a first request to the first recommendation system.

Specifically, the first request is used for requesting the first recommendation system to realize a first function, and the first function is one of the one or more functions.

For example, the first recommendation system has a plurality of functions such as a video distribution function, a video deletion function, a news distribution function, a news deletion function, a reading novel function, a novel distribution function, a novel deletion function, a listening to music, a music distribution function, and a music deletion function. For example, the first function may be a function of video distribution, or the first function may be a function of novel distribution.

For example, the first request may be a request to publish a video; or the first request may be a request to listen to music; or the first request may be a request to publish news.

In an embodiment of the present application, the inputting a first request to the first recommendation system includes: and directing the input first request to the first recommendation system in the sandbox in a routing mode.

Step S203: and the second server determines the importance degree of the first functional module according to the first detailed information returned by the first recommendation system in response to the first request.

Specifically, the first detailed information is used for describing a situation that the first recommendation system implements the first function when the first logical interface fails.

Optionally, as shown in fig. 5, for example, the second server inputs a first request to the first recommendation system, where the first request is a request for publishing a video, the first request is used to request to implement a function of publishing the video of the first recommendation system, a video publishing interface in the video recommendation module in the first recommendation system responds to the request for publishing the video (i.e., the first request), the returned information is that the video cannot be published (i.e., first detailed information), and the second server determines that the video recommendation module in the first recommendation system (i.e., the first functional module) belongs to a very important functional module according to the fact that the video cannot be published (i.e., the first detailed information).

In this embodiment of the application, another optional manner of determining the importance degree of the first function module according to the first detailed information returned by the first recommendation system in response to the first request may be as follows: and if the first detailed information indicates that the condition that the first recommendation system realizes the first function when the first logic interface fails is a first preset condition, determining that the first function module belongs to a predefined important function module.

For example, the first request is a request for publishing a video, the first detailed information is that when a video publishing interface under a video recommending module fails, the video publishing interface under the video recommending module in the first recommending system responds to the request for publishing the video, and the returned information is that the video cannot be published (i.e., the first detailed information). If the first preset condition is that the video cannot be published, determining that the video recommending module belongs to an important function module. If the first condition is that the video is released in a stuck state, the video recommending module is determined not to belong to the important functional module.

In this embodiment of the application, an optional manner of determining the importance degree of the first function module according to the first detailed information returned by the first recommendation system in response to the first request may be as follows:

and comparing the first detailed information with second detailed information, wherein the second detailed information is a condition that the first recommendation system responds to the first request to return to realize the first function when the first logic interface in the first function module in the first recommendation system does not have a fault.

For example, the first request is a request for publishing a video, the first detailed information is that when a video publishing interface under a video recommending module fails, the video publishing interface under the video recommending module in the first recommending system responds to the request for publishing the video, the returned information is that the video cannot be published (i.e., the first detailed information), and the number of completed processes in the function of publishing the video is 3, that is, the number of first processes is 3; the second detailed information is that when the video publishing interface under the video recommending module fails, the video publishing interface under the video recommending module in the first recommending system responds to a request for publishing a video, the returned information is that the video is successfully published (i.e., the second detailed information), the number of the completed processes in the video publishing function is 8, i.e., the number of the second processes is 8, if the preset threshold is 3, the difference between the number of the second processes and the number of the first processes is 5, and the difference between the number of the second processes and the number of the first processes is 5 greater than the preset threshold 3, so that the video recommending module is determined to belong to an important functional module.

It should be added that the first recommendation system needs to complete several processes when implementing the first function in the first recommendation system according to the first request. Wherein each process represents a staged task completed while implementing the first function.

In this embodiment of the application, after determining the importance degree of the first function module according to the first detailed information returned by the first recommendation system in response to the first request, the information of the first function module in the first recommendation system, the information of the first logic interface, the first detailed information, and the information of the severity degree may also be output.

For example, the first function module information in the first recommendation system is a video recommendation module, the first logic interface information in the first function module is a video publishing interface, the first detailed information is that a video cannot be published, and the severity information is very severe, the first function module information is output as a video module, the first logic interface information is a video publishing interface, the first detailed information is that a video cannot be published, and the severity information is very severe. For another example, if the first function module information in the first recommendation system is a novel recommendation module, the first logic interface information in the first function module is a novel deletion interface, the first detailed information is that the novel cannot be deleted, and the severity information is severe, the first function module information is output as the novel recommendation module, the first logic interface information is a novel deletion interface, the first detailed information is that the novel cannot be deleted, and the severity information is severe.

In the method, by outputting the information of the functional module, the information of the logic interface, the first detailed information and the severity information, a developer can obtain the information more intuitively, and the first recommendation system is optimized and debugged according to the information.

In the embodiment of the application, after the information of the first functional module in the first recommendation system, the information of the first logic interface, the first detailed information and the severity information are output, the user monitors the first functional module in the second recommendation system in a key mode, and the first functional module is prevented from being failed, so that the stability of the second recommendation system is poor.

Optionally, the information of the first function module in the first recommendation system, the information of the first logic interface, the first detailed information, and the information of the severity are stored, so that a developer can perform analysis and decision when a new function is added or an old function is deleted in the first recommendation system according to the information.

Step S204: and the second server sends the information of the importance degree of the first functional module to the first server.

The information of the importance degree of the first function module is used for the first server to monitor a first function module in a second recommendation system running on the line according to the importance degree of the first function module, wherein the first recommendation system is a test version of the second recommendation system.

Specifically, the information about the importance degree of the first function module may be that the first function module belongs to an important module, and the first function module does not belong to an important function module.

Step S205: the first server receives the information of the importance degree of the first function module sent by the second server.

Step S206: and the first server emphatically monitors the first functional module in the second recommendation system running on the line according to the information of the importance degree of the first functional module.

In this embodiment of the application, an optional manner for monitoring the first functional module in the second recommendation system running on line according to the information of the importance degree may be as follows:

and if the first functional module in the first recommendation system belongs to the predefined important functional module, monitoring the running state of the first functional module in the second recommendation system in the online system according to the first frequency.

And if the first functional module in the first recommendation system does not belong to the predefined important functional module, monitoring the running state of the first functional module in a second recommendation system in the online system according to a second frequency, wherein the first frequency is greater than the second frequency.

For example, if the video recommendation module in the first recommendation system belongs to the important function module, the video recommendation module in the second recommendation system belongs to the important function module, and the running state of the video recommendation module in the second recommendation system is monitored every 10 minutes.

For example, if the novel recommendation module in the first recommendation system does not belong to the important function module, the novel recommendation module in the second recommendation system does not belong to the important function module, and the running state of the video recommendation module in the second recommendation system is monitored every 1 hour.

It should be added that, when the first recommendation system and the second recommendation system are deployed on the same server, the second server does not need to send the information of the importance degree of the first function module to the first server, and the first server does not need to receive the information of the importance degree of the first function module sent by the second server. The first server may directly call the result of the information of the importance degree of the first function module in the second server.

In the method described in fig. 2, the importance degrees of the function modules in the first recommendation system can be tested in advance on line, and then the importance degrees of the function modules are sent to the first server, the first server monitors the function modules in the second recommendation system running on line according to the importance degrees of the function modules, if one of the function modules is an important module, the first server monitors the function module in a focused manner, and by the focused monitoring manner, the important function modules can be ensured not to fail, the situation that the important function modules fail to cause the whole recommendation system to be unavailable is avoided, and therefore the stability of the whole recommendation system is improved.

The method of the embodiments of the present application is set forth above in detail and the apparatus of the embodiments of the present application is provided below.

Referring to fig. 6, fig. 6 is a schematic structural diagram of a server 600 according to an embodiment of the present application, where the server 600 may include a simulation unit 601, an input unit 602, a determination unit 603, and a sending unit 604, where details of each unit are described below.

The simulation unit 601 is used for simulating that a first logic interface in a first functional module in a first recommendation system fails in a sandbox; the first functional module is used for realizing one or more functions of the first recommendation system, and the first logic interface is an interface which needs to be called when the first functional module realizes the one or more functions of the first recommendation system.

An input unit 602, configured to input a first request to the first recommendation system, where the first request is used to request the first recommendation system to implement a first function, and the first function is one of the one or more functions.

A determining unit 603, configured to determine, according to first detailed information returned by the first recommendation system in response to the first request, an importance degree of the first function module, where the first detailed information is used to describe a situation where the first recommendation system implements the first function when the first logic interface fails.

A sending unit 604, configured to send information of the importance degree of the first function module to a first server, so that the first server monitors a first function module in a second recommendation system running on a line according to the importance degree of the first function module, where the first recommendation system is a test version of the second recommendation system.

In an optional scheme, the determining unit 603 is configured to determine, according to first detailed information returned by the first recommendation system in response to the first request, an importance degree of the first function module, specifically:

In another alternative, the determining unit 603 is configured to determine, according to the first detailed information returned by the first recommendation system in response to the first request, the importance degree of the first function module, specifically:

In yet another alternative, the input unit 602, configured to input a first request to the first recommendation system, includes:

and directing the input first request to the first recommendation system in the sandbox in a routing mode.

In yet another alternative, after the determining unit 603 is configured to determine the importance degree of the first function module according to the first detailed information returned by the first recommendation system in response to the first request, the server further includes:

and the output unit is used for outputting the information of the first functional module in the first recommendation system, the information of the first logic interface, the first detailed information and the information of the severity degree.

In yet another alternative, before the first logic interface in the first functional module in the sandbox simulating the first recommendation system fails, the simulation unit 601 further includes:

and the generating unit is used for generating a topological graph of each logic interface in the first recommendation system, wherein the topological graph is used for describing the mutual calling relationship among the logic interfaces in the first recommendation system.

In another alternative, the generating unit is configured to generate a topological graph of each logical interface in the first recommendation system, and includes:

inputting a plurality of requests to the first recommendation system; each request of the plurality of requests is for requesting the first recommendation system to implement one of the one or more functions, wherein different requests of the plurality of requests are for requesting different implemented functions.

It should be noted that the implementation and beneficial effects of each unit can also correspond to the corresponding description of the method embodiment shown in fig. 2.

Referring to fig. 7, fig. 7 is a schematic structural diagram of a server 700 according to an embodiment of the present application, where the server 700 may include a receiving unit 701, a first monitoring unit 702, and a second monitoring unit 703, where details of each unit are described below.

The receiving unit 701 is configured to receive information of the importance degree of the first function module in the second recommendation system, which is sent by the second server.

A first monitoring unit 702, configured to monitor an operating state of the first function module in the second recommendation system according to a first frequency when the first function module in the second recommendation system belongs to a predefined important function module.

A second monitoring unit 703, configured to monitor an operating state of the first function module in the second recommendation system according to a second frequency when the first function module in the second recommendation system does not belong to a predefined important function module, where the first frequency is greater than the second frequency.

Referring to fig. 8, fig. 8 is a server 800 according to an embodiment of the present application, where the server 800 includes a processor 801, a memory 802, and a communication interface 803, and the processor 801, the memory 802, and the communication interface 803 are connected to each other by a bus.

The memory 802 includes, but is not limited to, a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM), or a portable read-only memory (CD-ROM), and the memory 802 is used for related instructions and data. The communication interface 803 is used to receive and transmit data.

The processor 801 may be one or more Central Processing Units (CPUs) 801, and in the case where the processor 801 is one CPU, the CPU may be a single-core CPU or a multi-core CPU.

The processor 801 in the server 800 invokes a computer program stored in the memory 802 to perform the following operations:

simulating a first logic interface in a first functional module in a first recommendation system in the sandbox to be failed; the first functional module is used for realizing one or more functions of the first recommendation system, and the first logic interface is an interface which needs to be called when the first functional module realizes the one or more functions of the first recommendation system.

And inputting a first request to the first recommendation system, wherein the first request is used for requesting the first recommendation system to realize a first function, and the first function is one of the one or more functions.

And determining the importance degree of the first function module according to first detailed information returned by the first recommendation system in response to the first request, wherein the first detailed information is used for describing the condition that the first recommendation system realizes the first function when the first logic interface fails.

The information of the importance degree of the first function module is sent to the first server through the communication interface 803, so that the first server monitors the first function module in a second recommendation system running on the line according to the importance degree of the first function module, wherein the first recommendation system is a test version of the second recommendation system.

In an optional scheme, the processor 801 is configured to determine, according to first detailed information returned by the first recommendation system in response to the first request, an importance degree of the first function module, specifically:

In another alternative, the processor 801 is configured to determine, according to the first detailed information returned by the first recommendation system in response to the first request, the importance degree of the first function module, specifically:

In another alternative, the processor 801 is configured to input a first request to the first recommendation system, specifically: and directing the input first request to the first recommendation system in the sandbox in a routing mode.

In yet another alternative, the processor 801 is further configured to, after determining the importance level of the first functional module according to first detailed information returned by the first recommendation system in response to the first request, output information of the first functional module in the first recommendation system, information of the first logical interface, the first detailed information, and information of the severity level.

In yet another alternative, the processor 801 is further configured to generate a topology map of each logical interface in the first recommendation system before a failure occurs in a first logical interface in a first functional module in the sandbox simulating the first recommendation system, where the topology map is used to describe a mutual calling relationship between each logical interface in the first recommendation system.

In another alternative, the processor 801 is configured to generate a topology map of each logical interface in the first recommendation system, specifically:

It should be noted that the implementation and beneficial effects of the operations may also correspond to the corresponding descriptions of the method embodiment shown in fig. 2.

Referring to fig. 9, fig. 9 is a server 900 according to an embodiment of the present application, where the server 900 includes a processor 901, a memory 902, and a communication interface 903, and the processor 901, the memory 902, and the communication interface 903 are connected to each other through a bus.

The memory 902 includes, but is not limited to, a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM), or a portable read-only memory (CD-ROM), and the memory 902 is used for related instructions and data. The communication interface 903 is used for receiving and transmitting data.

The processor 901 may be one or more Central Processing Units (CPUs) 901, and in the case that the processor 901 is one CPU, the CPU may be a single-core CPU or a multi-core CPU.

The processor 901 in the server 900 invokes a computer program stored in the memory 902 to perform the following operations:

the information of the importance degree of the first function module in the second recommendation system sent by the second server is received through the communication interface 903.

And if the first function module in the second recommendation system belongs to a predefined important function module, monitoring the running state of the first function module in the second recommendation system according to a first frequency.

Embodiments of the present application also provide a computer-readable storage medium, which stores instructions that, when executed on a processor, implement the operations performed in the method embodiment shown in fig. 2.

Embodiments of the present application also provide a computer program product, which when executed on a processor, implements the operations performed in the method embodiment shown in fig. 2.

One of ordinary skill in the art will appreciate that all or part of the processes in the methods of the above embodiments may be implemented by hardware related to instructions of a computer program, which may be stored in a computer-readable storage medium, and when executed, may include the processes of the above method embodiments. And the aforementioned storage medium includes: various media capable of storing computer programs, such as ROM or RAM, magnetic or optical disks, etc.

Claims

1. a monitoring method for functional modules in a distributed recommendation system, characterized in that, comprising:

A failure of the first logic interface in the first functional module of the first recommendation system is simulated in the sandbox; wherein the first functional module is used to implement one or more functions of the first recommendation system, so The first logical interface is an interface that the first functional module needs to call when implementing one or more functions of the first recommendation system;

Inputting a first request to the first recommendation system, wherein the first request is used to request the first recommendation system to implement a first function, and the first function is one of the one or more functions item function;

The importance of the first functional module is determined according to the first detailed information returned by the first recommendation system in response to the first request, where the first detailed information is used to describe what happens when the first logical interface fails. the situation in which the first recommendation system implements the first function;

Sending the information on the importance of the first functional module to the first server, so that the first server can recommend the first functional module in the second recommendation system running online according to the importance of the first functional module Monitoring is performed, wherein the first recommendation system is a test version of the second recommendation system.

2 . The method according to claim 1 , wherein determining the importance of the first functional module according to the first detailed information returned by the first recommendation system in response to the first request, comprising: 2 .

Comparing the first detailed information with the second detailed information, the second detailed information is that when the first logical interface in the first functional module in the first recommendation system is not faulty, the first recommendation The situation of realizing the first function returned by the system in response to the first request;

If the difference between the number of second processes and the number of first processes is greater than a preset threshold, it is determined that the first function module belongs to a predefined important function module; wherein, implementing the first function needs to complete multiple processes, and the The first number of processes is the number of completed processes in the process of implementing the first function indicated by the first detailed information, and the second number of processes is the number of processes completed in the process of implementing the first function indicated by the second detailed information. The number of completed processes.

3. The method according to claim 1, wherein the determining the importance of the first functional module according to the first detailed information returned by the first recommendation system in response to the first request, comprising:

If the first detailed information indicates that the situation in which the first recommendation system implements the first function when the first logical interface fails is a first preset situation, it is determined that the first function module belongs to a predefined important function module.

4. The method according to claim 1, wherein the inputting the first request to the first recommendation system comprises:

The input first request is directed to the first recommendation system in the sandbox by means of routing.

5. The method according to any one of claims 1-3, wherein the determining of the first function module is based on the first detailed information returned by the first recommendation system in response to the first request. After the level of importance, it also includes:

Output the information of the first functional module in the first recommendation system, the information of the first logical interface, the first detailed information, and the information of the severity.

6. The method according to any one of claims 1-3, wherein before the first logical interface in the first functional module in the simulated first recommendation system in the sandbox fails, the method further comprises:

generating a topology map of each logical interface in the first recommendation system, wherein the topology map is used to describe the mutual calling relationship between each logical interface in the first recommendation system;

The simulating failure of the first logical interface in the first functional module in the first recommendation system in the sandbox includes: simulating in the sandbox the first logical interface in the first functional module in the first recommendation system according to the topology map. The first logical interface is faulty, where the first logical interface is any logical interface in the topology diagram.

7. The method according to claim 6, wherein the generating a topology map of each logical interface in the first recommendation system comprises:

generating multiple requests, wherein each request in the multiple requests is a request for adding a request identity ID by sampling through the software development kit SDK;

The multiple requests are input to the first recommendation system; each request in the multiple requests is used to request the first recommendation system to implement one of the one or more functions, wherein the Different requests in the above multiple requests are used to request different functions;

When the collected request ID reaches a preset threshold, the topology generation system generates a topology diagram of each functional module in the first recommendation system according to multiple functional modules and multiple logical interfaces in the first recommendation system, wherein, Any one of the multiple modules is a functional module that responds to any one of the multiple requests, and the any one of the modules is used to respond to the received request when a request ID exists in the received request. The request ID is responded to, and the request ID is reported to the topology generation system, and any one of the multiple logical interfaces is a logical interface that responds to any one of the multiple requests.

8. A method for monitoring functional modules in a distributed recommendation system, comprising:

receiving information about the importance level of the first functional module in the second recommendation system sent by the second server;

If the first function module in the second recommendation system belongs to a predefined important function module, monitor the running state of the first function module in the second recommendation system according to a first frequency;

If the first function module in the second recommendation system does not belong to a predefined important function module, monitor the running state of the first function module in the second recommendation system according to a second frequency, wherein the The first frequency is greater than the second frequency.

9. A server, characterized in that the server comprises a processor, a memory and a communication interface, the memory is used to store a computer program, and the processor invokes the computer program to perform the following operations:

The information on the importance of the first functional module is sent to the first server through the communication interface, so as to be used by the first server in a second recommendation system running online according to the importance of the first functional module monitoring the first functional module of the first recommendation system, wherein the first recommendation system is a test version of the second recommendation system.

10 . The server according to claim 9 , wherein, the degree of importance of the first functional module is determined according to the first detailed information returned by the first recommendation system in response to the first request, specifically: 10 . :

11 . The server according to claim 9 , wherein, the degree of importance of the first functional module is determined according to the first detailed information returned by the first recommendation system in response to the first request, specifically: 11 . :

12. The server according to claim 9, wherein the inputting the first request to the first recommendation system is specifically:

13. A server, characterized in that the server comprises a processor, a memory and a communication interface, the memory is used to store a computer program, and the processor invokes the computer program to perform the following operations:

receiving, through the communication interface, the information on the importance level of the first functional module in the second recommendation system sent by the second server;

14. A monitoring system, comprising a first server and a second server, wherein:

The first server is the server of claim 13;

The second server is the server described in any one of claims 9-12.

15. A computer-readable storage medium, characterized in that the computer-readable storage medium stores a computer program that, when executed by a processor, causes the processor to implement any one of claims 1 to 8 The monitoring method of the function module in the distributed recommendation system described in item.