CN112817831A

CN112817831A - Application performance monitoring method, device, computer system and readable storage medium

Info

Publication number: CN112817831A
Application number: CN202110045515.3A
Authority: CN
Inventors: 毕竞元; 罗涛; 李思; 李可
Original assignee: Industrial and Commercial Bank of China Ltd ICBC
Current assignee: Industrial and Commercial Bank of China Ltd ICBC
Priority date: 2021-01-13
Filing date: 2021-01-13
Publication date: 2021-05-18

Abstract

The present disclosure provides an application performance monitoring method, an application performance monitoring apparatus, a computer system, a computer-readable storage medium, and a computer program product, which may be used in the field of information security, the internet of things technology, or other fields. The method comprises the following steps: acquiring an initial interface template image and a target interface template image of an application; acquiring a plurality of frames of images acquired by an application in response to a user request in a conversion process from an initial interface to a target interface, wherein each frame of image corresponds to an image frame number, and a preset time interval is formed between two adjacent frames of images; determining a first image frame number of an image corresponding to the initial interface template image in the multi-frame images and a second image frame number of an image corresponding to the target interface template image in the multi-frame images; calculating the response time of the application responding to the user request according to the first image frame number, the second image frame number and the preset time interval; and monitoring the response time.

Description

Application performance monitoring method, device, computer system and readable storage medium

Technical Field

The present disclosure relates to the field of computer technologies, and in particular, to an application performance monitoring method, an application performance monitoring apparatus, a computer system, a computer-readable storage medium, and a computer program product.

Background

With the rapid development of computer technology, various Applications (APP) have come into play. The performance of the application program is used as an important index influencing the satisfaction degree of the user, and therefore, monitoring and optimizing the performance of the application program is particularly important.

Taking the performance of monitoring the response time of an application as an example, the first problem to be solved is to calculate the response time.

In the process of implementing the concept of the present disclosure, the inventor finds that in the related art, at least the following problem exists, and the existing method for calculating the application response time needs to first obtain detailed information such as a source code and a certificate of an application program, so that the existing method for monitoring the application response time cannot be flexibly applied to all application programs.

Disclosure of Invention

In view of the above, the present disclosure provides an application performance monitoring method, an application performance monitoring apparatus, a computer system, a computer-readable storage medium, and a computer program product.

One aspect of the present disclosure provides an application performance monitoring method, including: acquiring an initial interface template image and a target interface template image of an application; acquiring a plurality of frames of images acquired in the conversion process of the application responding to a user request and converting an initial interface to a target interface, wherein each frame of image corresponds to an image frame number, and a preset time interval is formed between two adjacent frames of images; determining a first image frame number of an image corresponding to the initial interface template image in the multi-frame images and a second image frame number of an image corresponding to the target interface template image in the multi-frame images; calculating the response time of the application responding to the user request according to the first image frame serial number, the second image frame serial number and the preset time interval; and monitoring the response time.

According to the embodiment of the disclosure, acquiring the multi-frame image acquired by the application responding to the user request in the process of converting the initial interface into the target interface comprises: acquiring a recorded video aiming at the conversion process; and converting the recorded video into the multi-frame image according to a preset script program.

According to an embodiment of the present disclosure, determining the first image frame number of the image corresponding to the initial interface template image among the plurality of frames of images and the second image frame number of the image corresponding to the target interface template image among the plurality of frames of images includes: calculating the similarity between the initial interface template image and each frame of image in the multiple frames of images to obtain a first similarity data set; calculating the similarity between the target interface template image and each frame of image in the multiple frames of images to obtain a second similarity data set; determining a maximum value in the first similarity dataset and a maximum value in the second similarity dataset; taking the image frame number of the image corresponding to the maximum value in the first similarity data set as the first image frame number; and taking the image frame number of the image corresponding to the maximum value in the second similarity data set as the second image frame number.

According to an embodiment of the present disclosure, the multiple frames of images are acquired according to the playing process of the recorded video at the preset time interval and are sequentially stored, and calculating the response time of the application responding to the user request according to the first image frame number, the second image frame number and the preset time interval includes: calculating the difference value between the first image frame sequence number and the second image frame sequence number; and calculating the response time according to the difference value and the preset time interval.

According to an embodiment of the present disclosure, monitoring the response time includes: acquiring a preset response time threshold value of the application responding to the user request; and popping up warning information under the condition that the response time is greater than the preset response time threshold.

According to an embodiment of the present disclosure, obtaining the preset response time threshold of the application in response to the user request includes: acquiring target response time of other applications of the same type as the application in response to the request of the same type as the user request; and determining the preset response time threshold according to the target response time.

Another aspect of the present disclosure provides an application performance monitoring apparatus, including: the first acquisition module is used for acquiring an initial interface template image and a target interface template image of an application; the second acquisition module is used for acquiring a plurality of frames of images acquired in the conversion process of the application responding to the user request and converting the initial interface into the target interface, wherein each frame of image corresponds to an image frame sequence number, and a preset time interval is reserved between every two adjacent frames of images; the determining module is used for determining a first image frame number of an image corresponding to the initial interface template image in the multi-frame images and a second image frame number of an image corresponding to the target interface template image in the multi-frame images; the computing module is used for computing the response time of the application responding to the user request according to the first image frame serial number, the second image frame serial number and the preset time interval; and the monitoring module is used for monitoring the response time.

Another aspect of the present disclosure provides a computer system comprising: one or more processors; memory for storing one or more programs, wherein the one or more programs, when executed by the one or more processors, cause the one or more processors to implement the application performance monitoring method as described above.

Another aspect of the present disclosure provides a computer-readable storage medium having stored thereon computer-executable instructions for implementing the application performance monitoring method as described above when executed.

Another aspect of the present disclosure provides a computer program product comprising computer executable instructions for implementing the application performance monitoring method as described above when executed.

According to the embodiment of the disclosure, the method comprises the steps of acquiring an initial interface template image and a target interface template image of an application; acquiring a plurality of frames of images acquired by an application in response to a user request in a conversion process from an initial interface to a target interface, wherein each frame of image corresponds to an image frame number, and a preset time interval is formed between two adjacent frames of images; determining a first image frame number of an image corresponding to the initial interface template image in the multi-frame images and a second image frame number of an image corresponding to the target interface template image in the multi-frame images; calculating the response time of the application responding to the user request according to the first image frame number, the second image frame number and the preset time interval; and the technical means for monitoring the response time, because the response time is calculated in a mode of multi-frame images, the technical problem that the existing monitoring method aiming at the application response time cannot be flexibly applied to all the application programs is at least partially overcome, and the technical effect of flexibly monitoring the response time of each application program is further achieved.

Drawings

The above and other objects, features and advantages of the present disclosure will become more apparent from the following description of embodiments of the present disclosure with reference to the accompanying drawings, in which:

fig. 1 schematically illustrates an exemplary system architecture to which the application performance monitoring method may be applied, according to an embodiment of the present disclosure;

FIG. 2 schematically illustrates a flow chart of an application performance monitoring method according to an embodiment of the present disclosure;

3A-3C schematically illustrate schematic views of an initial interface template image or a target interface template image according to embodiments of the present disclosure;

4A-4B schematically illustrate a transition process from an initial interface to a target interface according to an embodiment of the disclosure;

FIG. 5 schematically illustrates a block diagram of an application performance monitoring apparatus according to an embodiment of the present disclosure; and

FIG. 6 schematically shows a block diagram of a computer system suitable for implementing the application performance monitoring method according to an embodiment of the present disclosure.

Detailed Description

Hereinafter, embodiments of the present disclosure will be described with reference to the accompanying drawings. It should be understood that the description is illustrative only and is not intended to limit the scope of the present disclosure. In the following detailed description, for purposes of explanation, numerous specific details are set forth in order to provide a thorough understanding of the embodiments of the disclosure. It may be evident, however, that one or more embodiments may be practiced without these specific details. Moreover, in the following description, descriptions of well-known structures and techniques are omitted so as to not unnecessarily obscure the concepts of the present disclosure.

The terminology used herein is for the purpose of describing particular embodiments only and is not intended to be limiting of the disclosure. The terms "comprises," "comprising," and the like, as used herein, specify the presence of stated features, steps, operations, and/or components, but do not preclude the presence or addition of one or more other features, steps, operations, or components.

All terms (including technical and scientific terms) used herein have the same meaning as commonly understood by one of ordinary skill in the art unless otherwise defined. It is noted that the terms used herein should be interpreted as having a meaning that is consistent with the context of this specification and should not be interpreted in an idealized or overly formal sense.

Where a convention analogous to "at least one of A, B and C, etc." is used, in general such a construction is intended in the sense one having skill in the art would understand the convention (e.g., "a system having at least one of A, B and C" would include but not be limited to systems that have a alone, B alone, C alone, a and B together, a and C together, B and C together, and/or A, B, C together, etc.). Where a convention analogous to "A, B or at least one of C, etc." is used, in general such a construction is intended in the sense one having skill in the art would understand the convention (e.g., "a system having at least one of A, B or C" would include but not be limited to systems that have a alone, B alone, C alone, a and B together, a and C together, B and C together, and/or A, B, C together, etc.).

The response time of mobile applications is an important measure of APP performance. The response time can directly influence the user's judgment and use experience of an application, and the slow APP response time may cause the user to be unable to tolerate or even directly uninstall the APP. It can be said that the application response time indirectly affects the user usage of the APP. In addition, the response time is an important optimization index due to the pressure of a plurality of external competitors and the evaluation of the APP of the same industry by some evaluation mechanisms. However, how to count and monitor this data becomes an urgent problem to be solved.

There are two methods for the response time statistics of most of the current APPs. According to the first scheme, a client side calculation statistical method needs to count and calculate response time in corresponding positions of a source code, for example, in an iOS, time stamps at the moment are recorded in positions of an APP initial interface and a target interface, and the difference between the APP initial interface and the target interface is the response time. In the second scheme, the Xcode Developer Tool (Xcode is an integrated development Tool) method, a Time Profiler (Time analyzer) plug-in of Instruments (a testing Tool) is used, so that the use condition of the APP CPU can be monitored, and the response Time of each task in the APP and the Time consumed by each method can be seen.

The inventor finds that, in the process of implementing the disclosed concept, the scheme can be used only on the basis of obtaining the APP source code, and although the time consumption of each response item can be accurately obtained, the scheme has a certain difference with the actual user experience, because it is only a statistical scheme on the code level, and in addition, the mobile terminal consumes time when rendering the image. This solution cannot represent the application response time that the user really experiences from a visual point of view. In the second scheme, although the time consumption of each method call can be accurately obtained, a developer certificate signature of the APP is required, otherwise, the test cannot be executed. In addition, both the first scheme and the second scheme cannot be used in the competitive product APP due to the limitation of the source code and the signature certificate, and cannot visually sense the difference between the product APP and the competitive product APP in the aspect of response time.

Embodiments of the present disclosure provide an application performance monitoring method, an application performance monitoring apparatus, a computer system, a computer-readable storage medium, and a computer program product. The method comprises the steps of obtaining an initial interface template image and a target interface template image of an application; acquiring a plurality of frames of images acquired by an application in response to a user request in a conversion process from an initial interface to a target interface, wherein each frame of image corresponds to an image frame number, and a preset time interval is formed between two adjacent frames of images; determining a first image frame number of an image corresponding to the initial interface template image in the multi-frame images and a second image frame number of an image corresponding to the target interface template image in the multi-frame images; calculating the response time of the application responding to the user request according to the first image frame number, the second image frame number and the preset time interval; and monitoring the response time.

Fig. 1 schematically illustrates an exemplary system architecture 100 to which the application performance monitoring method may be applied, according to an embodiment of the present disclosure. It should be noted that fig. 1 is only an example of a system architecture to which the embodiments of the present disclosure may be applied to help those skilled in the art understand the technical content of the present disclosure, and does not mean that the embodiments of the present disclosure may not be applied to other devices, systems, environments or scenarios.

As shown in fig. 1, the system architecture 100 according to this embodiment may include

terminal devices

101, 102, 103, a network 104 and a server 105. The network 104 serves as a medium for providing communication links between the

terminal devices

101, 102, 103 and the server 105. Network 104 may include various connection types, such as wired and/or wireless communication links, and so forth.

The user may use the

terminal devices

101, 102, 103 to interact with the server 105 via the network 104 to receive or send messages or the like. The

terminal devices

101, 102, 103 may have various communication client applications installed thereon, such as a shopping application, a web browser application, a search application, an instant messaging tool, a mailbox client, and/or social platform software.

The

terminal devices

101, 102, 103 may be various electronic devices having a display screen and supporting web browsing, including but not limited to smart phones, tablet computers, laptop portable computers, desktop computers, and the like. The

terminal devices

101, 102, 103 may implement task monitoring.

The server 105 may be a server that provides various services, such as a background management server that provides support for websites browsed by users using the

terminal devices

101, 102, 103, or a server for implementing monitoring tasks. The background management server may analyze and perform other processing on the received data such as the user request, and feed back a processing result (for example, a webpage, information, or data obtained or generated according to the user request) to the terminal device, so that the server for implementing the monitoring task may monitor information such as the APP running time.

It should be noted that the application performance monitoring method provided by the embodiment of the present disclosure may be generally executed by the server 105. Accordingly, the application performance monitoring apparatus provided by the embodiment of the present disclosure may be generally disposed in the server 105. The application performance monitoring method provided by the embodiment of the present disclosure may also be executed by a server or a server cluster that is different from the server 105 and is capable of communicating with the

terminal devices

101, 102, 103 and/or the server 105. Correspondingly, the application performance monitoring apparatus provided by the embodiment of the present disclosure may also be disposed in a server or a server cluster that is different from the server 105 and is capable of communicating with the

terminal devices

101, 102, 103 and/or the server 105. Alternatively, the application performance monitoring method provided by the embodiment of the present disclosure may also be executed by the

terminal device

101, 102, or 103, or may also be executed by another terminal device different from the

terminal device

101, 102, or 103. Correspondingly, the application performance monitoring apparatus provided by the embodiment of the present disclosure may also be disposed in the

terminal device

101, 102, or 103, or in another terminal device different from the

terminal device

101, 102, or 103.

For example, the initial interface template image, the target interface template image, and the multi-frame image acquired by the conversion process from the initial interface to the target interface may be originally stored in any one of the

terminal devices

101, 102, or 103 (e.g., the terminal device 101, but not limited thereto), or stored on an external storage device and may be imported into the terminal device 101. Then, the terminal device 101 may locally execute the application performance monitoring method provided by the embodiment of the present disclosure, or send the initial interface template image, the target interface template image, and the multi-frame image acquired in the conversion process from the initial interface to the target interface to another terminal device, server, or server cluster, and execute the application performance monitoring method provided by the embodiment of the present disclosure by another terminal device, server, or server cluster receiving the images.

It should be understood that the number of terminal devices, networks, and servers in fig. 1 is merely illustrative. There may be any number of terminal devices, networks, and servers, as desired for implementation.

It should be noted that the application performance monitoring method, the application performance monitoring device, the computer system, the computer readable storage medium, and the computer program product of the present disclosure may be used in the fields of information security and internet of things technology, and may also be used in any field other than the fields of information security and internet of things technology.

Fig. 2 schematically shows a flow chart of an application performance monitoring method according to an embodiment of the present disclosure.

As shown in fig. 2, the method includes operations S201 to S205.

In operation S201, an initial interface template image and a target interface template image of an application are acquired.

According to the embodiment of the present disclosure, the application may be, for example, the above-mentioned various communication client applications, the initial interface template image may be, for example, a captured image for any interface in the application running process, or may be a desktop icon image in which the application has not yet run, or may be a desktop captured image including the application icon, and the like, and the target interface template image may be, for example, a captured image for any interface in the application running process different from the initial interface template image.

It should be noted that, in order to facilitate the monitoring of the application performance, for example, the monitoring of the application response time, the initial interface template image and the target interface template image may be, for example, captured images corresponding to two adjacent pages loaded during the running process of the application, or captured images corresponding to a homepage entered when the application is not started yet and after the application is formally started.

In operation S202, a plurality of frames of images acquired by the application in response to a user request in a conversion process from the initial interface to the target interface are acquired, where each frame of image corresponds to an image frame number, and a preset time interval exists between two adjacent frames of images.

According to the embodiment of the present disclosure, the user request may be, for example, a request that the user click an application icon to start an application, or may be a request that the user click a certain tab or link of an application running page to jump the application to a next page while the application is running. The initial interface is, for example, an application current interface when the user request has not been applied to the application, the target interface is, for example, an interface to which the application normally jumps after responding to the user request, and the normal jump is used to indicate that the target interface does not include an interface in which the jump failed and a loading interface in the jump process. The conversion process from the initial interface to the target interface is a dynamic conversion process, and the multi-frame image is obtained according to the dynamic conversion process, for example. The image frame number is used to uniquely identify each frame of image. The preset time interval is used for determining the interval time between every two frames of images in the multi-frame images acquired in the conversion process.

In operation S203, a first image frame number of an image corresponding to the initial interface template image among the plurality of frame images and a second image frame number of an image corresponding to the target interface template image among the plurality of frame images are determined.

According to the embodiment of the present disclosure, after the multi-frame images representing the conversion process from the initial interface to the target interface are acquired in operation S202, the initial interface template image and the target interface template image stored in operation S201 may be matched with the multi-frame images one by one, so that the image frame numbers of one frame of image, i.e., the first image frame number and the second image frame number, corresponding to the initial interface template image and the target interface template image in the multi-frame images may be obtained accordingly, and the multi-frame target images from the image corresponding to the first image frame number to the image corresponding to the second image frame number may be obtained from the acquired multi-frame images at the same time.

In operation S204, a response time of the application in response to the user request is calculated according to the first image frame number, the second image frame number, and the preset time interval.

According to the embodiment of the present disclosure, for example, the target interval time between every two frame target images in the multi-frame target images obtained in operation S203 may be determined according to the interval time between every two frame images in the multi-frame images in operation S202, and the response time of the application in response to the user request may be calculated according to the target interval time and the images corresponding to the first image frame number and the second image frame number obtained in operation S203.

In operation S205, the response time is monitored.

According to an embodiment of the present disclosure, the response time may include, for example, a start time of the application, which may be, for example, a time taken from clicking an application icon to the time when the application is completely started and displays a home page, and a load time of the application running process in response to the request, which may be, for example, a time to jump from one page of the application to the next page. In this embodiment, the start time and each loading time (including different loading times corresponding to different requests) may be monitored separately.

Through the embodiment of the disclosure, the method for counting the response time of the application from the visual angle of the user without acquiring the application source code is realized, and the method can be effectively used for monitoring the response time of all applications.

The method illustrated in fig. 2 is further described below in conjunction with specific embodiments with reference to fig. 3A-3C and fig. 4A-4B.

3A-3C schematically illustrate schematic views of an initial interface template image or a target interface template image according to embodiments of the present disclosure.

According to an embodiment of the present disclosure, in a case that the user request is a request for starting an application by clicking an application icon (e.g., APP icon in fig. 3A) by a user, the monitored response time is, for example, a start time of the application (e.g., APP in fig. 3A), at this time, the initial interface template image may be, for example, a screenshot in which the APP icon is located (as shown in fig. 3A), and the target interface template image may be, for example, an APP homepage screenshot (as shown in fig. 3B). In the case that the user request is a request that the user clicks a certain tab or link of an application running page (for example, "query ticket" in fig. 3B) to jump the application to a next page, the monitored response time may be, for example, a loading time when the application responds to a certain running instruction (here, for example, an instruction "query ticket" in fig. 3B) during running, at this time, the initial interface template image may be, for example, an image intercepted corresponding to a page loaded during running of the APP (as shown in fig. 3B), and the target interface template image may be, for example, an image intercepted corresponding to a next page loaded during running of the APP in response to the user request (as shown in fig. 3C).

Fig. 4A-4B schematically illustrate a transition process from an initial interface to a target interface according to an embodiment of the disclosure.

As shown in fig. 4A, the application start-up procedure from fig. 3A to 3B is demonstrated.

As shown in FIG. 4B, the application loading process in response to a user request by FIGS. 3B-3C is illustrated.

According to an embodiment of the present disclosure, the above operation S202 includes: acquiring a recorded video aiming at a conversion process; and converting the recorded video into a multi-frame image according to a preset script program.

According to the embodiment shown in fig. 4A and 4B, the recorded video may be, for example, a video corresponding to the application starting process shown in fig. 4A, or may also be a video corresponding to the application loading process shown in fig. 4B, and the recorded video may be recorded and saved in a form of recording a screen command in a mobile phone or a computer, for example. The above-described multi-frame image may include each image in fig. 4A or 4B, for example. The preset script program can realize the functions of intercepting 50 frames of images in at least 1 second for the recorded video and saving the intercepted multiple frames of images to a folder, so that the multiple frames of images acquired according to the recorded video can be obtained.

According to an embodiment of the present disclosure, the above operation S203 includes: calculating the similarity between the initial interface template image and each frame of image in the multi-frame images to obtain a first similarity data set; calculating the similarity between the target interface template image and each frame of image in the multiple frames of images to obtain a second similarity data set; determining a maximum value in the first similarity dataset and a maximum value in the second similarity dataset; taking the image frame number of the image corresponding to the maximum value in the first similarity data set as a first image frame number; and taking the image frame number of the image corresponding to the maximum value in the second similarity data set as the second image frame number.

According to the embodiments shown in fig. 3A to 3C and fig. 4A to 4B, for example, by performing the process corresponding to the operation S203 on the template image corresponding to fig. 3A and 3B and the multi-frame image acquired by the application starting process shown in fig. 4A, or the template image corresponding to fig. 3B and 3C and the multi-frame image acquired by the application loading process shown in fig. 4B, the first image frame number and the second image frame number corresponding to the application starting process and the application loading process, respectively, may be determined.

According to an embodiment of the present disclosure, the multi-frame images are acquired and sequentially stored according to the preset time interval in the playing process of the recorded video, for example, in this case, the operation S204 includes: calculating the difference value between the first image frame sequence number and the second image frame sequence number; and calculating the response time according to the difference and the preset time interval.

According to an embodiment of the present disclosure, the preset time interval is determined according to the preset script program, for example. In the case where the preset script program is set to set a rule of "capturing 50 frames of images in 1 second", the preset time interval is, for example, 20 milliseconds. The values of the image frame numbers corresponding to the multiple frames of images may be, for example, 001 to 300, the first image frame number determined in operation S203 may be, for example, 031, and the second image frame number may be, for example, 271, and then the following calculation may be performed according to the calculation rule corresponding to operation S204: 20ms (271-.

According to an embodiment of the present disclosure, the operation S205 may further include, for example: acquiring a preset response time threshold value of an application responding to a user request; and popping up warning information under the condition that the response time is greater than a preset response time threshold value.

According to an embodiment of the present disclosure, the obtaining of the preset response time threshold of the application in response to the user request may further include: acquiring target response time of other applications of the same type as the application in response to a request of the same type as a user request; and determining a preset response time threshold according to the target response time.

According to the embodiment of the disclosure, the application is, for example, ticket grabbing software APP as shown in fig. 3A, and the other application of the same type as the application may be, for example, other ticket grabbing software APP, or may also be a web application capable of implementing the same ticket grabbing function. For example, the user request is a request of "query ticket" as shown in fig. 3B, and the request of the same type as the user request may be a tag or a link in another APP or a web page that can implement the same function of querying tickets. The response time threshold can be directly determined, or can be determined by comparing the response time of the same type of software responding to the same type of user request.

It should be noted that the application or the user request is not limited to the ticket snatching software APP or the request of "query ticket" as described above, the application in the above embodiment of the present disclosure may be various software or web applications, and the user request may be various user instructions capable of implementing page frame skipping.

According to the embodiment of the present disclosure, when the response time is greater than the preset response time threshold, a warning message may be popped up, and for the warning message, the application performance monitoring method may further include an optimization method for an application, for example, to accelerate the response time of the application through user processing, and the optimization processing method may be represented as: acquiring a plurality of execution operations collected by an application in response to a user request in a conversion process from an initial interface to a target interface; and delaying a part of the plurality of execution operations.

According to the embodiment of the disclosure, when it is monitored that a certain response time exceeds the preset response time threshold, the relevant operation evolution optimization processing for the user request corresponding to the response time may be performed, for example, when an application needs to connect to a server and acquire some device information of a server and a client when responding to the user request, the operation corresponding to the acquisition of some unimportant device information of the device may be performed, for example, after-processing.

According to the embodiment of the present disclosure, in the case where the partial operation is, for example, another operation unrelated to the access of the present application, the partial operation may be deleted.

According to the embodiment shown in fig. 4A, for example, the third image (advertisement interface) in fig. 4A is an operation unrelated to accessing the application, the operation related to presenting the advertisement interface included when the application responds to the user request can be directly deleted.

Through the embodiment of the disclosure, the competitiveness of the application in the same type of application can be effectively improved by optimizing the application response time, and the use satisfaction of a user is further improved.

According to the embodiment of the present disclosure, taking monitoring of APP start time as an example, the application performance monitoring method may correspond to the following modules, for example: the device comprises an image input comparison module, a recording starting process module, a video framing module, an image comparison module, a starting time calculation module, a result derivation module and a baseline management module.

According to the embodiment of the disclosure, the contrast image entering module can enter the paths of the two screenshots into a specific python script after storing the screenshot where the APP icon is located and the screenshot of the APP homepage, and then execute the script.

According to the embodiment of the disclosure, the recording starting process module can record and store a complete APP starting process in a form of inputting a screen recording command through a mobile phone or a computer.

According to the embodiment of the disclosure, the video framing module may, for example, implement a function of converting a video into a plurality of frames of images and saving the images in a folder through the aforementioned python script.

According to the embodiment of the disclosure, the image comparison module, for example, based on the aforementioned python script, may compare the multi-frame image with the two screenshots recorded in the contrast image recording module in sequence, and find out the corresponding click icon and the image frame number displayed by the homepage.

According to the embodiment of the disclosure, the start time calculating module may calculate the start time of the APP by using the found interval number of the image frame number, for example, based on the python script.

According to an embodiment of the present disclosure, the result deriving module may, for example, save the start time obtained each time in an Excel file based on the aforementioned python script, and then execute the baseline management module. The baseline management module is preset with a baseline value, the baseline is a 'snapshot' of each workpiece version in the project repository in a specific period, and provides a formal standard on which the subsequent work is based, and the standard can not be changed only after authorization, after an initial baseline is established, every subsequent change to the initial baseline is recorded as a difference value until the next baseline is established.

According to the embodiment of the disclosure, the baseline management module may, for example, compare the obtained activation time with an initially set baseline value (i.e., the preset response time threshold), and if the activation time value is much larger than the baseline value, a warning may be popped up. Meanwhile, if the starting time value of the competitive product APP (namely, the APP belongs to the same type with the self-owned APP or other APPs with the same functions) exists, the time length ranking of the self-owned APP can be obtained, and attention staff is reminded of the problem to be solved urgently at present to make corresponding optimization.

Through the embodiment of the disclosure, the starting time calculation method is realized through the python script, the starting time is counted in a pipeline mode, a software source code does not need to be exposed, and the real experience starting time is provided, so that any APP can obtain the starting time with millisecond precision by using the method, and even can be used for counting the showing time of any page of the APP. For the APP with more competitive products, after the display time of the own APP and the APP of the competitive products is obtained, the range of the own APP to be optimized can be quickly positioned, so that the competitive advantage of the own APP is expanded.

Fig. 5 schematically shows a block diagram of an application performance monitoring apparatus according to an embodiment of the present disclosure.

As shown in fig. 5, the application performance monitoring apparatus 500 includes a first obtaining module 510, a second obtaining module 520, a determining module 530, a calculating module 540, and a monitoring module 550.

The first obtaining module 510 is configured to obtain an initial interface template image and a target interface template image of an application.

A second obtaining module 520, configured to obtain multiple frames of images acquired by the application in response to a user request in a conversion process from the initial interface to the target interface, where each frame of image corresponds to an image frame number, and a preset time interval exists between two adjacent frames of images.

The determining module 530 is configured to determine a first image frame number of an image corresponding to the initial interface template image in the multiple frames of images and a second image frame number of an image corresponding to the target interface template image in the multiple frames of images.

And the calculating module 540 is configured to calculate a response time of the application responding to the user request according to the first image frame number, the second image frame number, and the preset time interval.

And a monitoring module 550 configured to monitor the response time.

According to an embodiment of the present disclosure, the second obtaining module includes a first obtaining unit and a converting unit.

A first obtaining unit for obtaining the recorded video for the conversion process.

And the conversion unit is used for converting the recorded video into a multi-frame image according to a preset script program.

According to an embodiment of the present disclosure, the determining module includes a first calculating unit, a second calculating unit, a determining unit, a first defining unit, and a second defining unit.

And the first calculating unit is used for calculating the similarity between the initial interface template image and each frame of image in the multi-frame images to obtain a first similarity data set.

And the second calculating unit is used for calculating the similarity between the target interface template image and each frame of image in the multiple frames of images to obtain a second similarity data set.

A determining unit for determining a maximum value in the first similarity data set and a maximum value in the second similarity data set.

And the first definition unit is used for taking the image frame number of the image corresponding to the maximum value in the first similarity data set as the first image frame number.

And the second definition unit is used for taking the image frame number of the image corresponding to the maximum value in the second similarity data set as the second image frame number.

According to the embodiment of the disclosure, the multi-frame images are acquired according to the playing process of the recorded video at preset time intervals and are sequentially stored, and the computing module comprises a third computing unit and a fourth computing unit.

And the third calculating unit is used for calculating the difference value between the first image frame number and the second image frame number.

And the fourth calculating unit is used for calculating the response time according to the difference value and the preset time interval.

According to an embodiment of the present disclosure, the monitoring module includes a second acquiring unit and a warning unit.

And the second acquisition unit is used for acquiring a preset response time threshold value of the application responding to the user request.

And the warning unit is used for popping up warning information under the condition that the response time is greater than a preset response time threshold.

According to an embodiment of the present disclosure, the second acquiring unit includes an acquiring subunit and a determining subunit.

And the acquiring subunit is used for acquiring the target response time of other applications of the same type as the application in response to the request of the same type as the user request.

And the determining subunit is used for determining a preset response time threshold according to the target response time.

Any of the modules, units, sub-units, or at least part of the functionality of any of them according to embodiments of the present disclosure may be implemented in one module. Any one or more of the modules, units and sub-units according to the embodiments of the present disclosure may be implemented by being split into a plurality of modules. Any one or more of the modules, units, sub-units according to the embodiments of the present disclosure may be implemented at least partially as a hardware circuit, such as a Field Programmable Gate Array (FPGA), a Programmable Logic Array (PLA), a system on a chip, a system on a substrate, a system on a package, an Application Specific Integrated Circuit (ASIC), or may be implemented in any other reasonable manner of hardware or firmware by integrating or packaging a circuit, or in any one of three implementations of software, hardware, and firmware, or in any suitable combination of any of them. Alternatively, one or more of the modules, units, sub-units according to embodiments of the disclosure may be at least partially implemented as computer program modules, which, when executed, may perform the corresponding functions.

For example, any plurality of the first obtaining module 510, the second obtaining module 520, the determining module 530, the calculating module 540 and the monitoring module 550 may be combined and implemented in one module/unit/sub-unit, or any one of the modules/units/sub-units may be split into a plurality of modules/units/sub-units. Alternatively, at least part of the functionality of one or more of these modules/units/sub-units may be combined with at least part of the functionality of other modules/units/sub-units and implemented in one module/unit/sub-unit. According to an embodiment of the present disclosure, at least one of the first obtaining module 510, the second obtaining module 520, the determining module 530, the calculating module 540, and the monitoring module 550 may be at least partially implemented as a hardware circuit, such as a Field Programmable Gate Array (FPGA), a Programmable Logic Array (PLA), a system on a chip, a system on a substrate, a system on a package, an Application Specific Integrated Circuit (ASIC), or may be implemented by hardware or firmware in any other reasonable manner of integrating or packaging a circuit, or implemented by any one of three implementations of software, hardware, and firmware, or in a suitable combination of any of them. Alternatively, at least one of the first acquiring module 510, the second acquiring module 520, the determining module 530, the calculating module 540 and the monitoring module 550 may be at least partially implemented as a computer program module, which when executed may perform a corresponding function.

It should be noted that the application performance monitoring apparatus part in the embodiment of the present disclosure corresponds to the application performance monitoring method part in the embodiment of the present disclosure, and the description of the application performance monitoring apparatus part specifically refers to the application performance monitoring method part, which is not described herein again.

FIG. 6 schematically shows a block diagram of a computer system suitable for implementing the application performance monitoring method according to an embodiment of the present disclosure. The computer system illustrated in FIG. 6 is only one example and should not impose any limitations on the scope of use or functionality of embodiments of the disclosure.

As shown in fig. 6, a computer system 600 according to an embodiment of the present disclosure includes a processor 601, which can perform various appropriate actions and processes according to a program stored in a Read Only Memory (ROM)602 or a program loaded from a storage section 608 into a Random Access Memory (RAM) 603. Processor 601 may include, for example, a general purpose microprocessor (e.g., a CPU), an instruction set processor and/or associated chipset, and/or a special purpose microprocessor (e.g., an Application Specific Integrated Circuit (ASIC)), among others. The processor 601 may also include onboard memory for caching purposes. Processor 601 may include a single processing unit or multiple processing units for performing different actions of a method flow according to embodiments of the disclosure.

In the RAM 603, various programs and data necessary for the operation of the system 600 are stored. The processor 601, the ROM 602, and the RAM 603 are connected to each other via a bus 604. The processor 601 performs various operations of the method flows according to the embodiments of the present disclosure by executing programs in the ROM 602 and/or RAM 603. It is to be noted that the programs may also be stored in one or more memories other than the ROM 602 and RAM 603. The processor 601 may also perform various operations of the method flows according to embodiments of the present disclosure by executing programs stored in the one or more memories.

According to an embodiment of the present disclosure, system 600 may also include an input/output (I/O) interface 605, input/output (I/O) interface 605 also connected to bus 604. The system 600 may also include one or more of the following components connected to the I/O interface 605: an input portion 606 including a keyboard, a mouse, and the like; an output portion 607 including a display such as a Cathode Ray Tube (CRT), a Liquid Crystal Display (LCD), and the like, and a speaker; a storage section 608 including a hard disk and the like; and a communication section 609 including a network interface card such as a LAN card, a modem, or the like. The communication section 609 performs communication processing via a network such as the internet. The driver 610 is also connected to the I/O interface 605 as needed. A removable medium 611 such as a magnetic disk, an optical disk, a magneto-optical disk, a semiconductor memory, or the like is mounted on the drive 610 as necessary, so that a computer program read out therefrom is mounted in the storage section 608 as necessary.

According to embodiments of the present disclosure, method flows according to embodiments of the present disclosure may be implemented as computer software programs. For example, embodiments of the present disclosure include a computer program product comprising a computer program embodied on a computer readable storage medium, the computer program containing program code for performing the method illustrated by the flow chart. In such an embodiment, the computer program may be downloaded and installed from a network through the communication section 609, and/or installed from the removable medium 611. The computer program, when executed by the processor 601, performs the above-described functions defined in the system of the embodiments of the present disclosure. The systems, devices, apparatuses, modules, units, etc. described above may be implemented by computer program modules according to embodiments of the present disclosure.

The present disclosure also provides a computer-readable storage medium, which may be contained in the apparatus/device/system described in the above embodiments; or may exist separately and not be assembled into the device/apparatus/system. The computer-readable storage medium carries one or more programs which, when executed, implement the method according to an embodiment of the disclosure.

According to an embodiment of the present disclosure, the computer-readable storage medium may be a non-volatile computer-readable storage medium. Examples may include, but are not limited to: a portable computer diskette, a hard disk, a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing. In the present disclosure, a computer readable storage medium may be any tangible medium that can contain, or store a program for use by or in connection with an instruction execution system, apparatus, or device.

For example, according to embodiments of the present disclosure, a computer-readable storage medium may include the ROM 602 and/or RAM 603 described above and/or one or more memories other than the ROM 602 and RAM 603.

Embodiments of the present disclosure also include a computer program product comprising a computer program containing program code for performing the method provided by the embodiments of the present disclosure, when the computer program product is run on an electronic device, the program code being adapted to cause the electronic device to carry out the application performance monitoring method provided by the embodiments of the present disclosure.

The computer program, when executed by the processor 601, performs the above-described functions defined in the system/apparatus of the embodiments of the present disclosure. The systems, apparatuses, modules, units, etc. described above may be implemented by computer program modules according to embodiments of the present disclosure.

In one embodiment, the computer program may be hosted on a tangible storage medium such as an optical storage device, a magnetic storage device, or the like. In another embodiment, the computer program may also be transmitted, distributed in the form of a signal on a network medium, downloaded and installed through the communication section 609, and/or installed from the removable medium 611. The computer program containing program code may be transmitted using any suitable network medium, including but not limited to: wireless, wired, etc., or any suitable combination of the foregoing.

In accordance with embodiments of the present disclosure, program code for executing computer programs provided by embodiments of the present disclosure may be written in any combination of one or more programming languages, and in particular, these computer programs may be implemented using high level procedural and/or object oriented programming languages, and/or assembly/machine languages. The programming language includes, but is not limited to, programming languages such as Java, C + +, python, the "C" language, or the like. The program code may execute entirely on the user computing device, partly on the user device, partly on a remote computing device, or entirely on the remote computing device or server. In the case of a remote computing device, the remote computing device may be connected to the user computing device through any kind of network, including a Local Area Network (LAN) or a Wide Area Network (WAN), or may be connected to an external computing device (e.g., through the internet using an internet service provider).

The flowchart and block diagrams in the figures illustrate the architecture, functionality, and operation of possible implementations of systems, methods and computer program products according to various embodiments of the present disclosure. In this regard, each block in the flowchart or block diagrams may represent a module, segment, or portion of code, which comprises one or more executable instructions for implementing the specified logical function(s). It should also be noted that, in some alternative implementations, the functions noted in the block may occur out of the order noted in the figures. For example, two blocks shown in succession may, in fact, be executed substantially concurrently, or the blocks may sometimes be executed in the reverse order, depending upon the functionality involved. It will also be noted that each block of the block diagrams or flowchart illustration, and combinations of blocks in the block diagrams or flowchart illustration, can be implemented by special purpose hardware-based systems which perform the specified functions or acts, or combinations of special purpose hardware and computer instructions. Those skilled in the art will appreciate that various combinations and/or combinations of features recited in the various embodiments and/or claims of the present disclosure can be made, even if such combinations or combinations are not expressly recited in the present disclosure. In particular, various combinations and/or combinations of the features recited in the various embodiments and/or claims of the present disclosure may be made without departing from the spirit or teaching of the present disclosure. All such combinations and/or associations are within the scope of the present disclosure.

The embodiments of the present disclosure have been described above. However, these examples are for illustrative purposes only and are not intended to limit the scope of the present disclosure. Although the embodiments are described separately above, this does not mean that the measures in the embodiments cannot be used in advantageous combination. The scope of the disclosure is defined by the appended claims and equivalents thereof. Various alternatives and modifications can be devised by those skilled in the art without departing from the scope of the present disclosure, and such alternatives and modifications are intended to be within the scope of the present disclosure.

Claims

1. An application performance monitoring method, comprising:

acquiring an initial interface template image and a target interface template image of an application;

acquiring a plurality of frames of images acquired in the conversion process of the application responding to a user request and converting an initial interface to a target interface, wherein each frame of image corresponds to an image frame number, and a preset time interval is formed between two adjacent frames of images;

determining a first image frame number of an image corresponding to the initial interface template image in the multi-frame images and a second image frame number of an image corresponding to the target interface template image in the multi-frame images;

calculating the response time of the application responding to the user request according to the first image frame serial number, the second image frame serial number and the preset time interval; and

the response time is monitored.

2. The method of claim 1, wherein obtaining the plurality of frames of images acquired by the application in response to a user request by a transition process from an initial interface to a target interface comprises:

acquiring a recorded video aiming at the conversion process; and

and converting the recorded video into the multi-frame image according to a preset script program.

3. The method of claim 1, wherein determining a first image frame number of an image of the plurality of images corresponding to the initial interface template image and a second image frame number of an image of the plurality of images corresponding to the target interface template image comprises:

calculating the similarity between the initial interface template image and each frame of image in the multiple frames of images to obtain a first similarity data set;

calculating the similarity between the target interface template image and each frame of image in the multiple frames of images to obtain a second similarity data set;

determining a maximum value in the first similarity dataset and a maximum value in the second similarity dataset;

taking the image frame number of the image corresponding to the maximum value in the first similarity data set as the first image frame number; and

and taking the image frame number of the image corresponding to the maximum value in the second similarity data set as the second image frame number.

4. The method of claim 2, wherein the plurality of images are acquired according to the playing process of the recorded video at the preset time interval and are sequentially stored, and calculating the response time of the application responding to the user request according to the first image frame number, the second image frame number and the preset time interval comprises:

calculating the difference value between the first image frame sequence number and the second image frame sequence number; and

and calculating the response time according to the difference value and the preset time interval.

5. The method of claim 1, wherein monitoring the response time comprises:

acquiring a preset response time threshold value of the application responding to the user request; and

and popping up warning information under the condition that the response time is greater than the preset response time threshold.

6. The method of claim 5, wherein obtaining a preset response time threshold for the application to respond to the user request comprises:

acquiring target response time of other applications of the same type as the application in response to the request of the same type as the user request; and

and determining the preset response time threshold according to the target response time.

7. An application performance monitoring device comprising:

the first acquisition module is used for acquiring an initial interface template image and a target interface template image of an application;

the second acquisition module is used for acquiring a plurality of frames of images acquired in the conversion process of the application responding to the user request and converting the initial interface into the target interface, wherein each frame of image corresponds to an image frame sequence number, and a preset time interval is reserved between every two adjacent frames of images;

the determining module is used for determining a first image frame number of an image corresponding to the initial interface template image in the multi-frame images and a second image frame number of an image corresponding to the target interface template image in the multi-frame images;

the computing module is used for computing the response time of the application responding to the user request according to the first image frame serial number, the second image frame serial number and the preset time interval; and

and the monitoring module is used for monitoring the response time.

8. A computer system, comprising:

one or more processors;

a memory for storing one or more programs,

wherein the one or more programs, when executed by the one or more processors, cause the one or more processors to implement the method of any of claims 1-6.

9. A computer readable storage medium having stored thereon executable instructions which, when executed by a processor, cause the processor to carry out the method of any one of claims 1 to 6.

10. A computer program product comprising computer executable instructions for implementing the method of any one of claims 1 to 6 when executed.