CN111198797A - Operation monitoring method and device and operation analysis method and device - Google Patents

Operation monitoring method and device and operation analysis method and device Download PDF

Info

Publication number
CN111198797A
CN111198797A CN201911380429.7A CN201911380429A CN111198797A CN 111198797 A CN111198797 A CN 111198797A CN 201911380429 A CN201911380429 A CN 201911380429A CN 111198797 A CN111198797 A CN 111198797A
Authority
CN
China
Prior art keywords
information
terminal
response
interface
application program
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN201911380429.7A
Other languages
Chinese (zh)
Other versions
CN111198797B (en
Inventor
张�杰
叶锋
熊斐
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Huawei Cloud Computing Technologies Co Ltd
Original Assignee
Huawei Technologies Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Huawei Technologies Co Ltd filed Critical Huawei Technologies Co Ltd
Priority to CN201911380429.7A priority Critical patent/CN111198797B/en
Publication of CN111198797A publication Critical patent/CN111198797A/en
Priority to PCT/CN2020/133429 priority patent/WO2021129335A1/en
Application granted granted Critical
Publication of CN111198797B publication Critical patent/CN111198797B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F11/00Error detection; Error correction; Monitoring
    • G06F11/30Monitoring
    • G06F11/3003Monitoring arrangements specially adapted to the computing system or computing system component being monitored
    • G06F11/302Monitoring arrangements specially adapted to the computing system or computing system component being monitored where the computing system component is a software system
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F11/00Error detection; Error correction; Monitoring
    • G06F11/30Monitoring
    • G06F11/34Recording or statistical evaluation of computer activity, e.g. of down time, of input/output operation ; Recording or statistical evaluation of user activity, e.g. usability assessment
    • G06F11/3438Recording or statistical evaluation of computer activity, e.g. of down time, of input/output operation ; Recording or statistical evaluation of user activity, e.g. usability assessment monitoring of user actions

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Quality & Reliability (AREA)
  • General Physics & Mathematics (AREA)
  • Computing Systems (AREA)
  • Computer Hardware Design (AREA)
  • Mathematical Physics (AREA)
  • Debugging And Monitoring (AREA)

Abstract

The application discloses an operation monitoring method and an operation analysis method, and belongs to the technical field of data processing. The method comprises the following steps: receiving a plurality of pieces of monitoring information sent by a terminal, wherein each piece of monitoring information comprises an identifier of the terminal, an identifier of an application program to which an interface of the application program displayed by the terminal belongs, operation time of an operation executed on the interface by a user, and operation information used for indicating the operation; and generating an operation track of the operation executed on the interface of the application program displayed on the terminal according to the monitoring information, wherein the operation track is recorded according to the operation time of the operation. The method and the device can analyze the operation executed by the user on the front-end interface of the application program.

Description

Operation monitoring method and device and operation analysis method and device
Technical Field
The present application relates to the field of data processing technologies, and in particular, to an operation monitoring method and apparatus, and an operation analysis method and apparatus.
Background
With the diversification of user requirements and the development of software technology, user operations to be executed in the process of accessing the application programs are more and more complicated. In addition, in order to improve user experience, the application service provider can also analyze operations generated by the user in the process of accessing the application program, so that the service performance of the application program can be improved according to the analysis result.
In the related art, when analyzing an operation generated in a process of accessing an application program by a user, it is generally required to first obtain a call record of an interface in a process of accessing the application program by the user using a terminal, then estimate an operation generated in the process by the user according to the call record, and then analyze the operation according to the operation. For example, in the process that a user remotely logs in a console through a terminal, when the user selects to enter the remote login in a terminal display interface, the terminal may initiate the call of the designated interface to the background for multiple times, so that when the call record includes the call record for calling the designated interface for multiple times, it can be estimated that the user performs the operation of selecting to enter the remote login in the terminal display interface, and the analysis is performed according to the operation.
However, this analysis process can only perform analysis according to an interface called by the application when the application is executed in the background, and cannot reflect an operation performed by the user on the front-end interface of the application, so that the operation performed by the user on the front-end interface cannot be analyzed.
Disclosure of Invention
The application provides an operation monitoring method and device and an operation analysis method and device, which can be used for analyzing the operation executed by a user on a front-end interface of an application program.
In a first aspect, the present application provides an operation monitoring method, which is applied to a terminal, and includes: when detecting that the terminal displays the interface of the application program, recording the identifier of the terminal and the identifier of the application program; when detecting that a user executes operation on an interface, recording operation time of the operation and operation information for indicating the operation; and sending monitoring information to the server, wherein the monitoring information comprises the identifier of the terminal, the identifier of the application program, the operation information and the operation time.
In the operation monitoring method provided by the embodiment of the application, the monitoring information including the identifier of the terminal, the identifier of the application program, the operation information and the operation time is recorded and sent to the server, and the monitoring information can truly reflect the operation executed by the user on the front-end interface of the application program, so that the server can analyze the operation executed by the user in the interface according to the monitoring information, and the accuracy of analyzing the operation executed by the user in the interface can be effectively ensured.
Optionally, to ensure the integrity of the monitoring information, the method further includes: when detecting that a user executes operation on the interface, generating operation response to the operation; the response time for generating the operation response and response information indicating the operation response are recorded. Correspondingly, the monitoring information further comprises response information and response time.
In one implementation, the operational information includes: type information for indicating an operation type of the operation and position information for indicating a position where the operation acts in the interface. The type information is used to indicate what operation the user inputs. From the type information and the location information, it can be determined what operation the user performed in the terminal and where the operation acted in the interface of the application.
Optionally, the operation information may further include: the information processing device comprises configuration information used for indicating the display interface of the terminal and indication information used for indicating the type of the information. The indication information of a certain piece of information is used for indicating that the information is operation information or response information. The configuration information is used for indicating a display environment when the terminal displays the interface and an operation environment when the terminal executes the operation, and when the operation information also comprises the configuration information, the display environment when the terminal displays the interface and the operation environment when the terminal executes the operation can be conveniently simulated according to the configuration information, so that the accuracy of the simulation operation is improved.
In addition, in addition to the operation information and the response information, the monitoring information may further include information such as a user identifier, so that the server can more fully know the operation environment when performing the operation on the terminal.
In one implementation, the response information may include: the waiting time from the operation time of the receiving operation to the response time of the generating response, indication information indicating success or failure of the response, indication information indicating the type of the information, and the like. The indication information is used for indicating that the information is operation information or response information. And, when the terminal generates an operation response to the operation and sends the API call request, the response information may further include: interface information for an application program interface invoked when a response is generated for an operation. Alternatively, the interface information may be an identification of the application program interface.
In one implementation manner, the terminal may obtain the operation information for instructing the operation in the following manner: and acquiring operation information according to the parameters according to which the application program generates operation response to the operation. For example, the terminal may directly use the parameter according to which the application program generates the operation response to the operation as the operation information for instructing the operation.
In one implementation manner, the terminal may obtain the response information for indicating the operation response in the following manner: the terminal detects an operation response aiming at an operation after receiving the operation executed on the interface, and records response information for indicating the response when detecting that the operation response is generated to the operation.
In a second aspect, the present application provides an operation analysis method, which is applied to a server, and includes: receiving a plurality of pieces of monitoring information sent by a terminal, wherein each piece of monitoring information comprises an identifier of the terminal, an identifier of an application program to which an interface of the application program displayed by the terminal belongs, operation time of an operation executed on the interface by a user, and operation information used for indicating the operation; and generating an operation track of the operation executed on the interface of the application program displayed by the terminal according to the monitoring information, wherein the operation track is recorded according to the operation time of each operation.
In the operation analysis method provided by the embodiment of the application, the server receives the monitoring information sent by the terminal, generates the operation track of the operation according to the monitoring information, and analyzes the operation executed by the user in the interface according to the operation track.
Optionally, each monitoring information further includes: and the response information is used for indicating the terminal to respond to the operation recorded by the monitoring information and the time for generating the response.
Correspondingly, according to the multiple pieces of monitoring information, an operation track of an operation executed on an interface of an application program displayed by the terminal is generated, and the operation track comprises the following steps: and generating a process of executing the operation recorded by each monitoring information on an interface of the application program recorded by each monitoring information displayed by the terminal according to the monitoring information, and responding according to the operation.
In an application scenario, after generating the operation trajectory, the method further comprises: generating a script program according to the operation track, and executing the script program to simulate the operation which is recorded in the operation track and is executed on the interface; or generating a script program according to the operation track, executing the script program to simulate the operation which is recorded in the operation track and is executed on the interface, and responding according to the operation.
The application scene is an application scene for performing scene simulation on the operation executed on the interface. In one scenario of the scenario simulation, the server performs the scenario simulation on the operation recorded in the operation track of a certain terminal, and the server can know the specific situation of each operation link in the process of implementing the operation at the terminal, and perform analysis operations such as operation process audit and operation fault location on the process of executing the operation on the terminal according to the specific situation.
Since the specific situation occurring in the process of executing the operation by the terminal can be known through the scene simulation, compared with the related technology which cannot acquire the specific situation occurring in the operation process, the details in the process of executing the operation by the terminal can be more clearly determined by analyzing the process of executing the operation by the terminal according to the specific situation, and the accuracy of analysis can be effectively ensured.
In another scenario of the scene simulation, the server may perform the scene simulation on the operations recorded by the operation tracks of the plurality of terminals, respectively, simulate a plurality of terminals to access the response server, request the response server to provide a real access process of the service to the corresponding terminal, and perform the performance test on the response server according to the simulated real access process.
The access process simulated through the scene is closer to the real access process, so that the specific situation in the real access process can be accurately reflected, the result of the performance test of the server by the access process simulated according to the scene is closer to the influence of the access process in the real access process on the performance of the server, and the service performance of the server can be accurately and effectively improved when the service performance of the server is optimized and responded according to the test result.
In a third aspect, the present application provides an operation monitoring device comprising: the recording module is used for recording the identifier of the terminal and the identifier of the application program when detecting that the terminal displays the interface of the application program; the recording module is further used for recording operation time of the operation and operation information used for indicating the operation when detecting that the user executes the operation on the interface; and the sending module is used for sending monitoring information to the server, wherein the monitoring information comprises the identifier of the terminal, the identifier of the application program, the operation information and the operation time.
Optionally, the apparatus further comprises: and the response module is used for generating operation response to the operation when detecting that the user executes the operation on the interface. Correspondingly, the recording module is also used for recording the response time for generating the operation response and the response information for indicating the operation response. And responding information and responding time when detecting that the user performs the operation on the interface.
Optionally, the operation information includes: type information for indicating an operation type of the operation and position information for indicating a position where the operation acts in the interface.
Optionally, the response information includes: and when a response is generated aiming at the operation, the interface information of the called application program interface is obtained.
In a fourth aspect, the present application provides an operation analysis apparatus comprising: the terminal comprises a receiving module, a processing module and a display module, wherein the receiving module is used for receiving a plurality of pieces of monitoring information sent by the terminal, and each piece of monitoring information comprises an identifier of the terminal, an identifier of an application program to which an interface of the application program displayed by the terminal belongs, operation time of an operation executed on the interface by a user, and operation information used for indicating the operation; and the generating module is used for generating an operation track of the operation executed on the interface of the application program displayed by the terminal according to the monitoring information, and the operation track is recorded according to the operation time of each operation.
Optionally, the apparatus further comprises: the processing module is used for generating a script program according to the operation track;
and the processing module is used for executing the script program to simulate the operation which is recorded in the operation track and is executed on the interface.
Optionally, each monitoring information further includes: response information for indicating a response to the operation recorded by the monitoring information by the terminal, and a time for generating the response. Correspondingly, the operation track also comprises response information and response time.
In a fifth aspect, the present application provides a computing device comprising a processor and a memory; the memory has a computer program stored therein; when the processor executes the computer program, the computing device implements the operation monitoring method provided by the first aspect.
In a sixth aspect, the present application also provides another computing device comprising a processor and a memory; the memory has a computer program stored therein; when the processor executes the computer program, the computing device implements the operation analysis method provided by the second aspect.
In a seventh aspect, the present application provides a non-volatile storage medium, and when instructions in the storage medium are executed by a processor, the operation monitoring method provided in the first aspect is implemented.
In an eighth aspect, the present application further provides another non-volatile storage medium, and when instructions in the storage medium are executed by a processor, the operation analysis method provided in the second aspect is implemented.
Drawings
FIG. 1 is a schematic diagram of an application scenario to which embodiments of the present application relate;
FIG. 2 is a flow chart of a method for monitoring operation provided by an embodiment of the present application;
FIG. 3 is a flow chart of a method of operation analysis provided by an embodiment of the present application;
FIG. 4 is a schematic structural diagram of an operation monitoring device according to an embodiment of the present disclosure;
FIG. 5 is a schematic diagram of another operation monitoring device according to an embodiment of the present disclosure;
FIG. 6 is a schematic structural diagram of an operation analysis apparatus according to an embodiment of the present application;
fig. 7 is a schematic structural diagram of another operation analysis apparatus provided in the embodiment of the present application.
Detailed Description
To make the objects, technical solutions and advantages of the present application more clear, embodiments of the present application will be described in further detail below with reference to the accompanying drawings.
Fig. 1 is a schematic diagram of an application scenario according to an embodiment of the present application. As shown in fig. 1, the application scenario includes: a terminal 10 and a server 11. Wherein a communication connection is established between the terminal 10 and the server 11 through a wired or wireless network. The terminal 10 may be a computer, a personal computer, a cloud host, a portable mobile terminal 10, a multimedia player, an electronic book reader, a wearable device, or the like. The server 11 may be a server 11, a server 11 cluster composed of several servers 11, or a cloud computing service center.
An application may be installed in the terminal 10. The terminal 10 may display an interface of an application program, receive an operation performed by a user in the interface, and perform the operation monitoring method provided in the embodiment of the present application. For example, when detecting that the terminal 10 displays an interface of an application, the terminal 10 may record the identifier of the terminal 10 and the identifier of the application. Also, when detecting an operation performed by a user on the interface of the application, the terminal 10 may record operation time of the operation and operation information indicating the operation, and transmit monitoring information including an identifier of the terminal 10, an identifier of the application, the operation time, and the operation information to the server 11.
The server 11 is configured to execute the operation analysis method provided in the embodiment of the present application. For example, the server 11 may receive the monitoring information sent by the terminal 10, and generate a process for executing the operation recorded by the plurality of monitoring information on the interface of the application program displayed by the terminal 10 according to the plurality of monitoring information. Further, the server 11 may generate a script program according to the generated operation trajectory, and perform operation analysis on the operation performed on the interface by executing the script program to simulate the operation performed on the interface recorded in the operation trajectory.
Because the monitoring information comprises information such as operation information and operation time for indicating the operation performed by the user on the interface, and the monitoring information can truly reflect the operation performed by the user on the front-end interface of the application program, the operation track generated according to the monitoring information can truly reflect the operation performed by the user in the interface, and when the operation performed by the user in the interface is analyzed according to the operation track, the accuracy of analyzing the operation performed by the user in the interface can be ensured.
Further, as shown in fig. 1, the terminal 10 includes a first processor 101, a first communication interface 102 and a first memory 103. The first processor 101, the first communication interface 102 and the first memory 103 are connected to each other via a first bus 104. The server 11 comprises a second processor 111, a second communication interface 112 and a second memory 113. The second processor 111, the second communication interface 112 and the second memory 113 are connected to each other via a second bus 114.
The first memory 103 and the second memory 113 are each used for storing computer programs. And the computer program can be an application program, and the processor can realize the functions of the application program when calling the application program in the corresponding memory. For example, when the first processor 101 calls the application program in the first memory 103, the terminal 10 can implement the operation monitoring method provided by the embodiment of the present application. When the second processor 111 calls the application program in the second memory 113, the server 11 can implement the operation analysis method provided by the embodiment of the present application.
In fig. 1, any one of the first bus 104 and the second bus 114 may be divided into an address bus, a data bus, a control bus, and the like. For ease of illustration, only one thick line is shown in FIG. 1, but it is not intended that there be only one bus or one type of bus.
In fig. 1, any one of the first processor 101 and the second processor 111 may be a hardware chip, which may be an application-specific integrated circuit (ASIC), a Programmable Logic Device (PLD), or a combination thereof. The PLD may be a Complex Programmable Logic Device (CPLD), a field-programmable gate array (FPGA), a General Array Logic (GAL), or any combination thereof. Alternatively, the processor may be a general-purpose processor, such as a Central Processing Unit (CPU), a Network Processor (NP), or a combination of a CPU and an NP.
In fig. 1, the first memory 103 and the second memory 113 may include a volatile memory (volatile memory), such as a random-access memory (RAM); non-volatile memory (non-volatile memory) may also be included, such as flash memory, Hard Disk Drive (HDD) or solid-state drive (SSD); combinations of the above categories of memory may also be included.
It should be noted that the operation analysis method provided in this embodiment of the present application may also be executed by a virtual machine, or may also be executed by a part of the server 11 and a part of the virtual machine, which is not specifically limited in this embodiment of the present application. For example, the server 11 may receive a plurality of pieces of monitoring information transmitted by the terminal 10, and generate an operation trajectory of an operation performed on an interface of an application displayed by the terminal 10 based on the plurality of pieces of monitoring information. The virtual machine can analyze the operation indicated by the operation information in the plurality of monitoring information according to the operation track.
Fig. 2 is a flowchart of an operation monitoring method according to an embodiment of the present application. As shown in fig. 2, the method may include the steps of:
step 201, the terminal receives a designation operation for instructing to display an interface of an application program, which is input by a user, and displays the interface of the application program in the terminal according to the designation operation.
In the process of using the terminal by the user, if the user needs to execute an operation in a certain interface of a certain application program installed in the terminal, the user can execute a specified operation on the terminal to instruct the terminal to display the interface of the application program. After receiving the specified operation, the terminal may display the interface of the application program in a display screen of the terminal according to the specified operation.
Step 202, when detecting that the terminal displays the interface of the application program, the terminal acquires and records the identifier of the terminal and the identifier of the application program.
The terminal is preset with an information acquisition application program. The information acquisition application can detect whether the terminal is displaying the interface of the application. When the interface of the terminal display application program is detected, the information acquisition application program can acquire and record the identifier of the terminal and the identifier of the application program.
And, the terminal may execute the information acquisition application for one or more applications that need monitoring operations installed in the terminal. That is, when the terminal displays an interface of any application program that needs to be monitored and operated, the terminal can obtain the identifier of the terminal and the identifier of the application program through the information obtaining application program.
Or, for one or more application programs needing monitoring operation installed in the terminal, an information acquisition application program may be embedded in each application program needing monitoring operation, so that when the terminal displays an interface of any application program needing monitoring operation, the information acquisition application program embedded in any application program needing monitoring operation is used to acquire information such as an identifier of the application program.
Optionally, the implementation manner of the terminal acquiring the identifier of the terminal may be: the information acquisition application program acquires an identification number of designated hardware or an identification number of designated software in the terminal, and takes part or all of the identification number as the identification of the terminal. For example, the information acquisition application may acquire a serial number of a Central Processing Unit (CPU) used by the terminal, and use part or all of the serial number as an identifier of the terminal. For another example, the information obtaining application may obtain a Universally Unique Identifier (UUID) of the terminal, and use part or all of the UUID as an identifier of the terminal. For another example, the information acquisition application may acquire a serial number of an operating system used by the terminal, and use part or all of the serial number of the operating system as the identifier of the terminal.
Alternatively, the information acquisition application may process the identification number of the designated hardware or the identification number of the designated software, and use the processed identification number as the identifier of the terminal. For example, the information obtaining application program may intercept the last 10 bits of the serial number of the central processing unit used by the terminal, and add 5 random numbers to the tail of the last 10 bits of the serial number, and a digital sequence formed by the last 10 bits of the serial number and the tail of the serial number added with 5 random numbers is the identifier of the terminal.
Alternatively, the identification of the application may be a randomly generated number having a specified total number of digits. Correspondingly, the implementation manner of the terminal acquiring the identifier of the application program may be as follows: when the information acquisition application program detects an interface of a terminal display application program, a random number with the appointed total number is generated, and the random number with the appointed total number is determined as the identifier of the application program.
It should be noted that, both the total number of bits of the identifier of the terminal and the total number of bits of the identifier of the application program may be determined according to application requirements, and this embodiment of the present application does not specifically limit this. For example, the total number of bits of the identification of the terminal may be 128 bits, and the total number of bits of the identification of the application may be 10 bits.
Step 203, when it is detected that the user performs the operation on the interface, the terminal acquires and records the operation time of the operation and the operation information for indicating the operation.
The terminal can acquire and record the operation time and the operation information by adopting an information acquisition application program preset in the terminal. Moreover, after receiving an operation executed by a user in the interface, the terminal generates a reaction for the operation, and the reaction is generated by the terminal according to the detected relevant parameters of the operation, so that after the terminal acquires the relevant parameters of the operation, the information acquisition application program can acquire the relevant parameters and obtain the operation time and the operation information according to the relevant parameters. Alternatively, the information acquisition application may determine the response time and the response information according to the detected response when the detected response is generated for the operation. The setting mode of the information obtaining application program used in step 203 may refer to the setting mode of the information obtaining application program in step 202.
Wherein the operation information includes: type information for indicating an operation type of the operation and position information for indicating a position where the operation acts in the interface. The type information is used to indicate what operation the user inputs. From the type information and the location information, it can be determined what operation the user performed in the terminal and where the operation acted in the interface of the application. For example, the type information of the operation type may indicate that the operation is a single-click operation of a left mouse button, a double-click operation of a left mouse button, a right mouse button, a double-click operation, a scroll wheel operation of a mouse, an input operation of a certain button in a keyboard, or the like. Further, the terminal may be provided with a coordinate system in advance, and the abscissa and the ordinate of the position of the operation on the interface may be determined from the coordinate system, and the position information may be expressed using the abscissa and the ordinate.
For example, when the user inputs the key code "M" at the cursor position in the interface using the keyboard, among the operation information indicating the operation, the type information is used to indicate the operation in which the key code "M" is input by the keyboard, and the position information is used to indicate the position of the cursor. For another example, when the user clicks the left button at a certain position in the interface using the mouse, among the operation information indicating the operation, the type information is used to indicate the operation of clicking the left button with the mouse, and the position information is used to indicate the certain position.
Optionally, the operation information may further include: the information processing device comprises configuration information used for indicating the display interface of the terminal and indication information used for indicating the type of the information. The indication information is used for indicating that the information is operation information or response information. The configuration information includes: configuration information of the terminal and configuration information of the application. The configuration information of the terminal may include: resolution of the terminal, an Internet Protocol (IP) address of the terminal, a network type used by the terminal, and an operating system used by the terminal. The configuration information of the application may include: type information of the application, version information of the application, and display resolution of the application. The configuration information used for indicating the terminal to display the interface is used for indicating the display environment of the terminal when the interface is displayed and the operation environment when the operation is executed, and when the operation information also comprises the configuration information, the display environment of the terminal when the interface is displayed and the operation environment when the operation is executed can be conveniently simulated according to the configuration information, so that the accuracy of the simulation operation is ensured. For example, the network environment in which the terminal is located can be determined from the IP address of the terminal, the network provider of the network used by the terminal when responding according to the operation, the bandwidth of the network, and the like can be determined. In addition, in addition to the operation information and the response information, the monitoring information may further include information such as a user identifier, so that the server can more fully know the operation environment when performing the operation on the terminal.
For example, the configuration information of the terminal may include: the resolution of the terminal is 1920 × 1080, the network used by the terminal is the network provided by the AA network operator, and the operating system used by the terminal is the Windows10 system. The configuration information of the application may include: the type of the application program is a network service type (such as a browser), the version information of the application program is version7.0.9, and the display resolution of the application program is 1920 × 1080.
And step 204, the terminal generates operation response to the operation according to the operation information and the interface.
After detecting that a user executes an operation on an interface, the terminal can determine a function which the user wants to realize when executing the operation according to the operation information of the operation and the content of the interface, and generate an operation response to the operation, so as to realize the function which the user wants to realize. The terminal generates an operation response according to the operation, which means that the terminal receives a reaction generated by the operation according to the operation after receiving the operation.
In one implementation, when the function indicated by the operation needs to be implemented in cooperation with a server (hereinafter referred to as a response server), the operation response generated by the terminal for the operation may be to generate an operation request for requesting the response server to provide the terminal with a service required to implement the function indicated by the operation, and to transmit the operation request to the response server. Illustratively, the operation request may be an Application Programming Interface (API) call request. For example, assuming that the operation performed by the user in the browser interface is to click a login button in the browser interface, since the implementation of the login operation requires the response server to provide a series of services such as authentication to the terminal, and the series of services requires the response server to call the API implementation. At this time, the terminal generates an operation response to the operation, generates an API call request requesting the response server to provide a series of services such as authentication, and transmits the API call request to the response server.
In another implementation manner, when the terminal itself can implement the function indicated by the operation, the terminal responds to the operation generated by the operation to execute the function indicated by the operation for the terminal. For example, assuming that the operation performed by the user in the word processing application program interface is to select a part of the text and instruct highlighting of the part of the text, since the terminal itself can implement the function of highlighting the text, it can be determined that the operation response generated by the terminal to the operation is to highlight the part of the text.
Step 205, when detecting that an operation response is generated to the operation, the terminal acquires and records response time for generating the operation response and response information for indicating the operation response.
The terminal can acquire and record the response time and the response information by adopting an information acquisition application program preset in the terminal. Moreover, when the terminal generates a response to the operation, the generated response needs to be executed by a component in the terminal, and the component is executed according to the corresponding indication parameter when executed, so that the information acquisition application program can determine the response information according to the indication parameter. Meanwhile, the time for the component to execute the response is the response time, so that the time when the information acquisition application program detects that the operation response is generated to the operation is the response time. The setting mode of the information obtaining application program used in step 205 may refer to the setting mode of the information obtaining application program in step 202.
Wherein the response information may include: the waiting time from the operation time of the receiving operation to the response time of the generating response, indication information indicating success or failure of the response, indication information for indicating the type of the information, and the like. The indication information is used for indicating that the information is operation information or response information. And, when the terminal generates an operation response to the operation and sends the API call request, the response information may further include: interface information for an application program interface requested to be called when a response is generated for an operation. Alternatively, the interface information may be an identification of the application program interface (API ID).
It should be noted that, the step 204 and the step 205 are optional steps, and when the monitoring method for the application provided in the embodiment of the present application is executed, whether to execute the step 204 and the step 205 may be selected according to application requirements. In addition, the terminal may also acquire the operation information and the response information in a sampling manner, in this case, the operation information may further include a sampling frequency when the terminal acquires the operation information, and the response information may further include a sampling frequency when the terminal acquires the operation information.
And step 206, the terminal sends the monitoring information to the server.
Wherein the monitoring information includes: identification of the terminal, identification of the application, operation information and operation time. At this time, the terminal may transmit monitoring information including an identification of the terminal, an identification of the application program, operation information, and operation time to the server. Alternatively, when performing step 204 and step 205, the monitoring information may further include: response information and response time. Correspondingly, the process of sending the monitoring information to the server by the terminal comprises the following steps: the terminal transmits monitoring information including the identifier of the terminal, the identifier of the application program, operation information, operation time, response information and response time to the server.
Because the monitoring information includes various information, the implementation manner of sending the monitoring information to the server by the terminal may be various. For example, the terminal may transmit a variety of information including an identification of the terminal, an identification of an application program, operation information, and operation time to the server at once every time the terminal transmits the information to the server. Alternatively, the terminal may transmit the plurality of types of information to the server in a plurality of transmission processes, respectively. And the time for the terminal to send the monitoring information to the server can also be determined according to the actual requirement. For example, the terminal may send the monitoring information to the server in real time, that is, the terminal may send the information to the server after acquiring each type of information. Or, the terminal may periodically send the monitoring information to the server, that is, after each information acquisition period, the terminal may send the monitoring information acquired in the information acquisition period to the server.
Optionally, the terminal may further generate a check code during the process of recording the information, and send the check code to the server together when sending the monitoring information to the server. The check code is used for checking whether the monitoring information is tampered or not so as to ensure the accuracy of the monitoring information. Correspondingly, after receiving the monitoring information and the check code, the server can generate the check code according to the monitoring information according to a check mode agreed with the terminal in advance, compare the check code generated by the server with the check code sent by the terminal, determine that the monitoring information is not tampered when the check code generated by the server is the same as the check code sent by the terminal, determine that the monitoring information is tampered when the check code generated by the server is different from the check code sent by the terminal, and discard the monitoring information.
In summary, in the operation monitoring method provided in the embodiment of the present application, by recording the monitoring information including the identifier of the terminal, the identifier of the application program, the operation information, and the operation time, and sending the monitoring information to the server, since the monitoring information can truly reflect the operation performed by the user on the front-end interface of the application program, the server can analyze the operation performed by the user in the interface according to the monitoring information, and can effectively ensure the accuracy of analyzing the operation performed by the user in the interface.
Fig. 3 is a flowchart of an operation analysis method according to an embodiment of the present application. As shown in fig. 3, the method may include the steps of:
step 301, the server receives a plurality of monitoring information sent by the terminal, where each monitoring information at least includes an identifier of the terminal, an identifier of an application program to which an interface of the application program displayed by the terminal belongs, an operation time of an operation executed by a user on the interface, and operation information for indicating the operation.
Optionally, each monitoring information may further include: a response time for generating a response to the operation information and response information indicating the generated response.
It should be noted that, after the server receives the monitoring information, the server may first preprocess the monitoring information, and then store the preprocessed monitoring information for subsequent use. For example, after receiving a data stream including a plurality of pieces of monitoring information, the server may perform message processing on the data stream by using a message processing module in the server, then perform stream processing operations such as data screening, data checking, and data classification on the monitoring information subjected to the message processing by using the stream processing module in the server, and then store the monitoring information subjected to the stream processing operations in a database. And when the data verification result indicates that the monitoring information is tampered, an alarm module in the server can send out alarm information. Meanwhile, the server may further include a storage module configured to store raw data of the plurality of pieces of monitoring information received from the terminal, and a management module configured to manage each module in the server. The message processing module may be a card (kafka) message processing system, and the database may be a time series database (tsdb).
Step 302, the server generates an operation track of the operation executed on the interface displayed by the terminal according to the monitoring information.
The server may generate, according to the plurality of pieces of monitoring information, operation trajectories for executing operations recorded in the plurality of pieces of monitoring information on the interface displayed by the terminal in an order from early to late of operation times of operations recorded in different pieces of monitoring information. Or, the plurality of monitoring information may be first screened according to a specified screening policy, and then an operation trajectory may be generated according to the screened monitoring information. The specified policy may be determined according to an analysis purpose of a subsequent analysis of the operation behavior. For example, when the operation behavior of the user when the terminal runs the same application program needs to be analyzed, the server may screen the monitoring information carrying the identifier of the same application program in the terminal, and generate an operation trajectory according to the monitoring information carrying the same application program. For another example, when the server receives a plurality of monitoring information sent by a plurality of terminals and needs to analyze an operation behavior executed in the same terminal, the server may screen the monitoring information carrying the identifier of the same terminal from the terminals and generate an operation trajectory according to the monitoring information carrying the identifier of the same terminal.
Wherein, when the monitoring information includes: when the identifier of the terminal, the identifier of the application program, the operation information, and the operation time are used, the operation trajectory may be regarded as a time-sequence description of a process of executing an operation recorded by corresponding monitoring information in an interface of the application program in which the terminal displays a plurality of monitoring information records, respectively. When the monitoring information further includes: when the identifier of the terminal, the identifier of the application program, the operation information, the operation time, the response information, and the response time are determined, the operation trajectory may be regarded as an interface where the application programs recorded by the plurality of monitoring information are respectively displayed on the terminal, the operation is performed in each interface, and the time-series description of the process of responding is performed according to each operation.
Illustratively, table 1 shows a plurality of monitoring information acquired by the terminal after the user identified as XP-0012738 performs an operation in the terminal. Each monitoring information includes: the identification of the terminal, the identification of the application program, the operation time and the operation information of the executed operation, and the response information and the response time of the response generated by the terminal according to the operation. These are described below:
when a user needs the terminal to display an interface of a certain application program, the user can execute a specified operation, and after the terminal receives the specified operation, the terminal displays the interface of the application program in a display screen according to the specified operation. At this time, the terminal may acquire and record the identifier 191191919.. 182783 (not shown in table 1) of the terminal and the identifier of the application (not shown in table 1). When the terminal detects that the user clicks a remote connection button in the interface by using the mouse in 20:29:17, the terminal can determine the action position of the mouse clicking operation in the interface as the position of the remote connection button displayed in the interface. At this time, as shown in table 1, the terminal acquires and records operation information (referred to as first operation information for convenience of distinction) indicating the operation as a mouse click "remote connection", and the operation time is 20:29: 17. The function of the "remote connection" is to establish a remote connection between the terminal and the remote console.
After the terminal receives the operation of clicking the remote connection button by the mouse, the terminal can display a console page with a Uniform Resource Locator (URL) address of http:// in. The terminal jump display console page can be regarded as an operation response (for convenience of distinguishing, referred to as a first operation response) generated by the terminal according to the operation of clicking a remote connection button by a mouse.
After the terminal generates the first operation response, as shown in table 1, the terminal acquires and records that the response time of the first operation response is 20:29:20, and the first response information for indicating the first operation response is: the page jumps to a console page with URL address http:// in.
Also, in order to establish a remote connection, the terminal needs to acquire a URL address of the remote console and transmit a remote connection establishment request to the remote console. Therefore, in the process of displaying the console page by the terminal, the terminal further needs to send an API call request for obtaining the URL address of the remote console to the remote server, and after obtaining the URL address of the remote console, send a remote connection establishment request to the remote console according to the URL address of the remote console. And, before transmitting the remote connection establishment request, the terminal may further transmit an API call request for detecting a service state of the remote console to the remote server.
In which, the terminal sends an API call request for obtaining the URL address of the remote console to the remote server, which may be regarded as an operation response (referred to as a second operation response for convenience of distinction) generated by the terminal according to an operation of clicking a "remote connect" button with a mouse. After the terminal generates the second operation response, as shown in table 1, the terminal acquires and records that the response time of the second operation response is 20:29:21, and the second response information for indicating the second operation response is: and initiating an API call request for acquiring the URL address of the remote console.
The terminal transmits an API call request for detecting a service status of the remote console, which may be regarded as an operation response (referred to as a third operation response for convenience of distinction) generated by the terminal according to an operation of clicking a "remote connect" button with a mouse, to the remote server. After the terminal generates the third operation response, as shown in table 1, the terminal acquires and records that the response time of the third operation response is 20:29:22, and the third response information for indicating the third operation response is: an API call request is initiated to detect a service status of the remote console.
The terminal sends a remote connection establishment request to the remote console, which may be regarded as an operation response (referred to as a fourth operation response for convenience of distinction) generated by the terminal according to an operation of clicking a "remote connection" button with a mouse. After the terminal generates the fourth operation response, as shown in table 1, the terminal acquires and records that the response time of the fourth operation response is 20:29:23, and the fourth response information for indicating the fourth operation response is: a remote connection establishment request is initiated.
Further, after the terminal sends the API call request to the remote server, the remote server may also send information to the terminal to reflect whether the API call request successfully calls the corresponding interface. Accordingly, the information reflecting whether the API call request successfully calls the corresponding interface may also be recorded in the corresponding response information (not shown in table 1). For example, after the terminal sends the API call request for obtaining the URL address of the remote console to the remote server, if the remote server successfully calls the corresponding interface according to the API call request, the remote server may send a status code "200" indicating that the interface was successfully called to the terminal, and then may record information indicating that the call request 200 is correct in the second response information of the second operation response. For another example, after the terminal transmits an API call request for detecting a service state of the remote console to the remote server, if the remote server fails to call a corresponding interface according to the API call request, the remote server may transmit a status code "404" indicating that the interface was called and failed to the terminal, and may record information indicating that the call request 404 is erroneous in the fourth response information of the fourth operation response.
Up to this point, the terminal has acquired monitoring information generated according to a user's operation of clicking a "remote connection" button in the interface using a mouse. As shown in table 1, the monitoring information includes: the first operation information and the operation time, the first response information and the response time, the second response information and the response time, the third response information and the response time, and the fourth response information and the response time.
After the remote connection is established between the terminal and the remote console, the user also inputs a new user command in the console page through the keyboard, namely respectively inputs 'a','d', 'u','s', 'e' and 'r' by using the keyboard. When an operation of inputting one character from the keyboard is regarded as one input operation, the operation of inputting a new user command may be regarded as seven input operations being performed, and accordingly, each piece of acquired monitoring information may include operation information indicating one input operation and an operation time. Wherein the second operation information for instructing an operation of inputting "a" using the keyboard is: the keyboard inputs a key code key 'a' and the operation time is 20:29: 35. The third operation information for instructing an operation of inputting "d" using the keyboard is: the keyboard inputs a key code "d", and the operation time is 20:29: 36. The fourth operation information for instructing an operation of inputting "d" using the keyboard is: the keyboard inputs a key code "d", and the operation time is 20:29: 37. The fifth operation information for instructing an operation of inputting "u" using the keyboard is: the keyboard inputs a key code key 'u' and the operation time is 20:29: 38. The sixth operation information for instructing an operation of inputting "s" using the keyboard is: the keyboard inputs the key code key's' and the operation time is 20:29: 39. The seventh operation information for instructing an operation of inputting "e" using the keyboard is: the keyboard inputs a key code key 'e' and the operation time is 20:29: 40. The eighth operation information for instructing an operation of inputting "r" using the keyboard is: the keyboard inputs a key code key 'r' and the operation time is 20:29: 41.
After the user inputs the operation of newly-built user command, the user clicks the button of closing the browser in the interface by using the mouse in a 20:29:45 mode, and the terminal can determine the action position of the mouse clicking operation in the interface as the position of the button of closing the browser in the interface. At this time, as shown in table 1, the terminal further acquires and records operation information (for convenience of distinction, it is referred to as ninth operation information) indicating the operation as a mouse click "close the browser", and the operation time is 20:29: 45. The terminal receives the operation of clicking the 'close browser' button to close the browser.
TABLE 1
Figure BDA0002342037190000111
Based on the plurality of pieces of monitoring information shown in table 1, the terminal generates, in order of the operation time from early to late, an operation trajectory showing the operation performed by the user and the response generated by the terminal in accordance with the operation, in order of the operation time from early to late. The operation trajectory is as follows:
step (1), clicking a remote connection button in the interface by a mouse, wherein the ratio of the remote connection button to the remote connection button is 20:29: 17;
and (2) jumping to a console page with the URL address of http:// in × an.ua:. com/c × b/bus × ns, 20:29: 20;
step (3), initiating an API call request for acquiring the URL address of the remote console, wherein the ratio of the API call request to the URL address of the remote console is 20:29: 21;
step (4), an API call request for detecting the service state of the remote console is initiated, and the API call request is 20:29: 22;
step (5), initiating a request for establishing remote connection, 20:29: 23;
step (6), respectively inputting 'a','d', 'u','s', 'e' and 'r' by the keyboard, wherein the ratio of the input data to the output data is 20:29: 41;
and (7) clicking the 'closed browser' by a mouse, wherein the ratio of the mouse to the 'closed browser' is 20:29: 45.
When the second response information further includes information indicating that the invocation request 200 is correct, step (4) in the operation trace may be: an API call request is initiated to detect the service status of the remote console, request 200 is correct, 20:29: 22. When the fourth response information further includes information indicating that the call request 404 is incorrect, the (5) th step in the operation trace may be: a request to establish a remote connection is initiated, request 404 is in error, 20:29: 23.
And step 303, the server analyzes the operation indicated by the operation information in the plurality of monitoring information according to the operation track.
There are various implementations of analyzing the operation indicated by the operation information in the monitoring information, and the following two implementations are exemplified as follows:
in a first implementation manner, the process of performing the operation on the interface recorded in the operation track can be simulated according to the operation track, so as to perform process analysis on the process of performing the operation on the terminal according to the simulated process. Or simulating the process of executing the operation on the interface recorded in the operation track according to the operation track and responding according to the operation, and performing process analysis on the process of executing the operation on the terminal and generating the response according to the simulated process.
Wherein, the simulation operation process is as follows: and the server simulates the operation environment when the terminal executes the operation recorded by the operation track according to the operation track, simulates the operation recorded by the operation track in the operation environment, and then realizes the process of the corresponding function according to each operation. That is, the simulated operation process can be regarded as a process of scene-reproducing the operation recorded in the operation trajectory. Similarly, the process of simulating the operation and the response may be regarded as a process of scene reproduction of the operation to the operation trajectory recording and the response to the operation.
In one case, the server performs scene simulation on the operation recorded in the operation track of a certain terminal, so that the server can acquire the specific situation of each operation link in the process of implementing the operation at the terminal, and perform analysis operations such as operation process audit, operation fault location and the like on the process of executing the operation on the terminal according to the specific situation.
The operation process audit is to supervise and examine whether there is a behavior violating the regulation in the operation process according to the specific conditions occurring in each link of the operation process. The operation fault location is a behavior of determining a cause of an error according to specific conditions occurring in each link of an operation process when an error prompt (an operation error prompt or an access unsuccessful prompt or the like) occurs in the operation process.
Since the specific situation occurring in the process of executing the operation by the terminal can be known through the scene simulation, compared with the related technology which cannot acquire the specific situation occurring in the operation process, the details in the process of executing the operation by the terminal can be more clearly determined by analyzing the process of executing the operation by the terminal according to the specific situation, and the accuracy of analysis can be effectively ensured.
In another case, the server may perform scene simulation on operations recorded by operation tracks of the plurality of terminals, respectively, simulate a plurality of terminals to access the response server, request the response server to provide a real access process of the service to the corresponding terminal, and perform a performance test on the response server according to the simulated real access process.
For example, the server may simulate, according to the operation trajectories of the million terminals, that the million terminals simultaneously access the response server, and request the response server to provide a real access process of the service to the corresponding terminal, so as to test the service performance of the response server under a load condition that the response server provides the service to the million terminals, and implement a pressure test on the response server, so as to optimize the service performance of the response server according to the result of the pressure test.
The access process simulated through the scene is closer to the real access process, so that the specific situation in the real access process can be accurately reflected, the result of the performance test of the server by the access process simulated according to the scene is closer to the influence of the access process in the real access process on the performance of the server, and the service performance of the server can be accurately and effectively improved when the service performance of the server is optimized and responded according to the test result.
When the operation is subjected to the scene simulation according to the operation trajectory, a script program may be generated according to the operation trajectory, and the script program is executed to implement the scene simulation process of the operation, so as to improve the automation degree of the scene simulation. The implementation process of generating the script program according to the operation track may be: and sequentially generating a computer program for executing corresponding operations and responses according to the time sequence of all operations and all responses in the operation track so as to obtain the script program.
In a second implementation, the server uses the display to show the operation trajectory. And according to the designated screening strategy used when the monitoring information is screened, different modes of display can be realized according to different analysis purposes.
For example, if the operation trajectory is generated according to the monitoring information carrying the identifier of the same application program, the displayed operation trajectory is a process in which the terminal runs the same application program. If the operation track is generated according to the monitoring information carrying the identifier of the same terminal, the displayed operation track is the operation behavior executed in the terminal.
Moreover, when the operation track is displayed, the viewing object can be a worker or a user for managing operation analysis work, and the operation process can be conveniently and intuitively viewed by the viewing object through the display operation.
In summary, in the operation analysis method provided in the embodiment of the present application, the server receives the monitoring information sent by the terminal, generates the operation trajectory of the operation according to the monitoring information, and analyzes the operation executed by the user in the interface according to the operation trajectory, where the monitoring information includes the identifier of the terminal, the identifier of the application program, the operation information, and the operation time, so that the monitoring information can truly reflect the operation executed by the user on the front-end interface of the application program, and can ensure the accuracy of analyzing the operation executed by the user in the interface.
The sequence of steps of the operation monitoring method and the operation analysis method provided in the embodiment of the present application may be appropriately adjusted, and the steps may also be correspondingly increased or decreased according to the situation, for example, whether to execute the step 204 and the step 205 may be selected according to the application requirement. Any method that can be easily conceived by a person skilled in the art within the technical scope disclosed in the present application is covered by the protection scope of the present application, and thus the detailed description thereof is omitted.
The embodiment of the application also provides an operation monitoring device. As shown in fig. 4, the operation monitoring device 40 may include:
the recording module 401 is configured to record the identifier of the terminal and the identifier of the application program when detecting that the terminal displays the interface of the application program.
The recording module 401 is further configured to record operation time of the operation and operation information for indicating the operation when it is detected that the user performs the operation on the interface.
A sending module 402, configured to send monitoring information to the server, where the monitoring information includes an identifier of the terminal, an identifier of the application program, operation information, and operation time.
Optionally, as shown in fig. 5, the operation monitoring device 40 further includes:
a response module 403, configured to generate an operation response to the operation when it is detected that the user performs the operation on the interface.
The recording module 401 is further configured to record a response time for generating the operation response and response information for indicating the operation response.
Correspondingly, the monitoring information further comprises response information and response time.
Optionally, the operation information includes: type information for indicating an operation type of the operation and position information for indicating a position where the operation acts in the interface.
Optionally, the response information includes: and when a response is generated aiming at the operation, the interface information of the called application program interface is obtained.
In summary, in the operation monitoring apparatus provided in the embodiment of the present application, the recording module records the monitoring information including the identifier of the terminal, the identifier of the application program, the operation information, and the operation time, and the sending module sends the monitoring information to the server, because the monitoring information can truly reflect the operation performed by the user on the front-end interface of the application program, the server can analyze the operation performed by the user in the interface according to the monitoring information, and can effectively ensure the accuracy of analyzing the operation performed by the user in the interface.
The embodiment of the application also provides an operation analysis device. As shown in fig. 6, the operation analyzing device 60 may include:
the receiving module 601 is configured to receive multiple pieces of monitoring information sent by a terminal, where each piece of monitoring information includes an identifier of the terminal, an identifier of an application to which an interface of the application displayed by the terminal belongs, operation time of an operation performed on the interface by a user, and operation information used for instructing the operation.
A generating module 602, configured to generate an operation trajectory of an operation executed on an interface of an application program displayed by the terminal according to the multiple pieces of monitoring information, where the operation trajectory is recorded according to operation time of each operation.
Alternatively, as shown in fig. 7, the operation analysis device 60 further includes:
and the processing module 603 is configured to generate a script program according to the operation trajectory.
The processing module 603 is further configured to execute a script program to simulate an operation performed on the interface recorded in the operation track.
Optionally, each monitoring information further includes: response information for indicating a response to the operation recorded by the monitoring information by the terminal, and a time for generating the response.
Correspondingly, the operation track further comprises response information and response time.
In summary, in the operation analysis device provided in this embodiment of the present application, the receiving module receives the monitoring information sent by the terminal, the generating module generates the operation trajectory of the operation according to the monitoring information, and the processing module analyzes the operation performed by the user in the interface according to the operation trajectory.
It can be clearly understood by those skilled in the art that, for convenience and brevity of description, the specific working processes of the above-described apparatuses and modules may refer to the corresponding processes in the foregoing method embodiments, and are not described herein again.
An embodiment of the present application provides a computing device comprising a processor and a memory. The memory has stored therein a computer program. When the processor executes the computer program, the computing device implements the operation monitoring method provided by the embodiment of the application. Alternatively, the computing device may be a terminal, and its schematic structural diagram refers to the structure of the terminal in fig. 1.
Embodiments of the present application also provide another computing device that includes a processor and a memory. The memory has stored therein a computer program. When the processor executes the computer program, the computing device implements the operation analysis method provided by the embodiment of the application. Alternatively, the computing device may be a server, and its schematic structural diagram refers to the structure of the server in fig. 1.
The embodiment of the application provides a nonvolatile storage medium, and when instructions in the storage medium are executed by a processor, the operation monitoring method provided by the embodiment of the application is realized.
The embodiment of the present application further provides another nonvolatile storage medium, and when instructions in the storage medium are executed by a processor, the operation analysis method provided by the embodiment of the present application is implemented.
Embodiments of the present application provide a computer program product including instructions, which, when running on a computer, enable the computer to execute the operation monitoring method provided by embodiments of the present application.
The embodiment of the present application further provides another computer program product containing instructions, which when run on a computer, causes the computer to execute the operation analysis method provided by the embodiment of the present application.
It will be understood by those skilled in the art that all or part of the steps for implementing the above embodiments may be implemented by hardware, or may be implemented by a program instructing relevant hardware, where the program may be stored in a computer-readable storage medium, and the above-mentioned storage medium may be a read-only memory, a magnetic disk or an optical disk, etc.
In the embodiments of the present application, the terms "first", "second", and "third" are used for descriptive purposes only and are not to be construed as indicating or implying relative importance. The term "at least one" means one or more, and the term "plurality" means two or more, unless expressly defined otherwise.
The term "and/or" in this application is only one kind of association relationship describing the associated object, and means that there may be three kinds of relationships, for example, a and/or B, which may mean: a exists alone, A and B exist simultaneously, and B exists alone. In addition, the character "/" herein generally indicates that the former and latter related objects are in an "or" relationship.
The above description is only exemplary of the present application and is not intended to limit the present application, and any modifications, equivalents, improvements, etc. made within the spirit and principles of the present application are intended to be included within the scope of the present application.

Claims (14)

1. An operation monitoring method, which is applied to a terminal, the method comprising:
when detecting that the terminal displays an interface of an application program, recording an identifier of the terminal and an identifier of the application program;
when detecting that a user executes operation on the interface, recording operation time of the operation and operation information for indicating the operation;
and sending monitoring information to a server, wherein the monitoring information comprises the identifier of the terminal, the identifier of the application program, the operation information and the operation time.
2. The method of claim 1, further comprising:
when detecting that a user executes operation on the interface, generating operation response to the operation;
recording a response time for generating the operation response and response information indicating the operation response;
wherein the monitoring information further comprises the response information and the response time.
3. The method according to claim 1 or 2, wherein the operation information comprises: type information for indicating an operation type of the operation and position information for indicating a position where the operation acts in the interface.
4. The method of claim 2, wherein the response information comprises: and when a response is generated aiming at the operation, the interface information of the called application program interface is obtained.
5. An operation analysis method, applied to a server, the method comprising:
receiving a plurality of pieces of monitoring information sent by a terminal, wherein each piece of monitoring information comprises an identifier of the terminal, an identifier of an application program to which an interface of the application program displayed by the terminal belongs, operation time of an operation executed on the interface by a user, and operation information used for indicating the operation;
and generating an operation track of the operation executed on the interface of the application program displayed by the terminal according to the monitoring information, wherein the operation track is recorded according to the operation time of each operation.
6. The method according to claim 5, wherein after the generating of the operation track of the operation executed on the interface of the application program displayed on the terminal according to the plurality of monitoring information, the method further comprises:
generating a script program according to the operation track;
and executing the script program to simulate the operation which is recorded in the operation track and is executed on the interface.
7. The method of claim 5, wherein each monitoring information further comprises: response information used for indicating the response generated by the terminal to the operation recorded by the monitoring information, and the time for generating the response; the operation track further comprises the response information and the response time.
8. An operation monitoring device, characterized in that the device comprises:
the recording module is used for recording the identifier of the terminal and the identifier of the application program when the interface of the application program displayed by the terminal is detected;
the recording module is further configured to record operation time of the operation and operation information for indicating the operation when it is detected that a user performs the operation on the interface;
and the sending module is used for sending monitoring information to a server, wherein the monitoring information comprises the identifier of the terminal, the identifier of the application program, the operation information and the operation time.
9. The apparatus of claim 8, further comprising:
the response module is used for generating operation response to the operation when detecting that the user executes the operation on the interface;
the recording module is further used for recording the response time for generating the operation response and the response information for indicating the operation response;
wherein the monitoring information further comprises the response information and the response time.
10. The apparatus of claim 8 or 9, wherein the operation information comprises: type information for indicating an operation type of the operation and position information for indicating a position where the operation acts in the interface.
11. The apparatus of claim 9, wherein the response information comprises: and when a response is generated aiming at the operation, the interface information of the called application program interface is obtained.
12. An operation analysis apparatus, characterized in that the apparatus comprises:
the terminal comprises a receiving module, a processing module and a display module, wherein the receiving module is used for receiving a plurality of pieces of monitoring information sent by the terminal, and each piece of monitoring information comprises an identifier of the terminal, an identifier of an application program to which an interface of the application program displayed by the terminal belongs, operation time of an operation executed on the interface by a user, and operation information used for indicating the operation;
and the generating module is used for generating an operation track of the operation executed on the interface of the application program displayed by the terminal according to the monitoring information, and the operation track is recorded according to the operation time of each operation.
13. The apparatus of claim 12, further comprising:
the processing module is used for generating a script program according to the operation track;
the processing module is further configured to execute the script program to simulate an operation recorded in the operation track and executed on the interface.
14. The apparatus of claim 12, wherein each monitoring information further comprises: response information used for indicating the response generated by the terminal to the operation recorded by the monitoring information, and the time for generating the response; the operation track further comprises the response information and the response time.
CN201911380429.7A 2019-12-27 2019-12-27 Operation monitoring method and device and operation analysis method and device Active CN111198797B (en)

Priority Applications (2)

Application Number Priority Date Filing Date Title
CN201911380429.7A CN111198797B (en) 2019-12-27 2019-12-27 Operation monitoring method and device and operation analysis method and device
PCT/CN2020/133429 WO2021129335A1 (en) 2019-12-27 2020-12-02 Operation monitoring method and apparatus, operation analysis method and apparatus

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201911380429.7A CN111198797B (en) 2019-12-27 2019-12-27 Operation monitoring method and device and operation analysis method and device

Publications (2)

Publication Number Publication Date
CN111198797A true CN111198797A (en) 2020-05-26
CN111198797B CN111198797B (en) 2021-12-31

Family

ID=70746076

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201911380429.7A Active CN111198797B (en) 2019-12-27 2019-12-27 Operation monitoring method and device and operation analysis method and device

Country Status (2)

Country Link
CN (1) CN111198797B (en)
WO (1) WO2021129335A1 (en)

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112083860A (en) * 2020-09-07 2020-12-15 珠海格力电器股份有限公司 Control method and device of mobile terminal
WO2021129335A1 (en) * 2019-12-27 2021-07-01 华为技术有限公司 Operation monitoring method and apparatus, operation analysis method and apparatus
CN114024849A (en) * 2022-01-05 2022-02-08 广州市成格信息技术有限公司 Intelligent AI operation and maintenance perception method and device

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN116545642B (en) * 2023-01-07 2024-05-14 杭州融至兴科技有限公司 Terminal monitoring management system for specific environment

Citations (12)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20160012230A1 (en) * 2013-03-01 2016-01-14 Hitachi, Ltd. Method for detecting unfair use and device for detectng unfair use
CN105306257A (en) * 2015-09-24 2016-02-03 浪潮(北京)电子信息产业有限公司 Method and system for collecting user experience
CN106682910A (en) * 2015-11-04 2017-05-17 中国移动通信集团公司 Information processing method, system and related equipment
CN107545424A (en) * 2016-06-23 2018-01-05 腾讯科技(深圳)有限公司 A kind of data monitoring processing method, device and system
US20180035606A1 (en) * 2016-08-05 2018-02-08 Romello Burdoucci Smart Interactive and Autonomous Robotic Property Maintenance Apparatus, System, and Method
CN108304301A (en) * 2017-12-15 2018-07-20 阿里巴巴集团控股有限公司 Record the method and device of user behavior track
CN108647133A (en) * 2018-04-28 2018-10-12 深圳市小牛在线互联网信息咨询有限公司 User's operation track recording method, device, storage medium and computer equipment
CN109376050A (en) * 2018-09-03 2019-02-22 平安普惠企业管理有限公司 A kind of APP monitoring method, computer readable storage medium and terminal device
CN109710354A (en) * 2018-12-13 2019-05-03 平安普惠企业管理有限公司 Page monitor method, page restoring method, device, equipment and medium
CN110275811A (en) * 2019-05-24 2019-09-24 北京指掌易科技有限公司 A kind of method of mobile terminal H5 application behavior monitoring
CN110362446A (en) * 2019-06-19 2019-10-22 平安普惠企业管理有限公司 Mobile application abnormal operation monitoring method, device, storage medium and electronic equipment
CN110515830A (en) * 2019-07-15 2019-11-29 平安普惠企业管理有限公司 Operation trace method for visualizing, device, equipment and storage medium

Family Cites Families (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8532282B2 (en) * 2004-06-14 2013-09-10 At&T Intellectual Property I, L.P. Tracking user operations
CN103488507A (en) * 2013-09-18 2014-01-01 北京思特奇信息技术股份有限公司 User behavior trajectory playback method
CN111198797B (en) * 2019-12-27 2021-12-31 华为技术有限公司 Operation monitoring method and device and operation analysis method and device

Patent Citations (12)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20160012230A1 (en) * 2013-03-01 2016-01-14 Hitachi, Ltd. Method for detecting unfair use and device for detectng unfair use
CN105306257A (en) * 2015-09-24 2016-02-03 浪潮(北京)电子信息产业有限公司 Method and system for collecting user experience
CN106682910A (en) * 2015-11-04 2017-05-17 中国移动通信集团公司 Information processing method, system and related equipment
CN107545424A (en) * 2016-06-23 2018-01-05 腾讯科技(深圳)有限公司 A kind of data monitoring processing method, device and system
US20180035606A1 (en) * 2016-08-05 2018-02-08 Romello Burdoucci Smart Interactive and Autonomous Robotic Property Maintenance Apparatus, System, and Method
CN108304301A (en) * 2017-12-15 2018-07-20 阿里巴巴集团控股有限公司 Record the method and device of user behavior track
CN108647133A (en) * 2018-04-28 2018-10-12 深圳市小牛在线互联网信息咨询有限公司 User's operation track recording method, device, storage medium and computer equipment
CN109376050A (en) * 2018-09-03 2019-02-22 平安普惠企业管理有限公司 A kind of APP monitoring method, computer readable storage medium and terminal device
CN109710354A (en) * 2018-12-13 2019-05-03 平安普惠企业管理有限公司 Page monitor method, page restoring method, device, equipment and medium
CN110275811A (en) * 2019-05-24 2019-09-24 北京指掌易科技有限公司 A kind of method of mobile terminal H5 application behavior monitoring
CN110362446A (en) * 2019-06-19 2019-10-22 平安普惠企业管理有限公司 Mobile application abnormal operation monitoring method, device, storage medium and electronic equipment
CN110515830A (en) * 2019-07-15 2019-11-29 平安普惠企业管理有限公司 Operation trace method for visualizing, device, equipment and storage medium

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2021129335A1 (en) * 2019-12-27 2021-07-01 华为技术有限公司 Operation monitoring method and apparatus, operation analysis method and apparatus
CN112083860A (en) * 2020-09-07 2020-12-15 珠海格力电器股份有限公司 Control method and device of mobile terminal
CN114024849A (en) * 2022-01-05 2022-02-08 广州市成格信息技术有限公司 Intelligent AI operation and maintenance perception method and device
CN114024849B (en) * 2022-01-05 2022-04-01 广州市成格信息技术有限公司 Intelligent AI operation and maintenance perception method and device

Also Published As

Publication number Publication date
CN111198797B (en) 2021-12-31
WO2021129335A1 (en) 2021-07-01

Similar Documents

Publication Publication Date Title
CN111198797B (en) Operation monitoring method and device and operation analysis method and device
CN107294808B (en) Interface test method, device and system
US8504991B2 (en) Cross-browser testing of a web application
CN110457195B (en) Method and device for obtaining local log of client, server and storage medium
CN111897724B (en) Automatic testing method and device suitable for cloud platform
CN111026645B (en) User interface automatic test method and device, storage medium and electronic equipment
US7464004B2 (en) Troubleshooting to diagnose computer problems
CN109376078B (en) Mobile application testing method, terminal equipment and medium
US20090006883A1 (en) Software error report analysis
US10705946B2 (en) Techniques for real time server testing in a production environment
US20130086554A1 (en) Analytics Driven Development
WO2018184361A1 (en) Application test method, server, terminal, and storage media
CN103034575B (en) Collapse analytical approach and device
CN110727572A (en) Buried point data processing method, device, equipment and storage medium
CN111654495B (en) Method, apparatus, device and storage medium for determining traffic generation source
CN112199277A (en) Browser-based defect reproduction method, device, equipment and storage medium
CN111414309A (en) Automatic test method of application program, computer equipment and storage medium
CN111143650B (en) Method, device, medium and electronic equipment for acquiring page data
CN112015715A (en) Industrial Internet data management service testing method and system
CN112671615B (en) Method, system and storage medium for collecting front-end user operation behavior data
CN114780412A (en) Page testing method, system, device and medium
CN112817816B (en) Embedded point processing method and device, computer equipment and storage medium
US9858549B2 (en) Business transaction resource usage tracking
CN113886221A (en) Test script generation method and device, storage medium and electronic equipment
CN112527606A (en) Data flow analysis method and device, computer equipment and storage medium

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant
TR01 Transfer of patent right
TR01 Transfer of patent right

Effective date of registration: 20220214

Address after: 550025 Huawei cloud data center, jiaoxinggong Road, Qianzhong Avenue, Gui'an New District, Guiyang City, Guizhou Province

Patentee after: Huawei Cloud Computing Technology Co.,Ltd.

Address before: 518129 Bantian HUAWEI headquarters office building, Longgang District, Guangdong, Shenzhen

Patentee before: HUAWEI TECHNOLOGIES Co.,Ltd.