WO2021129335A1 - Procédé et appareil de surveillance d'opération, procédé et appareil d'analyse d'opération - Google Patents

Procédé et appareil de surveillance d'opération, procédé et appareil d'analyse d'opération Download PDF

Info

Publication number
WO2021129335A1
WO2021129335A1 PCT/CN2020/133429 CN2020133429W WO2021129335A1 WO 2021129335 A1 WO2021129335 A1 WO 2021129335A1 CN 2020133429 W CN2020133429 W CN 2020133429W WO 2021129335 A1 WO2021129335 A1 WO 2021129335A1
Authority
WO
WIPO (PCT)
Prior art keywords
information
terminal
response
interface
application
Prior art date
Application number
PCT/CN2020/133429
Other languages
English (en)
Chinese (zh)
Inventor
张�杰
叶锋
熊斐
Original Assignee
华为技术有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 华为技术有限公司 filed Critical 华为技术有限公司
Publication of WO2021129335A1 publication Critical patent/WO2021129335A1/fr

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F11/00—Error detection; Error correction; Monitoring
    • G06F11/30—Monitoring
    • G06F11/3003—Monitoring arrangements specially adapted to the computing system or computing system component being monitored
    • G06F11/302—Monitoring arrangements specially adapted to the computing system or computing system component being monitored where the computing system component is a software system
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F11/00—Error detection; Error correction; Monitoring
    • G06F11/30—Monitoring
    • G06F11/34—Recording or statistical evaluation of computer activity, e.g. of down time, of input/output operation ; Recording or statistical evaluation of user activity, e.g. usability assessment
    • G06F11/3438—Recording or statistical evaluation of computer activity, e.g. of down time, of input/output operation ; Recording or statistical evaluation of user activity, e.g. usability assessment monitoring of user actions

Definitions

  • This application relates to the field of data processing technology, and in particular to an operation monitoring method and device, and an operation analysis method and device.
  • the application service provider may also analyze the operations generated by the user in the process of accessing the application, so as to improve the service performance of the application according to the analysis result.
  • this analysis process can only be analyzed based on the interface called when the application is executed in the background, and cannot reflect the operation performed by the user on the front-end interface of the application, so that the operation performed by the user on the front-end interface cannot be analyzed.
  • This application provides an operation monitoring method and device, and an operation analysis method and device, which can analyze operations performed by users on the front-end interface of an application program.
  • this application provides an operation monitoring method, which is applied to a terminal, and the method includes: when it is detected that the terminal displays an application program interface, recording the terminal's identity and the application's identity; when it is detected When the user performs an operation on the interface, the operation time of the operation and the operation information used to indicate the operation are recorded; the monitoring information is sent to the server, and the monitoring information includes the terminal identification, the application identification, the operation information and the operation time.
  • the monitoring information can be truly Reflects the operations performed by the user on the front-end interface of the application, so that the server can analyze the operations performed by the user in the interface according to the monitoring information, and can effectively ensure the accuracy of the analysis on the operations performed by the user in the interface.
  • the method further includes: when it is detected that the user performs an operation on the interface, generating an operation response to the operation; recording the response time for generating the operation response and the response used to indicate the operation response information.
  • the monitoring information also includes response information and response time.
  • the operation information includes: type information used to indicate the operation type of the operation and position information used to indicate the position of the operation in the interface.
  • the type information is used to indicate what the operation input by the user is. According to the type information and the location information, it is possible to determine what operation the user performs in the terminal and the location where the operation takes effect in the interface of the application program.
  • the operation information may further include: configuration information used to instruct the terminal to display the interface and indication information used to indicate the type of information.
  • the indication information of a certain information is used to indicate that the information is operation information or response information.
  • the configuration information is used to indicate the display environment when the terminal displays the interface and the operation environment when the operation is performed.
  • the operation information also includes the configuration information, it can be convenient to simulate the display environment when the terminal displays the interface and when the operation is performed according to the configuration information. The operating environment to improve the accuracy of the simulation operation.
  • the monitoring information may also include information such as user identification, so that the server can more fully understand the operating environment when performing operations on the terminal.
  • the response information may include: the waiting time from the operating time of receiving the operation to the response time of generating the response, the indication information indicating the success or failure of the response, and the indication information indicating the information type.
  • the indication information is used to indicate that the information is operation information or response information.
  • the response information may further include: interface information of the application program interface that is called when the response is generated for the operation.
  • the interface information may be an identification of an application program interface.
  • the terminal may obtain the operation information used to indicate the operation in the following manner: obtain the operation information according to the parameters on which the application program generates the operation response to the operation. For example, the terminal may directly use the parameters on which the application program generates an operation response to the operation as operation information for indicating the operation.
  • the terminal can obtain the response information used to indicate the operation response in the following manner: after the terminal receives the operation performed on the interface, it detects the operation response to the operation, and when it detects the operation response When an operation generates an operation response, the response information used to indicate the response is recorded.
  • this application provides an operation analysis method, which is applied to a server, and the method includes: receiving a plurality of monitoring information sent by a terminal, and each monitoring information includes the identification of the terminal and the interface of the application displayed by the terminal.
  • the server receives the monitoring information sent by the terminal, generates the operation trajectory of the operation based on the monitoring information, and analyzes the operation performed by the user in the interface according to the operation trajectory, because the monitoring information Including the terminal identification, application identification, operation information and operation time, so that the monitoring information can truly reflect the operation performed by the user on the front-end interface of the application, and can ensure the analysis of the operation performed by the user in the interface Accuracy.
  • each monitoring information further includes: response information used to instruct the terminal to generate a response to the operation recorded by the monitoring information, and the time for generating the response.
  • generating the operation trace of the operation performed on the interface of the application program displayed on the terminal includes: generating the interface of the application program recorded by each monitoring information on the terminal according to the multiple monitoring information The process of performing the operations recorded by each monitoring information and responding according to the operations.
  • the method further includes: generating a script program according to the operation trajectory, and executing the script program to simulate the operation performed on the interface recorded in the operation trajectory; or, generating a script program according to the operation trajectory , Execute the script program to simulate the operation performed on the interface recorded in the operation track, and respond to the process according to the operation.
  • the application scenario is an application scenario for scene simulation of operations performed on the interface.
  • the server performs scene simulation on the operation recorded by the operation track of a certain terminal.
  • the server can learn the specific situation of each operation link in the process of realizing the operation on the terminal, and according to the operation. For specific conditions, perform analysis operations such as operating process auditing and operating fault location on the process of performing operations on the terminal.
  • the server can perform scenario simulations on the operations recorded by the operation traces of multiple terminals, simulate multiple terminals accessing the response server, and request the response server to provide real access to the corresponding terminal for business services. Process, and perform a performance test on the response server according to the simulated real access process.
  • the access process simulated by the scenario is closer to the real access process, it can more accurately reflect the specific conditions of the real access process, and the performance test results of the server based on the access process simulated by the scenario are closer to the real access process.
  • the access process has an impact on server performance.
  • the service performance of the response server is optimized according to the test result, the service performance of the server can be improved accurately and effectively.
  • the present application provides an operation monitoring device, the device includes: a recording module for recording the terminal's identity and the application's identity when it is detected that the terminal displays the interface of the application; the recording module also uses When it is detected that the user is performing an operation on the interface, it records the operation time of the operation and the operation information used to indicate the operation; the sending module is used to send monitoring information to the server, and the monitoring information includes the terminal's identification, the application's identification, Operating information and operating time.
  • the device further includes: a response module for generating an operation response to the operation when it is detected that the user performs an operation on the interface.
  • the recording module is also used to record the response time for generating the operation response and the response information used to indicate the operation response. Response information and response time when it is detected that the user performs an operation on the interface.
  • the operation information includes: type information used to indicate the operation type of the operation and position information used to indicate the position of the operation on the interface.
  • the response information includes: interface information of an application program interface called when a response is generated for the operation.
  • the present application provides an operation analysis device.
  • the device includes: a receiving module for receiving a plurality of monitoring information sent by the terminal, each monitoring information including the identification of the terminal and the interface of the application displayed by the terminal belongs to The identification of the application, the operation time of the operation performed by the user on the interface, and the operation information used to indicate the operation; the generating module is used to generate the operation performed on the interface of the application displayed on the terminal according to multiple monitoring information Operation trajectory, the operation trajectory is recorded according to the operation time of each operation.
  • the device further includes: a processing module for generating a script program according to the operation trajectory;
  • the processing module is used to execute the script program to simulate the operation performed on the interface recorded in the operation track.
  • each monitoring information further includes: response information used to indicate the response generated by the terminal to the operation recorded by the monitoring information, and the time for generating the response.
  • the operation track also includes response information and response time.
  • the present application provides a computing device that includes a processor and a memory; a computer program is stored in the memory; when the processor executes the computer program, the computing device implements the operation monitoring method provided in the first aspect.
  • this application also provides another computing device, which includes a processor and a memory; the memory stores a computer program; when the processor executes the computer program, the computing device implements the operation analysis method provided in the second aspect.
  • the present application provides a non-volatile storage medium, which implements the operation monitoring method provided in the first aspect when the instructions in the storage medium are executed by the processor.
  • this application also provides another non-volatile storage medium, which implements the operation analysis method provided in the second aspect when the instructions in the storage medium are executed by the processor.
  • Figure 1 is a schematic diagram of an application scenario involved in an embodiment of the present application
  • FIG. 2 is a flowchart of an operation monitoring method provided by an embodiment of the present application.
  • FIG. 3 is a flowchart of an operation analysis method provided by an embodiment of the present application.
  • FIG. 4 is a schematic structural diagram of an operation monitoring device provided by an embodiment of the present application.
  • FIG. 5 is a schematic structural diagram of another operation monitoring device provided by an embodiment of the present application.
  • FIG. 6 is a schematic structural diagram of an operation analysis device provided by an embodiment of the present application.
  • FIG. 7 is a schematic structural diagram of another operation analysis device provided by an embodiment of the present application.
  • Fig. 1 is a schematic diagram of an application scenario involved in an embodiment of the present application.
  • the application scenario includes: a terminal 10 and a server 11.
  • a communication connection is established between the terminal 10 and the server 11 through a wired or wireless network.
  • the terminal 10 may be a computer, a personal computer, a cloud host, a portable mobile terminal 10, a multimedia player, an e-book reader or a wearable device, etc.
  • the server 11 may be a server 11, or a server 11 cluster composed of several servers 11, or a cloud computing service center.
  • An application program may be installed in the terminal 10.
  • the terminal 10 can display an interface of an application program, receive operations performed by a user on the interface, and execute the operation monitoring method provided in the embodiments of the present application. For example, when it is detected that the terminal 10 displays the interface of an application program, the terminal 10 may record the identification of the terminal 10 and the identification of the application. In addition, when an operation performed by the user on the interface of the application program is detected, the terminal 10 can record the operation time of the operation and the operation information used to indicate the operation, and include the identification of the terminal 10 and the application information. The monitoring information of the identification, operation time and operation information is sent to the server 11.
  • the server 11 is configured to execute the operation analysis method provided in the embodiment of the present application.
  • the server 11 may receive the monitoring information sent by the terminal 10, and based on the multiple monitoring information, generate a process of executing the operations recorded by the multiple monitoring information on the interface of the application displayed on the terminal 10.
  • the server 11 may also generate a script program according to the generated operation track, and execute the script program to simulate the operation performed on the interface recorded in the operation track, so as to perform operation analysis on the operation performed on the interface.
  • the monitoring information includes information such as operation information and operation time used to indicate the operation performed by the user on the interface, and the monitoring information can truly reflect the operation performed by the user on the front-end interface of the application, it is generated based on the monitoring information
  • the operation trajectory of can truly reflect the operation performed by the user in the interface.
  • the terminal 10 includes a first processor 101, a first communication interface 102 and a first memory 103.
  • the first processor 101, the first communication interface 102, and the first memory 103 are connected to each other through a first bus 104.
  • the server 11 includes a second processor 111, a second communication interface 112 and a second memory 113.
  • the second processor 111, the second communication interface 112, and the second memory 113 are connected to each other through a second bus 114.
  • Both the first memory 103 and the second memory 113 are used to store computer programs.
  • the computer program may be an application program, and when the processor calls the application program in the corresponding memory, the function of the application program can be realized.
  • the terminal 10 can implement the operation monitoring method provided in the embodiment of the present application.
  • the server 11 can implement the operation analysis method provided in the embodiment of the present application.
  • any one of the first bus 104 and the second bus 114 can be divided into an address bus, a data bus, a control bus, and the like.
  • address bus a data bus
  • control bus a control bus
  • any one of the first bus 104 and the second bus 114 can be divided into an address bus, a data bus, a control bus, and the like.
  • thick line is used in FIG. 1, but it does not mean that there is only one bus or one type of bus.
  • any one of the first processor 101 and the second processor 111 may be a hardware chip, and the hardware chip may be an application-specific integrated circuit (ASIC), a programmable logic device (programmable logic device, PLD) or a combination thereof.
  • ASIC application-specific integrated circuit
  • PLD programmable logic device
  • the above-mentioned PLD may be a complex programmable logic device (CPLD), a field-programmable gate array (FPGA), a generic array logic (GAL) or any combination thereof.
  • CPLD complex programmable logic device
  • FPGA field-programmable gate array
  • GAL generic array logic
  • it may also be a general-purpose processor, for example, a central processing unit (CPU), a network processor (NP), or a combination of a CPU and an NP.
  • the first memory 103 and the second memory 113 may include volatile memory (volatile memory), such as random-access memory (RAM); and may also include non-volatile memory (non-volatile memory). Volatile memory, such as flash memory, hard disk drive (HDD), or solid-state drive (SSD); it may also include a combination of the above types of memory.
  • volatile memory such as random-access memory (RAM)
  • non-volatile memory non-volatile memory
  • Volatile memory such as flash memory, hard disk drive (HDD), or solid-state drive (SSD); it may also include a combination of the above types of memory.
  • the operation analysis method provided in the embodiment of the present application may also be executed by a virtual machine, or partly executed by the server 11 and partly executed by a virtual machine, which is not specifically limited by the embodiment of the present application.
  • the server 11 may receive a plurality of monitoring information sent by the terminal 10, and based on the plurality of monitoring information, generate an operation track of the operation performed on the interface of the application program displayed on the terminal 10.
  • the virtual machine can analyze the operation indicated by the operation information in the multiple monitoring information according to the operation track.
  • Fig. 2 is a flowchart of an operation monitoring method provided by an embodiment of the application. As shown in Figure 2, the method may include the following steps:
  • Step 201 The terminal receives a designated operation for instructing to display the interface of the application program input by the user, and displays the interface of the application program in the terminal according to the designated operation.
  • the terminal can display the interface of the application on the display screen of the terminal according to the designated operation.
  • Step 202 When it is detected that the terminal displays the interface of the application program, the terminal obtains and records the identification of the terminal and the identification of the application program.
  • An information acquisition application is preset in the terminal.
  • the information acquisition application can detect whether the terminal is displaying the interface of the application.
  • the information acquisition application program can acquire and record the terminal's identification and the application's identification.
  • the terminal can execute information acquisition applications for one or more applications installed in the terminal that require monitoring operations. That is, when the terminal displays the interface of any application program that requires monitoring operations, the terminal can obtain the identification of the terminal and the identification of the application through the information acquisition application.
  • an information acquisition application can be embedded in each application that requires monitoring operations, so that the terminal can display the interface of any application that requires monitoring operations
  • the application acquires the identification and other information of the application.
  • the method for obtaining the identification of the terminal by the terminal may be as follows: the information obtaining application obtains the identification number of the designated hardware or the identification number of the designated software in the terminal, and uses part or all of the identification number as the identification of the terminal.
  • the information acquisition application can acquire the serial number of the central processing unit (CPU) used by the terminal, and use part or all of the serial number as the terminal's identification.
  • the information acquisition application can acquire the universally unique identifier (UUID) of the terminal, and use part or all of the UUID as the terminal's identification.
  • the information acquisition application may acquire the serial number of the operating system used by the terminal, and use part or all of the serial number of the operating system as the terminal's identification.
  • the information acquisition application can also process the identification number of the specified hardware or the identification number of the specified software, and use the processed identification number as the identification of the terminal.
  • the information acquisition application can intercept the last 10 digits of the serial number of the central processing unit used by the terminal, and add 5 random numbers to the last 10 digits of the serial number, and the last 10 digits of the serial number and its end are added
  • the digital sequence composed of 5 random numbers is the identification of the terminal.
  • the identification of the application program may be a randomly generated number with a designated total number of digits.
  • the way for the terminal to obtain the identification of the application program can be implemented as follows: when the information acquisition application detects that the terminal displays the interface of the application program, it generates a random number with a designated total number of bits, and determines the random number of the designated total number of bits Is the identity of the application.
  • the total number of digits of the identification of the terminal and the total number of digits of the identification of the application program can be determined according to application requirements, which are not specifically limited in the embodiment of the present application.
  • the total number of digits of the identification of the terminal may be 128 bits
  • the total number of digits of the identification of the application program may be 10 bits.
  • Step 203 When it is detected that the user performs an operation on the interface, the terminal acquires and records the operation time of the operation and the operation information used to indicate the operation.
  • the terminal may use the information acquisition application program preset in the terminal to acquire and record the operation time and operation information. Moreover, since the terminal responds to the operation after receiving the operation performed by the user in the interface, and the reaction is generated by the terminal according to the relevant parameters of the detected operation, the terminal obtains the relevant information of the operation After the parameters, the information obtaining application can obtain the relevant parameters, and obtain the operation time and operation information according to the relevant parameters. Alternatively, the information acquisition application can also determine the response time and response information based on the detected response when it detects a response to the operation.
  • the setting method of the information acquisition application used in step 203 may refer to the setting method of the information acquisition application in step 202 accordingly.
  • the operation information includes: type information used to indicate the operation type of the operation and position information used to indicate the position of the operation in the interface.
  • the type information is used to indicate what the operation input by the user is. According to the type information and the location information, it is possible to determine what operation the user performs in the terminal and the location where the operation takes effect in the interface of the application program.
  • the type information of the operation type can indicate that the operation is a click operation of the left mouse button, a double click operation of the left mouse button, a right mouse click operation, a double click operation of the right mouse button, a wheel operation of the mouse, or an input operation of a key on the keyboard Wait.
  • a coordinate system may be preset in the terminal, and the abscissa and ordinate of the position where the operation acts on the interface can be determined according to the coordinate system, and the abscissa and the ordinate may be used to represent the position information.
  • the type information is used to indicate the operation in which the keyboard input the key code "M”.
  • Information is used to indicate the position of the cursor.
  • the type information is used to indicate the operation of clicking the left button of the mouse, and the position information is used to indicate the operation. A certain location.
  • the operation information may also include: configuration information used to instruct the terminal to display the interface and indication information used to indicate the type of information.
  • the indication information is used to indicate that the information is operation information or response information.
  • the configuration information includes: terminal configuration information and application configuration information.
  • the configuration information of the terminal may include information such as the resolution of the terminal, the internet protocol (IP) address of the terminal, the network type used by the terminal, and the operating system used by the terminal.
  • the configuration information of the application may include: type information of the application, version information of the application, and display resolution of the application.
  • the configuration information used to indicate the terminal display interface is used to indicate the display environment when the terminal displays the interface and the operation environment when the operation is performed.
  • the operation information also includes the configuration information
  • Time display environment and operating environment when performing operations can be determined according to the IP address of the terminal, and the network provider of the network used by the terminal when generating a response based on the operation, as well as information such as the network bandwidth, can be determined.
  • the monitoring information may also include information such as user identification, so that the server can more fully understand the operating environment when performing operations on the terminal.
  • the configuration information of the terminal may include: the resolution of the terminal is 1920 ⁇ 1080, the network used by the terminal is the network provided by the AA network operator, and the operating system used by the terminal is the Windows 10 system.
  • the configuration information of the application program may include: the type of the application program is a network service class (such as a browser), the version information of the application program is Version 7.0.9, and the display resolution of the application program is 1920 ⁇ 1080.
  • Step 204 The terminal generates an operation response to the operation according to the operation information and interface.
  • the terminal After detecting that the user performs an operation on the interface, the terminal can determine the function that the user wants to implement when the operation is performed based on the operation information of the operation and the content of the interface, and generate an operation response to the operation, so as to realize the user's desire.
  • the operation response generated by the terminal according to the operation refers to the reaction generated by the terminal according to the operation after the terminal receives the operation.
  • the operation response generated by the terminal to the operation may be to generate an operation request, which is used to request a response
  • the server provides the terminal with services required to implement the function indicated by the operation, and sends the operation request to the response server.
  • the operation request may be an application programming interface (API) call request.
  • API application programming interface
  • the operation response generated by the terminal to the operation is to generate an API call request for a series of services such as authentication provided by the request response server, and send the API call request to the response server.
  • the operation response generated by the terminal to the operation is that the terminal executes the function indicated by the operation. For example, suppose that the operation performed by the user in the interface of a word processing application is to select part of the text and instruct to highlight the part of the text. Since the terminal itself can realize the function of highlighting the text, it can determine the operation response of the terminal to the operation To highlight this part of the text.
  • Step 205 When detecting that an operation response is generated to the operation, the terminal obtains and records the response time for generating the operation response and the response information used to indicate the operation response.
  • the terminal may use the information acquisition application program preset in the terminal to acquire and record the response time and response information.
  • the generated response needs to be executed by the component in the terminal, and the component is executed according to the corresponding indicator parameter. Therefore, the information acquisition application can determine the response information according to the indicator parameter .
  • the time when the component executes the response is the response time. Therefore, the time when the information acquisition application detects that the operation response to the operation is generated is the response time.
  • the setting method of the information acquisition application adopted in step 205 reference may be made to the setting method of the information acquisition application in step 202 accordingly.
  • the response information may include: the waiting time from the operating time of receiving the operation to the response time of generating the response, the indication information indicating the success or failure of the response, and the indication information indicating the type of information, etc.
  • the indication information is used to indicate that the information is operation information or response information.
  • the response information may also include: interface information of the application program interface requested to be called when the response is generated for the operation.
  • the interface information may be an application program interface identification (API ID).
  • step 204 and step 205 are optional steps.
  • the terminal may also obtain operation information and response information in a sampling manner.
  • the operation information may also include the sampling frequency when the terminal obtains the operation information
  • the response information may also include the sampling frequency when the terminal obtains the operation information.
  • Step 206 The terminal sends monitoring information to the server.
  • the monitoring information includes: the identification of the terminal, the identification of the application, the operation information, and the operation time.
  • the terminal may send monitoring information including the terminal's identification, the application's identification, operation information, and operation time to the server.
  • the monitoring information may further include: response information and response time.
  • the process of the terminal sending the monitoring information to the server includes: the terminal sending the monitoring information including the terminal's identification, the application's identification, operation information, operation time, response information, and response time to the server.
  • the monitoring information includes a variety of information
  • the timing for the terminal to send monitoring information to the server can also be determined according to actual needs. For example, the terminal can send monitoring information to the server in real time, that is, each time the terminal obtains a type of information, it can send the information to the server. Alternatively, the terminal may periodically send the monitoring information to the server, that is, after each information collection period, the terminal may send the monitoring information acquired during the information collection period to the server.
  • the terminal may also generate a check code, and send the check code to the server when sending monitoring information to the server.
  • the verification code is used to check whether the monitoring information has been tampered with, so as to ensure the accuracy of the monitoring information.
  • the server after the server receives the monitoring information and the check code, it can generate the check code based on the monitoring information according to the check method agreed with the terminal in advance, and compare the check code generated by the server with the check code sent by the terminal.
  • the monitoring information including the terminal identification, application identification, operation information, and operation time is recorded, and the monitoring information is sent to the server.
  • the monitoring information can truly reflect the operation performed by the user on the front-end interface of the application, so that the server can analyze the operation performed by the user in the interface according to the monitoring information, and can effectively ensure the analysis of the operation performed by the user in the interface Accuracy.
  • FIG. 3 is a flowchart of an operation analysis method provided by an embodiment of the application. As shown in Figure 3, the method may include the following steps:
  • Step 301 The server receives multiple monitoring information sent by the terminal.
  • Each monitoring information includes at least the identification of the terminal, the identification of the application to which the interface of the application displayed by the terminal belongs, the operation time of the operation performed by the user on the interface, and The operation information used to indicate the operation.
  • each monitoring information may further include: response time for generating a response to the operation information and response information for indicating the generated response.
  • the server can preprocess the monitoring information first, and then store the preprocessed monitoring information for subsequent use. For example, after the server receives a data stream that includes multiple monitoring information, it can use the message processing module in the server to perform message processing on the data stream, and then use the stream processing module in the server to perform data filtering on the monitoring information that has undergone message processing. Stream processing operations such as data verification and data classification, and then store the monitoring information after stream processing operations in the database. In addition, when the data verification result indicates that the monitoring information has been tampered with, the alarm module in the server can send out alarm information.
  • the server may also be provided with a storage module and a management module, the storage module is used to store the original data of multiple monitoring information received from the terminal, and the management module is used to manage each module in the server.
  • the message processing module may be a Kafka (kafka) message processing system, and the database may be a time series database (tsdb).
  • Step 302 The server generates an operation track of the operation performed on the interface displayed on the terminal according to the multiple monitoring information.
  • the server may generate an operation track for performing operations recorded by multiple monitoring information on the interface displayed by the terminal according to the multiple monitoring information, in the order of the operation time of the operation recorded in the different monitoring information from morning to evening.
  • the multiple monitoring information can be screened according to a specified screening strategy first, and then an operation track can be generated based on the screened monitoring information.
  • the designated strategy may be determined according to the analysis purpose of the subsequent analysis of the operation behavior. For example, when it is necessary to analyze the user's operation behavior when the terminal runs the same application program, the server can filter the monitoring information carrying the identity of the same application program in the terminal, and generate an operation track based on the monitoring information carrying the same application program.
  • the server when the server receives multiple monitoring information sent by multiple terminals and needs to analyze the operation behavior performed in the same terminal, it can filter the monitoring information that carries the identity of the same terminal in the terminal, and according to the information carried The monitoring information of the identity of the same terminal generates an operation track.
  • the operation track can be regarded as executing the corresponding monitoring information recorded in the interface of the application that displays multiple monitoring information records on the terminal.
  • the sequential description of the process of operation when the monitoring information also includes: terminal identification, application identification, operation information, operation time, response information, and response time, the operation track can be regarded as an interface that displays multiple monitoring information records on the terminal. The sequential description of the process of performing operations in each interface and responding to each operation.
  • Table 1 shows multiple monitoring information obtained by the terminal after the user whose user ID is XP-0012738 performs an operation in the terminal.
  • Each monitoring information includes: the identification of the terminal, the identification of the application, the operation time and operation information of the performed operation, and the response information and response time of the response generated by the terminal according to the operation. They are explained separately as follows:
  • the terminal When the user needs the terminal to display the interface of a certain application program, he can perform a designated operation. After the terminal receives the designated operation, the terminal displays the interface of the application program on the display screen according to the designated operation. At this time, the terminal can acquire and record the terminal's identifier as 191191919...182783 (not shown in Table 1) and the identifier of the application program (not shown in Table 1). When the terminal detects that the user clicks the "remote connection" button in the interface with the mouse at 20:29:17, the terminal can determine the position of the mouse click operation in the interface as "remote connection" is displayed in the interface The location of the button.
  • the terminal acquires and records the operation information used to indicate the operation (called the first operation information for easy distinction) as the mouse click "remote connection", and the operation time is 20:29:17 .
  • the function of "remote connection” is to establish a remote connection between the terminal and the remote console.
  • the terminal After the terminal receives the operation of clicking the "remote connection” button with the mouse, the terminal can display the uniform resource locator (URL) address according to the operation as http://in**an.ua**ei.com/ c**b/bus**ns console page, and the terminal displays the page jump to the console page at 20:29:20.
  • the terminal's jump to display the console page can be regarded as the operation response generated by the terminal according to the operation of clicking the "remote connection" button with the mouse (for the convenience of distinction, it is called the first operation response).
  • the terminal After the terminal generates the first operation response, as shown in Table 1, the terminal acquires and records that the response time of the first operation response is 20:29:20, and the first response information used to indicate the first operation response is:
  • the page jumps to the console page with the URL address http://in**an.ua**ei.com/c**b/bus**ns.
  • the terminal in order to establish a remote connection, the terminal also needs to obtain the URL address of the remote console and send a remote connection establishment request to the remote console. Therefore, in the process of displaying the console page on the terminal, the terminal also needs to send an API call request to the remote server to obtain the URL address of the remote console, and after obtaining the URL address of the remote console, according to the URL of the remote console The address sends a remote connection establishment request to the remote console. In addition, before sending the remote connection establishment request, the terminal may also send an API call request for detecting the service status of the remote console to the remote server.
  • the terminal sends an API call request to obtain the URL address of the remote console to the remote server, which can be regarded as an operation response generated by the terminal according to the operation of clicking the "remote connection" button with the mouse (for easy distinction, it is called the second operation response) .
  • the terminal After the terminal generates the second operation response, as shown in Table 1, the terminal obtains and records that the response time of the second operation response is 20:29:21, and the second response information used to indicate the second operation response is: Initiate an API call request to obtain the URL address of the remote console.
  • the terminal sends an API call request for detecting the service status of the remote console to the remote server, which can be regarded as an operation response generated by the terminal according to the operation of clicking the "remote connection" button with the mouse (for easy distinction, it is called the third operation response).
  • the terminal After the terminal generates the third operation response, as shown in Table 1, the terminal acquires and records that the response time of the third operation response is 20:29:22, and the third response information used to indicate the third operation response is: Initiate an API call request to detect the service status of the remote console.
  • the terminal sends a remote connection establishment request to the remote console, which can be regarded as an operation response generated by the terminal according to the operation of clicking the "remote connection" button with the mouse (for easy distinction, it is called the fourth operation response).
  • the terminal After the terminal generates the fourth operation response, as shown in Table 1, the terminal obtains and records that the response time of the fourth operation response is 20:29:23, and the fourth response information used to indicate the fourth operation response is: Initiate a remote connection establishment request.
  • the remote server may also send to the terminal information reflecting whether the API call request successfully calls the corresponding interface.
  • the information used to reflect whether the API call request successfully calls the corresponding interface can also be recorded in the corresponding response information (not shown in Table 1).
  • the terminal sends an API call request to obtain the URL address of the remote console to the remote server
  • the remote server can send the status code "200" to the terminal indicating that the interface is successfully called. ", the information indicating that the invocation request 200 is correct may be recorded in the second response information of the second operation response.
  • the remote server can send the terminal a status code indicating the failure to call the interface " 404", the information indicating the 404 error of the call request can be recorded in the fourth response information of the fourth operation response.
  • the terminal has obtained the monitoring information generated according to the operation of the user using the mouse to click the "remote connection" button in the interface.
  • the monitoring information includes: first operation information and operation time, first response information and response time, second response information and response time, third response information and response time, fourth response information and response time .
  • each acquired monitoring information can include an input operation indicating one input operation.
  • Operating information and operating time is: the keyboard input key code key "a”, and the operation time is 20:29:35.
  • the third operation information used to indicate the operation of using the keyboard to input “d” is: the keyboard input key code key “d”, and the operation time is 20:29:36.
  • the fourth operation information for instructing the operation of using the keyboard to input “d” is: the keyboard input key code key “d”, and the operation time is 20:29:37.
  • the fifth operation information for instructing the operation of using the keyboard to input “u” is: the keyboard input key code key "u”, and the operation time is 20:29:38.
  • the sixth operation information for instructing the operation of using the keyboard to input "s” is: the keyboard input key code key "s", and the operation time is 20:29:39.
  • the seventh operation information used to instruct the operation of using the keyboard to input “e” is: the keyboard input key code key “e”, and the operation time is 20:29:40.
  • the eighth operation information used to instruct the operation of using the keyboard to input “r” is: the keyboard input key code key "r”, and the operation time is 20:29:41.
  • the terminal After the user enters the operation of creating a new user command, the user clicks the "close browser” button in the interface with the mouse at 20:29:45, and the terminal can determine the position of the mouse click in the interface as the interface The position where the "Close Browser” button is displayed in. At this time, as shown in Table 1, the terminal again acquires and records the operation information used to indicate the operation (called the ninth operation information for easy distinction) as the mouse click "close browser", and the operation time is 20:29 :45. When the terminal receives the operation of clicking the "close browser” button, the browser will be closed.
  • the terminal According to the multiple monitoring information shown in Table 1, the terminal generates the following operation trajectory in the order of operation time from morning to night, and the operation trajectory shows the operations performed by the user and the terminal in the order of operation time from morning to night. According to the response generated by the operation.
  • the operation track is as follows:
  • Step (1) the mouse clicked the "remote connection” button in the interface, 20:29:17;
  • Step (2) the page jumps to the console page with URL address http://in**an.ua**ei.com/c**b/bus**ns, 20:29:20;
  • Step (3) initiate an API call request to obtain the URL address of the remote console, 20:29:21;
  • Step (4) initiate an API call request to detect the service status of the remote console, 20:29:22;
  • Step (5) initiate a request to establish a remote connection, 20:29:23;
  • Step (7) mouse click "close browser", 20:29:45.
  • the step (4) in the operation track may be: initiate an API call request to detect the service status of the remote console, and the request 200 is correct, 20: 29:22.
  • the step (5) in the operation track may be: initiate a request to establish a remote connection, request 404 error, 20:29:23.
  • Step 303 The server analyzes the operation indicated by the operation information in the multiple monitoring information according to the operation track.
  • the process of performing operations on the interface recorded in the operation trace can be simulated according to the operation trajectory, so as to perform process analysis on the process of performing operations on the terminal according to the simulated process.
  • the process of performing operations on the interface and responding according to the operations recorded in the operation trajectory is simulated, so as to perform process analysis on the process of performing operations on the terminal and generating responses according to the simulated process.
  • the simulation operation process refers to: the server simulates the operating environment when the terminal performs the operation recorded by the operation track according to the operation track, and simulates the operation recorded by the operation track in the operation environment, and then realizes the corresponding operation according to each operation.
  • Functional process That is, the simulated operation process can be regarded as a process of scene reproduction of the operation recorded on the operation track.
  • the process of simulating operation and response can be regarded as the process of scene reproducing the operation recorded on the operation track and the response to the operation.
  • the server performs scene simulation on the operation recorded by the operation track of a certain terminal, and the server can learn the specific situation of each operation link in the process of realizing the operation on the terminal, and make a corresponding analysis according to the specific situation. Perform analysis operations such as operation process audit and operation fault location in the process of performing operations on the terminal.
  • the operation process audit is to supervise and review whether there is any violation of regulations during the operation process based on the specific circumstances that occur in each link of the operation process.
  • Operation fault location is the behavior that determines the cause of the error according to the specific circumstances that occur in each link of the operation process when there is an error prompt (operation error prompt or access unsuccessful prompt, etc.) during the operation process.
  • the server can perform scenario simulations on the operations recorded by the operation traces of multiple terminals, simulate multiple terminals accessing the response server, and request the response server to provide the actual access process of the business service to the corresponding terminal, and Perform a performance test on the response server according to the simulated real access process.
  • the server can simulate millions of terminals accessing the response server at the same time based on the operation trajectory of millions of terminals, and request the response server to provide the real access process of business services to the corresponding terminal, so as to test that the response server is providing service to the million terminals.
  • the server can simulate millions of terminals accessing the response server at the same time based on the operation trajectory of millions of terminals, and request the response server to provide the real access process of business services to the corresponding terminal, so as to test that the response server is providing service to the million terminals.
  • the access process simulated by the scenario is closer to the real access process, it can more accurately reflect the specific conditions of the real access process, and the performance test results of the server based on the access process simulated by the scenario are closer to the real access process.
  • the access process has an impact on server performance.
  • the service performance of the response server is optimized according to the test result, the service performance of the server can be improved accurately and effectively.
  • a script program when performing scene simulation of an operation based on the operation trajectory, a script program can be generated based on the operation trajectory first, and the scene simulation process of the operation can be realized by executing the script program, so as to improve the automation degree of the scene simulation.
  • the implementation process of generating the script program according to the operation trajectory may be: according to the timing of all operations and all responses in the operation trajectory, a computer program for executing corresponding operations and responses is sequentially generated to obtain the script program.
  • the server uses a display to show the operation trajectory.
  • different ways of displaying can be realized according to different analysis purposes.
  • the displayed operation trajectory is a process in which the terminal runs the same application program. If the operation trajectory is generated based on the monitoring information carrying the identity of the same terminal, the displayed operation trajectory is the operation behavior performed in the terminal.
  • the viewing object may be a worker or user who manages the operation analysis work, and the display operation can facilitate the viewing object to more intuitively view the operation process.
  • the server receives the monitoring information sent by the terminal, generates the operation trajectory of the operation based on the monitoring information, and analyzes the operation performed by the user in the interface according to the operation trajectory , Because the monitoring information includes the terminal’s identity, application’s identity, operation information, and operation time, the monitoring information can truly reflect the operation performed by the user on the front-end interface of the application, and can ensure that the user is in the interface The accuracy of the operations performed for analysis.
  • the sequence of steps of the operation monitoring method and the operation analysis method provided in the embodiments of the present application can be adjusted appropriately, and the steps can also be increased or decreased according to the situation. For example, it is possible to choose whether to execute the above-mentioned step 204 and step 205 according to application requirements. Any person familiar with the technical field can easily think of a method of change within the technical scope disclosed in this application, which should be covered by the protection scope of this application, and therefore will not be repeated.
  • the operation monitoring device 40 may include:
  • the recording module 401 is used to record the identification of the terminal and the identification of the application when it is detected that the interface of the application is displayed on the terminal.
  • the recording module 401 is also used to record the operation time of the operation and the operation information used to indicate the operation when it is detected that the user performs an operation on the interface.
  • the sending module 402 is used to send monitoring information to the server.
  • the monitoring information includes the identification of the terminal, the identification of the application program, the operation information, and the operation time.
  • the operation monitoring device 40 further includes:
  • the response module 403 is used to generate an operation response to the operation when it is detected that the user performs an operation on the interface.
  • the recording module 401 is also used to record the response time for generating the operation response and the response information used to indicate the operation response.
  • the monitoring information also includes response information and response time.
  • the operation information includes: type information used to indicate the operation type of the operation and position information used to indicate the position of the operation on the interface.
  • the response information includes: interface information of an application program interface called when a response is generated for the operation.
  • the monitoring information including the terminal identification, application identification, operation information, and operation time is recorded through the recording module, and the sending module sends the monitoring information to the server Because the monitoring information can truly reflect the operations performed by the user on the front-end interface of the application, the server can analyze the operations performed by the user in the interface based on the monitoring information, and can effectively ensure that the user performs in the interface The accuracy of the analysis performed by the operation.
  • the operation analysis device 60 may include:
  • the receiving module 601 is used to receive multiple monitoring information sent by the terminal.
  • Each monitoring information includes the identification of the terminal, the identification of the application to which the interface of the application displayed by the terminal belongs, the operation time of the operation performed by the user on the interface, and Operation information used to indicate the operation.
  • the generating module 602 is configured to generate an operation trace of the operation performed on the interface of the application program displayed on the terminal according to a plurality of monitoring information, and the operation trace is recorded according to the operation time of each operation.
  • the operation analysis device 60 further includes:
  • the processing module 603 is used to generate a script program according to the operation trajectory.
  • the processing module 603 is also used to execute a script program to simulate the operation performed on the interface recorded in the operation track.
  • each monitoring information further includes: response information used to indicate the response generated by the terminal to the operation recorded by the monitoring information, and the time for generating the response.
  • the operation track also includes response information and response time.
  • the monitoring information sent by the terminal is received through the receiving module, the generating module generates the operation trajectory according to the monitoring information, and the processing module executes the user in the interface according to the operation trajectory. Analyze the operation of the application. Since the monitoring information includes the terminal’s identity, application’s identity, operation information, and operation time, the monitoring information can truly reflect the operation performed by the user on the front-end interface of the application, and ensure that the The accuracy of the analysis of the operations performed by the user in the interface.
  • An embodiment of the present application provides a computing device, which includes a processor and a memory.
  • a computer program is stored in the memory.
  • the computing device implements the operation monitoring method provided in the embodiment of the present application.
  • the computing device may be a terminal.
  • a schematic diagram of the structure please refer to the structure of the terminal in FIG. 1.
  • An embodiment of the present application also provides another computing device, which includes a processor and a memory.
  • a computer program is stored in the memory.
  • the computing device implements the operation analysis method provided in the embodiment of the present application.
  • the computing device may be a server.
  • a schematic diagram of the structure please refer to the structure of the server in FIG. 1.
  • the embodiment of the present application provides a non-volatile storage medium, and when an instruction in the storage medium is executed by a processor, the operation monitoring method provided in the embodiment of the present application is implemented.
  • the embodiment of the present application also provides another non-volatile storage medium.
  • the operation analysis method provided in the embodiment of the present application is implemented.
  • the embodiment of the present application provides a computer program product containing instructions.
  • the computer program product runs on a computer, the computer executes the operation monitoring method provided by the embodiment of the present application.
  • the embodiment of the present application also provides another computer program product containing instructions.
  • the computer program product runs on a computer, the computer executes the operation analysis method provided by the embodiment of the present application.
  • the program can be stored in a computer-readable storage medium.
  • the storage medium mentioned can be a read-only memory, a magnetic disk or an optical disk, etc.
  • the terms “first”, “second” and “third” are only used for descriptive purposes, and cannot be understood as indicating or implying relative importance.
  • the term “at least one” refers to one or more, and the term “plurality” refers to two or more, unless expressly defined otherwise.

Abstract

Procédé de surveillance d'opération et procédé d'analyse d'opération, dans le domaine technique du traitement de données. Le procédé consiste : à recevoir, par un serveur, de multiples éléments d'informations de surveillance envoyés par un terminal, chaque élément d'informations de surveillance comprenant au moins un identifiant de terminal, un identifiant d'une application dans une interface d'application affichée par le terminal, un temps d'opération d'une opération exécutée par un utilisateur sur l'interface, et des informations d'opération utilisées pour indiquer l'opération (301) ; à générer, par le serveur, en fonction des multiples éléments d'informations de surveillance, une trajectoire d'opération correspondant à l'opération exécutée sur l'interface affichée par le terminal (302), la trajectoire d'opération étant enregistrée en fonction du temps d'opération de l'opération. Le présent procédé peut effectuer une analyse d'une opération exécutée par un utilisateur sur une interface frontale d'une application.
PCT/CN2020/133429 2019-12-27 2020-12-02 Procédé et appareil de surveillance d'opération, procédé et appareil d'analyse d'opération WO2021129335A1 (fr)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201911380429.7 2019-12-27
CN201911380429.7A CN111198797B (zh) 2019-12-27 2019-12-27 操作监控方法及装置、操作分析方法及装置

Publications (1)

Publication Number Publication Date
WO2021129335A1 true WO2021129335A1 (fr) 2021-07-01

Family

ID=70746076

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2020/133429 WO2021129335A1 (fr) 2019-12-27 2020-12-02 Procédé et appareil de surveillance d'opération, procédé et appareil d'analyse d'opération

Country Status (2)

Country Link
CN (1) CN111198797B (fr)
WO (1) WO2021129335A1 (fr)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN116545642A (zh) * 2023-01-07 2023-08-04 杭州融至兴科技有限公司 一种用于特定环境下的终端监控管理系统
CN116545642B (zh) * 2023-01-07 2024-05-14 杭州融至兴科技有限公司 一种用于特定环境下的终端监控管理系统

Families Citing this family (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111198797B (zh) * 2019-12-27 2021-12-31 华为技术有限公司 操作监控方法及装置、操作分析方法及装置
CN112083860A (zh) * 2020-09-07 2020-12-15 珠海格力电器股份有限公司 移动终端的控制方法及装置
CN114024849B (zh) * 2022-01-05 2022-04-01 广州市成格信息技术有限公司 一种智能ai运维感知方法及装置

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20050278630A1 (en) * 2004-06-14 2005-12-15 Bracey William M Tracking user operations
CN103488507A (zh) * 2013-09-18 2014-01-01 北京思特奇信息技术股份有限公司 一种用户行为轨迹回放方法
CN105306257A (zh) * 2015-09-24 2016-02-03 浪潮(北京)电子信息产业有限公司 一种收集用户体验的方法及系统
CN106682910A (zh) * 2015-11-04 2017-05-17 中国移动通信集团公司 一种信息处理方法、系统及相关设备
CN109710354A (zh) * 2018-12-13 2019-05-03 平安普惠企业管理有限公司 页面监听方法、页面还原方法、装置、设备及介质
CN111198797A (zh) * 2019-12-27 2020-05-26 华为技术有限公司 操作监控方法及装置、操作分析方法及装置

Family Cites Families (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9589137B2 (en) * 2013-03-01 2017-03-07 Hitachi, Ltd. Method for detecting unfair use and device for detecting unfair use
CN107545424B (zh) * 2016-06-23 2020-11-27 腾讯科技（深圳）有限公司 一种数据监控处理方法、装置以及系统
US20180035606A1 (en) * 2016-08-05 2018-02-08 Romello Burdoucci Smart Interactive and Autonomous Robotic Property Maintenance Apparatus, System, and Method
CN108304301B (zh) * 2017-12-15 2021-03-19 创新先进技术有限公司 记录用户行为轨迹的方法及装置
CN108647133A (zh) * 2018-04-28 2018-10-12 深圳市小牛在线互联网信息咨询有限公司 用户操作轨迹记录方法、装置、存储介质以及计算机设备
CN109376050A (zh) * 2018-09-03 2019-02-22 平安普惠企业管理有限公司 一种app监测方法、计算机可读存储介质及终端设备
CN110275811A (zh) * 2019-05-24 2019-09-24 北京指掌易科技有限公司 一种移动端h5应用行为监控的方法
CN110362446B (zh) * 2019-06-19 2022-12-23 平安普惠企业管理有限公司 移动应用异常操作监测方法、装置、存储介质及电子设备
CN110515830A (zh) * 2019-07-15 2019-11-29 平安普惠企业管理有限公司 操作轨迹可视化方法、装置、设备及存储介质

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20050278630A1 (en) * 2004-06-14 2005-12-15 Bracey William M Tracking user operations
CN103488507A (zh) * 2013-09-18 2014-01-01 北京思特奇信息技术股份有限公司 一种用户行为轨迹回放方法
CN105306257A (zh) * 2015-09-24 2016-02-03 浪潮(北京)电子信息产业有限公司 一种收集用户体验的方法及系统
CN106682910A (zh) * 2015-11-04 2017-05-17 中国移动通信集团公司 一种信息处理方法、系统及相关设备
CN109710354A (zh) * 2018-12-13 2019-05-03 平安普惠企业管理有限公司 页面监听方法、页面还原方法、装置、设备及介质
CN111198797A (zh) * 2019-12-27 2020-05-26 华为技术有限公司 操作监控方法及装置、操作分析方法及装置

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN116545642A (zh) * 2023-01-07 2023-08-04 杭州融至兴科技有限公司 一种用于特定环境下的终端监控管理系统
CN116545642B (zh) * 2023-01-07 2024-05-14 杭州融至兴科技有限公司 一种用于特定环境下的终端监控管理系统

Also Published As

Publication number Publication date
CN111198797A (zh) 2020-05-26
CN111198797B (zh) 2021-12-31

Similar Documents

Publication Publication Date Title
US11704177B2 (en) Session triage and remediation systems and methods
WO2021129335A1 (fr) Procédé et appareil de surveillance d'opération, procédé et appareil d'analyse d'opération
WO2019196274A1 (fr) Procédé et appareil de test de page web, dispositif électronique et support
US8490059B2 (en) Cross-browser testing of a web application
US11704191B2 (en) Error remediation systems and methods
US7139978B2 (en) Recording user interaction with an application
US8566648B2 (en) Automated testing on devices
US7464004B2 (en) Troubleshooting to diagnose computer problems
US10705946B2 (en) Techniques for real time server testing in a production environment
WO2013075612A1 (fr) Procédé et dispositif d'identification automatique
WO2018184361A1 (fr) Procédé de test d'application, serveur, terminal et supports de stockage
US10521333B2 (en) Automated system for fixing and debugging software deployed to customers
CN109815119B (zh) 一种app链接渠道的测试方法及装置
US20160359989A1 (en) Recording And Triggering Web And Native Mobile Application Events With Mapped Data Fields
CN111552633A (zh) 接口的异常调用测试方法、装置、计算机设备及存储介质
CN110381026B (zh) 一种富客户端的业务服务封装和访问系统、方法和装置
US9477399B1 (en) Automated interaction for mobile applications
US10135684B2 (en) Differential staging of devices in bulk enrollment
CN113362173A (zh) 防重机制验证方法、验证系统、电子设备及存储介质
US9201591B1 (en) Automated coverage monitoring of mobile applications
RU2669172C2 (ru) Способ и система мониторинга согласованности веб-сайта
CN112015715A (zh) 工业互联网数据管理服务测试方法及系统
WO2015039585A1 (fr) Procédé et dispositif pour tester la fiabilité d'un logiciel
US20230131682A1 (en) Facilitated live analysis of screen content
US9858549B2 (en) Business transaction resource usage tracking

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 20905142

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 20905142

Country of ref document: EP

Kind code of ref document: A1