CN116974866A - Processing method and device of application response process, electronic equipment and storage medium - Google Patents

Processing method and device of application response process, electronic equipment and storage medium Download PDF

Info

Publication number
CN116974866A
CN116974866A CN202310145036.8A CN202310145036A CN116974866A CN 116974866 A CN116974866 A CN 116974866A CN 202310145036 A CN202310145036 A CN 202310145036A CN 116974866 A CN116974866 A CN 116974866A
Authority
CN
China
Prior art keywords
time
application
response
process event
event
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202310145036.8A
Other languages
Chinese (zh)
Inventor
王智勇
邓坤力
黄灿辉
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Tencent Technology Shenzhen Co Ltd
Original Assignee
Tencent Technology Shenzhen Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Tencent Technology Shenzhen Co Ltd filed Critical Tencent Technology Shenzhen Co Ltd
Priority to CN202310145036.8A priority Critical patent/CN116974866A/en
Publication of CN116974866A publication Critical patent/CN116974866A/en
Pending legal-status Critical Current

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F11/00—Error detection; Error correction; Monitoring
    • G06F11/30—Monitoring
    • G06F11/34—Recording or statistical evaluation of computer activity, e.g. of down time, of input/output operation ; Recording or statistical evaluation of user activity, e.g. usability assessment
    • G06F11/3409—Recording or statistical evaluation of computer activity, e.g. of down time, of input/output operation ; Recording or statistical evaluation of user activity, e.g. usability assessment for performance assessment
    • G06F11/3419—Recording or statistical evaluation of computer activity, e.g. of down time, of input/output operation ; Recording or statistical evaluation of user activity, e.g. usability assessment for performance assessment by assessing time
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F11/00—Error detection; Error correction; Monitoring
    • G06F11/30—Monitoring
    • G06F11/34—Recording or statistical evaluation of computer activity, e.g. of down time, of input/output operation ; Recording or statistical evaluation of user activity, e.g. usability assessment
    • G06F11/3452—Performance evaluation by statistical analysis
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F11/00—Error detection; Error correction; Monitoring
    • G06F11/30—Monitoring
    • G06F11/34—Recording or statistical evaluation of computer activity, e.g. of down time, of input/output operation ; Recording or statistical evaluation of user activity, e.g. usability assessment
    • G06F11/3466—Performance evaluation by tracing or monitoring
    • G06F11/3476—Data logging

Abstract

The present application relates to the field of data processing technologies, and in particular, to a processing method, an apparatus, an electronic device, and a storage medium for applying a response procedure, where the method includes: acquiring each process event associated with a target object in an application response process of the target application, wherein each process event is associated with a time stamp; dividing the duration of the application response process into a plurality of time intervals; each time interval corresponds to a time stamp range; according to the time stamps and the time stamp ranges, importance factors configured for various process events are obtained in advance, and importance indexes corresponding to the process event sets are obtained respectively; and respectively presenting corresponding importance indexes corresponding to the process event sets respectively associated with the time intervals on a progress time axis corresponding to the response video. In this way, the importance level determined by each process event in different time zones can be intuitively presented in consideration of all process events.

Description

Processing method and device of application response process, electronic equipment and storage medium
Technical Field
The present application relates to the field of data processing technologies, and in particular, to a processing method and apparatus for an application response procedure, an electronic device, and a storage medium.
Background
Under the related technology, in order to analyze an application response process triggered by a related object when the application is used, a playback progress bar is usually maintained while the pre-recorded application response process is played back, corresponding graphic identifiers are respectively configured for various events possibly occurring in the application response process, and the events occurring in the application response process and corresponding occurrence time are identified on the playback progress bar to obtain a processing result of the application response process, wherein the various events comprise operation events of the related object and response events triggered by the operation of the related object.
However, as hundreds of types of events may occur in the application response process, when the graphic identifiers corresponding to the event types are drawn on the playback progress bar, on one hand, multiple types of graphic identifiers need to be maintained, so that not only is the extremely high learning cost required, but also a large amount of resources are consumed to distinguish the graphic identifiers corresponding to different events, on the other hand, the playback progress bar contains excessive types of graphic identifiers, which causes disorder of visual graphic identifiers and reduces visual viewing effects; furthermore, because the length of the playback progress bar is limited, in order to avoid overlapping of graphic identifiers of different events, the influence of each event in the application response process, which cannot be comprehensively expressed, cannot be obtained as an effective processing result.
Disclosure of Invention
The embodiment of the application provides a processing method, a device, electronic equipment and a storage medium for an application response process, which are used for solving the problems that in a processing result obtained in the prior art, a playback progress bar marked with the occurrence time of an event has poor visual effect and the influence of each event cannot be comprehensively expressed.
In a first aspect, a method for processing an application response procedure is provided, including:
acquiring each process event associated with a target object in an application response process of the target application, wherein each process event is: triggering events of the target object or response events of the target application, wherein each process event is associated with a time stamp;
determining the duration of the application response process according to each time stamp, and dividing the duration into a plurality of time intervals according to the number of the set intervals; each time interval corresponds to a time stamp range;
respectively determining a process event set associated with each of the time intervals according to each time stamp and the time stamp ranges, and respectively obtaining importance indexes corresponding to each process event set based on importance factors configured for each process event in advance;
And generating a response video aiming at the application response process, configuring a progress time axis corresponding to the response video based on the duration, and respectively presenting corresponding importance indexes corresponding to each associated process event set of the time intervals on the progress time axis.
In a second aspect, a processing apparatus for applying a response procedure is provided, including:
the acquiring unit is used for acquiring each process event associated with the target object in the application response process of the target application, wherein each process event is as follows: triggering events of the target object or response events of the target application, wherein each process event is associated with a time stamp;
the dividing unit is used for determining the duration of the application response process according to each time stamp and dividing the duration into a plurality of time intervals according to the number of the set intervals; each time interval corresponds to a time stamp range;
the determining unit is used for respectively determining the process event sets respectively associated with the time intervals according to the time stamps and the time stamp ranges and respectively obtaining importance indexes corresponding to the process event sets based on importance factors configured for various process events in advance;
The generating unit is used for generating a response video aiming at the application response process, configuring a progress time axis corresponding to the response video based on the duration time, and respectively presenting corresponding importance indexes corresponding to the process event sets respectively associated with the time intervals on the progress time axis.
Optionally, when the process event sets associated with the time intervals respectively represent corresponding importance indexes on the progress time axis, the generating unit is configured to:
respectively determining target time points for presenting corresponding importance indexes in a plurality of corresponding time intervals on the progress time axis, wherein the corresponding process event sets are respectively associated with the time intervals;
and presenting important program indexes corresponding to each of the target time points on the progress time axis in an area line graph mode.
Optionally, the generating unit is further configured to:
generating a corresponding process playback tag based on an application response process of the current target application to the target object;
and responding to the triggering indication of the process playback label, playing the response video, displaying the playing progress on a progress time axis corresponding to the response video, and displaying an area line graph for identifying the change condition of the importance index in a plurality of time intervals on the progress time axis.
Optionally, the generating unit is further configured to:
and responding to the play position adjustment operation triggered by the progress time axis, determining an adjusted play time point, and continuing to play the response video from the position corresponding to the play time point in the response video.
Optionally, when the generating a response video for the application response process, the generating unit includes:
respectively acquiring page display information associated with each process event in the application response process;
privacy processing is carried out on text content and picture content contained in the page display information to obtain processed page display information, a plurality of corresponding response video frames are generated according to the processed page display information, and response videos are obtained based on the response video frames.
Optionally, when determining the process event sets associated with the time intervals respectively according to the time stamps and the time stamp ranges, the determining unit is configured to:
respectively determining the time stamp ranges to which the time stamps belong according to the time stamps and the time stamp ranges to obtain event time stamp sets respectively associated with the time intervals corresponding to the time stamp ranges, and obtaining a plurality of process event sets corresponding to the event time stamp sets;
And respectively determining the corresponding process event sets of the event timestamp sets as the associated process event sets of the corresponding time intervals.
Optionally, when the importance degree factors configured for each process event set in advance are based on the importance degree factors, the determining unit is configured to:
for each set of process events, the following operations are performed separately:
determining each process event contained in the process event set, and respectively determining the importance degree factors corresponding to each process event in the process event set according to the importance degree factors configured for each process event in advance;
and carrying out weighted superposition processing on importance factors corresponding to each process event in the process event set to obtain importance indexes corresponding to the process event set.
Optionally, the determining the duration of the application response process according to each timestamp, and when dividing the duration into a plurality of time intervals according to a set number of intervals, the dividing unit is configured to:
determining the duration of the application response process based on the time stamp corresponding to the earliest occurrence time and the latest occurrence time respectively in each time stamp, dividing the duration into a plurality of time intervals according to the number of the set intervals, and determining the sub-duration corresponding to each time interval;
And respectively determining the timestamp range corresponding to each of the time intervals based on the timestamp corresponding to the earliest occurrence time and the sub-duration corresponding to each of the time intervals.
Optionally, the acquiring unit is further configured to, in an application response process of the target application, before each process event associated with the target object, acquire the application response process of the target application, and further:
and sending a collection authorization request to the target object, and receiving an authorization permission indication triggered by the target object, wherein the collection authorization request is used for requesting permission of a target application to collect all process events associated with the target object in an application response process.
Optionally, when the schedule time axis corresponding to the response video is configured based on the duration, the generating unit is configured to:
configuring a corresponding progress time axis for the response video;
the duration is configured to be the total video duration corresponding to the progress time axis, the corresponding relation of the time intervals on the progress time axis is respectively established, and the association relation between each response video frame in the response video and each time point on the progress time axis is respectively established.
In a third aspect, an electronic device is presented comprising a memory, a processor and a computer program stored on the memory and executable on the processor, the processor implementing the above method when executing the program.
In a fourth aspect, a computer readable storage medium is provided, on which a computer program is stored, which computer program, when being executed by a processor, implements the above method.
In a fifth aspect, a computer program product is proposed, comprising a computer program which, when executed by a processor, implements the above method.
The application has the following beneficial effects:
in the embodiment of the application, a processing method, a device, an electronic device and a storage medium of an application response process are provided, wherein the duration of the application response process is divided into a plurality of time intervals, and a process event set respectively associated with each time interval is determined according to the time stamp respectively associated with each process event generated in the application response process, which is equivalent to all process events related in the application response process, and grouping and aggregation are carried out according to the time stamp associated with the process event, so that each process event set contains each process event in a time stamp range, and the classification and collection of the events from all process event layers are realized; and further, by pre-configuring importance factors for various process events, importance indexes corresponding to a process event set containing the process events can be determined by considering the importance factors of the single process event, and the comprehensive influence result of each process event covered by each timestamp range can be effectively measured; furthermore, by respectively presenting the importance indexes corresponding to the time intervals on the progress time axis, the importance indexes determined by the importance factors of the process events in the different time intervals can be intuitively presented in the progress time axis obtained by processing, the presentation mode is intuitive, the visual experience is very good, and the problem of visual confusion does not exist; in addition, in the technical scheme provided by the application, the comprehensive influence of all types of process events is considered, so that the occurrence condition of the process events in the application response process can be more comprehensively presented; and the method and the device have the advantages that the importance factors corresponding to the process event types which are important to pay attention to are needed in advance according to actual use requirements, and the important program indexes corresponding to different time intervals are presented, so that the active condition of a target object in using the target application can be expressed laterally, the time interval in which the process event which is important to pay attention to is likely to be positioned quickly, and the potential problems and optimizable points in the target application can be positioned and analyzed by presenting the corresponding contents in the response video.
Drawings
FIG. 1 is a schematic diagram of a playback progress bar drawn in an embodiment of the present application;
fig. 2 is a schematic diagram of a possible application scenario in an embodiment of the present application;
FIG. 3A is a schematic diagram of a process flow of applying a response procedure in an embodiment of the present application;
FIG. 3B is a schematic diagram of a plurality of time intervals divided according to an embodiment of the present application;
FIG. 3C is a schematic diagram illustrating determining importance index corresponding to each of a plurality of process event sets according to an embodiment of the present application;
FIG. 3D is a schematic diagram of a response video frame generated in an embodiment of the present application;
fig. 3E is a schematic diagram of a correspondence between a progress time axis and a duration of an application response process in an embodiment of the present application;
FIG. 3F is a schematic diagram of a selected target time point according to an embodiment of the application;
FIG. 3G is a schematic diagram of an area ray diagram obtained on a schedule time axis according to an embodiment of the present application;
FIG. 4 is a schematic diagram of a page for viewing a processing result in an embodiment of the present application;
FIG. 5 is a schematic view of a playback page of the processing results presented in an embodiment of the present application;
FIG. 6 is a schematic diagram of a logic structure of a processing device applying a response procedure according to an embodiment of the present application;
fig. 7 is a schematic diagram of a hardware component structure of an electronic device according to an embodiment of the present application;
FIG. 8 is a schematic diagram of a computing device according to an embodiment of the application.
Detailed Description
For the purpose of making the objects, technical solutions and advantages of the embodiments of the present application more apparent, the technical solutions of the present application will be clearly and completely described below with reference to the accompanying drawings in the embodiments of the present application, and it is apparent that the described embodiments are some embodiments of the technical solutions of the present application, but not all embodiments. All other embodiments, based on the embodiments described in the present document, which can be obtained by a person skilled in the art without any creative effort, are within the scope of protection of the technical solutions of the present application.
The terms first, second and the like in the description and in the claims and in the above-described figures, are used for distinguishing between similar elements and not necessarily for describing a particular sequential or chronological order. It is to be understood that the data so used may be interchanged where appropriate such that the embodiments of the application described herein may be capable of operation in sequences other than those illustrated or otherwise described.
Some terms in the embodiments of the present application are explained below to facilitate understanding by those skilled in the art.
Playback: in particular, the application site of the application object is shown, and the content shown comprises UI data (page style and changes thereof) and interaction data (clicking, sliding and the like).
Related objects: refers to an object for developing an application or to an object related to application function adjustment.
Target object: refers to objects that use an application.
Process events: the method comprises the steps that when a target object uses a target application, an event is generated in an application response process of the target application aiming at the target object, wherein the process event comprises a trigger event generated by triggering the target object and a response event of the target application; triggering events correspond to events generated by the interactive operation of the target object, such as clicking, sliding, inputting and other operation events on a page in the target application; the response event corresponds to an event generated by the target application in response to an operation of the target object, such as a page style change event, a presentation event of a different page, and the like.
The application response process: in the embodiment of the present application, the one-time application response process refers to a process in which the target application provides one service for one target object, for example, it is assumed that the target application is an application for booking an air ticket, and the one-time application response process refers to a process in which the target object completes the air ticket booking service by adopting the application.
Artificial intelligence (Artificial Intelligence, AI) is the theory, method, technique and application system that uses a digital computer or a machine controlled by a digital computer to simulate, extend and extend human intelligence, sense the environment, acquire knowledge and use the knowledge to obtain optimal results. In other words, artificial intelligence is an integrated technology of computer science that attempts to understand the essence of intelligence and to produce a new intelligent machine that can react in a similar way to human intelligence. Artificial intelligence, i.e. research on design principles and implementation methods of various intelligent machines, enables the machines to have functions of sensing, reasoning and decision.
The artificial intelligence technology is a comprehensive subject, and relates to the technology with wide fields, namely the technology with a hardware level and the technology with a software level. Artificial intelligence infrastructure technologies generally include technologies such as sensors, dedicated artificial intelligence chips, cloud computing, distributed storage, big data processing technologies, operation/interaction systems, mechatronics, and the like. The artificial intelligence software technology mainly comprises a computer vision technology, a voice processing technology, a natural language processing technology, machine learning/deep learning and other directions. In the technical scheme provided by the application, the application response process can be processed by means of an artificial intelligence technology.
The following briefly describes the design concept of the embodiment of the present application:
under the related technology, in order to analyze the application response process of the target application when the target object uses the target application, the application response process is recorded in a screen recording mode to obtain video content; and playing back the application response process in a mode of playing the video content, marking different types of events and occurrence time of the events on a playback progress bar corresponding to the video content by using different image identifiers, and finally processing to obtain the video content and the playback progress bar after drawing.
In particular, special events are currently drawn directly to a playback progress bar in the form of corresponding graphical identifiers, usually by means of a callstore tool, which is a process playback-based analysis tool.
For example, referring to fig. 1, which is a schematic diagram of a playback progress bar drawn in an embodiment of the present application, when a graphic identifier corresponding to a special event is directly drawn on the playback progress bar by adopting a fullstore technology, it can be known from the content illustrated in fig. 1 that a special event a is drawn as "lightning", a special event B is drawn as "star", and then, based on the content drawn on the playback progress bar, an object viewing the progress bar can quickly know whether or not an event occurs and when.
However, since the one application response process may include tens or even hundreds of types of events, and often the event types that need special attention may not be more than ten, if the graphic identifiers corresponding to the events are to be drawn on the playback progress bar one by one, on one hand, in view of limited expansibility of the existing processing manner on the event types, each type of event draws a different graphic identifier, which greatly increases the cost of learning the correspondence between the different types of events and the graphic identifiers, and makes it difficult to effectively establish the correspondence; on the other hand, when too many graphic identifications are simultaneously drawn on the playback progress bar, visual clutter can be generated, and visual viewing effects are greatly reduced. Moreover, in the display content in the prior art, based on the playback progress bar drawn by the fullest, whether the target object leaves the page of the target application can only be identified, and when no operation of the target object is determined, the target object leaves the page by default, which cannot not only indicate the activity of the target object, but also cannot screen the situation that the target object does not leave the target application but does not operate for a long time.
In view of this, in an embodiment of the present application, a processing method, an apparatus, an electronic device, and a storage medium for an application response process are provided, where in a specific processing process, each process event associated with a target object in an application response process of a target application is acquired first, where each process event is: triggering events of the target object or response events of the target application, wherein each process event is associated with a time stamp; determining the duration of the application response process according to each time stamp, and dividing the duration into a plurality of time intervals according to the number of the set intervals; each time interval corresponds to a time stamp range; then, respectively determining a process event set associated with each of a plurality of time intervals according to each time stamp and a plurality of time stamp ranges, and respectively obtaining importance indexes corresponding to each process event set based on importance factors configured for each process event in advance; and generating a response video aiming at the application response process, configuring a progress time axis corresponding to the response video based on the duration time, and respectively presenting corresponding importance indexes corresponding to each associated process event set of a plurality of time intervals on the progress time axis.
In this way, the duration of the application response process is divided into a plurality of time intervals, and the respective associated process event sets of the plurality of time intervals are determined according to the respective associated time stamps of the process events generated in the application response process, which is equivalent to grouping and aggregating all the process events related in the application response process according to the time stamps associated with the process events, so that each process event set contains each process event in a time stamp range, and the classification and aggregation of the events from all the process event layers are realized; and further, by pre-configuring importance factors for various process events, importance indexes corresponding to a process event set containing the process events can be determined by considering the importance factors of the single process event, and the comprehensive influence result of each process event covered by each timestamp range can be effectively measured; furthermore, by respectively presenting the importance indexes corresponding to the time intervals on the progress time axis, the importance indexes determined by the importance factors of the process events in the different time intervals can be intuitively presented in the progress time axis obtained by processing, the presentation mode is intuitive, the visual experience is very good, and the problem of visual confusion does not exist; in addition, in the technical scheme provided by the application, the comprehensive influence of all types of process events is considered, so that the occurrence condition of the process events in the application response process can be more comprehensively presented; and the method and the device have the advantages that the importance factors corresponding to the process event types which are important to pay attention to are needed in advance according to actual use requirements, and the important program indexes corresponding to different time intervals are presented, so that the active condition of a target object in using the target application can be expressed laterally, the time interval in which the process event which is important to pay attention to is likely to be positioned quickly, and the potential problems and optimizable points in the target application can be positioned and analyzed by presenting the corresponding contents in the response video.
The preferred embodiments of the present application will be described below with reference to the accompanying drawings of the specification, it being understood that the preferred embodiments described herein are for illustration and explanation only, and not for limitation of the present application, and that the embodiments of the present application and the features of the embodiments may be combined with each other without conflict.
Fig. 2 is a schematic diagram of a possible application scenario in an embodiment of the present application. The application scenario diagram includes a processing device 210, and a client device 220.
In the embodiment of the present application, the processing device 210 refers to a device for developing a target application, and is capable of providing services for the client device 220 for installing the target application; in some possible embodiments, the processing device 210 is deployed with self-developed implementation logic for implementing application response procedure processing, and in other possible embodiments, the processing device 210 is deployed with other device-developed implementation logic for implementing application response procedure processing.
When determining that the target object uses the target application on the client device 220, the processing device 210 collects process events generated by the target application in an application response process for the target object under the condition that the authorization of the target object allows; further, the processing device 210 processes each obtained process event, generates a response video, and simultaneously generates a progress time axis identifying importance indexes corresponding to different time intervals, wherein the importance indexes are obtained by processing based on importance factors corresponding to each process event included in the process event set after determining a process event set associated with the corresponding time interval.
The processing device 210 is a device capable of supporting normal operation of the target application, in a possible embodiment, the processing device 210 may refer to a server corresponding to the target application, which may be an independent physical server, a server cluster or a distributed system formed by a plurality of physical servers, or a cloud server that provides cloud services, a cloud database, cloud computing, cloud functions, cloud storage, network services, cloud communication, middleware services, domain name services, security services, CDN (Content Delivery Network, content distribution network), and basic cloud computing services such as big data and an artificial intelligence platform.
The client device 220 refers to a device used by a target object and provided with a target application, and specifically may be a computer device with a certain computing capability, such as a personal computer, a mobile phone, a tablet computer, a notebook, an electronic book reader, an intelligent home, and a vehicle-mounted terminal.
In the embodiment of the present application, a communication connection may be established between the processing device 210 and the client device 220 by using a wired communication or a wireless communication manner.
The technical scheme provided by the application can be used for processing the application response process of various applications in various application scenes, and the processing of the application response process is described below by taking several possible application scenes as examples:
And the first scene is that the target application is an applet application, and the application response process of the applet application is processed.
After the processing device 210 completes development of the applet application and issues the applet application to the applet-bearing platform, the target object may implement specific service processing by accessing the applet on the client device 220.
Further, after determining that the target object accesses the applet, the processing device 210 continuously acquires a process event generated during a complete service process currently provided by the applet for the target object under the condition that the process event generated during the application response process is acquired by the authorization of the target object; dividing each process event into a plurality of time intervals with a designated number according to the time stamp associated with each process event based on each obtained process event, and obtaining a process event set associated with each time interval; then, according to importance factors preset for all types of process events in advance, determining importance indexes corresponding to each process event set respectively; and based on the importance indexes corresponding to the time intervals, presenting the importance indexes corresponding to the time intervals on the progress time axis from the level of the progress time axis corresponding to the response video.
In the embodiment of the application, the response video is generated corresponding to the application response process, the total duration of the video corresponding to the response video is the same as the duration of the application response process, and the progress bar on the progress time axis can show the playing progress of the response video.
And the second scene is that the target application is a client application, and the application response process of the client application is processed.
After the processing device 210 completes the development of the client application, the target object may implement specific service processing by accessing the client application on the client device 220.
Further, after determining that the target object accesses the client application, the processing device 210 continuously acquires a process event generated in a complete service process currently provided by the client application for the target object under the condition that the target object is authorized to acquire the process event generated in the application response process; dividing each process event into a plurality of time intervals with a designated number according to the time stamp associated with each process event based on each obtained process event, and obtaining a process event set associated with each time interval; then, according to importance factors preset for all types of process events in advance, determining importance indexes corresponding to each process event set respectively; and based on the importance indexes corresponding to the time intervals, presenting the importance indexes corresponding to the time intervals on the progress time axis from the level of the progress time axis corresponding to the response video.
In the embodiment of the application, the response video is generated corresponding to the application response process, the total duration of the video corresponding to the response video is the same as the duration of the application response process, and the progress bar on the progress time axis can show the playing progress of the response video.
And thirdly, processing an application response process of the webpage application by using the webpage application as the target application.
After the processing device 210 completes development of the web application, the target object may implement specific business processing by accessing the web application on the client device 220.
Further, after determining that the target object accesses the web application, the processing device 210 continuously acquires a process event generated in a complete service process currently provided by the web application for the target object under the condition that the target object is authorized to acquire the process event generated in the application response process; dividing each process event into a plurality of time intervals with a designated number according to the time stamp associated with each process event based on each obtained process event, and obtaining a process event set associated with each time interval; then, according to importance factors preset for all types of process events in advance, determining importance indexes corresponding to each process event set respectively; and based on the importance indexes corresponding to the time intervals, presenting the importance indexes corresponding to the time intervals on the progress time axis from the level of the progress time axis corresponding to the response video.
In the embodiment of the application, the response video is generated corresponding to the application response process, the total duration of the video corresponding to the response video is the same as the duration of the application response process, and the progress bar on the progress time axis can show the playing progress of the response video.
The following describes in detail the processing flow of the application response procedure according to the embodiment of the present application from the point of view of the processing device 210 with reference to the accompanying drawings:
referring to fig. 3A, a schematic process flow of an application response procedure in an embodiment of the present application is shown, and in conjunction with fig. 3A, the process flow of the application response procedure is described below:
step 301: the processing device obtains each process event associated with the target object in the application response process of the target application, wherein each process event is: the trigger event of the target object, or the response event of the target application, each process event is associated with a time stamp.
In the embodiment of the application, due to the consideration of information privacy and safety, the authorization permission of the target object is required to be obtained before the process event generated in the application response process of the target application to the target object is acquired, and in the technical scheme provided by the application, the data related to the privacy safety of the target object is not stored.
In the process of requesting authorization permission of a target object, the processing device sends a collection authorization request to the target object and receives an authorization permission indication triggered by the target object, wherein the collection authorization request is used for requesting permission of the target application to collect all process events associated with the target object in an application response process.
In the embodiment of the present application, the processing device may respectively treat each user in the specified range as a target object according to the actual processing requirement, and obtain each process event generated by each user in the process of using the target application, where the description of the present application only uses the processing of one target object as an example, and describes the related processing process; moreover, considering that the same target object may use target applications at different times, the processing device may perform processing separately for application response processes that the same target object triggers at different times.
When sending an acquisition authorization request to a target object, in some possible implementation scenarios, the processing device may display the acquisition authorization request in a form of popup window or page content when the target object first uses the target application, and after determining that the target object triggers an authorization permission instruction, control each process event in the response process of the acquisition application of the target application; in other possible implementation scenarios, the processing device may display the acquisition authorization request in the form of a pop-up window or page content each time the target object revisits the target application, and control the target application to acquire each process event in the application response process after determining that the target object triggered the authorization permission indication.
Therefore, on the premise of authorization of the target object, the process events generated by the target object when the target application is used can be collected, and the awareness of the target object for data collection is maintained.
Further, when the processing device acquires each process event associated with the target object in the application response process of the target application, each process event acquired by the target application and generated in the process of using the target application by the target object may be acquired, where each process event is: a trigger event for the target object, or a response event for the target application.
Each process event obtained by the processing device may be denoted as e= { type i ，time i I=1, 2, 3 … … N, where N is the total number of process events, type, included in the application response process of the target application to the target object at this time i Characterization of type, time of ith Process event i The timestamp associated with the ith process event is characterized.
In the embodiment of the present application, the trigger event of the target object may be understood as an interaction event, for example, a click event, a sliding event, a long-press event, etc. triggered by the target object; response events of the target application include various User Interface (UI) events, such as UI initialization, UI change, keyboard height change, routing, and the like. Each process event is associated with a timestamp, wherein the associated timestamp characterizes the time of occurrence of the process event.
Step 302: the processing equipment determines the duration of the application response process according to each time stamp, and divides the duration into a plurality of time intervals according to the number of the set intervals, wherein each time interval corresponds to a time stamp range.
In the embodiment of the application, processing equipment acquires each process event in the application response process, and after determining each associated time stamp of each process event, the processing equipment can determine the duration of the application response process according to each associated time stamp of each process event; and further determining the number of time intervals according to the actual processing requirement, dividing the duration of the application response process into a plurality of time intervals, and obtaining the corresponding time stamp range of each time interval.
Specifically, in each timestamp, the processing device determines the duration of the application response process based on the timestamp corresponding to the earliest occurrence time and the latest occurrence time respectively, divides the duration into a plurality of time intervals according to the number of the set intervals, and determines the sub-duration corresponding to each of the time intervals; and determining the time stamp range corresponding to each of the time intervals based on the time stamp corresponding to the earliest occurrence time and the sub-duration time corresponding to each of the time intervals.
It should be noted that, in the embodiment of the present application, the sub-duration time of different time intervals may be the same or different according to the actual processing requirement, which is not specifically limited in the present application; and for the sub-duration time corresponding to each of the time intervals, the sum of the sub-duration time corresponding to each of the time intervals is the duration time corresponding to the application response process. In general, in an actual application response process, thousands of process events may be involved in an application response process, which makes the complexity of presenting a single process event extremely high and the visual presentation effect not good, so that by dividing a time interval, each process event in the same time interval is considered as a whole, and the application can set the value of the interval number according to the actual processing configuration.
For example, referring to fig. 3B, which is a schematic diagram of a plurality of time intervals obtained by dividing in the embodiment of the present application, it can be known from the content illustrated in fig. 3B that, for each obtained process event, step results of the process events after being arranged according to the occurrence sequence of each process event can be obtained according to the sequence of occurrence sequence of each process event expressed by the time stamp associated with each process event; further, it is possible to determine the time stamp corresponding to each of the earliest occurrence time and the latest occurrence time, and determine the duration between the time stamp corresponding to the latest occurrence time and the time stamp corresponding to the earliest occurrence time as the duration of the application response process.
Then, dividing the duration into a plurality of corresponding time intervals according to the number of the set intervals, and dividing the time intervals into 4 time intervals on the assumption that the number of the set intervals is 4 as shown in fig. 3B, wherein each time interval corresponds to a sub-duration, and further obtaining the timestamp range corresponding to each time interval by combining the timestamp corresponding to the earliest occurrence time and the sub-duration corresponding to each time interval.
For another example, assume that in each process event, the earliest time of occurrence is determined to correspond to a timestamp of 03/26/13:10:44 (i.e., 13 hours, 10 minutes, 44 seconds on day 3, 26), the time stamp corresponding to the latest occurrence time is 03/26/13:12:44, then the duration corresponding to the application response process can be determined to be 120 seconds; assuming that the number of the set intervals is 4, the sub-duration time corresponding to each time interval is 120/4=30 seconds; based on this, the time interval 1 corresponds to a time stamp range of 03/26/13:10:44-03/26/13:11:14; the timestamp range corresponding to time interval 2 is: 03/26/13:11:14-03/26/13:11:44; the timestamp range corresponding to time interval 3 is: 03/26/13:11:44-03/26/13:12:14; the timestamp range corresponding to time interval 4 is: 03/26/13:12:14-03/26/13:12:44.
In this way, the duration of the application response process can be divided into the time intervals of the set number of intervals by setting the number of intervals, which is equivalent to grouping from the time level, and because each time interval corresponds to a time stamp range, which is equivalent to establishing the association between the time interval and the time stamp of the process event, the processing basis is provided for the subsequent aggregation of each process event.
Step 303: the processing equipment respectively determines a process event set associated with each of a plurality of time intervals according to each time stamp and a plurality of time stamp ranges, and respectively obtains importance indexes corresponding to each process event set based on importance factors configured for each process event in advance.
In the embodiment of the application, when processing equipment respectively determines a process event set associated with each time interval according to each time stamp and a plurality of time stamp ranges, respectively determining a time stamp range to which each time stamp belongs according to each time stamp and the plurality of time stamp ranges to obtain an event time stamp set associated with each time interval corresponding to the plurality of time stamp ranges, and obtaining a plurality of process event sets corresponding to the plurality of event time stamp sets; and respectively determining the corresponding process event sets of the event timestamp sets as the associated process event sets of the corresponding time intervals.
It should be noted that, in the embodiment of the present application, since a corresponding process event set is determined corresponding to the process event occurring in each time interval, the following correspondence exists: total number of time intervals = total number of process event sets = total number of event timestamp sets. For a set of event timestamps, each timestamp in the set of event timestamps belongs to a time interval. Furthermore, on the basis of determining a plurality of event time stamp sets, a plurality of process event sets can be correspondingly obtained due to the association relation between the process events and the time stamps.
In the embodiment of the application, when the processing equipment respectively determines the process event sets corresponding to the process events, the process events are classified into barrels according to the associated time stamps. When determining the time interval to which each process event belongs, it is assumed that all process events involved in the current application response process are divided into K buckets, that is, the duration corresponding to the application response process is divided into K uniform time intervals, and K process event sets are finally obtained and recorded as E= { E 1 ，E 2 ，…，E K }。
When determining the time interval to which the process event belongs specifically, under the condition that the sub-duration time durations corresponding to the time intervals are the same, the following formula can be combined for judging:
Wherein, time is start Representing the earliest time of occurrence in each timestamp, time end Representing the latest time of occurrence in each timestamp, E j Representing a set of j-th process events,characterizing sub-durations, times, corresponding to individual time intervals i A time stamp representing the determined process event association.
Based on the above processing formula, the process event whose associated timestamp falls in the time interval j can be determined to be in the process event set corresponding to the time interval j.
For example, with continued reference to fig. 3B, after a plurality of time intervals are obtained by dividing the same time interval, a bucket (or called a classification collection) for all process events related to the application response process is implemented, so as to obtain a process event set corresponding to each of the plurality of time intervals.
In this way, the duration of the application response process is divided into a plurality of time intervals, the event time stamp sets respectively associated with the time intervals are determined according to the time stamps associated with the process events, and the process event sets are correspondingly determined according to the event time stamp sets, which is equivalent to grouping all the process events involved in the application response process according to the time stamps associated with the process events, so that each process event set contains all the process events in the time stamp range, and classification collection of all the process events is realized.
Further, when the processing device obtains the importance indexes corresponding to the process event sets respectively based on the importance factors configured for the process event sets in advance, the processing device performs the following operations for each process event set: determining each process event contained in the process event set, and respectively determining the importance degree factors corresponding to each process event in the process event set according to the importance degree factors configured for each process event in advance; and then carrying out weighted superposition processing on the importance factors corresponding to each process event in the process event set to obtain the importance index corresponding to the process event set.
Specifically, after dividing all process events included in the application response process into a plurality of process event sets, when calculating the corresponding importance index for the process event set corresponding to each time interval, the following formula may be adopted to calculate to obtain the importance index corresponding to each process event set:
wherein Result is j Representing the corresponding j-th set of process eventsImportance index (type) i ，time i )∈E j Characterizing each process event in the jth set of process events, weight typei Representing a preset importance factor for the event type of the process event i.
For example, referring to fig. 3C, which is a schematic diagram of determining importance indexes corresponding to each of a plurality of process event sets in the embodiment of the present application, as can be seen from the content illustrated in fig. 3C, it is assumed that the weight of an interaction event is set to 2, the weight of a page routing event is set to 8, the weight of a custom event a is set to 5, the weight of a custom event B is set to 4, other event weights are set to 1, and when calculating the importance indexes corresponding to each process event set, the importance indexes corresponding to each process event in the same process event set are obtained by weighting and aggregating the importance factors corresponding to each process event in the same process event set based on the importance factors configured for different types of process events in advance and the event types corresponding to different process events. Based on the importance index corresponding to different process event sets, time series data are formed.
According to the above-mentioned manner of calculating the importance index, different importance factors are configured for various process events according to the attention degree of different types of process events in advance, so that in a time interval in which the importance index takes a large value, abnormal or explorable process events occur at a high probability, and in a time interval in which the importance index takes a small value, events needing attention do not occur at a high probability, and thus excessive attention is not required. Therefore, based on the technical scheme provided by the application, the related objects can be effectively helped to quickly find potential abnormal points in the target application.
In this way, by determining the importance index corresponding to each process event set according to the importance factors configured for each type of process event in advance, the influence result obtained by each process event combination covered in each timestamp range can be effectively measured by considering the importance factor of a single process event and the importance index obtained by combining a plurality of process events in the process event set.
Step 304: the processing equipment generates a response video aiming at the application response process, configures a progress time axis corresponding to the response video based on the duration time, and respectively presents corresponding importance indexes corresponding to each associated process event set of a plurality of time intervals on the progress time axis.
In the embodiment of the application, when processing equipment generates a response video aiming at an application response process, page display information respectively associated with each process event in the application response process is acquired; and performing privacy processing on text content and picture content contained in the page display information to obtain processed page display information, generating a plurality of corresponding response video frames according to the processed page display information, and obtaining response video based on the response video frames.
It should be noted that, in the embodiment of the present application, when the processing device performs privacy processing on the text content and the picture content, the processing device may process the text content into special symbols, so that the original text content cannot be identified, where the special symbols may refer to well characters and the like; when the processing equipment carries out privacy processing on the picture content, the original picture content can be replaced by the black picture, so that the original picture content is prevented from being displayed.
The processing device is used for restoring the page content presentation change of the target application in the application response process, and considering that the process event occurs in a certain page of the target application, the page presentation information associated with each process event can be understood; and further, page contents which are watched from the view of the target object when the current process event occurs can be deduced reversely based on page display information which is respectively associated with each process event and the text contents and the picture contents which are subjected to privacy treatment, and response video frames which are generated corresponding to the page contents are constructed schematically.
Similarly, after generating a corresponding response video frame for each process event, the processing device arranges each obtained response video frame according to the occurrence sequence of the process event to obtain a response video, wherein the playing time of the corresponding generated response video frame is determined according to the time stamp of each process event; the total duration of the video corresponding to the response video is the same as the duration of the application response process.
For example, referring to fig. 3D, which is a schematic diagram of a response video frame generated in the embodiment of the present application, after determining a page content presented on a target application when a process event occurs, a processing device restores the page content, where text content in the restored page content is represented by a # symbol, and picture content is represented by a black picture.
In the embodiment of the application, for the generated response video, the response video frame corresponding to one process event starts to be displayed when reaching the playing position corresponding to the timestamp associated with the process event, and stops displaying when reaching the playing position corresponding to the next process event.
In this way, the page condition of the target application when different process events occur can be displayed under the condition that the privacy requirement on the target object is met, so that the page content change caused by the application response process can be restored from the view point of visualization.
In the embodiment of the present application, the processing device may only perform privacy processing on the text content processing content input with the target object according to the actual processing requirement, and may not perform privacy processing on other text contents of the service content in the identification page, which is not particularly limited in the present application. In addition, in a possible application scenario, for example, in a functional test scenario for a target application, the target object is used for testing the target application, and at this time, according to actual processing needs, a response video may be directly generated by a screen recording manner.
Further, in the embodiment of the present application, in order to visually show the playing progress of the response video, the processing device configures a progress timeline corresponding to the response video based on the duration of the application response process.
Specifically, the processing device configures a corresponding progress time axis for the response video; and configuring the duration of the application response process as the total video duration corresponding to the progress time axis, respectively establishing the corresponding relation of each of the time intervals on the progress time axis, and respectively establishing the association relation of each response video frame in the response video and each time point on the progress time axis.
In the embodiment of the application, when a progress time axis capable of representing the playing progress is configured aiming at the response video, the complete application response process is corresponding, and the duration of the application response process is configured as the total video duration corresponding to the progress time axis; in this case, the plurality of time intervals determined for the duration of the application response process can be directly mapped to each of the corresponding time intervals on the progress time axis, which corresponds to the time intervals that can be determined on the progress time axis.
Meanwhile, according to the time stamp associated with the process event, the play time point corresponding to each response video can be determined on the progress time axis according to the attribution condition in the time interval, so that the association relation between each response video frame and each time point on the play progress time axis can be established, the play content of the response video can be changed by changing the play position on the play progress time axis, wherein the establishment of the association relation between the video and the corresponding progress time axis is a conventional technology in the field, and the application does not specifically describe the description.
In this way, by configuring the progress time axis corresponding to the response video, the playing control of the response video is realized, so that the playing progress of the response video is controllable.
Further, the processing device may respectively present corresponding importance indexes corresponding to the process event sets associated with each of the plurality of time intervals on the progress time axis.
Specifically, in a plurality of time intervals corresponding to the progress time axis, the processing device respectively determines target time points for presenting corresponding importance indexes in a corresponding process event set corresponding to each of the plurality of time intervals in the corresponding time intervals on the progress time axis; and presenting important program indexes corresponding to the target time points on the progress time axis in an area line graph mode.
In the embodiment of the application, because the corresponding time intervals on the progress time axis are determined based on the time intervals corresponding to the duration of the application response process, based on the process event sets respectively associated with the time intervals in the duration of the application process, the process event sets respectively associated with the time intervals in the progress time axis can be determined.
For example, referring to fig. 3E, which is a schematic diagram illustrating a correspondence between a progress time axis and a duration of an application response process according to an embodiment of the present application, it can be seen from the content illustrated in fig. 3E that the duration of the application response process corresponds to a time length of the progress time axis and a time interval also corresponds to the time length.
Furthermore, in order to visually present the importance index corresponding to the process event set on the progress time axis, the processing device needs to correspond to each process event set, and in the corresponding time interval in the progress time axis, a target time point for presenting the importance index is selected, which corresponds to the presentation position when the importance index corresponding to the presentation time interval is selected.
For example, referring to fig. 3F, which is a schematic diagram of a target time point selected in the embodiment of the present application, according to actual processing needs, a processing device may select a time point corresponding to any position in a time interval as the target time point; specifically, a time point corresponding to the midpoint position in the time interval may be selected as the target time point, and each target time point illustrated in fig. 3F may be further obtained.
After the processing device determines the target time point in each time interval and the importance index corresponding to each time interval on the progress time axis, the importance index corresponding to each target time point can be presented on the progress time axis in an area line graph mode.
In addition, according to the actual processing requirement, the corresponding relation between each point on the folding line in the area folding line and the time point on the progress time axis can be established, so that when a certain position on the area folding line is clicked, the jump of the playing progress can be realized, and the establishment process of the related corresponding relation is a conventional technology in the field, and the application does not specifically describe the relation.
For example, referring to fig. 3G, which is a schematic diagram of an area line diagram obtained on a progress time axis according to an embodiment of the present application, as can be seen from the content illustrated in fig. 3G, it is assumed that 4 time intervals exist in the progress time axis, and after determining target time points in the 4 time intervals, it is assumed that importance indexes corresponding to the 4 time intervals are 6, 13, 3, and 13, respectively; the area line graph shown in fig. 3G can be obtained by connecting the importance index corresponding to each target time point with the area line graph, wherein the leftmost segment and the rightmost segment of the area line graph are aligned with the start and end positions of the progress time axis, respectively.
In this way, from the perspective of visualization, the importance indexes corresponding to the time intervals and determined by the importance indexes corresponding to the process event sets can be intuitively drawn on the progress time axis in an area line diagram mode, so that visual confusion is not generated, and the importance conditions of the process events in the process event sets corresponding to different time intervals can be effectively indicated; moreover, by pre-configuring importance factors corresponding to process event types needing to be focused on according to actual use requirements and presenting important program indexes corresponding to different time intervals, the side surface expresses the activity condition of a target object when the target application is used, so that the method is not only beneficial to quickly positioning the time interval in which the event with the focus is likely to exist, but also capable of positioning and analyzing potential problems and optimizable points in the target application by presenting corresponding contents in a response video.
Further, after finishing processing for the application response process to obtain a response video sum and a process event set associated with each of the corresponding multiple time intervals, respectively presenting a progress time axis of the corresponding importance index, the processing device may respond to a request for viewing the processing result and present the processing result.
Specifically, the processing device may generate a corresponding process playback tag based on an application response process of the current target application to the target object; and further, responding to the triggering indication aiming at the process playback label, playing the response video, displaying the playing progress on a progress time axis corresponding to the response video, and displaying an area line graph for marking the change condition of the importance index in a plurality of time intervals on the progress time axis.
It should be noted that after the processing device processes the application response process of the target application for different target objects and processes the application response processes of the target application for the same target object, a corresponding process playback tag may be generated for each application response process of the target application, so that a processing result obtained for the corresponding application response process may be presented by means of the process playback tag, where the processing result includes a response video and a progress time axis on which an area line graph is drawn.
In this way, from the view of subsequent processing browsing, the processing result which can be browsed can be determined by means of the process playback tag, and further, by triggering the process playback tag, the area line graph which marks the change condition of the importance index in a plurality of time intervals can be displayed while the response video is played, so that the time interval in which the key event is located can be intuitively known.
Meanwhile, when the response video is played, the processing device may determine an adjusted play time point in response to a play position adjustment operation triggered for the progress time axis, and continue playing the response video from a position corresponding to the play time point in the response video.
Specifically, the processing device may, while playing the response video, skip to an adjusted play time point in response to a play position adjustment operation triggered by the related object with respect to the progress time axis, and continue playing the response video from the play time point.
In the embodiment of the present application, when the play position adjustment operation is triggered according to the progress time axis, and when the adjusted play time point is determined, in some possible implementation manners, when the related object clicks at a certain position in the area line diagram, the clicked position may be determined as the adjusted play time point; in other possible implementations, when the related object directly drags against the progress time axis, the position where the related object is located after the dragging is stopped may be determined as the adjusted play time point at the corresponding time point on the progress time axis.
Therefore, when the processing result of the application response process is checked, the jump play of the response video can be realized according to the actual browsing requirement, and the checking experience of the related objects is improved.
The following describes a process of viewing a processing result based on an application response process provided by the present application, taking a target application as an example from a visual point of view:
in the embodiment of the application, the processing equipment can develop the processing function and the summarizing and presenting function for the application response process, so that the use experience of a user on the developed applet can be analyzed under the authorized condition, the abnormality (such as bug, cartoon, design and other problems) can be found in time, and the basis can be provided for optimizing the applet and upgrading the function.
The application can assist the applet developer in drill-down analysis by processing the application response process and presenting the processing result according to the trigger instruction.
Referring to fig. 4, which is a schematic page view of a processing result in an embodiment of the present application, as can be seen from the content illustrated in fig. 4, the processing device displays a generated process playback tag in a "playback" function of the "product experience analysis" module, and the content illustrated in fig. 4 includes: the method comprises the steps of generating process playback labels based on application response processes of the applet when a user uses the applet, wherein each process playback label comprises a starting time of the application response process, a duration (namely an access duration) of the application response process, a containing path and a development kit (Software Development Kit, SDK) version, and the containing path enumerates page paths of pages viewed by the user in the access process.
Further, after determining that the related object clicks to select a process playback tab, the processing device triggers entry into the playback page. Referring to fig. 5, a schematic view of a playback page of a processing result presented in an embodiment of the present application is shown, where related objects may view a complete user interaction site on the playback page, where the user interaction site includes attribute information related to an applet, a response video, and a progress timeline on which an area line graph is drawn, which are determined based on an application response procedure of the applet to a user.
The progress time axis below the playback player, similar to the progress bar of playing the response video, can display and adjust the playing progress. According to the method and the device, the area line graph is drawn on the progress time axis, so that the liveness of the user at different times can be displayed to the related objects, and the related objects can conveniently and efficiently explore the corresponding application response process.
In this way, the application is based on the process events generated in the operation of the small program, calculates the importance index comprehensively determined by each process event in different time intervals, and visualizes the importance index as a time sequence on the progress time axis, so that when the related object looks up the processing result of the application response process, the activity of the user in using the small program is quickly known, the abnormal point in the operation of the small program is helpful to be found, which is equivalent to intuitively providing the playback summary, and the importance determined by each process event in different time intervals can be intuitively presented under the condition of considering all process events.
Moreover, the technical scheme provided by the application solves the problem of expansibility of the existing scheme on the types and the number of the events, and the application can enable the final visual effect to be more obvious by configuring the process events with high importance with higher importance factors. Meanwhile, the time series data generated by aggregation can also be used for representing the activity information of the user. Compared with the prior art, when an application is opened for playback, the user behavior and UI change can be known only by playing the application to the corresponding position according to time, and the method and the device are equivalent to providing a playback abstract of an application processing process by determining the liveness according to important program indexes, so that partial information in the application response process can be captured under the condition that a response video is not required to be played.
Based on the same inventive concept, referring to fig. 6, which is a schematic logic structure diagram of a processing device for applying a response procedure in an embodiment of the present application, a processing device 600 for applying a response procedure includes an obtaining unit 601, a dividing unit 602, a determining unit 603, and a generating unit 604, where,
the acquiring unit 601 is configured to acquire each process event associated with the target object in an application response process of the target application, where each process event is: triggering events of the target object or response events of the target application, wherein each process event is associated with a time stamp;
A dividing unit 602, configured to determine a duration of an application response process according to each timestamp, and divide the duration into a plurality of time intervals according to a set number of intervals; each time interval corresponds to a time stamp range;
a determining unit 603, configured to determine, according to each timestamp and a plurality of timestamp ranges, a process event set associated with each of a plurality of time intervals, and obtain, based on importance factors configured for each type of process event in advance, importance indexes corresponding to each process event set, respectively;
the generating unit 604 is configured to generate a response video for the application response process, configure a progress time axis corresponding to the response video based on the duration, and respectively present corresponding importance indexes corresponding to the process event sets associated with the time intervals on the progress time axis.
Optionally, on the progress time axis, when the corresponding importance indexes are respectively presented corresponding to the process event sets associated with the time intervals, the generating unit 604 is configured to:
respectively determining target time points for presenting corresponding importance indexes in a plurality of corresponding time intervals on a progress time axis and corresponding process event sets respectively associated with the time intervals;
And presenting important program indexes corresponding to the target time points on the progress time axis in an area line graph mode.
Optionally, the generating unit 604 is further configured to:
generating a corresponding process playback tag based on an application response process of the current target application to the target object;
and responding to the triggering indication aiming at the process playback label, playing the response video, displaying the playing progress on a progress time axis corresponding to the response video, and displaying an area line graph for identifying the change condition of the importance index in a plurality of time intervals on the progress time axis.
Optionally, the generating unit 604 is further configured to:
and responding to the play position adjustment operation triggered by the progress time axis, determining an adjusted play time point, and continuing to play the response video from the position corresponding to the play time point in the response video.
Optionally, when generating the response video for the application response procedure, the generating unit 604 includes:
respectively acquiring page display information associated with each process event in the application response process;
privacy processing is carried out on text content and picture content contained in the page display information to obtain processed page display information, a plurality of corresponding response video frames are generated according to the processed page display information, and response videos are obtained based on the response video frames.
Optionally, when determining the process event sets associated with each of the plurality of time intervals according to each time stamp and the plurality of time stamp ranges, the determining unit 603 is configured to:
respectively determining the time stamp ranges of the time stamps according to the time stamps and the time stamp ranges to which the time stamps belong to obtain event time stamp sets respectively associated with the time intervals corresponding to the time stamp ranges, and obtaining a plurality of process event sets corresponding to the event time stamp sets;
and respectively determining the corresponding process event sets of the event timestamp sets as the associated process event sets of the corresponding time intervals.
Optionally, when the importance indexes corresponding to the process event sets are respectively obtained based on importance factors configured for each process event in advance, the determining unit 603 is configured to:
for each set of process events, the following operations are performed separately:
determining each process event contained in the process event set, and respectively determining the importance degree factors corresponding to each process event in the process event set according to the importance degree factors configured for each process event in advance;
and carrying out weighted superposition processing on the importance factors corresponding to each process event in the process event set to obtain the importance index corresponding to the process event set.
Optionally, when determining the duration of the application response process according to each timestamp and dividing the duration into a plurality of time intervals according to the number of the set intervals, the dividing unit 602 is configured to:
determining duration of an application response process based on the time stamp corresponding to the earliest occurrence time and the latest occurrence time respectively in each time stamp, dividing the duration into a plurality of time intervals according to the number of the set intervals, and determining sub-duration corresponding to each time interval;
and respectively determining the time stamp range corresponding to each of the time intervals based on the time stamp corresponding to the earliest occurrence time and the sub-duration corresponding to each of the time intervals.
Optionally, before acquiring each process event associated with the target object in the application response process of the target application, the acquiring unit 601 is further configured to:
and sending a collection authorization request to the target object and receiving an authorization permission indication triggered by the target object, wherein the collection authorization request is used for requesting permission of the target application to collect all process events associated with the target object in an application response process.
Optionally, when the progress time axis corresponding to the response video is configured based on the duration, the generating unit 604 is configured to:
Configuring a corresponding progress time axis aiming at the response video;
the duration is configured to be the total duration of the video corresponding to the progress time axis, the corresponding relation of each of the time intervals on the progress time axis is respectively established, and the association relation of each response video frame in the response video and each time point on the progress time axis is respectively established.
Having described the processing method and apparatus of the application response procedure of the exemplary embodiment of the present application, next, an electronic device according to another exemplary embodiment of the present application is described.
Those skilled in the art will appreciate that the various aspects of the application may be implemented as a system, method, or program product. Accordingly, aspects of the application may be embodied in the following forms, namely: an entirely hardware embodiment, an entirely software embodiment (including firmware, micro-code, etc.) or an embodiment combining hardware and software aspects may be referred to herein as a "circuit," module "or" system.
Based on the same inventive concept as the above-mentioned method embodiment, an electronic device is further provided in the embodiment of the present application, and referring to fig. 7, which is a schematic diagram of a hardware composition structure of an electronic device to which the embodiment of the present application is applied, an electronic device 700 may at least include a processor 701 and a memory 702. The memory 702 stores therein program code that, when executed by the processor 701, causes the processor 701 to execute the steps of any of the processing of the application response procedure described above.
In some possible implementations, a computing device according to the application may include at least one processor, and at least one memory. Wherein the memory stores program code that, when executed by the processor, causes the processor to perform the steps of the processing of the application response procedure according to the various exemplary embodiments of the application described hereinabove in this specification. For example, the processor may perform the steps as shown in fig. 3A.
A computing device 800 according to such an embodiment of the application is described below with reference to fig. 8. As shown in fig. 8, computing device 800 is in the form of a general purpose computing device. Components of computing device 800 may include, but are not limited to: the at least one processing unit 801, the at least one memory unit 802, and a bus 803 connecting the different system components (including the memory unit 802 and the processing unit 801).
Bus 803 represents one or more of several types of bus structures, including a memory bus or memory controller, a peripheral bus, a processor, and a local bus using any of a variety of bus architectures.
The storage unit 802 may include readable media in the form of volatile memory, such as Random Access Memory (RAM) 8021 and/or cache memory 8022, and may further include Read Only Memory (ROM) 8023.
The storage unit 802 may also include a program/utility 8025 having a set (at least one) of program modules 8024, such program modules 8024 including, but not limited to: an operating system, one or more application programs, other program modules, and program data, each or some combination of which may include an implementation of a network environment.
The computing device 800 may also communicate with one or more external devices 804 (e.g., keyboard, pointing device, etc.), one or more devices that enable objects to interact with the computing device 800, and/or any devices (e.g., routers, modems, etc.) that enable the computing device 800 to communicate with one or more other computing devices. Such communication may occur through an input/output (I/O) interface 805. Moreover, computing device 800 may also communicate with one or more networks such as a Local Area Network (LAN), a Wide Area Network (WAN) and/or a public network, such as the Internet, through network adapter 806. As shown, network adapter 806 communicates with other modules for computing device 800 over bus 803. It should be appreciated that although not shown, other hardware and/or software modules may be used in connection with computing device 800, including but not limited to: microcode, device drivers, redundant processors, external disk drive arrays, RAID systems, tape drives, data backup storage systems, and the like.
Various aspects of the processing of the application response procedure provided by the present application, which are based on the same inventive concept as the above-described method embodiments, may also be implemented in the form of a program product comprising program code for causing an electronic device to perform the steps in the processing method of the application response procedure according to the various exemplary embodiments of the application described in this specification, when the program product is run on an electronic device, e.g. the electronic device may perform the steps as in fig. 3A.
The program product may employ any combination of one or more readable media. The readable medium may be a readable signal medium or a readable storage medium. The readable storage medium can be, for example, but is not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or a combination of any of the foregoing. More specific examples (a non-exhaustive list) of the readable storage medium would include the following: an electrical connection having one or more wires, a portable disk, a hard disk, random Access Memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM or flash memory), optical fiber, portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.
While preferred embodiments of the present application have been described, additional variations and modifications in those embodiments may occur to those skilled in the art once they learn of the basic inventive concepts. It is therefore intended that the following claims be interpreted as including the preferred embodiments and all such alterations and modifications as fall within the scope of the application.
It will be apparent to those skilled in the art that various modifications and variations can be made to the present application without departing from the spirit or scope of the application. Thus, it is intended that the present application also include such modifications and alterations insofar as they come within the scope of the appended claims or the equivalents thereof.

Claims (15)

1. A method of processing an application response procedure, comprising:
acquiring each process event associated with a target object in an application response process of the target application, wherein each process event is: triggering events of the target object or response events of the target application, wherein each process event is associated with a time stamp;
determining the duration of the application response process according to each time stamp, and dividing the duration into a plurality of time intervals according to the number of the set intervals; each time interval corresponds to a time stamp range;
Respectively determining a process event set associated with each of the time intervals according to each time stamp and the time stamp ranges, and respectively obtaining importance indexes corresponding to each process event set based on importance factors configured for each process event in advance;
and generating a response video aiming at the application response process, configuring a progress time axis corresponding to the response video based on the duration, and respectively presenting corresponding importance indexes corresponding to each associated process event set of the time intervals on the progress time axis.
2. The method of claim 1, wherein presenting, on the schedule timeline, respective importance indicators corresponding to respective associated process event sets of the plurality of time intervals, respectively, comprises:
respectively determining target time points for presenting corresponding importance indexes in a plurality of corresponding time intervals on the progress time axis, wherein the corresponding process event sets are respectively associated with the time intervals;
and displaying importance indexes corresponding to the target time points on the progress time axis in an area line graph mode.
3. The method as recited in claim 2, further comprising:
generating a corresponding process playback tag based on an application response process of the current target application to the target object;
and responding to the triggering indication of the process playback label, playing the response video, displaying the playing progress on a progress time axis corresponding to the response video, and displaying an area line graph for identifying the change condition of the importance index in a plurality of time intervals on the progress time axis.
4. A method as recited in claim 3, further comprising:
and responding to the play position adjustment operation triggered by the progress time axis, determining an adjusted play time point, and continuing to play the response video from the position corresponding to the play time point in the response video.
5. The method of claim 1, wherein the generating a response video for the application response process comprises:
respectively acquiring page display information associated with each process event in the application response process;
privacy processing is carried out on text content and picture content contained in the page display information to obtain processed page display information, a plurality of corresponding response video frames are generated according to the processed page display information, and response videos are obtained based on the response video frames.
6. The method of claim 1, wherein the determining the respective associated set of process events for the plurality of time intervals based on the respective time stamps and the plurality of time stamp ranges, respectively, comprises:
respectively determining the time stamp ranges to which the time stamps belong according to the time stamps and the time stamp ranges to obtain event time stamp sets respectively associated with the time intervals corresponding to the time stamp ranges, and obtaining a plurality of process event sets corresponding to the event time stamp sets;
and respectively determining the corresponding process event sets of the event timestamp sets as the associated process event sets of the corresponding time intervals.
7. The method of claim 1, wherein the obtaining, based on importance factors configured for each process event in advance, respective importance indexes corresponding to each process event set includes:
for each set of process events, the following operations are performed separately:
determining each process event contained in the process event set, and respectively determining the importance degree factors corresponding to each process event in the process event set according to the importance degree factors configured for each process event in advance;
And carrying out weighted superposition processing on importance factors corresponding to each process event in the process event set to obtain importance indexes corresponding to the process event set.
8. The method according to any one of claims 1-7, wherein determining the duration of the application response procedure according to each timestamp and dividing the duration into a plurality of time intervals according to a set number of intervals comprises:
determining the duration of the application response process based on the time stamp corresponding to the earliest occurrence time and the latest occurrence time respectively in each time stamp, dividing the duration into a plurality of time intervals according to the number of the set intervals, and determining the sub-duration corresponding to each time interval;
and respectively determining the timestamp range corresponding to each of the time intervals based on the timestamp corresponding to the earliest occurrence time and the sub-duration corresponding to each of the time intervals.
9. The method of any of claims 1-7, wherein the acquiring, during an application response of the target application, prior to each process event associated with the target object, further comprises:
And sending a collection authorization request to the target object, and receiving an authorization permission indication triggered by the target object, wherein the collection authorization request is used for requesting permission of a target application to collect all process events associated with the target object in an application response process.
10. The method of any of claims 1-7, wherein the configuring the progress timeline corresponding to the response video based on the duration comprises:
configuring a corresponding progress time axis for the response video;
the duration is configured to be the total video duration corresponding to the progress time axis, the corresponding relation of the time intervals on the progress time axis is respectively established, and the association relation between each response video frame in the response video and each time point on the progress time axis is respectively established.
11. A processing apparatus for applying a response procedure, comprising:
the acquiring unit is used for acquiring each process event associated with the target object in the application response process of the target application, wherein each process event is as follows: triggering events of the target object or response events of the target application, wherein each process event is associated with a time stamp;
The dividing unit is used for determining the duration of the application response process according to each time stamp and dividing the duration into a plurality of time intervals according to the number of the set intervals; each time interval corresponds to a time stamp range;
the determining unit is used for respectively determining the process event sets respectively associated with the time intervals according to the time stamps and the time stamp ranges and respectively obtaining importance indexes corresponding to the process event sets based on importance factors configured for various process events in advance;
the generating unit is used for generating a response video aiming at the application response process, configuring a progress time axis corresponding to the response video based on the duration time, and respectively presenting corresponding importance indexes corresponding to the process event sets respectively associated with the time intervals on the progress time axis.
12. The apparatus of claim 11, wherein, on the progress time axis, the generating unit is configured to, when presenting the respective importance indexes corresponding to the respective process event sets associated with the plurality of time intervals, respectively:
respectively determining target time points for presenting corresponding importance indexes in a plurality of corresponding time intervals on the progress time axis, wherein the corresponding process event sets are respectively associated with the time intervals; and presenting important program indexes corresponding to each of the target time points on the progress time axis in an area line graph mode.
13. An electronic device comprising a memory, a processor and a computer program stored on the memory and executable on the processor, wherein the processor implements the method of any of claims 1-10 when the program is executed by the processor.
14. A computer-readable storage medium having stored thereon a computer program, characterized by: the computer program implementing the method according to any of claims 1-10 when executed by a processor.
15. A computer program product comprising a computer program which, when executed by a processor, implements the method according to any one of claims 1-10.
CN202310145036.8A 2023-01-30 2023-01-30 Processing method and device of application response process, electronic equipment and storage medium Pending CN116974866A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202310145036.8A CN116974866A (en) 2023-01-30 2023-01-30 Processing method and device of application response process, electronic equipment and storage medium

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202310145036.8A CN116974866A (en) 2023-01-30 2023-01-30 Processing method and device of application response process, electronic equipment and storage medium

Publications (1)

Publication Number Publication Date
CN116974866A true CN116974866A (en) 2023-10-31

Family

ID=88475491

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202310145036.8A Pending CN116974866A (en) 2023-01-30 2023-01-30 Processing method and device of application response process, electronic equipment and storage medium

Country Status (1)

Country Link
CN (1) CN116974866A (en)

Similar Documents

Publication Publication Date Title
US11811805B1 (en) Detecting fraud by correlating user behavior biometrics with other data sources
US10965559B1 (en) Automatic creation of related event groups for an IT service monitoring system
US10129282B2 (en) Anomalous network monitoring, user behavior detection and database system
US10417108B2 (en) Portable control modules in a machine data driven service monitoring system
CN109844781B (en) System and method for identifying process flows from log files and visualizing the flows
US10162456B2 (en) Touch prediction for visual displays
US20170277582A1 (en) Identification of distinguishable anomalies extracted from real time data streams
US10460398B1 (en) Method and system for crowdsourcing the detection of usability issues in a tax return preparation system
US11372956B2 (en) Multiple input neural networks for detecting fraud
US20120144379A1 (en) System and method for updadting software
US8396964B2 (en) Computer application analysis
US11315010B2 (en) Neural networks for detecting fraud based on user behavior biometrics
US20180300572A1 (en) Fraud detection based on user behavior biometrics
CN112817817A (en) Buried point information query method and device, computer equipment and storage medium
CN112416700A (en) Analyzing initiated predictive failures and SMART logs
US11106758B2 (en) Customized display of filtered social media content using a private dislike button
US11710313B2 (en) Generating event logs from video streams
US11704362B2 (en) Assigning case identifiers to video streams
CN116974866A (en) Processing method and device of application response process, electronic equipment and storage medium
US20210021898A1 (en) Rating and an overall viewership value determined based on user engagement
CN113610535A (en) Risk monitoring method and device suitable for consumption staging business process
US20230394030A1 (en) Generating event logs from video streams
US20200257825A1 (en) Customized display of filtered social media content using a private dislike button
US10748203B2 (en) Serving related content via a content sharing service
de Santana et al. Insights on User Actions from Log-based Graph Topology

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication